Export fails with dgraph:v20.07.0

Issues Dgraph
1

Hi,

I am using dgraph/dgraph:v20.07.0 with docker-compose on macOS 10.15.6 (19G73).

When I export my database with ~5000 nodes it works fine, but when I try with my bigger database (1.5M nodes) export stops/fails and I don’t get the expected {"code": "Success", "message": "Export completed."} result.

This is my docker-compose.yaml:

version: "3.7"
services:
  zero:
    image: dgraph/dgraph:v20.07.0
    container_name: "zero"
    volumes:
      - './processed_jsons:/dgraph/processed_jsons'
      - './backups:/dgraph/backups'
      - './.dgraph:/dgraph'
    ports:
      - 5080:5080
      - 6080:6080
    restart: on-failure
    command: dgraph zero --my=zero:5080
  alpha:
    image: dgraph/dgraph:v20.07.0
    depends_on:
      - zero
    container_name: "alpha"
    ports:
      - 8080:8080
      - 7080:7080
      - 9080:9080
    tty: true
    restart: on-failure
    command: dgraph alpha --my=alpha:7080 --lru_mb=2048 --zero=zero:5080 --abort_older_than=10m --whitelist=host.docker.internal,localhost,192.168.0.0/16,172.24.0.0/16
    volumes:
      - './.dgraph:/dgraph'
  ratel:
    image: dgraph/dgraph:v20.07.0
    container_name: "ratel"
    ports:
      - 8000:8000
    command: dgraph-ratel

I start export using:

curl localhost:8080/admin/export

In the logs it seems that export is starting and then alpha restarts or something:

alpha    | I0803 09:17:20.643259      15 export.go:36] Got export request through GraphQL admin API
alpha    | I0803 09:17:20.645733      15 export.go:718] Got readonly ts from Zero: 1080002
alpha    | I0803 09:17:20.645981      15 export.go:722] Requesting export for groups: [1]
alpha    | I0803 09:17:20.647088      15 export.go:394] Export requested at 1080002.
alpha    | I0803 09:17:20.648665      15 export.go:400] Running export for group 1 at timestamp 1080002.
alpha    | I0803 09:17:20.651141      15 export.go:421] Exporting data for group: 1 at /dgraph/export/dgraph.r1080002.u0803.0917/g01.rdf.gz
alpha    | I0803 09:17:20.653021      15 export.go:432] Exporting schema for group: 1 at /dgraph/export/dgraph.r1080002.u0803.0917/g01.schema.gz
alpha    | I0803 09:17:20.654795      15 export.go:443] Exporting GraphQL schema at /dgraph/export/dgraph.r1080002.u0803.0917/g01.gql_schema.gz
alpha    | I0803 09:17:21.657349      15 log.go:34] Export Time elapsed: 01s, bytes sent: 0 B, speed: 0 B/sec
alpha    | I0803 09:17:24.165224      15 log.go:34] Export Created batch of size: 4.4 MB in 1.7408s.
alpha    | I0803 09:17:31.451519      15 log.go:34] Export Created batch of size: 14 MB in 6.9362963s.

... a little pause ...

alpha    | I0803 09:18:12.347487      15 log.go:34] Export Created batch of size: 109 MB in 35.1637043s.
alpha    | I0803 09:18:15.181213       1 sentry_integration.go:48] This instance of Dgraph will send anonymous reports of panics back to Dgraph Labs via Sentry. No confidential information is sent. These reports help improve Dgraph. To opt-out, restart your instance with the --enable_sentry=false flag. For more info, see https://dgraph.io/docs/howto/#data-handling.
alpha    | I0803 09:18:15.244990       1 util_ee.go:126] KeyReader instantiated of type <nil>
alpha    | I0803 09:18:15.416695       1 init.go:102] 
alpha    | 
alpha    | Dgraph version   : v20.07.0
alpha    | Dgraph codename  : shuri
alpha    | Dgraph SHA-256   : 4cd320fc6eab163ab68602a5122a6c82c8467c2ed5ac93478d5f40d44eec71c4
alpha    | Commit SHA-1     : d65e20530
alpha    | Commit timestamp : 2020-07-28 15:31:37 -0700
alpha    | Branch           : HEAD
alpha    | Go version       : go1.14.4
alpha    | 
alpha    | For Dgraph official documentation, visit https://dgraph.io/docs/.
alpha    | For discussions about Dgraph     , visit http://discuss.hypermode.com.
alpha    | To say hi to the community       , visit https://dgraph.slack.com.
alpha    | 
alpha    | Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
alpha    | Copyright 2015-2020 Dgraph Labs, Inc.
alpha    | 
alpha    | 
alpha    | I0803 09:18:15.416759       1 run.go:654] x.Config: {PortOffset:0 QueryEdgeLimit:1000000 NormalizeNodeLimit:10000 PollInterval:1s GraphqlExtension:true}
alpha    | I0803 09:18:15.417100       1 run.go:655] x.WorkerConfig: {ExportPath:export NumPendingProposals:256 Tracing:0.01 MyAddr:alpha:7080 ZeroAddr:[zero:5080] RaftId:0 WhiteListedIPRanges:[{Lower:192.168.65.2 Upper:192.168.65.2} {Lower:127.0.0.1 Upper:127.0.0.1} {Lower:::1 Upper:::1} {Lower:192.168.0.0 Upper:192.168.255.255} {Lower:172.24.0.0 Upper:172.24.255.255}] MaxRetries:-1 StrictMutations:false AclEnabled:false AbortOlderThan:10m0s SnapshotAfter:10000 ProposedGroupId:0 StartTime:2020-08-03 09:17:08.2948424 +0000 UTC m=+0.052241701 LudicrousMode:false EncryptionKey:**** LogRequest:0}
alpha    | I0803 09:18:15.417796       1 run.go:656] worker.Config: {PostingDir:p BadgerTables:mmap BadgerVlog:mmap BadgerCompressionLevel:3 WALDir:w MutationsMode:0 AuthToken: AllottedMemory:2048 HmacSecret:**** AccessJwtTtl:0s RefreshJwtTtl:0s AclRefreshInterval:0s}
alpha    | I0803 09:18:15.420820       1 server_state.go:78] Setting Badger Compression Level: 3
alpha    | I0803 09:18:15.420870       1 server_state.go:87] Setting Badger table load option: mmap
alpha    | I0803 09:18:15.420891       1 server_state.go:99] Setting Badger value log load option: mmap
alpha    | I0803 09:18:15.421282       1 server_state.go:144] Opening write-ahead log BadgerDB with options: {Dir:w ValueDir:w SyncWrites:false TableLoadingMode:1 ValueLogLoadingMode:2 NumVersionsToKeep:1 ReadOnly:false Truncate:true Logger:0x2bcf318 Compression:2 InMemory:false MaxTableSize:67108864 LevelSizeMultiplier:10 MaxLevels:7 ValueThreshold:1048576 NumMemtables:5 BlockSize:4096 BloomFalsePositive:0.01 KeepL0InMemory:false MaxCacheSize:10485760 MaxBfCacheSize:0 LoadBloomsOnOpen:false NumLevelZeroTables:5 NumLevelZeroTablesStall:10 LevelOneSize:268435456 ValueLogFileSize:1073741823 ValueLogMaxEntries:10000 NumCompactors:2 CompactL0OnClose:true LogRotatesToFlush:2 ZSTDCompressionLevel:3 VerifyValueChecksum:false EncryptionKey:[] EncryptionKeyRotationDuration:240h0m0s BypassLockGuard:false ChecksumVerificationMode:0 DetectConflicts:false KeepBlockIndicesInCache:false KeepBlocksInCache:false managedTxns:false maxBatchCount:0 maxBatchSize:0}
alpha    | I0803 09:18:15.500713       1 log.go:34] All 3 tables opened in 21ms
alpha    | I0803 09:18:15.514741       1 log.go:34] Replaying file id: 697 at offset: 2425409
alpha    | I0803 09:18:15.538000       1 log.go:34] Replay took: 23.2033ms
alpha    | I0803 09:18:15.541687       1 log.go:34] Replaying file id: 698 at offset: 0
alpha    | I0803 09:18:15.558402       1 log.go:34] Replay took: 16.6541ms
alpha    | I0803 09:18:15.560833       1 log.go:34] Replaying file id: 699 at offset: 0
alpha    | I0803 09:18:15.575783       1 log.go:34] Replay took: 14.8694ms
alpha    | I0803 09:18:15.578400       1 log.go:34] Replaying file id: 700 at offset: 0
alpha    | I0803 09:18:15.580991       1 log.go:34] Replay took: 2.4903ms
alpha    | I0803 09:18:15.583538       1 server_state.go:78] Setting Badger Compression Level: 3
alpha    | I0803 09:18:15.583588       1 server_state.go:87] Setting Badger table load option: mmap
alpha    | I0803 09:18:15.583636       1 server_state.go:99] Setting Badger value log load option: mmap
alpha    | I0803 09:18:15.583705       1 server_state.go:168] Opening postings BadgerDB with options: {Dir:p ValueDir:p SyncWrites:false TableLoadingMode:2 ValueLogLoadingMode:2 NumVersionsToKeep:2147483647 ReadOnly:false Truncate:true Logger:0x2bcf318 Compression:2 InMemory:false MaxTableSize:67108864 LevelSizeMultiplier:10 MaxLevels:7 ValueThreshold:1024 NumMemtables:5 BlockSize:4096 BloomFalsePositive:0.01 KeepL0InMemory:false MaxCacheSize:1073741824 MaxBfCacheSize:524288000 LoadBloomsOnOpen:false NumLevelZeroTables:5 NumLevelZeroTablesStall:10 LevelOneSize:268435456 ValueLogFileSize:1073741823 ValueLogMaxEntries:1000000 NumCompactors:2 CompactL0OnClose:true LogRotatesToFlush:2 ZSTDCompressionLevel:3 VerifyValueChecksum:false EncryptionKey:[] EncryptionKeyRotationDuration:240h0m0s BypassLockGuard:false ChecksumVerificationMode:0 DetectConflicts:false KeepBlockIndicesInCache:true KeepBlocksInCache:true managedTxns:false maxBatchCount:0 maxBatchSize:0}
alpha    | I0803 09:18:16.612174       1 log.go:34] All 66 tables opened in 878ms
alpha    | I0803 09:18:16.701081       1 log.go:34] Replaying file id: 89 at offset: 93054720
alpha    | I0803 09:18:16.749556       1 log.go:34] Replay took: 48.379ms
alpha    | I0803 09:18:16.782411       1 groups.go:107] Current Raft Id: 0x1
alpha    | I0803 09:18:16.783214       1 worker.go:97] Worker listening at address: [::]:7080
alpha    | I0803 09:18:16.784751       1 run.go:524] Bringing up GraphQL HTTP API at 0.0.0.0:8080/graphql
alpha    | I0803 09:18:16.784950       1 run.go:525] Bringing up GraphQL HTTP admin API at 0.0.0.0:8080/admin
alpha    | I0803 09:18:16.785137       1 run.go:557] gRPC server started.  Listening on port 9080
alpha    | I0803 09:18:16.785845       1 run.go:558] HTTP server started.  Listening on port 8080
alpha    | I0803 09:18:16.883656       1 pool.go:160] CONNECTING to zero:5080
zero     | I0803 09:18:16.890388      14 zero.go:422] Got connection request: cluster_info_only:true 
zero     | I0803 09:18:16.891513      14 zero.go:440] Connected: cluster_info_only:true 
zero     | I0803 09:18:16.898180      14 zero.go:422] Got connection request: id:1 addr:"alpha:7080" 
zero     | I0803 09:18:16.899322      14 zero.go:553] Connected: id:1 addr:"alpha:7080" 
alpha    | I0803 09:18:16.900493       1 groups.go:135] Connected to group zero. Assigned group: 0
alpha    | I0803 09:18:16.900542       1 groups.go:137] Raft Id after connection to Zero: 0x1
alpha    | I0803 09:18:16.901340       1 draft.go:210] Node ID: 0x1 with GroupID: 1
alpha    | I0803 09:18:16.901385       1 pool.go:160] CONNECTING to alpha:7080
alpha    | I0803 09:18:16.902159       1 node.go:148] Setting raft.Config to: &{ID:1 peers:[] learners:[] ElectionTick:20 HeartbeatTick:1 Storage:0xc04ff8eb40 Applied:2063748 MaxSizePerMsg:262144 MaxCommittedSizePerReady:67108864 MaxUncommittedEntriesSize:0 MaxInflightMsgs:256 CheckQuorum:false PreVote:true ReadOnlyOption:0 Logger:0x2bcf318 DisableProposalForwarding:false}
alpha    | W0803 09:18:16.911326       1 pool.go:254] Connection lost with alpha:7080. Error: rpc error: code = Unknown desc = No node has been set up yet
alpha    | I0803 09:18:16.911452       1 node.go:306] Found Snapshot.Metadata: {ConfState:{Nodes:[1] Learners:[] XXX_unrecognized:[]} Index:2063748 Term:33 XXX_unrecognized:[]}
alpha    | I0803 09:18:16.912338       1 node.go:317] Found hardstate: {Term:41 Vote:1 Commit:2069914 XXX_unrecognized:[]}
alpha    | I0803 09:18:16.914779       1 node.go:326] Group 1 found 6166 entries
alpha    | I0803 09:18:16.914915       1 draft.go:1609] Restarting node for group: 1
alpha    | I0803 09:18:16.915560       1 node.go:185] Setting conf state to nodes:1 
alpha    | I0803 09:18:16.917393       1 log.go:34] 1 became follower at term 41
alpha    | I0803 09:18:16.918814       1 log.go:34] newRaft 1 [peers: [1], term: 41, commit: 2069914, applied: 2063748, lastindex: 2069914, lastterm: 41]
alpha    | I0803 09:18:16.918911       1 draft.go:160] Operation started with id: opRollup
alpha    | I0803 09:18:16.918961       1 groups.go:155] Server is ready
alpha    | I0803 09:18:16.919593       1 groups.go:790] Got address of a Zero leader: zero:5080
alpha    | I0803 09:18:16.919611       1 draft.go:1009] Found Raft progress: 2069914
alpha    | I0803 09:18:16.920550       1 groups.go:804] Starting a new membership stream receive from zero:5080.
alpha    | I0803 09:18:16.922904       1 groups.go:821] Received first state update from Zero: counter:515661 groups:<key:1 value:<members:<key:1 value:<id:1 group_id:1 addr:"alpha:7080" leader:true last_update:1596446233 > > tablets:<key:"ageQualification" value:<group_id:1 predicate:"ageQualification" > > tablets:<key:"altForm" value:<group_id:1 predicate:"altForm" > > tablets:<key:"altFormOfNeoId" value:<group_id:1 predicate:"altFormOfNeoId" > > tablets:<key:"altFormOfOid" value:<group_id:1 predicate:"altFormOfOid" > > tablets:<key:"altGenericForm" value:<group_id:1 predicate:"altGenericForm" > > tablets:<key:"alternateForm" value:<group_id:1 predicate:"alternateForm" > > tablets:<key:"child" value:<group_id:1 predicate:"child" > > tablets:<key:"childOrder" value:<group_id:1 predicate:"childOrder" > > tablets:<key:"comment" value:<group_id:1 predicate:"comment" > > tablets:<key:"content" value:<group_id:1 predicate:"content" space:52176092770 > > tablets:<key:"contentu" value:<group_id:1 predicate:"contentu" space:7294736292 > > tablets:<key:"counters" value:<group_id:1 predicate:"counters" > > tablets:<key:"definition" value:<group_id:1 predicate:"definition" > > tablets:<key:"deleteDate" value:<group_id:1 predicate:"deleteDate" > > tablets:<key:"deleted" value:<group_id:1 predicate:"deleted" space:57916644 > > tablets:<key:"dentry" value:<group_id:1 predicate:"dentry" > > tablets:<key:"description" value:<group_id:1 predicate:"description" > > tablets:<key:"descriptionShort" value:<group_id:1 predicate:"descriptionShort" > > tablets:<key:"dgraph.graphql.schema" value:<group_id:1 predicate:"dgraph.graphql.schema" > > tablets:<key:"dgraph.graphql.xid" value:<group_id:1 predicate:"dgraph.graphql.xid" > > tablets:<key:"dgraph.type" value:<group_id:1 predicate:"dgraph.type" space:1096053845 > > tablets:<key:"dict" value:<group_id:1 predicate:"dict" > > tablets:<key:"dictRef" value:<group_id:1 predicate:"dictRef" space:58390020 > > tablets:<key:"dummy" value:<group_id:1 predicate:"dummy" > > tablets:<key:"entryDict" value:<group_id:1 predicate:"entryDict" > > tablets:<key:"etymologyQualification" value:<group_id:1 predicate:"etymologyQualification" > > tablets:<key:"example" value:<group_id:1 predicate:"example" > > tablets:<key:"explanation" value:<group_id:1 predicate:"explanation" > > tablets:<key:"expression" value:<group_id:1 predicate:"expression" > > tablets:<key:"fromLanguage" value:<group_id:1 predicate:"fromLanguage" > > tablets:<key:"gender" value:<group_id:1 predicate:"gender" > > tablets:<key:"geoQualification" value:<group_id:1 predicate:"geoQualification" > > tablets:<key:"grammaticalPostfix" value:<group_id:1 predicate:"grammaticalPostfix" > > tablets:<key:"grammaticalQualification" value:<group_id:1 predicate:"grammaticalQualification" > > tablets:<key:"inAkad" value:<group_id:1 predicate:"inAkad" > > tablets:<key:"inDentry" value:<group_id:1 predicate:"inDentry" > > tablets:<key:"inDict" value:<group_id:1 predicate:"inDict" > > tablets:<key:"inHunglish" value:<group_id:1 predicate:"inHunglish" > > tablets:<key:"inLanguage" value:<group_id:1 predicate:"inLanguage" > > tablets:<key:"indexWord" value:<group_id:1 predicate:"indexWord" > > tablets:<key:"indexedInDict" value:<group_id:1 predicate:"indexedInDict" > > tablets:<key:"indexedInDicts" value:<group_id:1 predicate:"indexedInDicts" > > tablets:<key:"ipaPronunciation" value:<group_id:1 predicate:"ipaPronunciation" > > tablets:<key:"ipaPronunciationUK" value:<group_id:1 predicate:"ipaPronunciationUK" > > tablets:<key:"ipaPronunciationUSA" value:<group_id:1 predicate:"ipaPronunciationUSA" > > tablets:<key:"ixwRef" value:<group_id:1 predicate:"ixwRef" space:60664699 > > tablets:<key:"label" value:<group_id:1 predicate:"label" > > tablets:<key:"language" value:<group_id:1 predicate:"language" space:65793 > > tablets:<key:"lastChangeTime" value:<group_id:1 predicate:"lastChangeTime" > > tablets:<key:"levelIndexStyle" value:<group_id:1 predicate:"levelIndexStyle" > > tablets:<key:"meaning" value:<group_id:1 predicate:"meaning" > > tablets:<key:"missingRequiredConnections" value:<group_id:1 predicate:"missingRequiredConnections" > > tablets:<key:"name" value:<group_id:1 predicate:"name" > > tablets:<key:"oid" value:<group_id:1 predicate:"oid" space:57254645 > > tablets:<key:"oldSourceId" value:<group_id:1 predicate:"oldSourceId" > > tablets:<key:"order" value:<group_id:1 predicate:"order" > > tablets:<key:"orderPos" value:<group_id:1 predicate:"orderPos" > > tablets:<key:"origLang" value:<group_id:1 predicate:"origLang" > > tablets:<key:"parent" value:<group_id:1 predicate:"parent" > > tablets:<key:"pos" value:<group_id:1 predicate:"pos" > > tablets:<key:"pron" value:<group_id:1 predicate:"pron" > > tablets:<key:"root" value:<group_id:1 predicate:"root" > > tablets:<key:"sampaPronunciationUK" value:<group_id:1 predicate:"sampaPronunciationUK" > > tablets:<key:"sampaPronunciationUSA" value:<group_id:1 predicate:"sampaPronunciationUSA" > > tablets:<key:"selectable" value:<group_id:1 predicate:"selectable" > > tablets:<key:"shortName" value:<group_id:1 predicate:"shortName" > > tablets:<key:"source" value:<group_id:1 predicate:"source" > > tablets:<key:"sourceId" value:<group_id:1 predicate:"sourceId" > > tablets:<key:"sourceUrl" value:<group_id:1 predicate:"sourceUrl" > > tablets:<key:"stylisticQualification" value:<group_id:1 predicate:"stylisticQualification" > > tablets:<key:"subMeaning" value:<group_id:1 predicate:"subMeaning" > > tablets:<key:"subPos" value:<group_id:1 predicate:"subPos" > > tablets:<key:"sztakiOwn" value:<group_id:1 predicate:"sztakiOwn" > > tablets:<key:"thematicQualification" value:<group_id:1 predicate:"thematicQualification" > > tablets:<key:"thesaurus" value:<group_id:1 predicate:"thesaurus" > > tablets:<key:"toLanguage" value:<group_id:1 predicate:"toLanguage" > > tablets:<key:"translation" value:<group_id:1 predicate:"translation" > > tablets:<key:"translationExcerpt" value:<group_id:1 predicate:"translationExcerpt" > > tablets:<key:"translationShort" value:<group_id:1 predicate:"translationShort" > > tablets:<key:"usedBy" value:<group_id:1 predicate:"usedBy" > > tablets:<key:"value" value:<group_id:1 predicate:"value" > > snapshot_ts:1037973 checksum:1462596971915307763 > > zeros:<key:1 value:<id:1 addr:"zero:5080" leader:true > > maxLeaseId:4910000 maxTxnTs:1090000 maxRaftId:1 cid:"fc5ecd18-a02f-4c5d-a72d-e4ff349e044f" license:<maxNodes:18446744073709551615 expiryTs:1598783920 enabled:true > 
alpha    | I0803 09:18:19.021691       1 log.go:34] 1 is starting a new election at term 41
alpha    | I0803 09:18:19.021750       1 log.go:34] 1 became pre-candidate at term 41
alpha    | I0803 09:18:19.021772       1 log.go:34] 1 received MsgPreVoteResp from 1 at term 41
alpha    | I0803 09:18:19.022255       1 log.go:34] 1 became candidate at term 42
alpha    | I0803 09:18:19.022297       1 log.go:34] 1 received MsgVoteResp from 1 at term 42
alpha    | I0803 09:18:19.023493       1 log.go:34] 1 became leader at term 42
alpha    | I0803 09:18:19.023851       1 log.go:34] raft.node: 1 elected leader 1 at term 42
alpha    | I0803 09:18:19.919818       1 groups.go:873] Leader idx=0x1 of group=1 is connecting to Zero for txn updates
alpha    | I0803 09:18:19.919886       1 groups.go:882] Got Zero leader: zero:5080
alpha    | I0803 09:18:21.791467       1 admin.go:605] No GraphQL schema in Dgraph; serving empty GraphQL API

Am I doing something wrong here?

1 Like
2

I now tried with v20.03.4 and the result is the same: export seems to start, then alpha restarts and get

curl: (52) Empty reply from server

Also tried initiating export like this, but the it doesn’t work either:

curl 'http://localhost:8080/admin' -H 'content-type: application/json' --data-binary '{"query":"mutation {\n  export(input: {format: \"rdf\"}) {\n    response {\n      message\n      code\n    }\n  }\n}","variables":null}'
3

This seems like a bug where panic is being trigerred. Is it possible to share a minimal example along with the dataset that causes this?

9

Hey @beepsoft,

I’ve downloaded your database files, but the export on my system is succeeding. I used the same docker-compose file, slightly modified to run on Linux (host.docker.internal does not work on Linux):

version: "3.7"
services:
  zero:
    image: dgraph/dgraph:v20.07.0
    container_name: "zero"
    volumes:
      - './processed_jsons:/dgraph/processed_jsons'
      - './backups:/dgraph/backups'
      - './.dgraph:/dgraph'
    ports:
      - 5080:5080
      - 6080:6080
    restart: on-failure
    command: dgraph zero --my=zero:5080
  alpha:
    image: dgraph/dgraph:v20.07.0
    depends_on:
      - zero
    container_name: "alpha"
    ports:
      - 8080:8080
      - 7080:7080
      - 9080:9080
    tty: true
    restart: on-failure
    command: dgraph alpha --my=alpha:7080 --lru_mb=2048 --zero=zero:5080 --abort_older_than=10m --whitelist=localhost,192.168.0.0/16,172.0.0.0/8
    volumes:
      - './.dgraph:/dgraph'
  ratel:
    image: dgraph/dgraph:v20.07.0
    container_name: "ratel"
    ports:
      - 8000:8000
    command: dgraph-ratel

I ran both the curl commands you mentioned, but in both cases the export succeeds:

{"code": "Success", "message": "Export completed."}

and

{"data":{"export":{"response":{"message":"Export completed.","code":"Success"}}},"extensions":{"tracing":{"version":1,"startTime":"2020-08-12T14:05:42.298656775Z","endTime":"2020-08-12T14:08:34.741163827Z","duration":172442507052}}}

I also checked the export folder, and the backups seem to be created as expected:

$ ls -Rlh

.:
total 0
drwx------ 2 root root 100 Aug 12 19:30 dgraph.r1040002.u0812.1400
drwx------ 2 root root 100 Aug 12 19:35 dgraph.r1040002.u0812.1405

./dgraph.r1040002.u0812.1400:
total 139M
-rw-r--r-- 1 root root   28 Aug 12 19:33 g01.gql_schema.gz
-rw-r--r-- 1 root root 139M Aug 12 19:33 g01.rdf.gz
-rw-r--r-- 1 root root  681 Aug 12 19:33 g01.schema.gz

./dgraph.r1040002.u0812.1405:
total 139M
-rw-r--r-- 1 root root   28 Aug 12 19:38 g01.gql_schema.gz
-rw-r--r-- 1 root root 139M Aug 12 19:38 g01.rdf.gz
-rw-r--r-- 1 root root  681 Aug 12 19:38 g01.schema.gz

I ran it thrice, each time deleting and re-extracting the database files, but I’m unable to reproduce the issue.

11

Update: while the export succeeded on Linux without any problems, it does seem to fail on a MacBook. Will look into this and update you.

12

Thanks for the update! Hope you can figure out what goes wrong on macOS.

15

Hey @beepsoft,

It turns out the issue you’re facing is specific to just Docker on macOS. Our team is investigating the issue, but in the meantime, you may want to look into some alternatives:

  • Download and install Dgraph for macOS and use it without containerization.

  • Use Docker Toolbox instead of Docker Desktop. Toolbox uses docker-machine under the hood, which will run the container inside a Linux VM, so it does not face the issue you mentioned. I’ve tried this out and it works, although it requires a few changes:

Hope this helps!

1 Like
16

Adding further if you still would like to try some further options with Docker-Desktop.

  • Docker Desktop has a very low memory default setting, so increasing this might work as well.
  • You can also try this out directly under Linux-to-Linux within the HyperKit VM, e.g.
    screen ~/Library/Containers/com.docker.docker/Data/vms/0/tty
    Note: The tty path may have moved as it gets to changed often. I got the command from here.

The Docker Machine env is very reliable, but different experience (as docker is no longer on localhost, but a different IP address). Virtualbox is both love and hated (but free). It has a decent graphical panel with some richer set of command-line options as well. HyperKit/VPNKit that is used by Docker-Desktop do not afford many options to access underlying layers.

17

Thank you all, I will try these!