Sorry, I just noticed that although the node is started normally, but the service is not available, can you help me see it again?
[Sentry] 2021/03/19 05:54:02 Integration installed: ContextifyFrames
[Sentry] 2021/03/19 05:54:02 Integration installed: Environment
[Sentry] 2021/03/19 05:54:02 Integration installed: Modules
[Sentry] 2021/03/19 05:54:02 Integration installed: IgnoreErrors
[Decoder]: Using assembly version of decoder
Page Size: 4096
[Sentry] 2021/03/19 05:54:02 Integration installed: ContextifyFrames
[Sentry] 2021/03/19 05:54:02 Integration installed: Environment
[Sentry] 2021/03/19 05:54:02 Integration installed: Modules
[Sentry] 2021/03/19 05:54:02 Integration installed: IgnoreErrors
I0319 05:54:03.086588 19 sentry_integration.go:48] This instance of Dgraph will send anonymous reports of panics back to Dgraph Labs via Sentry. No confidential information is sent. These reports help improve Dgraph. To opt-out, restart your instance with the --enable_sentry=false flag. For more info, see https://dgraph.io/docs/howto/#data-handling.
I0319 05:54:03.300010 19 init.go:107]
Dgraph version : v20.11.2
Dgraph codename : tchalla-2
Dgraph SHA-256 : 0153cb8d3941ad5ad107e395b347e8d930a0b4ead6f4524521f7a525a9699167
Commit SHA-1 : 94f3a0430
Commit timestamp : 2021-02-23 13:07:17 +0530
Branch : HEAD
Go version : go1.15.5
jemalloc enabled : true
For Dgraph official documentation, visit https://dgraph.io/docs/.
For discussions about Dgraph , visit http://discuss.hypermode.com.
Licensed variously under the Apache Public License 2.0 and Dgraph Community License.
Copyright 2015-2020 Dgraph Labs, Inc.
I0319 05:54:03.300045 19 run.go:696] x.Config: {PortOffset:0 QueryEdgeLimit:1000000 NormalizeNodeLimit:10000 MutationsNQuadLimit:1000000 PollInterval:1s GraphqlExtension:true GraphqlDebug:false GraphqlLambdaUrl:}
I0319 05:54:03.300082 19 run.go:697] x.WorkerConfig: {TmpDir:t ExportPath:export NumPendingProposals:256 Tracing:0.01 MyAddr:dgraph-alpha-2.dgraph-alpha.crm-test.svc.cluster.local:7080 ZeroAddr:[dgraph-zero-0.dgraph-zero.crm-test.svc.cluster.local:5080 dgraph-zero-1.dgraph-zero.crm-test.svc.cluster.local:5080 dgraph-zero-2.dgraph-zero.crm-test.svc.cluster.local:5080] TLSClientConfig:<nil> TLSServerConfig:<nil> RaftId:0 WhiteListedIPRanges:[] MaxRetries:-1 StrictMutations:false AclEnabled:false AbortOlderThan:5m0s SnapshotAfter:10000 ProposedGroupId:0 StartTime:2021-03-19 05:54:02.664257482 +0000 UTC m=+0.014777776 LudicrousMode:false LudicrousConcurrency:2000 EncryptionKey:**** LogRequest:0 HardSync:false}
I0319 05:54:03.300131 19 run.go:698] worker.Config: {PostingDir:p PostingDirCompression:1 PostingDirCompressionLevel:0 WALDir:w MutationsMode:0 AuthToken: PBlockCacheSize:697932185 PIndexCacheSize:375809638 WalCache:0 HmacSecret:**** AccessJwtTtl:0s RefreshJwtTtl:0s CachePercentage:0,65,35,0 CacheMb:0}
I0319 05:54:03.300288 19 log.go:295] Found file: 2 First Index: 0
I0319 05:54:03.301570 19 storage.go:132] Init Raft Storage with snap: 0, first: 1, last: 0
I0319 05:54:03.301592 19 server_state.go:76] Setting Posting Dir Compression Level: 0
I0319 05:54:03.301602 19 server_state.go:120] Opening postings BadgerDB with options: {Dir:p ValueDir:p SyncWrites:false NumVersionsToKeep:2147483647 ReadOnly:false Logger:0x2e0fef8 Compression:1 InMemory:false MemTableSize:67108864 BaseTableSize:2097152 BaseLevelSize:10485760 LevelSizeMultiplier:10 TableSizeMultiplier:2 MaxLevels:7 ValueThreshold:1024 NumMemtables:5 BlockSize:4096 BloomFalsePositive:0.01 BlockCacheSize:697932185 IndexCacheSize:375809638 NumLevelZeroTables:5 NumLevelZeroTablesStall:15 ValueLogFileSize:1073741823 ValueLogMaxEntries:1000000 NumCompactors:4 CompactL0OnClose:false ZSTDCompressionLevel:0 VerifyValueChecksum:false EncryptionKey:[] EncryptionKeyRotationDuration:240h0m0s BypassLockGuard:false ChecksumVerificationMode:0 DetectConflicts:false managedTxns:false maxBatchCount:0 maxBatchSize:0}
I0319 05:54:03.308202 19 log.go:34] All 0 tables opened in 0s
I0319 05:54:03.308555 19 log.go:34] Discard stats nextEmptySlot: 0
I0319 05:54:03.308579 19 log.go:34] Set nextTxnTs to 0
I0319 05:54:03.308680 19 log.go:34] Deleting empty file: p/000001.vlog
E0319 05:54:03.309366 19 groups.go:1143] Error during SubscribeForUpdates for prefix "\x00\x00\vdgraph.cors\x00": Unable to find any servers for group: 1. closer err: <nil>
I0319 05:54:03.309395 19 groups.go:99] Current Raft Id: 0x5
I0319 05:54:03.309469 19 worker.go:104] Worker listening at address: [::]:7080
I0319 05:54:03.310726 19 run.go:519] Bringing up GraphQL HTTP API at 0.0.0.0:8080/graphql
E0319 05:54:03.310723 19 groups.go:1143] Error during SubscribeForUpdates for prefix "\x00\x00\x15dgraph.graphql.schema\x00": Unable to find any servers for group: 1. closer err: <nil>
I0319 05:54:03.310747 19 run.go:520] Bringing up GraphQL HTTP admin API at 0.0.0.0:8080/admin
I0319 05:54:03.310774 19 run.go:552] gRPC server started. Listening on port 9080
I0319 05:54:03.310783 19 run.go:553] HTTP server started. Listening on port 8080
I0319 05:54:03.409805 19 pool.go:162] CONNECTING to dgraph-zero-0.dgraph-zero.crm-test.svc.cluster.local:5080
I0319 05:54:03.413999 19 pool.go:162] CONNECTING to dgraph-zero-1.dgraph-zero.crm-test.svc.cluster.local:5080
I0319 05:54:03.417395 19 groups.go:127] Connected to group zero. Assigned group: 0
I0319 05:54:03.417410 19 groups.go:129] Raft Id after connection to Zero: 0x5
I0319 05:54:03.417461 19 pool.go:162] CONNECTING to dgraph-alpha-1.dgraph-alpha.crm-test.svc.cluster.local:7080
I0319 05:54:03.417484 19 pool.go:162] CONNECTING to dgraph-alpha-0.dgraph-alpha.crm-test.svc.cluster.local:7080
I0319 05:54:03.417517 19 pool.go:162] CONNECTING to dgraph-zero-2.dgraph-zero.crm-test.svc.cluster.local:5080
I0319 05:54:03.417543 19 draft.go:230] Node ID: 0x5 with GroupID: 1
I0319 05:54:03.417602 19 node.go:152] Setting raft.Config to: &{ID:5 peers:[] learners:[] ElectionTick:20 HeartbeatTick:1 Storage:0xc00031ab40 Applied:0 MaxSizePerMsg:262144 MaxCommittedSizePerReady:67108864 MaxUncommittedEntriesSize:0 MaxInflightMsgs:256 CheckQuorum:false PreVote:true ReadOnlyOption:0 Logger:0x2e0fef8 DisableProposalForwarding:false}
I0319 05:54:03.417720 19 node.go:321] Found hardstate: {Term:26 Vote:0 Commit:0 XXX_unrecognized:[]}
I0319 05:54:03.417736 19 node.go:326] Group 1 found 0 entries
I0319 05:54:03.417741 19 draft.go:1689] Restarting node for group: 1
I0319 05:54:03.417757 19 log.go:34] 5 became follower at term 26
I0319 05:54:03.417765 19 log.go:34] newRaft 5 [peers: [], term: 26, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
I0319 05:54:03.417782 19 draft.go:180] Operation started with id: opRollup
I0319 05:54:03.417866 19 groups.go:807] Got address of a Zero leader: dgraph-zero-1.dgraph-zero.crm-test.svc.cluster.local:5080
I0319 05:54:03.417864 19 draft.go:1084] Found Raft progress: 0
I0319 05:54:03.417979 19 groups.go:821] Starting a new membership stream receive from dgraph-zero-1.dgraph-zero.crm-test.svc.cluster.local:5080.
I0319 05:54:03.418953 19 groups.go:838] Received first state update from Zero: counter:76883 groups:<key:1 value:<members:<key:1 value:<id:1 group_id:1 addr:"dgraph-alpha-0.dgraph-alpha.crm-test.svc.cluster.local:7080" last_update:1615990975 > > members:<key:2 value:<id:2 group_id:1 addr:"dgraph-alpha-1.dgraph-alpha.crm-test.svc.cluster.local:7080" leader:true last_update:1616058242 > > members:<key:5 value:<id:5 group_id:1 addr:"dgraph-alpha-2.dgraph-alpha.crm-test.svc.cluster.local:7080" > > tablets:<key:"account_relation" value:<group_id:1 predicate:"account_relation" > > tablets:<key:"create_time" value:<group_id:1 predicate:"create_time" on_disk_bytes:192143375 uncompressed_bytes:840031838 > > tablets:<key:"dgraph.cors" value:<group_id:1 predicate:"dgraph.cors" on_disk_bytes:199 uncompressed_bytes:75 > > tablets:<key:"dgraph.drop.op" value:<group_id:1 predicate:"dgraph.drop.op" > > tablets:<key:"dgraph.graphql.p_query" value:<group_id:1 predicate:"dgraph.graphql.p_query" > > tablets:<key:"dgraph.graphql.p_sha256hash" value:<group_id:1 predicate:"dgraph.graphql.p_sha256hash" > > tablets:<key:"dgraph.graphql.schema" value:<group_id:1 predicate:"dgraph.graphql.schema" > > tablets:<key:"dgraph.graphql.schema_created_at" value:<group_id:1 predicate:"dgraph.graphql.schema_created_at" > > tablets:<key:"dgraph.graphql.schema_history" value:<group_id:1 predicate:"dgraph.graphql.schema_history" > > tablets:<key:"dgraph.graphql.xid" value:<group_id:1 predicate:"dgraph.graphql.xid" > > tablets:<key:"dgraph.type" value:<group_id:1 predicate:"dgraph.type" on_disk_bytes:183491132 uncompressed_bytes:661563607 > > tablets:<key:"identity_id" value:<group_id:1 predicate:"identity_id" on_disk_bytes:668112128 uncompressed_bytes:1123320948 > > tablets:<key:"model_type" value:<group_id:1 predicate:"model_type" > > tablets:<key:"namespace" value:<group_id:1 predicate:"namespace" on_disk_bytes:118698642 uncompressed_bytes:441263005 > > tablets:<key:"primary" value:<group_id:1 predicate:"primary" on_disk_bytes:34194501 uncompressed_bytes:125213558 > > tablets:<key:"relation" value:<group_id:1 predicate:"relation" on_disk_bytes:141790681 uncompressed_bytes:303153262 > > tablets:<key:"source" value:<group_id:1 predicate:"source" on_disk_bytes:133531354 uncompressed_bytes:286461038 > > tablets:<key:"source_id" value:<group_id:1 predicate:"source_id" on_disk_bytes:326471204 uncompressed_bytes:564324005 > > tablets:<key:"source_type" value:<group_id:1 predicate:"source_type" on_disk_bytes:28049557 uncompressed_bytes:112303541 > > tablets:<key:"tenant_id" value:<group_id:1 predicate:"tenant_id" on_disk_bytes:366011308 uncompressed_bytes:793126415 > > tablets:<key:"type" value:<group_id:1 predicate:"type" on_disk_bytes:130700470 uncompressed_bytes:449464903 > > snapshot_ts:328729 checksum:12249075648478441628 > > zeros:<key:1 value:<id:1 addr:"dgraph-zero-0.dgraph-zero.crm-test.svc.cluster.local:5080" > > zeros:<key:2 value:<id:2 addr:"dgraph-zero-1.dgraph-zero.crm-test.svc.cluster.local:5080" leader:true > > zeros:<key:3 value:<id:3 addr:"dgraph-zero-2.dgraph-zero.crm-test.svc.cluster.local:5080" > > maxLeaseId:15200000 maxTxnTs:350000 maxRaftId:5 removed:<id:3 group_id:1 addr:"dgraph-alpha-2.dgraph-alpha.crm-test.svc.cluster.local:7080" last_update:1615991006 > removed:<id:4 group_id:1 addr:"dgraph-alpha-2.dgraph-alpha.crm-test.svc.cluster.local:7080" > cid:"fec6a030-0c07-4fe9-a775-219482e41177" license:<maxNodes:18446744073709551615 expiryTs:1617290026 enabled:true >
I0319 05:54:08.310892 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:13.311046 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:18.311204 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:23.311344 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:28.311539 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:33.311694 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:36.575308 19 log.go:34] raft.node: 5 elected leader 2 at term 26
I0319 05:54:38.311822 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:43.311980 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
I0319 05:54:48.312119 19 admin.go:686] Error reading GraphQL schema: Please retry again, server is not ready to accept requests.