While Starting one of my alpha i’m getting below error
file does not exist for table 267629
Error while creating badger KV posting store
E0831 04:43:19.765693 19898 log.go:32] Received err: file does not exist for table 267629. Cleaning up…
[Sentry] 2021/08/31 04:43:19 Sending fatal event [977531abde554cdbb33dca2f26703a91] to o318308.ingest.sentry.io project: 1805390
2021/08/31 04:43:19 file does not exist for table 267629
Error while creating badger KV posting store
What version of Dgraph are you using?
v21.03
Dgraph Version
$ dgraph version
PASTE YOUR RESULTS HERE
Have you tried reproducing the issue with the latest release?
It happens in the latest version
What is the hardware spec (RAM, OS)?
32 Gb ram and Linux
Steps to reproduce the issue (command/config used to run Dgraph).
Ingested large amount of Data, suddenly server crashed and restarted server after that i’m facing this issue and alpha node is not at all starting.
I don’t quite understand how so many people run into this but dgraph devs cannot reproduce. We run into this on our production system weekly and keep having to remove these corrupt nodes.
Thanks for Response.
Is there is any work around for this issue. I have tried to start with new data folders but i’m getting below Error.
I0831 10:43:38.629539 28661 worker.go:114] Worker listening at address: [::]:7080
I0831 10:43:38.630743 28661 run.go:565] Bringing up GraphQL HTTP API at 0.0.0.0:8080/graphql
I0831 10:43:38.630767 28661 run.go:566] Bringing up GraphQL HTTP admin API at 0.0.0.0:8080/admin
I0831 10:43:38.630784 28661 run.go:593] gRPC server started. Listening on port 9080
I0831 10:43:38.630794 28661 run.go:594] HTTP server started. Listening on port 8080
E0831 10:43:38.630765 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
I0831 10:43:38.729876 28661 pool.go:164] CONN: Connecting to 192.180.66.41:5080
E0831 10:43:39.631884 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:40.632716 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:41.633815 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:42.634938 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:43.632025 28661 admin.go:862] namespace: 0. Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
E0831 10:43:43.635099 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:44.636267 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:45.636365 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:46.637076 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:47.637938 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:48.632934 28661 admin.go:862] namespace: 0. Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
E0831 10:43:48.638031 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:49.638128 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:50.639189 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:51.640252 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:52.641212 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:53.633675 28661 admin.go:862] namespace: 0. Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
E0831 10:43:53.641899 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:54.642601 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:55.643576 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:56.644187 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:57.644810 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:58.634832 28661 admin.go:862] namespace: 0. Error reading GraphQL schema: Please retry again, server is not ready to accept requests.
E0831 10:43:58.644924 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:43:59.645035 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:44:00.646258 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:44:01.646914 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
E0831 10:44:02.647607 28661 groups.go:1181] Error during SubscribeForUpdates for prefix “\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x15dgraph.graphql.schema\x00”: Unable to find any servers for group: 1. closer err:
^C
Yes, in these cases when drgaph tries to start and can’t find a file for a table (more likely after a compacting glitch /crash), I would love to command the server: “be nice, please discard your data and get fresh copies from the replicas”. A nice start-up option, something that won’t make us to remove nodes and bring in new ones every second day, thank you!
