Public node sync failed #5759
Labels
Comments
|
if after you stop all your private nodes you see that
it means that node is not able to connect outside. can you try to observe if it even tries to make any connections? for example with:
or observe debug logs from p2p
|
|
@dshulyak 2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: [/dns4/mainnet-bootnode-6.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: all dials failed\n * [/ip4/51.38.224.232/tcp/5000] dial backoff"}
2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWRcTWDHzptnhJn5h6CtwnokzzMaDLcXv6oM9CxQEXd5FL: [/dns4/mainnet-bootnode-4.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWRcTWDHzptnhJn5h6CtwnokzzMaDLcXv6oM9CxQEXd5FL: all dials failed\n * [/ip4/51.68.142.66/tcp/5000] dial backoff"}
2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWRkZMjGNrQfRyeKQC9U58cUwAfyQMtjNsupixkBFag8AY: [/dns4/mainnet-bootnode-14.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWRkZMjGNrQfRyeKQC9U58cUwAfyQMtjNsupixkBFag8AY: all dials failed\n * [/ip4/65.108.15.238/tcp/5000] dial backoff"}
2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWG4gk8GtMsAjYxHtbNC7oEoBTMRLbLDpKgSQMQkYBFRsw: [/dns4/mainnet-bootnode-12.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWG4gk8GtMsAjYxHtbNC7oEoBTMRLbLDpKgSQMQkYBFRsw: all dials failed\n * [/ip4/65.108.44.86/tcp/5000] dial backoff"}
2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWHK5m83sNj2eNMJMGAngcS9gBja27ho83t79Q2CD4iRjQ: [/dns4/mainnet-bootnode-10.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWHK5m83sNj2eNMJMGAngcS9gBja27ho83t79Q2CD4iRjQ: all dials failed\n * [/ip4/176.9.7.13/tcp/5000] dial backoff"}
2024-03-22T09:03:23.012Z WARN node.p2p failed to connect {"address": "{12D3KooWFYv99aGbtXnZQy6UZxyf72NpkWJp3K4HS8Py35WhKtzE: [/dns4/mainnet-bootnode-8.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWFYv99aGbtXnZQy6UZxyf72NpkWJp3K4HS8Py35WhKtzE: all dials failed\n * [/ip4/35.244.2.151/tcp/5000] dial backoff"}
2024-03-22T09:03:23.013Z WARN node.p2p failed to connect {"address": "{12D3KooWPStnitMbLyWAGr32gHmPr538mT658Thp6zTUujZt3LRf: [/dns4/mainnet-bootnode-0.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWPStnitMbLyWAGr32gHmPr538mT658Thp6zTUujZt3LRf: all dials failed\n * [/ip4/35.245.137.218/tcp/5000] dial backoff"}
2024-03-22T09:03:23.013Z WARN node.p2p failed to connect {"address": "{12D3KooWAsMgXLpyGdsRNjHBF3FaXwnXhyMEqWQYBXUpvCHNzFNK: [/dns4/mainnet-bootnode-2.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWAsMgXLpyGdsRNjHBF3FaXwnXhyMEqWQYBXUpvCHNzFNK: all dials failed\n * [/ip4/35.230.184.228/tcp/5000] dial backoff"}
2024-03-22T09:03:23.013Z WARN node.p2p failed to connect {"address": "{12D3KooWDAFRuFrMNgVQMDy8cgD71GLtPyYyfQzFxMZr2yUBgjHK: [/dns4/mainnet-bootnode-16.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWDAFRuFrMNgVQMDy8cgD71GLtPyYyfQzFxMZr2yUBgjHK: all dials failed\n * [/ip4/34.93.187.208/tcp/5000] dial backoff"}
2024-03-22T09:03:23.017Z WARN node.p2p failed to connect {"address": "{12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: [/dns4/mainnet-bootnode-18.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: all dials failed\n * [/ip4/5.9.156.149/tcp/5000] dial backoff"} |
|
2024-03-22T09:10:20.155Z WARN node.p2p failed to connect {"address": "{12D3KooWG4gk8GtMsAjYxHtbNC7oEoBTMRLbLDpKgSQMQkYBFRsw: [/dns4/mainnet-bootnode-12.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWG4gk8GtMsAjYxHtbNC7oEoBTMRLbLDpKgSQMQkYBFRsw: all dials failed\n * [/ip4/65.108.44.86/tcp/5000] dial backoff"}
2024-03-22T09:10:20.155Z WARN node.p2p failed to connect {"address": "{12D3KooWHK5m83sNj2eNMJMGAngcS9gBja27ho83t79Q2CD4iRjQ: [/dns4/mainnet-bootnode-10.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWHK5m83sNj2eNMJMGAngcS9gBja27ho83t79Q2CD4iRjQ: all dials failed\n * [/ip4/176.9.7.13/tcp/5000] dial backoff"}
2024-03-22T09:10:20.156Z WARN node.p2p failed to connect {"address": "{12D3KooWRkZMjGNrQfRyeKQC9U58cUwAfyQMtjNsupixkBFag8AY: [/dns4/mainnet-bootnode-14.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWRkZMjGNrQfRyeKQC9U58cUwAfyQMtjNsupixkBFag8AY: all dials failed\n * [/ip4/65.108.15.238/tcp/5000] dial backoff"}
2024-03-22T09:10:20.157Z WARN node.p2p failed to connect {"address": "{12D3KooWDAFRuFrMNgVQMDy8cgD71GLtPyYyfQzFxMZr2yUBgjHK: [/dns4/mainnet-bootnode-16.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWDAFRuFrMNgVQMDy8cgD71GLtPyYyfQzFxMZr2yUBgjHK: all dials failed\n * [/ip4/34.93.187.208/tcp/5000] dial backoff"}
2024-03-22T09:10:20.164Z WARN node.p2p failed to connect {"address": "{12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: [/dns4/mainnet-bootnode-6.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: all dials failed\n * [/ip4/51.38.224.232/tcp/5000] dial backoff"}
2024-03-22T09:10:20.164Z WARN node.p2p failed to connect {"address": "{12D3KooWAsMgXLpyGdsRNjHBF3FaXwnXhyMEqWQYBXUpvCHNzFNK: [/dns4/mainnet-bootnode-2.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWAsMgXLpyGdsRNjHBF3FaXwnXhyMEqWQYBXUpvCHNzFNK: all dials failed\n * [/ip4/35.230.184.228/tcp/5000] dial backoff"}
2024-03-22T09:10:20.165Z WARN node.p2p failed to connect {"address": "{12D3KooWFYv99aGbtXnZQy6UZxyf72NpkWJp3K4HS8Py35WhKtzE: [/dns4/mainnet-bootnode-8.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWFYv99aGbtXnZQy6UZxyf72NpkWJp3K4HS8Py35WhKtzE: all dials failed\n * [/ip4/35.244.2.151/tcp/5000] dial backoff"}
2024-03-22T09:10:20.167Z WARN node.p2p failed to connect {"address": "{12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: [/dns4/mainnet-bootnode-18.spacemesh.network/tcp/5000]}", "error": "failed to dial: failed to dial 12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: all dials failed\n * [/ip4/5.9.156.149/tcp/5000] dial backoff"}
2024-03-22T09:10:41.799Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"}
2024-03-22T09:10:41.832Z INFO node.sync node is too far behind {"sessionId": "e1d90b8f", "current": "72590", "last synced": "72513", "behind threshold": 36, "name": "sync"}
2024-03-22T09:10:50.168Z WARN node.p2p failed to connect {"address": "{12D3KooWMipk67c6SdWKGf88mcDcKpsNC9yYqE7YLVfYJrNpAQbp: [/ip4/10.0.63.89/tcp/754]}", "error": "failed to dial: failed to dial 12D3KooWMipk67c6SdWKGf88mcDcKpsNC9yYqE7YLVfYJrNpAQbp: no good addresses\n * [/ip4/10.0.63.89/tcp/754] gater disallows connection to peer"}
2024-03-22T09:10:50.168Z WARN node.p2p failed to connect {"address": "{12D3KooWFMvWsyedivfRVEoaGKYenUYTgjJbKsTavtYhb3yQzCPc: [/ip4/10.0.104.48/tcp/758]}", "error": "failed to dial: failed to dial 12D3KooWFMvWsyedivfRVEoaGKYenUYTgjJbKsTavtYhb3yQzCPc: no good addresses\n * [/ip4/10.0.104.48/tcp/758] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWQjBFD8FZ1CFZgyCFHL4MPPspuDcSbPkKcMNceWicUqny: [/ip4/10.0.66.169/tcp/755]}", "error": "failed to dial: failed to dial 12D3KooWQjBFD8FZ1CFZgyCFHL4MPPspuDcSbPkKcMNceWicUqny: no good addresses\n * [/ip4/10.0.66.169/tcp/755] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWHmNMzoCveeThwf1s2iAgMn1L8SSFEr9G87qbH5aa8Xfe: [/ip4/10.0.173.159/tcp/751]}", "error": "failed to dial: failed to dial 12D3KooWHmNMzoCveeThwf1s2iAgMn1L8SSFEr9G87qbH5aa8Xfe: no good addresses\n * [/ip4/10.0.173.159/tcp/751] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWJwwwNxPSogSZM9EG2iwvFi6ejVW8qnHPWSVBgzWBcnSh: [/ip4/10.0.90.215/tcp/751]}", "error": "failed to dial: failed to dial 12D3KooWJwwwNxPSogSZM9EG2iwvFi6ejVW8qnHPWSVBgzWBcnSh: no good addresses\n * [/ip4/10.0.90.215/tcp/751] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWLf9QB69Wv9VcsMMvDEJzr72tHacV2HiAh8ZVmfPcjvpu: [/ip4/10.0.75.62/tcp/754]}", "error": "failed to dial: failed to dial 12D3KooWLf9QB69Wv9VcsMMvDEJzr72tHacV2HiAh8ZVmfPcjvpu: no good addresses\n * [/ip4/10.0.75.62/tcp/754] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWR93rJTr2uQTwQXYG8uAmbGdjEs7wKqSQ1tX8QYCbM9rK: [/ip4/10.0.33.109/tcp/757]}", "error": "failed to dial: failed to dial 12D3KooWR93rJTr2uQTwQXYG8uAmbGdjEs7wKqSQ1tX8QYCbM9rK: no good addresses\n * [/ip4/10.0.33.109/tcp/757] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWQZkK5NpbQQHnVhh6tynuaQQuqrWvbfujAG2P2b1LtspU: [/ip4/10.0.35.133/tcp/755]}", "error": "failed to dial: failed to dial 12D3KooWQZkK5NpbQQHnVhh6tynuaQQuqrWvbfujAG2P2b1LtspU: no good addresses\n * [/ip4/10.0.35.133/tcp/755] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWR2g5FyjS8Cq2tR3sNKutWZjFrQCk3aZdn5vHwfuvDisk: [/ip4/10.0.39.227/tcp/752]}", "error": "failed to dial: failed to dial 12D3KooWR2g5FyjS8Cq2tR3sNKutWZjFrQCk3aZdn5vHwfuvDisk: no good addresses\n * [/ip4/10.0.39.227/tcp/752] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWCvLBCk4eLMY7A1ph5F5MXAdwRuWaXsYA9v8sgic1g4dA: [/ip4/10.0.42.188/tcp/754]}", "error": "failed to dial: failed to dial 12D3KooWCvLBCk4eLMY7A1ph5F5MXAdwRuWaXsYA9v8sgic1g4dA: no good addresses\n * [/ip4/10.0.42.188/tcp/754] gater disallows connection to peer"}
2024-03-22T09:10:50.169Z WARN node.p2p failed to connect {"address": "{12D3KooWHg1GXiwaZkrmcDgt2zu5uZagQModzJULK87ZH9hRSckb: [/ip4/10.0.110.168/tcp/751]}", "error": "failed to dial: failed to dial 12D3KooWHg1GXiwaZkrmcDgt2zu5uZagQModzJULK87ZH9hRSckb: no good addresses\n * [/ip4/10.0.110.168/tcp/751] gater disallows connection to peer"}
2024-03-22T09:10:50.170Z WARN node.p2p failed to connect {"address": "{12D3KooWJ7xFV1TpHs2dZaMtTU17Ea2F9nTQWGi1ub8M9HgFRf7U: [/ip4/10.0.52.215/tcp/752]}", "error": "failed to dial: failed to dial 12D3KooWJ7xFV1TpHs2dZaMtTU17Ea2F9nTQWGi1ub8M9HgFRf7U: no good addresses\n * [/ip4/10.0.52.215/tcp/752] gater disallows connection to peer"}
2024-03-22T09:10:50.170Z WARN node.p2p failed to connect {"address": "{12D3KooWRyaa159hc7gS9Wp2hEJJUUyVALYUPGewV3ZuXZnrZ2HW: [/ip4/10.0.31.195/tcp/757]}", "error": "failed to dial: failed to dial 12D3KooWRyaa159hc7gS9Wp2hEJJUUyVALYUPGewV3ZuXZnrZ2HW: no good addresses\n * [/ip4/10.0.31.195/tcp/757] gater disallows connection to peer"}
2024-03-22T09:10:50.171Z WARN node.p2p failed to connect {"address": "{12D3KooWLEMF3DeSVS9HvboZL3HYP6xJgzHgRnS6VRnNYtv6tL7K: [/ip4/10.0.86.198/tcp/754]}", "error": "failed to dial: failed to dial 12D3KooWLEMF3DeSVS9HvboZL3HYP6xJgzHgRnS6VRnNYtv6tL7K: no good addresses\n * [/ip4/10.0.86.198/tcp/754] gater disallows connection to peer"} |
|
Sorry, the above errors all appear in the k8s pod(containerd). No problem before 1.4 |
|
@Hugh-Top somehow you see all addresses from private IP class via: #5511 You can change that behavior by setting But additionally, you should check if that NAT is expected here. |
|
@pigmej hello， i have changed config by setting
|
|
in the logs above node fails to connect to bootnodes, and therefore can't obtain public peers. thats the first problem to solve. nothing will work without public peer. i can't reproduce it on nodes where i have access. after that problem is solved it will be better to to try using that public node with post services instead of public/private setup. |
|
Run telnet 34.93.187.208 5000
Trying 34.93.187.208...
Connected to 34.93.187.208.
Escape character is '^]'.
/multistream/1.0.0
|
Yes they do, some of them have per IP some per peer, some time based to avoid being easily disabled by attackers. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
I set 6 public nodes. after upgrade 1.4.x. public nodes sync failed forllow logs:
2024-03-22T00:09:49.338Z INFO node.fetcher peer stats {"total": 120, "global average latency": "907.203µs", "best peers": [{"id": "12D3KooWNtpwAHdUwEEPLR1ZMTcRh33A1EMSNQt4fYBAmyN9Z6Wf", "success": 10220, "failures": 1, "latency per 1024 bytes": "818.123µs"}, {"id": "12D3KooWEDrDpQxALxv8TztogUr1qpd8koJKchnkiZj26pyQLxR8", "success": 62215, "failures": 1, "latency per 1024 bytes": "849.019µs"}, {"id": "12D3KooWDr1ETVJwMGg9EyiazyguaWhMstWj1kJWNiFzLQhbQK5a", "success": 66580, "failures": 1, "latency per 1024 bytes": "849.872µs"}, {"id": "12D3KooWEycGfD3JhBs3iogsoidA76i6vgF4rrxxWDVPfHMB1m4r", "success": 5668, "failures": 1, "latency per 1024 bytes": "1.174125ms"}, {"id": "12D3KooWJ5hQW52f5rMqwLrxMEUTEvnzRyCjJbEJsKw1ofMGPyZ5", "success": 14923, "failures": 1, "latency per 1024 bytes": "2.102913ms"}], "name": "fetcher"} 2024-03-22T00:11:01.000Z WARN node.hare failed {"lid": 72481, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:16:01.000Z WARN node.hare failed {"lid": 72482, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:21:01.000Z WARN node.hare failed {"lid": 72483, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:26:01.000Z WARN node.hare failed {"lid": 72484, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:29:49.338Z INFO node.fetcher peer stats {"total": 119, "global average latency": "1.480688ms", "best peers": [{"id": "12D3KooWNtpwAHdUwEEPLR1ZMTcRh33A1EMSNQt4fYBAmyN9Z6Wf", "success": 13202, "failures": 1, "latency per 1024 bytes": "823.084µs"}, {"id": "12D3KooWDr1ETVJwMGg9EyiazyguaWhMstWj1kJWNiFzLQhbQK5a", "success": 70254, "failures": 1, "latency per 1024 bytes": "850.466µs"}, {"id": "12D3KooWEDrDpQxALxv8TztogUr1qpd8koJKchnkiZj26pyQLxR8", "success": 65889, "failures": 1, "latency per 1024 bytes": "917.201µs"}, {"id": "12D3KooWEycGfD3JhBs3iogsoidA76i6vgF4rrxxWDVPfHMB1m4r", "success": 8731, "failures": 1, "latency per 1024 bytes": "1.439371ms"}, {"id": "12D3KooWJ5hQW52f5rMqwLrxMEUTEvnzRyCjJbEJsKw1ofMGPyZ5", "success": 18312, "failures": 1, "latency per 1024 bytes": "1.533646ms"}], "name": "fetcher"} 2024-03-22T00:31:01.000Z WARN node.hare failed {"lid": 72485, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:36:01.000Z WARN node.hare failed {"lid": 72486, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:41:01.000Z WARN node.hare failed {"lid": 72487, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:46:01.000Z WARN node.hare failed {"lid": 72488, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:49:49.339Z INFO node.fetcher peer stats {"total": 123, "global average latency": "1.10341ms", "best peers": [{"id": "12D3KooWDr1ETVJwMGg9EyiazyguaWhMstWj1kJWNiFzLQhbQK5a", "success": 74003, "failures": 1, "latency per 1024 bytes": "873.699µs"}, {"id": "12D3KooWEDrDpQxALxv8TztogUr1qpd8koJKchnkiZj26pyQLxR8", "success": 69638, "failures": 1, "latency per 1024 bytes": "876.827µs"}, {"id": "12D3KooWAMzwAsivPZAGNLW5xNYJwbNsmW9xxJm2V9E8Y1cSwuTb", "success": 5829, "failures": 1, "latency per 1024 bytes": "1.153109ms"}, {"id": "12D3KooWSFq9fWxCEA2bmMnZ4J2LGCRr6gfFER788qwn1XQn7dkh", "success": 90, "failures": 0, "latency per 1024 bytes": "1.249727ms"}, {"id": "12D3KooWEycGfD3JhBs3iogsoidA76i6vgF4rrxxWDVPfHMB1m4r", "success": 11696, "failures": 1, "latency per 1024 bytes": "1.376178ms"}], "name": "fetcher"} 2024-03-22T00:51:01.000Z WARN node.hare failed {"lid": 72489, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T00:56:01.000Z WARN node.hare failed {"lid": 72490, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:01:01.000Z WARN node.hare failed {"lid": 72491, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:06:01.000Z WARN node.hare failed {"lid": 72492, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:09:49.339Z INFO node.fetcher peer stats {"total": 122, "global average latency": "886.766µs", "best peers": [{"id": "12D3KooWDr1ETVJwMGg9EyiazyguaWhMstWj1kJWNiFzLQhbQK5a", "success": 77829, "failures": 1, "latency per 1024 bytes": "748.689µs"}, {"id": "12D3KooWEDrDpQxALxv8TztogUr1qpd8koJKchnkiZj26pyQLxR8", "success": 73462, "failures": 1, "latency per 1024 bytes": "806.066µs"}, {"id": "12D3KooWHmNMzoCveeThwf1s2iAgMn1L8SSFEr9G87qbH5aa8Xfe", "success": 405, "failures": 0, "latency per 1024 bytes": "844.417µs"}, {"id": "12D3KooWNtpwAHdUwEEPLR1ZMTcRh33A1EMSNQt4fYBAmyN9Z6Wf", "success": 19481, "failures": 1, "latency per 1024 bytes": "970.054µs"}, {"id": "12D3KooWAMzwAsivPZAGNLW5xNYJwbNsmW9xxJm2V9E8Y1cSwuTb", "success": 9349, "failures": 1, "latency per 1024 bytes": "1.079896ms"}], "name": "fetcher"} 2024-03-22T01:11:01.000Z WARN node.hare failed {"lid": 72493, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:16:01.000Z WARN node.hare failed {"lid": 72494, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:21:01.000Z WARN node.hare failed {"lid": 72495, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:26:01.000Z WARN node.hare failed {"lid": 72496, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:29:49.340Z INFO node.fetcher peer stats {"total": 121, "global average latency": "829.647µs", "best peers": [{"id": "12D3KooWDr1ETVJwMGg9EyiazyguaWhMstWj1kJWNiFzLQhbQK5a", "success": 81938, "failures": 1, "latency per 1024 bytes": "820.658µs"}, {"id": "12D3KooWEDrDpQxALxv8TztogUr1qpd8koJKchnkiZj26pyQLxR8", "success": 77568, "failures": 1, "latency per 1024 bytes": "825.17µs"}, {"id": "12D3KooWNtpwAHdUwEEPLR1ZMTcRh33A1EMSNQt4fYBAmyN9Z6Wf", "success": 23334, "failures": 1, "latency per 1024 bytes": "832.882µs"}, {"id": "12D3KooWSFq9fWxCEA2bmMnZ4J2LGCRr6gfFER788qwn1XQn7dkh", "success": 119, "failures": 0, "latency per 1024 bytes": "847.448µs"}, {"id": "12D3KooWAMzwAsivPZAGNLW5xNYJwbNsmW9xxJm2V9E8Y1cSwuTb", "success": 12176, "failures": 1, "latency per 1024 bytes": "884.42µs"}], "name": "fetcher"} 2024-03-22T01:31:01.000Z WARN node.hare failed {"lid": 72497, "error": "hare failed to reach consensus in 4 iterations"} 2024-03-22T01:36:01.000Z WARN node.hare failed {"lid": 72498, "error": "hare failed to reach consensus in 4 iterations"}most of best peers are private nodes
The sync has been over 12 hours old and the latest snapshot was downloaded before starting
public nodes config:
after stop all private nodes, public node log:
2024-03-22T03:47:04.773Z INFO node.proposalBuilder received activeset update {"epoch_id": 18, "size": 1846733, "name": "proposalBuilder"} 2024-03-22T04:06:56.351Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"} 2024-03-22T04:26:56.352Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"} 2024-03-22T04:46:56.353Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"} 2024-03-22T05:06:56.353Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"} 2024-03-22T05:26:56.354Z INFO node.fetcher peer stats {"total": 0, "global average latency": "0s", "best peers": [], "name": "fetcher"} lsof -i:7513 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME go-spacem 12 root 73u IPv4 179215036 0t0 TCP *:7513 (LISTEN) go-spacem 12 root 74u IPv4 179215040 0t0 TCP *:7513 (LISTEN)Steps to reproduce
Actual Behavior
Expected Behavior
Environment
Please complete the following information:
Additional Resources
The text was updated successfully, but these errors were encountered: