We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Some log messages routinely output extremely large amounts of data, more than should be printed in the logs
E.g., one log line contains > 6M chars (probably the full list of ATX IDs):
> wc -L spacemesh-log-7c8cef2b.txt 6246156 spacemesh-log-7c8cef2b.txt
Here are the offending log messages:
> awk '{ if (length > 1000) { print length "\t" substr($0, 0, 300) }}' < spacemesh-log-7c8cef2b.txt | sort -n -k 1 1004 2024-04-22T21:16:52.351-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81747, "errmsg": "preprocess fetch layer 81747 proposals: batch failure: dbbd1db448=proposal get TXs: batch failure: 4d6c2d85e1=failed to parse tx: 4d6c2d85e1 (err: account is not spawned)f24ab1345e=pro 1130 2024-04-24T02:00:26.744-0700 WARN node.mesh smesher produced more than one ballot in the same layer {"smesher": "3db8749be9d142a4cb430614293ba227ef5707251fccb72d670b23058e8e3482", "prev": {"ballot_id": "76d326f4d0", "layer_id": 82091, "epoch_id": 20, "smesher": "3db8749be9d142a4cb430614293ba227ef570 1207 2024-04-15T14:36:50.524-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79651, "errmsg": "preprocess fetch layer 79651 proposals: batch failure: f04704a839=failed to negotiate protocol: protocols not supported: [hs/1]fb66de799f=failed to negotiate protocol: protocols not su 2575 2024-04-15T13:21:49.774-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79636, "errmsg": "preprocess fetch layer 79636 proposals: batch failure: fc218ba701=failed to negotiate protocol: protocols not supported: [hs/1]1eb6b0f3a9=failed to negotiate protocol: protocols not su 3943 2024-04-15T13:51:49.970-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79642, "errmsg": "preprocess fetch layer 79642 proposals: batch failure: 0c57ca95cc=failed to negotiate protocol: protocols not supported: [hs/1]aa71c8dd35=failed to negotiate protocol: protocols not su 5095 2024-04-15T12:26:50.099-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79625, "errmsg": "preprocess fetch layer 79625 proposals: batch failure: 58cb8fb80d=failed to negotiate protocol: protocols not supported: [hs/1]08ae03b225=failed to negotiate protocol: protocols not su 5601 2024-04-15T16:36:51.665-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79675, "errmsg": "preprocess fetch layer 79675 proposals: batch failure: ae4ecbcafb=peer 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: EOF20400d2138=peer 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkv 6179 2024-04-17T16:11:50.027-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80246, "errmsg": "preprocess fetch layer 80246 proposals: batch failure: 21f9950b42=proposal get TXs: batch failure: efe5c4058e=failed to parse tx: efe5c4058e (err: account is not spawned)26157a2960=pro 6708 2024-04-04T18:36:49.926-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 76531, "errmsg": "preprocess fetch layer 76531 proposals: batch failure: 64dd9c9880=proposal get TXs: batch failure: 6f088203cf=failed to parse tx: 6f088203cf (err: account is not spawned)75fc3a9a14=pro 7904 2024-04-21T02:46:52.144-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81237, "errmsg": "preprocess fetch layer 81237 proposals: batch failure: 3add5cd790=proposal get TXs: batch failure: b917333d28=failed to parse tx: b917333d28 (err: account is not spawned)fbd3814651=pro 8071 2024-04-18T07:02:04.060-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80424, "errmsg": "preprocess fetch layer 80424 proposals: batch failure: b1b19c08cb=peer 12D3KooWS6cYMRHuPBKKsU8jnByYykh8mSNXnDkRGDS1sWSu4GNd: stream reset64eedfabe5=peer 12D3KooWS6cYMRHuPBKKsU8jnByYykh 8407 2024-04-15T12:16:50.137-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79623, "errmsg": "preprocess fetch layer 79623 proposals: batch failure: 34a546186b=failed to negotiate protocol: protocols not supported: [hs/1]73f120cd6e=failed to negotiate protocol: protocols not su 8551 2024-04-15T14:11:49.814-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79646, "errmsg": "preprocess fetch layer 79646 proposals: batch failure: 2a7b808d53=failed to negotiate protocol: protocols not supported: [hs/1]5470a5be93=failed to negotiate protocol: protocols not su 8727 2024-04-17T05:12:04.417-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80114, "errmsg": "preprocess fetch layer 80114 proposals: batch failure: 2237a527a6=peer 12D3KooWPWRqW52egf4jXMTC1V1CY5t7bMeQGk75Znk1g4yDK5La: stream reset150adb040d=peer 12D3KooWPWRqW52egf4jXMTC1V1CY5t 10531 2024-04-18T21:17:04.790-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80595, "errmsg": "preprocess fetch layer 80595 proposals: batch failure: 4c1647c571=peer 12D3KooWSGYqmFShdvb5ckURcmnnRfyRX8H9LES8Wcxu9uNC225W: stream reset1f8fc18288=peer 12D3KooWSGYqmFShdvb5ckURcmnnRfy 11105 2024-04-21T17:46:53.089-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81417, "errmsg": "preprocess fetch layer 81417 proposals: batch failure: da402e09b9=peer 12D3KooWANotmP83fNqzSK69ktfso885cChEy7bdZ3Rh3TM551NN: stream reset3fef16fa40=peer 12D3KooWANotmP83fNqzSK69ktfso88 12171 2024-04-22T03:06:51.947-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81529, "errmsg": "preprocess fetch layer 81529 proposals: batch failure: ce3e639bb7=peer 12D3KooWAkgjBWcpVym7xh7mLXDQEv9mtZXawbu7HMkoRyj6FXHf: stream resetbb419629c2=peer 12D3KooWAkgjBWcpVym7xh7mLXDQEv9 13003 2024-04-16T20:07:14.046-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80005, "errmsg": "preprocess fetch layer 80005 proposals: batch failure: 6073027913=peer 12D3KooWQbLvw8bSj8YDmwzS1muhvpS8eZFXxcuk5SpxptuFSGN9: 25.011387s elapsed, 0 bytes read, 465 bytes written, timeou 15194 2024-04-16T05:01:50.129-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79824, "errmsg": "preprocess fetch layer 79824 proposals: batch failure: 3a6ab6d3bb=failed to negotiate protocol: protocols not supported: [hs/1]78aa7776aa=failed to negotiate protocol: protocols not su 15751 2024-04-22T09:41:51.660-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81608, "errmsg": "preprocess fetch layer 81608 proposals: batch failure: 048a8e6bc8=failed to negotiate protocol: protocols not supported: [hs/1]0b9f697b1e=failed to negotiate protocol: protocols not su 20780 2024-04-17T20:32:14.027-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80298, "errmsg": "preprocess fetch layer 80298 proposals: batch failure: a02f50a988=peer 12D3KooWKN8UhsVg9JyqcnGuLbpTaGhx2xCC2zrgiHaRw5Jdd9RF: 25.0132942s elapsed, 0 bytes read, 465 bytes written, timeo 23455 2024-04-21T19:31:56.573-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81438, "errmsg": "preprocess fetch layer 81438 proposals: batch failure: 1569dc41ea=failed to negotiate protocol: protocols not supported: [hs/1]a230ebe646=peer 12D3KooWLceNtvF5foqFp97QepGZ76xvmkWjcveiK 25291 2024-04-23T11:26:54.896-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81917, "errmsg": "preprocess fetch layer 81917 proposals: batch failure: 9cf90a8ff7=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset1198875371=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6 25925 2024-04-20T07:27:14.357-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81005, "errmsg": "preprocess fetch layer 81005 proposals: batch failure: 5aef728a46=peer 12D3KooWEmEvLPECyFArm3zntz8nRcuPAY7EfqjArZVrrPLmEWug: 25.2698127s elapsed, 4096 bytes read, 465 bytes written, ti 30334 2024-04-20T12:07:14.554-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81061, "errmsg": "preprocess fetch layer 81061 proposals: batch failure: 52a9ea29d3=peer 12D3KooWEmEvLPECyFArm3zntz8nRcuPAY7EfqjArZVrrPLmEWug: 25.0472473s elapsed, 0 bytes read, 465 bytes written, timeo 32385 2024-04-17T17:47:14.020-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80265, "errmsg": "preprocess fetch layer 80265 proposals: batch failure: d8f15a6b6b=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset90b2926431=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REV 47852 2024-04-18T22:16:23.380-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80606, "errmsg": "preprocess fetch layer 80606 proposals: batch failure: 0c68102aa3=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset7e9bcf5da8=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REV 51649 2024-04-20T07:57:15.517-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81008, "errmsg": "preprocess fetch layer 81008 proposals: batch failure: f68d3d30f6=failed to negotiate protocol: stream reset0e6f1d573c=peer 12D3KooWEE97ja6vtAufTwjT3iwJzkPdFtsrNiSoUShnBq95qoA5: stream 53089 2024-04-22T03:26:49.161-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81533, "errmsg": "preprocess fetch layer 81533 proposals: batch failure: 7b7cf5a176=peer 12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: stream resetd48cdc1543=peer 12D3KooWMJmdfwxDctuGGoTYJD8Wj9j 54975 2024-04-21T11:01:53.061-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81336, "errmsg": "preprocess fetch layer 81336 proposals: batch failure: 266aaffe7d=peer 12D3KooWABBcHqradmynPQnjYsLXNJUeaLURXKtiioQAvivK4oxL: stream reset52b79669c7=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6 55467 2024-04-20T00:41:52.180-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80924, "errmsg": "preprocess fetch layer 80924 proposals: batch failure: d60af4dfbd=peer 12D3KooWMxLkJSFTic5amkw2c1e9uDD6rLTzAuMaYZpTsuoy6n9A: stream resetb356684152=peer 12D3KooWMuoWtShb1B3RoDaVXHWcksS 66352 2024-04-15T22:12:15.246-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79742, "errmsg": "preprocess fetch layer 79742 proposals: batch failure: f7d2b6cf0c=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6faBjwmS24qPkVB3txmsC3: stream reset45567a0df2=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6 66599 2024-04-18T13:27:14.038-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 80501, "errmsg": "preprocess fetch layer 80501 proposals: batch failure: f2fe304fae=peer 12D3KooWCxHan2QdiEzwqAXxF9EivVdap4vWghgoWsYcwiEd5AP9: stream reset811aade587=peer 12D3KooWPStnitMbLyWAGr32gHmPr53 78578 2024-04-23T08:37:44.308-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 81880, "errmsg": "preprocess fetch layer 81880 proposals: batch failure: 14f25bc359=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset28baa63a32=peer 12D3KooWNtfKmp5hmf6EWLNaSjHXDoF 88326 2024-04-16T13:53:29.259-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79927, "errmsg": "preprocess fetch layer 79927 proposals: batch failure: bc28346a7e=peer 12D3KooWAcWXXCwsJN5Ax187Va292rxKJ8oaXWUq8bEKSy7Y2oAj: 25.013572s elapsed, 0 bytes read, 465 bytes written, timeou 90997 2024-04-16T18:02:51.327-0700 ERROR node.blockGenerator failed to process hare output {"layer_id": 79977, "errmsg": "preprocess fetch layer 79977 proposals: batch failure: 2c4362c522=peer 12D3KooWLfLNDK4xqvQbi39oUoUW184e4USaWy2w8UBdJWWN2zxe: 25.0020344s elapsed, 0 bytes read, 164 bytes written, timeo 3681596 2024-04-18T16:11:10.859-0700 INFO node.sync downloaded atxs {"total": 2712056, "downloaded": 2449093, "missing": ["0000208eca", "000066016c", "0001b5128f", "00022025d2", "0004443850", "0004e3ff89", "000525e405", "0005f91146", "000839b976", "0008485c90", "0009d8a25d", "000a3c75f9", "000b65e69a", "000 6246144 2024-04-18T01:18:48.553-0700 INFO node.sync downloaded atxs {"total": 2712056, "downloaded": 2265911, "missing": ["00000cb1a2", "0000208eca", "000066016c", "00007e7473", "0000df279b", "0000ed587f", "0000f1a50a", "00012c23f2", "000131b00b", "00013a908c", "0001498808", "000187530b", "0001b5128f", "000
Unknown
This issue appears in commit hash: v1.5.0
Related files (optionally with line numbers):
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Description
Some log messages routinely output extremely large amounts of data, more than should be printed in the logs
E.g., one log line contains > 6M chars (probably the full list of ATX IDs):
Here are the offending log messages:
Affected code
Unknown
This issue appears in commit hash: v1.5.0
Related files (optionally with line numbers):
The text was updated successfully, but these errors were encountered: