Fix extremely long log lines

[lrettig]

Description

Some log messages routinely output extremely large amounts of data, more than should be printed in the logs

E.g., one log line contains > 6M chars (probably the full list of ATX IDs):

> wc -L spacemesh-log-7c8cef2b.txt
6246156 spacemesh-log-7c8cef2b.txt

Here are the offending log messages:

> awk '{ if (length > 1000) { print length "\t" substr($0, 0, 300) }}' < spacemesh-log-7c8cef2b.txt | sort -n -k 1
1004    2024-04-22T21:16:52.351-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81747, "errmsg": "preprocess fetch layer 81747 proposals: batch failure: dbbd1db448=proposal get TXs: batch failure: 4d6c2d85e1=failed to parse tx: 4d6c2d85e1 (err: account is not spawned)f24ab1345e=pro
1130    2024-04-24T02:00:26.744-0700    WARN    node.mesh       smesher produced more than one ballot in the same layer {"smesher": "3db8749be9d142a4cb430614293ba227ef5707251fccb72d670b23058e8e3482", "prev": {"ballot_id": "76d326f4d0", "layer_id": 82091, "epoch_id": 20, "smesher": "3db8749be9d142a4cb430614293ba227ef570
1207    2024-04-15T14:36:50.524-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79651, "errmsg": "preprocess fetch layer 79651 proposals: batch failure: f04704a839=failed to negotiate protocol: protocols not supported: [hs/1]fb66de799f=failed to negotiate protocol: protocols not su
2575    2024-04-15T13:21:49.774-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79636, "errmsg": "preprocess fetch layer 79636 proposals: batch failure: fc218ba701=failed to negotiate protocol: protocols not supported: [hs/1]1eb6b0f3a9=failed to negotiate protocol: protocols not su
3943    2024-04-15T13:51:49.970-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79642, "errmsg": "preprocess fetch layer 79642 proposals: batch failure: 0c57ca95cc=failed to negotiate protocol: protocols not supported: [hs/1]aa71c8dd35=failed to negotiate protocol: protocols not su
5095    2024-04-15T12:26:50.099-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79625, "errmsg": "preprocess fetch layer 79625 proposals: batch failure: 58cb8fb80d=failed to negotiate protocol: protocols not supported: [hs/1]08ae03b225=failed to negotiate protocol: protocols not su
5601    2024-04-15T16:36:51.665-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79675, "errmsg": "preprocess fetch layer 79675 proposals: batch failure: ae4ecbcafb=peer 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkvombJJdrca8Hz: EOF20400d2138=peer 12D3KooWRS47KAs3ZLkBtE2AqjJCwxRYqZKmyLkv
6179    2024-04-17T16:11:50.027-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80246, "errmsg": "preprocess fetch layer 80246 proposals: batch failure: 21f9950b42=proposal get TXs: batch failure: efe5c4058e=failed to parse tx: efe5c4058e (err: account is not spawned)26157a2960=pro
6708    2024-04-04T18:36:49.926-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 76531, "errmsg": "preprocess fetch layer 76531 proposals: batch failure: 64dd9c9880=proposal get TXs: batch failure: 6f088203cf=failed to parse tx: 6f088203cf (err: account is not spawned)75fc3a9a14=pro
7904    2024-04-21T02:46:52.144-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81237, "errmsg": "preprocess fetch layer 81237 proposals: batch failure: 3add5cd790=proposal get TXs: batch failure: b917333d28=failed to parse tx: b917333d28 (err: account is not spawned)fbd3814651=pro
8071    2024-04-18T07:02:04.060-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80424, "errmsg": "preprocess fetch layer 80424 proposals: batch failure: b1b19c08cb=peer 12D3KooWS6cYMRHuPBKKsU8jnByYykh8mSNXnDkRGDS1sWSu4GNd: stream reset64eedfabe5=peer 12D3KooWS6cYMRHuPBKKsU8jnByYykh
8407    2024-04-15T12:16:50.137-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79623, "errmsg": "preprocess fetch layer 79623 proposals: batch failure: 34a546186b=failed to negotiate protocol: protocols not supported: [hs/1]73f120cd6e=failed to negotiate protocol: protocols not su
8551    2024-04-15T14:11:49.814-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79646, "errmsg": "preprocess fetch layer 79646 proposals: batch failure: 2a7b808d53=failed to negotiate protocol: protocols not supported: [hs/1]5470a5be93=failed to negotiate protocol: protocols not su
8727    2024-04-17T05:12:04.417-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80114, "errmsg": "preprocess fetch layer 80114 proposals: batch failure: 2237a527a6=peer 12D3KooWPWRqW52egf4jXMTC1V1CY5t7bMeQGk75Znk1g4yDK5La: stream reset150adb040d=peer 12D3KooWPWRqW52egf4jXMTC1V1CY5t
10531   2024-04-18T21:17:04.790-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80595, "errmsg": "preprocess fetch layer 80595 proposals: batch failure: 4c1647c571=peer 12D3KooWSGYqmFShdvb5ckURcmnnRfyRX8H9LES8Wcxu9uNC225W: stream reset1f8fc18288=peer 12D3KooWSGYqmFShdvb5ckURcmnnRfy
11105   2024-04-21T17:46:53.089-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81417, "errmsg": "preprocess fetch layer 81417 proposals: batch failure: da402e09b9=peer 12D3KooWANotmP83fNqzSK69ktfso885cChEy7bdZ3Rh3TM551NN: stream reset3fef16fa40=peer 12D3KooWANotmP83fNqzSK69ktfso88
12171   2024-04-22T03:06:51.947-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81529, "errmsg": "preprocess fetch layer 81529 proposals: batch failure: ce3e639bb7=peer 12D3KooWAkgjBWcpVym7xh7mLXDQEv9mtZXawbu7HMkoRyj6FXHf: stream resetbb419629c2=peer 12D3KooWAkgjBWcpVym7xh7mLXDQEv9
13003   2024-04-16T20:07:14.046-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80005, "errmsg": "preprocess fetch layer 80005 proposals: batch failure: 6073027913=peer 12D3KooWQbLvw8bSj8YDmwzS1muhvpS8eZFXxcuk5SpxptuFSGN9: 25.011387s elapsed, 0 bytes read, 465 bytes written, timeou
15194   2024-04-16T05:01:50.129-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79824, "errmsg": "preprocess fetch layer 79824 proposals: batch failure: 3a6ab6d3bb=failed to negotiate protocol: protocols not supported: [hs/1]78aa7776aa=failed to negotiate protocol: protocols not su
15751   2024-04-22T09:41:51.660-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81608, "errmsg": "preprocess fetch layer 81608 proposals: batch failure: 048a8e6bc8=failed to negotiate protocol: protocols not supported: [hs/1]0b9f697b1e=failed to negotiate protocol: protocols not su
20780   2024-04-17T20:32:14.027-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80298, "errmsg": "preprocess fetch layer 80298 proposals: batch failure: a02f50a988=peer 12D3KooWKN8UhsVg9JyqcnGuLbpTaGhx2xCC2zrgiHaRw5Jdd9RF: 25.0132942s elapsed, 0 bytes read, 465 bytes written, timeo
23455   2024-04-21T19:31:56.573-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81438, "errmsg": "preprocess fetch layer 81438 proposals: batch failure: 1569dc41ea=failed to negotiate protocol: protocols not supported: [hs/1]a230ebe646=peer 12D3KooWLceNtvF5foqFp97QepGZ76xvmkWjcveiK
25291   2024-04-23T11:26:54.896-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81917, "errmsg": "preprocess fetch layer 81917 proposals: batch failure: 9cf90a8ff7=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset1198875371=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6
25925   2024-04-20T07:27:14.357-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81005, "errmsg": "preprocess fetch layer 81005 proposals: batch failure: 5aef728a46=peer 12D3KooWEmEvLPECyFArm3zntz8nRcuPAY7EfqjArZVrrPLmEWug: 25.2698127s elapsed, 4096 bytes read, 465 bytes written, ti
30334   2024-04-20T12:07:14.554-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81061, "errmsg": "preprocess fetch layer 81061 proposals: batch failure: 52a9ea29d3=peer 12D3KooWEmEvLPECyFArm3zntz8nRcuPAY7EfqjArZVrrPLmEWug: 25.0472473s elapsed, 0 bytes read, 465 bytes written, timeo
32385   2024-04-17T17:47:14.020-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80265, "errmsg": "preprocess fetch layer 80265 proposals: batch failure: d8f15a6b6b=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset90b2926431=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REV
47852   2024-04-18T22:16:23.380-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80606, "errmsg": "preprocess fetch layer 80606 proposals: batch failure: 0c68102aa3=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset7e9bcf5da8=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REV
51649   2024-04-20T07:57:15.517-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81008, "errmsg": "preprocess fetch layer 81008 proposals: batch failure: f68d3d30f6=failed to negotiate protocol: stream reset0e6f1d573c=peer 12D3KooWEE97ja6vtAufTwjT3iwJzkPdFtsrNiSoUShnBq95qoA5: stream
53089   2024-04-22T03:26:49.161-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81533, "errmsg": "preprocess fetch layer 81533 proposals: batch failure: 7b7cf5a176=peer 12D3KooWMJmdfwxDctuGGoTYJD8Wj9jubQBbPfrgrzzXaQ1RTKE6: stream resetd48cdc1543=peer 12D3KooWMJmdfwxDctuGGoTYJD8Wj9j
54975   2024-04-21T11:01:53.061-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81336, "errmsg": "preprocess fetch layer 81336 proposals: batch failure: 266aaffe7d=peer 12D3KooWABBcHqradmynPQnjYsLXNJUeaLURXKtiioQAvivK4oxL: stream reset52b79669c7=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6
55467   2024-04-20T00:41:52.180-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80924, "errmsg": "preprocess fetch layer 80924 proposals: batch failure: d60af4dfbd=peer 12D3KooWMxLkJSFTic5amkw2c1e9uDD6rLTzAuMaYZpTsuoy6n9A: stream resetb356684152=peer 12D3KooWMuoWtShb1B3RoDaVXHWcksS
66352   2024-04-15T22:12:15.246-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79742, "errmsg": "preprocess fetch layer 79742 proposals: batch failure: f7d2b6cf0c=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6faBjwmS24qPkVB3txmsC3: stream reset45567a0df2=peer 12D3KooWJDZfTNuMb3p7dUv1Uu4oKP6
66599   2024-04-18T13:27:14.038-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 80501, "errmsg": "preprocess fetch layer 80501 proposals: batch failure: f2fe304fae=peer 12D3KooWCxHan2QdiEzwqAXxF9EivVdap4vWghgoWsYcwiEd5AP9: stream reset811aade587=peer 12D3KooWPStnitMbLyWAGr32gHmPr53
78578   2024-04-23T08:37:44.308-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 81880, "errmsg": "preprocess fetch layer 81880 proposals: batch failure: 14f25bc359=peer 12D3KooWBhzgPDkM7UgY9XFLSBj2REVQoUFxnzanM7tuAznRB77n: stream reset28baa63a32=peer 12D3KooWNtfKmp5hmf6EWLNaSjHXDoF
88326   2024-04-16T13:53:29.259-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79927, "errmsg": "preprocess fetch layer 79927 proposals: batch failure: bc28346a7e=peer 12D3KooWAcWXXCwsJN5Ax187Va292rxKJ8oaXWUq8bEKSy7Y2oAj: 25.013572s elapsed, 0 bytes read, 465 bytes written, timeou
90997   2024-04-16T18:02:51.327-0700    ERROR   node.blockGenerator     failed to process hare output   {"layer_id": 79977, "errmsg": "preprocess fetch layer 79977 proposals: batch failure: 2c4362c522=peer 12D3KooWLfLNDK4xqvQbi39oUoUW184e4USaWy2w8UBdJWWN2zxe: 25.0020344s elapsed, 0 bytes read, 164 bytes written, timeo
3681596 2024-04-18T16:11:10.859-0700    INFO    node.sync       downloaded atxs {"total": 2712056, "downloaded": 2449093, "missing": ["0000208eca", "000066016c", "0001b5128f", "00022025d2", "0004443850", "0004e3ff89", "000525e405", "0005f91146", "000839b976", "0008485c90", "0009d8a25d", "000a3c75f9", "000b65e69a", "000
6246144 2024-04-18T01:18:48.553-0700    INFO    node.sync       downloaded atxs {"total": 2712056, "downloaded": 2265911, "missing": ["00000cb1a2", "0000208eca", "000066016c", "00007e7473", "0000df279b", "0000ed587f", "0000f1a50a", "00012c23f2", "000131b00b", "00013a908c", "0001498808", "000187530b", "0001b5128f", "000

Affected code

Unknown

This issue appears in commit hash: v1.5.0

Related files (optionally with line numbers):