Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PIBD Testnet Testing Report Thread (NEED LOGS) #3697

Open
yeastplume opened this issue Feb 28, 2022 · 3 comments
Open

PIBD Testnet Testing Report Thread (NEED LOGS) #3697

yeastplume opened this issue Feb 28, 2022 · 3 comments

Comments

@yeastplume
Copy link
Member

Please report any and all issues from testnet PIBD as a comment in this thread. Please note your report will likely not be very useful at this stage without debug logs, so please post as much relevant log information as you can.
@pkariz
Copy link

pkariz commented Mar 7, 2022

On my first try i got stuck here:
Screenshot from 2022-02-27 23-04-24
Logs related to that time (unfortunately at that time i had file_log_level = "Info"):

20220227 22:25:01.598 INFO grin_servers::common::adapters - Received 32 block headers from IP1:13414
20220227 22:25:01.665 INFO grin_servers::common::adapters - Received 32 block headers from IP1:13414
20220227 22:25:01.695 INFO grin_servers::common::adapters - Received 32 block headers from IP1:13414
20220227 22:25:01.726 INFO grin_servers::common::adapters - Received 32 block headers from IP1:13414
20220227 22:25:01.751 INFO grin_servers::common::adapters - Received 6 block headers from IP1:13414
20220227 22:33:18.497 INFO grin_servers::common::types - DandelionEpoch: next_epoch: is_stem: true (90%), relay: Some(PeerAddr(IP2:13414))
20220227 22:43:28.561 INFO grin_servers::common::types - DandelionEpoch: next_epoch: is_stem: true (90%), relay: Some(PeerAddr(IP1:13414))
20220227 22:50:47.072 INFO grin_store::lmdb - Resized database from 939524096 to 1476395008
20220227 22:51:32.790 INFO grin_servers::grin::sync::syncer - synchronized at 1129299186803 @ 1147885 [0f11ef61ba06]
20220227 22:53:38.652 INFO grin_servers::common::types - DandelionEpoch: next_epoch: is_stem: false (90%), relay: Some(PeerAddr(IP3:13414))
20220227 23:03:48.758 INFO grin_servers::common::types - DandelionEpoch: next_epoch: is_stem: true (90%), relay: Some(PeerAddr(IP4:3414))
20220227 23:13:58.876 INFO grin_servers::common::types - DandelionEpoch: next_epoch: is_stem: true (90%), relay: Some(PeerAddr(IP4:3414))

After quiting the node and restarting it, it successfully synced.

I then tried to sync again, so i've manually deleted the chain data but i then got stuck on step 3/7 as the image bellow shows. Bellow the image are logs related to that time.
Screenshot from 2022-02-28 01-53-30

20220228 00:47:19.260 DEBUG grin_chain::txhashset::desegmenter - PIBD Desegmenter Validation Loop: PMMRs complete up to block 1046327: BlockHeader { version: HeaderVersion(5), height: 1046327, prev_hash: 64915eef379f, prev_root: b0f6c6f4d67f, timestamp: 2021-12-12T13:03:34Z, output_root: fecf3ce21317, range_proof_root: 6636656a0e6c, kernel_root: e82e246c273a, total_kernel_offset: BlindingFactor(<secret key hidden>), output_mmr_size: 2306043, kernel_mmr_size: 2160422, pow: ProofOfWork { total_difficulty: Difficulty { num: 1126498978434 }, secondary_scaling: 0, nonce: 5593490531392476048, proof: Cuckoo32(11540f91 155745be 2282da7e 2e5a93cb 31f58706 322560f3 32731d52 39dd8f34 411424f2 4cfe6fe9 4d9b19be 4fa94b63 63650ac8 65fbde14 66d3b44d 68b8fc20 6bdc4356 71639d1c 7362fb87 77fba41f 78a14d06 7df3c258 84ef8cc9 8d127c5d 8dfba6be 91de7ed0 99e2d93d a8d6751f ab4e9cd8 bcdcc6e8 c4ae1a9a cb89a6df cb9642c9 cc02b1c1 cf5c388c cfd974ea dcb46c85 e6d26bf8 e8db1357 f0519235 f33ed313 f977b6ef) } }
20220228 00:47:26.391 DEBUG grin_chain::txhashset::desegmenter - PIBD Desegmenter Validation Loop: PMMRs complete up to block 1081060: BlockHeader { version: HeaderVersion(5), height: 1081060, prev_hash: 3062edf1c15b, prev_root: 178fb558f761, timestamp: 2022-01-05T14:31:09Z, output_root: 45b912ba02cb, range_proof_root: d55603360794, kernel_root: d9529e0e331e, total_kernel_offset: BlindingFactor(<secret key hidden>), output_mmr_size: 2375663, kernel_mmr_size: 2229971, pow: ProofOfWork { total_difficulty: Difficulty { num: 1127474333857 }, secondary_scaling: 0, nonce: 17893877741750367776, proof: Cuckoo32(f341ebf f34847f 144596f2 1861e495 1d737807 1f341665 230a016d 293b8e33 3ab9b4b0 43e1b5f3 464056cd 48b88cc5 5225c79a 533f5bf7 5822bb2a 5ddfbde8 693e2364 6f7b1099 71faf891 757fbe65 81e2c30e 89530c9e 89c8f841 997c0aed 9c6f4fc1 a13a7d28 a2649518 a2b998b7 ad2f6dd7 b4431751 b5f663c2 bfc4e4c7 c40be458 c54445fc cab8ea27 d043b9d8 e66b9742 e80a2fc3 eafd27b8 f2e42787 fb6f3dd5 fed450f8) } }
20220228 00:47:33.781 DEBUG grin_chain::txhashset::desegmenter - PIBD Desegmenter Validation Loop: PMMRs complete up to block 1121929: BlockHeader { version: HeaderVersion(5), height: 1121929, prev_hash: 4d350f7c65b2, prev_root: a27bd11dd4b6, timestamp: 2022-02-08T00:39:29Z, output_root: 1284daf26fd3, range_proof_root: 61d3bb86a976, kernel_root: c381e6a1e6ce, total_kernel_offset: BlindingFactor(<secret key hidden>), output_mmr_size: 2457596, kernel_mmr_size: 2311802, pow: ProofOfWork { total_difficulty: Difficulty { num: 1128572879239 }, secondary_scaling: 0, nonce: 1127904320252587136, proof: Cuckoo32(7fec9e7 14aa0ff2 1d1de25c 1de3942d 2288ef7c 23e7a525 2bf0b0a9 3fd94a36 4067e406 40edaaa3 40f3785a 47803f5a 490832e1 4f0f1a43 5a8509d1 5c7f626e 69fb3418 6cf2c430 6e0c1932 77d1bbdb 78a8408f 7cec9766 7dcf634d 83de7b5e 86e7f08a 91e94d34 950dfef8 98ccaf81 a2997bd7 a5286aee a9d641b4 b84cf762 c33863db d1c9bbad d387e7ab db311955 dc7daaf8 ddb6cb1a e2914540 e948e336 ea2de698 ef099722) } }
20220228 00:47:37.419 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP1:13414. previous connecting time: 23:47:17.412
20220228 00:47:37.420 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (3 most_work). all 13 = 5 healthy + 0 banned + 8 defunct
20220228 00:47:37.609 DEBUG grin_p2p::peer - connect: handshaking with Ok(IP2:13414)
20220228 00:47:37.802 DEBUG grin_p2p::handshake - Connected! Cumulative 1129376285898 offered from PeerAddr(IP2:13414), ProtocolVersion(1000), "MW/Grin 5.1.1", HEADER_HIST | TXHASHSET_HIST | PEER_LIST | TX_KERNEL_HASH | PIBD_HIST
20220228 00:47:37.802 DEBUG grin_p2p::peers - Adding newly connected peer IP2:13414.
20220228 00:47:37.802 DEBUG grin_p2p::peers - Saving newly connected peer IP2:13414.
20220228 00:47:37.802 DEBUG grin_p2p::store - save_peer: PeerAddr(IP2:13414) marked Healthy
20220228 00:47:40.785 DEBUG grin_chain::txhashset::desegmenter - PIBD Desegmenter Validation Loop: PMMRs complete up to block 1147680: BlockHeader { version: HeaderVersion(5), height: 1147680, prev_hash: 32672c915033, prev_root: 2ec680f34ecb, timestamp: 2022-02-25T21:04:01Z, output_root: 7dc707c0af65, range_proof_root: 2b2d8760fe6a, kernel_root: f095cf86113b, total_kernel_offset: BlindingFactor(<secret key hidden>), output_mmr_size: 2509145, kernel_mmr_size: 2363330, pow: ProofOfWork { total_difficulty: Difficulty { num: 1129293324702 }, secondary_scaling: 0, nonce: 13383465540274292416, proof: Cuckoo32(1377248c 13a7cf6b 153d42d8 2fdbb144 3587143d 36018ea7 38cdeb96 3ad52307 3e62da41 4267c31b 48848ce6 4cbf5ee6 5337a48d 57265c5c 5c385c92 701ae59d 7c798b83 7fc6a6d4 858a13a0 87ee2b25 8c4da5dc 8cc76fac 9083daf1 9126d848 94383f2d 98845182 9a45a120 ab16360d ab25784c ab827c34 b199a524 bfb7cb2d c954294a cc1e550a d1d9fc5f dc8792a8 de680bf9 e281eafc e53b56b6 e9bb18d1 ecd7ce31 f94c3c6c) } }
20220228 00:47:40.789 DEBUG grin_chain::types - validate roots: 4e78750a2ec3 at 1147680, 7dc707c0af65 vs. 7dc707c0af65 (original: 3677d2eb4226, merged: 7dc707c0af65)
20220228 00:47:40.789 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetPibd { aborted: false, errored: false, completed_to_height: 1147680, required_height: 1147680 } -> TxHashsetSetup
20220228 00:47:40.789 DEBUG grin_chain::txhashset::desegmenter - desegmenter validation: rewinding and validating kernel history (readonly)
20220228 00:47:45.015 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220228 00:47:45.015 DEBUG grin_servers::common::adapters - Received compact_block 6283faf00952 at 1150738 from IP3:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220228 00:47:45.015 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6283faf00952 at 1150738 (v3)
20220228 00:47:50.763 DEBUG grin_chain::txhashset::desegmenter - desegmenter validation: validated kernel root on 1147680 headers
20220228 00:47:50.763 DEBUG grin_chain::txhashset::txhashset - Rewind header extension to 0a140990b8a7 at 1150737 from 0a140990b8a7 at 1150737
20220228 00:47:50.782 DEBUG grin_chain::pipe - header head updated to 6283faf00952 at 1150738
20220228 00:47:50.786 DEBUG grin_chain::chain - is_orphan: 6283faf00952, # orphans 8
20220228 00:47:57.428 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP2:13414. previous connecting time: 23:47:37.419
20220228 00:47:57.428 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 5 connected (1 most_work). all 13 = 6 healthy + 0 banned + 7 defunct
20220228 00:48:17.437 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP4:13414. previous connecting time: 23:47:57.428
20220228 00:48:17.437 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 5 connected (1 most_work). all 13 = 6 healthy + 0 banned + 7 defunct
20220228 00:48:24.318 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220228 00:48:24.318 DEBUG grin_servers::common::adapters - Received compact_block 454a9a2cad15 at 1150739 from IP3:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220228 00:48:24.318 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 454a9a2cad15 at 1150739 (v3)
20220228 00:48:37.444 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP5:13414. previous connecting time: 23:48:17.437

after that i have only monitor_peers and peer_connect logs, eg:

20220228 00:59:38.351 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 5 connected (1 most_work). all 13 = 6 healthy + 0 banned + 7 defunct
20220228 00:59:58.389 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP6:13414. previous connecting time: 23:59:38.351

After pressing q to shutdown the node, it got stuck in the shutting down state, logs related to that:

20220228 02:44:26.643 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 5 connected (3 most_work). all 13 = 6 healthy + 0 banned + 7 defunct
20220228 02:44:30.658 WARN grin::tui::ui - Shutdown in progress, please wait
20220228 02:44:30.658 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup -> Shutdown
20220228 02:44:30.705 INFO grin_api::rest - API server has been stopped
20220228 02:44:31.649 INFO grin_servers::grin::server - connect_and_monitor thread stopped

@yeastplume
Copy link
Member Author

@pkariz thanks very much for clearly reporting this, I appreciate it. I've done some work since that may fix these issues, would you be able to test against the latest version in pibd_impl? (If and when you have time, of course). Appreciate it!

@pkariz
Copy link

pkariz commented Mar 8, 2022 •
edited

Tried to resync now from the latest pibd_impl (commit: b08a6dd), it got stuck here:

Screenshot from 2022-03-08 18-59-50

Logs related to it:

20220308 16:59:58.815 DEBUG grin_servers::common::adapters - Received proof segment 609 for block_hash: 9b5688be10ad
20220308 17:00:05.431 DEBUG grin_servers::common::adapters - Received output segment 604 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:05.476 DEBUG grin_servers::common::adapters - Received output segment 603 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:06.170 DEBUG grin_servers::common::adapters - Received output segment 607 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:08.573 DEBUG grin_servers::common::adapters - Received output segment 605 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:08.575 DEBUG grin_servers::common::adapters - Received output segment 606 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:12.047 DEBUG grin_servers::common::adapters - Received proof segment 612 for block_hash: 9b5688be10ad
20220308 17:00:12.281 DEBUG grin_servers::common::adapters - Received proof segment 615 for block_hash: 9b5688be10ad
20220308 17:00:13.379 DEBUG grin_servers::common::adapters - Received proof segment 611 for block_hash: 9b5688be10ad
20220308 17:00:15.044 DEBUG grin_chain::txhashset::txhashset - Rewind header extension to 48b9e4c219e4 at 1163263 from 48b9e4c219e4 at 1163263
20220308 17:00:15.061 DEBUG grin_chain::pipe - header head updated to 461c45584410 at 1163264
20220308 17:00:15.071 DEBUG grin_p2p::peer - Requesting compact block 461c45584410 from IP1:3414
20220308 17:00:15.096 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:15.096 DEBUG grin_servers::common::adapters - Received compact_block 461c45584410 at 1163264 from IP1:3414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:15.096 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 461c45584410 at 1163264 (v3)
20220308 17:00:15.096 DEBUG grin_chain::chain - is_orphan: 461c45584410, # orphans 16
20220308 17:00:15.112 DEBUG grin_servers::common::adapters - Received proof segment 614 for block_hash: 9b5688be10ad
20220308 17:00:15.117 DEBUG grin_servers::common::adapters - Received proof segment 613 for block_hash: 9b5688be10ad
20220308 17:00:15.117 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:15.117 DEBUG grin_servers::common::adapters - Received compact_block 461c45584410 at 1163264 from IP2:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:15.117 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 461c45584410 at 1163264 (v3)
20220308 17:00:15.117 DEBUG grin_chain::chain - is_orphan: 461c45584410, # orphans 16
20220308 17:00:15.121 DEBUG grin_p2p::peer - Requesting compact block 461c45584410 from IP3:13414
20220308 17:00:15.381 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:15.381 DEBUG grin_servers::common::adapters - Received compact_block 461c45584410 at 1163264 from IP3:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:15.382 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 461c45584410 at 1163264 (v3)
20220308 17:00:15.382 DEBUG grin_chain::chain - is_orphan: 461c45584410, # orphans 16
20220308 17:00:15.705 DEBUG grin_p2p::peer - Requesting compact block 461c45584410 from IP4:13414
20220308 17:00:15.739 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:15.739 DEBUG grin_servers::common::adapters - Received compact_block 461c45584410 at 1163264 from IP4:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:15.739 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 461c45584410 at 1163264 (v3)
20220308 17:00:17.423 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP5:13414. previous connecting time: 15:59:57.416
20220308 17:00:17.423 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (1 most_work). all 15 = 5 healthy + 0 banned + 10 defunct
20220308 17:00:18.763 DEBUG grin_chain::chain - is_orphan: 461c45584410, # orphans 16
20220308 17:00:20.094 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:20.094 DEBUG grin_servers::common::adapters - Received compact_block 6272cd3f629a at 1163265 from IP2:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:20.094 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6272cd3f629a at 1163265 (v3)
20220308 17:00:22.071 DEBUG grin_chain::txhashset::txhashset - Rewind header extension to 461c45584410 at 1163264 from 461c45584410 at 1163264
20220308 17:00:22.093 DEBUG grin_chain::pipe - header head updated to 6272cd3f629a at 1163265
20220308 17:00:22.097 DEBUG grin_chain::chain - is_orphan: 6272cd3f629a, # orphans 17
20220308 17:00:22.097 DEBUG grin_p2p::peer - Requesting compact block 6272cd3f629a from IP1:3414
20220308 17:00:22.097 DEBUG grin_p2p::peer - Requesting compact block 6272cd3f629a from IP3:13414
20220308 17:00:22.097 DEBUG grin_p2p::peer - Requesting compact block 6272cd3f629a from IP4:13414
20220308 17:00:22.124 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:22.124 DEBUG grin_servers::common::adapters - Received compact_block 6272cd3f629a at 1163265 from IP1:3414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:22.124 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6272cd3f629a at 1163265 (v3)
20220308 17:00:22.124 DEBUG grin_chain::chain - is_orphan: 6272cd3f629a, # orphans 17
20220308 17:00:22.141 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:22.141 DEBUG grin_servers::common::adapters - Received compact_block 6272cd3f629a at 1163265 from IP4:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:22.141 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6272cd3f629a at 1163265 (v3)
20220308 17:00:22.141 DEBUG grin_chain::chain - is_orphan: 6272cd3f629a, # orphans 17
20220308 17:00:22.228 DEBUG grin_servers::common::adapters - Received output segment 611 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:22.283 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:00:22.283 DEBUG grin_servers::common::adapters - Received compact_block 6272cd3f629a at 1163265 from IP3:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:00:22.283 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6272cd3f629a at 1163265 (v3)
20220308 17:00:22.283 DEBUG grin_chain::chain - is_orphan: 6272cd3f629a, # orphans 17
20220308 17:00:22.359 DEBUG grin_servers::common::adapters - Received output segment 609 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:22.427 DEBUG grin_servers::common::adapters - Received output segment 612 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:22.456 DEBUG grin_servers::common::adapters - Received output segment 610 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:23.272 DEBUG grin_servers::common::adapters - Received output segment 608 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:32.240 DEBUG grin_servers::common::adapters - Received proof segment 618 for block_hash: 9b5688be10ad
20220308 17:00:32.296 DEBUG grin_servers::common::adapters - Received proof segment 616 for block_hash: 9b5688be10ad
20220308 17:00:32.541 DEBUG grin_servers::common::adapters - Received proof segment 617 for block_hash: 9b5688be10ad
20220308 17:00:37.459 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP6:13414. previous connecting time: 16:00:17.423
20220308 17:00:37.460 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (4 most_work). all 15 = 5 healthy + 0 banned + 10 defunct
20220308 17:00:41.919 DEBUG grin_servers::common::adapters - Received output segment 613 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:41.926 DEBUG grin_servers::common::adapters - Received output segment 614 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:42.626 DEBUG grin_servers::common::adapters - Received output segment 616 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:45.096 DEBUG grin_servers::common::adapters - Received output segment 617 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:45.100 DEBUG grin_servers::common::adapters - Received output segment 615 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:00:57.496 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP7:13414. previous connecting time: 16:00:37.459
20220308 17:00:57.496 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (4 most_work). all 15 = 5 healthy + 0 banned + 10 defunct
20220308 17:00:58.366 DEBUG grin_servers::common::adapters - Received output segment 618 for block_hash: 9b5688be10ad, bitmap_root: 1f1559885d8f
20220308 17:01:17.533 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP8:13414. previous connecting time: 16:00:57.496
20220308 17:01:17.533 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (4 most_work). all 15 = 5 healthy + 0 banned + 10 defunct
20220308 17:01:37.349 DEBUG grin_chain::types - validate roots: 9b5688be10ad at 1159920, 4282cd34b165 vs. 4282cd34b165 (original: 5dd7b5cd3e86, merged: 4282cd34b165)
20220308 17:01:37.349 DEBUG grin_chain::txhashset::desegmenter - desegmenter validation: rewinding and validating kernel history (readonly)
20220308 17:01:37.570 DEBUG grin_servers::grin::seed - peer_connect: ignore a duplicate request to IP7:13414. previous connecting time: 16:01:17.533
20220308 17:01:37.570 DEBUG grin_servers::grin::seed - monitor_peers: on 0.0.0.0:13414, 4 connected (4 most_work). all 15 = 5 healthy + 0 banned + 10 defunct
20220308 17:01:37.764 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetPibd { aborted: false, errored: false, completed_leaves: 3727559, leaves_required: 3727559, completed_to_height: 1159920, required_height: 1159920 } -> TxHashsetSetup { headers: Some(59920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:38.438 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(59920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(159920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:39.200 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(159920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(259920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:39.929 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(259920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(359920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:40.640 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(359920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(459920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:41.195 DEBUG grin_p2p::protocol - handle_payload: received compact block
20220308 17:01:41.195 DEBUG grin_servers::common::adapters - Received compact_block 6fb6a1787d3e at 1163266 from IP2:13414 [out/kern/kern_ids: 1/1/0] going to process.
20220308 17:01:41.195 DEBUG grin_servers::common::adapters - successfully hydrated (empty) block: 6fb6a1787d3e at 1163266 (v3)
20220308 17:01:41.335 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(459920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(559920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:41.989 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(559920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(659920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:42.696 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(659920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(759920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:43.357 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(759920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(859920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:44.019 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(859920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(959920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:44.672 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(959920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(1059920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:45.281 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(1059920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> TxHashsetSetup { headers: Some(1159920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None }
20220308 17:01:45.281 DEBUG grin_chain::txhashset::desegmenter - desegmenter validation: validated kernel root on 1159920 headers
20220308 17:01:45.281 DEBUG grin_chain::txhashset::txhashset - Rewind header extension to 6272cd3f629a at 1163265 from 6272cd3f629a at 1163265
20220308 17:01:45.300 DEBUG grin_chain::pipe - header head updated to 6fb6a1787d3e at 1163266
20220308 17:01:45.309 DEBUG grin_chain::chain - is_orphan: 6fb6a1787d3e, # orphans 18
20220308 17:01:45.309 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:46.309 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:47.310 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:48.310 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:49.310 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:50.310 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:51.310 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:52.311 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:53.311 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:54.311 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:55.311 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:56.312 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 17:01:57.312 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!

After pressing q it's stuck, the logs are pretty much the same:

20220308 19:08:51.132 WARN grin::tui::ui - Shutdown in progress, please wait
20220308 19:08:51.132 DEBUG grin_chain::types - sync_state: sync_status: TxHashsetSetup { headers: Some(1159920), headers_total: Some(1159920), kernel_pos: None, kernel_pos_total: None } -> Shutdown
20220308 19:08:51.227 INFO grin_api::rest - API server has been stopped
20220308 19:08:51.516 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 19:08:51.727 INFO grin_servers::grin::server - connect_and_monitor thread stopped
20220308 19:08:52.516 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 19:08:53.516 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 19:08:54.517 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 19:08:55.517 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!
20220308 19:08:56.517 ERROR grin_chain::txhashset::desegmenter - Header PMMR is thread locked somewhere (this should not be the case)!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pkariz @yeastplume