Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fast sync parallel #270

Open
wants to merge 211 commits into
base: dev
Choose a base branch
from
Open

Fast sync parallel #270

wants to merge 211 commits into from

Conversation

tbssajal
Copy link
Collaborator

No description provided.

Arghya115 and others added 30 commits August 26, 2022 21:28
@Arghya115 @tbssajal
resilient fast_sync working, with additional consistency check, lot o…
9273dd6 
…f logging, will be helpful for debugging if needed
@Arghya115 @tbssajal
working, speed issue fixed
da4db33
@Arghya115 @tbssajal
fault-tolerant fast_sync working, tested multiple times
6516e6e
@Arghya115 @tbssajal
getting peers from config file instead of hardcoding, change in loggi…
a265d60 
…ng minor fix in an api
@Arghya115 @tbssajal
minor change of logging level in fast_sync
ec9e997
@Arghya115 @tbssajal
removed .cs from folder name
790a4fd
@Arghya115 @tbssajal
batch size of blockHeaderDOwnloader changed(1000), TryGetBatch issue …
547fb9f 
…with(Min) fixed
@Arghya115 @tbssajal
resilient fast_sync working, with additional consistency check, lot o…
6e3128d 
…f logging, will be helpful for debugging if needed
@Arghya115 @tbssajal
working, speed issue fixed
70663ee
@Arghya115 @tbssajal
fault-tolerant fast_sync working, tested multiple times
5f9784d
@Arghya115 @tbssajal
getting peers from config file instead of hardcoding, change in loggi…
25b2687 
…ng minor fix in an api
@Arghya115 @tbssajal
removed .cs from folder name
c3a87af
@Arghya115 @tbssajal
nodeDownloader batchSize set to 500, changed logging
83734fc
@Arghya115 @tbssajal
added comments
4f9e776
@tariqsalam @tbssajal
added proto for root-hash-by-trie-name and block-batch for fastsync a…
c19ab39 
…nd corresponding methods in messageHandler.cs
@tariqsalam @tbssajal
fixed some logs
a89e0df
@tariqsalam @tbssajal
added methods to get trinodes
9f13c53
@tariqsalam @tbssajal
added methods for MessageFactory.cs
38850b7
@tariqsalam @tbssajal
added methods in interface
8ba7014
@tariqsalam @tbssajal
added unit tests for messaging
4c44681
@tariqsalam @tbssajal
removed unnecessary line
600d1ca
@tariqsalam @tbssajal
using switch instead of if
357d506
@tariqsalam @tbssajal
added comment documentation
c29dfdc
@tariqsalam @tbssajal
added event handler for new methods
b4b6e71
@tariqsalam @tbssajal
subscribed event handler for new methods
6f05292
@tariqsalam @tbssajal
added chekcpoint class, interface, registered in module, created basi…
acb03df 
…c methods
@tariqsalam @tbssajal
added repository for block-checkpoint, registered module, created bas…
0d2c23e 
…ic methods
@tariqsalam @tbssajal
added entryprefix
bc3e486
@tariqsalam @tbssajal
added some methods
f2f94ce
@tariqsalam @tbssajal
added repository id
cb055a3
tariqsalam and others added 28 commits August 26, 2022 22:42
@tariqsalam @tbssajal
added unit tests for checkpoint related network messaging
325a7d5
@tariqsalam @tbssajal
fixed some bugs
f947dc2
@tariqsalam @tbssajal
added request id in network message, fixed test
8e0820f
@tariqsalam @tbssajal
Added helper method for checkpoint
4aaf282
@tariqsalam @tbssajal
removed unnecessary part of codes
917d0e0
@tariqsalam @tbssajal
handled reply from peer and updated some method
50c7ab2
@tariqsalam @tbssajal
handling checkpoint reply, integrating blocksynchronizer with fastsyn…
35f6e83 
…c, modifying structure to hadnle further improvement
@tariqsalam @tbssajal
fixed unit tests
1dd4c45
@tariqsalam @tbssajal
added some more messages and fixed unit tests, adding method to check…
22fbf45 
… checkpoint infos
@tariqsalam @tbssajal
added some network message, fixed unit tests
46fa9bb
@tariqsalam @tbssajal
adding checkpoint handling methods
a0fa713
@tariqsalam @tbssajal
integrated fastsync with blocksynchronizer
846e103
@tariqsalam @tbssajal
updated checkpoint implementation
fbdf09a
@tariqsalam @tbssajal
Added necessary logs
3c8caf4
@tariqsalam @tbssajal
optimized from in memory usage, removed some info from db after they …
223e54e 
…were not needed anymore, moved all db related operations in dedicated class
@tariqsalam @tbssajal
Adding checkpoint config files
a019975
@tariqsalam @tbssajal
added checkpoint config, fixed unit tests, updated checkpoint related…
bf20dc9 
… implementation, renamed namespace for convinience
@tbssajal
renamed namespace for ease of review
8eaf07d
@tbssajal
fixed a bug, added warnings for invalid response, added block verific…
0613208 
…ation
@tbssajal
renamed file for ease of review
70f0d84
@tbssajal
same as dev to prevent unit test fail
2a223a2
@tbssajal
updated checkpoint implementation, removed saving checkpoint, added c…
9e68574 
…heckpoint verification when node starts, updating checkpoint from Application.cs
@tbssajal
fixed bug: commit in batch and clear cache for memory optimization
af80959
@tbssajal
updated checkpoint to keep only last and pending checkpoints
92375d9
@tbssajal
updating Block verification
212696b
@tbssajal
added block verification process with different thread so it does not…
416abc9 
… interrupt async downloading
@tbssajal
rebase
2d09c73
@tbssajal
resolved conflict and rebase
cec9ea2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sgladkov sgladkov Awaiting requested review from sgladkov

@kunalgoyal9 kunalgoyal9 Awaiting requested review from kunalgoyal9

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@tbssajal @Arghya115 @tariqsalam