Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add anti-entropy mechanism ("state sync") #37

Open
ktoso opened this issue Aug 24, 2020 · 0 comments
Open

Add anti-entropy mechanism ("state sync") #37

ktoso opened this issue Aug 24, 2020 · 0 comments
Labels
1 - triaged Task makes sense, is well defined, and is ready to be worked on t:swim

Comments

@ktoso
Copy link
Member

ktoso commented Aug 24, 2020

Because in the raw SWIM protocol we have here nodes may not be able to discover each-other in a very flaky network (esp. in the UDP implementation this is problematic).

The gossips are count limited when they are spread, and as such when cluster partitions happen the split may not be recovered from (in general raw SWIM is not great at dealing with this, and we don't necessarily want to solve it at this level entirely, but we should do better than just ignoring the topic in the UDP impl). A periodic triggered "sync all members" with some random nodes is used to avoid these problems; or a high level membership protocol sitting on top of SWIM can achieve the same results.

This is more of a shell details than an instance thing though perhaps?

@ktoso ktoso added 1 - triaged Task makes sense, is well defined, and is ready to be worked on t:swim labels Aug 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
1 - triaged Task makes sense, is well defined, and is ready to be worked on t:swim
Projects
None yet
Development

No branches or pull requests

1 participant