Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pn-counters are susceptible to partitioning #493

Open
nurturenature opened this issue Jul 22, 2022 · 0 comments
Open

pn-counters are susceptible to partitioning #493

nurturenature opened this issue Jul 22, 2022 · 0 comments

Comments

@nurturenature
Copy link

Running Jepsen tests on a pn-counter with partitioning has a high failure rate.

Please see previous issue for configuration and the environment to reproduce. Then:

lein run test --test-count 20 --workload pn-counter --rate 100 --topology dcs --nemesis partition

Most tests consistently fail most of the time:

  • all client op's return :ok
  • most final reads are unequal and most are invalid
  • non-monotonic reads with grow-only counters

Here's a plot of node read value differences from the complete total order counter, most tests are similar, showing 2 nodes ending up in a consistent state with 3 nodes diverging (swing, from p's to n's, counter):

offsets-parition

And a counter where 4 nodes converge to an invalid value:

offsets-partition-2

The nature and comprehensiveness in the respose to partitioning seemed to merit its own issue. Also to raise the status of the current zero mq being used.

Please suggest if it would be helpful to make any changes to the tests or environment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant