Skip to content

Is there a theoretical limit to how much data can be saved in one RIAK node? #1145

Answered by martinsumner
systream asked this question in Q&A
Discussion options

You must be logged in to vote

One key practical limit is handoffs, especially with ordered backends (leveldb/leveled) where the PUT speed slows with more frequent stalls as the vnode grows. If vnodes get too big, transfers may start to timeout. A transfer that times out is very expensive .. as it may require a lot of work to get back to where it was. In the worst case handoffs perpetually timeout -> restart -> timeout -> .....

There's been recent PRs to try and improve the handoff timeout situation, with some additional configuration tweaks added. But I would recommend as part of any non-functional test to determine sizing, to test how long a node replace takes, and if a node replace will complete reliably. If the nod…

Replies: 2 comments 1 reply

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
1 reply
@systream
Comment options

Answer selected by systream
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
3 participants