Skip to content
This repository has been archived by the owner on Mar 28, 2020. It is now read-only.

tuning the liveness check time of etcd pod #2108

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

armstrongli
Copy link

@armstrongli armstrongli commented Aug 5, 2019

liveness probe needs to take care of the following steps' time:

  • time to transmit a 4GB snapshot from leader to member -- 4000MB / 50MB/s = 80s
  • time to load snapshot —— 4000MB / 200MB/s = 20s
  • time to set up streams and follow up leader revisions -- 100s * 10 heartbeat/s * 1KB/heartbeat / 1024KB/MB / 50MB/s ~= 20s

total time -- 120s

Fix: #2109

Please read https://github.com/coreos/etcd-operator/blob/master/CONTRIBUTING.md#contribution-flow

liveness probe needs to take care of the following steps' time:
* time to transmit a 4GB snapshot from leader to member -- 4000MB / 50MB/s = 80s
* time to load snapshot —— 4000MB / 200MB/s = 20s
* time to set up streams and follow up leader revisions -- 100s * 10 heartbeat/s * 1KB/heartbeat / 1024KB/MB / 50MB/s ~= 20s

total time -- 120s
@andyliuliming
Copy link

Hi @armstrongli FYI, I also did something for this.
in this PR:
#2124
the liveness/readiness probe are exposed as some configs.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

etcd member cannot start up because of liveness check failures
2 participants