Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CDC resolved ts and checkpoint lag unstable and up to 2min #11060

Closed
fubinzh opened this issue May 9, 2024 · 4 comments
Closed

CDC resolved ts and checkpoint lag unstable and up to 2min #11060

fubinzh opened this issue May 9, 2024 · 4 comments
Assignees
@hicqu
Labels
area/ticdc Issues or PRs related to TiCDC. severity/major This is a major bug. type/bug This is a bug.
Projects
Question and Bug Reports

Comments

@fubinzh
Copy link

fubinzh commented May 9, 2024

What did you do?

  1. Deploy TiDB cluster with 2 CDC nodes (16c32g)
  2. Create kafka simple protocol changefeed
  3. Run workload for 4k tables (row width: 1.8k, cdc throughtput ~12k

What did you expect to see?

CDC lag should be stable

What did you see instead?

CDC resolve ts and checkpoint lag are very unstable, up to 2min sometimes.
image

Versions of the cluster

Release Version: v7.5.2-pr11031
Git Commit Hash: dd48f9e
Git Branch: heads/refs/tags/v7.5.2-pr11031
UTC Build Time: 2024-05-07 04:49:30
Go Version: go version go1.21.6 linux/amd64
Failpoint Build: false
@fubinzh fubinzh added area/ticdc Issues or PRs related to TiCDC. type/bug This is a bug. labels May 9, 2024
@github-actions github-actions bot added this to Need Triage in Question and Bug Reports May 9, 2024
@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/severity major

@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/label affects-7.5

@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/assign @hicqu

@asddongmen
Copy link
Contributor

Duplicated with #11078

Question and Bug Reports automation moved this from Need Triage to Done May 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hicqu hicqu

Labels
area/ticdc Issues or PRs related to TiCDC. severity/major This is a major bug. type/bug This is a bug.
Projects
Question and Bug Reports
Done
Milestone
No milestone
Development

No branches or pull requests
4 participants
@flowbehappy @fubinzh @hicqu @asddongmen