Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expand the Progress struct to contain more detailed information #226

Open
3 of 6 tasks
shuhaowu opened this issue Jan 5, 2021 · 0 comments
Open
3 of 6 tasks

Expand the Progress struct to contain more detailed information #226

shuhaowu opened this issue Jan 5, 2021 · 0 comments

Comments

@shuhaowu
Copy link
Contributor

shuhaowu commented Jan 5, 2021

To evaluate performance, we need a few more data points in the Progress struct of Ghostferry. Right now, the candidates are:

  1. Amount of time spent while throttled.
  2. The current number of actively copying DataIterator goroutines.
  3. The number of rows copied per second (both per table and the sum).
  4. The cumulative number of rows copied thus far for a particular table.
  5. The number of bytes copied per second (both per table and the sum).
  6. The cumulative number of bytes copied thus far for a particular table.

For exporting table specific metrics (3-6), we can alter the TableProgress struct.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant