Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Remove L0 compactor in completedCompactor #33169

Merged
merged 1 commit into from
May 21, 2024

Conversation

XuanYang-cn
Copy link
Contributor

See also: #33168

See also: milvus-io#33168

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
@sre-ci-robot sre-ci-robot added the size/M Denotes a PR that changes 30-99 lines. label May 20, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/bug Issues or changes related a bug labels May 20, 2024
Copy link
Contributor

mergify bot commented May 20, 2024

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

lo.ForEach(completedLevelZero, func(planID int64, _ int) {
c.completed.Remove(planID)
c.completedCompactor.Remove(planID)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be removed by injectDone?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

L0 compaction has no call back, so won't be called SyncSegments, and won't be called injectDone.

Althrough its weired to remove in get, but it's only communication DC and DN will do on L0 compaction, so it's the only chance to remove the l0 tasks in DN memory by Get.

@XuanYang-cn
Copy link
Contributor Author

/run-cpu-e2e

Copy link

codecov bot commented May 20, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.86%. Comparing base (a7f6193) to head (4586249).
Report is 12 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #33169      +/-   ##
==========================================
- Coverage   82.18%   81.86%   -0.33%     
==========================================
  Files        1009     1009              
  Lines      128806   128823      +17     
==========================================
- Hits       105860   105456     -404     
- Misses      18953    19371     +418     
- Partials     3993     3996       +3     
Files Coverage Δ
internal/datanode/compaction_executor.go 93.39% <100.00%> (+4.82%) ⬆️

... and 33 files with indirect coverage changes

@mergify mergify bot added the ci-passed label May 20, 2024
Copy link
Contributor

@congqixia congqixia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit b3bcc10 into milvus-io:master May 21, 2024
15 checks passed
@XuanYang-cn XuanYang-cn deleted the fix/rm-l0-compactor branch May 21, 2024 06:30
XuanYang-cn added a commit to XuanYang-cn/milvus that referenced this pull request May 21, 2024
See also: milvus-io#33168
pr: milvus-io#33169

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request May 21, 2024
See also: #33168
pr: #33169

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/bug Issues or changes related a bug lgtm size/M Denotes a PR that changes 30-99 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants