Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI Failure (AssertionError: Expected consumer to be throttled, metric value: 0) in EndToEndThrottlingTest.test_throttling #14139

Closed
oleiman opened this issue Oct 12, 2023 · 45 comments · Fixed by #17455, #17474 or #18451
Closed

CI Failure (AssertionError: Expected consumer to be throttled, metric value: 0) in EndToEndThrottlingTest.test_throttling #14139

oleiman opened this issue Oct 12, 2023 · 45 comments · Fixed by #17455, #17474 or #18451
Assignees
@Lazin
Labels
area/cloud-storage Shadow indexing subsystem ci-failure ci-rca/test CI Root Cause Analysis - Test Issue kind/bug Something isn't working sev/medium Bugs that do not meet criteria for high or critical, but are more severe than low.

Comments

@oleiman
Copy link
Member

oleiman commented Oct 12, 2023 •
edited by github-actions bot

https://buildkite.com/redpanda/redpanda/builds/38843#018b258e-3c04-46de-a3d9-1b6073086727

Module: rptest.tests.e2e_shadow_indexing_test
Class:  EndToEndThrottlingTest
Method: test_throttling
Arguments:
{
  "cloud_storage_type": 1
}

test_id:    rptest.tests.e2e_shadow_indexing_test.EndToEndThrottlingTest.test_throttling.cloud_storage_type=CloudStorageType.S3
status:     FAIL
run time:   4 minutes 13.106 seconds


    AssertionError('Expected consumer to be throttled, metric value: 0')
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 82, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/e2e_shadow_indexing_test.py", line 1294, in test_throttling
    assert times_throttled > 0, f"Expected consumer to be throttled, metric value: {times_throttled}"
AssertionError: Expected consumer to be throttled, metric value: 0

JIRA Link: CORE-2828
@oleiman oleiman added kind/bug Something isn't working ci-failure labels Oct 12, 2023
@oleiman oleiman mentioned this issue Oct 12, 2023
Merged
7 tasks
@andijcr andijcr added area/cloud-storage Shadow indexing subsystem sev/low Bugs which are non-functional paper cuts, e.g. typos, issues in log messages labels Oct 13, 2023
@StephanDollberg
Copy link
Member

https://buildkite.com/redpanda/redpanda/builds/39015

@ztlpn ztlpn mentioned this issue Oct 25, 2023
Open
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/39814
*https://buildkite.com/redpanda/redpanda/builds/40017

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/40517
*https://buildkite.com/redpanda/redpanda/builds/40972
*https://buildkite.com/redpanda/redpanda/builds/41483
*https://buildkite.com/redpanda/redpanda/builds/41734
*https://buildkite.com/redpanda/vtools/builds/10812
*https://buildkite.com/redpanda/redpanda/builds/41748
*https://buildkite.com/redpanda/redpanda/builds/41822
*https://buildkite.com/redpanda/redpanda/builds/42019
*https://buildkite.com/redpanda/redpanda/builds/42062
*https://buildkite.com/redpanda/redpanda/builds/42201
*https://buildkite.com/redpanda/redpanda/builds/42256
*https://buildkite.com/redpanda/redpanda/builds/42398
*https://buildkite.com/redpanda/redpanda/builds/42514
*https://buildkite.com/redpanda/redpanda/builds/42631
*https://buildkite.com/redpanda/redpanda/builds/42652

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/vtools/builds/11146

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/42890

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/43108

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/43255

@mmaslankaprv mmaslankaprv mentioned this issue Jan 4, 2024
Merged
7 tasks
@michael-redpanda michael-redpanda mentioned this issue Jan 5, 2024
Merged
7 tasks
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/43425
*https://buildkite.com/redpanda/vtools/builds/11290
*https://buildkite.com/redpanda/redpanda/builds/43521
*https://buildkite.com/redpanda/redpanda/builds/43534

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/43625

@piyushredpanda piyushredpanda mentioned this issue Jan 11, 2024
Merged
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/44032

@andijcr andijcr self-assigned this Jan 26, 2024
@andijcr andijcr added sev/medium Bugs that do not meet criteria for high or critical, but are more severe than low. and removed sev/low Bugs which are non-functional paper cuts, e.g. typos, issues in log messages labels Jan 26, 2024
@rockwotj rockwotj mentioned this issue Jan 31, 2024
Merged
@r-vasquez r-vasquez mentioned this issue Jan 31, 2024
Merged
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/44552

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/44740

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/44850
*https://buildkite.com/redpanda/vtools/builds/11761
*https://buildkite.com/redpanda/vtools/builds/11770
*https://buildkite.com/redpanda/redpanda/builds/44935
*https://buildkite.com/redpanda/redpanda/builds/44994
*https://buildkite.com/redpanda/redpanda/builds/45000
*https://buildkite.com/redpanda/redpanda/builds/45001

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/45088

@piyushredpanda piyushredpanda mentioned this issue Feb 20, 2024
Merged
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/45148

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/vtools/builds/12483
*https://buildkite.com/redpanda/redpanda/builds/46677
*https://buildkite.com/redpanda/redpanda/builds/46691
*https://buildkite.com/redpanda/redpanda/builds/46694
*https://buildkite.com/redpanda/redpanda/builds/46694
*https://buildkite.com/redpanda/redpanda/builds/46694
*https://buildkite.com/redpanda/redpanda/builds/46700

@rockwotj rockwotj mentioned this issue Mar 25, 2024
Merged
6 tasks
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/46708

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/46767
*https://buildkite.com/redpanda/redpanda/builds/46766
*https://buildkite.com/redpanda/redpanda/builds/46780
*https://buildkite.com/redpanda/redpanda/builds/46780
*https://buildkite.com/redpanda/redpanda/builds/46790

@Lazin Lazin added the ci-rca/test CI Root Cause Analysis - Test Issue label Mar 27, 2024
@dotnwat dotnwat mentioned this issue Mar 28, 2024
Merged
6 tasks
@Lazin Lazin mentioned this issue Mar 28, 2024
Merged
6 tasks
@michael-redpanda michael-redpanda mentioned this issue Mar 28, 2024
Merged
6 tasks
@andijcr andijcr mentioned this issue Mar 28, 2024
Merged
6 tasks
This was referenced Mar 28, 2024
Merged
Merged
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/46956
*https://buildkite.com/redpanda/redpanda/builds/46964
*https://buildkite.com/redpanda/redpanda/builds/46968
*https://buildkite.com/redpanda/redpanda/builds/46990
*https://buildkite.com/redpanda/redpanda/builds/47037
*https://buildkite.com/redpanda/redpanda/builds/47049

@vbotbuildovich vbotbuildovich mentioned this issue Mar 29, 2024
Closed
@piyushredpanda piyushredpanda mentioned this issue Apr 1, 2024
Merged
6 tasks
@michael-redpanda michael-redpanda mentioned this issue May 7, 2024
Merged
7 tasks
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/47062
*https://buildkite.com/redpanda/vtools/builds/12578
*https://buildkite.com/redpanda/redpanda/builds/48752
*https://buildkite.com/redpanda/redpanda/builds/48752
*https://buildkite.com/redpanda/redpanda/builds/48752
*https://buildkite.com/redpanda/redpanda/builds/48760
*https://buildkite.com/redpanda/redpanda/builds/48760
*https://buildkite.com/redpanda/redpanda/builds/48760
*https://buildkite.com/redpanda/redpanda/builds/48760
*https://buildkite.com/redpanda/redpanda/builds/48769
*https://buildkite.com/redpanda/redpanda/builds/48769
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48769
*https://buildkite.com/redpanda/redpanda/builds/48769
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48774
*https://buildkite.com/redpanda/redpanda/builds/48774
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48772
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48770
*https://buildkite.com/redpanda/redpanda/builds/48774
*https://buildkite.com/redpanda/redpanda/builds/48774
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48777
*https://buildkite.com/redpanda/redpanda/builds/48777
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48775
*https://buildkite.com/redpanda/redpanda/builds/48779
*https://buildkite.com/redpanda/redpanda/builds/48779
*https://buildkite.com/redpanda/redpanda/builds/48774
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48773
*https://buildkite.com/redpanda/redpanda/builds/48779
*https://buildkite.com/redpanda/redpanda/builds/48777
*https://buildkite.com/redpanda/redpanda/builds/48777

@vbotbuildovich vbotbuildovich reopened this May 7, 2024
@oleiman oleiman mentioned this issue May 7, 2024
Merged
@andijcr andijcr mentioned this issue May 8, 2024
Merged
7 tasks
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/48811
*https://buildkite.com/redpanda/redpanda/builds/48811
*https://buildkite.com/redpanda/redpanda/builds/48798
*https://buildkite.com/redpanda/redpanda/builds/48798
*https://buildkite.com/redpanda/redpanda/builds/48798
*https://buildkite.com/redpanda/redpanda/builds/48798
*https://buildkite.com/redpanda/redpanda/builds/48811
*https://buildkite.com/redpanda/redpanda/builds/48811
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/redpanda/builds/48813
*https://buildkite.com/redpanda/redpanda/builds/48813
*https://buildkite.com/redpanda/redpanda/builds/48813
*https://buildkite.com/redpanda/vtools/builds/13546
*https://buildkite.com/redpanda/redpanda/builds/48813
*https://buildkite.com/redpanda/redpanda/builds/48813
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48815
*https://buildkite.com/redpanda/redpanda/builds/48815
*https://buildkite.com/redpanda/redpanda/builds/48815
*https://buildkite.com/redpanda/redpanda/builds/48815
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48814
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/vtools/builds/13567
*https://buildkite.com/redpanda/vtools/builds/13566
*https://buildkite.com/redpanda/redpanda/builds/48811
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/redpanda/builds/48812
*https://buildkite.com/redpanda/redpanda/builds/48815
*https://buildkite.com/redpanda/redpanda/builds/48815

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/vtools/builds/13590
*https://buildkite.com/redpanda/redpanda/builds/48879
*https://buildkite.com/redpanda/redpanda/builds/48882
*https://buildkite.com/redpanda/vtools/builds/13607
*https://buildkite.com/redpanda/vtools/builds/13606

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/48915
*https://buildkite.com/redpanda/vtools/builds/13626

@nvartolomei nvartolomei mentioned this issue May 11, 2024
Open
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/48955
*https://buildkite.com/redpanda/redpanda/builds/48965

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/vtools/builds/13656
*https://buildkite.com/redpanda/redpanda/builds/48983

@Lazin Lazin mentioned this issue May 13, 2024
Merged
7 tasks
@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/vtools/builds/13666
*https://buildkite.com/redpanda/redpanda/builds/48990
*https://buildkite.com/redpanda/vtools/builds/13673

@vbotbuildovich
Copy link
Collaborator

*https://buildkite.com/redpanda/redpanda/builds/49046
*https://buildkite.com/redpanda/vtools/builds/13709

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Lazin Lazin

Labels
area/cloud-storage Shadow indexing subsystem ci-failure ci-rca/test CI Root Cause Analysis - Test Issue kind/bug Something isn't working sev/medium Bugs that do not meet criteria for high or critical, but are more severe than low.
Projects
None yet
Milestone
No milestone
5 participants
@Lazin @andijcr @oleiman @StephanDollberg @vbotbuildovich