Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recaptcha Enterprise sample tests flaky due to quota #25793

Open
dazuma opened this issue Apr 25, 2024 · 0 comments
Open

Recaptcha Enterprise sample tests flaky due to quota #25793

dazuma opened this issue Apr 25, 2024 · 0 comments
Assignees
Labels
priority: p2 Moderately-important priority. Fix may not be included in next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@dazuma
Copy link
Member

dazuma commented Apr 25, 2024

The test appears to be running afoul of a limit on key management operations per minute. It affects recaptcha_enterprise v1 and v1beta1.

Example output:

  1) Failure:
Site key lifecycle#test_0003_lists site key [acceptance/site_key_test.rb:82]:
In stdout.
--- expected
+++ actual
@@ -1279,6 +1279,7 @@
 projects/542339357638/keys/6Ld9tA8oAAAAAK7OTR23MbXS_vC1KvaG95AFEA65
 projects/542339357638/keys/6Lc1HAsoAAAAAJ8z1vUIzdI0ZMpQQAIJBSuuVgXa
 projects/542339357638/keys/6Lc2IQsoAAAAAJNgqTUrIOhjCF7dhXivAoLtJqke
+projects/542339357638/keys/6Lc2IQsoAAAAAJNgqTUrIOhjCF7dhXivAoLtJqke
 projects/542339357638/keys/6LfW8gYoAAAAADklFArTM2Os7woUj3MdWO-ntob1
 projects/542339357638/keys/6LcSkAYoAAAAAGHCu0oTFTDWNyJBQAUxy_GzswW7
 projects/542339357638/keys/6LePZwIoAAAAAErw5JsQW7gGa8xkQvgQ9sAGE8fp


  2) Error:
Site key lifecycle#test_0002_updates site key:
Google::Cloud::ResourceExhaustedError: 8:Quota exceeded for quota metric 'Key Management Requests' and limit 'Key Management Requests per minute' of service 'recaptchaenterprise.googleapis.com' for consumer 'project_number:542339357638'.. debug_error_string:{UNKNOWN:Error received from peer ipv4:173.194.202.95:443 {created_time:"2024-04-25T13:13:17.560197693+00:00", grpc_status:8, grpc_message:"Quota exceeded for quota metric \'Key Management Requests\' and limit \'Key Management Requests per minute\' of service \'recaptchaenterprise.googleapis.com\' for consumer \'project_number:542339357638\'."}}
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:455:in `rescue in create_key'
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:417:in `create_key'
    acceptance/site_key_test.rb:53:in `create_test_site_key'
    acceptance/site_key_test.rb:68:in `block (2 levels) in '

  3) Error:
Site key lifecycle#after_all:
Google::Cloud::ResourceExhaustedError: 8:Quota exceeded for quota metric 'Key Management Requests' and limit 'Key Management Requests per minute' of service 'recaptchaenterprise.googleapis.com' for consumer 'project_number:542339357638'.. debug_error_string:{UNKNOWN:Error received from peer ipv4:173.194.202.95:443 {grpc_message:"Quota exceeded for quota metric \'Key Management Requests\' and limit \'Key Management Requests per minute\' of service \'recaptchaenterprise.googleapis.com\' for consumer \'project_number:542339357638\'.", grpc_status:8, created_time:"2024-04-25T13:13:17.584102373+00:00"}}
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:900:in `rescue in delete_key'
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:862:in `delete_key'
    acceptance/site_key_test.rb:37:in `block (3 levels) in '
    acceptance/site_key_test.rb:36:in `each'
    acceptance/site_key_test.rb:36:in `block (2 levels) in '

  4) Error:
Create Assessment#before_all:
Google::Cloud::ResourceExhaustedError: 8:Quota exceeded for quota metric 'Key Management Requests' and limit 'Key Management Requests per minute' of service 'recaptchaenterprise.googleapis.com' for consumer 'project_number:542339357638'.. debug_error_string:{UNKNOWN:Error received from peer ipv4:173.194.202.95:443 {created_time:"2024-04-25T13:13:17.605074915+00:00", grpc_status:8, grpc_message:"Quota exceeded for quota metric \'Key Management Requests\' and limit \'Key Management Requests per minute\' of service \'recaptchaenterprise.googleapis.com\' for consumer \'project_number:542339357638\'."}}
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:455:in `rescue in create_key'
    /h/.gem/gems/google-cloud-recaptcha_enterprise-v1-0.20.1/lib/google/cloud/recaptcha_enterprise/v1/recaptcha_enterprise_service/client.rb:417:in `create_key'
    acceptance/create_assessment_test.rb:59:in `get_site_key'
    acceptance/create_assessment_test.rb:35:in `block (2 levels) in '
@product-auto-label product-auto-label bot added the samples Issues that are directly related to samples. label Apr 25, 2024
@dazuma dazuma added type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. priority: p2 Moderately-important priority. Fix may not be included in next release. and removed samples Issues that are directly related to samples. labels Apr 25, 2024
@product-auto-label product-auto-label bot added the samples Issues that are directly related to samples. label Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: p2 Moderately-important priority. Fix may not be included in next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Development

No branches or pull requests

1 participant