Skip to content
This repository has been archived by the owner on Nov 29, 2023. It is now read-only.

samples.snippets.quickstart.quickstart_test: test_quickstart failed #149

Closed
flaky-bot bot opened this issue Mar 18, 2021 · 9 comments
Closed

samples.snippets.quickstart.quickstart_test: test_quickstart failed #149

flaky-bot bot opened this issue Mar 18, 2021 · 9 comments
Assignees
@bradmiro
Labels
api: dataproc Issues related to the googleapis/python-dataproc API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p2 Moderately-important priority. Fix may not be included in next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Mar 18, 2021

Note: #133 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

commit: fb8232d
buildURL: Build Status, Sponge
status: failed

Test output
args = (project_id: "python-docs-samples-tests"
cluster {
  project_id: "python-docs-samples-tests"
  cluster_name: "py-qs-te...    worker_config {
      num_instances: 2
      machine_type_uri: "n1-standard-1"
    }
  }
}
region: "us-central1"
,)
kwargs = {'metadata': [('x-goog-api-client', 'gl-python/3.7.10 grpc/1.36.0 gax/1.26.1 gapic/2.3.0')]}

@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:





      return callable_(*args, **kwargs)





.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:73:




self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7fbd796cac90>

request = project_id: "python-docs-samples-tests"

cluster {

project_id: "python-docs-samples-tests"

cluster_name: "py-qs-tes...}

worker_config {

num_instances: 2

machine_type_uri: "n1-standard-1"

}

}

}

region: "us-central1"


timeout = None

metadata = [('x-goog-api-client', 'gl-python/3.7.10 grpc/1.36.0 gax/1.26.1 gapic/2.3.0')]

credentials = None, wait_for_ready = None, compression = None


def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)





  return _end_unary_response_blocking(state, call, False, None)





.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py:923:




state = <grpc._channel._RPCState object at 0x7fbd799eeb90>

call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fbd79a63640>

with_call = False, deadline = None


def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:





      raise _InactiveRpcError(state)





E           grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

E           	status = StatusCode.INVALID_ARGUMENT

E           	details = "Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.6-debian10."

E           	debug_error_string = "{"created":"@1616062050.524693780","description":"Error received from peer ipv4:74.125.195.95:443","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.6-debian10.","grpc_status":3}"

E           >


.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py:826: _InactiveRpcError


The above exception was the direct cause of the following exception:


capsys = <_pytest.capture.CaptureFixture object at 0x7fbd7bb8fd90>


def test_quickstart(capsys):





  quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)





quickstart/quickstart_test.py:73:




quickstart/quickstart.py:54: in quickstart

request={"project_id": project_id, "region": region, "cluster": cluster}

../../google/cloud/dataproc_v1/services/cluster_controller/client.py:413: in create_cluster

response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/gapic_v1/method.py:145: in call

return wrapped_func(*args, **kwargs)

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py:286: in retry_wrapped_func

on_error=on_error,

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py:184: in retry_target

return target()

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:75: in error_remapped_callable

six.raise_from(exceptions.from_grpc_error(exc), exc)




value = None

from_value = <_InactiveRpcError of RPC that terminated with:

status = StatusCode.INVALID_ARGUMENT

details = "Creating clusters us...g clusters using the n1-standard-1 machine type is not supported for image version 2.0.6-debian10.","grpc_status":3}"








???

E   google.api_core.exceptions.InvalidArgument: 400 Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.6-debian10.




:3: InvalidArgument
@flaky-bot flaky-bot bot added flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Mar 18, 2021
@product-auto-label product-auto-label bot added api: dataproc Issues related to the googleapis/python-dataproc API. samples Issues that are directly related to samples. labels Mar 18, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Mar 19, 2021

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

When run at the same commit (fb8232d), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

@flaky-bot flaky-bot bot added the flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. label Mar 19, 2021
@bradmiro bradmiro mentioned this issue Mar 19, 2021
Merged
@yoshi-automation yoshi-automation added 🚨 This issue needs some love. and removed 🚨 This issue needs some love. labels Mar 24, 2021
@meredithslota meredithslota added priority: p2 Moderately-important priority. Fix may not be included in next release. and removed priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. labels Mar 25, 2021
gcf-merge-on-green bot pushed a commit that referenced this issue Mar 26, 2021
@bradmiro
fix: (samples) fixing samples for new machine types (#150)
3343665 
Dataproc 2.0 is the new default image which does not support n1-standard-1.

Fixes #147, #148, #149
@bradmiro
Copy link
Contributor

Fixed in #150

@flaky-bot
Copy link
Author

flaky-bot bot commented Mar 30, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 674f337
buildURL: Build Status, Sponge
status: failed

Test output
args = (project_id: "python-docs-samples-tests"
cluster {
  project_id: "python-docs-samples-tests"
  cluster_name: "py-qs-te...    worker_config {
      num_instances: 2
      machine_type_uri: "n1-standard-1"
    }
  }
}
region: "us-central1"
,)
kwargs = {'metadata': [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]}

@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:





      return callable_(*args, **kwargs)





.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:73:




self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7fe3325b5c18>

request = project_id: "python-docs-samples-tests"

cluster {

project_id: "python-docs-samples-tests"

cluster_name: "py-qs-tes...}

worker_config {

num_instances: 2

machine_type_uri: "n1-standard-1"

}

}

}

region: "us-central1"


timeout = None

metadata = [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]

credentials = None, wait_for_ready = None, compression = None


def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)





  return _end_unary_response_blocking(state, call, False, None)





.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:923:




state = <grpc._channel._RPCState object at 0x7fe33047b048>

call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fe33050a908>

with_call = False, deadline = None


def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:





      raise _InactiveRpcError(state)





E           grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

E           	status = StatusCode.INVALID_ARGUMENT

E           	details = "Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10."

E           	debug_error_string = "{"created":"@1617095424.255874287","description":"Error received from peer ipv4:108.177.98.95:443","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"

E           >


.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:826: _InactiveRpcError


The above exception was the direct cause of the following exception:


capsys = <_pytest.capture.CaptureFixture object at 0x7fe3303ba898>


def test_quickstart(capsys):





  quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)





quickstart/quickstart_test.py:73:




quickstart/quickstart.py:54: in quickstart

request={"project_id": project_id, "region": region, "cluster": cluster}

../../google/cloud/dataproc_v1/services/cluster_controller/client.py:413: in create_cluster

response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call

return wrapped_func(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:286: in retry_wrapped_func

on_error=on_error,

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:184: in retry_target

return target()

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:75: in error_remapped_callable

six.raise_from(exceptions.from_grpc_error(exc), exc)




value = None

from_value = <_InactiveRpcError of RPC that terminated with:

status = StatusCode.INVALID_ARGUMENT

details = "Creating clusters us...g clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"








???

E   google.api_core.exceptions.InvalidArgument: 400 Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.




:3: InvalidArgument

@flaky-bot flaky-bot bot reopened this Mar 30, 2021
@flaky-bot flaky-bot bot reopened this Mar 31, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Mar 31, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 674f337
buildURL: Build Status, Sponge
status: failed

Test output
args = (project_id: "python-docs-samples-tests"
cluster {
  project_id: "python-docs-samples-tests"
  cluster_name: "py-qs-te...    worker_config {
      num_instances: 2
      machine_type_uri: "n1-standard-1"
    }
  }
}
region: "us-central1"
,)
kwargs = {'metadata': [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]}

@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:





      return callable_(*args, **kwargs)





.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:73:




self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7fb1b8573da0>

request = project_id: "python-docs-samples-tests"

cluster {

project_id: "python-docs-samples-tests"

cluster_name: "py-qs-tes...}

worker_config {

num_instances: 2

machine_type_uri: "n1-standard-1"

}

}

}

region: "us-central1"


timeout = None

metadata = [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]

credentials = None, wait_for_ready = None, compression = None


def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)





  return _end_unary_response_blocking(state, call, False, None)





.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:923:




state = <grpc._channel._RPCState object at 0x7fb1b64381d0>

call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fb1b64c9f48>

with_call = False, deadline = None


def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:





      raise _InactiveRpcError(state)





E           grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

E           	status = StatusCode.INVALID_ARGUMENT

E           	details = "Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10."

E           	debug_error_string = "{"created":"@1617181927.956706722","description":"Error received from peer ipv4:74.125.142.95:443","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"

E           >


.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:826: _InactiveRpcError


The above exception was the direct cause of the following exception:


capsys = <_pytest.capture.CaptureFixture object at 0x7fb1b6448c88>


def test_quickstart(capsys):





  quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)





quickstart/quickstart_test.py:73:




quickstart/quickstart.py:54: in quickstart

request={"project_id": project_id, "region": region, "cluster": cluster}

../../google/cloud/dataproc_v1/services/cluster_controller/client.py:413: in create_cluster

response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call

return wrapped_func(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:286: in retry_wrapped_func

on_error=on_error,

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:184: in retry_target

return target()

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:75: in error_remapped_callable

six.raise_from(exceptions.from_grpc_error(exc), exc)




value = None

from_value = <_InactiveRpcError of RPC that terminated with:

status = StatusCode.INVALID_ARGUMENT

details = "Creating clusters us...g clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"








???

E   google.api_core.exceptions.InvalidArgument: 400 Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.




:3: InvalidArgument

@bradmiro
Copy link
Contributor

This looks like a reporting lag. Closing again.

@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 1, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 674f337
buildURL: Build Status, Sponge
status: failed

Test output
args = (project_id: "python-docs-samples-tests"
cluster {
  project_id: "python-docs-samples-tests"
  cluster_name: "py-qs-te...    worker_config {
      num_instances: 2
      machine_type_uri: "n1-standard-1"
    }
  }
}
region: "us-central1"
,)
kwargs = {'metadata': [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]}

@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:





      return callable_(*args, **kwargs)





.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:73:




self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7efcbfa84da0>

request = project_id: "python-docs-samples-tests"

cluster {

project_id: "python-docs-samples-tests"

cluster_name: "py-qs-tes...}

worker_config {

num_instances: 2

machine_type_uri: "n1-standard-1"

}

}

}

region: "us-central1"


timeout = None

metadata = [('x-goog-api-client', 'gl-python/3.6.13 grpc/1.36.0 gax/1.26.3 gapic/2.3.0')]

credentials = None, wait_for_ready = None, compression = None


def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)





  return _end_unary_response_blocking(state, call, False, None)





.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:923:




state = <grpc._channel._RPCState object at 0x7efcbd949208>

call = <grpc._cython.cygrpc.SegregatedCall object at 0x7efcbd9daf48>

with_call = False, deadline = None


def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:





      raise _InactiveRpcError(state)





E           grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

E           	status = StatusCode.INVALID_ARGUMENT

E           	details = "Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10."

E           	debug_error_string = "{"created":"@1617268015.571548289","description":"Error received from peer ipv4:74.125.20.95:443","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"

E           >


.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:826: _InactiveRpcError


The above exception was the direct cause of the following exception:


capsys = <_pytest.capture.CaptureFixture object at 0x7efcbd96c710>


def test_quickstart(capsys):





  quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)





quickstart/quickstart_test.py:73:




quickstart/quickstart.py:54: in quickstart

request={"project_id": project_id, "region": region, "cluster": cluster}

../../google/cloud/dataproc_v1/services/cluster_controller/client.py:413: in create_cluster

response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call

return wrapped_func(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:286: in retry_wrapped_func

on_error=on_error,

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/retry.py:184: in retry_target

return target()

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:75: in error_remapped_callable

six.raise_from(exceptions.from_grpc_error(exc), exc)




value = None

from_value = <_InactiveRpcError of RPC that terminated with:

status = StatusCode.INVALID_ARGUMENT

details = "Creating clusters us...g clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.","grpc_status":3}"








???

E   google.api_core.exceptions.InvalidArgument: 400 Creating clusters using the n1-standard-1 machine type is not supported for image version 2.0.7-debian10.




:3: InvalidArgument

@flaky-bot flaky-bot bot reopened this Apr 1, 2021
@bradmiro
Copy link
Contributor

bradmiro commented Apr 1, 2021 •
edited

@busunkim96 I'm scratching my head a bit here. This, #147 and #148 are failing based on an old version of the code that was fixed in PR #150 and I can't reproduce the errors locally. Any idea?

@busunkim96
Copy link
Contributor

@bradmiro The periodic build "rewinds" to the latest release to check the samples against the library published on PyPI.

If there's nothing blocking the library release, one easy way to get rid of the error is to merge the release PR which will move forward the point to which the periodic build "rewinds" to.

Takashi also recently added the option for a second periodic build option to test samples at head. googleapis/synthtool#992 Once that synth PR has trickled through you can choose to have both periodic builds (latest release and HEAD) or just one or the either.

@bradmiro
Copy link
Contributor

bradmiro commented Apr 1, 2021

Gotcha, ok awesome. I have nothing blocking a merge on #138, so maybe we can proceed with that? Let me know if there's any blockers on your side.

@flaky-bot flaky-bot bot mentioned this issue Sep 1, 2021
Closed
msampathkumar pushed a commit to GoogleCloudPlatform/python-docs-samples that referenced this issue Nov 14, 2022
@bradmiro
fix: (samples) fixing samples for new machine types (#150)
063c5c9 
Dataproc 2.0 is the new default image which does not support n1-standard-1.

Fixes googleapis/python-dataproc#147, googleapis/python-dataproc#148, googleapis/python-dataproc#149
parthea pushed a commit to googleapis/google-cloud-python that referenced this issue Sep 22, 2023
@bradmiro
fix: (samples) fixing samples for new machine types (#150)
f67bdf3 
Dataproc 2.0 is the new default image which does not support n1-standard-1.

Fixes googleapis/python-dataproc#147, googleapis/python-dataproc#148, googleapis/python-dataproc#149
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@bradmiro bradmiro

Labels
api: dataproc Issues related to the googleapis/python-dataproc API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p2 Moderately-important priority. Fix may not be included in next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@meredithslota @busunkim96 @bradmiro @yoshi-automation