Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

samples.samples.quickstart_test: test_quickstart failed #390

Closed
flaky-bot bot opened this issue Jun 26, 2021 · 14 comments · Fixed by #397 or #398
Closed

samples.samples.quickstart_test: test_quickstart failed #390

flaky-bot bot opened this issue Jun 26, 2021 · 14 comments · Fixed by #397 or #398
Assignees
Labels
api: spanner Issues related to the googleapis/python-spanner API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. samples Issues that are directly related to samples. type: process A process-related concern. May include testing, release, or the like.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Jun 26, 2021

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and
I will stop commenting.


commit: 3132587
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f43237f3cc0>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f43237f52e8>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f43237a2f88>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1624700026.817055527","description":"Error received from peer ipv4:74.125.135.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@flaky-bot flaky-bot bot added flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Jun 26, 2021
@product-auto-label product-auto-label bot added api: spanner Issues related to the googleapis/python-spanner API. samples Issues that are directly related to samples. labels Jun 26, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Jun 27, 2021

commit: f3362fe
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7ffa0faa5cf8>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7ffa0fab02e8>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7ffa0fa503c8>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1624786868.800037571","description":"Error received from peer ipv4:74.125.142.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 1, 2021

commit: 1701899
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7faf9d08edd8>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7faf9d091940>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7faf9d02e888>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1625132286.619357730","description":"Error received from peer ipv4:74.125.20.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@skuruppu skuruppu assigned skuruppu and unassigned larkee Jul 2, 2021
gcf-merge-on-green bot pushed a commit that referenced this issue Jul 2, 2021
Also cleans up old instances and drops the new instance after the test.

Fixes #390 🦕
@flaky-bot flaky-bot bot reopened this Jul 2, 2021
@flaky-bot flaky-bot bot added the flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. label Jul 2, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 2, 2021

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.


commit: 0f1a5de
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f4bb9ca9198>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f4bb9cb1940>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f4bb9c55548>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1625218710.816268500","description":"Error received from peer ipv4:74.125.142.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@yoshi-automation yoshi-automation added the 🚨 This issue needs some love. label Jul 4, 2021
@skuruppu
Copy link
Contributor

skuruppu commented Jul 5, 2021

We've merged in several PRs since this issue was fixed and we have not seen this failure. I imagine that this is from a run where master was not merged in to include the fix. Closing.

@skuruppu skuruppu closed this as completed Jul 5, 2021
@skuruppu skuruppu removed the 🚨 This issue needs some love. label Jul 5, 2021
@flaky-bot flaky-bot bot reopened this Jul 5, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 5, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.


commit: 4a0a8e1
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f0a804b12b0>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.30.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f0a8071b668>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f0a806c93c8>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1625477492.143186918","description":"Error received from peer ipv4:74.125.142.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@yoshi-automation yoshi-automation added the 🚨 This issue needs some love. label Jul 6, 2021
@skuruppu
Copy link
Contributor

skuruppu commented Jul 7, 2021

I think I know what's going on. This repo is setup in some way where it doesn't actually tell you that the PR is not up-to-date with the master branch. When you trigger test runs, they run at older commits, so even though the underlying test was fixed last Friday, we keep getting this failure.

I will have to talk to the repo admins to see how this can be fixed.

@flaky-bot flaky-bot bot reopened this Jul 14, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 14, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.


commit: 1b04bbf
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.31.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f48c6e4d518>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.31.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f48c6e5ac50>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f48c6df66c8>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1626255225.677300883","description":"Error received from peer ipv4:74.125.195.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@skuruppu skuruppu assigned larkee and unassigned skuruppu Jul 14, 2021
@skuruppu
Copy link
Contributor

@larkee to follow up with the Python repo owners on what's going on here.

@tseaver
Copy link
Contributor

tseaver commented Jul 16, 2021

@skuruppu The flakybot isn't running on PR branches: it is a periodic run on master. See the job log.

@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 21, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.


commit: b0455d0
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.31.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f3bfbf0b3c8>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.38.1 gax/1.31.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f3bfbef9828>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f3bfbf93408>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1626860127.260842185","description":"Error received from peer ipv4:74.125.199.95:443","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...066,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@flaky-bot flaky-bot bot reopened this Jul 21, 2021
@tseaver
Copy link
Contributor

tseaver commented Jul 21, 2021

That flake was against a version of PR #415 which predated the merge of #423 into its branch.

@tseaver tseaver closed this as completed Jul 21, 2021
@flaky-bot
Copy link
Author

flaky-bot bot commented Jul 22, 2021

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.


commit: b0455d0
buildURL: Build Status, Sponge
status: failed

Test output
args = (parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE `my-database-id`"
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/m...-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.39.0 gax/1.31.0 gccl/3.6.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:
      return callable_(*args, **kwargs)

.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:67:


self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7f8e24fa5f98>
request = parent: "projects/python-docs-samples-tests/instances/test-instance"
create_statement: "CREATE DATABASE my-database-id"

timeout = None
metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance/databases/my-database-id...s-samples-tests/instances/test-instance'), ('x-goog-api-client', 'gl-python/3.6.13 grpc/1.39.0 gax/1.31.0 gccl/3.6.0')]
credentials = None, wait_for_ready = None, compression = None

def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)
  return _end_unary_response_blocking(state, call, False, None)

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:946:


state = <grpc._channel._RPCState object at 0x7f8e24f53c88>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f8e24ec84c8>
with_call = False, deadline = None

def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:
      raise _InactiveRpcError(state)

E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.NOT_FOUND
E details = "Instance not found: projects/python-docs-samples-tests/instances/test-instance"
E debug_error_string = "{"created":"@1626946616.234251095","description":"Error received from peer ipv4:74.125.195.95:443","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"
E >

.nox/py-3-6/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError

The above exception was the direct cause of the following exception:

@pytest.fixture
def example_database():
    spanner_client = spanner.Client()
    instance = spanner_client.instance(SPANNER_INSTANCE)
    database = instance.database("my-database-id")

    if not database.exists():
      database.create()

quickstart_test.py:48:


../../google/cloud/spanner_v1/database.py:374: in create
future = api.create_database(request=request, metadata=metadata)
../../google/cloud/spanner_admin_database_v1/services/database_admin/client.py:615: in create_database
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py:145: in call
return wrapped_func(*args, **kwargs)
.nox/py-3-6/lib/python3.6/site-packages/google/api_core/grpc_helpers.py:69: in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)


value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Instance not found: project...069,"grpc_message":"Instance not found: projects/python-docs-samples-tests/instances/test-instance","grpc_status":5}"

???
E google.api_core.exceptions.NotFound: 404 Instance not found: projects/python-docs-samples-tests/instances/test-instance

:3: NotFound

@flaky-bot flaky-bot bot reopened this Jul 22, 2021
@tseaver tseaver added type: process A process-related concern. May include testing, release, or the like. and removed 🚨 This issue needs some love. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Jul 22, 2021
@tseaver
Copy link
Contributor

tseaver commented Jul 22, 2021

I don't understand the reported failure, which purports to be running against commit b0455d0. However, the example_databse fixture which fails is not present in that commit:

$ git remote -v
origin	git@github.com:googleapis/python-spanner (fetch)
origin	git@github.com:googleapis/python-spanner (push)
$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
$ git log -1
commit b0455d0ab657cd053a7527e99bdbfadc4de23b30 (HEAD -> master, origin/master, origin/HEAD)
Author: Tres Seaver <tseaver@palladion.com>
Date:   Tue Jul 20 15:53:53 2021 -0400

    fix(deps): pin 'google-{api,cloud}-core' to allow 2.x versions (#415)
    
    Include comment on embargo of '>= 2.x' min versions
    
    Per: https://github.com/googleapis/google-cloud-python/issues/10566
$ 
$ git grep example_database || echo "Not Found"

Looking upward in the log, I see the following:

--- IMPORTANT IMPORTANT IMPORTANT ---
Now we rewind the repo back to the latest release...
Previous HEAD position was b0455d0 fix(deps): pin 'google-{api,cloud}-core' to allow 2.x versions (#415)
HEAD is now at 32a5576 chore: release 3.6.0 (#370)
The current head is:
32a557674dfe0718ea922d9a2359b89a26a7baf8

I don't understand the benefit of testing samples against old commits in the periodic job. @tmatsuo I think you added that bit in the synthool template (PR googleapis/synthtool#992) -- can you elaborate here?

The failure is in the test infrastructure, not in the actual library code or the sample itself, and is fixed on master. Having the flakybot keep the bug open doesn't seem like a win to me.

@tseaver
Copy link
Contributor

tseaver commented Jul 22, 2021

I guess this issue will be closed by merging the next release PR (#398).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: spanner Issues related to the googleapis/python-spanner API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. samples Issues that are directly related to samples. type: process A process-related concern. May include testing, release, or the like.
Projects
None yet
5 participants