Skip to content
This repository has been archived by the owner on Oct 19, 2023. It is now read-only.

response times out using the push to talk example #461

Open
electronicsuk opened this issue Jul 31, 2023 · 0 comments
Open

response times out using the push to talk example #461

electronicsuk opened this issue Jul 31, 2023 · 0 comments

Comments

@electronicsuk
Copy link

electronicsuk commented Jul 31, 2023

running the push to talk example. It appears to working up until playing back the response.
I get a message DEBUG:root:ConverseResponse: audio_data (1600 bytes) then it freezes for about a minute or so then times out.

I have tested the sound configuration using aplay and arecord. They both work as expected. I am running this using a docker container running debian bullseye. The container is hosted by BalenaOs on a raspberry pi 1.2B. I have a fibre over copper internet connection so there's plenty of bandwidth.


Press Enter to send a new request...
INFO:root:Recording audio request.
DEBUG:root:ConverseRequest: config {
  audio_in_config {
    encoding: LINEAR16
    sample_rate_hertz: 16000
  }
  audio_out_config {
    encoding: LINEAR16
    sample_rate_hertz: 16000
    volume_percentage: 50
  }
}

DEBUG:root:ConverseRequest: audio_in (6400 bytes)
WARNING:root:SoundDeviceStream read overflow (3200, 6400)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: event_type: END_OF_UTTERANCE

INFO:root:End of audio request detected
DEBUG:root:ConverseResponse: result {
  spoken_request_text: "what is the weather like"
}

INFO:root:Transcript of user request: "what is the weather like".
INFO:root:Playing assistant response.
DEBUG:root:ConverseResponse: result {
  conversation_state: "\n,C#FOv2::65d288e6-0000-2991-9a3e-089e08285770\022\366\001Kj93OFRSMXhIcC1MMDhBQ0otYlpnTFg1NE43SzdkbXBodzRQNU15UkN0UXdJQUFJQ3pBTUx2bEJWVnVRQUFBQUE4qc-gpgZ6VwoUCAESEDAwMDAwMDY3YTMwNDY0MjgSP3c4VFIxeEhwLUwwOEFDSi1iWmdMWDU0TjdLN2RtcGh3NFA1TXlSQ3RRd0lBQUlDekFNTHZsQlZWdVFBQUFBQYoBFRITCO6PmfjxuYADFT3XAgcdOy0Lyw"
  microphone_mode: CLOSE_MICROPHONE
}

DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)

^TTraceback (most recent call last):
  File "/env/bin/googlesamples-assistant-pushtotalk", line 8, in <module>
    sys.exit(main())
  File "/env/lib/python3.9/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/env/lib/python3.9/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/env/lib/python3.9/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 317, in main
    continue_conversation = assistant.converse()
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 289, in wrapped_f
    return self(f, *args, **kw)
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 379, in __call__
    do = self.iter(retry_state=retry_state)
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 314, in iter
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 382, in __call__
    result = fn(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 109, in converse
    for resp in self.assistant.Converse(iter_converse_requests(),
  File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 475, in __next__
    return self._next()
  File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 864, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
        status = StatusCode.DEADLINE_EXCEEDED
        details = "Deadline Exceeded"
        debug_error_string = "UNKNOWN:Error received from peer ipv4:142.250.179.234:443 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-07-31T21:32:13.336953588+00:00"}"
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant