Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wake word works once, and sometimes not at all #3574

Open
krisatmanning opened this issue Apr 20, 2024 · 1 comment
Open

Wake word works once, and sometimes not at all #3574

krisatmanning opened this issue Apr 20, 2024 · 1 comment
Labels

Comments

@krisatmanning
Copy link

Describe the issue you are experiencing

I have an M5 Atom Echo. From the ESP32Home Integration, if I toggle off and on the "Use Wake Word" from the atom echo config page it lets me say "OK, Nabu" one time. Togging off and on allows one time, then it quits.

Also if I press the top button briefly on the Atom Echo I can use the wake word once (SOMETIMES) and never more than once.

Firmware:

2024.4.0 (Apr 20 2024, 14:38:45)

This is similar to, but with different hardware as, #3464

What type of installation are you running?

Home Assistant Supervised

Which operating system are you running on?

Debian

Which add-on are you reporting an issue with?

CEC Scanner

What is the version of the add-on?

2024.4.0, min_version 2023.11.1

Steps to reproduce the issue

  1. Begin with ESP32Home integrated
  2. Add ESP32 Dashboard
  3. Install Atom Echo through dashboard using latest config file from github
  4. Add the atom echo to integration
  5. Configure Assistant (I use cloud) and set the wake word (I use OK Nabu)
  6. Pick Assistant in the configs (I use HA Cloud)
  7. Wake word works once
  8. Wake word will not work a second time
  9. Toggling off and back on the "Use Wake Word" toggle will sometimes allow it to work one time...but then only once
  10. Same behavior occurs in step 9 but when I use the top button on the Atom Echo

System Health information

Version core-2024.4.3
Installation Type Home Assistant Supervised
Development false
Supervisor true
Docker true
User root
Virtual Environment false
Python Version 3.12.2
Operating System Family Linux
Operating System Version 6.1.0-20-amd64
CPU Architecture x86_64
Timezone America/Chicago
Configuration Directory /config
Home Assistant Community Store
GitHub API ok
GitHub Content ok
GitHub Web ok
GitHub API Calls Remaining 5000
Installed Version 1.34.0
Stage running
Available Repositories 1401
Downloaded Repositories 30
Home Assistant Cloud
Logged In true
Subscription Expiration May 13, 2024 at 7:00 PM
Relayer Connected true
Relayer Region us-east-1
Remote Enabled true
Remote Connected true
Alexa Enabled false

Google Enabled false
Remote Server us-east-1-8.ui.nabu.casa
Certificate Status ready
Instance ID 81bb74266cf0435e8f312ec6f32f2c50
Reach Certificate Server ok
Reach Authentication Server ok
Reach Home Assistant Cloud ok
Home Assistant Supervisor
Host Operating System Debian GNU/Linux 12 (bookworm)
Update Channel stable
Supervisor Version supervisor-2024.04.0
Agent Version 1.6.0
Docker Version 26.0.0
Disk Total 914.4 GB
Disk Used 21.1 GB
Healthy true
Supported true
Supervisor API ok
Version API ok
Installed Add-ons Studio Code Server (5.15.0), Samba share (12.3.1), openWakeWord (1.10.0), ESPHome (2024.4.0)
Dashboards
Dashboards 11
Resources 20
Views 12
Mode storage
Recorder
Oldest Run Start Time April 14, 2024 at 8:44 PM
Current Run Start Time April 20, 2024 at 2:34 PM

Anything in the Supervisor logs that might be useful for us?

Nothing at all in supervisor logs

Anything in the add-on logs that might be useful for us?

Here's some logs after a button-press reset where I'm NOT able to get it to register OK, Nabu:

[15:21:29][D][binary_sensor:036]: 'Button': Sending state ON
[15:21:30][D][binary_sensor:036]: 'Button': Sending state OFF
[15:21:30][D][voice_assistant:556]: Signaling stop...
[15:21:30][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE
[15:21:30][D][voice_assistant:445]: Desired state set to IDLE
[15:21:30][D][voice_assistant:563]: Event Type: 0
[15:21:30][E][voice_assistant:693]: Error: no_wake_word - No wake word detected
[15:21:30][D][voice_assistant:556]: Signaling stop...
[15:21:30][D][voice_assistant:439]: State changed from STOP_MICROPHONE to STOP_MICROPHONE
[15:21:30][D][voice_assistant:445]: Desired state set to IDLE
[15:21:30][D][voice_assistant:439]: State changed from STOP_MICROPHONE to STOPPING_MICROPHONE
[15:21:30][D][light:036]: 'kitchen-atom-echo' Setting:
[15:21:30][D][light:051]: Brightness: 100%
[15:21:30][D][light:059]: Red: 100%, Green: 0%, Blue: 0%
[15:21:30][D][esp-idf:000]: I (694320) I2S: DMA queue destroyed

[15:21:30][D][voice_assistant:563]: Event Type: 2
[15:21:30][D][voice_assistant:653]: Assist Pipeline ended
[15:21:30][D][voice_assistant:439]: State changed from STOPPING_MICROPHONE to IDLE
[15:21:30][D][light:036]: 'kitchen-atom-echo' Setting:
[15:21:30][D][light:051]: Brightness: 60%
[15:21:30][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:21:31][D][light:036]: 'kitchen-atom-echo' Setting:
[15:21:31][D][light:051]: Brightness: 60%
[15:21:31][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:21:31][D][voice_assistant:439]: State changed from IDLE to START_MICROPHONE
[15:21:31][D][voice_assistant:445]: Desired state set to WAIT_FOR_VAD
[15:21:31][D][voice_assistant:163]: Starting Microphone
[15:21:31][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE
[15:21:31][D][esp-idf:000]: I (695305) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4

[15:21:31][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to WAIT_FOR_VAD
[15:21:31][D][voice_assistant:180]: Waiting for speech...
[15:21:31][D][voice_assistant:439]: State changed from WAIT_FOR_VAD to WAITING_FOR_VAD
[15:21:31][D][light:036]: 'kitchen-atom-echo' Setting:
[15:21:31][D][light:051]: Brightness: 60%
[15:21:31][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:21:31][D][voice_assistant:193]: VAD detected speech
[15:21:31][D][voice_assistant:439]: State changed from WAITING_FOR_VAD to START_PIPELINE
[15:21:31][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE
[15:21:31][D][voice_assistant:210]: Requesting start...
[15:21:31][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE
[15:21:31][D][voice_assistant:476]: Client started, streaming microphone
[15:21:31][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
[15:21:31][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE
[15:21:31][D][voice_assistant:563]: Event Type: 1
[15:21:31][D][voice_assistant:566]: Assist Pipeline running
[15:21:31][D][voice_assistant:563]: Event Type: 9

This is from after a button press where I am able to get it to register an OK, Nabu:

[15:23:46][D][binary_sensor:036]: 'Button': Sending state ON
[15:23:46][D][binary_sensor:036]: 'Button': Sending state OFF
[15:23:46][D][voice_assistant:556]: Signaling stop...
[15:23:46][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE
[15:23:46][D][voice_assistant:445]: Desired state set to IDLE
[15:23:46][D][voice_assistant:439]: State changed from STOP_MICROPHONE to STOPPING_MICROPHONE
[15:23:46][D][esp-idf:000]: I (831082) I2S: DMA queue destroyed

[15:23:46][D][voice_assistant:439]: State changed from STOPPING_MICROPHONE to IDLE
[15:23:47][D][voice_assistant:563]: Event Type: 0
[15:23:47][E][voice_assistant:693]: Error: no_wake_word - No wake word detected
[15:23:47][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:47][D][light:051]: Brightness: 100%
[15:23:47][D][light:059]: Red: 100%, Green: 0%, Blue: 0%
[15:23:47][D][voice_assistant:563]: Event Type: 2
[15:23:47][D][voice_assistant:653]: Assist Pipeline ended
[15:23:47][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:47][D][light:051]: Brightness: 60%
[15:23:47][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:23:47][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:47][D][light:051]: Brightness: 60%
[15:23:47][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:23:47][D][voice_assistant:439]: State changed from IDLE to START_MICROPHONE
[15:23:47][D][voice_assistant:445]: Desired state set to WAIT_FOR_VAD
[15:23:47][D][voice_assistant:163]: Starting Microphone
[15:23:47][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE
[15:23:48][D][esp-idf:000]: I (832111) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4

[15:23:48][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to WAIT_FOR_VAD
[15:23:48][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:48][D][light:051]: Brightness: 60%
[15:23:48][D][light:059]: Red: 100%, Green: 89%, Blue: 71%
[15:23:48][D][voice_assistant:180]: Waiting for speech...
[15:23:48][D][voice_assistant:439]: State changed from WAIT_FOR_VAD to WAITING_FOR_VAD
[15:23:48][D][voice_assistant:193]: VAD detected speech
[15:23:48][D][voice_assistant:439]: State changed from WAITING_FOR_VAD to START_PIPELINE
[15:23:48][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE
[15:23:48][D][voice_assistant:210]: Requesting start...
[15:23:48][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE
[15:23:48][D][voice_assistant:476]: Client started, streaming microphone
[15:23:48][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
[15:23:48][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE
[15:23:48][D][voice_assistant:563]: Event Type: 1
[15:23:48][D][voice_assistant:566]: Assist Pipeline running
[15:23:48][D][voice_assistant:563]: Event Type: 9
[15:23:51][D][voice_assistant:563]: Event Type: 10
[15:23:51][D][voice_assistant:572]: Wake word detected
[15:23:51][D][voice_assistant:563]: Event Type: 3
[15:23:51][D][voice_assistant:577]: STT started
[15:23:51][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:51][D][light:059]: Red: 0%, Green: 0%, Blue: 100%
[15:23:51][D][light:109]: Effect: 'Slow Pulse'
[15:23:54][D][voice_assistant:563]: Event Type: 11
[15:23:54][D][voice_assistant:717]: Starting STT by VAD
[15:23:55][D][voice_assistant:563]: Event Type: 12
[15:23:55][D][voice_assistant:721]: STT by VAD end
[15:23:55][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE
[15:23:55][D][voice_assistant:445]: Desired state set to AWAITING_RESPONSE
[15:23:55][D][voice_assistant:439]: State changed from STOP_MICROPHONE to STOPPING_MICROPHONE
[15:23:55][D][light:036]: 'kitchen-atom-echo' Setting:
[15:23:55][D][light:059]: Red: 0%, Green: 0%, Blue: 100%
[15:23:55][D][light:109]: Effect: 'Fast Pulse'
[15:23:55][D][esp-idf:000]: I (840035) I2S: DMA queue destroyed
[15:23:55][D][voice_assistant:439]: State changed from STOPPING_MICROPHONE to AWAITING_RESPONSE
[15:23:56][D][voice_assistant:563]: Event Type: 4
[15:23:56][D][voice_assistant:591]: Speech recognised as: "Turn on the small fan."
[15:23:56][D][voice_assistant:563]: Event Type: 5
[15:23:56][D][voice_assistant:596]: Intent started
[15:23:56][D][voice_assistant:563]: Event Type: 6
[15:23:56][D][voice_assistant:563]: Event Type: 7
[15:23:56][D][voice_assistant:619]: Response: "Turned on the light"

Additional information

No response

Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale label May 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant