Wake word not responding after update #5794

itnassol · 2024-05-15T14:22:54Z

The problem

I have 3 old Google Gen2s that I have converted to Assist, new boards and they have been working perfectly for 3 months now.

This morning I updated the ESPhome to 2024.5.0.

Now they speakers only respond once, If I reboot them they respond to the wake word, then nothing it’s like they are just not listening.

UPDATE - Just re-installed the 2024.4.2 version and everything is working again.

Which version of ESPHome has the issue?

2024.5.0

What type of installation are you using?

Home Assistant Add-on

Which version of Home Assistant has the issue?

2024.5.3

What platform are you using?

ESP8266

Board

No response

Component causing the issue

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

collinstork · 2024-05-16T18:55:22Z

This is also happening on Korvo1 v5 boards. Also working on 2024.4.2

Willber1 · 2024-05-18T03:31:25Z

Same exact symptoms here, 2024.5.0 responds only once, reboot allows another response.

gregkg · 2024-05-18T19:03:17Z

Exactly what I experienced with the Onju PCB replacement for google mini v2 after updating to ESPHome 2024.5.0 (on latest version of HA). Reverted to previous version of ESPHome & they are working again. Only thing I noticed in the logs were several warnings of " i2s_audio.media_player took a long time for an operation" after completing the first & only wakeword.

Willber1 · 2024-05-18T19:33:38Z

Thanks for the feedback. Same warning here. Can you enlighten me on how to roll back ESPhome? Cheers

…

On May 18, 2024 3:03:39 PM EDT, gregkg ***@***.***> wrote: Exactly what I experienced with the Onju PCB replacement for google mini v2 after updating to ESPHome 2024.5.0 (on latest version of HA). Reverted to previous version of ESPHome & they are working again. Only thing I noticed in the logs were several warnings of " i2s_audio.media_player took a long time for an operation" after completing the first & only wakeword. -- Reply to this email directly or view it on GitHub: #5794 (comment) You are receiving this because you commented. Message ID: ***@***.***>

gregkg · 2024-05-18T21:57:48Z

Thanks for the feedback. Same warning here. Can you enlighten me on how to roll back ESPhome? Cheers
…

I use the ESPHome add on in Home Assistant. Before every update, I create a backup of the add on version I’m currently using. So it's simply a restore of that.

Willber1 · 2024-05-19T00:15:10Z

Today I learned something...... Always did full backups and never considered the partial restore capabilities. That fixed the issue! Many thanks for your help. Cheers, Bill

…

On May 18, 2024 5:58:09 PM EDT, gregkg ***@***.***> wrote: > Thanks for the feedback. Same warning here. Can you enlighten me on how to roll back ESPhome? Cheers > […](#) I use the ESPHome add on in Home Assistant. Before every update, I create a backup of the add onversion I’m currently using. So it simply a restore of that. -- Reply to this email directly or view it on GitHub: #5794 (comment) You are receiving this because you commented. Message ID: ***@***.***>

Bandit3112011 · 2024-05-20T13:42:58Z

Same here and same after update to 2024.5.1

itnassol · 2024-05-20T15:02:39Z

Thank you Bandit3112011, saved me a job.

Willber1 · 2024-05-20T15:07:30Z

Ya bummer, just go into Backups, select Partial and look for ESPhome update of 2024.4.2 and flash that. Update the device and you should be good. Other units retain the 2024.5.1 version. Hopefully a future update will fix this. It might be related to the API calls. Cheers.

…

On May 20, 2024 9:43:20 AM EDT, Bandit3112011 ***@***.***> wrote: Same here and same after update to 2024.5.1 -- Reply to this email directly or view it on GitHub: #5794 (comment) You are receiving this because you commented. Message ID: ***@***.***>

PhilippeP62 · 2024-06-01T09:17:21Z

Add me to the list , same problem , same symptoms , same solution ...

PhilippeP62 · 2024-06-01T18:52:31Z

Ok pr#6849 solved the problem for me , thanks to @gnumpi

itnassol · 2024-06-02T10:12:29Z

Ok pr#6849 solved the problem for me , thanks to @gnumpi

Can you let us know how you did that? thanks

PhilippeP62 · 2024-06-02T10:15:22Z

You can add this to your config to load the i2s_audio component from the pull request:

external_components:
  - source: github://pr#6849
    components: i2s_audio
    refresh: 0s

itnassol · 2024-06-02T10:24:30Z

You can add this to your config to load the i2s_audio component from the pull request:
external_components:
  - source: github://pr#6849
    components: i2s_audio
    refresh: 0s

So, just to be sure, I update the ESP first add this to my config yaml and it should work?

PhilippeP62 · 2024-06-02T10:26:53Z

Update esphome to 2024.5 , edit your device config, update the device , test

And probably remove it before next esphome update if it's merged.

itnassol · 2024-06-03T11:22:17Z

Thank you

itnassol · 2024-06-06T06:51:04Z

Mic not as responsive as it should be, used to be able to call Assit from across the room, now I have to be right on it.

Quick update- returned to 2024.5.4 and the mic picks up the wake word instantly and responded well, install 2024.5.5 and you have to be right next door to the speaker and mic for it to hear you.

gnumpi · 2024-06-06T08:59:35Z

Mic not as responsive as it should be, used to be able to call Assit from across the room, now I have to be right on it.

Quick update- returned to 2024.5.4 and the mic picks up the wake word instantly and responded well, install 2024.5.5 and you have to be right next door to the speaker and mic for it to hear you.

Hey, that's strange as only the ring buffer size was changed. I will see if this is related anyway. Could you share your config?

itnassol · 2024-06-06T13:18:52Z

Mic not as responsive as it should be, used to be able to call Assit from across the room, now I have to be right on it.
Quick update- returned to 2024.5.4 and the mic picks up the wake word instantly and responded well, install 2024.5.5 and you have to be right next door to the speaker and mic for it to hear you.

Hey, that's strange as only the ring buffer size was changed. I will see if this is related anyway. Could you share your config?

No worries, here is the config from one of them....

`substitutions:
name: "dr-ada"
friendly_name: "Dr Ada"
wifi_ap_password: "password"

esphome:
name: ${name}
friendly_name: ${friendly_name}
name_add_mac_suffix: false
min_version: 2023.10.1
on_boot:
then:
- light.turn_on:
id: top_led
effect: slow_pulse
red: 100%
green: 60%
blue: 0%
- wait_until:
condition:
wifi.connected:
- light.turn_on:
id: top_led
effect: pulse
red: 0%
green: 100%
blue: 0%
- wait_until:
condition:
api.connected:
- light.turn_on:
id: top_led
effect: none
red: 0%
green: 100%
blue: 0%
- delay: 1s
- script.execute: reset_led

esp32:
board: esp32-s3-devkitc-1
framework:
type: arduino

logger:
api:
encryption:
key: "Q9sZOVZj9005+tDi9Cdwr3xPwm2+LmrD/LBRs1SC3Hc="
services:
- service: start_va
then:
- voice_assistant.start
- service: stop_va
then:
- voice_assistant.stop

ota:

wifi:
ssid: !secret wifi_ssid
password: !secret wifi_password
ap:
password: "${wifi_ap_password}"

captive_portal:

globals:

id: thresh_percent
type: float
initial_value: "0.03"
restore_value: false
id: touch_calibration_values_left
type: uint32_t[5]
restore_value: false
id: touch_calibration_values_center
type: uint32_t[5]
restore_value: false
id: touch_calibration_values_right
type: uint32_t[5]
restore_value: false

interval:

interval: 1s
then:
- script.execute:
  id: calibrate_touch
  button: 0
- script.execute:
  id: calibrate_touch
  button: 1
- script.execute:
  id: calibrate_touch
  button: 2

i2s_audio:

i2s_lrclk_pin: GPIO13
i2s_bclk_pin: GPIO18

external_components:

source: github://pr#6849
components: i2s_audio
refresh: 0s

media_player:

platform: i2s_audio
name: None
id: onju_out
dac_type: external
i2s_dout_pin: GPIO12
mode: mono
mute_pin:
number: GPIO21
inverted: True

speaker:

- platform: i2s_audio

id: onju_out

dac_type: external

i2s_dout_pin: GPIO12

mode: stereo

microphone:

platform: i2s_audio
id: onju_microphone
i2s_din_pin: GPIO17
adc_type: external
pdm: false

voice_assistant:
id: va
microphone: onju_microphone
media_player: onju_out

speaker: onju_out

use_wake_word: true
on_start:
- light.turn_on:
id: top_led
blue: 100%
red: 0%
green: 0%
effect: none
on_listening:
- light.turn_on:
id: top_led
blue: 100%
red: 0%
green: 0%
brightness: 100%
effect: pulse
on_tts_end:
- media_player.play_media: !lambda return x;
- light.turn_on:
id: top_led
blue: 0%
red: 20%
green: 100%
effect: pulse
on_end:
- delay: 100ms
- wait_until:
not:
media_player.is_playing: onju_out
- script.execute: reset_led
on_client_connected:
- if:
condition:
and:
- switch.is_on: use_wake_word
- binary_sensor.is_off: mute_switch
then:
- voice_assistant.start_continuous:
on_client_disconnected:
- if:
condition:
and:
- switch.is_on: use_wake_word
- binary_sensor.is_off: mute_switch
then:
- voice_assistant.stop:
on_error:
- light.turn_on:
id: top_led
blue: 0%
red: 100%
green: 0%
- delay: 1s
- script.execute: reset_led

number:

platform: template
name: "Touch threshold percentage"
id: touch_threshold_percentage
update_interval: never
entity_category: config
initial_value: 1.25
min_value: -1
max_value: 5
step: 0.25
optimistic: true
on_value:
then:
- lambda: !lambda |-
id(thresh_percent) = 0.01 * x;

esp32_touch:
setup_mode: false
sleep_duration: 2ms
measurement_duration: 800us
low_voltage_reference: 0.8V
high_voltage_reference: 2.4V

filter_mode: IIR_16
debounce_count: 2
noise_threshold: 0
jitter_step: 0
smooth_mode: IIR_2

denoise_grade: BIT8
denoise_cap_level: L0

binary_sensor:

platform: esp32_touch
id: volume_down
pin: GPIO4
threshold: 539000 # 533156-551132
on_press:
then:
- light.turn_on: left_led
- script.execute:
id: set_volume
volume: -0.05
- delay: 1s
- while:
condition:
binary_sensor.is_on: volume_down
then:
- script.execute:
id: set_volume
volume: -0.05
- delay: 150ms
on_release:
then:
- light.turn_off: left_led
platform: esp32_touch
id: volume_up
pin: GPIO2
threshold: 580000 # 575735-593064
on_press:
then:
- light.turn_on: right_led
- script.execute:
id: set_volume
volume: 0.05
- delay: 1s
- while:
condition:
binary_sensor.is_on: volume_up
then:
- script.execute:
id: set_volume
volume: 0.05
- delay: 150ms
on_release:
then:
- light.turn_off: right_led
platform: esp32_touch
id: action
pin: GPIO3
threshold: 751000 # 745618-767100
on_click:
- if:
  condition:
  or:
  - switch.is_off: use_wake_word
  - binary_sensor.is_on: mute_switch
  then:
  - if:
  condition: voice_assistant.is_running
  then:
  - voice_assistant.stop:
  - script.execute: reset_led
  else:
  - voice_assistant.start:
  else:
  - voice_assistant.stop
  - delay: 1s
  - script.execute: reset_led
  - script.wait: reset_led
  - voice_assistant.start_continuous:
platform: gpio
id: mute_switch
pin:
number: GPIO38
mode: INPUT_PULLUP
name: Disable wake word
on_press:
- script.execute: turn_on_wake_word
  on_release:
- script.execute: turn_off_wake_word
platform: status
id: api_connection
filters:
- delayed_on: 1s
  on_press:
- if:
  condition:
  and:
  - switch.is_on: use_wake_word
  - binary_sensor.is_off: mute_switch
  then:
  - voice_assistant.start_continuous:
  on_release:
- if:
  condition:
  and:
  - switch.is_on: use_wake_word
  - binary_sensor.is_off: mute_switch
  then:
  - voice_assistant.stop:

light:

platform: esp32_rmt_led_strip
id: leds
pin: GPIO11
chipset: SK6812
num_leds: 6
rgb_order: grb
rmt_channel: 0
default_transition_length: 0s
gamma_correct: 2.8
platform: partition
id: left_led
segments:
- id: leds
  from: 0
  to: 0
platform: partition
id: top_led
segments:
- id: leds
  from: 1
  to: 4
  effects:
- pulse:
  name: pulse
  transition_length: 250ms
  update_interval: 250ms
- pulse:
  name: slow_pulse
  transition_length: 1s
  update_interval: 2s
- addressable_lambda:
  name: show_volume
  update_interval: 50ms
  lambda: |-
  int int_volume = int(id(onju_out).volume * 100.0f * it.size());
  int full_leds = int_volume / 100;
  int last_brightness = int_volume % 100;
  int i = 0;
  for(; i < full_leds; i++) {
  it[i] = Color::WHITE;
  }
  if(i < 4) {
  it[i++] = Color(0,0,0).fade_to_white(last_brightness*256/100);
  }
  for(; i < it.size(); i++) {
  it[i] = Color::BLACK;
  }
platform: partition
id: right_led
segments:
- id: leds
  from: 5
  to: 5

script:

id: reset_led
then:
- if:
  condition:
  and:
  - switch.is_on: use_wake_word
  - binary_sensor.is_off: mute_switch
  then:
  - light.turn_on:
  id: top_led
  blue: 100%
  red: 100%
  green: 0%
  brightness: 100%
  effect: none
  else:
  - light.turn_off: top_led
id: set_volume
mode: restart
parameters:
volume: float
then:
- media_player.volume_set:
  id: onju_out
  volume: !lambda return clamp(id(onju_out).volume+volume, 0.0f, 1.0f);
- light.turn_on:
  id: top_led
  effect: show_volume
- delay: 1s
- script.execute: reset_led
id: turn_on_wake_word
then:
- if:
  condition:
  and:
  - binary_sensor.is_off: mute_switch
  - switch.is_on: use_wake_word
  then:
  - lambda: id(va).set_use_wake_word(true);
  - if:
  condition:
  not:
  - voice_assistant.is_running
  then:
  - voice_assistant.start_continuous
  - script.execute: reset_led
id: turn_off_wake_word
then:
- voice_assistant.stop
- lambda: id(va).set_use_wake_word(false);
- script.execute: reset_led
id: calibrate_touch
parameters:
button: int
then:
- lambda: |-
  static byte thresh_indices[3] = {0, 0, 0};
  static uint32_t sums[3] = {0, 0, 0};
  static byte qsizes[3] = {0, 0, 0};
  static int consecutive_anomalies_per_button[3] = {0, 0, 0};
  
  uint32_t newval;
  uint32_t* calibration_values;
  switch(button) {
  case 0:
  newval = id(volume_down).get_value();
  calibration_values = id(touch_calibration_values_left);
  break;
  case 1:
  newval = id(action).get_value();
  calibration_values = id(touch_calibration_values_center);
  break;
  case 2:
  newval = id(volume_up).get_value();
  calibration_values = id(touch_calibration_values_right);
  break;
  default:
  ESP_LOGE("touch_calibration", "Invalid button ID (%d)", button);
  return;
  }
  
  if(newval == 0) return;
  
  //ESP_LOGD("touch_calibration", "[%d] qsize %d, sum %d, thresh_index %d, consecutive_anomalies %d", button, qsizes[button], sums[button], thresh_indices[button], consecutive_anomalies_per_button[button]);
  //ESP_LOGD("touch_calibration", "[%d] New value is %d", button, newval);
  
  if(qsizes[button] == 5) {
  float avg = float(sums[button])/float(qsizes[button]);
  if((fabs(float(newval)-avg)/avg) > id(thresh_percent)) {
  consecutive_anomalies_per_button[button]++;
  //ESP_LOGD("touch_calibration", "[%d] %d anomalies detected.", button, consecutive_anomalies_per_button[button]);
  if(consecutive_anomalies_per_button[button] < 10)
  return;
  }
  }
  
  //ESP_LOGD("touch_calibration", "[%d] Resetting consecutive anomalies counter.", button);
  consecutive_anomalies_per_button[button] = 0;
  
  if(qsizes[button] == 5) {
  //ESP_LOGD("touch_calibration", "[%d] Queue full, removing %d.", button, id(touch_calibration_values)[thresh_indices[button]]);
  sums[button] -= (uint32_t) *(calibration_values+thresh_indices[button]);// id(touch_calibration_values)[thresh_indices[button]];
  qsizes[button]--;
  }
  *(calibration_values+thresh_indices[button]) = newval;
  sums[button] += newval;
  qsizes[button]++;
  thresh_indices[button] = (thresh_indices[button] + 1) % 5;
  
  //ESP_LOGD("touch_calibration", "[%d] Average value is %d", button, sums[button]/qsizes[button]);
  uint32_t newthresh = uint32_t((sums[button]/qsizes[button]) * (1.0 + id(thresh_percent)));
  //ESP_LOGD("touch_calibration", "[%d] Setting threshold %d", button, newthresh);
  
  switch(button) {
  case 0:
  id(volume_down).set_threshold(newthresh);
  break;
  case 1:
  id(action).set_threshold(newthresh);
  break;
  case 2:
  id(volume_up).set_threshold(newthresh);
  break;
  default:
  ESP_LOGE("touch_calibration", "Invalid button ID (%d)", button);
  return;
  }

switch:

platform: template
name: Use Wake Word
id: use_wake_word
optimistic: true
restore_mode: RESTORE_DEFAULT_ON
on_turn_on:
- script.execute: turn_on_wake_word
  on_turn_off:
- script.execute: turn_off_wake_word
platform: template
name: Listen DR
id: listen_dr
optimistic: true
on_turn_on:
- switch.turn_off: use_wake_word
- delay: 1s
- voice_assistant.start_continuous
  on_turn_off:
- switch.turn_on: use_wake_word`

gnumpi · 2024-06-06T15:57:26Z

So far I couldn't reproduce your issue with my hardware, which HA version are you running?

gnumpi linked a pull request Jun 1, 2024 that will close this issue

fix: arduino media player sets wrong state for announcements esphome/esphome#6849

Open

13 tasks

This was referenced Jun 4, 2024

Volume change on device no visual response tetele/onju-voice-satellite#42

Open

2024.5.2 (out of some bugs) - Wake word from HA works, mic works, speaker does not tetele/onju-voice-satellite#48

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Wake word not responding after update #5794

Wake word not responding after update #5794

itnassol commented May 15, 2024

collinstork commented May 16, 2024

Willber1 commented May 18, 2024

gregkg commented May 18, 2024

Willber1 commented May 18, 2024 via email

gregkg commented May 18, 2024 •

edited

Willber1 commented May 19, 2024 via email

Bandit3112011 commented May 20, 2024

itnassol commented May 20, 2024

Willber1 commented May 20, 2024 via email

PhilippeP62 commented Jun 1, 2024

PhilippeP62 commented Jun 1, 2024

itnassol commented Jun 2, 2024

PhilippeP62 commented Jun 2, 2024

itnassol commented Jun 2, 2024

PhilippeP62 commented Jun 2, 2024 •

edited

itnassol commented Jun 3, 2024

itnassol commented Jun 6, 2024 •

edited

gnumpi commented Jun 6, 2024

itnassol commented Jun 6, 2024

gnumpi commented Jun 6, 2024

Wake word not responding after update #5794

Wake word not responding after update #5794

Comments

itnassol commented May 15, 2024

The problem

Which version of ESPHome has the issue?

What type of installation are you using?

Which version of Home Assistant has the issue?

What platform are you using?

Board

Component causing the issue

Example YAML snippet

Anything in the logs that might be useful for us?

Additional information

collinstork commented May 16, 2024

Willber1 commented May 18, 2024

gregkg commented May 18, 2024

Willber1 commented May 18, 2024 via email

gregkg commented May 18, 2024 • edited

Willber1 commented May 19, 2024 via email

Bandit3112011 commented May 20, 2024

itnassol commented May 20, 2024

Willber1 commented May 20, 2024 via email

PhilippeP62 commented Jun 1, 2024

PhilippeP62 commented Jun 1, 2024

itnassol commented Jun 2, 2024

PhilippeP62 commented Jun 2, 2024

itnassol commented Jun 2, 2024

PhilippeP62 commented Jun 2, 2024 • edited

itnassol commented Jun 3, 2024

itnassol commented Jun 6, 2024 • edited

gnumpi commented Jun 6, 2024

itnassol commented Jun 6, 2024

speaker:

- platform: i2s_audio

id: onju_out

dac_type: external

i2s_dout_pin: GPIO12

mode: stereo

speaker: onju_out

gnumpi commented Jun 6, 2024

gregkg commented May 18, 2024 •

edited

PhilippeP62 commented Jun 2, 2024 •

edited

itnassol commented Jun 6, 2024 •

edited