How to Achieve Offline Voice Control for Smart Home without Wake Word using Home Assistant

I am looking for a solution to enable offline voice control for my smart home devices without the use of a wake word. The system should allow me to control devices by simple voice commands, such as “turn on the light,” “turn off the air conditioner,” or “open/close the curtains,” without needing a specific wake word.

Requirements:

  1. No Wake Word: I want the system to operate without the need for a wake word (e.g., “Hey Siri,” “Alexa,” etc.). Voice commands should be recognized without needing any specific activation phrase.
  2. Offline Functionality: The system should work without an internet connection. However, if an offline solution is not feasible, an online solution would be acceptable, but it must still not require a wake word.
  3. Microphone-only Setup: I only want to use a microphone device for voice input, with no speakers or any form of audible feedback.

Hardware and Software Setup:

Previous Attempts:

I have tried using HAOS combined with the RHASSPY plugin, but encountered several issues:

  1. ReSpeaker 4-Mic Array is not recognized correctly by HAOS and the RHASSPY plugin. There seems to be a driver issue, as I couldn’t install it properly.
  2. When attempting to use the recording command in SSH, it fails due to missing commands, preventing the microphone from functioning as expected.

Request:

Could anyone provide a new solution or technical approach to achieve this setup, either using Home Assistant or other compatible systems? I would greatly appreciate any suggestions or guidance.

Thank you very much!

For the audio part without wake word, i think of two solutions.

  • use some streaming tts (kaldi, if you want to run on cpu) which will transcript everything, and when you detect intent in the transcription, do the command.
  • train multiple wake word, one per needed command

YES
I have tried using HAOS combined with the RHASSPY plugin, but encountered several issues:

  1. ReSpeaker 4-Mic Array is not recognized correctly by HAOS and the RHASSPY plugin. There seems to be a driver issue, as I couldn’t install it properly.
  2. When attempting to use the recording command in SSH, it fails due to missing commands, preventing the microphone from functioning as expected.