Dear all,
my aim is to use Snips and Rhasspy at the same time. The reason for this is that I had some well functioning Snips Skills (for example asking for regional train connections or adding stuff to my “Bring”-grocery-list). Another reason is that I would like to keep using the “Hey Snips”-Hotword.
But until now I wasn`t able to get it up and running - due to changing and sometimes recurring problems.
Now my question: Has anyone a similar setup and can me show the needed settings and preferences? Or can anyone give me hints?
My setup:
** Hardware **
- Raspberry Pi 4 with Raspbian Buster (2GB RAM)
- Seed Respeaker 4-Mic-Array (with HermesLED installed)
** Software **
- Snips installed (not in a container)
- Home Assistant/hass.io in a Docker Container on the same Raspberry Pi 4
- Rhasspy 2.4.19 in a Docker Container on the same Raspberry Pi 4 (german profile)
- Rhasspy 2.5-pre in another Container, pointing to the same profile in /.config/Rhasspy/profiles/de/ (but I am waiting for some features like Google TTS Wavenet-Cache support to switch for good)
My idea until now:
- Listen for wakeword on start-up
- MQTT enabled, pointing to IP Adress and Port of Snips’ MQTT broker (Publish intent over MQTT checked)
- Intent Handling via Hass (Token and PW entered), send events to Home Assistant checked
- Wake up on MQTT message
- Voice detection: Use MQTT
- Speech recognition: Pocketsphinx (or Kaldi, if it does not take too long on my Raspberry Pi 4)
- Do intent recognition with OpenFST on this device (don’t know which ist the best option here for my setup / language is german)
- TTS: Google Wavenet (credentials.json in the profile directory, path /tts/googlewavenet/credentials.json)
- Audio recording: Get microphone input remotely with MQTT
- Play sound remotely with MQTT
- WAV sounds: changed the path file to Snips’-WAV-Files (e.g. ${RHASSPY_BASE_DIR}/usr/share/snips/assisstant/custom_dialogue/sound/start_of_input.wav), and disabled the sound feeback in snips itself (but did not hear any sound feedback since)