Rhasspy 2.5: sattelite can not remotely detect wakeword

ulno · April 8, 2020, 12:53am

I set up rhasspy 2.5 on two venv environments (pulled current code today recursively and issued another make), one of them has a mosquitto server running.
I can make them work standalone, but if I configure one as satellite and also set the wakeword to Hermes MQTT, I see a lot of data being streamed through mqtt, but my precise password never triggers (it does in the standalone setups).

Did I misunderstand something in the satellite setup? I have to admit that I also don’t get a local wakeword with remote stt working with Hermes MQTT - even if I can verify there is a lot of raw data going via my mqtt server.

So, even the satellite setup as described in the local documentation does not work. It does detect a local wakeword and then starts dumping tons of raw data into MQTT, but then stops with a timeout. It also plays the wav-detection sound from the master and not the local wav of the client.

log master:

Starting up...
DEBUG:rhasspysupervisor:Namespace(debug=True, docker_compose='', local_mqtt_port=12183, profile='en', supervisord_conf='supervisord.conf', system_profiles=None, user_profiles=PosixPath('/home/homeaut/.config/rhasspy/profiles'))
DEBUG:rhasspysupervisor:Loading profile en (user=/home/homeaut/.config/rhasspy/profiles, system=None)
DEBUG:rhasspyprofile.profile:Loading /home/homeaut/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/en/profile.json
DEBUG:rhasspyprofile.profile:Loading /home/homeaut/.config/rhasspy/profiles/en/profile.json
DEBUG:rhasspysupervisor:Generating supervisord conf
DEBUG:rhasspysupervisor:Microphone disabled (system=hermes)
DEBUG:rhasspysupervisor:Speakers disabled (system=dummy)
DEBUG:rhasspysupervisor:Intent handling disabled (system=dummy)
DEBUG:rhasspysupervisor:Wrote /home/homeaut/.config/rhasspy/profiles/en/supervisord.conf
Starting services...
2020-04-08 15:13:18,332 INFO supervisord started with pid 26328
[DEBUG:2020-04-08 15:13:18,700] rhasspyserver_hermes: Namespace(certfile=None, host='0.0.0.0', keyfile=None, local_mqtt_port=12183, log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', log_level='DEBUG', mqtt_host=None, mqtt_password=None, mqtt_port=None, mqtt_username=None, port=12101, profile='en', set=[], system_profiles=None, user_profiles='/home/homeaut/.config/rhasspy/profiles', web_dir='/home/homeaut/rhasspy-voltron/rhasspy-server-hermes/web')
[DEBUG:2020-04-08 15:13:18,739] rhasspyprofile.profile: Loading /home/homeaut/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/en/profile.json
[DEBUG:2020-04-08 15:13:18,739] rhasspyprofile.profile: Loading /home/homeaut/.config/rhasspy/profiles/en/profile.json
[DEBUG:2020-04-08 15:13:18,739] rhasspyprofile.profile: Loading default profile settings from /home/homeaut/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/defaults.json
[DEBUG:2020-04-08 15:13:18,740] rhasspyserver_hermes: Starting core
[DEBUG:2020-04-08 15:13:18,740] rhasspyserver_hermes: Connecting to localhost:1883 (retries: 0/10)
[DEBUG:2020-04-08 15:13:18,743] rhasspyserver_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:18,743] rhasspyserver_hermes: Subscribed to hermes/hotword/+/detected
[DEBUG:2020-04-08 15:13:18,743] rhasspyserver_hermes: Subscribed to hermes/asr/textCaptured
[DEBUG:2020-04-08 15:13:18,743] rhasspyserver_hermes: Subscribed to hermes/intent/#
[DEBUG:2020-04-08 15:13:18,743] rhasspyserver_hermes: Subscribed to hermes/nlu/intentNotRecognized
[DEBUG:2020-04-08 15:13:18,744] rhasspyserver_hermes: Subscribed to rhasspy/asr/router/router/audioCaptured
[DEBUG:2020-04-08 15:13:18,744] rhasspyserver_hermes: Subscribed to hermes/audioServer/router/audioSummary
[DEBUG:2020-04-08 15:13:18,744] rhasspyserver_hermes: Subscribed to hermes/intent/#
[DEBUG:2020-04-08 15:13:18,744] rhasspyserver_hermes: Subscribed to hermes/audioServer/router/audioSummary
[DEBUG:2020-04-08 15:13:18,744] rhasspyserver_hermes: Subscribed to hermes/hotword/+/detected
[DEBUG:2020-04-08 15:13:18,745] rhasspyserver_hermes: Subscribed to hermes/asr/textCaptured
[DEBUG:2020-04-08 15:13:18,745] rhasspyserver_hermes: Subscribed to hermes/nlu/intentNotRecognized
[DEBUG:2020-04-08 15:13:18,745] rhasspyserver_hermes: Subscribed to rhasspy/asr/router/router/audioCaptured
[INFO:2020-04-08 15:13:18,745] rhasspyserver_hermes: Started
[DEBUG:2020-04-08 15:13:18,745] rhasspyserver_hermes: Starting web server at http://0.0.0.0:12101
Running on http://0.0.0.0:12101 (CTRL + C to quit)
2020-04-08 15:13:19,337 INFO spawned: 'dialogue' with pid 26333
2020-04-08 15:13:19,341 INFO spawned: 'intent_recognition' with pid 26334
2020-04-08 15:13:19,348 INFO spawned: 'speech_to_text' with pid 26335
2020-04-08 15:13:19,351 INFO spawned: 'text_to_speech' with pid 26338
2020-04-08 15:13:19,354 INFO spawned: 'wake_word' with pid 26340
[DEBUG:2020-04-08 15:13:19,667] rhasspytts_cli_hermes: Namespace(debug=True, host='localhost', language='en-US', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', password=None, play_command=None, port=1883, siteId=['router'], tts_command='bash -c \'curl -sS -X GET -G --output - --data-urlencode INPUT_TYPE=TEXT --data-urlencode OUTPUT_TYPE=AUDIO --data-urlencode AUDIO=WAVE --data-urlencode LOCALE={lang} --data-urlencode INPUT_TEXT="$0" http://localhost:59125/process --data-urlencode VOICE=dfki-prudence-hsmm\'', username=None, voices_command='curl -sS -X GET http://localhost:59125/voices')
[DEBUG:2020-04-08 15:13:19,668] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,669] rhasspytts_cli_hermes: Connecting to localhost:1883
[DEBUG:2020-04-08 15:13:19,675] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,676] rhasspytts_cli_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:19,677] rhasspytts_cli_hermes: Subscribed to hermes/tts/say
[DEBUG:2020-04-08 15:13:19,677] rhasspytts_cli_hermes: Subscribed to hermes/audioServer/router/playFinished
[DEBUG:2020-04-08 15:13:19,677] rhasspytts_cli_hermes: Subscribed to rhasspy/tts/getVoices
[DEBUG:2020-04-08 15:13:19,702] rhasspydialogue_hermes: Namespace(debug=True, host='localhost', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', password=None, port=1883, session_timeout=30.0, siteId=['router', 'ulno-desktop'], sound=[['wake', '/home/homeaut/rhasspy-voltron/etc/wav/beep_hi.wav'], ['recorded', '/home/homeaut/rhasspy-voltron/etc/wav/beep_lo.wav'], ['error', '/home/homeaut/rhasspy-voltron/etc/wav/beep_error.wav']], username=None, wakewordId=None)
[DEBUG:2020-04-08 15:13:19,703] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,704] rhasspydialogue_hermes: Connecting to localhost:1883
[DEBUG:2020-04-08 15:13:19,710] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,711] rhasspydialogue_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:19,712] rhasspydialogue_hermes: Subscribed to hermes/asr/textCaptured
[DEBUG:2020-04-08 15:13:19,712] rhasspydialogue_hermes: Subscribed to hermes/dialogueManager/startSession
[DEBUG:2020-04-08 15:13:19,712] rhasspydialogue_hermes: Subscribed to hermes/intent/#
[DEBUG:2020-04-08 15:13:19,713] rhasspydialogue_hermes: Subscribed to hermes/dialogueManager/continueSession
[DEBUG:2020-04-08 15:13:19,713] rhasspydialogue_hermes: Subscribed to hermes/hotword/+/detected
[DEBUG:2020-04-08 15:13:19,713] rhasspydialogue_hermes: Subscribed to hermes/tts/sayFinished
[DEBUG:2020-04-08 15:13:19,714] rhasspydialogue_hermes: Subscribed to hermes/audioServer/router/playFinished
[DEBUG:2020-04-08 15:13:19,714] rhasspydialogue_hermes: Subscribed to hermes/dialogueManager/endSession
[DEBUG:2020-04-08 15:13:19,715] rhasspydialogue_hermes: Subscribed to hermes/nlu/intentNotRecognized
[DEBUG:2020-04-08 15:13:19,715] rhasspydialogue_hermes: Subscribed to hermes/audioServer/ulno-desktop/playFinished
[DEBUG:2020-04-08 15:13:19,796] rhasspywake_precise_hermes: Namespace(debug=True, engine=None, host='localhost', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', log_predictions=False, model='hey-mycroft-2.pb', model_dir=['/home/homeaut/.config/rhasspy/profiles/en/precise'], password=None, port=1883, sensitivity=0.5, siteId=['router'], trigger_level=3, udp_audio_port=None, username=None, wakewordId='')
[DEBUG:2020-04-08 15:13:19,796] rhasspywake_precise_hermes: Using engine at /home/homeaut/rhasspy-voltron/.venv/tools/precise-engine/precise-engine
[DEBUG:2020-04-08 15:13:19,797] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,809] rhasspywake_precise_hermes: Loading Precise engine at /home/homeaut/rhasspy-voltron/.venv/tools/precise-engine/precise-engine
[DEBUG:2020-04-08 15:13:19,835] rhasspywake_precise_hermes: Loaded Mycroft Precise (model=/home/homeaut/rhasspy-voltron/rhasspy-wake-precise-hermes/rhasspywake_precise_hermes/models/hey-mycroft-2.pb, sensitivity=0.5, trigger_level=3)
[DEBUG:2020-04-08 15:13:19,835] rhasspywake_precise_hermes: Connecting to localhost:1883
[DEBUG:2020-04-08 15:13:19,840] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:19,840] rhasspywake_precise_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:19,841] rhasspywake_precise_hermes: Subscribed to rhasspy/hotword/getHotwords
[DEBUG:2020-04-08 15:13:19,842] rhasspywake_precise_hermes: Subscribed to hermes/hotword/toggleOff
[DEBUG:2020-04-08 15:13:19,842] rhasspywake_precise_hermes: Subscribed to hermes/audioServer/router/audioFrame
[DEBUG:2020-04-08 15:13:19,843] rhasspywake_precise_hermes: Subscribed to hermes/hotword/toggleOn
[DEBUG:2020-04-08 15:13:20,020] rhasspynlu_hermes: Namespace(casing='lower', debug=True, host='localhost', intent_graph='/home/homeaut/.config/rhasspy/profiles/en/intent_graph.pickle.gz', language='en_US', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', no_fuzzy=False, password=None, port=1883, replace_numbers=True, siteId=['router'], username=None)
[DEBUG:2020-04-08 15:13:20,021] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:20,022] rhasspynlu_hermes: Connecting to localhost:1883
[DEBUG:2020-04-08 15:13:20,029] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:20,030] rhasspynlu_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:20,030] rhasspynlu_hermes: Subscribed to rhasspy/nlu/router/train
[DEBUG:2020-04-08 15:13:20,031] rhasspynlu_hermes: Subscribed to hermes/nlu/query
[DEBUG:2020-04-08 15:13:20,188] rhasspyasr_kaldi_hermes: Namespace(base_dictionary=['/home/homeaut/.config/rhasspy/profiles/en/kaldi/base_dictionary.txt', '/home/homeaut/.config/rhasspy/profiles/en/kaldi_custom_words.txt'], debug=True, dictionary='/home/homeaut/.config/rhasspy/profiles/en/kaldi/dictionary.txt', dictionary_casing='lower', g2p_casing='ignore', g2p_model='/home/homeaut/.config/rhasspy/profiles/en/kaldi/g2p.fst', graph_dir='/home/homeaut/.config/rhasspy/profiles/en/kaldi/model/graph', host='localhost', language_model='/home/homeaut/.config/rhasspy/profiles/en/kaldi/language_model.txt', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', model_dir='/home/homeaut/.config/rhasspy/profiles/en/kaldi/model', model_type='nnet3', no_overwrite_train=False, password=None, port=1883, reuse_transcribers=False, siteId=['router'], unknown_words='/home/homeaut/.config/rhasspy/profiles/en/kaldi_unknown_words.txt', username=None, voice_before_seconds=0.5, voice_min_seconds=1.0, voice_sensitivity=1, voice_silence_seconds=0.5, voice_skip_seconds=0.0, voice_speech_seconds=0.3)
[DEBUG:2020-04-08 15:13:20,188] rhasspyasr_kaldi_hermes: Loading Kaldi model from /home/homeaut/.config/rhasspy/profiles/en/kaldi/model (graph=/home/homeaut/.config/rhasspy/profiles/en/kaldi/model/graph)
[DEBUG:2020-04-08 15:13:20,189] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:20,189] rhasspyasr_kaldi_hermes: Connecting to localhost:1883
[DEBUG:2020-04-08 15:13:20,193] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:20,193] rhasspyasr_kaldi_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:20,193] rhasspyasr_kaldi_hermes: Subscribed to hermes/asr/toggleOff
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to hermes/asr/stopListening
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to hermes/audioServer/router/+/audioSessionFrame
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to hermes/asr/toggleOn
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to rhasspy/g2p/pronounce
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to rhasspy/asr/router/train
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to hermes/asr/startListening
[DEBUG:2020-04-08 15:13:20,194] rhasspyasr_kaldi_hermes: Subscribed to hermes/audioServer/router/audioFrame
2020-04-08 15:13:21,196 INFO success: dialogue entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:21,196 INFO success: intent_recognition entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:21,197 INFO success: speech_to_text entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:21,197 INFO success: text_to_speech entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:21,197 INFO success: wake_word entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
[DEBUG:2020-04-08 15:14:03,307] rhasspydialogue_hermes: <- HotwordDetected(modelId='athena.pb', modelVersion='', modelType='personal', currentSensitivity=0.4, siteId='ulno-desktop', sessionId='', sendAudioCaptured=None)
[DEBUG:2020-04-08 15:14:03,307] rhasspydialogue_hermes: Playing WAV /home/homeaut/rhasspy-voltron/etc/wav/beep_hi.wav
[DEBUG:2020-04-08 15:14:03,309] rhasspydialogue_hermes: -> HotwordToggleOff(siteId='ulno-desktop', reason=<HotwordToggleReason.PLAY_AUDIO: 'playAudio'>)
[DEBUG:2020-04-08 15:14:03,309] rhasspydialogue_hermes: Publishing 49 bytes(s) to hermes/hotword/toggleOff
[DEBUG:2020-04-08 15:14:03,310] rhasspydialogue_hermes: -> AsrToggleOff(siteId='ulno-desktop', reason=<AsrToggleReason.PLAY_AUDIO: 'playAudio'>)
[DEBUG:2020-04-08 15:14:03,310] rhasspydialogue_hermes: Publishing 49 bytes(s) to hermes/asr/toggleOff
[DEBUG:2020-04-08 15:14:03,311] rhasspydialogue_hermes: -> AudioPlayBytes(83948 byte(s))
[DEBUG:2020-04-08 15:14:03,816] rhasspydialogue_hermes: <- AudioPlayFinished(id='d4b3d701-6ba5-4cf0-b899-93b6c9d0a44a', sessionId='')
[DEBUG:2020-04-08 15:14:03,817] rhasspydialogue_hermes: -> HotwordToggleOn(siteId='ulno-desktop', reason=<HotwordToggleReason.PLAY_AUDIO: 'playAudio'>)
[DEBUG:2020-04-08 15:14:03,817] rhasspydialogue_hermes: Publishing 49 bytes(s) to hermes/hotword/toggleOn
[DEBUG:2020-04-08 15:14:03,818] rhasspydialogue_hermes: -> AsrToggleOn(siteId='ulno-desktop', reason=<AsrToggleReason.PLAY_AUDIO: 'playAudio'>)
[DEBUG:2020-04-08 15:14:03,818] rhasspydialogue_hermes: Publishing 49 bytes(s) to hermes/asr/toggleOn
[DEBUG:2020-04-08 15:14:03,818] rhasspydialogue_hermes: Starting new session (id=ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6)
[DEBUG:2020-04-08 15:14:03,819] rhasspydialogue_hermes: -> DialogueSessionStarted(siteId='ulno-desktop', sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6', customData='athena')
[DEBUG:2020-04-08 15:14:03,820] rhasspydialogue_hermes: Publishing 123 bytes(s) to hermes/dialogueManager/sessionStarted
[DEBUG:2020-04-08 15:14:03,820] rhasspydialogue_hermes: -> HotwordToggleOff(siteId='ulno-desktop', reason=<HotwordToggleReason.DIALOGUE_SESSION: 'dialogueSession'>)
[DEBUG:2020-04-08 15:14:03,821] rhasspydialogue_hermes: Publishing 55 bytes(s) to hermes/hotword/toggleOff
[DEBUG:2020-04-08 15:14:03,821] rhasspydialogue_hermes: Listening for session ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6
[DEBUG:2020-04-08 15:14:03,821] rhasspydialogue_hermes: -> AsrStartListening(siteId='ulno-desktop', sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6', stopOnSilence=True, sendAudioCaptured=True, wakewordId='athena')
[DEBUG:2020-04-08 15:14:03,822] rhasspydialogue_hermes: Publishing 173 bytes(s) to hermes/asr/startListening
[ERROR:2020-04-08 15:14:33,853] rhasspydialogue_hermes: Session timed out: ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6
[DEBUG:2020-04-08 15:14:33,853] rhasspydialogue_hermes: -> AsrStopListening(siteId='ulno-desktop', sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6')
[DEBUG:2020-04-08 15:14:33,853] rhasspydialogue_hermes: Publishing 99 bytes(s) to hermes/asr/stopListening
[DEBUG:2020-04-08 15:14:33,854] rhasspydialogue_hermes: -> DialogueSessionEnded(termination=DialogueSessionTermination(reason=<DialogueSessionTerminationReason.TIMEOUT: 'timeout'>), sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6', customData='athena', siteId='ulno-desktop')
[DEBUG:2020-04-08 15:14:33,854] rhasspydialogue_hermes: Publishing 161 bytes(s) to hermes/dialogueManager/sessionEnded

log client:

Starting up...
DEBUG:rhasspysupervisor:Namespace(debug=True, docker_compose='', local_mqtt_port=12183, profile='en', supervisord_conf='supervisord.conf', system_profiles=None, user_profiles=PosixPath('/home/ulno/.config/rhasspy/profiles'))
DEBUG:rhasspysupervisor:Loading profile en (user=/home/ulno/.config/rhasspy/profiles, system=None)
DEBUG:rhasspyprofile.profile:Loading /storage/0/tmp/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/en/profile.json
DEBUG:rhasspyprofile.profile:Loading /home/ulno/.config/rhasspy/profiles/en/profile.json
DEBUG:rhasspysupervisor:Generating supervisord conf
WARNING:rhasspysupervisor:No sound output device listing command provided.
DEBUG:rhasspysupervisor:Speech to text disabled (system=hermes)
DEBUG:rhasspysupervisor:Intent recognition disabled (system=hermes)
DEBUG:rhasspysupervisor:Intent handling disabled (system=dummy)
DEBUG:rhasspysupervisor:Dialogue disabled (system=dummy)
DEBUG:rhasspysupervisor:Wrote /home/ulno/.config/rhasspy/profiles/en/supervisord.conf
Starting services...
2020-04-08 15:13:21,574 INFO supervisord started with pid 125591
[DEBUG:2020-04-08 15:13:22,134] rhasspyserver_hermes: Namespace(certfile=None, host='0.0.0.0', keyfile=None, local_mqtt_port=12183, log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', log_level='DEBUG', mqtt_host=None, mqtt_password=None, mqtt_port=None, mqtt_username=None, port=12101, profile='en', set=[], system_profiles=None, user_profiles='/home/ulno/.config/rhasspy/profiles', web_dir='/storage/0/tmp/rhasspy-voltron/rhasspy-server-hermes/web')
[DEBUG:2020-04-08 15:13:22,218] rhasspyprofile.profile: Loading /storage/0/tmp/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/en/profile.json
[DEBUG:2020-04-08 15:13:22,219] rhasspyprofile.profile: Loading /home/ulno/.config/rhasspy/profiles/en/profile.json
[DEBUG:2020-04-08 15:13:22,219] rhasspyprofile.profile: Loading default profile settings from /storage/0/tmp/rhasspy-voltron/rhasspy-profile/rhasspyprofile/profiles/defaults.json
[DEBUG:2020-04-08 15:13:22,221] rhasspyserver_hermes: Starting core
[DEBUG:2020-04-08 15:13:22,221] rhasspyserver_hermes: Connecting to router:1883 (retries: 0/10)
[DEBUG:2020-04-08 15:13:22,228] rhasspyserver_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:22,228] rhasspyserver_hermes: Subscribed to hermes/hotword/+/detected
[DEBUG:2020-04-08 15:13:22,228] rhasspyserver_hermes: Subscribed to hermes/asr/textCaptured
[DEBUG:2020-04-08 15:13:22,228] rhasspyserver_hermes: Subscribed to hermes/intent/#
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/nlu/intentNotRecognized
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to rhasspy/asr/ulno-desktop/ulno-desktop/audioCaptured
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/audioServer/ulno-desktop/audioSummary
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/nlu/intentNotRecognized
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/hotword/+/detected
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/audioServer/ulno-desktop/audioSummary
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to rhasspy/asr/ulno-desktop/ulno-desktop/audioCaptured
[DEBUG:2020-04-08 15:13:22,229] rhasspyserver_hermes: Subscribed to hermes/asr/textCaptured
[DEBUG:2020-04-08 15:13:22,230] rhasspyserver_hermes: Subscribed to hermes/intent/#
[INFO:2020-04-08 15:13:22,230] rhasspyserver_hermes: Started
[DEBUG:2020-04-08 15:13:22,230] rhasspyserver_hermes: Starting web server at http://0.0.0.0:12101
Running on http://0.0.0.0:12101 (CTRL + C to quit)
2020-04-08 15:13:22,577 INFO spawned: 'microphone' with pid 125600
2020-04-08 15:13:22,581 INFO spawned: 'speakers' with pid 125601
2020-04-08 15:13:22,584 INFO spawned: 'text_to_speech' with pid 125602
2020-04-08 15:13:22,588 INFO spawned: 'wake_word' with pid 125603
[DEBUG:2020-04-08 15:13:22,904] rhasspyspeakers_cli_hermes: Namespace(debug=True, host='router', list_command=None, log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', password=None, play_command='paplay', port=1883, siteId=['ulno-desktop'], username=None)
[DEBUG:2020-04-08 15:13:22,905] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,906] rhasspyspeakers_cli_hermes: Connecting to router:1883
[DEBUG:2020-04-08 15:13:22,915] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,915] rhasspyspeakers_cli_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:22,916] rhasspyspeakers_cli_hermes: Subscribed to rhasspy/audioServer/getDevices
[DEBUG:2020-04-08 15:13:22,917] rhasspyspeakers_cli_hermes: Subscribed to hermes/audioServer/ulno-desktop/playBytes/#
[DEBUG:2020-04-08 15:13:22,917] rhasspyspeakers_cli_hermes: Subscribed to hermes/audioServer/toggleOff
[DEBUG:2020-04-08 15:13:22,917] rhasspyspeakers_cli_hermes: Subscribed to hermes/audioServer/toggleOn
[DEBUG:2020-04-08 15:13:22,923] rhasspytts_cli_hermes: Namespace(debug=True, host='router', language='en-US', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', password=None, play_command=None, port=1883, siteId=['ulno-desktop'], tts_command='bash -c \'curl -sS -X GET -G --output - --data-urlencode INPUT_TYPE=TEXT --data-urlencode OUTPUT_TYPE=AUDIO --data-urlencode AUDIO=WAVE --data-urlencode LOCALE={lang} --data-urlencode INPUT_TEXT="$0" http://router:59125/process --data-urlencode VOICE=dfki-prudence-hsmm\'', username=None, voices_command='curl -sS -X GET http://router:59125/voices')
[DEBUG:2020-04-08 15:13:22,924] rhasspywake_precise_hermes: Namespace(debug=True, engine=None, host='router', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', log_predictions=False, model='athena.pb', model_dir=['/home/ulno/.config/rhasspy/profiles/en/precise'], password=None, port=1883, sensitivity=0.4, siteId=['ulno-desktop'], trigger_level=3, udp_audio_port=12102, username=None, wakewordId='')
[DEBUG:2020-04-08 15:13:22,924] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,924] rhasspytts_cli_hermes: Connecting to router:1883
[DEBUG:2020-04-08 15:13:22,924] rhasspywake_precise_hermes: Using engine at /storage/0/tmp/rhasspy-voltron/.venv/tools/precise-engine/precise-engine
[DEBUG:2020-04-08 15:13:22,925] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,926] rhasspywake_precise_hermes: Loading Precise engine at /storage/0/tmp/rhasspy-voltron/.venv/tools/precise-engine/precise-engine
[DEBUG:2020-04-08 15:13:22,927] rhasspywake_precise_hermes: Listening for audio on UDP port 12102
[DEBUG:2020-04-08 15:13:22,933] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,933] rhasspytts_cli_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:22,934] rhasspytts_cli_hermes: Subscribed to rhasspy/tts/getVoices
[DEBUG:2020-04-08 15:13:22,934] rhasspytts_cli_hermes: Subscribed to hermes/audioServer/ulno-desktop/playFinished
[DEBUG:2020-04-08 15:13:22,934] rhasspytts_cli_hermes: Subscribed to hermes/tts/say
[DEBUG:2020-04-08 15:13:22,935] rhasspywake_precise_hermes: Loaded Mycroft Precise (model=/storage/0/tmp/rhasspy-voltron/rhasspy-wake-precise-hermes/rhasspywake_precise_hermes/models/athena.pb, sensitivity=0.4, trigger_level=3)
[DEBUG:2020-04-08 15:13:22,935] rhasspywake_precise_hermes: Connecting to router:1883
[DEBUG:2020-04-08 15:13:22,945] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:22,945] rhasspywake_precise_hermes: Connected to MQTT broker
[DEBUG:2020-04-08 15:13:22,946] rhasspywake_precise_hermes: Subscribed to rhasspy/hotword/getHotwords
[DEBUG:2020-04-08 15:13:22,946] rhasspywake_precise_hermes: Subscribed to hermes/hotword/toggleOn
[DEBUG:2020-04-08 15:13:22,946] rhasspywake_precise_hermes: Subscribed to hermes/hotword/toggleOff
[DEBUG:2020-04-08 15:13:22,946] rhasspywake_precise_hermes: Subscribed to hermes/audioServer/ulno-desktop/audioFrame
[DEBUG:2020-04-08 15:13:23,089] __main__: Namespace(channels=1, debug=True, device_index=None, host='router', log_format='[%(levelname)s:%(asctime)s] %(name)s: %(message)s', output_siteId='ulno-desktop2', password=None, port=1883, sample_rate=16000, sample_width=2, siteId=['ulno-desktop'], udp_audio_port=12102, username=None)
[DEBUG:2020-04-08 15:13:23,090] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:23,091] rhasspymicrophone_pyaudio_hermes: Audio will also be sent to UDP port 12102
[DEBUG:2020-04-08 15:13:23,092] __main__: Connecting to router:1883
ALSA lib pcm_dsnoop.c:641:(snd_pcm_dsnoop_open) [DEBUG:2020-04-08 15:13:23,101] rhasspymicrophone_pyaudio_hermes: Connected to MQTT broker
unable to open slave
[DEBUG:2020-04-08 15:13:23,101] asyncio: Using selector: EpollSelector
[DEBUG:2020-04-08 15:13:23,101] rhasspymicrophone_pyaudio_hermes: Subscribed to hermes/asr/stopListening
[DEBUG:2020-04-08 15:13:23,102] rhasspymicrophone_pyaudio_hermes: Subscribed to hermes/audioServer/toggleSummaryOff
ALSA lib pcm_dmix.c:1089:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm.c:2642:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2642:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2642:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
[DEBUG:2020-04-08 15:13:23,102] rhasspymicrophone_pyaudio_hermes: Subscribed to hermes/asr/startListening
[DEBUG:2020-04-08 15:13:23,102] rhasspymicrophone_pyaudio_hermes: Subscribed to rhasspy/audioServer/getDevices
[DEBUG:2020-04-08 15:13:23,102] rhasspymicrophone_pyaudio_hermes: Subscribed to hermes/audioServer/toggleSummaryOn
connect(2) call to /dev/shm/jack-1000/default/jack_0 failed (err=No such file or directory)
attempt to connect to server failed
connect(2) call to /dev/shm/jack-1000/default/jack_0 failed (err=No such file or directory)
attempt to connect to server failed
ALSA lib pcm_oss.c:377:(_snd_pcm_oss_open) Unknown field port
ALSA lib pcm_oss.c:377:(_snd_pcm_oss_open) Unknown field port
ALSA lib pcm_usb_stream.c:486:(_snd_pcm_usb_stream_open) Invalid type for card
ALSA lib pcm_usb_stream.c:486:(_snd_pcm_usb_stream_open) Invalid type for card
ALSA lib pcm_dmix.c:1089:(snd_pcm_dmix_open) unable to open slave
connect(2) call to /dev/shm/jack-1000/default/jack_0 failed (err=No such file or directory)
attempt to connect to server failed
[DEBUG:2020-04-08 15:13:23,145] rhasspymicrophone_pyaudio_hermes: Recording audio
[DEBUG:2020-04-08 15:13:23,210] rhasspywake_precise_hermes: Receiving audio
2020-04-08 15:13:24,211 INFO success: microphone entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:24,212 INFO success: speakers entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:24,212 INFO success: text_to_speech entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-08 15:13:24,212 INFO success: wake_word entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
[DEBUG:2020-04-08 15:14:03,305] rhasspywake_precise_hermes: -> HotwordDetected(modelId='athena.pb', modelVersion='', modelType='personal', currentSensitivity=0.4, siteId='ulno-desktop', sessionId='', sendAudioCaptured=None)
[DEBUG:2020-04-08 15:14:03,305] rhasspywake_precise_hermes: Publishing 166 bytes(s) to hermes/hotword/athena/detected
[DEBUG:2020-04-08 15:14:03,307] rhasspyserver_hermes: <- HotwordDetected(modelId='athena.pb', modelVersion='', modelType='personal', currentSensitivity=0.4, siteId='ulno-desktop', sessionId='', sendAudioCaptured=None)
[WARNING:2020-04-08 15:14:03,307] rhasspyserver_hermes: Dialogue management is disabled. ASR will NOT be automatically enabled.
[DEBUG:2020-04-08 15:14:03,309] rhasspyserver_hermes: Sent 50 char(s) to websocket
[DEBUG:2020-04-08 15:14:03,312] rhasspywake_precise_hermes: <- HotwordToggleOff(siteId='ulno-desktop', reason='playAudio')
[DEBUG:2020-04-08 15:14:03,313] rhasspywake_precise_hermes: Disabled
[DEBUG:2020-04-08 15:14:03,316] rhasspyspeakers_cli_hermes: <- AudioPlayBytes(83948 byte(s))
[DEBUG:2020-04-08 15:14:03,316] rhasspyspeakers_cli_hermes: ['paplay']
[DEBUG:2020-04-08 15:14:03,814] rhasspyspeakers_cli_hermes: -> AudioPlayFinished(id='d4b3d701-6ba5-4cf0-b899-93b6c9d0a44a', sessionId='')
[DEBUG:2020-04-08 15:14:03,814] rhasspyspeakers_cli_hermes: Publishing 63 bytes(s) to hermes/audioServer/ulno-desktop/playFinished
[DEBUG:2020-04-08 15:14:03,816] rhasspytts_cli_hermes: <- AudioPlayFinished(id='d4b3d701-6ba5-4cf0-b899-93b6c9d0a44a', sessionId='')
[DEBUG:2020-04-08 15:14:03,820] rhasspywake_precise_hermes: <- HotwordToggleOn(siteId='ulno-desktop', reason='playAudio')
[DEBUG:2020-04-08 15:14:03,820] rhasspywake_precise_hermes: Enabled
[DEBUG:2020-04-08 15:14:03,822] rhasspywake_precise_hermes: <- HotwordToggleOff(siteId='ulno-desktop', reason='dialogueSession')
[DEBUG:2020-04-08 15:14:03,823] rhasspywake_precise_hermes: Disabled
[DEBUG:2020-04-08 15:14:03,823] rhasspymicrophone_pyaudio_hermes: <- AsrStartListening(siteId='ulno-desktop', sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6', stopOnSilence=True, sendAudioCaptured=True, wakewordId='athena')
[DEBUG:2020-04-08 15:14:03,824] rhasspymicrophone_pyaudio_hermes: Disable UDP output
[DEBUG:2020-04-08 15:14:33,856] rhasspymicrophone_pyaudio_hermes: <- AsrStopListening(siteId='ulno-desktop', sessionId='ulno-desktop-athena-d7d1e093-4ea7-4c74-99dd-1ec79c6ee8b6')
[DEBUG:2020-04-08 15:14:33,857] rhasspymicrophone_pyaudio_hermes: Enable UDP output

ulno · April 8, 2020, 8:01pm

Small update: using RemoteHttp works for stt and IntentRecognition (but of course there is no remote http for the wakeword)

Zoso · April 12, 2020, 9:52pm

Not sure if it is related, but using a non-Rhasspy based satellite is tricky compared to the previous version. Using a Matrix Voice ESP32 with no local wakeword is no longer possible (unless I missed something when setting up). Audio is streaming properly - if I set the master siteID the same as my satellite and wake the system manually from the webUI it will capture my spoken command and send the event to HASS as expected.

ulno · April 13, 2020, 3:20pm

It definitely seems related. @synesthesiam are there any plans to enable a remote wakeword in 2.5 or is there anything that can be tested to help with that?

synesthesiam · April 14, 2020, 2:51pm

Yes, I’ve spent some time this morning looking into it. For now, doing a remote wake word is going to rely on having a shared MQTT broker between satellite and host. I have this working over UDP too so the satellite doesn’t flood the broker.

What won’t work yet is having multiple satellites streaming audio data into a master wakeword service. This requires re-factoring the wakeword services to support an independent audio stream and detector per site id.

KiboOst · April 14, 2020, 3:04pm

Anyway, I wouldn’t have even one satellite streaming continually audio on the network

ulno · April 14, 2020, 6:05pm

I would. Especially if it’s a dedicated peer to peer encrypted network made of low cost devices.

Zoso · April 15, 2020, 3:10pm

Thanks synesthesiam! This would open up the use of multiple satellites of low cost/power devices as ulno mentions. Myself in particular and using a matrix voice ESP32. I know it now has basic wakeword abilities on device but it is very limited at this time and espressif wants to charge for custom wakewords outside the 1 or 2 they support (one of which is she who cannot be named!).

Of at the end of the day, a pi zero and respeaker is also inexpensive and then allows the use of rhasspy on both ends.

ulno · April 15, 2020, 4:00pm

@Zoso do you have any experience using the esp with just a normal i2s microphone (they go for around 2.5 USD at aliexpress)?

Zoso · April 15, 2020, 9:29pm

I do not. It is next on my list since I have several esp32 based random sensors around the house. Might as well get some more functionality out of them!

speaker94 · May 23, 2020, 7:56pm

Hello there!

I think i have opened a thread that ends up with an similar question or problem.
In the 2.5-pre you can specify multiple siteIDs for multiple satellites but if i stream on more than 1 siteID is no operational wake-word-detection at the server-side: