Don't understand how to be heard by Rhasspy

fastjack · August 31, 2020, 3:38pm

On the host for starter then in the container…

GraphiPerso · August 31, 2020, 3:40pm

just try in for now :

pi@raspberrypi:~ $ arecord -Dcapture -r 16000 -c 1 -f S16_LE -v test.wav
Capture WAVE ‘test.wav’ : Signed 16 bit Little Endian, Fréquence 16000 Hz, Mono
Plug PCM: Rate conversion PCM (48000, sformat=S16_LE)
Converter: libspeex (builtin)
Protocol version: 10002
Its setup is:
stream : CAPTURE
access : RW_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 16000
exact rate : 16000 (16000/1)
msbits : 16
buffer_size : 8000
period_size : 2000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 2000
period_event : 0
start_threshold : 1
stop_threshold : 8000
silence_threshold: 0
silence_size : 0
boundary : 524288000
Slave: Hardware PCM card 2 ‘USB PnP Audio Device’ device 0 subdevice 0
Its setup is:
stream : CAPTURE
access : MMAP_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 48000
exact rate : 48000 (48000/1)
msbits : 16
buffer_size : 24003
period_size : 6000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 6000
period_event : 0
start_threshold : 3
stop_threshold : 24003
silence_threshold: 0
silence_size : 0
boundary : 1573060608
appl_ptr : 0
hw_ptr : 0
^CInterrompu par le signal Interrompre…
arecord: pcm_read:2145: erreur en lecture: Appel système interrompu
pi@raspberrypi:~ $ aplay -Dplayback -v test.wav
aplay: main:828: erreur à l’ouverture audio: Aucun fichier ou dossier de ce type

fastjack · August 31, 2020, 3:42pm

What about just aplay -v test.wav ?

GraphiPerso · August 31, 2020, 4:18pm

I just eard something like a fart from the speaker…

pi@raspberrypi:~ $ arecord -Dcapture -r 16000 -c 1 -f S16_LE -v test.wav
Capture WAVE ‘test.wav’ : Signed 16 bit Little Endian, Fréquence 16000 Hz, Mono
Plug PCM: Rate conversion PCM (48000, sformat=S16_LE)
Converter: libspeex (builtin)
Protocol version: 10002
Its setup is:
stream : CAPTURE
access : RW_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 16000
exact rate : 16000 (16000/1)
msbits : 16
buffer_size : 8000
period_size : 2000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 2000
period_event : 0
start_threshold : 1
stop_threshold : 8000
silence_threshold: 0
silence_size : 0
boundary : 524288000
Slave: Hardware PCM card 2 ‘USB PnP Audio Device’ device 0 subdevice 0
Its setup is:
stream : CAPTURE
access : MMAP_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 48000
exact rate : 48000 (48000/1)
msbits : 16
buffer_size : 24003
period_size : 6000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 6000
period_event : 0
start_threshold : 3
stop_threshold : 24003
silence_threshold: 0
silence_size : 0
boundary : 1573060608
appl_ptr : 0
hw_ptr : 0
^CInterrompu par le signal Interrompre…
arecord: pcm_read:2145: erreur en lecture: Appel système interrompu
pi@raspberrypi:~ $ aplay -v test.wav
Lecture WAVE ‘test.wav’ : Signed 16 bit Little Endian, Fréquence 16000 Hz, Mono
Plug PCM: Rate conversion PCM (48000, sformat=S16_LE)
Converter: libspeex (builtin)
Protocol version: 10002
Its setup is:
stream : PLAYBACK
access : RW_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 16000
exact rate : 16000 (16000/1)
msbits : 16
buffer_size : 8000
period_size : 2000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 2000
period_event : 0
start_threshold : 8000
stop_threshold : 8000
silence_threshold: 0
silence_size : 0
boundary : 524288000
Slave: Route conversion PCM (sformat=S16_LE)
Transformation table:
0 <- 0
1 <- 0
Its setup is:
stream : PLAYBACK
access : MMAP_INTERLEAVED
format : S16_LE
subformat : STD
channels : 1
rate : 48000
exact rate : 48000 (48000/1)
msbits : 16
buffer_size : 24003
period_size : 6000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 6000
period_event : 0
start_threshold : 24000
stop_threshold : 24003
silence_threshold: 0
silence_size : 0
boundary : 1573060608
Slave: Hardware PCM card 3 ‘USB2.0 Device’ device 0 subdevice 0
Its setup is:
stream : PLAYBACK
access : MMAP_INTERLEAVED
format : S16_LE
subformat : STD
channels : 2
rate : 48000
exact rate : 48000 (48000/1)
msbits : 16
buffer_size : 24003
period_size : 6000
period_time : 125000
tstamp_mode : NONE
tstamp_type : MONOTONIC
period_step : 1
avail_min : 6000
period_event : 0
start_threshold : 24000
stop_threshold : 24003
silence_threshold: 0
silence_size : 0
boundary : 1573060608
appl_ptr : 0
hw_ptr : 0
aplay: pcm_write:2053: erreur en écriture: Erreur d’entrée/sortie

fastjack · August 31, 2020, 4:22pm

This looks good. You should be able to configure RHasspy to listen with arecord on the “capture” device and playback on the default device now…

Andrew49 · August 31, 2020, 5:37pm

Hi @GraphiPerso, I’m glad to see that you are now on the way to solving this.
@fastjack and @koan, many thanks for stepping in to help! I’ve leaned a lot from this thread myself.

GraphiPerso · September 1, 2020, 5:50am

arecord on capture but… no capture… on the previous log, there is a “writing error : error in/out” (don’t know if my translate is accurate…)

here is the log from web interface rhasspy :

[ERROR:2020-09-01 07:47:43,686] rhasspyserver_hermes:
Traceback (most recent call last):
File “/usr/lib/rhasspy/.venv/lib/python3.7/site-packages/quart/app.py”, line 1821, in full_dispatch_request
result = await self.dispatch_request(request_context)
File “/usr/lib/rhasspy/.venv/lib/python3.7/site-packages/quart/app.py”, line 1869, in dispatch_request
return await handler(**request_.view_args)
File “/usr/lib/rhasspy/rhasspy-server-hermes/rhasspyserver_hermes/main.py”, line 827, in api_listen_for_command
handle_captured(), messages, message_types
File “/usr/lib/rhasspy/rhasspy-server-hermes/rhasspyserver_hermes/init.py”, line 959, in publish_wait
result_awaitable, timeout=timeout_seconds
File “/usr/lib/python3.7/asyncio/tasks.py”, line 449, in wait_for
raise futures.TimeoutError()
concurrent.futures._base.TimeoutError
[DEBUG:2020-09-01 07:47:13,666] rhasspyserver_hermes: Publishing 180 bytes(s) to hermes/asr/startListening
[DEBUG:2020-09-01 07:47:13,666] rhasspyserver_hermes: -> AsrStartListening(site_id=‘default’, session_id=‘f9047008-105d-4577-b685-6f22b30b744c’, lang=None, stop_on_silence=True, send_audio_captured=True, wakeword_id=None, intent_filter=None)
[DEBUG:2020-09-01 07:47:13,664] rhasspyserver_hermes: Subscribed to hermes/error/asr
[DEBUG:2020-09-01 07:47:13,663] rhasspyserver_hermes: Waiting for transcription (session_id=f9047008-105d-4577-b685-6f22b30b744c)
[DEBUG:2020-09-01 07:47:12,327] rhasspyprofile.download: intent.system flair fsticuffs = False
[DEBUG:2020-09-01 07:47:12,326] rhasspyprofile.download: speech_to_text.kaldi.open_transcription True False = False
[DEBUG:2020-09-01 07:47:12,326] rhasspyprofile.download: speech_to_text.kaldi.mix_weight >0 0 = False
[DEBUG:2020-09-01 07:47:12,325] rhasspyprofile.download: speech_to_text.pocketsphinx.mix_weight >0 0 = False
[DEBUG:2020-09-01 07:47:12,325] rhasspyprofile.download: speech_to_text.pocketsphinx.open_transcription True False = False
[DEBUG:2020-09-01 07:47:12,324] rhasspyprofile.download: speech_to_text.system kaldi pocketsphinx = False
[DEBUG:2020-09-01 07:47:12,324] rhasspyprofile.download: Skipping acoustic_model/variances (/profiles/fr/acoustic_model/variances)
[DEBUG:2020-09-01 07:47:12,324] rhasspyprofile.download: Skipping acoustic_model/transition_matrices (/profiles/fr/acoustic_model/transition_matrices)
[DEBUG:2020-09-01 07:47:12,323] rhasspyprofile.download: Skipping acoustic_model/noisedict (/profiles/fr/acoustic_model/noisedict)
[DEBUG:2020-09-01 07:47:12,323] rhasspyprofile.download: Skipping acoustic_model/mixture_weights (/profiles/fr/acoustic_model/mixture_weights)
[DEBUG:2020-09-01 07:47:12,322] rhasspyprofile.download: Skipping acoustic_model/means (/profiles/fr/acoustic_model/means)
[DEBUG:2020-09-01 07:47:12,322] rhasspyprofile.download: Skipping acoustic_model/mdef (/profiles/fr/acoustic_model/mdef)
[DEBUG:2020-09-01 07:47:12,321] rhasspyprofile.download: Skipping acoustic_model/feature_transform (/profiles/fr/acoustic_model/feature_transform)
[DEBUG:2020-09-01 07:47:12,321] rhasspyprofile.download: Skipping acoustic_model/feat.params (/profiles/fr/acoustic_model/feat.params)
[DEBUG:2020-09-01 07:47:12,320] rhasspyprofile.download: Skipping g2p.fst (/profiles/fr/g2p.fst)
[DEBUG:2020-09-01 07:47:12,319] rhasspyprofile.download: Skipping base_dictionary.txt (/profiles/fr/base_dictionary.txt)
[DEBUG:2020-09-01 07:47:12,319] rhasspyprofile.download: speech_to_text.system pocketsphinx pocketsphinx = True

GraphiPerso · September 2, 2020, 1:25pm

is there somebody? maybe I have kill everybody with my problem

GraphiPerso · September 6, 2020, 7:37am

help please please!

GraphiPerso · September 27, 2020, 12:19pm

Somebody is there? I didn’t solve this problem :s

Andrew49 · September 27, 2020, 8:08pm

Hello,
Sorry you still have a problem with this.
It’s difficult (for me, at least) to diagnose what is going wrong. I get the feeling that on your device there are settings or other software somewhere preventing the sound on Rhasspy from working correctly. It might be your Domiticz installation, about which I have no knowledge, or something else running on the same device. My advice in your situation is to make a clean install of Rhasspy on a separate device if you have one (e.g. Rhasspy Pi - see the installation section in the docs). Even if you need to buy this specially, it would be worth it to get started. You can always come back onto the device you are trying to use later, when you have more experience of how Rhasspy works, and the device you buy will make a good satellite.
Hope this helps, and good luck!

GraphiPerso · September 28, 2020, 5:37am

I don’t know for domoticz… as I know, it doesn’t use any sound. It just manage domotic things… but I can’t be sure if it’s not the problem…
I need to move to hassio for kicking domoticz, but I don’t understand how to install my two esp8266 with dzvent scripts… I try the forum but there is no answer
Without that I can’t reinstall all for rhasspy…

kookic · October 1, 2020, 6:55pm

ce n’est pas une réponse, mais un petit conseil
installer portainer pour gérer facilement vos docker
et installer webmin pour gérer tout ou presque votre pc linux
pour le son voir si dsnoop dans alsa peut aider (partage mic avec plusieurs applications)

GraphiPerso · October 3, 2020, 7:12am

Merci pour les conseils!
Pour portainer je vais voir ça, par contre pour webmin, j’ai pas un pc linux mais un raspberry pi sous debian, ça change quelque chose?
Qu’est ce que c’est dsnoop?

kookic · October 3, 2020, 3:48pm

Dsnoop permet de partager une entrée son (micro) avec d’autre application
Mon fichier asound.conf:

    pcm.micPoppy{
        type dsnoop
        slave {

        pcm "hw:1,0" 
        channels 1
    }
    ipc_key 1025
}
pcm.hpPoppy{
    type hw
    card 1
    device 0
}
pcm.!default {
        type asym
        playback.pcm {
                type plug
                slave.pcm "hw:1,0"   
     }
        capture.pcm {
                type plug
                slave.pcm "micPoppy"
        }
}

micPoppy peut être utilisé par rhasspy et une autre app en même temps, sinon si une app utilise le micro, rhasspy n’en a plus!
J’utilise pulseaudio avec alsa, car l’api dezzer a besoin de pulseaudio.
Dans rhasspy je sélectionne “pulse” dans la liste audio = Use arecord directly (ALSA)
Pour webmin bien pratique ça doit le faire
https://foxty.io/installer-webmin-raspberry-pi/

GraphiPerso · October 4, 2020, 7:27am

Mais du coup (j’avoue que tu m’as un peu perdu ) je dois changer à la fois le asound.conf et aussi le truc dans l’interface web de rhasspy? dsnoop c’est un truc à installer ou c’est de base dessus?

kookic · October 4, 2020, 9:05am

Non pas d’install, c’est plus un paramètre de Alsa . Lit la doc alsa (bon courage)

GraphiPerso · October 5, 2020, 7:01am

Don't understand how to be heard by Rhasspy

D’accord, merci ^^