Rhasspy 2.5.8 Released

[synesthesiam]

Hi @nordeep, glad Larynx is working for someone

@nordeep

Does Larynx could speech numbers?!

Yes, it looks like I just made a mistake with a config file for Russian. I’ve fixed it on my end, and it will be in the next update.

@nordeep

Can we hope for a female voice of Russian Larynx?

I should be able to do that. I have some female Russian audio from the same dataset as the male audio.

@nordeep

PS: Seems Porcupine updates to V1.9 - added some new words to RPi platform.

Thanks! I’ll try and get this updated soon. Here’s the Github issue: https://github.com/rhasspy/rhasspy/issues/139

[nordeep]

@synesthesiam Thank you!
Will wait for updates. Not so convenient without ability to speech numbers

@synesthesiam If it’s not difficult, could you give some recommendations - how to organize conversation between User <-> Rhasspy <-> HA?
Just simple example:

User - “Rhasspy, turn off the lights everywhere.”
Rhasspy - “Ok, but this intent requires confirmation”
User - “Rhasspy, turn off the lights everywhere.”
Rhasspy - “Turning off lights everywhere.”
HA - light.turn_off group.all_lights

At the moment I can imagine complex configuration with HA actions like, rest_commands, turn_on/off some input_boolean and so on. And I’m not completely sure if this will work.

[Platup]

@synesthesiam

If you delete the file name in the web UI, it should stop playing that WAV file. There should be shorter delay too, since there’s no worry of the mic picking up the beeps as speech.

--------- Edit -----------
Scratch everything I said below.
I was trying to apply the settings on the Satellite, but it appears to work as stated when the volume is set or the wav is removed on the base.
The wav files and sound volume don’t apply on the individual satellite, although I had made the assumption it would since I am using a local wake word.

------ End Edit ----------

Just got a chance to try this and it’s still playing. I removed the wake and recorded lines from the web UI, saved and restarted. I also tried power cycling it and verified in the config…

"sounds": {
"aplay": {
    "device": "default:CARD=seeed2micvoicec"
},
"recorded": "",
"system": "aplay",
"wake": ""
},

I left the error wave populated, but I don’t see it anywhere in the config.
I also noticed the overall volume including the wake sounds seems to be controlled by the volume under the audio playing section. The volume under “Sound” doesn’t seem to affect anything.

I’m making these settings on the Satellite, and the satellite is running a local wakeword / UDP.

[synesthesiam]

@nordeep

If it’s not difficult, could you give some recommendations - how to organize conversation between User <-> Rhasspy <-> HA?

You could do this will a Python skill or a somewhat simple NodeRED automation. Using NodeRED as an example, I’d create an intent in Rhasspy like this (oversimplified of course):

[MaybeTurnOffLights]
turn off the lights everywhere

Don’t listen for this intent in HA. Instead, just have NodeRED listen for it.

1. The first time NodeRED gets MaybeTurnOffLights, it sends a message to Rhasspy for TTS (maybe using /api/text-to-speech) with “Ok, but this intent requires confirmation” and then sets a variable indicating it’s ready for confirmation.
2. When the users triggers the same MaybeTurnOffLights intent, NodeRED now either sends a message directly to HA or delivers a different intent to Rhasspy (maybe using /api/handle-intent) which HA should be listening for.

Bonus points if you add a timeout to the NodeRED flow so the confirmation variable gets reset if the user doesn’t confirm within a few minutes or something

[nordeep]

@synesthesiam Thank you for recommendations! Thinking the same way, but using pure HA
Going deep at learning how Rhasspy interacts with HA, and have a few questions:

1. Does MQTT has the similar to /api/listen-for-command? I know about hermes/hotword/<WAKEWORD_ID>/detected but wakeword call wake WAV Sound, /api/listen-for-command doesn’t.
2. Is there a way to forcefully specify intent in API call? In case if I have some logic at intent handle side and want to add slots(items) to intent handle by short phrases(listing).

[synesthesiam]

No problem, hope I can help.

1. You’re looking for hermes/asr/startListening
2. When calling /api/listen-for-command you can add ?entity=<entity>&value=<value> to the URL to include a custom entity with a value that will be passed through to the intent.

[nordeep]

@synesthesiam

1. Trying to use hermes/asr/startListening but can’t understand - do I need to send hermes/asr/stopListening and do I need to control - sessionId? /api/listen-for-command - looks more simple
2. Can I set, as example - ?intent=VacuumControl ?!

I’m looking the way to realize next logic at Rhasspy <-> HA:
– Rhasspy, Start Vacuum cleaner (we are have intent but we need to specify it)
– (HA answer) - Please, specify the place of cleaning
– Rhasspy, (we do not need to say intent again, we just list places) kitchen, hall, etc

As I can imagine this - I could send api call /api/listen-for-command?intent=VacuumControl and Rhasspy, knowing about intent, waiting for only <place1> [and] [<place2>] [and] [<place3>] etc.

[nordeep]

Continue to adjust Rhasspy for my tasks. For me doesn’t work Volume control WAV Sounds. Audio Playing Volume control works as expected. I’m using alsa. Am I doing something wrong?

I see /api/set-volume but how I can get current volume level?

[synesthesiam]

@nordeep

I see /api/set-volume but how I can get current volume level?

I don’t have a message or API for this yet, and it can be more complex if it involves satellites. Unless you set it otherwise, all the volumes should start out at 1.0.

@nordeep

Am I doing something wrong?

The volume should be between 0 and 1, so try something like 0.5.

[nordeep]

A part of my profile below. Does WAV Sounds volume work only if Dialougue manager enabled on satellite?
0.05 - Sound volume
0.15 - Audio playing volume

{
    "dialogue": {
        "satellite_site_ids": "default,sat1",
        "volume": "0.05"
    },
    "sounds": {
        "aplay": {
            "device": "sysdefault:CARD=Headphones",
            "volume": "0.15"
        }
    }
}

[FredTheFrog]

Late to the party here. What can I say, real life has been quite demanding. Gave my Rhasspy nodes an update from 2.5.5 this morning. Piece of cake, took only a few minutes to download, extract, and setup. Thank you, @synesthesiam !!

Merry Christmas and Happy Holidays to everyone in the Rhasspy community!!

[farfade]

Hello @synesthesiam,

I’m trying to upgrade to 2.5.8 as I see the deb packages are fixed (thanks for maintaning it, and as true packages and not as an AppImage).

I’m facing an odd dependency requirement on libgfortran3 : it is not available in debian buster which have been the stable distro for a while now. The previous versions of rhasspy were depending on libgfortran4 I think, which is available on debian buster.

Is it possible to fix that dependency ?

Edit : hum, if I instruct dpkg to ignore dependency to libgfortran3 (and by the way to llvm-7-runtime that appeared with 2.5.8 too), it works. I would encourage to minimize the required dependencies (by modularizing at least) to control the “monolithication” of rhasspy. It is something that does not provide new features but is essential to keep a project maintainable

Cheers

[farfade]

@synesthesiam

• Group separator for co-located satellites (dialogue.group_separator)

I may be interested in that feature (if needed to deal with two satellites hearing the same command), but I’m not able to find doc about it , could you kindly provide instructions for using it ?

[Enc3ph4l0n]

Simply rename the satellites (siteIds) you wish to group with a prefix. Rhasspy will silently ignore other satellites in a group if a satellite is already active from that group. For example, your satellites could be named like so:

downstairs.kitchen
downstairs.living-room
upstairs.front-bedroom
back-bedroom

If you wake the kitchen satellite, then Rhasspy will ignore the living room whilst the kitchen session is active. The front bedroom will activate as normal. The back bedroom is not in a group, as it has no prefix. However, depending on proximity of the devices there’s always a chance your desired satellite is not the one that is activated, but it will then block your desired satellite from activating until the session is finished.

Don’t forget to amend the satellite siteIds on the master device!

[Lionel_Richer]

@synesthesiam

group_separator

Hello,
My Rhasspy don’t detect the group.
The group is rdc.
The satellite1 is rdc.bureau and the satellite2 is rdc.salon
Here my log, with 2 sessions (in the same second) et my configuration :

[DEBUG:2020-12-31 17:23:14,398] rhasspydialogue_hermes: -> DialogueSessionStarted(session_id=‘rdc.salon-snowboy-2bd12d65-7d33-4cf6-a771-e2037d9a4fd6’, site_id=‘rdc.salon’, custom_data=‘snowboy’, lang=None)
[DEBUG:2020-12-31 17:23:14,547] rhasspydialogue_hermes: -> DialogueSessionStarted(session_id=‘rdc.bureau-snowboy-cd4563a6-3840-43b7-9c7c-5c34a4c1c067’, site_id=‘rdc.bureau’, custom_data=‘snowboy’, lang=None)

"dialogue": {
    "group_separator": "rdc.",
    "satellite_site_ids": "rdc.bureau,rdc.salon",
    "system": "rhasspy"
}

Could you explain my error ?
Thanks

[chbarrer]

Hi!!.. Have a great 2021!

have problems enabling spanish support. English is perfect , but in Spanish timeout errors and NewDecoder returned -1 are killing me!.

SOme ideas’?.. may be fixed in next release?

Thanks!

[chbarrer]

Hi [synesthesiam]

Thanks for this great release!..

I´m trying to get working in Spanish using Pocketsphinx but looks like all files are not downloading to install , and even using kaldi also does not download. Plus other problems related apparently with ASR that caused timeout problems. Wht do you suggest_… i´ve tried using traditional install through debian package and docker.

Englis works nice, but looking to work in Spanish.

Have a great 2021!

[Enc3ph4l0n]

Your group separator value is incorrect - including the group in the separator value effectively nullifies the group. It should just be a dot, as that is the separator between the group and siteId. Change your config to this:

"dialogue": {
    "group_separator": ".",
    "satellite_site_ids": "rdc.bureau,rdc.salon",
    "system": "rhasspy"
}

[synesthesiam]

Hi, @chbarrer thanks for trying Rhasspy

It turns out there were errors in both the Pocketsphinx and Kaldi Spanish download links. I’m fixing them now, and will push out an update to the Docker image and Debian files soon (I’ll post here to let you know).

[AlmostSerious]

Hi, I just realized that for the german deepspeech the download links seem to be wrong aswell.

I am getting the following error:

DownloadFailedException: (‘https://raw.githubusercontent.com/de_deepspeech-aashishag/9fe9fbd758b2f775650ad0972710256d65be1317/model/alphabet.txt’, ‘File size mismatch (got 14 byte(s), expected 338)’)

Ok now i just copied the files manually from https://github.com/synesthesiam/de_deepspeech-aashishag/releases/tag/v1.0
but then I am getting time_out errors. Similar to what I have with Larynx TTS