In case people missed the announcement at the State of the Open Home 2022 conference today, I will be joining Nabu Casa at the end of November to work on Rhasspy full time
Paulus, the founder of Home Assistant, has declared that 2023 will be the âYear of Voiceâ. We will be meeting in a few weeks to create a roadmap for exactly what that means, but at the core will be a great âout of the boxâ experience for Home Assistant (HA) users [1]. This will include auto discovery of Rhasspy base stations and satellites by HA (through the Rhasspy integration), and auto discovery of HA devices/entities by Rhasspy (so you can say âturn off the living room lightâ with no configuration).
[1] I plan to make this framework general, so other home automation frameworks can also benefit.
For all of us in the Rhasspy community, this will finally mean I have time for updates to Rhasspy. In the short term, my plans are to add Whisper and Coqui STT for speech to text, Mimic 3 and Coqui TTS for text to speech, and upgrade many of the existing services (like Porcupine).
Longer term, I would like to do many different things like:
- Work with folks like @rolyan_trauts to create a DIY satellite mic with quality audio input (looking at the ESP32-S3 and some I2S mics ATM)
- Extend language support with more African, Asian, and European languages. Really anything non-English The most important part of this is getting the training tools released so community members can start training models.
- Add wildcards and recursive rules to sentence templates. This would let you have templates like âadd * to my shopping listâ and make it possible to have commands like âdo X and Y and Z andâŠâ
- Re-architect Rhasspy to ensure that all of the services (wake word, STT, TTS) can be easily reused by other open source projects. This is still a bit fuzzy in my head, but I would like to use something like Guix to build and package each service so everything is still usable outside of Rhasspy.
Let me know your thoughts and questions below, and thank you for your patience over the last year!