Was it difficult to get working on the phone at all?
No. It was as easy as for a Debian or Ubuntu computer.
Was it difficult to get working on the phone at all?
No. It was as easy as for a Debian or Ubuntu computer.
Hi there, got the server up and running (manualy for now).
Settings are saved (wrt. to maryTTS) as follows:
"text_to_speech": {
"marytts": {
"voice": "thorsten_low"
},
"system": "marytts"
},
The other keys mentionned in docu / text-to-speech/#marytts are not explicitely stored in the JSON, but visible in the Rhasspy UI (de_DE, thorsten_low).
Putting that combined in the âVoiceâ field doesnât help changing back leads to the locale also beeing stored in the JSON, but still this results in
TtsException: file does not start with RIFF id
What did I miss or could do better?
Tests with âhttp://external-ip:59125/â work quite good, calling with âopenapiâ postfix results in 404 errorâŚ
@synesthesiam
I like the announcement!
Is there already a date when the mimic3 repository will be online in the Github? I would like to test the Debian packages.
Greetings, Jens
Wow, how could Portuguese (Brazilian) not be on the list?
Iâll have to check this myself. The Mimic 3 server should also work with Rhasspyâs âremote TTSâ option, but I need to double check I havenât broken anything with that either!
Hopefully next month, but I sent you a link with the beta packages
It was, but people told me that the voice I trained wasnât understandable. I used this dataset: https://github.com/Edresson/TTS-Portuguese-Corpus
Do you know of any other TTS Portuguese datasets?
sorry no. Iâm clueless about lang models, data, etc.
Nice!
"text_to_speech": {
"command": {
"say_arguments": " --ssml --voice 'de_DE/m-ailabs_low#rebecca_braunert_plunkett' ",
"say_program": "mimic3"
},
"satellite_site_ids": "default",
"system": "command"
},
Das ist ein Test in deutsch <voice name="en_US/vctk_low#p236">and this is an test in english.</voice>
⌠and Rhasspy speaks two languages in one sentence - cool.
It runs a bit slow on my old machine without GPU. With enough power and cache it will definitely get better.
Greetings, Jens
I didnât, but I donât see any useful data there
Awesome! The way to speed this up is to run mimic-server
as a service (check the source code for a systemd unit example), and then use mimic3 --remote ...
so it will use the web server instead.
Calling it up via the web interface wasnât faster either. Now I have to pimp my base a bit firstâŚ
Btw, I think Mycroft should link to some demoâs in their Mimic 3 blog post announcement.
If people could hear presumably how good the TTS sounds theyâd be more likely to sign up and get involved. My 2 cents.
Will this be a drop in replacement?
Hello,
unfortunately i cannot sent PM as a new user and therefore cant test RTFâs for different architectures. Can someone give hints about RTFs, maybe for ARM?
Thanks
Hi @The1And0, on 64-bit ARM you can get an RTF of around 0.5. 32-bit ARM is slower, around 1.2 or 1.3. If youâre on a 64-bit x86/64 machine though, it can be 10x faster than ARM
Try it out for yourself: https://github.com/mycroftAI/mimic3
Oh, thereâs a Docker image now. (Although apparently without harvard-glow_tts
yet?)
Is it compatible with the âRemote HTTPâ TTS option of Rhasspy?
It is! Just set this as the URL: http://localhost:59125/api/tts
You can change the voice like this: http://localhost:59125/api/tts?voice=en_US/vctk_low#p236
I think Iâm missing something with the docker image.
After running the image I can access the web server but I cannot synthesize voices.
My guess is I have to still manually download the voices. But how do you do it using the docker image?
I tried locating the mimic3-download command in the image but no luck.
ERROR:mimic3_http.synthesis:Error during inference
Traceback (most recent call last):
File â/home/mimic3/app/mimic3_http/synthesis.pyâ, line 125, in do_synthesis_proc
result = do_synthesis(item, mimic3)
File â/home/mimic3/app/mimic3_http/synthesis.pyâ, line 81, in do_synthesis
raise e
File â/home/mimic3/app/mimic3_http/synthesis.pyâ, line 61, in do_synthesis
mimic3.speak_text(params.text, text_language=params.text_language)
File â/home/mimic3/app/mimic3_tts/tts.pyâ, line 368, in speak_text
voice = self._get_or_load_voice(self.voice)
File â/home/mimic3/app/mimic3_tts/tts.pyâ, line 579, in _get_or_load_voice
voice = Mimic3Voice.load_from_directory(
File â/home/mimic3/app/mimic3_tts/voice.pyâ, line 283, in load_from_directory
onnx_model = Mimic3Voice._load_model(
File â/home/mimic3/app/mimic3_tts/voice.pyâ, line 403, in _load_model
onnx_model = onnxruntime.InferenceSession(
File â/home/mimic3/app/.venv/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_inference_collection.pyâ, line 335, in init
self._create_inference_session(providers, provider_options, disabled_optimizers)
File â/home/mimic3/app/.venv/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_inference_collection.pyâ, line 370, in _create_inference_session
sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model)
RuntimeError: /onnxruntime_src/onnxruntime/core/platform/posix/env.cc:183 onnxruntime::{anonymous}::PosixThread::PosixThread(const char*, int, unsigned int ()(int, Eigen::ThreadPoolInterface), Eigen::ThreadPoolInterface*, const onnxruntime::ThreadOptions&) pthread_setaffinity_np failed, error code: 0 error msg:
Connect to the docker image
sudo docker exec âit nginx-test /bin/bash
as if the container name was nginx-test but change name to the container name
Its like ssh as you connect to the docker image and logon as by default your will be root
then do as you would do on a host wget and you may need to install wget as you would do âapt-get installâ
Docker to connect its always sudo docker exec âit <container-name> /bin/bash
Thatâs what I meant by running the mimic3-download command âfrom the imageâ
Shouldâve specified I was running it through docker exec /bin/bash
@tipofthesowrd You may need to run this before running the Docker image:
mkdir -p "${HOME}/.local/share/mycroft/mimic3"
chmod a+rwx "${HOME}/.local/share/mycroft/mimic3"
The Docker image runs as an unprivileged user for security, so it may not have permission to download voices.