Support offline mobile

[boxabirds]

This repository is really great! Decent samples too.

I see a huge opportunity for this to be extended to support mobile.

There are a number of obstacles to this of course, including running on TF-Lite.

If you ported it to Dart you could transpile it to iOS and Android.

[erogol]

Thx ! We also plan to expand 🐸 TTS's use in offline and low-compute devices.

Currently, some models we release are already real-time using simply the torch back-end.

Targeting the mobile, we can make use of Torch Script, ONNX or TF-Lite export. So one step at a time we plan to get there.

Actually you can already run the vanilla Tacotron on TF-Lite. A bit of documentation is here https://github.com/coqui-ai/TTS/wiki/Converting-Torch-Tacotron-to-TF-2.0

[whitmer]

Is this the correct link? https://github.com/mozilla/TTS/wiki/Converting-Torch-to-TF-2.0

[Dmole]

There are currently 3 FOSS TTSEs for Mobile https://search.f-droid.org/?q=tts+engine&lang=en
A coqui-ai.apk could improve that short list.

[alfureu]

Any update on this? Just discovered this project and I am amazed this does not exist yet on Android...

[erogol]

No plans so far to support offline mobile.

[alfureu]

😢

[RedAuburn]

I'm curious, why do so many TTS projects not bundle for Android? It seems strange, especially when TTS is most used on mobile devices

[Dmole]

Note that currently Coqui is less reliable, and orders of magnitude slower than Android TTS options.
Coqui would require a lot of work to use a reasonable amount of CPU/battery, and that's not currently the project focus.

[whitmer]

Just a bump for mobile support. I run an open source project that provides speech output tools for people with disabilities, and in the last year there have been multiple Android devices that are losing their native TTS options. We have many international users, and right now I have to pay a healthy chunk for a proprietary offline TTS provider in order to ensure support for everyone. I'd love to start routing some of that investment to something more open that can benefit more people. Open source offline as flexible and modern as Coqui would have a huge impact on the disability community.

[csukuangfj]

Please see
#3194

You can use sherpa-onnx to run VITS models from Coqui on Android and also embedded devices, e.g., raspberry pi.

We have pre-built Android APKs for the VITS English models from Coqui.
https://k2-fsa.github.io/sherpa/onnx/tts/apk.html

[tentator]

WOWOWOWOW! Thanks a lot, those voices literally R O C K ! ! !
Bye bye IVONA and the like..

[a-pav]

I'm trying to understand how this project works, specially whether it's entirely offline or not. Well, which one is it? Do my text go through a online server before they're speaking?

[csukuangfj]

Please have a look at https://k2-fsa.github.io/sherpa/onnx/tts/apk-engine.html

It is completely offline.

No data is sent out. Everything is processed locally.

No need to connect to a remote server.

Also, you don't need to be concerned about privacy issues.