We plan to make a Home Assistant Willow component to use any of their supported TTS modules to play speech output on device. We just didn't get to it yet.
Our inference server (open source, releasing next week) has highly optimized Whisper, LLaMA/Vicuna/etc, text to speech, etc implementations as well.
It's actually not that hard on the device - if the response from the HA component has audio, play it.
Our inference server (open source, releasing next week) has highly optimized Whisper, LLaMA/Vicuna/etc, text to speech, etc implementations as well.
It's actually not that hard on the device - if the response from the HA component has audio, play it.
We just don't have the HA component yet :).