Hello! Earlier this week Mistral released:
https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-26...
Last time I ported a TTS model to Rust using candle, this time I ported an ASR model to Rust with burn.
I was able to lean on the wgpu backend to get the model running in the browser after sharding it.
Here is the HF Space:
https://huggingface.co/spaces/TrevorJS/voxtral-mini-realtime
and here are the model weights (q4 + tokenizer):
https://huggingface.co/TrevorJS/voxtral-mini-realtime-gguf
and the code:
https://github.com/TrevorS/voxtral-mini-realtime-rs
Didn't have a chance to use agent teams with this project, maybe next one! :)
0