Post
3193
🚀 Just released a PoC: Kurtis-E1 MLX Voice Agent
An offline, privacy-first voice assistant built for macOS (Apple Silicon), designed for empathetic, short-form interactions.
🧠 Powered by:
- Whisper (via MLX) for speech-to-text: https://pypi.org/project/mlx-whisper/
- Kurtis-E1 (a custom SmolLM2 LLM) via Ollama
- Coqui-TTS XTTSv2 for multilingual TTS
- Optional translation layer via TowerInstruct-13B-v0.1 for non-English voice input/output: Unbabel/TowerInstruct-13B-v0.1
🎧 Everything runs entirely on-device (Mac Mini M4 Max - 24gb) — no cloud, no remote API calls, no data leakage.
💡 Code is fully handcrafted (no AI-generated code), and designed to showcase what’s possible with local models, even on laptops.
🛠️ Open to contributions, ideas (e.g., LM Studio for MLX inference, MLX worker subprocess, optimize for latency and VRAM usage).
👉 Video demo (Italian): https://www.youtube.com/watch?v=8-1PcmUStaI
PoC: https://github.com/ethicalabs-ai/Kurtis-E1-MLX-Voice-Agent
Kurtis-E1: ethicalabs/kurtis-e1-67a9148e0836885c44c7902c
Kurtis-E1 WebGPU: ethicalabs/Kurtis-E1-WebGPU
An offline, privacy-first voice assistant built for macOS (Apple Silicon), designed for empathetic, short-form interactions.
🧠 Powered by:
- Whisper (via MLX) for speech-to-text: https://pypi.org/project/mlx-whisper/
- Kurtis-E1 (a custom SmolLM2 LLM) via Ollama
- Coqui-TTS XTTSv2 for multilingual TTS
- Optional translation layer via TowerInstruct-13B-v0.1 for non-English voice input/output: Unbabel/TowerInstruct-13B-v0.1
🎧 Everything runs entirely on-device (Mac Mini M4 Max - 24gb) — no cloud, no remote API calls, no data leakage.
💡 Code is fully handcrafted (no AI-generated code), and designed to showcase what’s possible with local models, even on laptops.
🛠️ Open to contributions, ideas (e.g., LM Studio for MLX inference, MLX worker subprocess, optimize for latency and VRAM usage).
👉 Video demo (Italian): https://www.youtube.com/watch?v=8-1PcmUStaI
PoC: https://github.com/ethicalabs-ai/Kurtis-E1-MLX-Voice-Agent
Kurtis-E1: ethicalabs/kurtis-e1-67a9148e0836885c44c7902c
Kurtis-E1 WebGPU: ethicalabs/Kurtis-E1-WebGPU