An offline, privacy-first voice assistant built for macOS (Apple Silicon), designed for empathetic, short-form interactions.
🧠 Powered by: - Whisper (via MLX) for speech-to-text: https://pypi.org/project/mlx-whisper/ - Kurtis-E1 (a custom SmolLM2 LLM) via Ollama - Coqui-TTS XTTSv2 for multilingual TTS - Optional translation layer via TowerInstruct-13B-v0.1 for non-English voice input/output: Unbabel/TowerInstruct-13B-v0.1
🎧 Everything runs entirely on-device (Mac Mini M4 Max - 24gb) — no cloud, no remote API calls, no data leakage. 💡 Code is fully handcrafted (no AI-generated code), and designed to showcase what’s possible with local models, even on laptops. 🛠️ Open to contributions, ideas (e.g., LM Studio for MLX inference, MLX worker subprocess, optimize for latency and VRAM usage).