echokit_server

We built a voice AI agent in Rust. EchoKit server is an open-source framework that connects speech input, LLM reasoning, and speech output — so you can build local or hybrid voice assistants with real-time interaction. It's super easy to set up. Current features: 1. Supports both traditional ASR → LLM → TTS pipelines and end-to-end models like Gemini Live. 2. Voice Activity Detection (VAD) for low-latency, streaming voice input. 3. MCP support for external tools. 4. Works with both ESP32 hardware and web clients. 5. Streaming TTS output for GPT-Sovits Would love to hear what kind of projects people would build with this or any feedback.

Have you wanted a voice AI agent that you could fully control, customize, and understand from the ground up—not just a black box. EchoKit is a DIY, open-source voice agent running on an ESP32-S3. The fun part is the server backend, which I wrote entirely in Rust to handle the AI pipeline (ASR, LLM, TTS). The stack is: Hardware: EchoKit board (ESP32-S3) Firmware: ESP-IDF Server: Rust (Actix Web/Tungstenite) AI: Customizable pipeline. The tutorial uses Groq for the Whisper, Llama 3, and TTS models, which makes the response time incredibly fast (usually just a few seconds for the full ASR->LLM->TTS roundtrip). It's designed to be easy for makers, students, or anyone curious about AI to build in just a few minutes. You can modify the system prompts, swap out models, or even add custom actions (Step 6 in the guide). The tutorial (linked) walks