Reachy Mini goes fully local
May 27, 2026
Summary
This post details the implementation of a fully local speech-to-speech pipeline for Reachy Mini, integrating various components for VAD, STT, LLM inference, and TTS. It provides specific instructions and configurations for running llama.cpp with Gemma 4 locally, setting up the `speech-to-speech` library, and connecting it to the Reachy Mini. It also discusses alternative LLM backends like vLLM and Hugging Face Inference Endpoints, highlighting trade-offs in latency, privacy, and cost.
More from the Distributed Training Abstraction trail
- Training a coding model to paint watercolours with TRL and OpenEnv
- How 🤗 Accelerate runs very large models thanks to PyTorch
- Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL
- From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease
- How to train a Language Model with Megatron-LM