Milvus + RustFS+ Vibe Coding: Build a Lightweight RAG Chatbot from Scratch
Mar 10, 2026Jinghe Ma

Summary
This post details the construction of a lightweight RAG chatbot using Milvus and RustFS. It covers the installation of Milvus with an S3-compatible object storage backend (RustFS) via Docker Compose, including configuration adjustments for Milvus. The process of reading, chunking, and embedding Markdown documentation using OpenAI's text-embedding-3-large model is described. Embeddings are then stored in a Milvus collection. Finally, a RAG pipeline is implemented using Milvus for retrieval and OpenAI's GPT-5 for response generation, with a code example for the retrieval and LLM call.
More from the AI Data Storage Engine trail
- Milvus Snapshots: Point-in-Time Collection Views Without Copying Data
- Announcing Milvus 3.0: Lake-Native Vector Search and a More Powerful Retrieval Engine
- How to Recover Milvus Data After etcd Corruption Without a Backup
- Open Tag: An Open-Source Claude Tag for Claude Code and Codex
- How Force Merge Compaction Nearly Doubled Milvus Search QPS