AI Data Storage Engine
Milvus + RustFS+ Vibe Coding: Build a Lightweight RAG Chatbot from Scratch

Milvus + RustFS+ Vibe Coding: Build a Lightweight RAG Chatbot from Scratch

3/10/2026 · Jinghe Ma

What this post added

This post details the end-to-end construction of a lightweight RAG chatbot using Milvus and RustFS. It covers the installation of Milvus and RustFS via Docker Compose, including configuration adjustments for object storage. The process of chunking Markdown documentation, generating embeddings with OpenAI's text-embedding-3-large model, and storing these embeddings in a Milvus collection is explained. Finally, it outlines the RAG pipeline, demonstrating how to embed user queries, retrieve relevant document chunks from Milvus using cosine similarity search, construct a prompt, and call an LLM (GPT-5) for an answer. The post provides code snippets for each stage and emphasizes the flexibility of the retrieval layer.

Read the original post ↗