
3/10/2026 · Jinghe Ma
What this post added
This post details the end-to-end construction of a lightweight RAG chatbot using Milvus and RustFS. It covers the installation of Milvus and RustFS via Docker Compose, including configuration adjustments for object storage. The process of chunking Markdown documentation, generating embeddings with OpenAI's text-embedding-3-large model, and storing these embeddings in a Milvus collection is explained. Finally, it outlines the RAG pipeline, demonstrating how to embed user queries, retrieve relevant document chunks from Milvus using cosine similarity search, construct a prompt, and call an LLM (GPT-5) for an answer. The post provides code snippets for each stage and emphasizes the flexibility of the retrieval layer.