We Built Graph RAG Without the Graph Database
Apr 17, 2026Cheney Zhang

Summary
Introduces 'Vector Graph RAG', a Python library that enables multi-hop reasoning for RAG systems using only Milvus. It details a novel approach to represent graph structures (entities, relations, passages) within Milvus collections using ID references. The post outlines the four-step retrieval flow: seed retrieval, subgraph expansion (one hop by default), LLM reranking of expanded relations, and answer generation. It highlights the performance benefits of avoiding a separate graph database and iterative LLM calls, achieving competitive recall on multi-hop QA benchmarks.
More from the AI Data Storage Engine trail
- Milvus Snapshots: Point-in-Time Collection Views Without Copying Data
- Announcing Milvus 3.0: Lake-Native Vector Search and a More Powerful Retrieval Engine
- How to Recover Milvus Data After etcd Corruption Without a Backup
- Open Tag: An Open-Source Claude Tag for Claude Code and Codex
- How Force Merge Compaction Nearly Doubled Milvus Search QPS