What If You Could See Why RAG Fails? Debugging RAG in 3D with Project_Golem and Milvus

This post details the integration of Milvus 2.6.8 with Project_Golem to provide a production-ready, scalable solution for visualizing RAG retrieval behavior in 3D. It addresses the limitations of the original Project_Golem (full rebuilds, brute-force search, lack of metadata filtering) by leveraging Milvus for vector storage, indexing, and millisecond-level retrieval. Key contributions include: enabling real-time ingestion via Milvus Streaming Nodes, separating retrieval from visualization for independent scaling, and outlining a future path for incremental visualization updates using UMAP's transform() method and WebSockets. The integration allows for immediate search of newly added documents and sets the stage for hybrid search capabilities within the visualization tool.