
2/6/2024 · Manuel Meyer
What this post added
This post details how Dust integrated Qdrant into their AI assistant platform, focusing on retrieval augmented generation (RAG). Key technical aspects include Dust's two-step approach: starting with Qdrant Cloud for quick setup and then scaling and optimizing by leveraging Qdrant's features like quantization (Scalar Quantization) and MMAP payload threshold configuration. The post highlights the resulting cost reduction (2x) and ability to maintain low latency and high accuracy at scale. Observability features of Qdrant were also noted as beneficial for scaling.