Building a Personalized Product Recommender System with Vipshop and Milvus
Jul 29, 2021milvus

Summary
This post details Vipshop's implementation of a personalized product recommender system using Milvus. It describes a read/write separation architecture, the use of Redis for managing collection aliases to enable seamless data updates (effectively near real-time updates by switching entire data collections), batch writing data to multiple partitions, index building and pre-loading for performance, and a data recall process that achieves an average latency of 30ms. It also highlights lessons learned regarding connection pooling for the Java client, index warm-up, and parameter tuning (nlist, nprobe).
More from the AI Data Storage Engine trail
- Milvus Snapshots: Point-in-Time Collection Views Without Copying Data
- Announcing Milvus 3.0: Lake-Native Vector Search and a More Powerful Retrieval Engine
- How to Recover Milvus Data After etcd Corruption Without a Backup
- Open Tag: An Open-Source Claude Tag for Claude Code and Codex
- How Force Merge Compaction Nearly Doubled Milvus Search QPS