AI Data Storage Engine
Building a Milvus Cluster Based on JuiceFS

Building a Milvus Cluster Based on JuiceFS

6/15/2021 · Changjian Gao and Jingjing Jia

What this post added

This post details the integration of Milvus with JuiceFS, a cloud-native distributed POSIX file system. It explains how to configure Milvus to use JuiceFS for shared file storage, including setting up MySQL for metadata, creating a JuiceFS file system on object storage (e.g., Azure Blob Storage) and Redis for metadata, and configuring Milvus nodes (read/write roles) and Mishards. Performance benchmarks are presented, highlighting JuiceFS's advantages over EFS in IOPS and throughput, and demonstrating near-instantaneous data loading from disk to memory.

Read the original post ↗