Milvus

JSON Shredding in Milvus: 88.9x Faster JSON Filtering with Flexibility

Dec 4, 2025Jack Zhang
JSON Shredding in Milvus: 88.9x Faster JSON Filtering with Flexibility
SummaryAI, from the source post

Introduces JSON Shredding, a new feature that optimizes the storage and querying of semi-structured JSON data in Milvus. It categorizes JSON keys into typed, dynamic, and shared, storing them in optimized columnar formats (Arrow/Parquet) or a compact binary-JSON column with an inverted index for shared keys. This enables schema-free agility with high query performance, demonstrated by benchmarks showing up to 88.9x speedup for shared key queries and 15-30x for typed key queries.

More from the AI Data Storage Engine trail