Matryoshka Embeddings: Detail at Multiple Scales

This post introduces Matryoshka embeddings, a novel embedding technique that embeds multiple scales of representation within a single vector. It explains the concept, the "funnel search" inference method, and the training objective modification. It also highlights Milvus's seamless support for these embeddings and lists popular Matryoshka embedding models.