Introducing Pinecone Rerank V0
Dec 2, 2024Cesare Campagnano, Antonio Mallia, Jack Pertschuk, Gareth Jones
Summary
Introduced `pinecone-rerank-v0`, a new cross-encoder model for reranking search results in RAG systems. The model was evaluated against several industry-leading rerankers (Cohere, Voyage AI, Jina AI, BAAI, Google) on BEIR, TREC Deep Learning, Financebench-RAG, and Pinecone-RAG datasets, demonstrating superior performance in NDCG@10 and MRR@10 metrics. The post details the evaluation methodology, including datasets and metrics used, and provides a Python code example for integrating the new reranker via the Pinecone inference API.
More from the Integrated Inference for Embeddings trail
- Simplifying Vector Embeddings with Pinecone Integrated Inference Capabilities
- Retrieval Inference for scale and performance
- Introducing integrated inference: Embed, rerank, and retrieve your data with a single API
- Introducing reranking to Pinecone Inference to simplify building accurate AI
- Introducing Pinecone Inference to streamline your AI workflow