Today, we are announcing the general availability of reranking models on Heroku Managed Inference and Agents , featuring support for Cohere Rerank 3.5 and Amazon Rerank 1.0 .
Semantic reranking models score documents based on their relevance to a specific query. Unlike keyword search or vector similarity, rerank models understand nuanced semantic relationships to identify the most relevant documents for a given question. Reranking acts as your RAG pipeline’s high-fidelity filter, decreasing noise and token costs by identifying which documents best answer the specific query.
Implement two-stage retrieval with the Heroku Rerank API
The Heroku Managed Inference API is designed to be compatible with the Cohere format.…