What Is Reranking in RAG?
Reranking is a second pass where a model scores retrieved documents for relevance, so the best ones are used in the final prompt.
Why It Matters for Cost
- Reranking cost often scales with documents scored per request.
- High rerank document counts can dominate total unit economics.
- You can often reduce costs with better retrieval quality before reranking more docs.
Back to calculator: RAG Cost per User