How To Choose Chunk Size and Chunk Count
Chunk size and chunk count directly affect retrieval token overhead and answer quality.
Starting Heuristics
- Chunk size: often 150-350 tokens as a baseline.
- Chunks per request: often 3-8 for many product workflows.
- Increase chunks only when recall failures are visible in evaluations.
Back to calculator: RAG Cost per User