Compare context windows
Choose a model with enough room for retrieval.
RAG chunk budget planner
Plan a retrieval-augmented generation chunk budget around a selected model’s context window, system prompt, output reserve, and retrieved chunk count.
How to use this tool
- Choose the generation model that will receive retrieved context.
- Enter system-prompt and output-token reservations.
- Choose how many retrieved chunks to include and use the resulting per-chunk budget.
Worked example: Example: with a 200,000-token context window, a 5,000-token system prompt, a 5,000-token output reserve, and 10 chunks, each chunk can be about 19,000 tokens.
Retrieval budget397,000 tokens
Maximum per chunk49,625 tokens
Total document capacity397,000 tokens