How much does a RAG app cost to run?
Cost of retrieval-augmented generation: answering questions over your documents with live model prices.
Estimated monthly cost — RAG question answering
Calculated live from current TokenRex prices.
| Model | Input / 1M | Output / 1M | Per month |
|---|---|---|---|
| GPT-6 Luna | $0.10 | $0.50 | $8.50 |
| Claude Haiku 4.5 | $1.00 | $5.00 | $85.00 |
| Gemini 3.8 Flash | $0.75 | $3.75 | $63.75 |
| Gemini 3.1 Flash Lite | $0.25 | $1.50 | $22.50 |
| Claude Sonnet 5 | $2.00 | $10.00 | $170.00 |
| Gemini 4 Argon | $2.00 | $10.00 | $170.00 |
The workload we priced
10,000 requests a month, each with about 6,000 input tokens and 500 output tokens. One token is roughly three quarters of an English word.
What drives the bill
Retrieved passages make up most of the input; retrieve fewer, better chunks.
Embedding your documents is a one-time cost per document, priced separately.
Questions
- Are these exact monthly bills?
- They are estimates from live TokenRex prices and the token counts shown. Real bills depend on your actual prompt and reply lengths, which every API response reports in its usage field.
- How do I lower the cost?
- Shorten system prompts, cap reply length, cache repeated input where the model supports it, and send simple requests to a smaller model.
- Which currency am I billed in?
- Wallet top-ups and billing are in Indian rupees. Prices display in US dollars by default, and signed-in users can choose another display currency.
Related
- What is a token?
- What is prompt caching?
- How to reduce LLM API costs
- How much does an AI chatbot cost per month?
- How much does an AI coding agent cost?
- Cost to summarise documents with an LLM
- Cost of AI translation with an LLM API
- Cost to classify emails and tickets with AI
- Cost of extracting structured data with an LLM
- How much does an AI agent cost per task?