What is prompt caching?
Prompt caching lets a provider reuse a repeated beginning of a prompt at a lower input price instead of reprocessing it.
Definition
Prompt caching lets a provider reuse a repeated beginning of a prompt at a lower input price instead of reprocessing it.
How it works on TokenRex
TokenRex bills cached input at the provider-reported cached rate where the model supports it, and shows cache read and write prices on each model page.
Cached output is not offered.