What is Prompt caching?
Reusing a recently processed prompt prefix so repeated input is billed at a lower price.
It helps when many requests start with the same long instructions or documents. Cache writes can cost extra, and cache reads are cheaper than normal input.
Learn more
- How LLM API pricing works in LLM APIs without the jargon
- Estimate your bill before you build in LLM APIs without the jargon