Conceptual
Login

Cutting Cost and Latency with Prompt Caching

Mark a long stable prefix — system prompt, documents, tool definitions — so the provider reuses its computed state across calls, sharply reducing cost and time-to-first-token on repeated requests.