Skip to main content

​
Prompt Caching

Provider-side mechanism that reuses the key-value (KV) computation for a stable prompt prefix, billing cached tokens at a lower rate (typically ~10–20% of input price) than freshly computed tokens. Stub — expand when a dedicated source is ingested.