Understanding Context Caching
Google AI Studio and Vertex AI feature native context caching. Developers can store large, persistent documents, videos, source code, or system instructions in the model memory, and read from it across multiple API requests.
- Massive Savings: Cached input tokens are billed at a 90% discount compared to base inputs.
- Large Context Support: Excellent for codebases, long user histories, PDF libraries, or full movies.
- Fast Response: Speeds up model latency significantly since large contexts do not need to be processed again.