Amazon Bedrock documents prompt-caching patterns for running OpenAI models in agents
An Amazon Bedrock post explains implicit and explicit prompt caching for agent workloads running OpenAI models, showing how to save the model’s prefill (KV) state for reusable prefixes (e.g., tools and instructions) using prompt_cache_breakpoint and prompt_cache_key to cut token costs and latency; it notes caching requires exact identical text and a reusable prefix of at least 1,024 tokens. The post also discusses combining implicit caching (Bedrock-chosen breakpoints) with explicit markers to share starting state across sessions and subagents.