Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #24074

OpenAI models

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

CODING · 1 SOURCE · AWS Machine Learning

Amazon Bedrock documents prompt-caching patterns for running OpenAI models in agents

An Amazon Bedrock post explains implicit and explicit prompt caching for agent workloads running OpenAI models, showing how to save the model’s prefill (KV) state for reusable prefixes (e.g., tools and instructions) using prompt_cache_breakpoint and prompt_cache_key to cut token costs and latency; it notes caching requires exact identical text and a reusable prefix of at least 1,024 tokens. The post also discusses combining implicit caching (Bedrock-chosen breakpoints) with explicit markers to share starting state across sessions and subagents.

5.0