Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #34965

implicit prompt caching

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

COMPANIES · 1 SOURCE · AWS Machine Learning

Amazon Bedrock adds explicit prompt caching for open-weight models

Amazon Web Services announced that open-weight models on Amazon Bedrock now support explicit prompt caching (in addition to implicit caching). Prompt caching lets Bedrock reuse computed state for matching prompt prefixes to reduce input processing, lower input billing rates for cache reads, and cut response latency; developers use the Chat Completions API and should consult each model’s card for supported caching modes, minimum prefix lengths, breakpoints, and TTLs.

6.0