Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #38499

SGLang 0.5.13

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

COMPANIES · 1 SOURCE · AWS Machine Learning

AWS adds distributed KV-caching skill to Agent Toolkit to speed self-hosted LLMs

AWS published a distributed KV caching skill for the Agent Toolkit that integrates Amazon ElastiCache to share KV attention state across GPU servers, and includes tools (KVTrace) and guided flows to evaluate, deploy, and troubleshoot caching; AWS reports up to 40% inference cost savings and up to 80% faster time-to-first-token in benchmarked cases. The skill requires LMCache 0.5.8rc1 or later and vLLM 0.11.1 or later and works with coding agents such as Kiro, Claude Code, and OpenAI Codex.

7.0