Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #32776

480B model

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

CODING · 1 SOURCE · InfoQ AI, ML & Data Engineering

Google open-sources 'TPU Sync' C++ library to move KV cache and weights on TPUs

Google Cloud released TPU Sync, a native C++ library (Apache 2.0) that moves KV cache blocks and model weights between TPU HBM, host DRAM, shared storage, and the network, with Python wheels for JAX and PyTorch. Google reports large latency and TTFT reductions for long-context and disaggregated LLM serving (e.g., Qwen3 235B median KV transfer latency down to ~230 ms and average TTFT reductions of ~60%, up to 90% for a 480B model), but several features (storage tier, RL weight sync) and Python packages are experimental or development builds and APIs may change rapidly.

7.0