Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #31446

NVIDIA TensorRT LLM (TRT-LLM)

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

CODING · 1 SOURCE · NVIDIA Developer

NVIDIA open-sources Snapshot to checkpoint and restore GPU workloads on Kubernetes

NVIDIA released Snapshot, an open-source component of its DSX AI Factory Platform that checkpoints fully initialized GPU workloads (CPU and GPU memory) and restores them on compatible nodes, enabling inference replicas to come online in seconds instead of minutes. Benchmarks and design partners (Crusoe, Saturn Cloud) show restores under 45 seconds and 8x–36x speedups versus cold starts across vLLM, SGLang, and TensorRT LLM setups on HGX B300 hardware.

7.0