Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #27325

vLLM-Omni (vLLM-Omni/vLLM-TRT integrations)

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

MODELS · 1 SOURCE · NVIDIA Developer

NVIDIA releases Cosmos Framework with Cosmos 3 Nano simulation recipes and NIM microservices

NVIDIA announced the Cosmos Framework, a modular platform of world foundation models and developer tools for physical AI that supports training, RL, optimization and inference across models including Cosmos 3, Alpamayo, GR00T, Qwen and pi0.5. The release includes Cosmos 3 Nano simulation recipes and example checkpoints (PyTorch/vLLM-Omni), NIM microservices for accelerated inference (quantization, speculative decoding, KV-cache-aware routing) with ~2–3x speedups on H200 GPUs, and guidance on GPU memory use (Cosmos3-Nano: ~58 GiB BF16; ~44 GiB FP8 with offloading); a livestream is scheduled for Nov. 5.

7.0