Tech Meridian ← ENTITY INDEX
RU

COMPANY · ENTITY #1985

PyTorch

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

CODING · 1 SOURCE · AWS Machine Learning

NVIDIA NVRx adds fault-tolerance to PyTorch FSDP training on Amazon EKS

NVIDIA describes how to integrate its Resiliency Extension (NVRx) with PyTorch FSDP on Amazon EKS to reduce downtime for large multi-node GPU training. The post demonstrates async checkpointing (TorchAsyncCheckpoint), in-process restart, and an in-job restart launcher (ft_launcher), provides H100 2–8 node benchmarks, and publishes reproducible code and a pip-installable nvidia-resiliency-ext package.

6.0

RESEARCH · 1 SOURCE · Google Research

Croissant 1.0: a schema.org-based metadata format for ML-ready datasets, with support from major dataset hosts and frameworks

Croissant is a new ML-oriented metadata format (v1.0) built on schema.org that standardizes description and organization of datasets without changing underlying file formats. The release includes a spec, example datasets, an open-source Python validator/consumer/generator, a visual editor, and a Responsible AI (RAI) vocabulary extension, and is being adopted by Kaggle, Hugging Face, OpenML, indexed by Dataset Search, and made loadable in major frameworks via TensorFlow Datasets.

7.0