Tech Meridian← ALL MODELS
PROMY MERIDIAN

META · MODEL RELEASE TRACKER

Llama 3 405B

Llama 3 405B is a specific model in the Llama 3 family. Supplied excerpts report that during its pre-training Meta ran a 54-day pre-training period on up to 16K NVIDIA H100 GPUs and attributed a small number of unexpected job interruptions to silent data corruption in hardware.

CURRENT SNAPSHOT0/5 DIMENSIONS WITH DATA

The dimensions that change the decision.

PRICING

Not established from the available sources.

CONTEXT WINDOW

Not established from the available sources.

MODALITIES

Not established from the available sources.

BENCHMARKS

Not established from the available sources.

AVAILABILITY

Not established from the available sources.

VERIFIABLE FACTS

Every value stays attached to a source and date.

WHAT CHANGED

Stored passport versions, without reconstructed history.

Passport updated3 facts
LIMITATIONS · Silent data corruption caused unexpected job interruptions during pre-training+ During a 54-day period of Llama 3 405B pre-training on up to 16K NVIDIA H100 GPUs, Meta attributed 6 of 419 unexpected job interruptions to silent data corruption.
Passport created2 facts