Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #20322

Neuron Explorer

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

CODING · 1 SOURCE · Hugging Face

Profiling TorchNeuron on AWS Trainium — system-level walkthrough (Part 1)

This tutorial shows how to profile PyTorch workloads on AWS Trainium using TorchNeuron (torch-neuronx). It covers configuring torch.profiler with NeuronConfig and NeuronProfiler, exporting matched system/device traces (NEFF/NTFF), inspecting execution with Neuron Explorer, and compares three RMSNorm implementations (naive PyTorch ops, fused torch.rms_norm, and torch.compile) with reproducible examples in the torch-neuronx examples directory.

6.0

MODELS · 1 SOURCE · AWS Machine Learning

Deepgram ports Nova-3 speech-to-text to AWS Trainium2, gains 11–70% batch cost efficiency

Deepgram worked with AWS to port its Nova-3 speech-to-text model to AWS Trainium2, using TorchNeuron, NKILib kernels and custom Neuron kernels; the final setup runs eight model replicas on a single Amazon EC2 trn2.3xlarge instance. On Deepgram’s offline, throughput-oriented batch workloads (e.g., contact-center analytics, medical transcription) this configuration processed 11–70% more audio per dollar versus the compute options Deepgram previously used, measured using instance pricing at the time of evaluation.

7.0