TorchNeuron

2026-10-20

COMPANIES · 1 SOURCE · TechCrunch AI

Google releases open-source TorchTPU to run PyTorch on TPUs, challenging Nvidia

Google announced TorchTPU, an open-source PyTorch implementation that lets developers run existing PyTorch apps on Google’s TPUs with minimal changes; the move follows Amazon’s recent release of TorchNeuron for Trainium and accompanies efforts to decouple PyTorch from Nvidia-specific code. Google also released a TPU agent suite and updated LiteRT to assist porting and edge deployments.

8.0

2026-10-20

CODING · 1 SOURCE · Hugging Face

Hugging Face launches TorchNeuron — native PyTorch backend for AWS Trainium (public beta Oct 20, 2026)

TorchNeuron is a new PyTorch plugin from Hugging Face that exposes Neuron as a native PyTorch device for AWS Trainium, enabling eager execution, torch.compile and native distributed APIs (DTensor, FSDP, TP). It brings Transformers, Diffusers and other Hugging Face libraries to Trainium without Optimum Neuron-specific forks, increases out-of-the-box text-generation model compatibility (89% of top 100 vs 46% with Optimum Neuron v0.4.5), and will be available as a public beta starting Oct 20, 2026 (pip install torch-neuronx).

8.0

2026-10-19

COMPANIES · 1 SOURCE · TechCrunch AI

AWS launches TorchNeuron to run PyTorch models on Trainium

Amazon Web Services released TorchNeuron, a PyTorch-compatible tool that AWS says lets developers run PyTorch apps on its Trainium AI chips with minimal configuration (one-line change). AWS also plans to contribute upstream changes to PyTorch to reduce framework tie‑ins to specific chips and argues the move gives startups easier access to AWS cloud and better price‑performance across training and inference.

8.0

2026-10-19

MODELS · 1 SOURCE · AWS Machine Learning

Deepgram ports Nova-3 speech-to-text to AWS Trainium2, gains 11–70% batch cost efficiency

Deepgram worked with AWS to port its Nova-3 speech-to-text model to AWS Trainium2, using TorchNeuron, NKILib kernels and custom Neuron kernels; the final setup runs eight model replicas on a single Amazon EC2 trn2.3xlarge instance. On Deepgram’s offline, throughput-oriented batch workloads (e.g., contact-center analytics, medical transcription) this configuration processed 11–70% more audio per dollar versus the compute options Deepgram previously used, measured using instance pricing at the time of evaluation.

7.0