TensorRT

2026-10-23

CODING · 1 SOURCE · NVIDIA Developer

NVIDIA adds Global Performance Tuner to TensorRT 11.1 to expand build routes

A Part 1 blog post introduces TensorRT's Global Performance Tuner, released in TensorRT 11.1, which provides customizable build routes and an accuracy-aware tuning workflow that expands the compiler's solution space and validates candidate engines against end-to-end accuracy and performance. The article frames compilation as a builder/search problem, explains the tuner's three guiding principles, and points readers to documentation and a forthcoming Part 2 covering algorithm and architecture details.

7.0

2026-09-29

CODING · 1 SOURCE · NVIDIA Developer

NVIDIA publishes lessons from building AI-native TensorRT Model Connect

NVIDIA published a first‑hand account of engineering choices behind TensorRT Model Connect, an open‑source C++ collection of model reference implementations built on TensorRT. The article describes an AI‑native development approach—using coding agents with outcome‑driven tasks, model‑family isolation, reversible changes, and GPU‑backed validation—and notes the project covered 128 model families tested on NVIDIA GB300 as of the public July 29, 2026 release comparison.

6.0

2026-09-22

CODING · 1 SOURCE · NVIDIA Developer

NVIDIA updates Isaac ROS 5.0 to use rosidl::Buffer CUDA backend for zero-copy GPU transport

NVIDIA contributed a CUDA buffer backend to ROS 2 Lyrical and updated all nodes in NVIDIA Isaac ROS 5.0 to use rosidl::Buffer, enabling zero-copy GPU-resident message transport when runtime conditions allow. The post demonstrates an AI coding agent (migrate-node-to-rosidl-buffer skill) migrating a TensorRT-based Depth Anything 3 node, and verifies the optimized path with NVIDIA Nsight Systems and runtime checks that report backend_type == "cuda".

6.0

2026-09-21

COMPANIES · 1 SOURCE · NVIDIA Developer

NVIDIA Dynamo-Triton 26.07 enables TensorRT multi-device inference across GPUs

NVIDIA has enabled TensorRT multi-device inference in Dynamo-Triton release 26.07 (TensorRT multi-device is supported starting in TensorRT 11.0), allowing a single KIND_MODEL instance to own multiple GPUs and present one gRPC endpoint while using NCCL-backed distributed collectives. In a Cosmos 3 Nano video-generation demo, distributing a 44,160-token transformer across up to eight GPUs reduced end-to-end generation latency from 156.6s to 34.2s and produced a reported transformer RPC speedup of 6.09x; users can download Dynamo-Triton 26.07 from NGC and follow the TensorRT multi-device guide to reproduce the setup.

7.5

2026-08-28

MODELS · 1 SOURCE · NVIDIA Developer

NVIDIA TensorRT Model Connect: deploy open models from checkpoint to inference in two commands

A NVIDIA Developer post announces TensorRT Model Connect, a tool that purports to let developers take open AI models from checkpoint to running inference with two commands, addressing model-specific conversion and preprocessing steps. The announcement outlines the workflow; full details on supported formats, frameworks, and system requirements are provided in NVIDIA's documentation.

6.0