Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #1725

CUTLASS

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

CODING · 1 SOURCE · InfoQ AI, ML & Data Engineering

TornadoVM 7.3 released with CUDA hybrid API and jitLLM v2.0

TornadoVM 7.3, an open‑source heterogeneous GPU programming framework for Java, replaces JNI with the Foreign Function & Memory (FFM) API, removes the experimental JVMCI dependency, and centralizes compiler metadata via reflection/ASM/Unsafe. The release deepens Nvidia integration (optimized CUDA backend with cuTile/TileContext and direct cuBLAS/CUTLASS calls), adds Apple MXL support and multi‑GPU execution, and ships jitLLM v2.0 — a single‑JAR Java AI inference engine; both projects are being commercialized through Beestream.ai.

6.0

RESEARCH · 1 SOURCE · Google Research

Google Research outlines software optimizations for mixed-input matmul on NVIDIA Ampere (CUTLASS)

A Google Research blog post by Manish Gupta presents software techniques to implement mixed-input matrix multiplication (e.g., F16 inputs × U8 weights) on NVIDIA Ampere Tensor Cores by handling data-type conversion and layout conformance; the methods are released in the open-source NVIDIA/CUTLASS repository and are reported to add minimal software overhead while approaching hardware peak performance. The work targets memory- and compute-heavy LLM workloads by enabling weight-only quantization patterns that reduce model memory footprint.

7.0