NVIDIA cuTile and Jane Street optimize Mamba‑2 forward pass with three Tensor Core kernels
Jane Street implemented the Mamba‑2 state‑space sequence model using NVIDIA's CUDA Tile (cuTile) Python DSL and worked with NVIDIA to optimize three custom forward‑pass kernels—chunk_cumsum, fwd_pass_state, and compute_out—targeting Tensor Cores. Optimizations include register‑resident tiling, TF32 casts, DRAM latency hints, operand routing to Tensor Memory, TMA‑friendly memory layouts, and an autotuner for block size and occupancy per input shape.