Calibration methods for HiFloat4 quantization: HiGPTQ, HiAutoRound, HiFlatQuant
This arXiv paper (2610.41112v1) evaluates three calibration approaches—HiGPTQ, HiAutoRound, and HiFlatQuant—for the HiFloat4 (HiF4) 4-bit block floating-point format. The authors report that these methods narrow the accuracy gap to BF16 to under 1% and outperform NVFP4 across a range of models and downstream tasks compared with direct HiF4 conversion.