Audio LLMs can predict when their transcriptions are unreliable using audio-encoder representations
A new arXiv paper (arXiv:2609.30625v1) shows that Audio LLMs are poor judges of their own transcription reliability but that reliability is strongly encoded in frozen audio-encoder representations. The authors build a lightweight predictor on those representations that classifies transcription reliability before generation, achieving 81.10% in-domain and 78.09% cross-domain macro-F1 and outperforming prior baselines by ~10–12 points; the labels transfer across different Audio LLM families when their reliability boundaries are aligned.