Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #12648

HuBERT

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · Apple Machine Learning Research

Code-switching detection from speech using language-selective dimensions in Whisper-small

The authors identify language-selective hidden-state dimensions in pretrained speech encoders and aggregate their frame-level activations to detect code-switching (CS) directly from audio. Using a small tuning set, the Whisper-small encoder achieved a mean F1 of 0.798 across 14 language pairs on CS-FLEURS, outperforming a CNN (0.776) and a HuBERT linear baseline (0.751).

6.0

RESEARCH · 1 SOURCE · Apple Machine Learning Research

Language discrimination during HuBERT pretraining reduces the bilingual multilingual gap

Authors report that strengthening language discrimination in a controlled English–French HuBERT pretraining setup—via an auxiliary language classifier or per-language k-means targets—reduces the multilingual gap on phonetic, lexical, and prosodic measures while retaining cross-language sharing. Key results: phone-ABX fell from 11.6% to 10.4% (monolingual: 10.8%), sWUGGY rose from 52.1% to 56.7% (monolingual: 58.5%), and ProsAudit (lexical) rose from 68.9% to 72.9%; largest gains occur when discrimination is introduced in the first HuBERT iteration.

7.0