Falcon-Emirati-7B: Emirati-dialect 7B model built from Falcon-H1-Arabic
Falcon-Emirati-7B is a 7B-parameter dialect-specialized model derived from Falcon-H1-Arabic, trained to understand and generate Emirati Arabic, including idioms, proverbs, and cultural references. The team adapted the Falcon-H1 hybrid architecture (State Space 'Mamba' + attention) and used a dedicated pipeline combining curated Emirati web text, MSA cultural materials, and synthetic Emirati-dialect data to compensate for sparse native written sources.