Hugging Face AI open-source blog: Falcon-Emirati: When an LLM Learns the Dialect, the Culture, and the Nuance

Falcon-Emirati-7B released: a 7B dialect-specific model based on Falcon-H1-Arabic, focused on understanding and generating Emirati Arabic. It adopts the Falcon-H1 hybrid architecture (Mamba and Transformer attention in parallel), and builds three pipelines of real dialect web data, UAE-culture MSA corpus, and vocabulary-constrained synthetic data. The team explored the amount of dialect data injection and training stages through ablation experiments to balance real and synthetic data.