--- title: "Thesis Proposal — paper by Umar et al. (2026)" description: "Large multilingual speech models such as Whisper and MMS still struggle when African speakers alternate languages several… 2 references." authors: ["Umar Baba Umar", "Sulaimon Adebayo Bashir", "Abdulmalik Danlami Mohammed", "Amina Gogo Tafida"] year: 2026 venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)" source: "https://aclanthology.org/2026.acl-srw.67/" doi: "10.18653/v1/2026.acl-srw.67" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/umar-2026-thesis-proposal-self-adaptive-epistemic/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/umar-2026-thesis-proposal-self-adaptive-epistemic/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/53/) / Thesis Proposal: Self-Adaptive and Epistemic Uncertainty-Guided ASR of Dense Intra-Sentential Code-Switched Speech for African Low-Resource Languages # Thesis Proposal: Self-Adaptive and Epistemic Uncertainty-Guided ASR of Dense Intra-Sentential Code-Switched Speech for African Low-Resource Languages **Authors:** [Umar Baba Umar](https://md.research.elamur.ai/free/en/authors/umar-baba-umar/), [Sulaimon Adebayo Bashir](https://md.research.elamur.ai/free/en/authors/sulaimon-adebayo-bashir/), [Abdulmalik Danlami Mohammed](https://md.research.elamur.ai/free/en/authors/abdulmalik-danlami-mohammed/) and Amina Gogo Tafida · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.acl-srw.67/) · [PDF](https://aclanthology.org/2026.acl-srw.67.pdf) · [DOI 10.18653/v1/2026.acl-srw.67](https://doi.org/10.18653/v1/2026.acl-srw.67) · [OpenAlex](https://openalex.org/W7166845543) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary Large multilingual speech models such as Whisper and MMS still struggle when African speakers alternate languages several times within one sentence. Errors cluster at language transitions, adaptation favors the dominant language, and global WER hides these failures. This Student Research Workshop paper is a thesis proposal, so it reports no experimental results. It outlines a framework for Hausa–English (Engausa) and Hausa–Yorùbá built around three research questions: - **Corpus design:** a new corpus with token-level language tags, switch regions modeled as time windows around transitions, and a distinction between borrowings and true switches. It will have labeled and unlabeled partitions and will be expanded with LLM-generated text constrained by Equivalence Constraint Theory and the Matrix Language Frame Model. - **Uncertainty at switch points:** testing whether epistemic uncertainty, estimated via Monte Carlo Dropout, rises at switch points and can filter pseudo-labels for self-training. - **Switch-aware adaptation:** fine-tuning with auxiliary language identification and boundary supervision while limiting catastrophic forgetting. The work matters because it treats code-switching as structured linguistic behavior rather than noise. It also introduces switch-sensitive evaluation for under-served African languages. ## Key points - Planned data per language pair: about 10 hours of manually transcribed speech plus 20+ hours of unlabeled spontaneous recordings. Splits will be speaker-separated and balanced by switch density, and a double-annotated subset will measure inter-annotator agreement. - A switch region is defined as all frames within a window of width δ around aligned language-transition times, which accommodates pauses and co-articulation. - Four baselines are planned: a zero-adaptation multilingual model, standard fine-tuning, naive self-training, and joint ASR + LID without boundary weighting. Proposed components will be added incrementally, ending in a full combined model. - Evaluation will use overall WER, switch-region WER, and per-language WER, with Δlang (the absolute WER gap between languages) as an imbalance measure. Expected Calibration Error (ECE) will assess confidence calibration. - The authors argue that existing African resources (OkwuGbé, NaijaVoices, WAXAL) are mostly monolingual and lack dense switch annotation. They cite SEAME as the reference corpus for Mandarin–English code-switched ASR. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 493 works 🧭 Topics (2): [🎙️ Speech & spoken language](https://md.research.elamur.ai/free/en/topics/speech/) · 519 works · [🌱 Low-resource languages](https://md.research.elamur.ai/free/en/topics/low-resource-languages/) · 287 works ## Cite Cite as: Umar Baba Umar, Sulaimon Adebayo Bashir, Abdulmalik Danlami Mohammed and Amina Gogo Tafida. 2026. Thesis Proposal: Self-Adaptive and Epistemic Uncertainty-Guided ASR of Dense Intra-Sentential Code-Switched Speech for African Low-Resource Languages. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{umar2026thesis, title = {{Thesis Proposal: Self-Adaptive and Epistemic Uncertainty-Guided ASR of Dense Intra-Sentential Code-Switched Speech for African Low-Resource Languages}}, author = {Umar Baba Umar, Sulaimon Adebayo Bashir, Abdulmalik Danlami Mohammed and Amina Gogo Tafida}, booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)}, year = {2026}, doi = {10.18653/v1/2026.acl-srw.67}, url = {https://doi.org/10.18653/v1/2026.acl-srw.67} } ``` - [← previous Thesis Proposal: On the Granularity-Robustness Trade-off in Text-Derived Knowledge Graphs](https://md.research.elamur.ai/free/en/papers/pralomram-2026-thesis-proposal-granularity-robustness-trade/) - [next → Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment](https://md.research.elamur.ai/free/en/papers/pandita-2026-thesis-proposal-human-centered-perspective/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/53/) ## References 2 references, 2 of them with a card of ours. ↗ leads to the work. 1. David Ifeoluwa Adelani, Jade Abbott, Graham Neubig, Daniel Preoţiuc-Pietro, and 1 others. 2021. [MasakhaNER: Named entity recognition for african languages](https://md.research.elamur.ai/free/en/papers/adelani-2021-masakhaner-named-entity-recognition-african/). Transactions of the Association for Computational Linguistics, 9:1116–1131. 2. Maryam Al Ali and Hanan Aldarmaki. 2024. [Mixat: A data set of bilingual emirati-english speech](https://md.research.elamur.ai/free/en/papers/ali-2024-mixat-data-set-bilingual-emirati/). In Proceedings of the 11th Workshop on Spoken Language Technologies for Under-Resourced Languages (SIGUL 2024). Used here as the cited 2024 Arabic-English code-switching dataset paper. \#\# Limitations *Updated 1 November 2026*