--- title: "SpeechLM for Automatic Speech Recognition in Low-resource" description: "The authors ask whether a general-purpose, instruction-tuned speech language model can be adapted into a supervised ASR… 11 references." authors: ["Md Abdur Razzaq Riyadh", "Eneko Agirre", "Eva Navas", "Claudia Borg"] year: 2026 venue: "Proceedings of Speech Language Models in Low-Resource Settings: Performance, Evaluation, and Bias Analysis (SPEAKABLE) @ LREC 2026" source: "https://aclanthology.org/2026.speakable-1.14/" doi: "10.63317/2634e2pv97js" licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)" licence_url: "https://creativecommons.org/licenses/by-nc/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/riyadh-2026-speechlm-automatic-speech-recognition-low/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/riyadh-2026-speechlm-automatic-speech-recognition-low/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/43/) / SpeechLM for Automatic Speech Recognition in Low-resource Languages # SpeechLM for Automatic Speech Recognition in Low-resource Languages **Authors:** [Md Abdur Razzaq Riyadh](https://md.research.elamur.ai/free/en/authors/md-abdur-razzaq-riyadh/), [Eneko Agirre](https://md.research.elamur.ai/free/en/authors/eneko-agirre/), [Eva Navas](https://md.research.elamur.ai/free/en/authors/eva-navas/) and [Claudia Borg](https://md.research.elamur.ai/free/en/authors/claudia-borg/) · **Year:** 2026 · **Venue:** [Proceedings of Speech Language Models in Low-Resource Settings: Performance, Evaluation, and Bias Analysis (SPEAKABLE) @ LREC 2026](https://md.research.elamur.ai/free/en/venues/speakable/) ([Speech Language Models in Low-Resource Settings: Performance, Evaluation, and Bias Analysis (SPEAKABLE) @ LREC 2026](https://md.research.elamur.ai/free/en/venues/speakable/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.speakable-1.14/) · [PDF](https://aclanthology.org/2026.speakable-1.14.pdf) · [DOI 10.63317/2634e2pv97js](https://doi.org/10.63317/2634e2pv97js) · [OpenAlex](https://openalex.org/W7166559167) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary The authors ask whether a general-purpose, instruction-tuned speech language model can be adapted into a supervised ASR system for two under-resourced languages, Basque and Maltese. They also ask which internal component matters most. They fine-tuned LLaMA-Omni, which chains a whisper speech encoder, a speech adaptor, LLaMA 3.1-8B-Instruct and a speech decoder, and ran extensive hyperparameter searches. They then ran three controlled experiments: plain fine-tuning; replacing the LLM with the Basque-adapted Latxa Instruct (called Latxa-Omni); and replacing the encoder with a whisper already fine-tuned on the target language. A 35-hour Basque subset served as a control for the effect of data size. With ample in-domain data, the SpeechLM beat a fine-tuned whisper-large-v3 on Basque. It suffered badly when data was scarce (Maltese, reduced Basque) and generalized worse to out-of-distribution Basque speech. The Basque LLM recovered much of that robustness. This is presented as the first systematic look at SpeechLM-based ASR in low-resource settings. ## Key points - **Average WER across test splits:** - Basque: 8.09% - Maltese: 25.65% - **Basque in-distribution:** LLaMA-Omni improved on the fine-tuned whisper-large-v3 baseline by about 22%. - **Maltese in-distribution:** performance fell by roughly 50% relative to the baseline, which the authors attribute to the much smaller training set. - **Out-of-distribution Basque (Faktoria), WER:** | Model | EUS-only portion | Other portion | |---|---|---| | whisper-large-v3 | 18.56% | 29.42% | | LLaMA-Omni | 25.23% | 54.81% | | Latxa-Omni | 21.87% | 31.54% | | LLaMA-Omni with adapted encoder | 22.88% | 45.14% | Language-adapting the LLM helped more than language-adapting the encoder. - **Maltese errors** were mostly confusions between similar-sounding words and faulty word segmentation, often producing Italian-like forms. The authors read this as the LLM failing to learn Maltese grammar from limited data, even though the encoder captures the sounds. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [University of the Basque Country](https://md.research.elamur.ai/free/en/universities/university-of-the-basque-country/) — University, Leioa, Spain · 57 works · 16,520 citations - [University of Malta](https://md.research.elamur.ai/free/en/universities/university-of-malta/) — University, Msida, Malta · 29 works · 894 citations 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 452 works 🧭 Topics (2): [🎙️ Speech & spoken language](https://md.research.elamur.ai/free/en/topics/speech/) · 480 works · [🌱 Low-resource languages](https://md.research.elamur.ai/free/en/topics/low-resource-languages/) · 267 works ## Cite Cite as: Md Abdur Razzaq Riyadh, Eneko Agirre, Eva Navas and Claudia Borg. 2026. SpeechLM for Automatic Speech Recognition in Low-resource Languages. Proceedings of Speech Language Models in Low-Resource Settings: Performance, Evaluation, and Bias Analysis (SPEAKABLE) @ LREC 2026. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{riyadh2026speechlm, title = {{SpeechLM for Automatic Speech Recognition in Low-resource Languages}}, author = {Md Abdur Razzaq Riyadh, Eneko Agirre, Eva Navas and Claudia Borg}, booktitle = {Proceedings of Speech Language Models in Low-Resource Settings: Performance, Evaluation, and Bias Analysis (SPEAKABLE) @ LREC 2026}, year = {2026}, doi = {10.63317/2634e2pv97js}, url = {https://doi.org/10.63317/2634e2pv97js} } ``` - [← previous Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception](https://md.research.elamur.ai/free/en/papers/wan-2026-speech-hands-self-reflection-voice/) - [next → SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks](https://md.research.elamur.ai/free/en/papers/safarzadeh-2026-spence-syntactic-probe-detecting-contamination/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/43/) ## References 11 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Rosana Ardila, Megan Branson, Kelly Davis, Michael Kohler, Josh Meyer, Michael Henretty, Reuben Morais, Lindsay Saunders, Francis Tyers, and Gregor Weber. 2020. [Common voice: A massively-multilingual speech corpus](https://md.research.elamur.ai/free/en/papers/ardila-2019-common-voice-massively-multilingual-speech/). In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 4218–4222, Marseille, France. European Language Resources Association. Julen Etxaniz, Oscar Sainz, Naiara Miguel, Itziar Aldabe, German Rigau, Eneko Agirre, Aitor Ormazabal, Mikel Artetxe, and Aitor Soroa. Latxa: An open language model and evaluation suite for basque. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14952–14972. Association for Computational Linguistics. [↗](https://doi.org/10.48550/arxiv.1912.06670) 2. Qingkai Fang, Shoutao Guo, Yan Zhou, Zhengrui Ma, Shaolei Zhang, and Yang Feng. 2025. Llama-omni: Seamless speech interaction with large language models. In International Conference on Representation Learning, volume 2025, pages 57607–57624. [↗](https://doi.org/10.48550/arxiv.2409.06666) 3. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. [Deep Learning](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). MIT Press. [http://www.deeplearningbook.org](http://www.deeplearningbook.org). Faktoria (EUS only) 18.56% 25.23% 21.87% 22.88% Faktoria (others) 29.42% 54.81% 31.54% 45.14% Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al. 2024. The Llama 3 Herd of Models. [↗](http://www.deeplearningbook.org) 4. Carlos Daniel Hernandez Mena, Albert Gatt, Andrea DeMarco, Claudia Borg, Lonneke van der Plas, Amanda Muscat, and Ian Padovani. 2020. [MASRI-HEADSET: A Maltese corpus for speech recognition](https://md.research.elamur.ai/free/en/papers/mena-2020-masri-headset-maltese-corpus-speech/). In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 6381–6388, Marseille, France. European Language Resources Association. [↗](https://doi.org/10.48550/arxiv.2008.05760) 5. Oddur Kjartansson, Alexander Gutkin, Alena Butryna, Isin Demirsahin, and Clara Rivera. 2020. Open-Source High Quality Speech Datasets for Basque, Catalan and Galician. In Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced Languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL), pages 21–27, Marseille, France. European Language Resources association. [find](https://scholar.google.com/scholar?q=Oddur+Kjartansson%2C+Alexander+Gutkin%2C+Alena+Butryna%2C+Isin+Demirsahin%2C+and+Clara+Rivera%2E+2020%2E+Open%2DSource+High+Quality+Speech+Datasets+for+Basque%2C+Catalan+and+Galician%2E+In+Proceedings+of+the+1st+Joint+) 6. Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. [find](https://scholar.google.com/scholar?q=Ilya+Loshchilov+and+Frank+Hutter%2E+2019%2E+Decoupled+weight+decay+regularization%2E+In+7th+International+Conference+on+Learning+Representations%2C+ICLR+2019%2C+New+Orleans%2C+LA%2C+USA%2C+May+6%2D9%2C+2019%2E+OpenReview%2En) 7. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2022. [Robust Speech Recognition via Large-Scale Weak Supervision](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/). [↗](https://doi.org/10.48550/arxiv.2212.04356) 8. Amparo Varona, Mikel Penagarikano, Germán Bordel, and Luis Javier Rodriguez-Fuentes. 2024. A Bilingual Basque–Spanish Dataset of Parliamentary Sessions for the Development and Evaluation of Speech Technology. Applied Sciences, 14(5):1951. [↗](https://doi.org/10.3390/app14051951) 9. Aohan Zeng, Zhengxiao Du, Mingdao Liu, Kedong Wang, Shengmin Jiang, Lei Zhao, Yuxiao Dong, and Jie Tang. 2024. [GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot](https://md.research.elamur.ai/free/en/papers/zeng-2024-glm-4-voice-intelligent/). [↗](https://doi.org/10.48550/arxiv.2412.02612) 10. Yuhao Zhang, Yuhao Du, Zhanchen Dai, Xiangnan Ma, Kaiqi Kou, Benyou Wang, and Haizhou Li. 2025a. Echox: Towards mitigating acoustic-semantic gap via echo training for speech-to-speech llms. [↗](https://doi.org/10.48550/arxiv.2509.09174) 11. Yuhao Zhang, Zhiheng Liu, Fan Bu, Ruiyu Zhang, Benyou Wang, and Haizhou Li. 2025b. Soundwave: Less is More for Speech-Text Alignment in LLMs. [find](https://scholar.google.com/scholar?q=Yuhao+Zhang%2C+Zhiheng+Liu%2C+Fan+Bu%2C+Ruiyu+Zhang%2C+Benyou+Wang%2C+and+Haizhou+Li%2E+2025b%2E+Soundwave%3A+Less+is+More+for+Speech%2DText+Alignment+in+LLMs%2E) *Updated 1 November 2026*