---
title: "TamilVoiceLab@DravidianLangTech 2026: Investigating Whisper"
description: "For the DravidianLangTech 2026 shared task on Tamil Dialect Speech Recognition, the authors build a… 21 references, cited by 1 paper here."
authors: ["S.B.Priya", "Bharathi B"]
year: 2026
venue: "Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages"
source: "https://aclanthology.org/2026.dravidianlangtech-1.63/"
doi: "10.18653/v1/2026.dravidianlangtech-1.63"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/priya-2026-tamilvoicelab-dravidianlangtech-2026-investigating-whisper/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/priya-2026-tamilvoicelab-dravidianlangtech-2026-investigating-whisper/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/18/) / TamilVoiceLab@DravidianLangTech 2026: Investigating Whisper Tamil Large-v2 for Dialectal Tamil Speech Recognition

# TamilVoiceLab@DravidianLangTech 2026: Investigating Whisper Tamil Large-v2 for Dialectal Tamil Speech Recognition

**Authors:** [S.B.Priya](https://md.research.elamur.ai/free/en/authors/s-b-priya/) and [Bharathi B](https://md.research.elamur.ai/free/en/authors/bharathi-b/) · **Year:** 2026 · **Venue:** [Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages](https://md.research.elamur.ai/free/en/venues/dravidianlangtech/) ([Workshop on Speech, Vision, and Language Technologies for Dravidian Languages 2026](https://md.research.elamur.ai/free/en/venues/dravidianlangtech/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.dravidianlangtech-1.63/) · [PDF](https://aclanthology.org/2026.dravidianlangtech-1.63.pdf) · [DOI 10.18653/v1/2026.dravidianlangtech-1.63](https://doi.org/10.18653/v1/2026.dravidianlangtech-1.63) · [OpenAlex](https://openalex.org/W7166819334)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
Speech recognizers trained mostly on standard Tamil often fail on regional varieties, which differ in pronunciation, rhythm, vocabulary and syntax. For the DravidianLangTech 2026 shared task on Tamil Dialect Speech Recognition, the authors build a zero fine-tuning baseline. They apply the pretrained Whisper Tamil Large-v2 model directly, with no extra training or domain adaptation.

The shared-task corpus covers four dialect regions of Tamil Nadu. Its training portion has roughly 9.22 hours of transcribed audio, and a separate test set is unlabeled. Only the test data is used here. The Whisper processor converts 16 kHz audio into log-Mel spectrograms, the model decodes them with beam search, and the output is scored by Word Error Rate.

The system reaches a WER of 0.71. That is clearly worse than the fine-tuned or dialect-trained Tamil systems the authors cite, which report roughly 0.30–0.45. Most errors involve regional vocabulary, colloquial phrasing and dialectal pronunciation, yet many frequent words are still recognized. The study is useful as a reference point for how much dialect-aware adaptation and balanced dialect data Tamil ASR still requires.

## Key points
- Model: Whisper Tamil Large-v2, used off the shelf (no fine-tuning) with log-Mel features and beam search decoding.
- Data: the Tamil Dialect Speech dataset, released for DravidianLangTech's shared task and described in Bharathi et al. (2026). It covers Northern, Southern, Western and Central dialects, with spontaneous and read speech at 16 kHz.
- Data splits: the training set has 5,134 recordings (about 9.22 h) and the test set about 2.05 h. The paper gives the number of test files as 579 in some places and 580 in others.
- Result: WER = 0.71 on the test set. Comparison systems with fine-tuning or LoRA adaptation report about 0.30–0.45.
- Code is released on GitHub (Prisur2013/TAMILVOICELABS_1991).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 493 works

🧭 Topics (1): [🎙️ Speech & spoken language](https://md.research.elamur.ai/free/en/topics/speech/) · 519 works

## Cite

Cite as: S.B.Priya and Bharathi B. 2026. TamilVoiceLab@DravidianLangTech 2026: Investigating Whisper Tamil Large-v2 for Dialectal Tamil Speech Recognition. Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sbpriya2026tamilvoicelab,
  title = {{TamilVoiceLab@DravidianLangTech 2026: Investigating Whisper Tamil Large-v2 for Dialectal Tamil Speech Recognition}},
  author = {S.B.Priya and Bharathi B},
  booktitle = {Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages},
  year = {2026},
  doi = {10.18653/v1/2026.dravidianlangtech-1.63},
  url = {https://doi.org/10.18653/v1/2026.dravidianlangtech-1.63}
}
```

- [← previous TamilMayangoliSpell: An Open-Source Neural Framework for Context-Sensitive Mayangoli Error Correction in Tamil](https://md.research.elamur.ai/free/en/papers/m-2026-tamilmayangolispell-open-source-neural-framework/)
- [next → Taming System Complexity: Demystifying Software Engineering Agents in Diagnosing Linux Kernel Faults](https://md.research.elamur.ai/free/en/papers/zhou-2026-taming-system-complexity-demystifying-software/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/18/)

## References

21 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Priyobroto Acharya, Soham Chaudhuri, Sayan Das, Dipanjan Saha, and Dipankar Das. 2025. Junlp@ lt-edi-2025: Efficient low-rank adaptation of whisper for inclusive tamil speech recognition targeting vulnerable populations. In Proceedings of the 5th Conference on Language, Data and Knowledge: Fifth Wor… [find](https://scholar.google.com/scholar?q=Priyobroto+Acharya%2C+Soham+Chaudhuri%2C+Sayan+Das%2C+Dipanjan+Saha%2C+and+Dipankar+Das%2E+2025%2E+Junlp%40+lt%2Dedi%2D2025%3A+Efficient+low%2Drank+adaptation+of+whisper+for+inclusive+tamil+speech+recognition+targeting+vul)
2. Maha Tufail Agro, Atharva Kulkarni, Karima Kadaoui, Zeerak Talat, and Hanan Aldarmaki. 2025. Code-switching in end-to-end automatic speech recognition: A systematic literature review. arXiv preprint arXiv:2507.07741. [find](https://scholar.google.com/scholar?q=Maha+Tufail+Agro%2C+Atharva+Kulkarni%2C+Karima+Kadaoui%2C+Zeerak+Talat%2C+and+Hanan+Aldarmaki%2E+2025%2E+Code%2Dswitching+in+end%2Dto%2Dend+automatic+speech+recognition%3A+A+systematic+literature+review%2E+arXiv+preprint+a)
3. Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick Von Platen, Yatharth Saraf, Juan Pino, and 1 others. 2021. [Xls-r: Self-supervised cross-lingual speech representation learning at scale](https://md.research.elamur.ai/free/en/papers/babu-2021-xls-r-self-supervised-cross/). arXiv preprint arXiv:2111.09296.
4. Érik Beltrán Lobato. 2025. Multilingual speech-to-speech machine translation. [find](https://scholar.google.com/scholar?q=%C3%89rik+Beltr%C3%A1n+Lobato%2E+2025%2E+Multilingual+speech%2Dto%2Dspeech+machine+translation%2E)
5. B. Bharathi, Bharathi Raja Chakravarthi, Shunmuga Priya Muthusamy Chinnan, S. Saranya, and S. Suhasini. 2026. Findings in Tamil Dialect Speech Recognition and Classification. In Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages. Association for Co… [find](https://scholar.google.com/scholar?q=B%2E+Bharathi%2C+Bharathi+Raja+Chakravarthi%2C+Shunmuga+Priya+Muthusamy+Chinnan%2C+S%2E+Saranya%2C+and+S%2E+Suhasini%2E+2026%2E+Findings+in+Tamil+Dialect+Speech+Recognition+and+Classification%2E+In+Proceedings+of+the+Six)
6. B Bharathi, S Saranya, P Vijayalakshmi, and T Nagarajan. 2025. Multi-dialect speech corpus creation for enhancing tamil automatic speech recognition. Circuits, Systems, and Signal Processing, pages 1–19. [find](https://scholar.google.com/scholar?q=B+Bharathi%2C+S+Saranya%2C+P+Vijayalakshmi%2C+and+T+Nagarajan%2E+2025%2E+Multi%2Ddialect+speech+corpus+creation+for+enhancing+tamil+automatic+speech+recognition%2E+Circuits%2C+Systems%2C+and+Signal+Processing%2C+pages+1%E2%80%93)
7. Dawit Ketema Gete, Bedru Yimam Ahmed, Tadesse Destaw Belay, Yohannes Ayana Ejigu, Sukairaj Hafiz Imam, Alemu Belay Tessema, Mohammed Oumer Adem, Tadesse Amare Belay, Robert Geislinger, Umma Aliyu Musa, and 1 others. 2025. [Whispering in amharic: Fine-tuning whisper for low-resource language](https://md.research.elamur.ai/free/en/papers/gete-2025-whispering-amharic-fine-tuning-whisper/). arXiv pr…
8. Tahir Javed, Kaushal Bhogale, Abhigyan Raman, Pratyush Kumar, Anoop Kunchukuttan, and Mitesh M Khapra. 2023. Indicsuperb: A speech processing universal performance benchmark for indian languages. In Proceedings of the AAAI conference on artificial intelligence, volume 37, pages 12942–12950. [find](https://scholar.google.com/scholar?q=Tahir+Javed%2C+Kaushal+Bhogale%2C+Abhigyan+Raman%2C+Pratyush+Kumar%2C+Anoop+Kunchukuttan%2C+and+Mitesh+M+Khapra%2E+2023%2E+Indicsuperb%3A+A+speech+processing+universal+performance+benchmark+for+indian+languages%2E+In+P)
9. Markus Miiller, Sebastian Stiiker, and Alex Waibel. 2018. Multilingual adaptation of rnn based asr systems. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 5219–5223. IEEE. [find](https://scholar.google.com/scholar?q=Markus+Miiller%2C+Sebastian+Stiiker%2C+and+Alex+Waibel%2E+2018%2E+Multilingual+adaptation+of+rnn+based+asr+systems%2E+In+2018+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing+%28ICASSP%29%2C+p)
10. Gowtham Papala, Aniket Ransing, and Pooja Jain. 2023. Sentiment analysis and speaker diarization in hindi and marathi using using finetuned whisper: sentiment analysis in hindi and marathi. Scalable Computing: Practice and Experience, 24(4):835–846. [find](https://scholar.google.com/scholar?q=Gowtham+Papala%2C+Aniket+Ransing%2C+and+Pooja+Jain%2E+2023%2E+Sentiment+analysis+and+speaker+diarization+in+hindi+and+marathi+using+using+finetuned+whisper%3A+sentiment+analysis+in+hindi+and+marathi%2E+Scalable+C)
11. Chandrika Prasad, Veenga Gode Swamy Rao, R China Appala Naidu, and 1 others. 2026. An asr transformer-based model for kannada speech-to-text transcription. Journal of Artificial Intelligence and Technology. [find](https://scholar.google.com/scholar?q=Chandrika+Prasad%2C+Veenga+Gode+Swamy+Rao%2C+R+China+Appala+Naidu%2C+and+1+others%2E+2026%2E+An+asr+transformer%2Dbased+model+for+kannada+speech%2Dto%2Dtext+transcription%2E+Journal+of+Artificial+Intelligence+and+Techn)
12. Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli. 2020. [wav2vec 2.0: A framework for self-supervised learning of speech representations](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/). Advances in neural information processing systems, 33:12449–12460.
13. Xabier de Zuazo, Eva Navas, Ibon Saratxaga, and Inma Hernáez Rioja. 2025. Whisper-lm: Improving asr models with language models for low-resource languages. arXiv preprint arXiv:2503.23542. — [arXiv:2503.23542](https://arxiv.org/abs/2503.23542) [find](https://scholar.google.com/scholar?q=Xabier+de+Zuazo%2C+Eva+Navas%2C+Ibon+Saratxaga%2C+and+Inma+Hern%C3%A1ez+Rioja%2E+2025%2E+Whisper%2Dlm%3A+Improving+asr+models+with+language+models+for+low%2Dresource+languages%2E+arXiv+preprint+arXiv%3A2503%2E23542%2E+%E2%80%94+%5BarXiv%3A25)
14. Yunpeng Liu, Xukui Yang, and Dan Qu. 2024. Exploration of whisper fine-tuning strategies for low-resource asr. EURASIP Journal on Audio, Speech, and Music Processing, 2024(1):29. [find](https://scholar.google.com/scholar?q=Yunpeng+Liu%2C+Xukui+Yang%2C+and+Dan+Qu%2E+2024%2E+Exploration+of+whisper+fine%2Dtuning+strategies+for+low%2Dresource+asr%2E+EURASIP+Journal+on+Audio%2C+Speech%2C+and+Music+Processing%2C+2024%281%29%3A29%2E)
15. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. [Robust speech recognition via large-scale weak supervision](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/). In International conference on machine learning, pages 28492–28518. PMLR.
16. Frederick Riemenschneider and Anette Frank. 2025. Cross-lingual generalization and compression: from language-specific to shared neurons. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13470–13491. [find](https://scholar.google.com/scholar?q=Frederick+Riemenschneider+and+Anette+Frank%2E+2025%2E+Cross%2Dlingual+generalization+and+compression%3A+from+language%2Dspecific+to+shared+neurons%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+f)
17. S Saranya, B Bharathi, S Gomathy Dhanya, and Aishwarya Krishnakumar. 2025. Real-time continuous tamil dialect speech recognition and summarization. Circuits, Systems, and Signal Processing, 44(4):2855– 2881. [find](https://scholar.google.com/scholar?q=S+Saranya%2C+B+Bharathi%2C+S+Gomathy+Dhanya%2C+and+Aishwarya+Krishnakumar%2E+2025%2E+Real%2Dtime+continuous+tamil+dialect+speech+recognition+and+summarization%2E+Circuits%2C+Systems%2C+and+Signal+Processing%2C+44%284%29%3A2855)
18. Sanket Shah, Kavya Ranjan Saxena, Kancha-rana Manideep Bharadwaj, Sharath Adavanne, and Nagaraj Adiga. 2025. Indicst: Indian multilingual translation corpus for evaluating speech large language models. In 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASS… [find](https://scholar.google.com/scholar?q=Sanket+Shah%2C+Kavya+Ranjan+Saxena%2C+Kancha%2Drana+Manideep+Bharadwaj%2C+Sharath+Adavanne%2C+and+Nagaraj+Adiga%2E+2025%2E+Indicst%3A+Indian+multilingual+translation+corpus+for+evaluating+speech+large+language+models)
19. Suwon Shon, Ahmed Ali, and James Glass. 2018. Convolutional neural networks and language embeddings for end-to-end dialect recognition. arXiv preprint arXiv:1803.04567. — [arXiv:1803.04567](https://arxiv.org/abs/1803.04567) [find](https://scholar.google.com/scholar?q=Suwon+Shon%2C+Ahmed+Ali%2C+and+James+Glass%2E+2018%2E+Convolutional+neural+networks+and+language+embeddings+for+end%2Dto%2Dend+dialect+recognition%2E+arXiv+preprint+arXiv%3A1803%2E04567%2E+%E2%80%94+%5BarXiv%3A1803%2E04567%5D%28https%3A%2F%2Far)
20. Xuchen Wei, Yangxin Wu, Yaoyin Zhang, Henglyu Liu, Kehai Chen, Xuefeng Bai, and Min Zhang. 2025. Hitsz’s end-to-end speech translation systems combining sequence-to-sequence auto speech recognition model and indic large language model for iwslt 2025 in indic track. In Proceedings of the 22nd Interna… [find](https://scholar.google.com/scholar?q=Xuchen+Wei%2C+Yangxin+Wu%2C+Yaoyin+Zhang%2C+Henglyu+Liu%2C+Kehai+Chen%2C+Xuefeng+Bai%2C+and+Min+Zhang%2E+2025%2E+Hitsz%E2%80%99s+end%2Dto%2Dend+speech+translation+systems+combining+sequence%2Dto%2Dsequence+auto+speech+recognition+mo)
21. Jiqiao Zhang and Degen Huang. 2025. Speech recognition for low-resource languages using large language models and related-language data. In International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2025), volume 13664, pages 1264–1269. SPIE. [find](https://scholar.google.com/scholar?q=Jiqiao+Zhang+and+Degen+Huang%2E+2025%2E+Speech+recognition+for+low%2Dresource+languages+using+large+language+models+and+related%2Dlanguage+data%2E+In+International+Conference+on+Image%2C+Signal+Processing%2C+and+Pa)

*Updated 31 October 2026*