---
title: "CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech — Yan 2026"
description: "The authors build CS-YODAS, a Creative Commons resource of spontaneous code-switched speech taken from YouTube audio in the cleaned YODAS… 30 references."
authors: ["Brian Yan", "Qingzheng Wang", "Matthew Wiesner", "Anuj Diwan", "Olga Iakovenko", "Alex Polok", "Injy Hamed", "Shuichiro Shimizu", "Iris Emerman", "Thomas Hain", "David R. Mortensen", "Peter Viechnicki", "Shinji Watanabe"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.456/"
doi: "10.63317/3fir5kp98qyt"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yan-2026-cs-yodas-mined-dataset-wild/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yan-2026-cs-yodas-mined-dataset-wild/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/) / CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech

# CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech

**Authors:** Brian Yan, Qingzheng Wang, Matthew Wiesner, Anuj Diwan, Olga Iakovenko, Alex Polok, [Injy Hamed](https://md.research.elamur.ai/free/en/authors/injy-hamed/), Shuichiro Shimizu, Iris Emerman, [Thomas Hain](https://md.research.elamur.ai/free/en/authors/thomas-hain/), [David R. Mortensen](https://md.research.elamur.ai/free/en/authors/david-r-mortensen/), Peter Viechnicki and [Shinji Watanabe](https://md.research.elamur.ai/free/en/authors/shinji-watanabe/) · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.456/) · [PDF](https://aclanthology.org/2026.lrec-1.456.pdf) · [DOI 10.63317/3fir5kp98qyt](https://doi.org/10.63317/3fir5kp98qyt) · [OpenAlex](https://openalex.org/W7160057849)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Large multilingual speech corpora usually tag each utterance with one language and filter out mixed-language material. As a result, natural code-switching (CS) is scarce in training data, and existing CS speech sets tend to be small, tied to one domain, elicited, or synthetic. The authors build CS-YODAS, a Creative Commons resource of spontaneous code-switched speech taken from YouTube audio in the cleaned YODAS corpus used by OWSM v4.

Their mining pipeline has two stages:
- **Candidate detection:** an LLM (Qwen3-14B) reads each transcript and lists the languages it finds. Lines with two or more languages become candidates.
- **Validation:** bilingual volunteers answer five questions about sample segments. Their answers then serve as in-context examples so the LLM can screen every candidate the same way. This removes common false alarms such as transcript errors, proper nouns and cognates.

Validation lifts precision from 18% to 70%. The release keeps 15 seconds of surrounding audio around each switch so researchers can study the context in which switching happens. Baseline experiments on spoken language identification suggest synthetic CS data cannot yet replace real recordings.

## Key points
- **Size and languages:** about 313 hours (312.7 h) of contextual audio across 7 matrix languages: Arabic, Mandarin Chinese, Czech, French, Hindi, Japanese and Russian. It is available on Hugging Face as `byan/cs-yodas`.
- **Source corpus:** the cleaned YODAS from OWSM v4, which holds 166k hours in 75 languages.
- **Precision gain:** human-guided LLM validation raised precision from 18% (700 mine_iter0 samples) to 70% (120 mine_iter1 samples). Hindi reached 82.9%, Chinese 76.9% and Arabic 55.2%, while Japanese and Russian yielded few true positives.
- **Share of switching:** only 37.3 h (11.9%) of the audio is intra-sentential CS. French supplies most of the data (273.7 h), and Hindi has the highest CS rate (29.7%).
- **LID baseline:** accuracy on CS-FLEURS READ stays at zero until the model has more than 5 hours of CS-YODAS training data.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cite

Cite as: Brian Yan, Qingzheng Wang, Matthew Wiesner, Anuj Diwan, Olga Iakovenko, Alex Polok, Injy Hamed, Shuichiro Shimizu, Iris Emerman, Thomas Hain, David R. Mortensen, Peter Viechnicki and Shinji Watanabe. 2026. CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech. Proceedings of the Fifteenth Language Resources and Evaluation Conference.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yan2026cs,
  title = {{CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech}},
  author = {Brian Yan, Qingzheng Wang, Matthew Wiesner, Anuj Diwan, Olga Iakovenko, Alex Polok, Injy Hamed, Shuichiro Shimizu, Iris Emerman, Thomas Hain, David R. Mortensen, Peter Viechnicki and Shinji Watanabe},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/3fir5kp98qyt},
  url = {https://doi.org/10.63317/3fir5kp98qyt}
}
```

- [← previous Crowdsourcing Piedmontese to Test LLMs on Non-Standard Orthography](https://md.research.elamur.ai/free/en/papers/vico-2026-crowdsourcing-piedmontese-test-llms-non/)
- [next → Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation](https://md.research.elamur.ai/free/en/papers/xu-2026-cultural-knowledge-biases-llms-through/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/)

## References

30 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Rosana Ardila, Megan Branson, Kelly Davis, Michael Kohler, Josh Meyer, Michael Henretty, Reuben Morais, Lindsay Saunders, Francis Tyers, and Gregor Weber. 2020. Common Voice: A massively-multilingual speech corpus. In Proc. LREC, pages 4218–4222. [our card](https://md.research.elamur.ai/free/en/papers/ardila-2019-common-voice-massively-multilingual-speech/)
2. Laurie Burchell, Alexandra Birch, Robert P Thompson, and Kenneth Heafield. 2024. Code-switched language identification is harder than you think. arXiv preprint arXiv:2402.01505. [find](https://scholar.google.com/scholar?q=Laurie+Burchell%2C+Alexandra+Birch%2C+Robert+P+Thompson%2C+and+Kenneth+Heafield%2E+2024%2E+Code%2Dswitched+language+identification+is+harder+than+you+think%2E+arXiv+preprint+arXiv%3A2402%2E01505%2E)
3. Shammur Absar Chowdhury, Amir Hussein, Ahmed Abdelali, and Ahmed Ali. 2021. Towards one model to rule all: Multilingual strategy for dialectal code-switching Arabic ASR. In Proc. Interspeech, pages 2466–2470. [our card](https://md.research.elamur.ai/free/en/papers/chowdhury-2021-towards-one-model-rule-all/)
4. Alexis Conneau, Min Ma, Simran Khanuja, Yu Zhang, Vera Axelrod, Siddharth Dalmia, Jason Riesa, Clara Rivera, and Ankur Bapna. 2023. FLEURS: Few-shot learning evaluation of universal representations of speech. In Proc. IEEE SLT, pages 798–805. [our card](https://md.research.elamur.ai/free/en/papers/conneau-2022-fleurs-few-shot-learning-evaluation/)
5. Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. 2019. ArcFace: Additive angular margin loss for deep face recognition. In Proc. CVPR. [find](https://scholar.google.com/scholar?q=Jiankang+Deng%2C+Jia+Guo%2C+Niannan+Xue%2C+and+Stefanos+Zafeiriou%2E+2019%2E+ArcFace%3A+Additive+angular+margin+loss+for+deep+face+recognition%2E+In+Proc%2E+CVPR%2E)
6. Brecht Desplanques, Jenthe Thienpondt, and Kris Demuynck. 2020. ECAPA-TDNN: Emphasized channel attention, propagation and aggregation in TDNN based speaker verification. In Proc. Interspeech, pages 3830–3834. [find](https://scholar.google.com/scholar?q=Brecht+Desplanques%2C+Jenthe+Thienpondt%2C+and+Kris+Demuynck%2E+2020%2E+ECAPA%2DTDNN%3A+Emphasized+channel+attention%2C+propagation+and+aggregation+in+TDNN+based+speaker+verification%2E+In+Proc%2E+Interspeech%2C+pages+38)
7. Margaret Deuchar, Peredur Davies, Jon Herring, M Carmen Parafita Couto, and Diana Carter. 2014. Building bilingual corpora. Advances in the Study of Bilingualism, pages 93–111. [find](https://scholar.google.com/scholar?q=Margaret+Deuchar%2C+Peredur+Davies%2C+Jon+Herring%2C+M+Carmen+Parafita+Couto%2C+and+Diana+Carter%2E+2014%2E+Building+bilingual+corpora%2E+Advances+in+the+Study+of+Bilingualism%2C+pages+93%E2%80%93111%2E)
8. Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanava… [find](https://scholar.google.com/scholar?q=Anuj+Diwan%2C+Rakesh+Vaideeswaran%2C+Sanket+Shah%2C+Ankita+Singh%2C+Srinivasa+Raghavan%2C+Shreya+Khare%2C+Vinit+Unni%2C+Saurabh+Vyas%2C+Akash+Rajpuria%2C+Chiranjeevi+Yarra%2C+Ashish+Mittal%2C+Prasanta+Kumar+Ghosh%2C+Preethi+)
9. MUCS 2021: Multilingual and code-switching ASR challenges for low resource Indian languages. In Proc. Interspeech, pages 2446–2450. [find](https://scholar.google.com/scholar?q=MUCS+2021%3A+Multilingual+and+code%2Dswitching+ASR+challenges+for+low+resource+Indian+languages%2E+In+Proc%2E+Interspeech%2C+pages+2446%E2%80%932450%2E)
10. Injy Hamed, Nizar Habash, Slim Abdennadher, and Ngoc Thang Vu. 2022. ArzEn-ST: A three-way speech translation corpus for code-switched Egyptian Arabic-English. In Proc. WANLP, pages 119–130. [find](https://scholar.google.com/scholar?q=Injy+Hamed%2C+Nizar+Habash%2C+Slim+Abdennadher%2C+and+Ngoc+Thang+Vu%2E+2022%2E+ArzEn%2DST%3A+A+three%2Dway+speech+translation+corpus+for+code%2Dswitched+Egyptian+Arabic%2DEnglish%2E+In+Proc%2E+WANLP%2C+pages+119%E2%80%93130%2E)
11. Amir Hussein, Dorsa Zeinali, Ondřej Klejch, Matthew Wiesner, Brian Yan, Shammur Chowdhury, Ahmed Ali, Shinji Watanabe, and Sanjeev Khudanpur. 2024. Speech collage: code-switched audio generation by collaging monolingual corpora. In Proc. ICASSP, pages 12006– 12010. [find](https://scholar.google.com/scholar?q=Amir+Hussein%2C+Dorsa+Zeinali%2C+Ond%C5%99ej+Klejch%2C+Matthew+Wiesner%2C+Brian+Yan%2C+Shammur+Chowdhury%2C+Ahmed+Ali%2C+Shinji+Watanabe%2C+and+Sanjeev+Khudanpur%2E+2024%2E+Speech+collage%3A+code%2Dswitched+audio+generation+by+co)
12. Fei Jia, Nithin Rao Koluguri, Jagadeesh Balam, and Boris Ginsburg. 2023. A compact end-to-end model with local and global context for spoken language identification. In Proc. Interspeech, pages 5321–5325. [find](https://scholar.google.com/scholar?q=Fei+Jia%2C+Nithin+Rao+Koluguri%2C+Jagadeesh+Balam%2C+and+Boris+Ginsburg%2E+2023%2E+A+compact+end%2Dto%2Dend+model+with+local+and+global+context+for+spoken+language+identification%2E+In+Proc%2E+Interspeech%2C+pages+5321%E2%80%935)
13. Jee-weon Jung, Wangyou Zhang, Jiatong Shi, Zakaria Aldeneh, Takuya Higuchi, Barry-John Theobald, Ahmed Hussen Abdelaziz, and Shinji Watanabe. 2024. ESPnet-SPK: Full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models. arXiv preprint arXi… — [arXiv:2401.17230](https://arxiv.org/abs/2401.17230) [find](https://scholar.google.com/scholar?q=Jee%2Dweon+Jung%2C+Wangyou+Zhang%2C+Jiatong+Shi%2C+Zakaria+Aldeneh%2C+Takuya+Higuchi%2C+Barry%2DJohn+Theobald%2C+Ahmed+Hussen+Abdelaziz%2C+and+Shinji+Watanabe%2E+2024%2E+ESPnet%2DSPK%3A+Full+pipeline+speaker+embedding+toolkit+)
14. Jacob Kahn, Morgane Riviere, Weiyi Zheng, Evgeny Kharitonov, Qiantong Xu, Pierre-Emmanuel Mazaré, Julien Karadayi, Vitaliy Liptchinsky, Ronan Collobert, Christian Fuegen, et al. 2020. Libri-Light: A benchmark for ASR with limited or no supervision. In Proc. ICASSP, pages 7669–7673. [find](https://scholar.google.com/scholar?q=Jacob+Kahn%2C+Morgane+Riviere%2C+Weiyi+Zheng%2C+Evgeny+Kharitonov%2C+Qiantong+Xu%2C+Pierre%2DEmmanuel+Mazar%C3%A9%2C+Julien+Karadayi%2C+Vitaliy+Liptchinsky%2C+Ronan+Collobert%2C+Christian+Fuegen%2C+et+al%2E+2020%2E+Libri%2DLight%3A+A+b)
15. Shuyue Stella Li, Cihan Xiao, Tianjian Li, and Bismarck Odoom. 2023a. Simple yet effective code-switching language identification with multitask pre-training and transfer learning. arXiv preprint arXiv:2305.19759. — [arXiv:2305.19759](https://arxiv.org/abs/2305.19759) [find](https://scholar.google.com/scholar?q=Shuyue+Stella+Li%2C+Cihan+Xiao%2C+Tianjian+Li%2C+and+Bismarck+Odoom%2E+2023a%2E+Simple+yet+effective+code%2Dswitching+language+identification+with+multitask+pre%2Dtraining+and+transfer+learning%2E+arXiv+preprint+arXi)
16. Xinjian Li, Shinnosuke Takamichi, Takaaki Saeki, William Chen, Sayaka Shiota, and Shinji Watanabe. 2023b. YODAS: YouTube-oriented dataset for audio and speech. In Proc. IEEE ASRU, pages 1–8. [find](https://scholar.google.com/scholar?q=Xinjian+Li%2C+Shinnosuke+Takamichi%2C+Takaaki+Saeki%2C+William+Chen%2C+Sayaka+Shiota%2C+and+Shinji+Watanabe%2E+2023b%2E+YODAS%3A+YouTube%2Doriented+dataset+for+audio+and+speech%2E+In+Proc%2E+IEEE+ASRU%2C+pages+1%E2%80%938%2E)
17. Dau-Cheng Lyu, Tien Ping Tan, Engsiong Chng, and Haizhou Li. 2010. SEAME: a mandarin-english code-switching speech corpus in southeast asia. In Proc. Interspeech, pages 1986– 1989. [find](https://scholar.google.com/scholar?q=Dau%2DCheng+Lyu%2C+Tien+Ping+Tan%2C+Engsiong+Chng%2C+and+Haizhou+Li%2E+2010%2E+SEAME%3A+a+mandarin%2Denglish+code%2Dswitching+speech+corpus+in+southeast+asia%2E+In+Proc%2E+Interspeech%2C+pages+1986%E2%80%93+1989%2E)
18. C. Myers-Scotton. 1993. Duelling Languages: Grammatical Structure in Codeswitching. Clarendon Press. [find](https://scholar.google.com/scholar?q=C%2E+Myers%2DScotton%2E+1993%2E+Duelling+Languages%3A+Grammatical+Structure+in+Codeswitching%2E+Clarendon+Press%2E)
19. Puyuan Peng, Brian Yan, Shinji Watanabe, and David Harwath. 2023. Prompting the hidden talent of web-scale speech models for zero-shot task generalization. In Proc. Interspeech, pages 396–400. [find](https://scholar.google.com/scholar?q=Puyuan+Peng%2C+Brian+Yan%2C+Shinji+Watanabe%2C+and+David+Harwath%2E+2023%2E+Prompting+the+hidden+talent+of+web%2Dscale+speech+models+for+zero%2Dshot+task+generalization%2E+In+Proc%2E+Interspeech%2C+pages+396%E2%80%93400%2E)
20. Yifan Peng, Shakeel Muhammad, Yui Sudo, William Chen, Jinchuan Tian, Chyi-Jiunn Lin, and Shinji Watanabe. 2025. OWSM v4: Improving open Whisper-style speech models via data scaling and cleaning. Proc. Interspeech, pages 2225– 2229. [find](https://scholar.google.com/scholar?q=Yifan+Peng%2C+Shakeel+Muhammad%2C+Yui+Sudo%2C+William+Chen%2C+Jinchuan+Tian%2C+Chyi%2DJiunn+Lin%2C+and+Shinji+Watanabe%2E+2025%2E+OWSM+v4%3A+Improving+open+Whisper%2Dstyle+speech+models+via+data+scaling+and+cleaning%2E+Proc%2E)
21. Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, et al. 2024. Scaling speech technology to 1,000+ languages. Journal of Machine Learning Research, pages 1–52. [our card](https://md.research.elamur.ai/free/en/papers/pratap-2023-scaling-speech-technology-1-000/)
22. Vineel Pratap, Qiantong Xu, Anuroop Sriram, Gabriel Synnaeve, and Ronan Collobert. 2020. MLS: A large-scale multilingual dataset for speech research. In Proc. Interspeech, pages 2757–2761. [our card](https://md.research.elamur.ai/free/en/papers/pratap-2020-mls-large-scale-multilingual-dataset/)
23. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. In Proc. ICML, pages 28492– 28518. [our card](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/)
24. Pradeep Rangan, Sundeep Teki, and Hemant Misra. 2020. Exploiting spectral augmentation for code-switched spoken language identification. arXiv preprint arXiv:2010.07130. — [arXiv:2010.07130](https://arxiv.org/abs/2010.07130) [find](https://scholar.google.com/scholar?q=Pradeep+Rangan%2C+Sundeep+Teki%2C+and+Hemant+Misra%2E+2020%2E+Exploiting+spectral+augmentation+for+code%2Dswitched+spoken+language+identification%2E+arXiv+preprint+arXiv%3A2010%2E07130%2E+%E2%80%94+%5BarXiv%3A2010%2E07130%5D%28https%3A%2F%2Fa)
25. Jörgen Valk and Tanel Alumäe. 2021. VoxLingua107: a dataset for spoken language recognition. In Proc. IEEE SLT, pages 652–658. [find](https://scholar.google.com/scholar?q=J%C3%B6rgen+Valk+and+Tanel+Alum%C3%A4e%2E+2021%2E+VoxLingua107%3A+a+dataset+for+spoken+language+recognition%2E+In+Proc%2E+IEEE+SLT%2C+pages+652%E2%80%93658%2E)
26. Ewald van der Westhuizen and Thomas Niesler. 2018. A first south African corpus of multilingual code-switched soap opera speech. In Proc. LREC. [find](https://scholar.google.com/scholar?q=Ewald+van+der+Westhuizen+and+Thomas+Niesler%2E+2018%2E+A+first+south+African+corpus+of+multilingual+code%2Dswitched+soap+opera+speech%2E+In+Proc%2E+LREC%2E)
27. Changhan Wang, Morgane Riviere, Ann Lee, Anne Wu, Chaitanya Talnikar, Daniel Haziza, Mary Williamson, Juan Pino, and Emmanuel Dupoux. 2021. VoxPopuli: A large-scale multilingual speech corpus for representation learning, semi-supervised learning and interpretation. In Proc. ACL-IJCNLP. [our card](https://md.research.elamur.ai/free/en/papers/wang-2021-voxpopuli-large-scale-multilingual-speech/)
28. Qingzheng Wang, Hye-jin Shim, Jiancheng Sun, and Shinji Watanabe. 2025. Geolocation-aware robust spoken language identification. In Proc. IEEE ASRU. [find](https://scholar.google.com/scholar?q=Qingzheng+Wang%2C+Hye%2Djin+Shim%2C+Jiancheng+Sun%2C+and+Shinji+Watanabe%2E+2025%2E+Geolocation%2Daware+robust+spoken+language+identification%2E+In+Proc%2E+IEEE+ASRU%2E)
29. Brian Yan, Injy Hamed, Shuichiro Shimizu, Vasista Sai Lodagala, William Chen, Olga Iakovenko, Bashar Talafha, Amir Hussein, Alexander Polok, Kalvin Chang, et al. 2025. CS-FLEURS: A massively multilingual and code-switched speech dataset. In Proc. Interspeech, pages 743–747. [find](https://scholar.google.com/scholar?q=Brian+Yan%2C+Injy+Hamed%2C+Shuichiro+Shimizu%2C+Vasista+Sai+Lodagala%2C+William+Chen%2C+Olga+Iakovenko%2C+Bashar+Talafha%2C+Amir+Hussein%2C+Alexander+Polok%2C+Kalvin+Chang%2C+et+al%2E+2025%2E+CS%2DFLEURS%3A+A+massively+multiling)
30. Miao Zhao, Yufeng Ma, Min Liu, and Minqiang Xu. 2021. The SpeakIn system for VoxCeleb speaker recognition challenge 2021. arXiv preprint arXiv:2109.01989. — [arXiv:2109.01989](https://arxiv.org/abs/2109.01989) [find](https://scholar.google.com/scholar?q=Miao+Zhao%2C+Yufeng+Ma%2C+Min+Liu%2C+and+Minqiang+Xu%2E+2021%2E+The+SpeakIn+system+for+VoxCeleb+speaker+recognition+challenge+2021%2E+arXiv+preprint+arXiv%3A2109%2E01989%2E+%E2%80%94+%5BarXiv%3A2109%2E01989%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F21)