---
title: "Thesis Proposal — paper by Zheng and Xiong (2026)"
description: "Square Bai Script (Fangkuai Baiwen) is derived from Chinese characters. 37 references. Among them: 0."
authors: ["Jingting Zheng", "Deyi Xiong"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)"
source: "https://aclanthology.org/2026.acl-srw.43/"
doi: "10.18653/v1/2026.acl-srw.43"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zheng-2026-thesis-proposal-diagnosing-mitigating-semantic/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zheng-2026-thesis-proposal-diagnosing-mitigating-semantic/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/53/) / Thesis Proposal: Diagnosing and Mitigating Semantic Interference in Script-Sharing Low-Resource Language Models: A Case Study on Square Bai Script

# Thesis Proposal: Diagnosing and Mitigating Semantic Interference in Script-Sharing Low-Resource Language Models: A Case Study on Square Bai Script

**Authors:** [Jingting Zheng](https://md.research.elamur.ai/free/en/authors/jingting-zheng/) and [Deyi Xiong](https://md.research.elamur.ai/free/en/authors/deyi-xiong/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-srw.43/) · [PDF](https://aclanthology.org/2026.acl-srw.43.pdf) · [DOI 10.18653/v1/2026.acl-srw.43](https://doi.org/10.18653/v1/2026.acl-srw.43) · [OpenAlex](https://openalex.org/W7166836082)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary

Square Bai Script (Fangkuai Baiwen) is derived from Chinese characters. Many of its glyphs look like, or are identical to, Chinese ones but mean something different. Models with strong Chinese knowledge therefore tend to read Bai text through Chinese senses. The authors call this semantic interference. It shows up as substituted senses, Chinese leaking into output and inconsistent disambiguation. This thesis proposal argues that current adaptation pipelines struggle with Bai because they assume visible glyph overlap transfers safely, not only because data is scarce.

Three studies are planned:
- diagnosing interference against matched non-shared controls;
- comparing adaptation strategies on a modest compute budget, such as prompting with lexical support, tokenizer and vocabulary controls, continued pretraining and PEFT;
- mapping when overlap helps or harms, while tracking Chinese retention.

As a proposal, it reports no final results. Its value is in treating script overlap as a conditional variable to be measured and in building audited resources for an underserved written minority language.

## Key points

- **Main corpus:** The Dabenqu corpus has 28,382 Bai–Chinese sentence pairs, validated by experts, and is the main supervised data.
- **Out-of-domain test:** A small Shanhuabei epigraphic set (about 80 items, including roof-tile inscriptions) is reserved for stress testing. A versioned PUA-based glyph encoding and normalization pipeline is also in place.
- **Planned benchmark:** BaiBench will provide fixed splits, diagnostic strata and minimal contrast sets, plus a Chinese retention suite.
- **Experimental setup:** Experiments center on trainable sub-1B models with parameter-efficient updates, using a 0.6B backbone (Qwen3 offers this size). Translation is the primary task, and synthetic data is only an optional late extension.
- **Timeline:** Data auditing and the first version of BaiBench are scheduled for 2026 Q2–Q3, and the main Study III experiments for 2026 Q4–2027 Q1. Raw data that cannot be redistributed will be replaced by released derived artifacts.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Tianjin University](https://md.research.elamur.ai/free/en/universities/tianjin-university/) — University, Tianjin, China · 52 works · 1,128 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works · [🌱 Low-resource languages](https://md.research.elamur.ai/free/en/topics/low-resource-languages/) · 287 works

## Cite

Cite as: Jingting Zheng and Deyi Xiong. 2026. Thesis Proposal: Diagnosing and Mitigating Semantic Interference in Script-Sharing Low-Resource Language Models: A Case Study on Square Bai Script. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zheng2026thesis,
  title = {{Thesis Proposal: Diagnosing and Mitigating Semantic Interference in Script-Sharing Low-Resource Language Models: A Case Study on Square Bai Script}},
  author = {Jingting Zheng and Deyi Xiong},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-srw.43},
  url = {https://doi.org/10.18653/v1/2026.acl-srw.43}
}
```

- [← previous Thesis Proposal: A Normalization-First Framework for Sound, Complete, and Utility-Ready Open Information Extraction](https://md.research.elamur.ai/free/en/papers/prakash-2026-thesis-proposal-normalization-first-framework/)
- [next → Thesis Proposal: Efficient KV Cache Reuse for Multi-Document Retrieval-Augmented Generation](https://md.research.elamur.ai/free/en/papers/zhang-2026-thesis-proposal-efficient-kv-cache/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/53/)

## References

37 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Belen Alastruey, João Maria Janeiro, Alexandre Allauzen, Maha Elbayad, Loïc Barrault, and Marta R. Costa-jussà. 2025. Interference matrix: Quantifying cross-lingual interference in transformer encoders. arXiv preprint arXiv:2508.02256. — [arXiv:2508.02256](https://arxiv.org/abs/2508.02256) [find](https://scholar.google.com/scholar?q=Belen+Alastruey%2C+Jo%C3%A3o+Maria+Janeiro%2C+Alexandre+Allauzen%2C+Maha+Elbayad%2C+Lo%C3%AFc+Barrault%2C+and+Marta+R%2E+Costa%2Djuss%C3%A0%2E+2025%2E+Interference+matrix%3A+Quantifying+cross%2Dlingual+interference+in+transformer+encoder)
2. Tyler A. Chang, Catherine Arnett, Zhuowen Tu, and Benjamin K. Bergen. 2024. Goldfish: Monolingual language models for 350 languages. arXiv preprint arXiv:2408.10441. [find](https://scholar.google.com/scholar?q=Tyler+A%2E+Chang%2C+Catherine+Arnett%2C+Zhuowen+Tu%2C+and+Benjamin+K%2E+Bergen%2E+2024%2E+Goldfish%3A+Monolingual+language+models+for+350+languages%2E+arXiv+preprint+arXiv%3A2408%2E10441%2E)
3. Jiale Chen, Xuelian Dong, Qihao Yang, Wenxiu Xie, and Tianyong Hao. 2025. Can large language models translate spoken-only languages through international phonetic transcription? In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 23420–23435, Suzhou, Chin… [find](https://scholar.google.com/scholar?q=Jiale+Chen%2C+Xuelian+Dong%2C+Qihao+Yang%2C+Wenxiu+Xie%2C+and+Tianyong+Hao%2E+2025%2E+Can+large+language+models+translate+spoken%2Donly+languages+through+international+phonetic+transcription%3F+In+Proceedings+of+the+)
4. Jonathan H. Clark, Dan Garrette, Iulia Turc, and John Wieting. 2022. [Canine: Pre-training an efficient tokenization-free encoder for language representation](https://md.research.elamur.ai/free/en/papers/clark-2022-canine-pre-training-efficient-tokenization/). Transactions of the Association for Computational Linguistics, 10:73–91.
5. John Dang, Shivalika Singh, Daniel D’souza, Arash Ahmadian, Alejandro Salamanca, Madeline Smith, Aidan Peppin, Sungjin Hong, Manoj Govindassamy, Terrence Zhao, Sandra Kublik, Meor Amer, Viraat Aryabumi, Jon Ander Campos, Yi-Chern Tan, Tom Kocmi, Florian Strub, Nathan Grinsztajn, Yannis Flet-Berliac,… — [Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier](https://md.research.elamur.ai/free/en/papers/dang-2024-aya-expanse-combining-research-breakthroughs/)
6. Ona de Gibert, Joseph Attieh, Teemu Vahtola, Mikko Aulamo, Zihao Li, Raúl Vázquez, Tiancheng Hu, and Jörg Tiedemann. 2025. [Scaling low-resource MT via synthetic data generation with LLMs](https://md.research.elamur.ai/free/en/papers/gibert-2025-scaling-low-resource-mt-synthetic/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 27674–27692, Su…
7. Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. [QLoRA: Efficient finetuning of quantized LLMs](https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/). In Advances in Neural Information Processing Systems.
8. Peter Devine, Mardhiyah Sanni, Farid Adilazuarda, Julieta Gil Loizaga, and Barry Haddow. 2026. Kakugo: Distillation of low-resource languages into small language models. arXiv preprint arXiv:2601.14051. [find](https://scholar.google.com/scholar?q=Peter+Devine%2C+Mardhiyah+Sanni%2C+Farid+Adilazuarda%2C+Julieta+Gil+Loizaga%2C+and+Barry+Haddow%2E+2026%2E+Kakugo%3A+Distillation+of+low%2Dresource+languages+into+small+language+models%2E+arXiv+preprint+arXiv%3A2601%2E1405)
9. Tianyu Dong, Bo Li, Jinsong Liu, Shaolin Zhu, and Deyi Xiong. 2025. MLAS-LoRA: Language-aware parameters detection and LoRA-based knowledge transfer for multilingual machine translation. In Proceedings of the 63rd Annual Meeting of the Association for Benedikt Ebing, Lennart Keller, and Goran Glavaš… [find](https://scholar.google.com/scholar?q=Tianyu+Dong%2C+Bo+Li%2C+Jinsong+Liu%2C+Shaolin+Zhu%2C+and+Deyi+Xiong%2E+2025%2E+MLAS%2DLoRA%3A+Language%2Daware+parameters+detection+and+LoRA%2Dbased+knowledge+transfer+for+multilingual+machine+translation%2E+In+Proceeding)
10. Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020. Don’t stop pretraining: Adapt language models to domains and tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8342–8360, Online. A… [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Ana+Marasovic%CC%81%2C+Swabha+Swayamdipta%2C+Kyle+Lo%2C+Iz+Beltagy%2C+Doug+Downey%2C+and+Noah+A%2E+Smith%2E+2020%2E+Don%E2%80%99t+stop+pretraining%3A+Adapt+language+models+to+domains+and+tasks%2E+In+Proceedings+of+)
11. Edward J Hu, yelong shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. [LoRA: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). In International Conference on Learning Representations.
12. Jaavid Aktar Husain, Raj Dabre, Aswanth Kumar, Jay Gala, Thanmay Jayakumar, Ratish Puduppully, and Anoop Kunchukuttan. 2024. RomanSetu: Efficiently unlocking multilingual capabilities of large language models via romanization. In Proceedings of the 62nd Annual Meeting of the Association for Computat… [find](https://scholar.google.com/scholar?q=Jaavid+Aktar+Husain%2C+Raj+Dabre%2C+Aswanth+Kumar%2C+Jay+Gala%2C+Thanmay+Jayakumar%2C+Ratish+Puduppully%2C+and+Anoop+Kunchukuttan%2E+2024%2E+RomanSetu%3A+Efficiently+unlocking+multilingual+capabilities+of+large+languag)
13. Renren Jin and Deyi Xiong. 2022. Informative language representation learning for massively multilingual neural machine translation. In Proceedings of the 29th International Conference on Computational Linguistics, pages 5158–5174, Gyeongju, Republic of Korea. International Committee on Computationa… [find](https://scholar.google.com/scholar?q=Renren+Jin+and+Deyi+Xiong%2E+2022%2E+Informative+language+representation+learning+for+massively+multilingual+neural+machine+translation%2E+In+Proceedings+of+the+29th+International+Conference+on+Computationa)
14. Julie Kallini, Dan Jurafsky, Christopher Potts, and Martijn Bartelds. 2025. False friends are not foes: Investigating vocabulary overlap in multilingual language models. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 21138–21154, Suzhou, China. Association for Comput… [find](https://scholar.google.com/scholar?q=Julie+Kallini%2C+Dan+Jurafsky%2C+Christopher+Potts%2C+and+Martijn+Bartelds%2E+2025%2E+False+friends+are+not+foes%3A+Investigating+vocabulary+overlap+in+multilingual+language+models%2E+In+Findings+of+the+Association)
15. Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, and Nicholas Carlini. 2022. Deduplicating training data makes language models better. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers),… [find](https://scholar.google.com/scholar?q=Katherine+Lee%2C+Daphne+Ippolito%2C+Andrew+Nystrom%2C+Chiyuan+Zhang%2C+Douglas+Eck%2C+Chris+Callison%2DBurch%2C+and+Nicholas+Carlini%2E+2022%2E+Deduplicating+training+data+makes+language+models+better%2E+In+Proceedings+o)
16. Tomasz Limisiewicz, Jiří Balhar, and David Mareček. 2023. Tokenization impacts multilingual language modeling: Assessing vocabulary allocation and overlap across languages. In Findings of the Association for Computational Linguistics: ACL 2023, pages 5661–5681, Toronto, Canada. Association for Com… [find](https://scholar.google.com/scholar?q=Tomasz+Limisiewicz%2C+Jir%CC%8C%C3%AD+Balhar%2C+and+David+Marec%CC%8Cek%2E+2023%2E+Tokenization+impacts+multilingual+language+modeling%3A+Assessing+vocabulary+allocation+and+overlap+across+languages%2E+In+Findings+of+the+Associ)
17. Arijit Nag, Soumen Chakrabarti, Animesh Mukherjee, and Niloy Ganguly. 2025. Efficient continual pre-training of LLMs for low-resource languages. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies… [find](https://scholar.google.com/scholar?q=Arijit+Nag%2C+Soumen+Chakrabarti%2C+Animesh+Mukherjee%2C+and+Niloy+Ganguly%2E+2025%2E+Efficient+continual+pre%2Dtraining+of+LLMs+for+low%2Dresource+languages%2E+In+Proceedings+of+the+2025+Conference+of+the+Nations+of)
18. Artidoro Pagnoni, Ramakanth Pasunuru, Pedro Rodriguez, John Nguyen, Benjamin Muller, Margaret Li, Chunting Zhou, Lili Yu, Jason E. Weston, Luke Zettlemoyer, Gargi Ghosh, Mike Lewis, Ari Holtzman, and Srini Iyer. 2025. Byte latent transformer: Patches scale better than tokens. In Proceedings of the 6… [find](https://scholar.google.com/scholar?q=Artidoro+Pagnoni%2C+Ramakanth+Pasunuru%2C+Pedro+Rodriguez%2C+John+Nguyen%2C+Benjamin+Muller%2C+Margaret+Li%2C+Chunting+Zhou%2C+Lili+Yu%2C+Jason+E%2E+Weston%2C+Luke+Zettlemoyer%2C+Gargi+Ghosh%2C+Mike+Lewis%2C+Ari+Holtzman%2C+and+)
19. Leiyu Pan, Supryadi, and Deyi Xiong. 2023. Is robustness transferable across languages in multilingual neural machine translation? In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 14114–14125, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Leiyu+Pan%2C+Supryadi%2C+and+Deyi+Xiong%2E+2023%2E+Is+robustness+transferable+across+languages+in+multilingual+neural+machine+translation%3F+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2)
20. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318, Philadelphia, Pennsylvania, USA. Association for Computational…
21. Renhao Pei, Yihong Liu, Peiqin Lin, François Yvon, and Hinrich Schuetze. 2025. Understanding in-context machine translation for low-resource languages: A case study on Manchu. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 87… [find](https://scholar.google.com/scholar?q=Renhao+Pei%2C+Yihong+Liu%2C+Peiqin+Lin%2C+Fran%C3%A7ois+Yvon%2C+and+Hinrich+Schuetze%2E+2025%2E+Understanding+in%2Dcontext+machine+translation+for+low%2Dresource+languages%3A+A+case+study+on+Manchu%2E+In+Proceedings+of+the+63)
22. Maja Popović. 2017. [chrF++: words helping character n-grams](https://md.research.elamur.ai/free/en/papers/popovic-2017-chrf-words-helping-character-n/). In Proceedings of the Second Conference on Machine Translation, pages 612–618, Copenhagen, Denmark. Association for Computational Linguistics.
23. Matt Post. 2018. [A call for clarity in reporting BLEU scores](https://md.research.elamur.ai/free/en/papers/post-2018-call-clarity-reporting-bleu-scores/). In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186– 191, Brussels, Belgium. Association for Computational Linguistics.
24. Ricardo Rei, Craig Stewart, Ana C. Farinha, and Alon Lavie. 2020. [COMET: A neural framework for MT evaluation](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2685–2702, Online. Association for Computational Linguistics.
25. Oscar Sainz, Jon Campos, Iker García-Ferrero, Julen Etxaniz, Oier Lopez de Lacalle, and Eneko Agirre. 2023. [NLP evaluation in trouble: On the need to measure LLM data contamination for each benchmark](https://md.research.elamur.ai/free/en/papers/sainz-2023-nlp-evaluation-trouble-need-measure/). In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 10776–10787, Singap…
26. Seyoung Song, Haneul Yoo, Jiho Jin, Kyunghyun Cho, and Alice Oh. 2025. Shared heritage, distinct writing: Rethinking resource selection for east asian historical documents. In Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pac… [find](https://scholar.google.com/scholar?q=Seyoung+Song%2C+Haneul+Yoo%2C+Jiho+Jin%2C+Kyunghyun+Cho%2C+and+Alice+Oh%2E+2025%2E+Shared+heritage%2C+distinct+writing%3A+Rethinking+resource+selection+for+east+asian+historical+documents%2E+In+Proceedings+of+the+14th+)
27. Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, Wei-Yin Ko, Daniel D’souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, and Sara Hooker. 2024. [Aya model: An instruction fine…](https://md.research.elamur.ai/free/en/papers/ustun-2024-aya-model-instruction-finetuned-open/)
28. Feng Wang. 2004. On the features of the ancient Bai script. Journal of Dali College, 3(4):9–12. In Chinese. [find](https://scholar.google.com/scholar?q=Feng+Wang%2E+2004%2E+On+the+features+of+the+ancient+Bai+script%2E+Journal+of+Dali+College%2C+3%284%29%3A9%E2%80%9312%2E+In+Chinese%2E)
29. Feng Wang. 2020. Types and transmission characteristics of Dabenqu libretto manuscripts in square Bai script. Studies of Ethnic Literature, 38(6):112–120. In Chinese. [find](https://scholar.google.com/scholar?q=Feng+Wang%2E+2020%2E+Types+and+transmission+characteristics+of+Dabenqu+libretto+manuscripts+in+square+Bai+script%2E+Studies+of+Ethnic+Literature%2C+38%286%29%3A112%E2%80%93120%2E+In+Chinese%2E)
30. Hao Wang, Hirofumi Shimizu, and Daisuke Kawahara. 2023. Kanbun-lm: Reading and translating classical chinese in japanese methods by language models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 8589–8601, Toronto, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hao+Wang%2C+Hirofumi+Shimizu%2C+and+Daisuke+Kawahara%2E+2023%2E+Kanbun%2Dlm%3A+Reading+and+translating+classical+chinese+in+japanese+methods+by+language+models%2E+In+Findings+of+the+Association+for+Computational+Li)
31. Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, and Colin Raffel. 2022. ByT5: Towards a token-free future with pre-trained byte-to-byte models. Transactions of the Association for Computational Linguistics, 10:291–306. [find](https://scholar.google.com/scholar?q=Linting+Xue%2C+Aditya+Barua%2C+Noah+Constant%2C+Rami+Al%2DRfou%2C+Sharan+Narang%2C+Mihir+Kale%2C+Adam+Roberts%2C+and+Colin+Raffel%2E+2022%2E+ByT5%3A+Towards+a+token%2Dfree+future+with+pre%2Dtrained+byte%2Dto%2Dbyte+models%2E+Transac)
32. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, and 41 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
33. Haneul Yoo, Jiho Jin, Juhee Son, JinYeong Bak, Kyunghyun Cho, and Alice Oh. 2022. HUE: Pre-trained model and dataset for understanding hanja documents of ancient korea. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 1832–1844, Seattle, United States. Association for… [find](https://scholar.google.com/scholar?q=Haneul+Yoo%2C+Jiho+Jin%2C+Juhee+Son%2C+JinYeong+Bak%2C+Kyunghyun+Cho%2C+and+Alice+Oh%2E+2022%2E+HUE%3A+Pre%2Dtrained+model+and+dataset+for+understanding+hanja+documents+of+ancient+korea%2E+In+Findings+of+the+Association+)
34. Chen Zhang, Jiuheng Lin, Xiao Liu, Zekai Zhang, and Yansong Feng. 2025. Read it in two steps: Translating extremely low-resource languages with code-augmented grammar books. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3977… [find](https://scholar.google.com/scholar?q=Chen+Zhang%2C+Jiuheng+Lin%2C+Xiao+Liu%2C+Zekai+Zhang%2C+and+Yansong+Feng%2E+2025%2E+Read+it+in+two+steps%3A+Translating+extremely+low%2Dresource+languages+with+code%2Daugmented+grammar+books%2E+In+Proceedings+of+the+63rd)
35. Jianyu Zheng. 2026. Effective vocabulary expanding of multilingual language models for extremely low-resource languages. arXiv preprint arXiv:2602.09388. — [arXiv:2602.09388](https://arxiv.org/abs/2602.09388) [find](https://scholar.google.com/scholar?q=Jianyu+Zheng%2E+2026%2E+Effective+vocabulary+expanding+of+multilingual+language+models+for+extremely+low%2Dresource+languages%2E+arXiv+preprint+arXiv%3A2602%2E09388%2E+%E2%80%94+%5BarXiv%3A2602%2E09388%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F260)
36. Shaolin Zhu, Menglong Cui, and Deyi Xiong. 2024a. Towards robust in-context learning for machine translation with large language models. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 16619–16629, To… [find](https://scholar.google.com/scholar?q=Shaolin+Zhu%2C+Menglong+Cui%2C+and+Deyi+Xiong%2E+2024a%2E+Towards+robust+in%2Dcontext+learning+for+machine+translation+with+large+language+models%2E+In+Proceedings+of+the+2024+Joint+International+Conference+on+Co)
37. Shaolin Zhu, Leiyu Pan, Bo Li, and Deyi Xiong. 2024b. LANDeRMT: Dectecting and routing language-aware neurons for selectively finetuning LLMs to machine translation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12135– 12148… [find](https://scholar.google.com/scholar?q=Shaolin+Zhu%2C+Leiyu+Pan%2C+Bo+Li%2C+and+Deyi+Xiong%2E+2024b%2E+LANDeRMT%3A+Dectecting+and+routing+language%2Daware+neurons+for+selectively+finetuning+LLMs+to+machine+translation%2E+In+Proceedings+of+the+62nd+Annual+)

*Updated 2 November 2026*
