---
title: "Bringing Mapudungun into the Modern MT — Thompson 2026"
description: "Mapudungun is a polysynthetic language spoken by over 200,000 Mapuche people in Chile and Argentina."
authors: ["Isaac Thompson", "Brandon Rogers", "Eric Ringger"]
year: 2026
venue: "Proceedings of the Sixth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP)"
source: "https://aclanthology.org/2026.americasnlp-6.16/"
doi: "10.18653/v1/2026.americasnlp-6.16"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/thompson-2026-bringing-mapudungun-into-modern-mt/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/thompson-2026-bringing-mapudungun-into-modern-mt/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/2/) / Bringing Mapudungun into the Modern MT Ecosystem: Morphology-Aware Tokenization for NLLB-200 Fine-Tuning

# Bringing Mapudungun into the Modern MT Ecosystem: Morphology-Aware Tokenization for NLLB-200 Fine-Tuning

**Authors:** Isaac Thompson, Brandon Rogers, [Eric Ringger](https://md.research.elamur.ai/free/en/authors/eric-ringger/) · **Year:** 2026 · **Venue:** Proceedings of the Sixth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.americasnlp-6.16/) · [PDF](https://aclanthology.org/2026.americasnlp-6.16.pdf) · [DOI 10.18653/v1/2026.americasnlp-6.16](https://doi.org/10.18653/v1/2026.americasnlp-6.16) · [OpenAlex](https://openalex.org/W7166857697)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
Mapudungun is a polysynthetic language spoken by over 200,000 Mapuche people in Chile and Argentina. It is not covered by NLLB-200 or by major commercial translation services, and standard BPE tends to break its long agglutinative words into fragments that ignore morpheme boundaries. The authors present the first fine-tuning study of NLLB-200 (600M, 1.3B and 3.3B parameters) for Mapudungun–Spanish translation in both directions. They train on a cleaned version of the AVENUE corpus, which consists of oral-history interviews, and compare eight ways of pre-segmenting the Mapudungun side. Their new method, Morfessor-VC, starts from Morfessor's unsupervised morpheme splits and then restricts the resulting units to tokens that already exist in NLLB's pretrained vocabulary, so the pretrained embeddings remain usable. With Morfessor-VC, the smallest model reaches roughly the quality of a 3.3B model using ordinary BPE. Every fine-tuned system beats frontier LLMs by a wide margin. The work sets new baselines for Mapudungun MT and releases resources that communities can build on for education and revitalization.

## Key points
- On arn→es, the 600M Morfessor-VC model scores 43.2 chrF++ and the 3.3B Standard BPE model scores 42.9 (p = 0.039), despite the five-fold difference in parameters.
- All fine-tuned conditions exceed frontier LLMs by more than 27 chrF++; Aya Expanse 8B, for example, reaches only 15.9.
- After cleaning, the AVENUE data has train/dev/test splits of 55,452 / 1,581 / 9,382 sentence pairs. About 24% of Mapudungun utterances mix in Spanish, and the authors keep these code-switched utterances.
- The eight tokenization conditions are Standard BPE, Joint BPE, Mono BPE, Optuna BPE, Morfessor, Morfessor-VC, Morfessor-BPE and SentencePiece UnigramLM. Optuna tuning chose a vocabulary of 10,954, but scores changed little across vocabulary sizes.
- Code is available on GitHub (byu-matrix-lab/mapudungun-nllb) and model weights on HuggingFace. Stated limitations include a single domain, the AMU orthography only, and a pilot human evaluation with one annotator.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{thompson2026bringing,
  title = {{Bringing Mapudungun into the Modern MT Ecosystem: Morphology-Aware Tokenization for NLLB-200 Fine-Tuning}},
  author = {Thompson, Isaac and Rogers, Brandon and Ringger, Eric},
  booktitle = {Proceedings of the Sixth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP)},
  year = {2026},
  doi = {10.18653/v1/2026.americasnlp-6.16},
  url = {https://doi.org/10.18653/v1/2026.americasnlp-6.16}
}
```

- [← previous Bridging the Culture Gap: A Framework for LLM-Driven Socio-Cultural Localization of Math Word Problems in Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/azime-2026-bridging-culture-gap-framework-llm/)
- [next → BSC's Submission to the Instruction Following Track of IWSLT 2026](https://md.research.elamur.ai/free/en/papers/pareras-2026-bsc-s-submission-instruction-following/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/2/)

## References

35 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ona de Gibert, Robert Pugh, Ali Marashian, Raul Vazquez, Abteen Ebrahimi, Pavel Denisov, Enora Rice, Edward Gow-Smith, Juan Prieto, Melissa Robles, Rubén Manrique, Oscar Moreno, Angel Lino, Rolando Coto-Solano, Aldo Alvarez, Marvin Agüero-Torales, John E. Ortega, Luis Chiruzzo, Arturo Oncevay, and 3… [find](https://scholar.google.com/scholar?q=Ona+de+Gibert%2C+Robert+Pugh%2C+Ali+Marashian%2C+Raul+Vazquez%2C+Abteen+Ebrahimi%2C+Pavel+Denisov%2C+Enora+Rice%2C+Edward+Gow%2DSmith%2C+Juan+Prieto%2C+Melissa+Robles%2C+Rub%C3%A9n+Manrique%2C+Oscar+Moreno%2C+Angel+Lino%2C+Rolando+Co)
2. Orevaoghene Ahia, Luke Bandarkar, Ife Henshaw, Sabrina Schneider, Sachin Kumar Singh, Antonios Anastasopoulos, David Mortensen, Graham Neubig, and Yulia Tsvetkov. 2023. All languages are NOT created (tokenized) equal. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Pro… [find](https://scholar.google.com/scholar?q=Orevaoghene+Ahia%2C+Luke+Bandarkar%2C+Ife+Henshaw%2C+Sabrina+Schneider%2C+Sachin+Kumar+Singh%2C+Antonios+Anastasopoulos%2C+David+Mortensen%2C+Graham+Neubig%2C+and+Yulia+Tsvetkov%2E+2023%2E+All+languages+are+NOT+created+%28)
3. Cristian Ahumada, Claudio Gutierrez, and Antonios Anastasopoulos. 2022. Educational tools for Ma-puzugun. In Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022), pages 183–196, Seattle, Washington. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Cristian+Ahumada%2C+Claudio+Gutierrez%2C+and+Antonios+Anastasopoulos%2E+2022%2E+Educational+tools+for+Ma%2Dpuzugun%2E+In+Proceedings+of+the+17th+Workshop+on+Innovative+Use+of+NLP+for+Building+Educational+Applicat)
4. Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, and Masanori Koyama. 2019. Optuna: A next-generation hyperparameter optimization framework. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 2623–2631. ACM. [find](https://scholar.google.com/scholar?q=Takuya+Akiba%2C+Shotaro+Sano%2C+Toshihiko+Yanase%2C+Takeru+Ohta%2C+and+Masanori+Koyama%2E+2019%2E+Optuna%3A+A+next%2Dgeneration+hyperparameter+optimization+framework%2E+In+Proceedings+of+the+25th+ACM+SIGKDD+Internation) [our card](https://md.research.elamur.ai/free/en/papers/akiba-2019-optuna-next-generation-hyperparameter-optimization/)
5. Andrés Chandiá. 2022. A Mapudüngun FST morphological analyser and its web interface. In Proceedings of the 13th Language Resources and Evaluation Conference, pages 6540–6547, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Andr%C3%A9s+Chandi%C3%A1%2E+2022%2E+A+Mapud%C3%BCngun+FST+morphological+analyser+and+its+web+interface%2E+In+Proceedings+of+the+13th+Language+Resources+and+Evaluation+Conference%2C+pages+6540%E2%80%936547%2C+Marseille%2C+France%2E+Europe)
6. Michael DeGenaro and Luke Lupicki. 2024. Low-resource machine translation for indigenous languages of the Americas. In Proceedings of the 4th Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP 2024), pages 1–7, Mexico City, Mexico. Association for Computati… [find](https://scholar.google.com/scholar?q=Michael+DeGenaro+and+Luke+Lupicki%2E+2024%2E+Low%2Dresource+machine+translation+for+indigenous+languages+of+the+Americas%2E+In+Proceedings+of+the+4th+Workshop+on+Natural+Language+Processing+for+Indigenous+Lan)
7. Belen Alastruey, Niyati Bafna, Andrea Caciolai, Kevin Heffernan, Artyom Kozhevnikov, Christophe Ropers, Eduardo Sánchez, Charles-Éric Saint-James, Ioannis Tsiamas, and 1 others. 2026. OmniLingual MT: Machine translation for 1,600 languages. arXiv preprint arXiv:2603.16309. — [arXiv:2603.16309](https://arxiv.org/abs/2603.16309) [find](https://scholar.google.com/scholar?q=Belen+Alastruey%2C+Niyati+Bafna%2C+Andrea+Caciolai%2C+Kevin+Heffernan%2C+Artyom+Kozhevnikov%2C+Christophe+Ropers%2C+Eduardo+S%C3%A1nchez%2C+Charles%2D%C3%89ric+Saint%2DJames%2C+Ioannis+Tsiamas%2C+and+1+others%2E+2026%2E+OmniLingual+MT%3A+)
8. C.M. Downey, Terra Blevins, Nora Goldfine, and Shane Steinert-Threlkeld. 2023. Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages. In Proceedings of the 3rd Workshop on Multi-lingual Representation Learning (MRL), pages 268–281, Singapore. Association… [find](https://scholar.google.com/scholar?q=C%2EM%2E+Downey%2C+Terra+Blevins%2C+Nora+Goldfine%2C+and+Shane+Steinert%2DThrelkeld%2E+2023%2E+Embedding+structure+matters%3A+Comparing+methods+to+adapt+multilingual+vocabularies+to+new+languages%2E+In+Proceedings+of+the)
9. Duygu Ataman and Marcello Federico. 2018. Compositional representation of morphologically-rich input for neural machine translation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 305–311, Melbourne, Australia. Association f… [find](https://scholar.google.com/scholar?q=Duygu+Ataman+and+Marcello+Federico%2E+2018%2E+Compositional+representation+of+morphologically%2Drich+input+for+neural+machine+translation%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Co)
10. Mingjun Duan, Carlos Fasola, Sai Krishna Rallabandi, Rodolfo M. Vega, Antonios Anastasopoulos, Lori Levin, and Alan W. Black. 2020. A resource for computational experiments on Mapudungun. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 2872–2877, Marseille, France. Eur… [find](https://scholar.google.com/scholar?q=Mingjun+Duan%2C+Carlos+Fasola%2C+Sai+Krishna+Rallabandi%2C+Rodolfo+M%2E+Vega%2C+Antonios+Anastasopoulos%2C+Lori+Levin%2C+and+Alan+W%2E+Black%2E+2020%2E+A+resource+for+computational+experiments+on+Mapudungun%2E+In+Proceedin)
11. Sreejit Banerjee and Pushpak Bhattacharyya. 2018. Meaningless yet meaningful: Morphology grounded subword-level NMT. In Proceedings of the 2nd Workshop on Subword/Character LEvels Models, pages 55–60, New Orleans, Louisiana. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sreejit+Banerjee+and+Pushpak+Bhattacharyya%2E+2018%2E+Meaningless+yet+meaningful%3A+Morphology+grounded+subword%2Dlevel+NMT%2E+In+Proceedings+of+the+2nd+Workshop+on+Subword%2FCharacter+LEvels+Models%2C+pages+55%E2%80%9360%2C)
12. Abteen Ebrahimi, Ona de Gibert, Raul Vazquez, Rolando Coto-Solano, Pavel Denisov, Robert Pugh, Manuel Mager, Arturo Oncevay, Luis Chiruzzo, Katharina von der Wense, and Shruti Rijhwani. 2024. Findings of the AmericasNLP 2024 shared task on machine translation into indigenous languages. [find](https://scholar.google.com/scholar?q=Abteen+Ebrahimi%2C+Ona+de+Gibert%2C+Raul+Vazquez%2C+Rolando+Coto%2DSolano%2C+Pavel+Denisov%2C+Robert+Pugh%2C+Manuel+Mager%2C+Arturo+Oncevay%2C+Luis+Chiruzzo%2C+Katharina+von+der+Wense%2C+and+Shruti+Rijhwani%2E+2024%2E+Findings)
13. In Proceedings of the 4th Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP 2024), pages 236–246, Mexico City, Mexico. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=In+Proceedings+of+the+4th+Workshop+on+Natural+Language+Processing+for+Indigenous+Languages+of+the+Americas+%28AmericasNLP+2024%29%2C+pages+236%E2%80%93246%2C+Mexico+City%2C+Mexico%2E+Association+for+Computational+Linguis)
14. IEEE International Conference on Pattern Recognition Systems (ICPRS), pages 1–7. [find](https://scholar.google.com/scholar?q=IEEE+International+Conference+on+Pattern+Recognition+Systems+%28ICPRS%29%2C+pages+1%E2%80%937%2E)
15. Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, Vishrav Chaudhary, Luis Chiruzzo, Angela Fan, John Ortega, Ricardo Ramos, Annette Rios, Ivan Meza Ruiz, Gustavo Giménez-Lugo, Elisabeth Peutêtre, Katharina Kann, and Alexis Palmer. 2023. Findings of the AmericasNLP 2023 shared task on machine translatio… [find](https://scholar.google.com/scholar?q=Abteen+Ebrahimi%2C+Manuel+Mager%2C+Arturo+Oncevay%2C+Vishrav+Chaudhary%2C+Luis+Chiruzzo%2C+Angela+Fan%2C+John+Ortega%2C+Ricardo+Ramos%2C+Annette+Rios%2C+Ivan+Meza+Ruiz%2C+Gustavo+Gim%C3%A9nez%2DLugo%2C+Elisabeth+Peut%C3%AAtre%2C+Kathari)
16. Edward Gow-Smith and Danaé Sánchez Villegas. 2023. Low-resource machine translation for low-resource languages: Corpus augmentation and pretrained model leverage. In Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP), pages 74–86, Toront… [find](https://scholar.google.com/scholar?q=Edward+Gow%2DSmith+and+Dana%C3%A9+S%C3%A1nchez+Villegas%2E+2023%2E+Low%2Dresource+machine+translation+for+low%2Dresource+languages%3A+Corpus+augmentation+and+pretrained+model+leverage%2E+In+Proceedings+of+the+Workshop+on+Nat)
17. Thamme Gowda and Jonathan May. 2020. Finding the optimal vocabulary size for neural machine translation. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3955–3964, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Thamme+Gowda+and+Jonathan+May%2E+2020%2E+Finding+the+optimal+vocabulary+size+for+neural+machine+translation%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2020%2C+pages+3955%E2%80%933964%2C+Onli)
18. Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pages 388–395, Barcelona, Spain. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2E+2004%2E+Statistical+significance+tests+for+machine+translation+evaluation%2E+In+Proceedings+of+the+2004+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+388%E2%80%93395%2C+Barcel)
19. Taku Kudo. 2018. Subword regularization: Improving neural network translation models with multiple subword candidates. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 66–75, Melbourne, Australia. Association for Computational… [find](https://scholar.google.com/scholar?q=Taku+Kudo%2E+2018%2E+Subword+regularization%3A+Improving+neural+network+translation+models+with+multiple+subword+candidates%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Li)
20. Taku Kudo and John Richardson. 2018. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66–71, Brussels, Belgium. Associ… [find](https://scholar.google.com/scholar?q=Taku+Kudo+and+John+Richardson%2E+2018%2E+SentencePiece%3A+A+simple+and+language+independent+subword+tokenizer+and+detokenizer+for+neural+text+processing%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+M) [our card](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/)
21. Lori Levin, Rodolfo Vega, Jaime Carbonell, Ralf Brown, Alon Lavie, Eliseo Cañulef, and Carolina Huenchullan. 2002. Data collection and language technologies for Mapudungun. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002), Las Palmas, Gran Canaria… [find](https://scholar.google.com/scholar?q=Lori+Levin%2C+Rodolfo+Vega%2C+Jaime+Carbonell%2C+Ralf+Brown%2C+Alon+Lavie%2C+Eliseo+Ca%C3%B1ulef%2C+and+Carolina+Huenchullan%2E+2002%2E+Data+collection+and+language+technologies+for+Mapudungun%2E+In+Proceedings+of+the+Third)
22. Hernan Lira, Luis Martí, and Nayat Sanchez-Pi. 2025. Spanish–Mapudungun translation using transfer learning for low-resource languages. In 2025 15th Manuel Mager, Rajat Bhatnagar, Graham Neubig, Ngoc Thang Vu, and Katharina Kann. 2023. Neural machine translation for the indigenous languages of the A… [find](https://scholar.google.com/scholar?q=Hernan+Lira%2C+Luis+Mart%C3%AD%2C+and+Nayat+Sanchez%2DPi%2E+2025%2E+Spanish%E2%80%93Mapudungun+translation+using+transfer+learning+for+low%2Dresource+languages%2E+In+2025+15th+Manuel+Mager%2C+Rajat+Bhatnagar%2C+Graham+Neubig%2C+Ngoc+)
23. Manuel Mager, Arturo Oncevay, Elisabeth Mager, Katharina Kann, and Thang Vu. 2022. BPE vs. morphological segmentation: A case study on machine translation of four polysynthetic languages. In Findings of the Association for Computational Linguistics: ACL 2022, pages 961–971, Dublin, Ireland. Associat… [find](https://scholar.google.com/scholar?q=Manuel+Mager%2C+Arturo+Oncevay%2C+Elisabeth+Mager%2C+Katharina+Kann%2C+and+Thang+Vu%2E+2022%2E+BPE+vs%2E+morphological+segmentation%3A+A+case+study+on+machine+translation+of+four+polysynthetic+languages%2E+In+Findings+)
24. Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky, Colin Raffel, Manan Dey, Matthias Gallé, Arun Raja, Chenglei Si, Wilson Y. Lee, Benoît Sagot, and Samson Tan. 2021. Between words and characters: A brief history of open-vocabulary modeling and tokenization in NLP. arXiv preprint arXiv:2112.10508. [find](https://scholar.google.com/scholar?q=Sabrina+J%2E+Mielke%2C+Zaid+Alyafeai%2C+Elizabeth+Salesky%2C+Colin+Raffel%2C+Manan+Dey%2C+Matthias+Gall%C3%A9%2C+Arun+Raja%2C+Chenglei+Si%2C+Wilson+Y%2E+Lee%2C+Beno%C3%AEt+Sagot%2C+and+Samson+Tan%2E+2021%2E+Between+words+and+characters%3A+A)
25. Benjamin Minixhofer, Fabian Paischer, and Navid Rekabsaz. 2022. WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Hum… [find](https://scholar.google.com/scholar?q=Benjamin+Minixhofer%2C+Fabian+Paischer%2C+and+Navid+Rekabsaz%2E+2022%2E+WECHSEL%3A+Effective+initialization+of+subword+embeddings+for+cross%2Dlingual+transfer+of+monolingual+language+models%2E+In+Proceedings+of+the)
26. NLLB Team, Marta R. Costa-jussà, and 1 others. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672. [find](https://scholar.google.com/scholar?q=NLLB+Team%2C+Marta+R%2E+Costa%2Djuss%C3%A0%2C+and+1+others%2E+2022%2E+No+language+left+behind%3A+Scaling+human%2Dcentered+machine+translation%2E+arXiv+preprint+arXiv%3A2207%2E04672%2E)
27. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318, Philadelphia, Pennsylvania, USA. Association for Computational… [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+BLEU%3A+a+method+for+automatic+evaluation+of+machine+translation%2E+In+Proceedings+of+the+40th+Annual+Meeting+of+the+Association+for+Comp) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
28. María Begoña Pendas, Andrés Carvallo, and Carlos Aspillaga. 2023. Neural machine translation through active learning on low-resource languages: The case of Spanish to Mapudungun. In Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP), pag… [find](https://scholar.google.com/scholar?q=Mar%C3%ADa+Bego%C3%B1a+Pendas%2C+Andr%C3%A9s+Carvallo%2C+and+Carlos+Aspillaga%2E+2023%2E+Neural+machine+translation+through+active+learning+on+low%2Dresource+languages%3A+The+case+of+Spanish+to+Mapudungun%2E+In+Proceedings+of+the)
29. Aleksandar Petrov, Emanuele La Malfa, Philip Torr, and Adel Bibi. 2023. Language model tokenizers introduce unfairness between languages. In Advances in Neural Information Processing Systems, volume 36. [find](https://scholar.google.com/scholar?q=Aleksandar+Petrov%2C+Emanuele+La+Malfa%2C+Philip+Torr%2C+and+Adel+Bibi%2E+2023%2E+Language+model+tokenizers+introduce+unfairness+between+languages%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+3)
30. Maja Popović. 2017. chrF++: words helping character n-grams. In Proceedings of the Second Conference on Machine Translation, pages 612–618, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Maja+Popovic%CC%81%2E+2017%2E+chrF%2B%2B%3A+words+helping+character+n%2Dgrams%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+pages+612%E2%80%93618%2C+Copenhagen%2C+Denmark%2E+Association+for+Computational+Linguist) [our card](https://md.research.elamur.ai/free/en/papers/popovic-2017-chrf-words-helping-character-n/)
31. Matt Post. 2018. A call for clarity in reporting BLEU scores. In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186– 191, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Matt+Post%2E+2018%2E+A+call+for+clarity+in+reporting+BLEU+scores%2E+In+Proceedings+of+the+Third+Conference+on+Machine+Translation%3A+Research+Papers%2C+pages+186%E2%80%93+191%2C+Brussels%2C+Belgium%2E+Association+for+Computa) [our card](https://md.research.elamur.ai/free/en/papers/post-2018-call-clarity-reporting-bleu-scores/)
32. Phillip Rust, Jonas Pfeiffer, Ivan Vulić, Sebastian Ruder, and Iryna Gurevych. 2021. How good is your tokenizer? on the monolingual performance of multilingual language models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Join… [find](https://scholar.google.com/scholar?q=Phillip+Rust%2C+Jonas+Pfeiffer%2C+Ivan+Vulic%CC%81%2C+Sebastian+Ruder%2C+and+Iryna+Gurevych%2E+2021%2E+How+good+is+your+tokenizer%3F+on+the+monolingual+performance+of+multilingual+language+models%2E+In+Proceedings+of+the+) [our card](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/)
33. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural machine translation of rare words with subword units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1715–1725, Berlin, Germany. Association for Computational Lin… [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016%2E+Neural+machine+translation+of+rare+words+with+subword+units%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computational+Ling)
34. Sami Virpioja, Peter Smit, Stig-Arne Grönroos, and Mikko Kurimo. 2013. Morfessor 2.0: Python implementation and extensions for Morfessor Baseline. Technical Report 25/2013 in Aalto University publication series SCIENCE + TECHNOLOGY, Aalto University. [find](https://scholar.google.com/scholar?q=Sami+Virpioja%2C+Peter+Smit%2C+Stig%2DArne+Gr%C3%B6nroos%2C+and+Mikko+Kurimo%2E+2013%2E+Morfessor+2%2E0%3A+Python+implementation+and+extensions+for+Morfessor+Baseline%2E+Technical+Report+25%2F2013+in+Aalto+University+publicat)
35. Peter Wittenburg, Hennie Brugman, Albert Russel, Alex Klassmann, and Han Sloetjes. 2006. ELAN: a professional framework for multimodality research. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC), pages 1556–1559, Genoa, Italy. European Language Resourc… [find](https://scholar.google.com/scholar?q=Peter+Wittenburg%2C+Hennie+Brugman%2C+Albert+Russel%2C+Alex+Klassmann%2C+and+Han+Sloetjes%2E+2006%2E+ELAN%3A+a+professional+framework+for+multimodality+research%2E+In+Proceedings+of+the+5th+International+Conference+o) [our card](https://md.research.elamur.ai/free/en/papers/wittenburg-2006-elan-professional-framework-multimodality-research/)