---
title: "Challenges in Machine Translation of Interactive Multimodal"
description: "The authors report on an applied project that localizes the Czech e-learning portal Škola s nadhledem into… 84% recall. 22 references."
authors: ["Lucie Polakova", "Miroslav Hrabal", "Věra Kloudová", "Michal Novák", "Mariia Anisimova", "Martin Popel"]
year: 2026
venue: "Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)"
source: "https://aclanthology.org/2026.bea-1.11/"
doi: "10.18653/v1/2026.bea-1.11"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/polakova-2026-challenges-machine-translation-interactive-multimodal/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/polakova-2026-challenges-machine-translation-interactive-multimodal/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/25/) / Challenges in Machine Translation of Interactive Multimodal Exercises

# Challenges in Machine Translation of Interactive Multimodal Exercises

**Authors:** [Lucie Polakova](https://md.research.elamur.ai/free/en/authors/lucie-polakova/), Miroslav Hrabal, Věra Kloudová, [Michal Novák](https://md.research.elamur.ai/free/en/authors/michal-novak/), Mariia Anisimova and [Martin Popel](https://md.research.elamur.ai/free/en/authors/martin-popel/) · **Year:** 2026 · **Venue:** [Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)](https://md.research.elamur.ai/free/en/venues/bea/) ([BEA 2026](https://md.research.elamur.ai/free/en/venues/bea/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.bea-1.11/) · [PDF](https://aclanthology.org/2026.bea-1.11.pdf) · [DOI 10.18653/v1/2026.bea-1.11](https://doi.org/10.18653/v1/2026.bea-1.11) · [OpenAlex](https://openalex.org/W7166863719)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary

The authors report on an applied project that localizes the Czech e-learning portal Škola s nadhledem into Ukrainian, English and German. The portal is used by many Ukrainian pupils in Czech schools. Its content is difficult for MT: exercises are short, heavy in terminology, interactive, multimodal, and wrapped in complex XML/HTML. The team translates plain text first and then projects the markup back, rather than translating text and tags together. They fine-tuned a locally hosted EuroLLM-9B-Instruct with LoRA, using in-domain parallel and back-translated data, and compared SFT, CPO and SimPO variants. Automatic metrics, two rounds of human evaluation and in-portal testing identified SFT+CPO as the best system. For Czech-Ukrainian it outperformed the earlier Transformer-based system. The paper also gives a linguistic classification of errors. It separates classic MT mistakes from newer LLM-specific ones, such as "fixing" deliberately false statements or completing unfinished sentences. These findings are useful for EdTech teams weighing open-source LLMs for confidential, domain-specific translation.

## Key points

- **Data:** The portal has 9,000+ exercises, of which about 1,000 suitable ones were preselected. Professionals translated 396 biology, chemistry and geography exercises into all three languages, split into 190 dev and 206 test exercises.
- **Adaptation data:**
  - For Czech-English: CzEng 2.0 and back-translated Wikipedia.
  - For Czech-German: 57,000 sentence pairs crawled with Bitextor and 1.2M monolingual sentences from oebv.at.
  - Preference pairs were chosen using MetricX and Gemma-3-27B-it.
- **Main result:** Compared with the pre-LLM Czech-Ukrainian system, SFT+CPO gained +1.5 chrF2, −0.4 MetricX24, and +0.61 in human scores on a 0–10 scale.
- **In-image text detection:** In a preliminary test, a small VLM detected images needing translation with 84% recall (F1 = 0.64) on 1,000 images. Under 7% of these images actually required translation.
- **Releases:**
  - The models (Hrabal et al., 2025) and the translation software (Popel et al., 2025) are available in LINDAT/CLARIAH. The software includes a web frontend, an API server and a tagged-document translator.
  - The translated exercises are due to become public by the end of 2026.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Charles University](https://md.research.elamur.ai/free/en/universities/charles-university/) — University, Prague, Czechia · 133 works · 20,686 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (2): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 1,087 works · [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works

## Cite

Cite as: Lucie Polakova, Miroslav Hrabal, Věra Kloudová, Michal Novák, Mariia Anisimova and Martin Popel. 2026. Challenges in Machine Translation of Interactive Multimodal Exercises. Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{polakova2026challenges,
  title = {{Challenges in Machine Translation of Interactive Multimodal Exercises}},
  author = {Lucie Polakova, Miroslav Hrabal, Věra Kloudová, Michal Novák, Mariia Anisimova and Martin Popel},
  booktitle = {Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.bea-1.11},
  url = {https://doi.org/10.18653/v1/2026.bea-1.11}
}
```

- [← previous Challenges in Japanese Euphemism Classification: An Analysis of Pretrained Japanese and Multilingual Models](https://md.research.elamur.ai/free/en/papers/takahashi-2026-challenges-japanese-euphemism-classification-analysis/)
- [next → Challenging the Myth: A Research Arc on LLMs as Human Simulacra](https://md.research.elamur.ai/free/en/papers/munker-2026-challenging-myth-research-arc-llms/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/25/)

## References

22 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Nuaman Chen, Li Zhou, and Zilong Wang. 2023. Frustratingly easy label projection for cross-lingual transfer. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 4500–4515, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nuaman+Chen%2C+Li+Zhou%2C+and+Zilong+Wang%2E+2023%2E+Frustratingly+easy+label+projection+for+cross%2Dlingual+transfer%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+)
2. Miquel Esplà-Gomis. 2009. Bitextor: a free/open-source software to harvest translation memories from multilingual websites. In Beyond Translation Memories: New Tools for Translators Workshop, Ottawa, Canada. [find](https://scholar.google.com/scholar?q=Miquel+Espl%C3%A0%2DGomis%2E+2009%2E+Bitextor%3A+a+free%2Fopen%2Dsource+software+to+harvest+translation+memories+from+multilingual+websites%2E+In+Beyond+Translation+Memories%3A+New+Tools+for+Translators+Workshop%2C+Ottawa%2C+)
3. Miroslav Hrabal, Martin Popel, Lucie Poláková, Michal Novák, Věra Kloudová, and Mariia Anisimova. 2025. EdUKate translation models 2025. [find](https://scholar.google.com/scholar?q=Miroslav+Hrabal%2C+Martin+Popel%2C+Lucie+Pol%C3%A1kov%C3%A1%2C+Michal+Nov%C3%A1k%2C+Ve%CC%8Cra+Kloudov%C3%A1%2C+and+Mariia+Anisimova%2E+2025%2E+EdUKate+translation+models+2025%2E)
4. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. [find](https://scholar.google.com/scholar?q=LINDAT%2FCLARIAH%2DCZ+digital+library+at+the+Institute+of+Formal+and+Applied+Linguistics+%28%C3%9AFAL%29%2C+Faculty+of+Mathematics+and+Physics%2C+Charles+University%2E)
5. Juraj Juraska, Daniel Deutsch, Mara Finkelstein, and Markus Freitag. 2024. [MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2024-metricx-24-google-submission-wmt/). In Proceedings of the Workshop on Machine Translation (WMT 2024).
6. Anna-Lena Kempe and Åke Grönlund. 2019. Collaborative digital textbooks–a comparison of five different designs shaping teaching and learning. Education and Information Technologies, 24(5):2909–2941. [find](https://scholar.google.com/scholar?q=Anna%2DLena+Kempe+and+%C3%85ke+Gr%C3%B6nlund%2E+2019%2E+Collaborative+digital+textbooks%E2%80%93a+comparison+of+five+different+designs+shaping+teaching+and+learning%2E+Education+and+Information+Technologies%2C+24%285%29%3A2909%E2%80%932941%2E)
7. Věra Kloudová, Ondřej Bojar, and Martin Popel. 2021. Detecting post-edited references and their effect on human evaluation. In Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval), pages 114–119, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ve%CC%8Cra+Kloudov%C3%A1%2C+Ondr%CC%8Cej+Bojar%2C+and+Martin+Popel%2E+2021%2E+Detecting+post%2Dedited+references+and+their+effect+on+human+evaluation%2E+In+Proceedings+of+the+Workshop+on+Human+Evaluation+of+NLP+Systems+%28HumEval)
8. Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Konstantin Dranch, Anton Dvorkovich, Sergey Dukanov, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Howard Lakougna, Jessica Lundin, Christof Monz, Kent… — [Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets](https://md.research.elamur.ai/free/en/papers/kocmi-2025-findings-wmt25-general-machine-translation/)
9. Tom Kocmi, Martin Popel, and Ondřej Bojar. 2020. Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords. Preprint, arXiv:2007.03006. — [arXiv:2007.03006](https://arxiv.org/abs/2007.03006) [find](https://scholar.google.com/scholar?q=Tom+Kocmi%2C+Martin+Popel%2C+and+Ondr%CC%8Cej+Bojar%2E+2020%2E+Announcing+CzEng+2%2E0+Parallel+Corpus+with+over+2+Gigawords%2E+Preprint%2C+arXiv%3A2007%2E03006%2E+%E2%80%94+%5BarXiv%3A2007%2E03006%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2007%2E03006%29)
10. Lieve Macken, Laura Van Brussel, and Joke Daems. 2019. NMT’s wonderland where people turn into rabbits. A study on the comprehensibility of newly invented words in NMT output. Computational Linguistics in the Netherlands Journal, 9:67–80. [find](https://scholar.google.com/scholar?q=Lieve+Macken%2C+Laura+Van+Brussel%2C+and+Joke+Daems%2E+2019%2E+NMT%E2%80%99s+wonderland+where+people+turn+into+rabbits%2E+A+study+on+the+comprehensibility+of+newly+invented+words+in+NMT+output%2E+Computational+Linguistic)
11. Yu Meng, Mengzhou Xia, and Danqi Chen. 2024. Simpo: Simple preference optimization with a reference-free reward. In Advances in Neural Information Processing Systems (NeurIPS). [find](https://scholar.google.com/scholar?q=Yu+Meng%2C+Mengzhou+Xia%2C+and+Danqi+Chen%2E+2024%2E+Simpo%3A+Simple+preference+optimization+with+a+reference%2Dfree+reward%2E+In+Advances+in+Neural+Information+Processing+Systems+%28NeurIPS%29%2E)
12. Maslahatun Nadziro, Aufia Aisa, and Rina Dian Rahmawati. 2023. The development of QR code-based Arabic textbooks for non-arabic education students. Scaffolding: Jurnal Pendidikan Islam dan Multikul-turalisme, 5(2):960–981. [find](https://scholar.google.com/scholar?q=Maslahatun+Nadziro%2C+Aufia+Aisa%2C+and+Rina+Dian+Rahmawati%2E+2023%2E+The+development+of+QR+code%2Dbased+Arabic+textbooks+for+non%2Darabic+education+students%2E+Scaffolding%3A+Jurnal+Pendidikan+Islam+dan+Multikul%2Dtu)
13. NLLB Team, Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, and 1 others. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672. [find](https://scholar.google.com/scholar?q=NLLB+Team%2C+Marta+R%2E+Costa%2Djuss%C3%A0%2C+James+Cross%2C+Onur+%C3%87elebi%2C+Maha+Elbayad%2C+Kenneth+Heafield%2C+Kevin+Heffernan%2C+and+1+others%2E+2022%2E+No+language+left+behind%3A+Scaling+human%2Dcentered+machine+translation%2E+arX)
14. Tanmay Parekh, I-Hung Hsu, Kuan-Hao Huang, Kai-Wei Chang, and Nanyun Peng. 2024. Contextual label projection for cross-lingual structured prediction. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Vol… [find](https://scholar.google.com/scholar?q=Tanmay+Parekh%2C+I%2DHung+Hsu%2C+Kuan%2DHao+Huang%2C+Kai%2DWei+Chang%2C+and+Nanyun+Peng%2E+2024%2E+Contextual+label+projection+for+cross%2Dlingual+structured+prediction%2E+In+Proceedings+of+the+2024+Conference+of+the+North)
15. Lucie Poláková, Martin Popel, Věra Kloudová, Michal Novák, Mariia Anisimova, and Jiří Balhar. 2025. Mitigating language barriers in education: Developing multilingual digital learning materials with machine translation. In EDULEARN25 Proceedings, pages 8754–8760, Valencia, Spain. IATED. [find](https://scholar.google.com/scholar?q=Lucie+Pol%C3%A1kov%C3%A1%2C+Martin+Popel%2C+Ve%CC%8Cra+Kloudov%C3%A1%2C+Michal+Nov%C3%A1k%2C+Mariia+Anisimova%2C+and+Jir%CC%8C%C3%AD+Balhar%2E+2025%2E+Mitigating+language+barriers+in+education%3A+Developing+multilingual+digital+learning+materials+with)
16. Martin Popel, Michal Novák, Jiří Balhar, Ondřej Košarko, Jiří Mayer, Lucie Poláková, Věra Kloudová, and Mariia Anisimova. 2025. EdUKate translation software 2. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles… [find](https://scholar.google.com/scholar?q=Martin+Popel%2C+Michal+Nov%C3%A1k%2C+Jir%CC%8C%C3%AD+Balhar%2C+Ondr%CC%8Cej+Ko%C5%A1arko%2C+Jir%CC%8C%C3%AD+Mayer%2C+Lucie+Pol%C3%A1kov%C3%A1%2C+Ve%CC%8Cra+Kloudov%C3%A1%2C+and+Mariia+Anisimova%2E+2025%2E+EdUKate+translation+software+2%2E+LINDAT%2FCLARIAH%2DCZ+digital+library+at)
17. Martin Popel, Lucie Poláková, Michal Novák, Jindřich Helcl, Jindřich Libovický, Pavel Straňák, Tomáš Krabač, Jaroslava Hlaváčová, Mariia Anisimova, and Tereza Chlaňová. 2024. Charles Translator: A Machine Translation System between Ukrainian and Czech. In Proceedings of the 2024 Joint Internat… [find](https://scholar.google.com/scholar?q=Martin+Popel%2C+Lucie+Pol%C3%A1kov%C3%A1%2C+Michal+Nov%C3%A1k%2C+Jindr%CC%8Cich+Helcl%2C+Jindr%CC%8Cich+Libovick%C3%BD%2C+Pavel+Stran%CC%8C%C3%A1k%2C+Tom%C3%A1%C5%A1+Krabac%CC%8C%2C+Jaroslava+Hlav%C3%A1c%CC%8Cov%C3%A1%2C+Mariia+Anisimova%2C+and+Tereza+Chlan%CC%8Cov%C3%A1%2E+2024%2E+Charles+Translator%3A)
18. Maja Popović. 2015. [chrF: character n-gram F-score for automatic MT evaluation](https://md.research.elamur.ai/free/en/papers/popovic-2015-chrf-character-n-gram-f/). In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395, Lisbon, Portugal. Association for Computational Linguistics.
19. D. K. Thennal, Chris Biemann, and Hans Ole Hatzel. 2026. Just Use XML: Revisiting Joint Translation and Label Projection. Preprint, arXiv:2603.12021. [find](https://scholar.google.com/scholar?q=D%2E+K%2E+Thennal%2C+Chris+Biemann%2C+and+Hans+Ole+Hatzel%2E+2026%2E+Just+Use+XML%3A+Revisiting+Joint+Translation+and+Label+Projection%2E+Preprint%2C+arXiv%3A2603%2E12021%2E)
20. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. [Attention is all you need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In Advances in Neural Information Processing Systems, volume 30.
21. Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, and Young Jin Kim. 2024. Contrastive preference optimization: Pushing the boundaries of LLM-based machine translation. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Au… [find](https://scholar.google.com/scholar?q=Haoran+Xu%2C+Amr+Sharaf%2C+Yunmo+Chen%2C+Weiting+Tan%2C+Lingfeng+Shen%2C+Benjamin+Van+Durme%2C+Kenton+Murray%2C+and+Young+Jin+Kim%2E+2024%2E+Contrastive+preference+optimization%3A+Pushing+the+boundaries+of+LLM%2Dbased+mach)
22. Thomas Zenkel, Joern Wuebker, and John DeNero. 2021. Automatic bilingual markup transfer. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 3524–3533, Punta Cana, Dominican Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Thomas+Zenkel%2C+Joern+Wuebker%2C+and+John+DeNero%2E+2021%2E+Automatic+bilingual+markup+transfer%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2021%2C+pages+3524%E2%80%933533%2C+Punta+Cana%2C+Dominic)

*Updated 1 November 2026*