---
title: "Ondřej Bojar — all works — Elamur Research"
description: "All 62 works of Ondřej Bojar in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/ondrej-bojar/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/ondrej-bojar/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Ondřej Bojar](https://md.research.elamur.ai/free/en/authors/ondrej-bojar/) / all works

# Ondřej Bojar — all works

62 works · [← Ondřej Bojar](https://md.research.elamur.ai/free/en/authors/ondrej-bojar/)

1. **[Moses: Open Source Toolkit for Statistical Machine Translation ↗](https://aclanthology.org/P07-2045/) Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions · no summary yet**Philipp Koehn et al.*2007 · 7,797 citations*
2. **[Findings of the 2016 Conference on Machine Translation](https://md.research.elamur.ai/free/en/papers/bojar-2016-findings-2016-conference-machine-translation/) [Conference on Machine Translation: Shared Task Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-shared-task-papers/)**Ondřej Bojar, Rajen Chatterjee, Christian Federmann, et al.*2016 · 940 citations*
3. **[Findings of the 2014 Workshop on Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/bojar-2014-findings-2014-workshop-statistical-machine/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ondřej Bojar, Christian Buck, Christian Federmann, et al.*2014 · 935 citations*
4. **[Findings of the 2019 Conference on Machine Translation (WMT19)](https://md.research.elamur.ai/free/en/papers/barrault-2019-findings-2019-conference-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, et al.*2019 · 847 citations*
5. **[Findings of the 2018 Conference on Machine Translation (WMT18)](https://md.research.elamur.ai/free/en/papers/bojar-2018-findings-2018-conference-machine-translation/) [Conference on Machine Translation: Shared Task Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-shared-task-papers/)**Ondřej Bojar, Christian Federmann, Mark Fishel, et al.*2018 · 753 citations*
6. **[Findings of the 2017 Conference on Machine Translation (WMT17)](https://md.research.elamur.ai/free/en/papers/bojar-2017-findings-2017-conference-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ondřej Bojar, Rajen Chatterjee, Christian Federmann, et al.*2017 · 691 citations*
7. **[Findings of the 2015 Workshop on Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/bojar-2015-findings-2015-workshop-statistical-machine/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ondřej Bojar, Rajen Chatterjee, Christian Federmann, et al.*2015 · 465 citations*
8. **[Findings of the 2013 Workshop on Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/bojar-2013-findings-2013-workshop-statistical-machine/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ondřej Bojar, Christian Buck, Chris Callison-Burch, et al.*2013 · 445 citations*
9. **[Findings of the 2020 Conference on Machine Translation (WMT20)](https://md.research.elamur.ai/free/en/papers/barrault-2020-findings-2020-conference-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, et al.*2020 · 403 citations*
10. **[Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals ↗](https://doi.org/10.1038/s41467-020-18073-9) Nature Communications 11:4381 · no summary yet**Martin Popel et al.*2020 · 374 citations*
11. **[Results of the WMT19 Metrics Shared Task: Segment-Level and Strong MT Systems Pose Big Challenges](https://md.research.elamur.ai/free/en/papers/ma-2019-results-wmt19-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Qingsong Ma, Johnny Wei, Ondřej Bojar, et al.*2019 · 285 citations*
12. **[Results of the WMT17 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/bojar-2017-results-wmt17-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ondřej Bojar, Yvette Graham, Amir Kamran*2017 · 212 citations*
13. **[Results of the WMT20 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/mathur-2020-results-wmt20-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Nitika Mathur, Johnny Wei, Markus Freitag, et al.*2020 · 195 citations*
14. **[Findings of the 2021 Conference on Machine Translation (WMT21)](https://md.research.elamur.ai/free/en/papers/akhbardeh-2021-findings-2021-conference-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, et al.*2021 · 189 citations*
15. **[Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet](https://md.research.elamur.ai/free/en/papers/kocmi-2024-findings-wmt24-general-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.*2024 · 178 citations*
16. **[Findings of the IWSLT 2022 Evaluation Campaign](https://md.research.elamur.ai/free/en/papers/anastasopoulos-2022-findings-iwslt-2022-evaluation-campaign/) [International Conference on Spoken Language Translation (IWSLT)](https://md.research.elamur.ai/free/en/venues/iwslt/)**Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, et al.*2022 · 177 citations*
17. **[Results of the WMT16 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/bojar-2016-results-wmt16-metrics-shared-task/) [Conference on Machine Translation: Shared Task Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-shared-task-papers/)**Ondřej Bojar, Yvette Graham, Amir Kamran, et al.*2016 · 177 citations*
18. **[Results of the WMT14 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/machacek-2014-results-wmt14-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Matouš Macháček, Ondřej Bojar*2014 · 176 citations*
19. **[Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain](https://md.research.elamur.ai/free/en/papers/freitag-2021-results-wmt21-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Ricardo Rei, Nitika Mathur, et al.*2021 · 169 citations*
20. **[Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance](https://md.research.elamur.ai/free/en/papers/ma-2018-results-wmt18-metrics-shared-task/) [Conference on Machine Translation: Shared Task Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-shared-task-papers/)**Qingsong Ma, Ondřej Bojar, Yvette Graham*2018 · 165 citations*
21. **[Results of the WMT15 Metrics Shared Task ↗](https://aclanthology.org/W15-3031/) Proceedings of the Tenth Workshop on Statistical Machine Translation · no summary yet**Miloš Stanojević et al.*2015 · 153 citations*
22. **[FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN](https://md.research.elamur.ai/free/en/papers/agarwal-2023-findings-iwslt-2023-evaluation-campaign/) [International Conference on Spoken Language Translation (IWSLT)](https://md.research.elamur.ai/free/en/venues/iwslt/)**Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, et al.*2023 · 152 citations*
23. **[Trivial Transfer Learning for Low-Resource Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/kocmi-2018-trivial-transfer-learning-low-resource/) [Conference on Machine Translation: Research Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-research-papers/)**Tom Kocmi, Ondřej Bojar*2018 · 141 citations*
24. **[Results of the WMT13 Metrics Shared Task ↗](https://aclanthology.org/W13-2202/) Proceedings of the Eighth Workshop on Statistical Machine Translation · no summary yet**Matouš Macháček, Ondřej Bojar*2013 · 112 citations*
25. [**Not an Interlingua, But Close: Comparison of English AMRs to Chinese and Czech**Nianwen Xue, Ondřej Bojar, Jan Hajič, et al.*Machine translation · 106 citations*](https://md.research.elamur.ai/free/en/papers/xue-2014-not-interlingua-but-close-comparison/)
26. **[Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets](https://md.research.elamur.ai/free/en/papers/kocmi-2025-findings-wmt25-general-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, et al.*2025 · 73 citations*
27. **[Findings of the WMT 2017 Biomedical Translation Shared Task](https://md.research.elamur.ai/free/en/papers/yepes-2017-findings-wmt-2017-biomedical-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Antonio Jimeno Yepes, Aurélie Névéol, Mariana Neves, et al.*2017 · 69 citations*
28. **[A Fine-Grained Analysis of BERTScore](https://md.research.elamur.ai/free/en/papers/hanna-2021-fine-grained-analysis-bertscore/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Michael Hanna, Ondřej Bojar*2021 · 63 citations*
29. [**HUME: Human UCCA-Based Evaluation of Machine Translation**Alexandra Birch, Omri Abend, Ondřej Bojar, et al.*Machine translation · 58 citations*](https://md.research.elamur.ai/free/en/papers/birch-2016-hume-human-ucca-based-evaluation/)
30. [**Phrase-Based and Deep Syntactic English-to-Czech Statistical Machine Translation**Ondřej Bojar, Jan Hajič*Machine translation · 37 citations*](https://md.research.elamur.ai/free/en/papers/bojar-2008-phrase-based-deep-syntactic-english/)
31. **[SAO WMT19 Test Suite: Machine Translation of Audit Reports ↗](https://aclanthology.org/W19-5355/) Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1) · no summary yet**Tereza Vojtěchová et al.*2019 · 31 citations*
32. **[Tackling Sparse Data Issue in Machine Translation Evaluation ↗](https://aclanthology.org/P10-2016/) Proceedings of the ACL 2010 Conference Short Papers · no summary yet**Ondřej Bojar, Kamil Kos, David Mareček*2010 · 31 citations*
33. **[Speech Translation and Metrics in 2026: Findings of the IWSLT Campaign ↗](https://aclanthology.org/2026.iwslt-1.39/) Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026) · no summary yet**David Ifeoluwa Adelani et al.*2026 · 30 citations*
34. **[Neural Machine Translation Quality and Post-Editing Performance ↗](https://aclanthology.org/2021.emnlp-main.801/) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yet**Vilém Zouhar et al.*2021 · 30 citations*
35. **[Terra: a Collection of Translation Error-Annotated Corpora ↗](https://aclanthology.org/L12-1260/) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) · no summary yet**Mark Fishel, Ondřej Bojar, Maja Popović*2012 · 29 citations*
36. **[TerrorCat: a Translation Error Categorization-based MT Quality Metric ↗](https://aclanthology.org/W12-3105/) Proceedings of the Seventh Workshop on Statistical Machine Translation · no summary yet**Mark Fishel et al.*2012 · 27 citations*
37. **[Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation ↗](https://aclanthology.org/2022.lrec-1.694/) Proceedings of the Thirteenth Language Resources and Evaluation Conference · no summary yet**Idris Abdulmumin et al.*2022 · 21 citations*
38. **[SLTEV: Comprehensive Evaluation of Spoken Language Translation ↗](https://aclanthology.org/2021.eacl-demos.9/) Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations · no summary yet**Ebrahim Ansari et al.*2021 · 20 citations*
39. [**Automatic MT Error Analysis: Hjerson Helping Addicter**Jan Berka, Ondřej Bojar, Mark Fishel, et al.*Machine translation · 17 citations*](https://md.research.elamur.ai/free/en/papers/berka-2012-automatic-mt-error-analysis-hjerson/)
40. **[Towards a Predicate-Argument Evaluation for MT ↗](https://aclanthology.org/W12-4204/) Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yet**Ondřej Bojar, Dekai Wu*2012 · 16 citations*
41. **[MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation ↗](https://aclanthology.org/2023.iwslt-1.12/) Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023) · no summary yet**Dominik Macháček, Ondřej Bojar, Raj Dabre*2023 · 15 citations*
42. **[A Test Suite and Manual Evaluation of Document-Level NMT at WMT19 ↗](https://aclanthology.org/W19-5352/) Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1) · no summary yet**Kateřina Rysová et al.*2019 · 14 citations*
43. **[Approximating a Deep-Syntactic Metric for MT Evaluation and Tuning ↗](https://aclanthology.org/W11-2108/) Proceedings of the Sixth Workshop on Statistical Machine Translation · no summary yet**Matouš Macháček, Ondřej Bojar*2011 · 14 citations*
44. **[Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation ↗](https://aclanthology.org/2024.lrec-main.575/) Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) · no summary yet**Matthias Sperber et al.*2024 · 10 citations*
45. **[Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation ↗](https://aclanthology.org/2023.acl-long.122/) Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Josef Jon, Ondřej Bojar*2023 · 10 citations*
46. **[Bilingual Embeddings and Word Alignments for Translation Quality Estimation ↗](https://aclanthology.org/W16-2380/) Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers · no summary yet**Amal Abdelsalam, Ondřej Bojar, Samhaa El-Beltagy*2016 · 10 citations*
47. **[Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translation ↗](https://arxiv.org/abs/2509.17349) arXiv:2509.17349 · no summary yet**Peter Polak et al.*2025 · 9 citations*
48. **[Quality and Quantity of Machine Translation References for Automatic Metrics ↗](https://aclanthology.org/2024.humeval-1.1/) Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024 · no summary yet**Vilém Zouhar, Ondřej Bojar*2024 · 9 citations*
49. **[Automated Evaluation Metric for Terminology Consistency in MT ↗](https://aclanthology.org/2022.wmt-1.41/) Proceedings of the Seventh Conference on Machine Translation (WMT) · no summary yet**Kirill Semenov, Ondřej Bojar*2022 · 9 citations*
50. **[Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation ↗](https://aclanthology.org/2022.wmt-1.9/) Proceedings of the Seventh Conference on Machine Translation (WMT) · no summary yet**Dávid Javorský, Dominik Macháček, Ondřej Bojar*2022 · 8 citations*
51. **[Evaluating Optimal Reference Translations ↗](https://arxiv.org/abs/2311.16787) arXiv:2311.16787 · no summary yet**Vilem Zouhar et al.*2023 · 5 citations*
52. **[CUNI and Phrase at WMT25 MT Evaluation Task ↗](https://aclanthology.org/2025.wmt-1.68/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Miroslav Hrabal et al.*2025 · 4 citations*
53. **[Current state of LLMs for Arabic dialectal machine translation](https://md.research.elamur.ai/free/en/papers/jon-2026-current-state-llms-arabic-dialectal/) [Workshop on NLP for Languages Using Arabic Script](https://md.research.elamur.ai/free/en/venues/abjadnlp/)**Josef Jon, Rawan Bondok, Ondřej Bojar*2026 · 2 citations*
54. **[Explainable Quality Estimation: CUNI Eval4NLP Submission ↗](https://aclanthology.org/2021.eval4nlp-1.24/) Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems · no summary yet**Peter Polák, Muskaan Singh, Ondřej Bojar*2021 · 2 citations*
55. **[GAATME: A Genetic Algorithm for Adversarial Translation Metrics Evaluation ↗](https://aclanthology.org/2024.lrec-main.668/) Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) · no summary yet**Josef Jon, Ondřej Bojar*2024 · 1 citation*
56. **[Robustness of Multi-Source MT to Transcription Errors ↗](https://aclanthology.org/2023.findings-acl.228/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Dominik Macháček et al.*2023 · 1 citation*
57. **[Machine Translation for Low-Resource Languages through Monolingual Data and LLM: A Case Study of English-to-Basque](https://md.research.elamur.ai/free/en/papers/luu-2026-machine-translation-low-resource-languages/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Nam Luu, Aitor Soroa, German Rigau, et al.*2026*
58. **[Training data generation for context-dependent rubric-based short answer grading](https://md.research.elamur.ai/free/en/papers/sindelar-2026-training-data-generation-context-dependent/) [Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC](https://md.research.elamur.ai/free/en/venues/dtf/)**Pavel Šindelář, Filip Prášil, Dávid Slivka, et al.*2026*
59. **[Eye tracking for Machine Translation Quality Evaluation ↗](https://aclanthology.org/2026.gaze4nlp-1.1/) Proceedings fo the Second International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP · no summary yet**Natalia Glazyrina, Ondřej Bojar*2026*
60. **[Last Translation Benchmark ↗](https://arxiv.org/abs/2609.04173) arXiv:2609.04173 · no summary yet**Vilem Zouhar et al.*2026*
61. **[Intrinsic vs. Extrinsic Evaluation of Czech Sentence Embeddings: Semantic Relevance Doesn't Help with MT Evaluation ↗](https://aclanthology.org/2025.mtsummit-1.20/) Proceedings of Machine Translation Summit XX: Volume 1 · no summary yet**Petra Barančíková, Ondřej Bojar*2025*
62. **[CUBBITT Translation Models (en-fr) (v1.0) ↗](http://hdl.handle.net/11234/1-3743) Lindat/Clarin Repository (Lindat Clarin) · no summary yet**Martin Popel et al.*2021*