---
title: "Tom Kocmi — all works — Elamur Research"
description: "All 26 works of Tom Kocmi in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/tom-kocmi/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/tom-kocmi/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Tom Kocmi](https://md.research.elamur.ai/free/en/authors/tom-kocmi/) / all works

# Tom Kocmi — all works

26 works · [← Tom Kocmi](https://md.research.elamur.ai/free/en/authors/tom-kocmi/)

1. **[Large Language Models Are State-of-the-Art Evaluators of Translation Quality ↗](https://aclanthology.org/2023.eamt-1.19/) Proceedings of the 24th Annual Conference of the European Association for Machine Translation · no summary yet**Tom Kocmi, Christian Federmann*2023 · 459 citations*
2. **[Findings of the 2020 Conference on Machine Translation (WMT20)](https://md.research.elamur.ai/free/en/papers/barrault-2020-findings-2020-conference-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, et al.*2020 · 403 citations*
3. **[To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation ↗](https://aclanthology.org/2021.wmt-1.57/) Proceedings of the Sixth Conference on Machine Translation · no summary yet**Tom Kocmi et al.*2021 · 269 citations*
4. [**Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust**Markus Freitag, Ricardo Rei, Nitika Mathur, et al.*Machine translation · 265 citations*](https://md.research.elamur.ai/free/en/papers/freitag-2022-results-wmt22-metrics-shared-task/)
5. **[GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4](https://md.research.elamur.ai/free/en/papers/kocmi-2023-gemba-mqm-detecting-translation-quality/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Christian Federmann*2023 · 192 citations*
6. **[Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet](https://md.research.elamur.ai/free/en/papers/kocmi-2024-findings-wmt24-general-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.*2024 · 178 citations*
7. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.*2023 · 155 citations*
8. **[Trivial Transfer Learning for Low-Resource Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/kocmi-2018-trivial-transfer-learning-low-resource/) [Conference on Machine Translation: Research Papers](https://md.research.elamur.ai/free/en/venues/conference-on-machine-translation-research-papers/)**Tom Kocmi, Ondřej Bojar*2018 · 141 citations*
9. **[Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models](https://md.research.elamur.ai/free/en/papers/lu-2024-error-analysis-prompting-enables-human/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Qingyu Lu, Baopu Qiu, Liang Ding, et al.*2024 · 136 citations*
10. **[Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/freitag-2024-are-llms-breaking-mt-metrics/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.*2024 · 107 citations*
11. **[NTREX-128 – News Test References for MT Evaluation of 128 Languages](https://md.research.elamur.ai/free/en/papers/federmann-2022-ntrex-128-news-test-references/) [Workshop on Scaling Up Multilingual Evaluation](https://md.research.elamur.ai/free/en/venues/sumeval/)**Christian Federmann, Tom Kocmi, Ying Xin*2022 · 104 citations*
12. **[Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/kocmi-2024-error-span-annotation-balanced-approach/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, et al.*2024 · 83 citations*
13. **[Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets](https://md.research.elamur.ai/free/en/papers/kocmi-2025-findings-wmt25-general-machine-translation/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, et al.*2025 · 73 citations*
14. **[Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗](https://aclanthology.org/2025.wmt-1.24/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Alon Lavie et al.*2025 · 39 citations*
15. **[AI-Assisted Human Evaluation of Machine Translation ↗](https://aclanthology.org/2025.naacl-long.255/) Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · no summary yet**Vilém Zouhar, Tom Kocmi, Mrinmaya Sachan*2025 · 31 citations*
16. **[Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets](https://md.research.elamur.ai/free/en/papers/moghe-2025-machine-translation-meta-evaluation-through/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Nikita Moghe, Arnisa Fazla, Chantal Amrhein, et al.*2025 · 28 citations*
17. **[MS-COMET: More and Better Human Judgements Improve Metric Performance ↗](https://aclanthology.org/2022.wmt-1.47/) Proceedings of the Seventh Conference on Machine Translation (WMT) · no summary yet**Tom Kocmi, Hitokazu Matsushita, Christian Federmann*2022 · 20 citations*
18. **[Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics ↗](https://aclanthology.org/2023.wmt-1.62/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt*2023 · 16 citations*
19. **[SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window ↗](https://aclanthology.org/2024.naacl-short.18/) Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers) · no summary yet**Vikas Raunak, Tom Kocmi, Matt Post*2024 · 15 citations*
20. **[Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference ↗](https://aclanthology.org/2023.eacl-main.95/) Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · no summary yet**Vilém Zouhar et al.*2023 · 15 citations*
21. **[Pearmut: Human Evaluation of Translation Made Trivial ↗](https://arxiv.org/abs/2601.02933) arXiv:2601.02933 · no summary yet**Vilem Zouhar, Tom Kocmi*2026 · 11 citations*
22. **[Searching for a Higher Power in the Human Evaluation of MT ↗](https://aclanthology.org/2022.wmt-1.7/) Proceedings of the Seventh Conference on Machine Translation (WMT) · no summary yet**Johnny Wei, Tom Kocmi, Christian Federmann*2022 · 10 citations*
23. **[Evaluating Metrics for Document-context Evaluation in Machine Translation ↗](https://aclanthology.org/2023.wmt-1.68/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Vikas Raunak, Tom Kocmi, Matt Post*2023 · 9 citations*
24. **[eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings ↗](https://aclanthology.org/2023.wmt-1.61/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Muhammad ElNokrashy, Tom Kocmi*2023 · 8 citations*
25. **[On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs ↗](https://aclanthology.org/2021.humeval-1.11/) Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval) · no summary yet**Roman Grundkiewicz et al.*2021 · 4 citations*
26. **[Contrastive ESA: Human Evaluation of Multiple Translations at Once ↗](https://arxiv.org/abs/2607.26640) arXiv:2607.26640 · no summary yet**Vilem Zouhar et al.*2026 · 1 citation*