---
title: "WMT 2023 — accepted papers — Elamur Research"
description: "WMT 2023 — accepted papers: 11 papers in the Elamur Research library (Singapore), with our summaries, ranked by citations."
canonical: "https://research.elamur.ai/free/en/venues/wmt/2023/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/wmt/2023/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [WMT](https://md.research.elamur.ai/free/en/venues/wmt/) / 2023

# WMT 2023 — accepted papers

WMT 2023 is the 2023 edition of the Conference on Machine Translation (WMT), held in Singapore, December 2023 (publisher: Association for Computational Linguistics). The ACL Anthology lists 100 papers of it; our library holds 11 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 [Singapore](https://md.research.elamur.ai/free/en/countries/singapore/) · 🗓 December 2023

[**100** papers in the proceedings](#all) · [**11** works in our library](https://md.research.elamur.ai/free/en/venues/wmt/2023/#works) · [**1,309** citations of these works](https://md.research.elamur.ai/free/en/venues/wmt/2023/#works)

## Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. **[Findings of the WMT 2023 Shared Task on Quality Estimation](https://md.research.elamur.ai/free/en/papers/blain-2023-findings-wmt-2023-shared-task/)**Frederic Blain, Chrysoula Zerva, Ricardo Rei et al.*73 citations · our summary*
2. **[Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist](https://md.research.elamur.ai/free/en/papers/karpinska-2023-large-language-models-effectively-leverage/)**Marzena Karpinska, Mohit Iyyer*65 citations · our summary*
3. **[ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages](https://md.research.elamur.ai/free/en/papers/robinson-2023-chatgpt-mt-competitive-high-but/)**Nathaniel Robinson, Perez Ogayo, David R. Mortensen et al.*51 citations · our summary*
4. **[Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA ↗](https://aclanthology.org/2023.wmt-1.43/)**Xuan Zhang, Navid Rajabi, Kevin Duh et al.*42 citations*
5. **[Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet ↗](https://aclanthology.org/2023.wmt-1.1/)**Tom Kocmi, Eleftherios Avramidis, Rachel Bawden et al.*38 citations*
6. **[GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4](https://md.research.elamur.ai/free/en/papers/kocmi-2023-gemba-mqm-detecting-translation-quality/)**Tom Kocmi, Christian Federmann*36 citations · our summary*
7. **[The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-devil-is-errors-leveraging-large/)**Patrick Fernandes, Daniel Deutsch, Mara Finkelstein et al.*33 citations · our summary*
8. **[Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings ↗](https://aclanthology.org/2023.wmt-1.15/)**Yangjian Wu, Gang Hu*28 citations*
9. **[Domain Terminology Integration into Machine Translation: Leveraging Large Language Models ↗](https://aclanthology.org/2023.wmt-1.82/)**Yasmin Moslem, Gianfranco Romani, Mahdi Molaei et al.*25 citations*
10. **[Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? ↗](https://aclanthology.org/2023.wmt-1.23/)**Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz et al.*20 citations*

## All accepted papers (100)

The most cited first; 11 with our summary link to their page here, the others to the original.

1. **[Findings of the WMT 2023 Shared Task on Quality Estimation](https://md.research.elamur.ai/free/en/papers/blain-2023-findings-wmt-2023-shared-task/)**Frederic Blain, Chrysoula Zerva, Ricardo Rei et al.*73 citations · our summary*
2. **[Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist](https://md.research.elamur.ai/free/en/papers/karpinska-2023-large-language-models-effectively-leverage/)**Marzena Karpinska, Mohit Iyyer*65 citations · our summary*
3. **[ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages](https://md.research.elamur.ai/free/en/papers/robinson-2023-chatgpt-mt-competitive-high-but/)**Nathaniel Robinson, Perez Ogayo, David R. Mortensen et al.*51 citations · our summary*
4. **[Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA ↗](https://aclanthology.org/2023.wmt-1.43/)**Xuan Zhang, Navid Rajabi, Kevin Duh et al.*42 citations*
5. **[Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet ↗](https://aclanthology.org/2023.wmt-1.1/)**Tom Kocmi, Eleftherios Avramidis, Rachel Bawden et al.*38 citations*
6. **[GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4](https://md.research.elamur.ai/free/en/papers/kocmi-2023-gemba-mqm-detecting-translation-quality/)**Tom Kocmi, Christian Federmann*36 citations · our summary*
7. **[The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-devil-is-errors-leveraging-large/)**Patrick Fernandes, Daniel Deutsch, Mara Finkelstein et al.*33 citations · our summary*
8. **[Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings ↗](https://aclanthology.org/2023.wmt-1.15/)**Yangjian Wu, Gang Hu*28 citations*
9. **[Domain Terminology Integration into Machine Translation: Leveraging Large Language Models ↗](https://aclanthology.org/2023.wmt-1.82/)**Yasmin Moslem, Gianfranco Romani, Mahdi Molaei et al.*25 citations*
10. **[Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? ↗](https://aclanthology.org/2023.wmt-1.23/)**Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz et al.*20 citations*
11. **[Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task](https://md.research.elamur.ai/free/en/papers/rei-2023-scaling-up-cometkiwi-unbabel-ist/)**Ricardo Rei, Nuno M. Guerreiro, José Pombal et al.*20 citations · our summary*
12. **[Findings of the WMT 2023 Shared Task on Automatic Post-Editing ↗](https://aclanthology.org/2023.wmt-1.55/)**Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag et al.*17 citations*
13. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo et al.*17 citations · our summary*
14. **[Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)](https://md.research.elamur.ai/free/en/papers/muller-2023-findings-second-wmt-shared-task/)**Mathias Müller, Malihe Alikhani, Eleftherios Avramidis et al.*16 citations · our summary*
15. **[Towards Effective Disambiguation for Machine Translation with Large Language Models](https://md.research.elamur.ai/free/en/papers/iyer-2023-effective-disambiguation-machine-translation-large/)**Vivek Iyer, Pinzhen Chen, Alexandra Birch*13 citations · our summary*
16. **[Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation](https://md.research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/)**Santanu Pal, Partha Pakray, Sahinur Rahman Laskar et al.*11 citations · our summary*
17. **[HW-TSC's Participation in the WMT 2023 Automatic Post Editing Shared Task ↗](https://aclanthology.org/2023.wmt-1.85/)**Jiawei Yu, Min Zhang, Zhao Yanqing et al.*11 citations*
18. **[One Wide Feedforward Is All You Need ↗](https://aclanthology.org/2023.wmt-1.98/)**Telmo Pires, António Vilarinho Lopes, Yannick Assogba et al.*11 citations*
19. **[MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2023-metricx-23-google-submission-wmt/)**Juraj Juraska, Mara Finkelstein, Daniel Deutsch et al.*8 citations · our summary*
20. **[Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics ↗](https://aclanthology.org/2023.wmt-1.62/)**Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt*7 citations*
21. **[Findings of the Word-Level AutoCompletion Shared Task in WMT 2023 ↗](https://aclanthology.org/2023.wmt-1.53/)**Lemao Liu, Francisco Casacuberta, George Foster et al.*7 citations*
22. **[Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting ↗](https://aclanthology.org/2023.wmt-1.80/)**Nikolay Bogoychev, Pinzhen Chen*7 citations*
23. **[Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level ↗](https://aclanthology.org/2023.wmt-1.96/)**Daniel Deutsch, Juraj Juraska, Mara Finkelstein et al.*7 citations*
24. **[Embed_Llama: Using LLM Embeddings for the Metrics Shared Task ↗](https://aclanthology.org/2023.wmt-1.60/)**Sören Dreano, Derek Molloy, Noel Murphy*6 citations*
25. **[Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs ↗](https://aclanthology.org/2023.wmt-1.3/)**Longyue Wang, Zhaopeng Tu, Yan Gu et al.*6 citations*

[See all 100 papers in WMT 2023 — accepted papers →](https://md.research.elamur.ai/free/en/venues/wmt/2023/papers/)

## Papers with our summary in our library (11)

The most cited first (OpenAlex citations plus our library's).

1. **[GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4](https://md.research.elamur.ai/free/en/papers/kocmi-2023-gemba-mqm-detecting-translation-quality/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Tom Kocmi, Christian Federmann*2023 · 191 citations*
2. **[The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-devil-is-errors-leveraging-large/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.*2023 · 156 citations*
3. **[Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist](https://md.research.elamur.ai/free/en/papers/karpinska-2023-large-language-models-effectively-leverage/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Marzena Karpinska, Mohit Iyyer*2023 · 156 citations*
4. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.*2023 · 155 citations*
5. **[ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages](https://md.research.elamur.ai/free/en/papers/robinson-2023-chatgpt-mt-competitive-high-but/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Nathaniel Robinson, Perez Ogayo, David R. Mortensen, et al.*2023 · 151 citations*
6. **[Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task](https://md.research.elamur.ai/free/en/papers/rei-2023-scaling-up-cometkiwi-unbabel-ist/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Ricardo Rei, Nuno M. Guerreiro, José Pombal, et al.*2023 · 135 citations*
7. **[Findings of the WMT 2023 Shared Task on Quality Estimation](https://md.research.elamur.ai/free/en/papers/blain-2023-findings-wmt-2023-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Frederic Blain, Chrysoula Zerva, Ricardo Rei, et al.*2023 · 129 citations*
8. **[MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2023-metricx-23-google-submission-wmt/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Juraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.*2023 · 118 citations*
9. **[Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation](https://md.research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Santanu Pal, Partha Pakray, Sahinur Rahman Laskar, et al.*2023 · 41 citations*
10. **[Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)](https://md.research.elamur.ai/free/en/papers/muller-2023-findings-second-wmt-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, et al.*2023 · 39 citations*
11. **[Towards Effective Disambiguation for Machine Translation with Large Language Models](https://md.research.elamur.ai/free/en/papers/iyer-2023-effective-disambiguation-machine-translation-large/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Vivek Iyer, Pinzhen Chen, Alexandra Birch*2023 · 38 citations*

## Top topics

Topics of its works in our library, with the number of works on each.

[Machine translation (10)](https://md.research.elamur.ai/free/en/topics/machine-translation/) · [Evaluation & benchmarks (8)](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Low-resource languages (2)](https://md.research.elamur.ai/free/en/topics/low-resource-languages/)

## Fields

[Arts and Humanities (11)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science (11)](https://md.research.elamur.ai/free/en/shelves/computer-science/)

## Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

[🧑‍🔬**Daniel Deutsch**3 works here · 429 citations](https://md.research.elamur.ai/free/en/authors/daniel-deutsch/) · [🧑‍🔬**Markus Freitag**3 works here · 429 citations](https://md.research.elamur.ai/free/en/authors/markus-freitag/) · [🧑‍🔬**André F. T. Martins**3 works here · 420 citations](https://md.research.elamur.ai/free/en/authors/andre-f-t-martins/) · [🧑‍🔬**Ricardo Rei**3 works here · 419 citations](https://md.research.elamur.ai/free/en/authors/ricardo-rei/) · [🧑‍🔬**Tom Kocmi**2 works here · 346 citations](https://md.research.elamur.ai/free/en/authors/tom-kocmi/) · [🧑‍🔬**Graham Neubig**2 works here · 307 citations](https://md.research.elamur.ai/free/en/authors/graham-neubig/) · [🧑‍🔬**Chrysoula Zerva**2 works here · 284 citations](https://md.research.elamur.ai/free/en/authors/chrysoula-zerva/) · [🧑‍🔬**Frederic Blain**2 works here · 284 citations](https://md.research.elamur.ai/free/en/authors/frederic-blain/) · [🧑‍🔬**Mara Finkelstein**2 works here · 274 citations](https://md.research.elamur.ai/free/en/authors/mara-finkelstein/) · [🧑‍🔬**José G. C. de Souza**2 works here · 264 citations](https://md.research.elamur.ai/free/en/authors/jose-g-c-de-souza/) · [🧑‍🔬**Nuno M. Guerreiro**2 works here · 264 citations](https://md.research.elamur.ai/free/en/authors/nuno-m-guerreiro/) · [🧑‍🔬**Eleftherios Avramidis**2 works here · 194 citations](https://md.research.elamur.ai/free/en/authors/eleftherios-avramidis/)

## Top institutions

Institutions on the bylines of its works here, by the number of works.

[🎓**Instituto Superior Técnico** Lisbon · Portugal 4 works here](https://md.research.elamur.ai/free/en/universities/instituto-superior-tecnico/) · [🎓**Tilburg University** Tilburg · Netherlands 3 works here](https://md.research.elamur.ai/free/en/universities/tilburg-university/) · [🔬**Instituto de Telecomunicações** Lisbon · Portugal 3 works here](https://md.research.elamur.ai/free/en/labs/instituto-de-telecomunicacoes/) · [🔬**Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento** Lisbon · Portugal 2 works here](https://md.research.elamur.ai/free/en/labs/instituto-de-engenharia-de-sistemas-e-computadores-investigacao-e/) · [🏢**Microsoft** Redmond · United States 2 works here](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🎓**Université Paris-Saclay** Gif-sur-Yvette · France 2 works here](https://md.research.elamur.ai/free/en/universities/universite-paris-saclay/) · [🎓**University of Surrey** Guildford · United Kingdom 2 works here](https://md.research.elamur.ai/free/en/universities/university-of-surrey/) · [🔬**German Research Centre for Artificial Intelligence** Kaiserslautern · Germany 2 works here](https://md.research.elamur.ai/free/en/labs/german-research-centre-for-artificial-intelligence/) · [🎓**Carnegie Mellon University** Pittsburgh · United States 2 works here](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🎓**Northeastern University** Boston · United States 1 work here](https://md.research.elamur.ai/free/en/universities/northeastern-university/) · [🏢**Google** Mountain View · United States 1 work here](https://md.research.elamur.ai/free/en/companies/google/) · [🏢**Amazon** Seattle · United States 1 work here](https://md.research.elamur.ai/free/en/companies/amazon/)

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

- [← previous WMT 2022](https://md.research.elamur.ai/free/en/venues/wmt/2022/)
- [next → WMT 2024](https://md.research.elamur.ai/free/en/venues/wmt/2024/)
- [↑ back to WMT](https://md.research.elamur.ai/free/en/venues/wmt/)