---
title: "WMT 2023 — all accepted papers with summaries and citations"
description: "All 100 papers of WMT 2023, the most cited first; those with our summary link to it. Among them: Findings of the WMT 2023 Shared Task on…"
canonical: "https://research.elamur.ai/free/en/venues/wmt/2023/papers/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/wmt/2023/papers/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [WMT](https://md.research.elamur.ai/free/en/venues/wmt/) / [2023](https://md.research.elamur.ai/free/en/venues/wmt/2023/) / papers

# WMT 2023: all accepted papers

100 papers · the most cited first · [← WMT 2023](https://md.research.elamur.ai/free/en/venues/wmt/2023/)

1. **[Findings of the WMT 2023 Shared Task on Quality Estimation](https://md.research.elamur.ai/free/en/papers/blain-2023-findings-wmt-2023-shared-task/)**Frederic Blain, Chrysoula Zerva, Ricardo Rei et al.*73 citations · our summary*
2. **[Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist](https://md.research.elamur.ai/free/en/papers/karpinska-2023-large-language-models-effectively-leverage/)**Marzena Karpinska, Mohit Iyyer*65 citations · our summary*
3. **[ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages](https://md.research.elamur.ai/free/en/papers/robinson-2023-chatgpt-mt-competitive-high-but/)**Nathaniel Robinson, Perez Ogayo, David R. Mortensen et al.*51 citations · our summary*
4. **[Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA ↗](https://aclanthology.org/2023.wmt-1.43/)**Xuan Zhang, Navid Rajabi, Kevin Duh et al.*42 citations*
5. **[Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet ↗](https://aclanthology.org/2023.wmt-1.1/)**Tom Kocmi, Eleftherios Avramidis, Rachel Bawden et al.*38 citations*
6. **[GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4](https://md.research.elamur.ai/free/en/papers/kocmi-2023-gemba-mqm-detecting-translation-quality/)**Tom Kocmi, Christian Federmann*36 citations · our summary*
7. **[The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-devil-is-errors-leveraging-large/)**Patrick Fernandes, Daniel Deutsch, Mara Finkelstein et al.*33 citations · our summary*
8. **[Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings ↗](https://aclanthology.org/2023.wmt-1.15/)**Yangjian Wu, Gang Hu*28 citations*
9. **[Domain Terminology Integration into Machine Translation: Leveraging Large Language Models ↗](https://aclanthology.org/2023.wmt-1.82/)**Yasmin Moslem, Gianfranco Romani, Mahdi Molaei et al.*25 citations*
10. **[Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? ↗](https://aclanthology.org/2023.wmt-1.23/)**Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz et al.*20 citations*
11. **[Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task](https://md.research.elamur.ai/free/en/papers/rei-2023-scaling-up-cometkiwi-unbabel-ist/)**Ricardo Rei, Nuno M. Guerreiro, José Pombal et al.*20 citations · our summary*
12. **[Findings of the WMT 2023 Shared Task on Automatic Post-Editing ↗](https://aclanthology.org/2023.wmt-1.55/)**Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag et al.*17 citations*
13. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo et al.*17 citations · our summary*
14. **[Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)](https://md.research.elamur.ai/free/en/papers/muller-2023-findings-second-wmt-shared-task/)**Mathias Müller, Malihe Alikhani, Eleftherios Avramidis et al.*16 citations · our summary*
15. **[Towards Effective Disambiguation for Machine Translation with Large Language Models](https://md.research.elamur.ai/free/en/papers/iyer-2023-effective-disambiguation-machine-translation-large/)**Vivek Iyer, Pinzhen Chen, Alexandra Birch*13 citations · our summary*
16. **[Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation](https://md.research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/)**Santanu Pal, Partha Pakray, Sahinur Rahman Laskar et al.*11 citations · our summary*
17. **[HW-TSC's Participation in the WMT 2023 Automatic Post Editing Shared Task ↗](https://aclanthology.org/2023.wmt-1.85/)**Jiawei Yu, Min Zhang, Zhao Yanqing et al.*11 citations*
18. **[One Wide Feedforward Is All You Need ↗](https://aclanthology.org/2023.wmt-1.98/)**Telmo Pires, António Vilarinho Lopes, Yannick Assogba et al.*11 citations*
19. **[MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2023-metricx-23-google-submission-wmt/)**Juraj Juraska, Mara Finkelstein, Daniel Deutsch et al.*8 citations · our summary*
20. **[Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics ↗](https://aclanthology.org/2023.wmt-1.62/)**Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt*7 citations*
21. **[Findings of the Word-Level AutoCompletion Shared Task in WMT 2023 ↗](https://aclanthology.org/2023.wmt-1.53/)**Lemao Liu, Francisco Casacuberta, George Foster et al.*7 citations*
22. **[Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting ↗](https://aclanthology.org/2023.wmt-1.80/)**Nikolay Bogoychev, Pinzhen Chen*7 citations*
23. **[Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level ↗](https://aclanthology.org/2023.wmt-1.96/)**Daniel Deutsch, Juraj Juraska, Mara Finkelstein et al.*7 citations*
24. **[Embed_Llama: Using LLM Embeddings for the Metrics Shared Task ↗](https://aclanthology.org/2023.wmt-1.60/)**Sören Dreano, Derek Molloy, Noel Murphy*6 citations*
25. **[Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs ↗](https://aclanthology.org/2023.wmt-1.3/)**Longyue Wang, Zhaopeng Tu, Yan Gu et al.*6 citations*
26. **[GUIT-NLP's Submission to Shared Task: Low Resource Indic Language Translation ↗](https://aclanthology.org/2023.wmt-1.87/)**Mazida Akhtara Ahmed, Kuwali Talukdar, Parvez Aziz Boruah et al.*6 citations*
27. **[Empowering a Metric with LLM-assisted Named Entity Annotation: HW-TSC's Submission to the WMT23 Metrics Shared Task ↗](https://aclanthology.org/2023.wmt-1.70/)**Zhanglin Wu, Yilun Liu, Min Zhang et al.*5 citations*
28. **[MEE4 and XLsim : IIIT HYD's Submissions' for WMT23 Metrics Shared Task ↗](https://aclanthology.org/2023.wmt-1.66/)**Ananya Mukherjee, Manish Shrivastava*5 citations*
29. **[Quality Estimation Using Minimum Bayes Risk ↗](https://aclanthology.org/2023.wmt-1.67/)**Subhajit Naskar, Daniel Deutsch, Markus Freitag*5 citations*
30. **[AIST AIRC Submissions to the WMT23 Shared Task ↗](https://aclanthology.org/2023.wmt-1.13/)**Matiss Rikters, Makoto Miwa*4 citations*
31. **[Achieving State-of-the-Art Multilingual Translation Model with Minimal Data and Parameters ↗](https://aclanthology.org/2023.wmt-1.18/)**Hui Zeng*4 citations*
32. **[Document-Level Language Models for Machine Translation ↗](https://aclanthology.org/2023.wmt-1.39/)**Frithjof Petrick, Christian Herold, Pavel Petrushkov et al.*4 citations*
33. **[Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies ↗](https://aclanthology.org/2023.wmt-1.54/)**Kirill Semenov, Vilém Zouhar, Tom Kocmi et al.*4 citations*
34. **[KYB General Machine Translation Systems for WMT23 ↗](https://aclanthology.org/2023.wmt-1.10/)**Ben Li, Yoko Matsuzaki, Shivam Kalkar*4 citations*
35. **[Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality ↗](https://aclanthology.org/2023.wmt-1.65/)**Chi-kiu Lo, Samuel Larkin, Rebecca Knowles*4 citations*
36. **[Neural Machine Translation for English - Manipuri and English - Assamese ↗](https://aclanthology.org/2023.wmt-1.86/)**Goutam Agrawal, Rituraj Das, Anupam Biswas et al.*4 citations*
37. **[PRHLT's Submission to WLAC 2023 ↗](https://aclanthology.org/2023.wmt-1.78/)**Angel Navarro, Miguel Domingo, Francisco Casacuberta*4 citations*
38. **[PROMT Systems for WMT23 Shared General Translation Task ↗](https://aclanthology.org/2023.wmt-1.12/)**Alexander Molchanov, Vladislav Kovalenko*4 citations*
39. **[Treating General MT Shared Task as a Multi-Domain Adaptation Problem: HW-TSC's Submission to the WMT23 General MT Shared Task ↗](https://aclanthology.org/2023.wmt-1.16/)**Zhanglin Wu, Daimeng Wei, Zongyao Li et al.*4 citations*
40. **[eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings ↗](https://aclanthology.org/2023.wmt-1.61/)**Muhammad ElNokrashy, Tom Kocmi*4 citations*
41. **[ACES: Translation Accuracy Challenge Sets at WMT 2023 ↗](https://aclanthology.org/2023.wmt-1.57/)**Chantal Amrhein, Nikita Moghe, Liane Guillou*3 citations*
42. **[Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective ↗](https://aclanthology.org/2023.wmt-1.58/)**Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz et al.*3 citations*
43. **[Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System ↗](https://aclanthology.org/2023.wmt-1.2/)**Mariana Neves, Antonio Jimeno Yepes, Aurélie Névéol et al.*3 citations*
44. **[HW-TSC 2023 Submission for the Quality Estimation Shared Task ↗](https://aclanthology.org/2023.wmt-1.72/)**Yuang Li, Chang Su, Ming Zhu et al.*3 citations*
45. **[IACS-LRILT: Machine Translation for Low-Resource Indic Languages ↗](https://aclanthology.org/2023.wmt-1.93/)**Dhairya Suman, Atanu Mandal, Santanu Pal et al.*3 citations*
46. **[Identifying Context-Dependent Translations for Evaluation Set Production ↗](https://aclanthology.org/2023.wmt-1.42/)**Rachel Wicks, Matt Post*3 citations*
47. **[KnowComp Submission for WMT23 Sign Language Translation Task ↗](https://aclanthology.org/2023.wmt-1.36/)**Baixuan Xu, Haochen Shi, Tianshi Zheng et al.*3 citations*
48. **[MUNI-NLP Systems for Low-resource Indic Machine Translation ↗](https://aclanthology.org/2023.wmt-1.91/)**Edoardo Signoroni, Pavel Rychly*3 citations*
49. **[Machine Translation Advancements for Low-Resource Indian Languages in WMT23: CFILT-IITB's Effort for Bridging the Gap ↗](https://aclanthology.org/2023.wmt-1.89/)**Meet Doshi, Pranav Gaikwad, Sourabh Deoghare et al.*3 citations*
50. **[NAIST-NICT WMT'23 General MT Task Submission ↗](https://aclanthology.org/2023.wmt-1.7/)**Hiroyuki Deguchi, Kenji Imamura, Yuto Nishida et al.*3 citations*
51. **[RoCS-MT: Robustness Challenge Set for Machine Translation ↗](https://aclanthology.org/2023.wmt-1.21/)**Rachel Bawden, Benoît Sagot*3 citations*
52. **[SKIM at WMT 2023 General Translation Task ↗](https://aclanthology.org/2023.wmt-1.9/)**Keito Kudo, Takumi Ito, Makoto Morishita et al.*3 citations*
53. **[Semantically-Informed Regressive Encoder Score ↗](https://aclanthology.org/2023.wmt-1.69/)**Vasiliy Viskov, George Kokush, Daniil Larionov et al.*3 citations*
54. **[Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES ↗](https://aclanthology.org/2023.wmt-1.25/)**Beatrice Savoldi, Marco Gaido, Matteo Negri et al.*3 citations*
55. **[UvA-MT's Participation in the WMT 2023 General Translation Shared Task ↗](https://aclanthology.org/2023.wmt-1.17/)**Di Wu, Shaomu Tan, David Stap et al.*3 citations*
56. **[Yishu: Yishu at WMT2023 Translation Task ↗](https://aclanthology.org/2023.wmt-1.11/)**Luo Min, Yixin Tan, Qiulin Chen*3 citations*
57. **[DUTNLP System for the WMT2023 Discourse-Level Literary Translation ↗](https://aclanthology.org/2023.wmt-1.31/)**Anqi Zhao, Kaiyu Huang, Hao Yu et al.*2 citations*
58. **[Evaluating Metrics for Document-context Evaluation in Machine Translation ↗](https://aclanthology.org/2023.wmt-1.68/)**Vikas Raunak, Tom Kocmi, Matt Post*2 citations*
59. **[Findings of the WMT 2023 Shared Task on Parallel Data Curation ↗](https://aclanthology.org/2023.wmt-1.5/)**Steve Sloto, Brian Thompson, Huda Khayrallah et al.*2 citations*
60. **[IOL Research Machine Translation Systems for WMT23 General Machine Translation Shared Task ↗](https://aclanthology.org/2023.wmt-1.19/)**Wenbo Zhang*2 citations*
61. **[IOL Research's Submission for WMT 2023 Quality Estimation Shared Task ↗](https://aclanthology.org/2023.wmt-1.76/)**Zeyu Yan*2 citations*
62. **[Low-Resource Machine Translation Systems for Indic Languages ↗](https://aclanthology.org/2023.wmt-1.90/)**Ivana Kvapilíková, Ondřej Bojar*2 citations*
63. **[MUNI-NLP Submission for Czech-Ukrainian Translation Task at WMT23 ↗](https://aclanthology.org/2023.wmt-1.14/)**Pavel Rychly, Yuliia Teslia*2 citations*
64. **[Multifaceted Challenge Set for Evaluating Machine Translation Performance ↗](https://aclanthology.org/2023.wmt-1.22/)**Xiaoyu Chen, Daimeng Wei, Zhanglin Wu et al.*2 citations*
65. **[NITS-CNLP Low-Resource Neural Machine Translation Systems of English-Manipuri Language Pair ↗](https://aclanthology.org/2023.wmt-1.92/)**Kshetrimayum Boynao Singh, Ningthoujam Avichandra Singh, Loitongbam Sanayai Meetei et al.*2 citations*
66. **[SJTU-MTLAB's Submission to the WMT23 Word-Level Auto Completion Task ↗](https://aclanthology.org/2023.wmt-1.77/)**Xingyu Chen, Rui Wang*2 citations*
67. **[TTIC's Submission to WMT-SLT 23 ↗](https://aclanthology.org/2023.wmt-1.35/)**Marcelo Sandoval-Castaneda, Yanhong Li, Bowen Shi et al.*2 citations*
68. **[There's No Data like Better Data: Using QE Metrics for MT Data Filtering ↗](https://aclanthology.org/2023.wmt-1.50/)**Jan-Thorsten Peter, David Vilar, Daniel Deutsch et al.*2 citations*
69. **[Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative ↗](https://aclanthology.org/2023.wmt-1.59/)**Sören Dreano, Derek Molloy, Noel Murphy*2 citations*
70. **[Towards Better Evaluation for Formality-Controlled English-Japanese Machine Translation ↗](https://aclanthology.org/2023.wmt-1.49/)**Edison Marrese-Taylor, Pin Chen Wang, Yutaka Matsuo*2 citations*
71. **[Unify Word-level and Span-level Tasks: NJUNLP's Participation for the WMT2023 Quality Estimation Shared Task ↗](https://aclanthology.org/2023.wmt-1.71/)**Xiang Geng, Zhejian Lai, Yu Zhang et al.*2 citations*
72. **[A Benchmark for Evaluating Machine Translation Metrics on Dialects without Standard Orthography ↗](https://aclanthology.org/2023.wmt-1.99/)**Noëmi Aepli, Chantal Amrhein, Florian Schottmann et al.*1 citation*
73. **[A Fast Method to Filter Noisy Parallel Data WMT2023 Shared Task on Parallel Data Curation ↗](https://aclanthology.org/2023.wmt-1.37/)**Nguyen-Hoang Minh-Cong, Nguyen Van Vinh, Nguyen Le-Minh*1 citation*
74. **[A Sentence Alignment Approach to Document Alignment and Multi-faceted Filtering for Curating Parallel Sentence Pairs from Web-crawled Data ↗](https://aclanthology.org/2023.wmt-1.38/)**Steinthor Steingrimsson*1 citation*
75. **[Automating Behavioral Testing in Machine Translation ↗](https://aclanthology.org/2023.wmt-1.97/)**Javier Ferrando, Matthias Sperber, Hendra Setiawan et al.*1 citation*
76. **[Biomedical Parallel Sentence Retrieval Using Large Language Models ↗](https://aclanthology.org/2023.wmt-1.26/)**Sheema Firdous, Sadaf Abdul Rauf*1 citation*
77. **[Bridging the Gap between Position-Based and Content-Based Self-Attention for Neural Machine Translation ↗](https://aclanthology.org/2023.wmt-1.46/)**Felix Schmidt, Mattia Di Gangi*1 citation*
78. **[CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm ↗](https://aclanthology.org/2023.wmt-1.8/)**Josef Jon, Martin Popel, Ondřej Bojar*1 citation*
79. **[GTCOM and DLUT's Neural Machine Translation Systems for WMT23 ↗](https://aclanthology.org/2023.wmt-1.20/)**Hao Zong*1 citation*
80. **[HW-TSC's Submissions to the WMT23 Discourse-Level Literary Translation Shared Task ↗](https://aclanthology.org/2023.wmt-1.32/)**Yuhao Xie, Zongyao Li, Zhanglin Wu et al.*1 citation*
81. **[IIIT HYD's Submission for WMT23 Test-suite Task ↗](https://aclanthology.org/2023.wmt-1.24/)**Ananya Mukherjee, Manish Shrivastava*1 citation*
82. **[IOL Research Machine Translation Systems for WMT23 Low-Resource Indic Language Translation Shared Task ↗](https://aclanthology.org/2023.wmt-1.94/)**Wenbo Zhang*1 citation*
83. **[KnowComp Submission for WMT23 Word-Level AutoCompletion Task ↗](https://aclanthology.org/2023.wmt-1.79/)**Yi Wu, Haochen Shi, Weiqi Wang et al.*1 citation*
84. **[Lingua Custodia's Participation at the WMT 2023 Terminology Shared Task ↗](https://aclanthology.org/2023.wmt-1.81/)**Jingshu Liu, Mariam Nakhlé, Gaëtan Caillout et al.*1 citation*
85. **[MMT's Submission for the WMT 2023 Quality Estimation Shared Task ↗](https://aclanthology.org/2023.wmt-1.75/)**Yulong Wu, Viktor Schlegel, Daniel Beck et al.*1 citation*
86. **[NICT-AI4B's Submission to the Indic MT Shared Task in WMT 2023 ↗](https://aclanthology.org/2023.wmt-1.88/)**Raj Dabre, Jay Gala, Pranjal A. Chitale*1 citation*
87. **[OPUS-CAT Terminology Systems for the WMT23 Terminology Shared Task ↗](https://aclanthology.org/2023.wmt-1.83/)**Tommi Nieminen*1 citation*
88. **[Samsung R&D Institute Philippines at WMT 2023 ↗](https://aclanthology.org/2023.wmt-1.6/)**Jan Christian Blaise Cruz*1 citation*
89. **[SurreyAI 2023 Submission for the Quality Estimation Shared Task ↗](https://aclanthology.org/2023.wmt-1.74/)**Archchana Sindhujan, Diptesh Kanojia, Constantin Orasan et al.*1 citation*
90. **[TJUNLP:System Description for the WMT23 Literary Task in Chinese to English Translation Direction ↗](https://aclanthology.org/2023.wmt-1.33/)**Shaolin Zhu, Deyi Xiong*1 citation*
91. **[The Path to Continuous Domain Adaptation Improvements by HW-TSC for the WMT23 Biomedical Translation Shared Task ↗](https://aclanthology.org/2023.wmt-1.27/)**Zhanglin Wu, Daimeng Wei, Zongyao Li et al.*1 citation*
92. **[Trained MT Metrics Learn to Cope with Machine-translated References ↗](https://aclanthology.org/2023.wmt-1.95/)**Jannis Vamvas, Tobias Domhan, Sony Trenous et al.*1 citation*
93. **[VARCO-MT: NCSOFT's WMT'23 Terminology Shared Task Submission ↗](https://aclanthology.org/2023.wmt-1.84/)**Geon Woo Park, Junghwa Lee, Meiying Ren et al.*1 citation*
94. **[A Closer Look at Transformer Attention for Multilingual Translation ↗](https://aclanthology.org/2023.wmt-1.45/)**Jingyi Zhang, Gerard de Melo, Hongfei Xu et al.
95. **[Investigating Techniques for a Deeper Understanding of Neural Machine Translation (NMT) Systems through Data Filtering and Fine-tuning Strategies ↗](https://aclanthology.org/2023.wmt-1.28/)**Lichao Zhu, Maria Zimina, Maud Bénard et al.
96. **[MAX-ISI System at WMT23 Discourse-Level Literary Translation Task ↗](https://aclanthology.org/2023.wmt-1.29/)**Li An, Linghao Jin, Xuezhe Ma
97. **[Machine Translation for Nko: Tools, Corpora, and Baseline Results ↗](https://aclanthology.org/2023.wmt-1.34/)**Moussa Doumbouya, Baba Mamadi Diané, Solo Farabado Cissé et al.
98. **[The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages ↗](https://aclanthology.org/2023.wmt-1.48/)**Benjamin Muller, Belen Alastruey, Prangthip Hansanti et al.
99. **[The MAKE-NMTVIZ System Description for the WMT23 Literary Task ↗](https://aclanthology.org/2023.wmt-1.30/)**Fabien Lopez, Gabriela González, Damien Hansen et al.
100. **[Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation ↗](https://aclanthology.org/2023.wmt-1.47/)**Tosho Hirasawa, Emanuele Bugliarello, Desmond Elliott et al.
- [← back to](https://md.research.elamur.ai/free/en/venues/wmt/2023/) — WMT 2023