---
title: "Chi-kiu Lo — all works — Elamur Research"
description: "All 35 works of Chi-kiu Lo in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/chi-kiu-lo/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/chi-kiu-lo/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Chi-kiu Lo](https://md.research.elamur.ai/free/en/authors/chi-kiu-lo/) / all works

# Chi-kiu Lo — all works

35 works · [← Chi-kiu Lo](https://md.research.elamur.ai/free/en/authors/chi-kiu-lo/)

1. [**Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust**Markus Freitag, Ricardo Rei, Nitika Mathur, et al.*Machine translation · 265 citations*](https://md.research.elamur.ai/free/en/papers/freitag-2022-results-wmt22-metrics-shared-task/)
2. **[YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available Resources](https://md.research.elamur.ai/free/en/papers/lo-2019-yisi-unified-semantic-mt-quality/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Chi-kiu Lo*2019 · 219 citations*
3. **[Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain](https://md.research.elamur.ai/free/en/papers/freitag-2021-results-wmt21-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Ricardo Rei, Nitika Mathur, et al.*2021 · 169 citations*
4. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.*2023 · 155 citations*
5. [**MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles**Chi-kiu Lo, Dekai Wu*Machine translation · 135 citations*](https://md.research.elamur.ai/free/en/papers/lo-2011-meant-inexpensive-high-accuracy-semi/)
6. **[Fully Automatic Semantic MT Evaluation ↗](https://aclanthology.org/W12-3129/) Proceedings of the Seventh Workshop on Statistical Machine Translation · no summary yet**Chi-kiu Lo, Anand Karthik Tumuluru, Dekai Wu*2012 · 113 citations*
7. **[Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/freitag-2024-are-llms-breaking-mt-metrics/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.*2024 · 107 citations*
8. [**MEANT 2.0: Accurate semantic MT evaluation for any output language**Chi-kiu Lo*Machine translation · 82 citations*](https://md.research.elamur.ai/free/en/papers/lo-2017-meant-2-0-accurate-semantic/)
9. **[Accurate semantic textual similarity for cleaning noisy parallel corpora using semantic machine translation evaluation metric: The NRC supervised submissions to the Parallel Corpus Filtering task ↗](https://aclanthology.org/W18-6481/) Proceedings of the Third Conference on Machine Translation: Shared Task Papers · no summary yet**Chi-kiu Lo et al.*2018 · 47 citations*
10. **[XMEANT: Better semantic MT evaluation without reference translations ↗](https://aclanthology.org/P14-2124/) Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yet**Chi-kiu Lo et al.*2014 · 44 citations*
11. **[Improving machine translation by training against an automatic semantic frame based evaluation metric ↗](https://aclanthology.org/P13-2067/) Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yet**Chi-kiu Lo et al.*2013 · 40 citations*
12. **[Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗](https://aclanthology.org/2025.wmt-1.24/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Alon Lavie et al.*2025 · 39 citations*
13. **[Unsupervised vs. supervised weight estimation for semantic MT evaluation metrics ↗](https://aclanthology.org/W12-4206/) Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yet**Chi-kiu Lo, Dekai Wu*2012 · 37 citations*
14. **[MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric ↗](https://aclanthology.org/W13-2254/) Proceedings of the Eighth Workshop on Statistical Machine Translation · no summary yet**Chi-kiu Lo, Dekai Wu*2013 · 31 citations*
15. **[Can Informal Genres be better Translated by Tuning on Automatic Semantic Metrics? ↗](https://aclanthology.org/2013.mtsummit-papers.12/) Proceedings of Machine Translation Summit XIV: Papers · no summary yet**Chi-Kiu Lo, Dekai Wu*2013 · 28 citations*
16. **[Extended Study on Using Pretrained Language Models and YiSi-1 for Machine Translation Evaluation ↗](https://aclanthology.org/2020.wmt-1.99/) Proceedings of the Fifth Conference on Machine Translation · no summary yet**Lo, Chi-kiu*2020 · 23 citations*
17. **[Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation ↗](https://aclanthology.org/W11-1002/) Proceedings of Fifth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yet**Chi-kiu Lo, Dekai Wu*2011 · 23 citations*
18. **[Accuracy and robustness in measuring the lexical similarity of semantic role fillers for automatic semantic MT evaluation ↗](https://aclanthology.org/Y12-1062/) Proceedings of the 26th Pacific Asia Conference on Language, Information, and Computation · no summary yet**Anand Karthik Tumuluru, Chi-kiu Lo, Dekai Wu*2012 · 20 citations*
19. **[LTG vs. ITG Coverage of Cross-Lingual Verb Frame Alternations ↗](https://aclanthology.org/2012.eamt-1.64/) Proceedings of the 16th Annual Conference of the European Association for Machine Translation · no summary yet**Karteek Addanki et al.*2012 · 19 citations*
20. **[Evaluating Machine Translation Utility via Semantic Role Labels ↗](https://aclanthology.org/L10-1521/) Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10) · no summary yet**Chi-kiu Lo, Dekai Wu*2010 · 18 citations*
21. **[Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality ↗](https://aclanthology.org/2023.wmt-1.65/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Chi-kiu Lo, Samuel Larkin, Rebecca Knowles*2023 · 16 citations*
22. **[Improving evaluation and optimization of MT systems against MEANT ↗](https://aclanthology.org/W15-3056/) Proceedings of the Tenth Workshop on Statistical Machine Translation · no summary yet**Chi-kiu Lo, Philipp Dowling, Dekai Wu*2015 · 14 citations*
23. **[Machine Translation Reference-less Evaluation using YiSi-2 with Bilingual Mappings of Massive Multilingual Language Model ↗](https://aclanthology.org/2020.wmt-1.100/) Proceedings of the Fifth Conference on Machine Translation · no summary yet**Chi-kiu Lo, Samuel Larkin*2020 · 12 citations*
24. **[Semantic vs. Syntactic vs. N-gram Structure for Machine Translation Evaluation ↗](https://aclanthology.org/W10-3807/) Proceedings of the 4th Workshop on Syntax and Structure in Statistical Translation · no summary yet**Chi-kiu Lo, Dekai Wu*2010 · 10 citations*
25. **[Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics ↗](https://aclanthology.org/2023.mtsummit-research.16/) Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track · no summary yet**Chi-kiu Lo, Rebecca Knowles, Cyril Goutte*2023 · 9 citations*
26. **[MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality ↗](https://aclanthology.org/2024.wmt-1.34/) Proceedings of the Ninth Conference on Machine Translation · no summary yet**Rebecca Knowles, Samuel Larkin, Chi-Kiu Lo*2024 · 7 citations*
27. **[On the reliability and inter-annotator agreement of human semantic MT evaluation via HMEANT ↗](https://aclanthology.org/L14-1136/) Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14) · no summary yet**Chi-kiu Lo, Dekai Wu*2014 · 5 citations*
28. **[Evaluation Briefs: Drawing on Translation Studies for Human Evaluation of MT ↗](https://aclanthology.org/2024.amta-research.17/) Proceedings of the 16th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track) · no summary yet**Ting Liu et al.*2024 · 4 citations*
29. **[Machine Translation Metrics for Indigenous Languages Using Fine-tuned Semantic Embeddings ↗](https://aclanthology.org/2025.americasnlp-1.11/) Proceedings of the Fifth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP) · no summary yet**Nathaniel Krasner et al.*2025 · 3 citations*
30. **[Better Semantic Frame Based MT Evaluation via Inversion Transduction Grammars ↗](https://aclanthology.org/W14-4003/) Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yet**Dekai Wu et al.*2014 · 3 citations*
31. **[MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants ↗](https://aclanthology.org/2025.wmt-1.69/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Rebecca Knowles, Samuel Larkin, Chi-Kiu Lo*2025 · 1 citation*
32. **[In the Blind: Building Pseudo-References for MT Evaluation ↗](https://arxiv.org/abs/2609.13611) arXiv:2609.13611 · no summary yet**Diptesh Kanojia et al.*2026*
33. **[Data Sampling and (In)stability in Machine Translation Evaluation ↗](https://aclanthology.org/2023.findings-acl.826/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Chi-kiu Lo, Rebecca Knowles*2023*
34. **[Lexical Access Preference and Constraint Strategies for Improving Multiword Expression Association within Semantic MT Evaluation ↗](https://aclanthology.org/W14-4719/) Proceedings of the 4th Workshop on Cognitive Aspects of the Lexicon (CogALex) · no summary yet**Dekai Wu, Chi-kiu Lo, Markus Saers*2014*
35. **[Human semantic MT evaluation with HMEANT for IWSLT 2013 ↗](https://aclanthology.org/2013.iwslt-evaluation.2/) Proceedings of the 10th International Workshop on Spoken Language Translation: Evaluation Campaign · no summary yet**Chi-kiu Lo, Dekai Wu*2013*