---
title: "Daniel Deutsch — all works — Elamur Research"
description: "All 34 works of Daniel Deutsch in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/daniel-deutsch/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/daniel-deutsch/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Daniel Deutsch](https://md.research.elamur.ai/free/en/authors/daniel-deutsch/) / all works

# Daniel Deutsch — all works

34 works · [← Daniel Deutsch](https://md.research.elamur.ai/free/en/authors/daniel-deutsch/)

1. **[Gemma 3 Technical Report ↗](https://arxiv.org/abs/2503.19786) arXiv:2503.19786 · no summary yet**Gemma Team et al.*2025 · 1,147 citations*
2. **[The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-devil-is-errors-leveraging-large/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.*2023 · 158 citations*
3. **[Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.*2023 · 155 citations*
4. **[Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary](https://md.research.elamur.ai/free/en/papers/deutsch-2021-question-answering-as-automatic-metric/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Daniel Deutsch, Tania Bedrax-Weiss, Dan Roth*2021 · 152 citations*
5. **[MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2024-metricx-24-google-submission-wmt/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Juraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.*2024 · 118 citations*
6. **[MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/juraska-2023-metricx-23-google-submission-wmt/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Juraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.*2023 · 118 citations*
7. **[A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods](https://md.research.elamur.ai/free/en/papers/deutsch-2021-statistical-analysis-summarization-evaluation-metrics/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Daniel Deutsch, Rotem Dror, Dan Roth*2021 · 117 citations*
8. **[Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/freitag-2024-are-llms-breaking-mt-metrics/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.*2024 · 107 citations*
9. **[WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects](https://md.research.elamur.ai/free/en/papers/deutsch-2025-wmt24-expanding-language-coverage-wmt24/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Daniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, et al.*2025 · 80 citations*
10. **[Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration](https://md.research.elamur.ai/free/en/papers/deutsch-2023-ties-matter-meta-evaluating-modern/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Daniel Deutsch, George Foster, Markus Freitag*2023 · 76 citations*
11. **[On the Limitations of Reference-Free Evaluations of Generated Text ↗](https://aclanthology.org/2022.emnlp-main.753/) Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yet**Daniel Deutsch, Rotem Dror, Dan Roth*2022 · 69 citations*
12. **[Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics ↗](https://aclanthology.org/2022.naacl-main.442/) Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Daniel Deutsch, Rotem Dror, Dan Roth*2022 · 54 citations*
13. **[Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries ↗](https://aclanthology.org/2021.conll-1.24/) Proceedings of the 25th Conference on Computational Natural Language Learning · no summary yet**Daniel Deutsch, Dan Roth*2021 · 47 citations*
14. **[Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗](https://aclanthology.org/2025.wmt-1.24/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Alon Lavie et al.*2025 · 39 citations*
15. **[SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics ↗](https://aclanthology.org/2020.nlposs-1.17/) Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS) · no summary yet**Daniel Deutsch, Dan Roth*2020 · 35 citations*
16. **[A General-Purpose Algorithm for Constrained Sequential Inference ↗](https://aclanthology.org/K19-1045/) Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL) · no summary yet**Daniel Deutsch, Shyam Upadhyay, Dan Roth*2019 · 30 citations*
17. **[Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level ↗](https://aclanthology.org/2023.wmt-1.96/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Daniel Deutsch et al.*2023 · 25 citations*
18. **[There's No Data like Better Data: Using QE Metrics for MT Data Filtering ↗](https://aclanthology.org/2023.wmt-1.50/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Jan-Thorsten Peter et al.*2023 · 21 citations*
19. [**A Distributional and Orthographic Aggregation Model for English Derivational Morphology**Daniel Deutsch, John Hewitt, Dan Roth*English · 19 citations*](https://md.research.elamur.ai/free/en/papers/deutsch-2018-distributional-orthographic-aggregation-model-english/)
20. **[Quality Estimation Using Minimum Bayes Risk ↗](https://aclanthology.org/2023.wmt-1.67/) Proceedings of the Eighth Conference on Machine Translation · no summary yet**Subhajit Naskar, Daniel Deutsch, Markus Freitag*2023 · 14 citations*
21. **[SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?](https://md.research.elamur.ai/free/en/papers/li-2025-ssa-comet-do-llms-outperform/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Senyu Li, Jiayi Wang, Felermino D. M. A. Ali, et al.*2025 · 13 citations*
22. **[Summary Cloze: A New Task for Content Selection in Topic-Focused Summarization ↗](https://aclanthology.org/D19-1386/) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yet**Daniel Deutsch, Dan Roth*2019 · 12 citations*
23. **[MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task ↗](https://aclanthology.org/2025.wmt-1.70/) Proceedings of the Tenth Conference on Machine Translation · no summary yet**Juraj Juraska et al.*2025 · 11 citations*
24. **[Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries ↗](https://arxiv.org/abs/2010.12495) arXiv (Cornell University) · no summary yet**Daniel Deutsch, Dan Roth*2020 · 11 citations*
25. **[Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection ↗](https://aclanthology.org/2020.coling-main.10/) Proceedings of the 28th International Conference on Computational Linguistics · no summary yet**Disha Jindal, Daniel Deutsch, Dan Roth*2020 · 11 citations*
26. **[Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data ↗](https://aclanthology.org/2024.wmt-1.110/) Proceedings of the Ninth Conference on Machine Translation · no summary yet**Zhongtao Liu et al.*2024 · 10 citations*
27. **[Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection ↗](https://aclanthology.org/2023.eacl-main.42/) Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · no summary yet**Daniel Deutsch, Dan Roth*2023 · 10 citations*
28. **[Enhancing Human Evaluation in Machine Translation with Comparative Judgement ↗](https://aclanthology.org/2025.acl-long.1002/) Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Yixiao Song et al.*2025 · 7 citations*
29. **[Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation ↗](https://arxiv.org/abs/2501.18771) arXiv:2501.18771 · no summary yet**Muhammed Yusuf Kocyigit et al.*2025 · 5 citations*
30. **[Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ↗](https://aclanthology.org/2022.findings-acl.296/) Findings of the Association for Computational Linguistics: ACL 2022 · no summary yet**Daniel Deutsch, Dan Roth*2022 · 5 citations*
31. **[Enhancing Human Evaluation in Machine Translation with Comparative Judgment ↗](https://arxiv.org/abs/2502.17797) arXiv:2502.17797 · no summary yet**Yixiao Song et al.*2025 · 4 citations*
32. **[Generating Difficult-to-Translate Texts](https://md.research.elamur.ai/free/en/papers/zouhar-2026-generating-difficult-translate-texts/) [Workshop on Multilingual Multicultural Evaluation](https://md.research.elamur.ai/free/en/venues/mme/)**Vilém Zouhar, Wenda Xu, Parker Riley, et al.*2026 · 3 citations*
33. **[Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code ↗](https://arxiv.org/abs/2204.13848) arXiv (Cornell University) · no summary yet**Daniel Deutsch, Dan Roth*2022 · 3 citations*
34. **[MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/riley-2026-mqm-re-annotation-technique-collaborative/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Parker Riley, Daniel Deutsch, Mara Finkelstein, et al.*2026*