--- title: "Nitika Mathur — papers and cards" description: "Nitika Mathur: 2 paper cards in the Research library (2020–2022), with what each paper is about, the ideas Mova took from it, and the co-authors." canonical: "https://research.elamur.ai/free/en/authors/nitika-mathur/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/nitika-mathur/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Nitika Mathur # Nitika Mathur 2 paper cards in the Research library · 2020–2022 Nitika Mathur wrote 2 of the papers Mova reads, in 2020–2022, most of them on [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/); often with [Alon Lavie](https://md.research.elamur.ai/free/en/authors/alon-lavie/), André F. T. Martins, [Chi-kiu Lo](https://md.research.elamur.ai/free/en/authors/chi-kiu-lo/). [OpenAlex](https://openalex.org/A5007765266) · [**h-index 10**](https://openalex.org/authors/A5007765266) · [504 citations](https://openalex.org/authors/A5007765266) · [17 works](https://openalex.org/works?filter=author.id:A5007765266) — openalex-snapshot, 2026-10-14 The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Nitika+Mathur) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Nitika+Mathur) · [dblp](https://dblp.org/search?q=Nitika+Mathur) · [ACL Anthology](https://aclanthology.org/search/?q=Nitika+Mathur) · [ORCID](https://orcid.org/orcid-search/search?searchQuery=Nitika+Mathur) Topics: [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) 2 ## Papers 1. **[Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust](https://md.research.elamur.ai/free/en/papers/freitag-2022-results-wmt22-metrics-shared-task/)** *(2022)* The shared task scored submitted MT metrics on WMT22 system outputs for three pairs (English to German, English to Russian, Chinese to English) across four domains: news, social, e-commerce and chat. 2. **[Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics](https://md.research.elamur.ai/free/en/papers/mathur-2020-tangled-up-bleu-reevaluating-evaluation/)** *(2020)* The paper checks how metrics are judged. The usual test is the Pearson correlation between a metric's system scores and human direct-assessment scores, computed on the WMT 2019 systems. The authors show that this correlation is fragile: a single outlier system, far worse than the rest, can lift the correlation of all… ## Co-authors (11) - [Alon Lavie](https://md.research.elamur.ai/free/en/authors/alon-lavie/) - André F. T. Martins - [Chi-kiu Lo](https://md.research.elamur.ai/free/en/authors/chi-kiu-lo/) - [Craig Stewart](https://md.research.elamur.ai/free/en/authors/craig-stewart/) - [Eleftherios Avramidis](https://md.research.elamur.ai/free/en/authors/eleftherios-avramidis/) - [George Foster](https://md.research.elamur.ai/free/en/authors/george-foster/) - [Markus Freitag](https://md.research.elamur.ai/free/en/authors/markus-freitag/) - [Ricardo Rei](https://md.research.elamur.ai/free/en/authors/ricardo-rei/) - [Timothy Baldwin](https://md.research.elamur.ai/free/en/authors/timothy-baldwin/) - Tom Kocmi - Trevor Cohn ## More papers in the library (5) Pages of the Research library: our summary, the ideas, references and who cites each. - [Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/freitag-2024-are-llms-breaking-mt-metrics/) — Markus Freitag, Nitika Mathur, Daniel Deutsch, et al. · 2024 - [Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent](https://md.research.elamur.ai/free/en/papers/freitag-2023-results-wmt23-metrics-shared-task/) — Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al. · 2023 - [Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain](https://md.research.elamur.ai/free/en/papers/freitag-2021-results-wmt21-metrics-shared-task/) — Markus Freitag, Ricardo Rei, Nitika Mathur, et al. · 2021 - [Results of the WMT20 Metrics Shared Task](https://md.research.elamur.ai/free/en/papers/mathur-2020-results-wmt20-metrics-shared-task/) — Nitika Mathur, Johnny Wei, Markus Freitag, et al. · 2020 - [Accurate Evaluation of Segment-level Machine Translation Metrics](https://md.research.elamur.ai/free/en/papers/graham-2015-accurate-evaluation-segment-level-machine/) — Yvette Graham, Timothy Baldwin, Nitika Mathur · 2015