--- title: "HumEval 2022 — accepted papers — Elamur Research" description: "HumEval 2022 — accepted papers: 1 paper in the Elamur Research library (Dublin, Ireland), with our summaries, ranked by citations." canonical: "https://research.elamur.ai/free/en/venues/humeval/2022/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/humeval/2022/) [home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [HumEval](https://md.research.elamur.ai/free/en/venues/humeval/) / 2022 # HumEval 2022 — accepted papers HumEval 2022 is the 2022 edition of the Workshop on Human Evaluation of NLP Systems (HumEval), held in Dublin, Ireland, May 2022 (publisher: Association for Computational Linguistics). The ACL Anthology lists 10 papers of it; our library holds 1 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions. 📍 Dublin, [Ireland](https://md.research.elamur.ai/free/en/countries/ireland/) · 🗓 May 2022 [**10** papers in the proceedings](#all) · [**1** work in our library](https://md.research.elamur.ai/free/en/venues/humeval/2022/#works) · [**0** citations of these works](https://md.research.elamur.ai/free/en/venues/humeval/2022/#works) ## Most cited papers By their OpenAlex citations; a paper with our summary links to its page here, the others to the original. 1. **[The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ↗](https://aclanthology.org/2022.humeval-1.6/)**Anastasia Shimorina, Anya Belz*26 citations* 2. **[Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ↗](https://aclanthology.org/2022.humeval-1.9/)**Huiyuan Lai, Jiali Mao, Antonio Toral et al.*10 citations* 3. **[Toward More Effective Human Evaluation for Machine Translation ↗](https://aclanthology.org/2022.humeval-1.7/)**Belén Saldías Fuentes, George Foster, Markus Freitag et al.*7 citations* 4. **[A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ↗](https://aclanthology.org/2022.humeval-1.8/)**Varvara Logacheva, Daryna Dementieva, Irina Krotova et al.*5 citations* 5. **[Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching ↗](https://aclanthology.org/2022.humeval-1.5/)**Simone Balloccu, Ehud Reiter*2 citations* 6. **[Perceptual Quality Dimensions of Machine-Generated Text with a Focus on Machine Translation ↗](https://aclanthology.org/2022.humeval-1.3/)**Vivien Macketanz, Babak Naderi, Steven Schmidt et al.*2 citations* 7. **[Vacillating Human Correlation of SacreBLEU in Unprotected Languages ↗](https://aclanthology.org/2022.humeval-1.1/)**Ahrii Kim, Jinhyeon Kim*1 citation* ## All accepted papers (10) The most cited first; 1 with our summary link to their page here, the others to the original. 1. **[The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ↗](https://aclanthology.org/2022.humeval-1.6/)**Anastasia Shimorina, Anya Belz*26 citations* 2. **[Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ↗](https://aclanthology.org/2022.humeval-1.9/)**Huiyuan Lai, Jiali Mao, Antonio Toral et al.*10 citations* 3. **[Toward More Effective Human Evaluation for Machine Translation ↗](https://aclanthology.org/2022.humeval-1.7/)**Belén Saldías Fuentes, George Foster, Markus Freitag et al.*7 citations* 4. **[A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ↗](https://aclanthology.org/2022.humeval-1.8/)**Varvara Logacheva, Daryna Dementieva, Irina Krotova et al.*5 citations* 5. **[Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching ↗](https://aclanthology.org/2022.humeval-1.5/)**Simone Balloccu, Ehud Reiter*2 citations* 6. **[Perceptual Quality Dimensions of Machine-Generated Text with a Focus on Machine Translation ↗](https://aclanthology.org/2022.humeval-1.3/)**Vivien Macketanz, Babak Naderi, Steven Schmidt et al.*2 citations* 7. **[Vacillating Human Correlation of SacreBLEU in Unprotected Languages ↗](https://aclanthology.org/2022.humeval-1.1/)**Ahrii Kim, Jinhyeon Kim*1 citation* 8. **[A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ↗](https://aclanthology.org/2022.humeval-1.2/)**Mariya Borovikova, Loïc Grobol, Anaïs Halftermeyer et al. 9. **[Human evaluation of web-crawled parallel corpora for machine translation ↗](https://aclanthology.org/2022.humeval-1.4/)**Gema Ramírez-Sánchez, Marta Bañón, Jaume Zaragoza-Bernabeu et al. 10. **[Towards Human Evaluation of Mutual Understanding in Human-Computer Spontaneous Conversation: An Empirical Study of Word Sense Disambiguation for Naturalistic Social Dialogs in American English](https://md.research.elamur.ai/free/en/papers/luu-2022-human-evaluation-mutual-understanding-human/)**Alex Lưu*our summary* ## Papers with our summary in our library (1) The most cited first (OpenAlex citations plus our library's). 1. **[Towards Human Evaluation of Mutual Understanding in Human-Computer Spontaneous Conversation: An Empirical Study of Word Sense Disambiguation for Naturalistic Social Dialogs in American English](https://md.research.elamur.ai/free/en/papers/luu-2022-human-evaluation-mutual-understanding-human/) [Workshop on Human Evaluation of NLP Systems (HumEval)](https://md.research.elamur.ai/free/en/venues/humeval/)**Alex Lưu*2022* ## Top topics Topics of its works in our library, with the number of works on each. [Word sense disambiguation (1)](https://md.research.elamur.ai/free/en/topics/word-sense-disambiguation/) · [Dialogue systems (1)](https://md.research.elamur.ai/free/en/topics/dialogue-systems/) · [Evaluation & benchmarks (1)](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [English (1)](https://md.research.elamur.ai/free/en/topics/english/) ## Fields [Arts and Humanities (1)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science (1)](https://md.research.elamur.ai/free/en/shelves/computer-science/) ## Top institutions Institutions on the bylines of its works here, by the number of works. [🎓**Brandeis University** Waltham · United States 1 work here](https://md.research.elamur.ai/free/en/universities/brandeis-university/) Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library. - [← previous HumEval 2021](https://md.research.elamur.ai/free/en/venues/humeval/2021/) - [↑ back to HumEval](https://md.research.elamur.ai/free/en/venues/humeval/)