---
title: "Who cites The GEM Benchmark: Natural — 215 citing papers"
description: "215 papers of the Elamur Research library cite «The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/gehrmann-2021-gem-benchmark-natural-language-generation/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/gehrmann-2021-gem-benchmark-natural-language-generation/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [The GEM Benchmark: Natural Language Generation…](https://md.research.elamur.ai/free/en/papers/gehrmann-2021-gem-benchmark-natural-language-generation/) / cited by

# Who cites «The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics»

215 papers of our library cite it (of the 149,439 whose bibliographies we read) · 48 with a page here, the most cited first · [← back to «The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics»](https://md.research.elamur.ai/free/en/papers/gehrmann-2021-gem-benchmark-natural-language-generation/)

1. [**PaLM: Scaling Language Modeling with Pathways arXiv:2204.02311**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 4,753 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
2. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,160 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
3. [**Finetuned Language Models Are Zero-Shot Learners arXiv:2109.01652**Jason Wei, Maarten Bosma, Vincent Y. Zhao, et al.*2021 · 1,954 citations*](https://md.research.elamur.ai/free/en/papers/wei-2021-finetuned-language-models-zero-shot/)
4. [**Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models arXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj**Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.*2022 · 1,756 citations*](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
5. **[Bias and Fairness in Large Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Isabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.*2023 · 1,082 citations*
6. [**GLM-130B: An Open Bilingual Pre-trained Model arXiv:2210.02414**Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.*2022 · 786 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2022-glm-130b-open-bilingual-pre/)
7. [**AgentBench: Evaluating LLMs as Agents arXiv:2308.03688**Xiao Liu, Hao Yu, Hanchen Zhang, et al.*2023 · 432 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-agentbench-evaluating-llms-agents/)
8. **[CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities](https://md.research.elamur.ai/free/en/papers/lee-2022-coauthor-designing-human-ai-collaborative/) [CHI Conference on Human Factors in Computing Systems](https://md.research.elamur.ai/free/en/venues/chi-conference-on-human-factors-in-computing-systems/)**Mina Lee, Percy Liang, Qian Yang*2022 · 423 citations*
9. [**Evaluation of Text Generation: A Survey arXiv:2006.14799**Asli Celikyilmaz, Elizabeth Clark, Jianfeng Gao*2020 · 388 citations*](https://md.research.elamur.ai/free/en/papers/celikyilmaz-2020-evaluation-text-generation-survey/)
10. [**Datasets: A Community Library for Natural Language Processing arXiv:2109.02846**Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, et al.*2021 · 368 citations*](https://md.research.elamur.ai/free/en/papers/lhoest-2021-datasets-community-library-natural-language/)
11. [**UL2: Unifying Language Learning Paradigms arXiv:2205.05131**Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.*2022 · 347 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-ul2-unifying-language-learning-paradigms/)
12. **[SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer](https://md.research.elamur.ai/free/en/papers/vu-2022-spot-better-frozen-model-adaptation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tu Vu, Brian Lester, Noah Constant, et al.*2022 · 306 citations*
13. **[TRUE: Re-evaluating Factual Consistency Evaluation](https://md.research.elamur.ai/free/en/papers/honovich-2022-true-re-evaluating-factual-consistency/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Or Honovich, Roee Aharoni, Jonathan Herzig, et al.*2022 · 279 citations*
14. **[LaMP: When Large Language Models Meet Personalization](https://md.research.elamur.ai/free/en/papers/salemi-2024-lamp-when-large-language-models/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Alireza Salemi, Sheshera Mysore, Michael Bendersky, et al.*2024 · 246 citations*
15. [**TrustLLM: Trustworthiness in Large Language Models arXiv:2401.05561**Yue Huang, Lichao Sun, Haoran Wang, et al.*2024 · 237 citations*](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
16. [**Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models arXiv:2405.01535**Seungone Kim, Juyoung Suk, Shayne Longpre, et al.*2024 · 234 citations*](https://md.research.elamur.ai/free/en/papers/kim-2024-prometheus-2-open-source-language/)
17. [**mGPT: Few-Shot Learners Go Multilingual arXiv:2204.07580**Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.*2022 · 203 citations*](https://md.research.elamur.ai/free/en/papers/shliazhko-2022-mgpt-few-shot-learners-go/)
18. **[Measuring Attribution in Natural Language Generation Models](https://md.research.elamur.ai/free/en/papers/rashkin-2023-measuring-attribution-natural-language-generation/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Hannah Rashkin, Vitaly Nikolaev, Matthew Lamm, et al.*2023 · 201 citations*
19. **[AraT5: Text-to-Text Transformers for Arabic Language Generation](https://md.research.elamur.ai/free/en/papers/nagoudi-2022-arat5-text-text-transformers-arabic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**El Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed*2022 · 201 citations*
20. **[RealTime QA: What's the Answer Right Now?](https://md.research.elamur.ai/free/en/papers/kasai-2022-realtime-qa-s-answer-right/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, et al.*2022 · 181 citations*
21. **[“I'm sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset](https://md.research.elamur.ai/free/en/papers/smith-2022-i-m-sorry-hear-that/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Eric Michael Smith, Melissa Hall, Melanie Kambadur, et al.*2022 · 167 citations*
22. **[LLM-based NLG Evaluation: Current Status and Challenges](https://md.research.elamur.ai/free/en/papers/gao-2025-llm-based-nlg-evaluation-current/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Mingqi Gao, Xinyu Hu, Xunjian Yin, et al.*2025 · 153 citations*
23. **[ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic](https://md.research.elamur.ai/free/en/papers/koto-2024-arabicmmlu-assessing-massive-multitask-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Fajri Koto, Haonan Li, Sara Shatnawi, et al.*2024 · 117 citations*
24. [**Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation arXiv:2212.07981**Yixin Liu, Alexander R. Fabbri, Pengfei Liu, et al.*2022 · 117 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-revisiting-gold-standard-grounding-summarization/)
25. [**ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning arXiv:2111.10952**Vamsi Aribandi, Yi Tay, Tal Schuster, et al.*2021 · 114 citations*](https://md.research.elamur.ai/free/en/papers/aribandi-2021-ext5-towards-extreme-multi-task/)
26. **[Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation](https://md.research.elamur.ai/free/en/papers/deng-2021-compression-transduction-creation-unified-framework/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Mingkai Deng, Bowen Tan, Zhengzhong Liu, et al.*2021 · 102 citations*
27. **[Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark](https://md.research.elamur.ai/free/en/papers/dziri-2022-evaluating-attribution-dialogue-systems-begin/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nouha Dziri, Hannah Rashkin, Tal Linzen, et al.*2022 · 100 citations*
28. **[Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation](https://md.research.elamur.ai/free/en/papers/bulian-2022-tomayto-tomahto-beyond-token-level/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jannis Bulian, Christian Buck, Wojciech Gajewski, et al.*2022 · 100 citations*
29. **[On Learning to Summarize with Large Language Models as References](https://md.research.elamur.ai/free/en/papers/liu-2024-learning-summarize-large-language-models/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Yixin Liu, Kejian Shi, Katherine He, et al.*2024 · 94 citations*
30. **[NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation](https://md.research.elamur.ai/free/en/papers/dhole-2023-nl-augmenter-framework-task-sensitive/) [Northern European Journal of Language Technology](https://md.research.elamur.ai/free/en/venues/northern-european-journal-of-language-technology/)**Kaustubh Dhole, Varun Gangal, Sebastian Gehrmann, et al.*2023 · 86 citations*
31. [**AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model arXiv:2208.01448**Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.*2022 · 84 citations*](https://md.research.elamur.ai/free/en/papers/soltan-2022-alexatm-20b-few-shot-learning/)
32. **[ORCA: A Challenging Benchmark for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/elmadany-2023-orca-challenging-benchmark-arabic-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**AbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed*2023 · 83 citations*
33. [**Benchmarking Benchmark Leakage in Large Language Models arXiv:2404.18824**Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.*2024 · 73 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-benchmarking-benchmark-leakage-large-language/)
34. **[AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs](https://md.research.elamur.ai/free/en/papers/mousi-2025-aradice-benchmarks-dialectal-cultural-capabilities/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Basel Mousi, Nadir Durrani, Fatema Ahmad, et al.*2025 · 68 citations*
35. **[Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy](https://md.research.elamur.ai/free/en/papers/ippolito-2023-preventing-generation-verbatim-memorization-language/) [International Natural Language Generation Conference (INLG)](https://md.research.elamur.ai/free/en/venues/inlg/)**Daphne Ippolito, Florian Tramer, Milad Nasr, et al.*2023 · 68 citations*
36. **[SatLM: Satisfiability-Aided Language Models Using Declarative Prompting](https://md.research.elamur.ai/free/en/papers/ye-2023-satlm-satisfiability-aided-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Xi Ye, Qiaochu Chen, Isil Dillig, et al.*2023 · 62 citations*
37. [**Weisfeiler-Leman in the Bamboo: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity**Juri Opitz, Angel Daza, Anette Frank*2021 · 47 citations*](https://md.research.elamur.ai/free/en/papers/opitz-2021-weisfeiler-leman-bamboo-novel-amr/)
38. **[SLING: Sino Linguistic Evaluation of Large Language Models](https://md.research.elamur.ai/free/en/papers/song-2022-sling-sino-linguistic-evaluation-large/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yixiao Song, Kalpesh Krishna, Rajesh Bhatt, et al.*2022 · 41 citations*
39. **[Dolphin: A Challenging and Diverse Benchmark for Arabic NLG](https://md.research.elamur.ai/free/en/papers/nagoudi-2023-dolphin-challenging-diverse-benchmark-arabic/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**El Moatez Billah Nagoudi, AbdelRahim Elmadany, Ahmed Oumar El-Shangiti, et al.*2023 · 35 citations*
40. [**PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning arXiv:2305.19472**Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, et al.*2023 · 25 citations*](https://md.research.elamur.ai/free/en/papers/brahman-2023-plasma-making-small-language-models/)
41. **[AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark](https://md.research.elamur.ai/free/en/papers/gupta-2024-aavenue-detecting-llm-biases-nlu/) [Workshop on NLP for Positive Impact](https://md.research.elamur.ai/free/en/venues/nlp4pi/)**Abhay Gupta, Ece Yurtseven, Philip Meng, et al.*2024 · 17 citations*
42. **[LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English](https://md.research.elamur.ai/free/en/papers/s-2024-lexsumm-lext5-benchmarking-modeling-legal/) [Natural Legal Language Processing Workshop](https://md.research.elamur.ai/free/en/venues/nllp/)**Santosh T.Y.S.S, Cornelius Weiss, Matthias Grabmair*2024 · 16 citations*
43. **[Benchmarking LLaMA-3 on Arabic Language Generation Tasks](https://md.research.elamur.ai/free/en/papers/khondaker-2024-benchmarking-llama-3-arabic-language/) [Arabic Natural Language Processing Conference (ArabicNLP)](https://md.research.elamur.ai/free/en/venues/arabicnlp/)**Md Tawkat Islam Khondaker, Numaan Naeem, Fatimah Khan, et al.*2024 · 12 citations*
44. **[MarsadLab at PalmX Shared Task: An LLM Benchmark for Arabic Culture and Islamic Civilization](https://md.research.elamur.ai/free/en/papers/biswas-2025-marsadlab-palmx-shared-task-llm/) [Arabic Natural Language Processing Conference (ArabicNLP)](https://md.research.elamur.ai/free/en/venues/arabicnlp/)**Md. Rafiul Biswas, Shimaa Ibrahim, Kais Attia, et al.*2025 · 1 citation*
45. **[DefGen-Bench: A Benchmark for Chinese Criminal Defence Opinion Generation in LegalAI](https://md.research.elamur.ai/free/en/papers/zhang-2026-defgen-bench-benchmark-chinese-criminal/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Senbo Zhang, Qiqi Wang, Fanghao Lou, et al.*2026*
46. **[Evaluating Language Model Pluralism through In-the-wild Crowd Discussions](https://md.research.elamur.ai/free/en/papers/mundada-2026-evaluating-language-model-pluralism-through/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Gagan Mundada, Rohan Surana, Nandhini Swaminathan, et al.*2026*
47. **[Position: What Are We Measuring? Rethinking Evaluation in Natural Language Generation](https://md.research.elamur.ai/free/en/papers/zaghouani-2026-position-what-are-we-measuring/) [Workshop on Generation, Evaluation and Metrics (GEM)](https://md.research.elamur.ai/free/en/venues/gem/)**Wajdi Zaghouani*2026*
48. **[The American Palimpsest: Quantifying South Asian English Dialect Erasure in LLMs](https://md.research.elamur.ai/free/en/papers/bharati-2026-american-palimpsest-quantifying-south-asian/) [Workshop on Cross-Cultural Considerations in NLP](https://md.research.elamur.ai/free/en/venues/c3nlp/)**Soumedhik Bharati, Shibam Mandal, Swarup Kr Ghosh, et al.*2026*

167 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/gehrmann-2021-gem-benchmark-natural-language-generation/) — The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics