---
title: "Who cites Aidan N. Gomez — 17,698 papers of our library"
description: "17,698 papers of the Elamur Research library cite the works of Aidan N. Gomez, found in their bibliographies · page 1 of 20 · 1–100; the most…"
canonical: "https://research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Aidan N. Gomez](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/) / cited by

# Who cites Aidan N. Gomez

17,908 citations of their works from 17,698 papers of our library (of the 149,439 whose bibliographies we read) · 1,916 with a page here, the most cited first · page 1 of 20 · 1–100 · [← Aidan N. Gomez](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/)

**1** [2](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/2/) … [10](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/10/) … [20](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/20/) [next →](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/2/)

1. **[BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Jacob Devlin, Ming-Wei Chang, Kenton Lee, et al.*2019 · 56,209 citations*
2. [**An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale arXiv:2010.11929**Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.*2020 · 23,726 citations*](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/)
3. **[Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Nils Reimers, Iryna Gurevych*2019 · 17,096 citations*
4. **[Transformers: State-of-the-Art Natural Language Processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Thomas Wolf, Lysandre Debut, Victor Sanh, et al.*2020 · 15,755 citations*
5. [**Language Models are Few-Shot Learners arXiv:2005.14165**Tom B. Brown, Benjamin Mann, Nick Ryder, et al.*2020 · 14,178 citations*](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
6. **[BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mike Lewis, Yinhan Liu, Naman Goyal, et al.*2020 · 12,856 citations*
7. [**Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer arXiv:1910.10683**Colin Raffel, Noam Shazeer, Adam Roberts, et al.*2019 · 11,325 citations*](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)
8. [**RoBERTa: A Robustly Optimized BERT Pretraining Approach arXiv:1907.11692**Yinhan Liu, Myle Ott, Naman Goyal, et al.*2019 · 9,837 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)
9. [**Llama 2: Open Foundation and Fine-Tuned Chat Models arXiv:2307.09288**Hugo Touvron, Louis Martin, Kevin Stone, et al.*2023 · 9,669 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-2-open-foundation-fine/)
10. [**LLaMA: Open and Efficient Foundation Language Models arXiv:2302.13971**Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.*2023 · 9,603 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
11. [**Graph Attention Networks arXiv:1710.10903**Petar Veličkovic, Guillem Cucurull, Arantxa Casanova, et al.*2017 · 9,035 citations*](https://md.research.elamur.ai/free/en/papers/veli-vckovic-2017-graph-attention-networks/)
12. [**Learning Transferable Visual Models From Natural Language Supervision arXiv:2103.00020**Alec Radford, Jong Wook Kim, Chris Hallacy, et al.*2021 · 8,767 citations*](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
13. **[BioBERT: a pre-trained biomedical language representation model for biomedical text mining](https://md.research.elamur.ai/free/en/papers/lee-2019-biobert-pre-trained-biomedical-language/) [Bioinformatics](https://md.research.elamur.ai/free/en/venues/bioinformatics/)**Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.*2019 · 8,339 citations*
14. [**The Llama 3 Herd of Models arXiv:2407.21783**Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.*2024 · 7,682 citations*](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/)
15. [**ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education**Enkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, et al.*2023 · 7,440 citations*](https://md.research.elamur.ai/free/en/papers/kasneci-2023-chatgpt-good-opportunities-challenges-large/)
16. [**Representation Learning with Contrastive Predictive Coding arXiv:1807.03748**Aaron van den Oord, Yazhe Li, Oriol Vinyals*2018 · 7,022 citations*](https://md.research.elamur.ai/free/en/papers/oord-2018-representation-learning-contrastive-predictive-coding/)
17. [**Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks arXiv:2005.11401**Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.*2020 · 6,256 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/)
18. **[Emerging Properties in Self-Supervised Vision Transformers](https://md.research.elamur.ai/free/en/papers/caron-2021-emerging-properties-self-supervised-vision/) [IEEE/CVF International Conference on Computer Vision (ICCV)](https://md.research.elamur.ai/free/en/venues/ieee-cvf-international-conference-on-computer-vision-iccv/)**Mathilde Caron, Hugo Touvron, Ishan Misra, et al.*2021 · 6,046 citations*
19. **[Survey of Hallucination in Natural Language Generation](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Ziwei Ji, Nayeon Lee, Rita Frieske, et al.*2022 · 5,974 citations*
20. **[Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Pengfei Liu, Weizhe Yuan, Jinlan Fu, et al.*2021 · 5,423 citations*
21. [**PaLM: Scaling Language Modeling with Pathways arXiv:2204.02311**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 4,753 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
22. **[The Power of Scale for Parameter-Efficient Prompt Tuning](https://md.research.elamur.ai/free/en/papers/lester-2021-power-scale-parameter-efficient-prompt/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Brian Lester, Rami Al-Rfou, Noah Constant*2021 · 4,287 citations*
23. [**A Call for Clarity in Reporting BLEU Scores**Matt Post*2018 · 4,152 citations*](https://md.research.elamur.ai/free/en/papers/post-2018-call-clarity-reporting-bleu-scores/)
24. **[Energy and Policy Considerations for Deep Learning in NLP](https://md.research.elamur.ai/free/en/papers/strubell-2019-energy-policy-considerations-deep-learning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Emma Strubell, Ananya Ganesh, Andrew McCallum*2019 · 4,075 citations*
25. **[fairseq: A Fast, Extensible Toolkit for Sequence Modeling](https://md.research.elamur.ai/free/en/papers/ott-2019-fairseq-fast-extensible-toolkit-sequence/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Myle Ott, Sergey Edunov, Alexei Baevski, et al.*2019 · 3,984 citations*
26. **[SimCSE: Simple Contrastive Learning of Sentence Embeddings](https://md.research.elamur.ai/free/en/papers/gao-2021-simcse-simple-contrastive-learning-sentence/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tianyu Gao, Xingcheng Yao, Danqi Chen*2021 · 3,942 citations*
27. [**Longformer: The Long-Document Transformer arXiv:2004.05150**Iz Beltagy, Matthew E. Peters, Arman Cohan*2020 · 3,880 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/)
28. [**XLNet: Generalized Autoregressive Pretraining for Language Understanding arXiv:1906.08237**Zhilin Yang, Zihang Dai, Yiming Yang, et al.*2019 · 3,857 citations*](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
29. **[Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Takeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.*2022 · 3,832 citations*
30. [**Training Verifiers to Solve Math Word Problems arXiv:2110.14168**Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.*2021 · 3,796 citations*](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/)
31. **[A Survey on Evaluation of Large Language Models](https://md.research.elamur.ai/free/en/papers/chang-2023-survey-evaluation-large-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Yupeng Chang, Xu Wang, Jindong Wang, et al.*2023 · 3,648 citations*
32. **[SciBERT: A Pretrained Language Model for Scientific Text](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Iz Beltagy, Kyle Lo, Arman Cohan*2019 · 3,582 citations*
33. **[Conformer: Convolution-augmented Transformer for Speech Recognition](https://md.research.elamur.ai/free/en/papers/gulati-2020-conformer-convolution-augmented-transformer-speech/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Anmol Gulati, James Qin, Chung-Cheng Chiu, et al.*2020 · 3,475 citations*
34. [**Scaling Laws for Neural Language Models arXiv:2001.08361**Jared Kaplan, Sam McCandlish, Tom Henighan, et al.*2020 · 3,434 citations*](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/)
35. **[mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer](https://md.research.elamur.ai/free/en/papers/xue-2021-mt5-massively-multilingual-pre-trained/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Linting Xue, Noah Constant, Adam Roberts, et al.*2021 · 3,226 citations*
36. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,160 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
37. [**Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805**Gemini Team, Rohan Anil, Sebastian Borgeaud, et al.*2023 · 3,050 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2023-gemini-family-highly-capable-multimodal/)
38. [**RoFormer: Enhanced Transformer with Rotary Position Embedding arXiv:2104.09864**Jianlin Su, Yu Lu, Shengfeng Pan, et al.*2021 · 3,028 citations*](https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/)
39. **[Language Models as Knowledge Bases?](https://md.research.elamur.ai/free/en/papers/petroni-2019-language-models-as-knowledge-bases/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.*2019 · 3,028 citations*
40. **[CodeBERT: A Pre-Trained Model for Programming and Natural Languages](https://md.research.elamur.ai/free/en/papers/feng-2020-codebert-pre-trained-model-programming/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhangyin Feng, Daya Guo, Duyu Tang, et al.*2020 · 2,967 citations*
41. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
42. [**ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942**Zhenzhong Lan, Mingda Chen, Sebastian Goodman, et al.*2019 · 2,806 citations*](https://md.research.elamur.ai/free/en/papers/lan-2019-albert-lite-bert-self-supervised/)
43. [**Hierarchical Text-Conditional Image Generation with CLIP Latents arXiv:2204.06125**Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, et al.*2022 · 2,713 citations*](https://md.research.elamur.ai/free/en/papers/ramesh-2022-hierarchical-text-conditional-image-generation/)
44. [**Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing arXiv:2007.15779**Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon*2020 · 2,674 citations*](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/)
45. [**The Curious Case of Neural Text Degeneration arXiv:1904.09751**Ari Holtzman, Jan Buys, Li Du, et al.*2019 · 2,660 citations*](https://md.research.elamur.ai/free/en/papers/holtzman-2019-curious-case-neural-text-degeneration/)
46. [**Evaluating Large Language Models Trained on Code arXiv:2107.03374**Mark Chen, Jerry Tworek, Heewoo Jun, et al.*2021 · 2,659 citations*](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
47. **[SpanBERT: Improving Pre-training by Representing and Predicting Spans](https://md.research.elamur.ai/free/en/papers/joshi-2019-spanbert-improving-pre-training-representing/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Mandar Joshi, Danqi Chen, Yinhan Liu, et al.*2019 · 2,616 citations*
48. **[Lost in the Middle: How Language Models Use Long Contexts](https://md.research.elamur.ai/free/en/papers/liu-2023-lost-middle-language-models-use/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nelson F. Liu, Kevin Lin, John Hewitt, et al.*2023 · 2,584 citations*
49. [**Robust Speech Recognition via Large-Scale Weak Supervision arXiv:2212.04356**Alec Radford, Jong Wook Kim, Tao Xu, et al.*2022 · 2,546 citations*](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/)
50. [**Sparks of Artificial General Intelligence: Early experiments with GPT-4 arXiv:2303.12712**Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, et al.*2023 · 2,439 citations*](https://md.research.elamur.ai/free/en/papers/bubeck-2023-sparks-artificial-general-intelligence-early/)
51. **[UNITER: UNiversal Image-TExt Representation Learning](https://md.research.elamur.ai/free/en/papers/chen-2019-uniter-universal-image-text-representation/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Yen-Chun Chen, Linjie Li, Licheng Yu, et al.*2019 · 2,418 citations*
52. [**Measuring Mathematical Problem Solving With the MATH Dataset arXiv:2103.03874**Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.*2021 · 2,395 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/)
53. **[TinyBERT: Distilling BERT for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/jiao-2020-tinybert-distilling-bert-natural-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Xiaoqi Jiao, Yichun Yin, Lifeng Shang, et al.*2020 · 2,378 citations*
54. **[Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image Captioning](https://md.research.elamur.ai/free/en/papers/sharma-2018-conceptual-captions-cleaned-hypernymed-image/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Piyush Sharma, Nan Ding, Sebastian Goodman, et al.*2018 · 2,348 citations*
55. [**Relational inductive biases, deep learning, and graph networks arXiv:1806.01261**Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, et al.*2018 · 2,335 citations*](https://md.research.elamur.ai/free/en/papers/battaglia-2018-relational-inductive-biases-deep-learning/)
56. [**ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks arXiv:1908.02265**Jiasen Lu, Dhruv Batra, Devi Parikh, et al.*2019 · 2,302 citations*](https://md.research.elamur.ai/free/en/papers/lu-2019-vilbert-pretraining-task-agnostic-visiolinguistic/)
57. [**Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198**Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.*2022 · 2,246 citations*](https://md.research.elamur.ai/free/en/papers/alayrac-2022-flamingo-visual-language-model-few/)
58. **[Multimodal Transformer for Unaligned Multimodal Language Sequences](https://md.research.elamur.ai/free/en/papers/tsai-2019-multimodal-transformer-unaligned-multimodal-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.*2019 · 2,193 citations*
59. **[Text Summarization with Pretrained Encoders](https://md.research.elamur.ai/free/en/papers/liu-2019-text-summarization-pretrained-encoders/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yang Liu, Mirella Lapata*2019 · 2,095 citations*
60. **[Training Compute-Optimal Large Language Models](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.*2022 · 2,032 citations*
61. **[BLEURT: Learning Robust Metrics for Text Generation](https://md.research.elamur.ai/free/en/papers/sellam-2020-bleurt-learning-robust-metrics-text/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Thibault Sellam, Dipanjan Das, Ankur Parikh*2020 · 2,032 citations*
62. **[BERT Rediscovers the Classical NLP Pipeline](https://md.research.elamur.ai/free/en/papers/tenney-2019-bert-rediscovers-classical-nlp-pipeline/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ian Tenney, Dipanjan Das, Ellie Pavlick*2019 · 2,028 citations*
63. **[Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks](https://md.research.elamur.ai/free/en/papers/li-2020-oscar-object-semantics-aligned-pre/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Xiujun Li, Xi Yin, Chunyuan Li, et al.*2020 · 1,877 citations*
64. **[On Faithfulness and Factuality in Abstractive Summarization](https://md.research.elamur.ai/free/en/papers/maynez-2020-faithfulness-factuality-abstractive-summarization/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Joshua Maynez, Shashi Narayan, Bernd Bohnet, et al.*2020 · 1,857 citations*
65. [**DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654**Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.*2020 · 1,828 citations*](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/)
66. [**PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization arXiv:1912.08777**Jingqing Zhang, Yao Zhao, Mohammad Saleh, et al.*2019 · 1,828 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2019-pegasus-pre-training-extracted-gap/)
67. [**AllenNLP: A Deep Semantic Natural Language Processing Platform arXiv:1803.07640**Matt Gardner, Joel Grus, Mark Neumann, et al.*2018 · 1,819 citations*](https://md.research.elamur.ai/free/en/papers/gardner-2018-allennlp-deep-semantic-natural-language/)
68. **[Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference](https://md.research.elamur.ai/free/en/papers/schick-2021-exploiting-cloze-questions-few-shot/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Timo Schick, Hinrich Schütze*2021 · 1,817 citations*
69. **[What Does BERT Learn about the Structure of Language?](https://md.research.elamur.ai/free/en/papers/jawahar-2019-what-does-bert-learn-about/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ganesh Jawahar, Benoît Sagot, Djamé Seddah*2019 · 1,806 citations*
70. **[ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT](https://md.research.elamur.ai/free/en/papers/khattab-2020-colbert-efficient-effective-passage/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Omar Khattab, Matei Zaharia*2020 · 1,789 citations*
71. [**Pre-trained Models for Natural Language Processing: A Survey arXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897**Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.*2020 · 1,759 citations*](https://md.research.elamur.ai/free/en/papers/qiu-2020-pre-trained-models-natural-language/)
72. [**Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models arXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj**Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.*2022 · 1,756 citations*](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
73. [**OPT: Open Pre-trained Transformer Language Models arXiv:2205.01068**Susan Zhang, Stephen Roller, Naman Goyal, et al.*2022 · 1,755 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
74. [**Qwen Technical Report arXiv:2309.16609**Jinze Bai, Shuai Bai, Yunfei Chu, et al.*2023 · 1,669 citations*](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/)
75. [**Universal Sentence Encoder arXiv:1803.11175**Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.*2018 · 1,629 citations*](https://md.research.elamur.ai/free/en/papers/cer-2018-universal-sentence-encoder/)
76. [**Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530**Gemini Team, Petko Georgiev, Ving Ian Lei, et al.*2024 · 1,589 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2024-gemini-1-5-unlocking-multimodal/)
77. **[Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates](https://md.research.elamur.ai/free/en/papers/kudo-2018-subword-regularization-improving-neural-network/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Taku Kudo*2018 · 1,573 citations*
78. [**VisualBERT: A Simple and Performant Baseline for Vision and Language arXiv:1908.03557**Liunian Harold Li, Mark Yatskar, Da Yin, et al.*2019 · 1,568 citations*](https://md.research.elamur.ai/free/en/papers/li-2019-visualbert-simple-performant-baseline-vision/)
79. **[Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Bonan Min, Hayley Ross, Elior Sulem, et al.*2021 · 1,556 citations*
80. **[Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://md.research.elamur.ai/free/en/papers/pan-2023-unifying-large-language-models-knowledge/) [IEEE Transactions on Knowledge and Data Engineering](https://md.research.elamur.ai/free/en/venues/ieee-transactions-on-knowledge-and-data-engineering/)**Shirui Pan, Linhao Luo, Yufei Wang, et al.*2023 · 1,551 citations*
81. **[CLIPScore: A Reference-free Evaluation Metric for Image Captioning](https://md.research.elamur.ai/free/en/papers/hessel-2021-clipscore-reference-free-evaluation-metric/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jack Hessel, Ari Holtzman, Maxwell Forbes, et al.*2021 · 1,550 citations*
82. **[Universal Sentence Encoder for English](https://md.research.elamur.ai/free/en/papers/cer-2018-universal-sentence-encoder-english/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.*2018 · 1,546 citations*
83. **[Efficient Transformers: A Survey](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Yi Tay, Mostafa Dehghani, Dara Bahri, et al.*2020 · 1,539 citations*
84. **[Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned](https://md.research.elamur.ai/free/en/papers/voita-2019-analyzing-multi-head-self-attention/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Elena Voita, David Talbot, Fedor Moiseev, et al.*2019 · 1,535 citations*
85. [**Zero-Shot Text-to-Image Generation arXiv:2102.12092**Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.*2021 · 1,528 citations*](https://md.research.elamur.ai/free/en/papers/ramesh-2021-zero-shot-text-image-generation/)
86. **[Multi-Task Deep Neural Networks for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/liu-2019-multi-task-deep-neural-networks/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Xiaodong Liu, Pengcheng He, Weizhu Chen, et al.*2019 · 1,524 citations*
87. **[Pre-Training with Whole Word Masking for Chinese BERT](https://md.research.elamur.ai/free/en/papers/cui-2019-pre-training-whole-word-masking/) [IEEE/ACM Transactions on Audio Speech and Language Processing](https://md.research.elamur.ai/free/en/venues/ieee-acm-transactions-on-audio-speech-and-language-processing/)**Yiming Cui, Wanxiang Che, Ting Liu, et al.*2019 · 1,490 citations*
88. [**LAION-5B: An open large-scale dataset for training next generation image-text models arXiv:2210.08402**Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.*2022 · 1,485 citations*](https://md.research.elamur.ai/free/en/papers/schuhmann-2022-laion-5b-open-large-scale/)
89. [**Code Llama: Open Foundation Models for Code arXiv:2308.12950**Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.*2024 · 1,430 citations*](https://md.research.elamur.ai/free/en/papers/roziere-2024-code-llama-open-foundation-models/)
90. [**Unified Language Model Pre-training for Natural Language Understanding and Generation arXiv:1905.03197**Li Dong, Nan Yang, Wenhui Wang, et al.*2019 · 1,422 citations*](https://md.research.elamur.ai/free/en/papers/dong-2019-unified-language-model-pre-training/)
91. **[wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.*2020 · 1,421 citations*
92. **[Language-agnostic BERT Sentence Embedding](https://md.research.elamur.ai/free/en/papers/feng-2020-language-agnostic-bert-sentence-embedding/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.*2020 · 1,413 citations*
93. **[VideoBERT: A Joint Model for Video and Language Representation Learning](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/) [IEEE/CVF International Conference on Computer Vision (ICCV)](https://md.research.elamur.ai/free/en/venues/ieee-cvf-international-conference-on-computer-vision-iccv/)**Chen Sun, Austin Myers, Carl Vondrick, et al.*2019 · 1,345 citations*
94. [**LaMDA: Language Models for Dialog Applications arXiv:2201.08239**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,344 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
95. **[Parameter-efficient fine-tuning of large-scale pre-trained language models](https://md.research.elamur.ai/free/en/papers/ding-2023-parameter-efficient-fine-tuning-large/) [Nature Machine Intelligence](https://md.research.elamur.ai/free/en/venues/nature-machine-intelligence/)**Ning Ding, Yujia Qin, Guang You Yang, et al.*2023 · 1,325 citations*
96. [**DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing arXiv:2111.09543**Pengcheng He, Jianfeng Gao, Weizhu Chen*2021 · 1,320 citations*](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/)
97. **[RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models](https://md.research.elamur.ai/free/en/papers/gehman-2020-realtoxicityprompts-evaluating-neural-toxic-degeneration/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Samuel Gehman, Suchin Gururangan, Maarten Sap, et al.*2020 · 1,306 citations*
98. [**AraBERT: Transformer-based Model for Arabic Language Understanding arXiv:2003.00104**Wissam Antoun, Fady Baly, Hazem Hajj*2020 · 1,304 citations*](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
99. **[COMET: Commonsense Transformers for Automatic Knowledge Graph Construction](https://md.research.elamur.ai/free/en/papers/bosselut-2019-comet-commonsense-transformers-automatic-knowledge/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Antoine Bosselut, Hannah Rashkin, Maarten Sap, et al.*2019 · 1,294 citations*
100. [**CTRL: A Conditional Transformer Language Model for Controllable Generation arXiv:1909.05858**Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.*2019 · 1,291 citations*](https://md.research.elamur.ai/free/en/papers/keskar-2019-ctrl-conditional-transformer-language-model/)

**1** [2](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/2/) … [10](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/10/) … [20](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/20/) [next →](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/) — Aidan N. Gomez