---
title: "Who cites BERT: Pre-training of Deep Bidirectional…"
description: "23,422 papers of the Elamur Research library cite «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [BERT: Pre-training of Deep Bidirectional…](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) / cited by

# Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 1 of 15 · 1–100 · [← the paper](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)

**1** [2](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/)

1. [**End-to-End Object Detection with Transformers**Nicolas Carion, Francisco Massa, Gabriel Synnaeve, et al.*2020 · 16,761 citations*](https://md.research.elamur.ai/free/en/papers/carion-2020-end-end-object-detection-transformers/)
2. [**Transformers: State-of-the-Art Natural Language Processing**Thomas Wolf, Lysandre Debut, Victor Sanh, et al.*2020 · 15,591 citations*](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
3. [**Momentum Contrast for Unsupervised Visual Representation Learning**Kaiming He, Haoqi Fan, Yuxin Wu, et al.*2019 · 13,143 citations*](https://md.research.elamur.ai/free/en/papers/he-2019-momentum-contrast-unsupervised-visual-representation/)
4. [**Chain-of-Thought Prompting Elicits Reasoning in Large Language Models**Jason Wei, Xuezhi Wang, Dale Schuurmans, et al.*2022 · 11,278 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/)
5. [**Language Models are Few-Shot Learners**Tom B. Brown, Benjamin Mann, Nick Ryder, et al.*2020 · 10,782 citations*](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
6. [**Learning Transferable Visual Models From Natural Language Supervision**Alec Radford, Jong Wook Kim, Chris Hallacy, et al.*2021 · 8,295 citations*](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
7. [**BioBERT: a pre-trained biomedical language representation model for biomedical text mining**Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.*2019 · 8,281 citations*](https://md.research.elamur.ai/free/en/papers/lee-2019-biobert-pre-trained-biomedical-language/)
8. [**Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer**Colin Raffel, Noam Shazeer, Adam Roberts, et al.*2019 · 7,433 citations*](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)
9. [**ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education**Enkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, et al.*2023 · 7,429 citations*](https://md.research.elamur.ai/free/en/papers/kasneci-2023-chatgpt-good-opportunities-challenges-large/)
10. [**LoRA: Low-Rank Adaptation of Large Language Models**Edward J. Hu, Yelong Shen, Phillip Wallis, et al.*2021 · 5,972 citations*](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/)
11. [**Survey of Hallucination in Natural Language Generation**Ziwei Ji, Nayeon Lee, Rita Frieske, et al.*2022 · 5,947 citations*](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/)
12. [**Emerging Properties in Self-Supervised Vision Transformers**Mathilde Caron, Hugo Touvron, Ishan Misra, et al.*2021 · 5,910 citations*](https://md.research.elamur.ai/free/en/papers/caron-2021-emerging-properties-self-supervised-vision/)
13. [**LLaMA: Open and Efficient Foundation Language Models**Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.*2023 · 5,609 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
14. [**Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing**Pengfei Liu, Weizhe Yuan, Jinlan Fu, et al.*2021 · 5,375 citations*](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/)
15. [**Dense Passage Retrieval for Open-Domain Question Answering**Vladimir Karpukhin, Barlas Oguz, Sewon Min, et al.*2020 · 5,370 citations*](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/)
16. [**Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks**Nils Reimers, Iryna Gurevych*2019 · 4,838 citations*](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/)
17. [**Energy and Policy Considerations for Deep Learning in NLP**Emma Strubell, Ananya Ganesh, Andrew McCallum*2019 · 4,049 citations*](https://md.research.elamur.ai/free/en/papers/strubell-2019-energy-policy-considerations-deep-learning/)
18. [**SimCSE: Simple Contrastive Learning of Sentence Embeddings**Tianyu Gao, Xingcheng Yao, Danqi Chen*2021 · 3,921 citations*](https://md.research.elamur.ai/free/en/papers/gao-2021-simcse-simple-contrastive-learning-sentence/)
19. [**Large language models are zero-shot reasoners**Takeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.*2022 · 3,780 citations*](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/)
20. [**XLNet: Generalized Autoregressive Pretraining for Language Understanding**Zhilin Yang, Zihang Dai, Yiming Yang, et al.*2019 · 3,740 citations*](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
21. [**A Survey on Evaluation of Large Language Models**Yupeng Chang, Xu Wang, Jindong Wang, et al.*2023 · 3,640 citations*](https://md.research.elamur.ai/free/en/papers/chang-2023-survey-evaluation-large-language-models/)
22. [**SciBERT: A Pretrained Language Model for Scientific Text**Iz Beltagy, Kyle Lo, Arman Cohan*2019 · 3,548 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/)
23. [**Measuring Massive Multitask Language Understanding**Dan Hendrycks, Collin Burns, Steven Basart, et al.*2020 · 3,489 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/)
24. [**HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units**Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, et al.*2021 · 3,441 citations*](https://md.research.elamur.ai/free/en/papers/hsu-2021-hubert-self-supervised-speech-representation/)
25. [**A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions**Lei Huang, Weijiang Yu, Weitao Ma, et al.*2023 · 3,221 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/)
26. [**On the Opportunities and Risks of Foundation Models**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,044 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
27. [**Language Models as Knowledge Bases?**Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.*2019 · 2,977 citations*](https://md.research.elamur.ai/free/en/papers/petroni-2019-language-models-as-knowledge-bases/)
28. [**CodeBERT: A Pre-Trained Model for Programming and Natural Languages**Zhangyin Feng, Daya Guo, Duyu Tang, et al.*2020 · 2,954 citations*](https://md.research.elamur.ai/free/en/papers/feng-2020-codebert-pre-trained-model-programming/)
29. [**A Survey of Large Language Models**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,847 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/)
30. [**LXMERT: Learning Cross-Modality Encoder Representations from Transformers**Hao Tan, Mohit Bansal*2019 · 2,714 citations*](https://md.research.elamur.ai/free/en/papers/tan-2019-lxmert-learning-cross-modality-encoder/)
31. [**Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing**Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon*2020 · 2,636 citations*](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/)
32. [**PaLM: Scaling Language Modeling with Pathways**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 2,603 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
33. [**Scalable Diffusion Models with Transformers**William Peebles, Saining Xie*2022 · 2,595 citations*](https://md.research.elamur.ai/free/en/papers/peebles-2022-scalable-diffusion-models-transformers/)
34. [**SpanBERT: Improving Pre-training by Representing and Predicting Spans**Mandar Joshi, Danqi Chen, Yinhan Liu, et al.*2019 · 2,580 citations*](https://md.research.elamur.ai/free/en/papers/joshi-2019-spanbert-improving-pre-training-representing/)
35. [**Evaluating Large Language Models Trained on Code**Mark Chen, Jerry Tworek, Heewoo Jun, et al.*2021 · 2,529 citations*](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
36. [**Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding**Chitwan Saharia, William Chan, Saurabh Saxena, et al.*2022 · 2,416 citations*](https://md.research.elamur.ai/free/en/papers/saharia-2022-photorealistic-text-image-diffusion-models/)
37. [**UNITER: UNiversal Image-TExt Representation Learning**Yen-Chun Chen, Linjie Li, Licheng Yu, et al.*2019 · 2,344 citations*](https://md.research.elamur.ai/free/en/papers/chen-2019-uniter-universal-image-text-representation/)
38. [**Measuring Mathematical Problem Solving With the MATH Dataset**Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.*2021 · 2,318 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/)
39. [**ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks**Jiasen Lu, Dhruv Batra, Devi Parikh, et al.*2019 · 2,217 citations*](https://md.research.elamur.ai/free/en/papers/lu-2019-vilbert-pretraining-task-agnostic-visiolinguistic/)
40. [**Emergent Abilities of Large Language Models**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,215 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
41. [**SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems**Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.*2019 · 2,187 citations*](https://md.research.elamur.ai/free/en/papers/wang-2019-superglue-stickier-benchmark-general-purpose/)
42. [**Multimodal Transformer for Unaligned Multimodal Language Sequences**Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.*2019 · 2,170 citations*](https://md.research.elamur.ai/free/en/papers/tsai-2019-multimodal-transformer-unaligned-multimodal-language/)
43. [**BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models**Junnan Li, Dongxu Li, Silvio Savarese, et al.*2023 · 2,114 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-blip-2-bootstrapping-language-image/)
44. [**Flamingo: a Visual Language Model for Few-Shot Learning**Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.*2022 · 2,108 citations*](https://md.research.elamur.ai/free/en/papers/alayrac-2022-flamingo-visual-language-model-few/)
45. [**How Multilingual is Multilingual BERT?**Telmo Pires, Eva Schlinger, Dan Garrette*2019 · 2,095 citations*](https://md.research.elamur.ai/free/en/papers/pires-2019-how-multilingual-is-multilingual-bert/)
46. [**Toolformer: Language Models Can Teach Themselves to Use Tools**Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.*2023 · 2,020 citations*](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/)
47. [**BERT Rediscovers the Classical NLP Pipeline**Ian Tenney, Dipanjan Das, Ellie Pavlick*2019 · 1,993 citations*](https://md.research.elamur.ai/free/en/papers/tenney-2019-bert-rediscovers-classical-nlp-pipeline/)
48. [**Making Pre-trained Language Models Better Few-shot Learners**Tianyu Gao, Adam Fisch, Danqi Chen*2021 · 1,952 citations*](https://md.research.elamur.ai/free/en/papers/gao-2021-making-pre-trained-language-models/)
49. [**An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale**Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.*2020 · 1,947 citations*](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/)
50. [**AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts**Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, et al.*2020 · 1,879 citations*](https://md.research.elamur.ai/free/en/papers/shin-2020-autoprompt-eliciting-knowledge-language-models/)
51. [**Unsupervised Data Augmentation for Consistency Training**Qizhe Xie, Zihang Dai, Eduard Hovy, et al.*2019 · 1,837 citations*](https://md.research.elamur.ai/free/en/papers/xie-2019-unsupervised-data-augmentation-consistency-training/)
52. [**Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks**Xiujun Li, Xi Yin, Chunyuan Li, et al.*2020 · 1,827 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-oscar-object-semantics-aligned-pre/)
53. [**Scaling Laws for Neural Language Models**Jared Kaplan, Sam McCandlish, Tom Henighan, et al.*2020 · 1,814 citations*](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/)
54. [**PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization**Jingqing Zhang, Yao Zhao, Mohammad Saleh, et al.*2019 · 1,806 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2019-pegasus-pre-training-extracted-gap/)
55. [**DeBERTa: Decoding-enhanced BERT with Disentangled Attention**Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.*2020 · 1,800 citations*](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/)
56. [**Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference**Timo Schick, Hinrich Schütze*2021 · 1,796 citations*](https://md.research.elamur.ai/free/en/papers/schick-2021-exploiting-cloze-questions-few-shot/)
57. [**What Does BERT Learn about the Structure of Language?**Ganesh Jawahar, Benoît Sagot, Djamé Seddah*2019 · 1,789 citations*](https://md.research.elamur.ai/free/en/papers/jawahar-2019-what-does-bert-learn-about/)
58. [**COMET: A Neural Framework for MT Evaluation**Ricardo Rei, Craig Stewart, Ana C Farinha, et al.*2020 · 1,784 citations*](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/)
59. [**ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT**Omar Khattab, Matei Zaharia*2020 · 1,776 citations*](https://md.research.elamur.ai/free/en/papers/khattab-2020-colbert-efficient-effective-passage/)
60. [**Pre-trained Models for Natural Language Processing: A Survey**Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.*2020 · 1,740 citations*](https://md.research.elamur.ai/free/en/papers/qiu-2020-pre-trained-models-natural-language/)
61. [**Longformer: The Long-Document Transformer**Iz Beltagy, Matthew E. Peters, Arman Cohan*2020 · 1,737 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/)
62. [**BERTopic: Neural topic modeling with a class-based TF-IDF procedure**Maarten Grootendorst*2022 · 1,729 citations*](https://md.research.elamur.ai/free/en/papers/grootendorst-2022-bertopic-neural-topic-modeling-class/)
63. [**OPT: Open Pre-trained Transformer Language Models**Susan Zhang, Stephen Roller, Naman Goyal, et al.*2022 · 1,709 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
64. [**Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models**Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.*2022 · 1,695 citations*](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
65. [**Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering**Gautier Izacard, Edouard Grave*2021 · 1,674 citations*](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/)
66. [**Qwen Technical Report**Jinze Bai, Shuai Bai, Yunfei Chu, et al.*2023 · 1,643 citations*](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/)
67. [**Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference**R. Thomas McCoy, Ellie Pavlick, Tal Linzen*2019 · 1,630 citations*](https://md.research.elamur.ai/free/en/papers/mccoy-2019-right-wrong-reasons-diagnosing-syntactic/)
68. [**Multitask Prompted Training Enables Zero-Shot Task Generalization**Victor Sanh, Albert Webson, Colin Raffel, et al.*2021 · 1,577 citations*](https://md.research.elamur.ai/free/en/papers/sanh-2021-multitask-prompted-training-enables-zero/)
69. [**mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer**Linting Xue, Noah Constant, Adam Roberts, et al.*2021 · 1,574 citations*](https://md.research.elamur.ai/free/en/papers/xue-2021-mt5-massively-multilingual-pre-trained/)
70. [**Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey**Bonan Min, Hayley Ross, Elior Sulem, et al.*2021 · 1,548 citations*](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/)
71. [**Unifying Large Language Models and Knowledge Graphs: A Roadmap**Shirui Pan, Linhao Luo, Yufei Wang, et al.*2023 · 1,545 citations*](https://md.research.elamur.ai/free/en/papers/pan-2023-unifying-large-language-models-knowledge/)
72. [**Competition-Level Code Generation with AlphaCode**Yujia Li, David Choi, Junyoung Chung, et al.*2022 · 1,543 citations*](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/)
73. [**Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision**Chao Jia, Yinfei Yang, Ye Xia, et al.*2021 · 1,528 citations*](https://md.research.elamur.ai/free/en/papers/jia-2021-scaling-up-visual-vision-language/)
74. [**Efficient Transformers: A Survey**Yi Tay, Mostafa Dehghani, Dara Bahri, et al.*2020 · 1,513 citations*](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/)
75. [**VisualBERT: A Simple and Performant Baseline for Vision and Language**Liunian Harold Li, Mark Yatskar, Da Yin, et al.*2019 · 1,510 citations*](https://md.research.elamur.ai/free/en/papers/li-2019-visualbert-simple-performant-baseline-vision/)
76. [**Multi-Task Deep Neural Networks for Natural Language Understanding**Xiaodong Liu, Pengcheng He, Weizhu Chen, et al.*2019 · 1,501 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-multi-task-deep-neural-networks/)
77. [**CLIPScore: A Reference-free Evaluation Metric for Image Captioning**Jack Hessel, Ari Holtzman, Maxwell Forbes, et al.*2021 · 1,498 citations*](https://md.research.elamur.ai/free/en/papers/hessel-2021-clipscore-reference-free-evaluation-metric/)
78. [**How Can We Know What Language Models Know?**Zhengbao Jiang, Frank F. Xu, Jun Araki, et al.*2020 · 1,493 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2020-how-can-we-know-what/)
79. [**The State and Fate of Linguistic Diversity and Inclusion in the NLP World**Pratik Joshi, Sebastin Santy, Amar Budhiraja, et al.*2020 · 1,492 citations*](https://md.research.elamur.ai/free/en/papers/joshi-2020-state-fate-linguistic-diversity-inclusion/)
80. [**Pre-Training with Whole Word Masking for Chinese BERT**Yiming Cui, Wanxiang Che, Ting Liu, et al.*2019 · 1,485 citations*](https://md.research.elamur.ai/free/en/papers/cui-2019-pre-training-whole-word-masking/)
81. [**BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation**Junnan Li, Dongxu Li, Caiming Xiong, et al.*2022 · 1,463 citations*](https://md.research.elamur.ai/free/en/papers/li-2022-blip-bootstrapping-language-image-pre/)
82. [**GLM: General Language Model Pretraining with Autoregressive Blank Infilling**Zhengxiao Du, Yujie Qian, Xiao Liu, et al.*2022 · 1,449 citations*](https://md.research.elamur.ai/free/en/papers/du-2022-glm-general-language-model-pretraining/)
83. [**DINOv2: Learning Robust Visual Features without Supervision**Maxime Oquab, Timothee Darcet, Theo Moutakanni, et al.*2023 · 1,425 citations*](https://md.research.elamur.ai/free/en/papers/oquab-2023-dinov2-learning-robust-visual-features/)
84. [**Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?**Sewon Min, Xinxi Lyu, Ari Holtzman, et al.*2022 · 1,423 citations*](https://md.research.elamur.ai/free/en/papers/min-2022-rethinking-role-demonstrations-what-makes/)
85. [**Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects**Jianmo Ni, Jiacheng Li, Julian McAuley*2019 · 1,421 citations*](https://md.research.elamur.ai/free/en/papers/ni-2019-justifying-recommendations-distantly-labeled-reviews/)
86. [**Language-agnostic BERT Sentence Embedding**Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.*2020 · 1,412 citations*](https://md.research.elamur.ai/free/en/papers/feng-2020-language-agnostic-bert-sentence-embedding/)
87. [**Unified Language Model Pre-training for Natural Language Understanding and Generation**Li Dong, Nan Yang, Wenhui Wang, et al.*2019 · 1,389 citations*](https://md.research.elamur.ai/free/en/papers/dong-2019-unified-language-model-pre-training/)
88. [**wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations**Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.*2020 · 1,355 citations*](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/)
89. [**Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation**Nils Reimers, Iryna Gurevych*2020 · 1,320 citations*](https://md.research.elamur.ai/free/en/papers/reimers-2020-making-monolingual-sentence-embeddings-multilingual/)
90. [**DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing**Pengcheng He, Jianfeng Gao, Weizhu Chen*2021 · 1,316 citations*](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/)
91. [**LaMDA: Language Models for Dialog Applications**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,314 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
92. [**VideoBERT: A Joint Model for Video and Language Representation Learning**Chen Sun, Austin Myers, Carl Vondrick, et al.*2019 · 1,305 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/)
93. [**BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions**Christopher Clark, Kenton Lee, Ming-Wei Chang, et al.*2019 · 1,299 citations*](https://md.research.elamur.ai/free/en/papers/clark-2019-boolq-exploring-surprising-difficulty-natural/)
94. [**AraBERT: Transformer-based Model for Arabic Language Understanding**Wissam Antoun, Fady Baly, Hazem Hajj*2020 · 1,297 citations*](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
95. [**A Comprehensive Overview of Large Language Models**Humza Naveed, Asad Ullah Khan, Shi Qiu, et al.*2023 · 1,286 citations*](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/)
96. [**COMET: Commonsense Transformers for Automatic Knowledge Graph Construction**Antoine Bosselut, Hannah Rashkin, Maarten Sap, et al.*2019 · 1,282 citations*](https://md.research.elamur.ai/free/en/papers/bosselut-2019-comet-commonsense-transformers-automatic-knowledge/)
97. [**RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models**Samuel Gehman, Suchin Gururangan, Maarten Sap, et al.*2020 · 1,277 citations*](https://md.research.elamur.ai/free/en/papers/gehman-2020-realtoxicityprompts-evaluating-neural-toxic-degeneration/)
98. [**CTRL: A Conditional Transformer Language Model for Controllable Generation**Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.*2019 · 1,273 citations*](https://md.research.elamur.ai/free/en/papers/keskar-2019-ctrl-conditional-transformer-language-model/)
99. [**The Rise and Potential of Large Language Model Based Agents: A Survey**Zhiheng Xi, Wenxiang Chen, Xin Guo, et al.*2023 · 1,262 citations*](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/)
100. [**CamemBERT: a Tasty French Language Model**Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.*2019 · 1,262 citations*](https://md.research.elamur.ai/free/en/papers/martin-2019-camembert-tasty-french-language-model/)

**1** [2](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/)