---
title: "Who cites BERT: Pre-training of Deep Bidirectional…"
description: "23,422 papers of the Elamur Research library cite «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [BERT: Pre-training of Deep Bidirectional…](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) / [cited by](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) / page 2

# Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 2 of 15 · 101–200 · [← the paper](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) **2** [3](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/3/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/3/)

101. [**What Makes Good In-Context Examples for GPT-3?**Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.*2022 · 1,235 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-what-makes-good-context-examples/)
102. [**Latent Retrieval for Weakly Supervised Open Domain Question Answering**Kenton Lee, Ming-Wei Chang, Kristina Toutanova*2019 · 1,234 citations*](https://md.research.elamur.ai/free/en/papers/lee-2019-latent-retrieval-weakly-supervised-open/)
103. [**A Structural Probe for Finding Syntax in Word Representations**John Hewitt, Christopher D. Manning*2019 · 1,228 citations*](https://md.research.elamur.ai/free/en/papers/hewitt-2019-structural-probe-finding-syntax-word/)
104. [**PIQA: Reasoning about Physical Commonsense in Natural Language**Yonatan Bisk, Rowan Zellers, Ronan Le Bras, et al.*2019 · 1,218 citations*](https://md.research.elamur.ai/free/en/papers/bisk-2019-piqa-reasoning-about-physical-commonsense/)
105. [**Publicly Available Clinical BERT Embeddings**Emily Alsentzer, John R. Murphy, Willie Boag, et al.*2019 · 1,209 citations*](https://md.research.elamur.ai/free/en/papers/alsentzer-2019-publicly-available-clinical-bert-embeddings/)
106. [**Recipes for Building an Open-Domain Chatbot**Stephen Roller, Emily Dinan, Naman Goyal, et al.*2021 · 1,206 citations*](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/)
107. [**Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity**Yao Lu, Max Bartolo, Alastair Moore, et al.*2022 · 1,187 citations*](https://md.research.elamur.ai/free/en/papers/lu-2022-fantastically-ordered-prompts-where-find/)
108. [**A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly**Yifan Yao, Jinhao Duan, Kaidi Xu, et al.*2023 · 1,181 citations*](https://md.research.elamur.ai/free/en/papers/yao-2023-survey-large-language-model-llm/)
109. [**On the Cross-lingual Transferability of Monolingual Representations**Mikel Artetxe, Sebastian Ruder, Dani Yogatama*2020 · 1,168 citations*](https://md.research.elamur.ai/free/en/papers/artetxe-2020-cross-lingual-transferability-monolingual-representations/)
110. [**BERTweet: A pre-trained language model for English Tweets**Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen*2020 · 1,139 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2020-bertweet-pre-trained-language-model/)
111. [**Program Synthesis with Large Language Models**Jacob Austin, Augustus Odena, Maxwell Nye, et al.*2021 · 1,136 citations*](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/)
112. [**StereoSet: Measuring stereotypical bias in pretrained language models**Moin Nadeem, Anna Bethke, Siva Reddy*2021 · 1,131 citations*](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/)
113. [**It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners**Timo Schick, Hinrich Schütze*2021 · 1,118 citations*](https://md.research.elamur.ai/free/en/papers/schick-2021-it-s-not-just-size/)
114. [**Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm**Laria Reynolds, Kyle McDonell*2021 · 1,111 citations*](https://md.research.elamur.ai/free/en/papers/reynolds-2021-prompt-programming-large-language-models/)
115. [**MASS: Masked Sequence to Sequence Pre-training for Language Generation**Kaitao Song, Xu Tan, Tao Qin, et al.*2019 · 1,109 citations*](https://md.research.elamur.ai/free/en/papers/song-2019-mass-masked-sequence-sequence-pre/)
116. [**SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)**Marcos Zampieri, Shervin Malmasi, Preslav Nakov, et al.*2019 · 1,109 citations*](https://md.research.elamur.ai/free/en/papers/zampieri-2019-semeval-2019-task-6-identifying/)
117. [**MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models**Deyao Zhu, Jun Chen, Xiaoqian Shen, et al.*2023 · 1,105 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2023-minigpt-4-enhancing-vision-language/)
118. [**Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them**Mirac Suzgun, Nathan Scales, Nathanael Schärli, et al.*2023 · 1,094 citations*](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/)
119. [**Bias and Fairness in Large Language Models: A Survey**Isabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.*2023 · 1,072 citations*](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/)
120. [**RoFormer: Enhanced Transformer with Rotary Position Embedding**Jianlin Su, Yu Lu, Shengfeng Pan, et al.*2021 · 1,072 citations*](https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/)
121. [**Quantifying Attention Flow in Transformers**Samira Abnar, Willem Zuidema*2020 · 1,049 citations*](https://md.research.elamur.ai/free/en/papers/abnar-2020-quantifying-attention-flow-transformers/)
122. [**GPT Understands, Too**Xiao Liu, Yanan Zheng, Zhengxiao Du, et al.*2021 · 1,039 citations*](https://md.research.elamur.ai/free/en/papers/liu-2021-gpt-understands-too/)
123. [**MTEB: Massive Text Embedding Benchmark**Niklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.*2022 · 1,021 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2022-mteb-massive-text-embedding-benchmark/)
124. [**P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks**Xiao Liu, Kaixuan Ji, Yicheng Fu, et al.*2022 · 1,013 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-p-tuning-prompt-tuning-can/)
125. [**Linguistic Knowledge and Transferability of Contextual Representations**Nelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.*2019 · 1,011 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-linguistic-knowledge-transferability-contextual-representations/)
126. [**VL-BERT: Pre-training of Generic Visual-Linguistic Representations**Weijie Su, Xizhou Zhu, Yue Cao, et al.*2019 · 1,008 citations*](https://md.research.elamur.ai/free/en/papers/su-2019-vl-bert-pre-training-generic/)
127. [**A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models**Wenqi Fan; Yujuan Ding; Liangbo Ning; Shijie Wang; Hengyun Li; Dawei Yin; Tat-Seng Chua;, Qing Li*2024 · 1,006 citations*](https://md.research.elamur.ai/free/en/papers/fan-2024-survey-rag-meeting-llms-towards/)
128. [**K-BERT: Enabling Language Representation with Knowledge Graph**Weijie Liu, Peng Zhou, Zhe Zhao, et al.*2019 · 1,006 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-k-bert-enabling-language-representation/)
129. [**MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices**Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.*2020 · 1,003 citations*](https://md.research.elamur.ai/free/en/papers/sun-2020-mobilebert-compact-task-agnostic-bert/)
130. [**Big Bird: Transformers for Longer Sequences**Manzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.*2020 · 992 citations*](https://md.research.elamur.ai/free/en/papers/zaheer-2020-big-bird-transformers-longer-sequences/)
131. [**ERNIE 2.0: A Continual Pre-training Framework for Language Understanding**Yu Sun, Shuohuan Wang, Yukun Li, et al.*2019 · 976 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-ernie-2-0-continual/)
132. [**PaLM 2 Technical Report**Rohan Anil, Andrew M. Dai, Orhan Firat, et al.*2023 · 971 citations*](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/)
133. [**Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models**Yue Zhang, Yafu Li, Leyang Cui, et al.*2023 · 962 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-siren-s-song-ai-ocean/)
134. [**TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification**Francesco Barbieri, Jose Camacho-Collados, Leonardo Neves, et al.*2020 · 952 citations*](https://md.research.elamur.ai/free/en/papers/barbieri-2020-tweeteval-unified-benchmark-comparative-evaluation/)
135. [**ERNIE: Enhanced Representation through Knowledge Integration**Yu Sun, Shuohuan Wang, Yukun Li, et al.*2019 · 949 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-ernie-enhanced-representation-through-knowledge/)
136. [**AdapterFusion: Non-Destructive Task Composition for Transfer Learning**Jonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, et al.*2020 · 948 citations*](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-adapterfusion-non-destructive-task-composition/)
137. [**MPNet: Masked and Permuted Pre-training for Language Understanding**Kaitao Song, Xu Tan, Tao Qin, et al.*2020 · 944 citations*](https://md.research.elamur.ai/free/en/papers/song-2020-mpnet-masked-permuted-pre-training/)
138. [**DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs**Dheeru Dua, Yizhong Wang, Pradeep Dasigi, et al.*2019 · 941 citations*](https://md.research.elamur.ai/free/en/papers/dua-2019-drop-reading-comprehension-benchmark-requiring/)
139. [**Patient Knowledge Distillation for BERT Model Compression**Siqi Sun, Yu Cheng, Zhe Gan, et al.*2019 · 939 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-patient-knowledge-distillation-bert-model/)
140. [**A Survey of Data Augmentation Approaches for NLP**Steven Y. Feng, Varun Gangal, Jason Wei, et al.*2021 · 935 citations*](https://md.research.elamur.ai/free/en/papers/feng-2021-survey-data-augmentation-approaches-nlp/)
141. [**C-Pack: Packed Resources For General Chinese Embeddings**Shitao Xiao, Zheng Liu, Peitian Zhang, et al.*2023 · 920 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/)
142. [**Extracting Training Data from Large Language Models**Nicholas Carlini, Florian Tramer, Eric Wallace, et al.*2020 · 901 citations*](https://md.research.elamur.ai/free/en/papers/carlini-2020-extracting-training-data-large-language/)
143. [**LayoutLM: Pre-training of Text and Layout for Document Image Understanding**Yiheng Xu, Minghao Li, Lei Cui, et al.*2019 · 889 citations*](https://md.research.elamur.ai/free/en/papers/xu-2019-layoutlm-pre-training-text-layout/)
144. [**Do As I Can, Not As I Say: Grounding Language in Robotic Affordances**Michael Ahn, Anthony Brohan, Noah Brown, et al.*2022 · 873 citations*](https://md.research.elamur.ai/free/en/papers/ahn-2022-i-i-say-grounding-language/)
145. [**ChatGPT: Jack of all trades, master of none**Jan Kocon, Igor Cichecki, Oliwier Kaszyca, et al.*2023 · 863 citations*](https://md.research.elamur.ai/free/en/papers/kocon-2023-chatgpt-jack-all-trades-master/)
146. [**TaPas: Weakly Supervised Table Parsing via Pre-training**Jonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, et al.*2020 · 844 citations*](https://md.research.elamur.ai/free/en/papers/herzig-2020-tapas-weakly-supervised-table-parsing/)
147. [**UNIFIEDQA: Crossing Format Boundaries with a Single QA System**Daniel Khashabi, Sewon Min, Tushar Khot, et al.*2020 · 843 citations*](https://md.research.elamur.ai/free/en/papers/khashabi-2020-unifiedqa-crossing-format-boundaries-single/)
148. [**BERT-ATTACK: Adversarial Attack Against BERT Using BERT**Linyang Li, Ruotian Ma, Qipeng Guo, et al.*2020 · 840 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-bert-attack-adversarial-attack-against/)
149. [**A Unified MRC Framework for Named Entity Recognition**Xiaoya Li, Jingrong Feng, Yuxian Meng, et al.*2020 · 833 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-unified-mrc-framework-named-entity/)
150. [**MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*2020 · 831 citations*](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-mad-x-adapter-based-framework/)
151. [**On the Sentence Embeddings from Pre-trained Language Models**Bohan Li, Hao Zhou, Junxian He, et al.*2020 · 830 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-sentence-embeddings-pre-trained-language/)
152. [**Unsupervised Dense Information Retrieval with Contrastive Learning**Gautier Izacard, Mathilde Caron, Lucas Hosseini, et al.*2021 · 824 citations*](https://md.research.elamur.ai/free/en/papers/izacard-2021-unsupervised-dense-information-retrieval-contrastive/)
153. [**MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance**Wei Zhao, Maxime Peyrard, Fei Liu, et al.*2019 · 822 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2019-moverscore-text-generation-evaluating-contextualized/)
154. [**DocVQA: A Dataset for VQA on Document Images**Minesh Mathew, Dimosthenis Karatzas, C.V. Jawahar*2020 · 820 citations*](https://md.research.elamur.ai/free/en/papers/mathew-2020-docvqa-dataset-vqa-document-images/)
155. [**ERASER: A Benchmark to Evaluate Rationalized NLP Models**Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.*2020 · 820 citations*](https://md.research.elamur.ai/free/en/papers/deyoung-2020-eraser-benchmark-evaluate-rationalized-nlp/)
156. [**Is ChatGPT a General-Purpose Natural Language Processing Task Solver?**Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.*2023 · 818 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-chatgpt-general-purpose-natural-language/)
157. [**GPT-NeoX-20B: An Open-Source Autoregressive Language Model**Sidney Black, Stella Biderman, Eric Hallahan, et al.*2022 · 818 citations*](https://md.research.elamur.ai/free/en/papers/black-2022-gpt-neox-20b-open-source/)
158. [**Entity, Relation, and Event Extraction with Contextualized Span Representations**David Wadden, Ulme Wennberg, Yi Luan, et al.*2019 · 818 citations*](https://md.research.elamur.ai/free/en/papers/wadden-2019-entity-relation-event-extraction-contextualized/)
159. [**Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond**Jingfeng Yang, Hongye Jin, Ruixiang Tang, et al.*2023 · 806 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-harnessing-power-llms-practice-survey/)
160. [**BARTScore: Evaluating Generated Text as Text Generation**Weizhe Yuan, Graham Neubig, Pengfei Liu*2021 · 806 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2021-bartscore-evaluating-generated-text-text/)
161. [**XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale**Arun Babu, Changhan Wang, Andros Tjandra, et al.*2021 · 799 citations*](https://md.research.elamur.ai/free/en/papers/babu-2021-xls-r-self-supervised-cross/)
162. [**Learning Deep Transformer Models for Machine Translation**Qiang Wang, Bei Li, Tong Xiao, et al.*2019 · 798 citations*](https://md.research.elamur.ai/free/en/papers/wang-2019-learning-deep-transformer-models-machine/)
163. [**Calibrate Before Use: Improving Few-Shot Performance of Language Models**Tony Z. Zhao, Eric Wallace, Shi Feng, et al.*2021 · 791 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2021-calibrate-before-use-improving-few/)
164. [**Revisiting Pre-Trained Models for Chinese Natural Language Processing**Yiming Cui, Wanxiang Che, Ting Liu, et al.*2020 · 788 citations*](https://md.research.elamur.ai/free/en/papers/cui-2020-revisiting-pre-trained-models-chinese/)
165. [**ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission**Kexin Huang, Jaan Altosaar, Rajesh Ranganath*2019 · 788 citations*](https://md.research.elamur.ai/free/en/papers/huang-2019-clinicalbert-modeling-clinical-notes-predicting/)
166. [**Explainability for Large Language Models: A Survey**Haiyan Zhao, Hanjie Chen, Fan Yang, et al.*2023 · 785 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-explainability-large-language-models-survey/)
167. [**Towards Reasoning in Large Language Models: A Survey**Jie Huang, Kevin Chen-Chuan Chang*2023 · 775 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-reasoning-large-language-models-survey/)
168. [**GLM-130B: An Open Bilingual Pre-trained Model**Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.*2022 · 775 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2022-glm-130b-open-bilingual-pre/)
169. [**Relational Graph Attention Network for Aspect-based Sentiment Analysis**Kai Wang, Weizhou Shen, Yunyi Yang, et al.*2020 · 775 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-relational-graph-attention-network-aspect/)
170. [**LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking**Yupan Huang, Tengchao Lv, Lei Cui, et al.*2022 · 774 citations*](https://md.research.elamur.ai/free/en/papers/huang-2022-layoutlmv3-pre-training-document-ai/)
171. [**Reformer: The Efficient Transformer**Nikita Kitaev, Łukasz Kaiser, Anselm Levskaya*2020 · 774 citations*](https://md.research.elamur.ai/free/en/papers/kitaev-2020-reformer-efficient-transformer/)
172. [**ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision**Wonjae Kim, Bokyung Son, Ildoo Kim*2021 · 762 citations*](https://md.research.elamur.ai/free/en/papers/kim-2021-vilt-vision-language-transformer-convolution/)
173. [**On Measuring Social Biases in Sentence Encoders**Chandler May, Alex Wang, Shikha Bordia, et al.*2019 · 761 citations*](https://md.research.elamur.ai/free/en/papers/may-2019-measuring-social-biases-sentence-encoders/)
174. [**Reproducible scaling laws for contrastive language-image learning**Mehdi Cherti, Romain Beaumont, Ross Wightman, et al.*2022 · 750 citations*](https://md.research.elamur.ai/free/en/papers/cherti-2022-reproducible-scaling-laws-contrastive-language/)
175. [**EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks**Jason Wei, Kai Zou*2019 · 750 citations*](https://md.research.elamur.ai/free/en/papers/wei-2019-eda-easy-data-augmentation-techniques/)
176. [**ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning**Ahmed Masry, Do Xuan Long, Jia Qing Tan, et al.*2022 · 744 citations*](https://md.research.elamur.ai/free/en/papers/masry-2022-chartqa-benchmark-question-answering-about/)
177. [**Integrating Multimodal Information in Large Pretrained Transformers**Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.*2020 · 742 citations*](https://md.research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/)
178. [**Revealing the Dark Secrets of BERT**Olga Kovaleva, Alexey Romanov, Anna Rogers, et al.*2019 · 737 citations*](https://md.research.elamur.ai/free/en/papers/kovaleva-2019-revealing-dark-secrets-bert/)
179. [**Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning**Haokun Liu, Derek Tam, Mohammed Muqeeth, et al.*2022 · 735 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-few-shot-parameter-efficient-fine/)
180. [**Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps**Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, et al.*2020 · 735 citations*](https://md.research.elamur.ai/free/en/papers/ho-2020-constructing-multi-hop-qa-dataset/)
181. [**MLQA: Evaluating Cross-lingual Extractive Question Answering**Patrick Lewis, Barlas Oğuz, Ruty Rinott, et al.*2019 · 735 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2019-mlqa-evaluating-cross-lingual-extractive/)
182. [**A Novel Cascade Binary Tagging Framework for Relational Triple Extraction**Zhepei Wei, Jianlin Su, Yue Wang, et al.*2020 · 732 citations*](https://md.research.elamur.ai/free/en/papers/wei-2020-novel-cascade-binary-tagging-framework/)
183. [**Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach**Wenpeng Yin, Jamaal Hay, Dan Roth*2019 · 731 citations*](https://md.research.elamur.ai/free/en/papers/yin-2019-benchmarking-zero-shot-text-classification/)
184. [**IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages**Divyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.*2020 · 730 citations*](https://md.research.elamur.ai/free/en/papers/kakwani-2020-indicnlpsuite-monolingual-corpora-evaluation-benchmarks/)
185. [**Learning To Retrieve Prompts for In-Context Learning**Ohad Rubin, Jonathan Herzig, Jonathan Berant*2021 · 717 citations*](https://md.research.elamur.ai/free/en/papers/rubin-2021-learning-retrieve-prompts-context-learning/)
186. [**A Multiscale Visualization of Attention in the Transformer Model**Jesse Vig*2019 · 708 citations*](https://md.research.elamur.ai/free/en/papers/vig-2019-multiscale-visualization-attention-transformer-model/)
187. [**Fact or Fiction: Verifying Scientific Claims**David Wadden, Shanchuan Lin, Kyle Lo, et al.*2020 · 706 citations*](https://md.research.elamur.ai/free/en/papers/wadden-2020-fact-or-fiction-verifying-scientific/)
188. [**Capabilities of GPT-4 on Medical Challenge Problems**Harsha Nori, Nicholas King, Scott Mayer McKinney, et al.*2023 · 700 citations*](https://md.research.elamur.ai/free/en/papers/nori-2023-capabilities-gpt-4-medical-challenge/)
189. [**Crosslingual Generalization through Multitask Finetuning**Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.*2022 · 692 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2022-crosslingual-generalization-through-multitask-finetuning/)
190. [**GLTR: Statistical Detection and Visualization of Generated Text**Sebastian Gehrmann, Hendrik Strobelt, Alexander M. Rush*2019 · 691 citations*](https://md.research.elamur.ai/free/en/papers/gehrmann-2019-gltr-statistical-detection-visualization-generated/)
191. [**SPECTER: Document-level Representation Learning using Citation-informed Transformers**Arman Cohan, Sergey Feldman, Iz Beltagy, et al.*2020 · 690 citations*](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/)
192. [**TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data**Pengcheng Yin, Graham Neubig, Wen-tau Yih, et al.*2020 · 690 citations*](https://md.research.elamur.ai/free/en/papers/yin-2020-tabert-pretraining-joint-understanding-textual/)
193. [**Explain Yourself! Leveraging Language Models for Commonsense Reasoning**Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.*2019 · 690 citations*](https://md.research.elamur.ai/free/en/papers/rajani-2019-explain-yourself-leveraging-language-models/)
194. [**CORD-19: The COVID-19 Open Research Dataset**Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, et al.*2020 · 685 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-cord-19-covid-19-open/)
195. [**Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes**Cheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.*2023 · 684 citations*](https://md.research.elamur.ai/free/en/papers/hsieh-2023-distilling-step-step-outperforming-larger/)
196. [**DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation**Yizhe Zhang, Siqi Sun, Michel Galley, et al.*2019 · 684 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2019-dialogpt-large-scale-generative-pre/)
197. [**ELI5: Long Form Question Answering**Angela Fan, Yacine Jernite, Ethan Perez, et al.*2019 · 682 citations*](https://md.research.elamur.ai/free/en/papers/fan-2019-eli5-long-form-question-answering/)
198. [**Large Language Models Are Human-Level Prompt Engineers**Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.*2022 · 677 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2022-large-language-models-human-level/)
199. [**Mask-Predict: Parallel Decoding of Conditional Masked Language Models**Marjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.*2019 · 671 citations*](https://md.research.elamur.ai/free/en/papers/ghazvininejad-2019-mask-predict-parallel-decoding-conditional/)
200. [**Well-Read Students Learn Better: On the Importance of Pre-training Compact Models**Iulia Turc, Ming-Wei Chang, Kenton Lee, et al.*2019 · 671 citations*](https://md.research.elamur.ai/free/en/papers/turc-2019-well-read-students-learn-better/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) **2** [3](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/3/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/3/)

- [← back to](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) — BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding