---
title: "Who cites BERT: Pre-training of Deep Bidirectional…"
description: "23,422 papers of the Elamur Research library cite «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/7/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/7/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [BERT: Pre-training of Deep Bidirectional…](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) / [cited by](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) / page 7

# Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 7 of 15 · 601–700 · [← the paper](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/6/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) … [6](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/6/) **7** [8](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/)

601. [**Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training**Oshin Agarwal, Heming Ge, Siamak Shakeri, et al.*2021 · 238 citations*](https://md.research.elamur.ai/free/en/papers/agarwal-2021-knowledge-graph-based-synthetic-corpus/)
602. [**Multimodal Few-Shot Learning with Frozen Language Models**Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.*2021 · 238 citations*](https://md.research.elamur.ai/free/en/papers/tsimpoukelli-2021-multimodal-few-shot-learning-frozen/)
603. [**Perceiver: General Perception with Iterative Attention**Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.*2021 · 238 citations*](https://md.research.elamur.ai/free/en/papers/jaegle-2021-perceiver-general-perception-iterative-attention/)
604. [**mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval**Xin Zhang, Yanzhao Zhang, Dingkun Long, et al.*2024 · 236 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-mgte-generalized-long-context-text/)
605. [**COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs**Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, et al.*2020 · 235 citations*](https://md.research.elamur.ai/free/en/papers/hwang-2020-comet-atomic-2020-symbolic-neural/)
606. [**Generative Language Modeling for Automated Theorem Proving**Stanislas Polu, Ilya Sutskever*2020 · 235 citations*](https://md.research.elamur.ai/free/en/papers/polu-2020-generative-language-modeling-automated-theorem/)
607. [**SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification**Elisabetta Fersini, Francesca Gasparini, Giulia Rizzi, et al.*2022 · 234 citations*](https://md.research.elamur.ai/free/en/papers/fersini-2022-semeval-2022-task-5-multimedia/)
608. [**Self-Guided Contrastive Learning for BERT Sentence Representations**Taeuk Kim, Kang Min Yoo, Sang-goo Lee*2021 · 234 citations*](https://md.research.elamur.ai/free/en/papers/kim-2021-self-guided-contrastive-learning-bert/)
609. [**The Importance of Modeling Social Factors of Language: Theory and Practice**Dirk Hovy, Diyi Yang*2021 · 234 citations*](https://md.research.elamur.ai/free/en/papers/hovy-2021-importance-modeling-social-factors-language/)
610. [**Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English Text**Bharathi Raja Chakravarthi, Vigneshwaran Muralidaran, Ruba Priyadharshini, et al.*2020 · 234 citations*](https://md.research.elamur.ai/free/en/papers/chakravarthi-2020-corpus-creation-sentiment-analysis-code/)
611. [**MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension**Alon Talmor, Jonathan Berant*2019 · 234 citations*](https://md.research.elamur.ai/free/en/papers/talmor-2019-multiqa-empirical-investigation-generalization-transfer/)
612. [**CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learning**Sarkar Snigdha Sarathi Das, Arzoo Katiyar, Rebecca Passonneau, et al.*2022 · 233 citations*](https://md.research.elamur.ai/free/en/papers/das-2022-container-few-shot-named-entity/)
613. [**A Discrete Hard EM Approach for Weakly Supervised Question Answering**Sewon Min, Danqi Chen, Hannaneh Hajishirzi, et al.*2019 · 233 citations*](https://md.research.elamur.ai/free/en/papers/min-2019-discrete-hard-em-approach-weakly/)
614. [**Dialog State Tracking: A Neural Reading Comprehension Approach**Shuyang Gao, Abhishek Sethi, Sanchit Agarwal, et al.*2019 · 233 citations*](https://md.research.elamur.ai/free/en/papers/gao-2019-dialog-state-tracking-neural-reading/)
615. [**Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision**Zhiqing Sun, Yikang Shen, Qinhong Zhou, et al.*2023 · 232 citations*](https://md.research.elamur.ai/free/en/papers/sun-2023-principle-driven-self-alignment-language/)
616. [**Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information**Michele Bevilacqua, Roberto Navigli*2020 · 232 citations*](https://md.research.elamur.ai/free/en/papers/bevilacqua-2020-breaking-through-80-glass-ceiling/)
617. [**Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders**Terra Blevins, Luke Zettlemoyer*2020 · 232 citations*](https://md.research.elamur.ai/free/en/papers/blevins-2020-moving-down-long-tail-word/)
618. [**How Context Affects Language Models' Factual Predictions**Fabio Petroni, Patrick Lewis, Aleksandra Piktus, et al.*2020 · 231 citations*](https://md.research.elamur.ai/free/en/papers/petroni-2020-context-affects-language-models-factual/)
619. [**Compositional Questions Do Not Necessitate Multi-hop Reasoning**Sewon Min, Eric Wallace, Sameer Singh, et al.*2019 · 231 citations*](https://md.research.elamur.ai/free/en/papers/min-2019-compositional-questions-do-not-necessitate/)
620. [**Detecting Hallucinated Content in Conditional Neural Sequence Generation**Chunting Zhou, Graham Neubig, Jiatao Gu, et al.*2021 · 229 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2021-detecting-hallucinated-content-conditional-neural/)
621. [**Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies**Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, et al.*2021 · 228 citations*](https://md.research.elamur.ai/free/en/papers/dev-2021-harms-gender-exclusivity-challenges-non/)
622. [**CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairs**Ahmed El-Kishky, Vishrav Chaudhary, Francisco Guzmán, et al.*2020 · 228 citations*](https://md.research.elamur.ai/free/en/papers/kishky-2020-ccaligned-massive-collection-cross-lingual/)
623. [**AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on Tweets**Marco Polignano, Pierpaolo Basile, Marco de Gemmis, et al.*2019 · 228 citations*](https://md.research.elamur.ai/free/en/papers/polignano-2019-alberto-italian-bert-language-understanding/)
624. [**Hurdles to Progress in Long-form Question Answering**Kalpesh Krishna, Aurko Roy, Mohit Iyyer*2021 · 227 citations*](https://md.research.elamur.ai/free/en/papers/krishna-2021-hurdles-progress-long-form-question/)
625. [**Neural CRF Model for Sentence Alignment in Text Simplification**Chao Jiang, Mounica Maddela, Wuwei Lan, et al.*2020 · 227 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2020-neural-crf-model-sentence-alignment/)
626. [**Overview of the TREC 2019 deep learning track**Nick Craswell, Bhaskar Mitra, Emine Yilmaz, et al.*2020 · 224 citations*](https://md.research.elamur.ai/free/en/papers/craswell-2020-overview-trec-2019-deep-learning/)
627. [**Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting**Haoyang Huang, Tianyi Tang, Dongdong Zhang, et al.*2023 · 223 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-all-languages-created-equal-llms/)
628. [**Unsupervised Evaluation of Interactive Dialog with DialoGPT**Shikib Mehri, Maxine Eskenazi*2020 · 223 citations*](https://md.research.elamur.ai/free/en/papers/mehri-2020-unsupervised-evaluation-interactive-dialog-dialogpt/)
629. [**Learning to Faithfully Rationalize by Construction**Sarthak Jain, Sarah Wiegreffe, Yuval Pinter, et al.*2020 · 222 citations*](https://md.research.elamur.ai/free/en/papers/jain-2020-learning-faithfully-rationalize-construction/)
630. [**Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level Neural Machine Translation**Marcin Junczys-Dowmunt*2019 · 222 citations*](https://md.research.elamur.ai/free/en/papers/dowmunt-2019-microsoft-translator-wmt-2019-large/)
631. [**The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives**Elena Voita, Rico Sennrich, Ivan Titov*2019 · 222 citations*](https://md.research.elamur.ai/free/en/papers/voita-2019-bottom-up-evolution-representations-transformer/)
632. [**HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification**Yichen Jiang, Shikha Bordia, Zheng Zhong, et al.*2020 · 221 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2020-hover-dataset-many-hop-fact/)
633. [**Reasoning Over Semantic-Level Graph for Fact Checking**Wanjun Zhong, Jingjing Xu, Duyu Tang, et al.*2020 · 221 citations*](https://md.research.elamur.ai/free/en/papers/zhong-2020-reasoning-over-semantic-level-graph/)
634. [**Transformer Memory as a Differentiable Search Index**Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.*2022 · 220 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-transformer-memory-differentiable-search-index/)
635. [**NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models**Chankyu Lee, Rajarshi Roy, Mengyao Xu, et al.*2024 · 219 citations*](https://md.research.elamur.ai/free/en/papers/lee-2024-nv-embed-improved-techniques-training/)
636. [**Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment**Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li*2023 · 219 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-trustworthy-llms-survey-guideline-evaluating/)
637. [**Multilingual Translation from Denoising Pre-Training**Yuqing Tang, Chau Tran, Xian Li, et al.*2021 · 219 citations*](https://md.research.elamur.ai/free/en/papers/tang-2021-multilingual-translation-denoising-pre-training/)
638. [**A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages**Pedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot*2020 · 219 citations*](https://md.research.elamur.ai/free/en/papers/suarez-2020-monolingual-approach-contextualized-word-embeddings/)
639. [**Generating Fact Checking Explanations**Pepa Atanasova, Jakob Grue Simonsen, Christina Lioma, et al.*2020 · 219 citations*](https://md.research.elamur.ai/free/en/papers/atanasova-2020-generating-fact-checking-explanations/)
640. [**What Happens To BERT Embeddings During Fine-tuning?**Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, et al.*2020 · 219 citations*](https://md.research.elamur.ai/free/en/papers/merchant-2020-what-happens-bert-embeddings-during/)
641. [**Head-Driven Phrase Structure Grammar Parsing on Penn Treebank**Junru Zhou, Hai Zhao*2019 · 219 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2019-head-driven-phrase-structure-grammar/)
642. [**Break It Down: A Question Understanding Benchmark**Tomer Wolfson, Mor Geva, Ankit Gupta, et al.*2020 · 218 citations*](https://md.research.elamur.ai/free/en/papers/wolfson-2020-break-it-down-question-understanding/)
643. [**Unsupervised Question Decomposition for Question Answering**Ethan Perez, Patrick Lewis, Wen-tau Yih, et al.*2020 · 218 citations*](https://md.research.elamur.ai/free/en/papers/perez-2020-unsupervised-question-decomposition-question-answering/)
644. [**Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models**Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.*2023 · 217 citations*](https://md.research.elamur.ai/free/en/papers/sengupta-2023-jais-jais-chat-arabic-centric/)
645. [**FOLIO: Natural Language Reasoning with First-Order Logic**Simeng Han, Hailey Schoelkopf, Yilun Zhao, et al.*2022 · 217 citations*](https://md.research.elamur.ai/free/en/papers/han-2022-folio-natural-language-reasoning-first/)
646. [**Structured Pruning Learns Compact and Accurate Models**Mengzhou Xia, Zexuan Zhong, Danqi Chen*2022 · 216 citations*](https://md.research.elamur.ai/free/en/papers/xia-2022-structured-pruning-learns-compact-accurate/)
647. [**Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models**Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.*2020 · 216 citations*](https://md.research.elamur.ai/free/en/papers/lin-2020-birds-have-four-legs-numersense/)
648. [**Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index**Minjoon Seo, Jinhyuk Lee, Tom Kwiatkowski, et al.*2019 · 216 citations*](https://md.research.elamur.ai/free/en/papers/seo-2019-real-time-open-domain-question/)
649. [**YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available Resources**Chi-kiu Lo*2019 · 216 citations*](https://md.research.elamur.ai/free/en/papers/lo-2019-yisi-unified-semantic-mt-quality/)
650. [**Annotating and Modeling Fine-grained Factuality in Summarization**Tanya Goyal, Greg Durrett*2021 · 215 citations*](https://md.research.elamur.ai/free/en/papers/goyal-2021-annotating-modeling-fine-grained-factuality/)
651. [**Syntactic Data Augmentation Increases Robustness to Inference Heuristics**Junghyun Min, R. Thomas McCoy, Dipanjan Das, et al.*2020 · 215 citations*](https://md.research.elamur.ai/free/en/papers/min-2020-syntactic-data-augmentation-increases-robustness/)
652. [**An Unsupervised Sentence Embedding Method by Mutual Information Maximization**Yan Zhang, Ruidan He, Zuozhu Liu, et al.*2020 · 213 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2020-unsupervised-sentence-embedding-method-mutual/)
653. [**Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4**Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, et al.*2023 · 212 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-evaluating-logical-reasoning-ability-chatgpt/)
654. [**TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task**Christoph Alt, Aleksandra Gabryszak, Leonhard Hennig*2020 · 212 citations*](https://md.research.elamur.ai/free/en/papers/alt-2020-tacred-revisited-thorough-evaluation-tacred/)
655. [**MADLAD-400: A Multilingual And Document-Level Large Audited Dataset**Sneha Kudugunta, Isaac Caswell, Biao Zhang, et al.*2023 · 211 citations*](https://md.research.elamur.ai/free/en/papers/kudugunta-2023-madlad-400-multilingual-document-level/)
656. [**Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?**Byung-Doh Oh, William Schuler*2023 · 211 citations*](https://md.research.elamur.ai/free/en/papers/oh-2023-why-does-surprisal-larger-transformer/)
657. [**An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models**Nicholas Meade, Elinor Poole-Dayan, Siva Reddy*2022 · 211 citations*](https://md.research.elamur.ai/free/en/papers/meade-2022-empirical-survey-effectiveness-debiasing-techniques/)
658. [**Answers Unite! Unsupervised Metrics for Reinforced Summarization Models**Thomas Scialom, Sylvain Lamprier, Benjamin Piwowarski, et al.*2019 · 210 citations*](https://md.research.elamur.ai/free/en/papers/scialom-2019-answers-unite-unsupervised-metrics-reinforced/)
659. [**LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders**Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, et al.*2024 · 209 citations*](https://md.research.elamur.ai/free/en/papers/behnamghader-2024-llm2vec-large-language-models-secretly/)
660. [**Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch**Le Yu, Bowen Yu, Haiyang Yu, et al.*2023 · 209 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-language-models-super-mario-absorbing/)
661. [**Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning**Pan Lu, Liang Qiu, Kai-Wei Chang, et al.*2022 · 209 citations*](https://md.research.elamur.ai/free/en/papers/lu-2022-dynamic-prompt-learning-policy-gradient/)
662. [**Logical Natural Language Generation from Open-Domain Tables**Wenhu Chen, Jianshu Chen, Yu Su, et al.*2020 · 209 citations*](https://md.research.elamur.ai/free/en/papers/chen-2020-logical-natural-language-generation-open/)
663. [**Active Example Selection for In-Context Learning**Yiming Zhang, Shi Feng, Chenhao Tan*2022 · 207 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-active-example-selection-context-learning/)
664. [**Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP**Timo Schick, Sahana Udupa, Hinrich Schutze*2021 · 207 citations*](https://md.research.elamur.ai/free/en/papers/schick-2021-self-diagnosis-self-debiasing-proposal/)
665. [**Enabling Language Models to Fill in the Blanks**Chris Donahue, Mina Lee, Percy Liang*2020 · 207 citations*](https://md.research.elamur.ai/free/en/papers/donahue-2020-enabling-language-models-fill-blanks/)
666. [**Generating Training Data with Language Models: Towards Zero-Shot Language Understanding**Yu Meng, Jiaxin Huang, Yu Zhang, et al.*2022 · 206 citations*](https://md.research.elamur.ai/free/en/papers/meng-2022-generating-training-data-language-models/)
667. [**Prompting GPT-3 To Be Reliable**Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.*2022 · 206 citations*](https://md.research.elamur.ai/free/en/papers/si-2022-prompting-gpt-3-reliable/)
668. [**Challenges in Detoxifying Language Models**Johannes Welbl, Amelia Glaese, Jonathan Uesato, et al.*2021 · 206 citations*](https://md.research.elamur.ai/free/en/papers/welbl-2021-challenges-detoxifying-language-models/)
669. [**Explaining Answers with Entailment Trees**Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, et al.*2021 · 206 citations*](https://md.research.elamur.ai/free/en/papers/dalvi-2021-explaining-answers-entailment-trees/)
670. [**Training Question Answering Models From Synthetic Data**Raul Puri, Ryan Spring, Mohammad Shoeybi, et al.*2020 · 206 citations*](https://md.research.elamur.ai/free/en/papers/puri-2020-training-question-answering-models-synthetic/)
671. [**Entities as Experts: Sparse Memory Access with Entity Supervision**Thibault Févry, Livio Baldini Soares, Nicholas FitzGerald, et al.*2020 · 205 citations*](https://md.research.elamur.ai/free/en/papers/fevry-2020-entities-as-experts-sparse-memory/)
672. [**LLM+P: Empowering Large Language Models with Optimal Planning Proficiency**Bo Liu, Yuqian Jiang, Xiaohan Zhang, et al.*2023 · 204 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-llm-p-empowering-large-language/)
673. [**Towards a Unified Multi-Dimensional Evaluator for Text Generation**Ming Zhong, Yang Liu, Da Yin, et al.*2022 · 204 citations*](https://md.research.elamur.ai/free/en/papers/zhong-2022-unified-multi-dimensional-evaluator-text/)
674. [**Entity-level Factual Consistency of Abstractive Text Summarization**Feng Nan, Ramesh Nallapati, Zhiguo Wang, et al.*2021 · 204 citations*](https://md.research.elamur.ai/free/en/papers/nan-2021-entity-level-factual-consistency-abstractive/)
675. [**On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation**Ruidan He, Linlin Liu, Hai Ye, et al.*2021 · 204 citations*](https://md.research.elamur.ai/free/en/papers/he-2021-effectiveness-adapter-based-tuning-pretrained/)
676. [**mGPT: Few-Shot Learners Go Multilingual**Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.*2022 · 203 citations*](https://md.research.elamur.ai/free/en/papers/shliazhko-2022-mgpt-few-shot-learners-go/)
677. [**Contextualizing Hate Speech Classifiers with Post-hoc Explanation**Brendan Kennedy, Xisen Jin, Aida Mostafazadeh Davani, et al.*2020 · 203 citations*](https://md.research.elamur.ai/free/en/papers/kennedy-2020-contextualizing-hate-speech-classifiers-post/)
678. [**DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation**Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.*2023 · 201 citations*](https://md.research.elamur.ai/free/en/papers/valipour-2023-dylora-parameter-efficient-tuning-pre/)
679. [**AraT5: Text-to-Text Transformers for Arabic Language Generation**El Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed*2022 · 201 citations*](https://md.research.elamur.ai/free/en/papers/nagoudi-2022-arat5-text-text-transformers-arabic/)
680. [**Evaluating Factuality in Generation with Dependency-level Entailment**Tanya Goyal, Greg Durrett*2020 · 201 citations*](https://md.research.elamur.ai/free/en/papers/goyal-2020-evaluating-factuality-generation-dependency-level/)
681. [**CTRLsum: Towards Generic Controllable Text Summarization**Junxian He, Wojciech Kryscinski, Bryan McCann, et al.*2022 · 199 citations*](https://md.research.elamur.ai/free/en/papers/he-2022-ctrlsum-generic-controllable-text-summarization/)
682. [**A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets**Md Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/laskar-2023-systematic-study-comprehensive-evaluation-chatgpt/)
683. [**Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias**Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-large-language-model-attributed-training/)
684. [**Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs**Suyu Ge, Yunan Zhang, Liyuan Liu, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/ge-2023-model-tells-discard-adaptive-kv/)
685. [**Toxicity Detection: Does Context Really Matter?**John Pavlopoulos, Jeffrey Sorensen, Lucas Dixon, et al.*2020 · 198 citations*](https://md.research.elamur.ai/free/en/papers/pavlopoulos-2020-toxicity-detection-does-context-really/)
686. [**Improved Lexically Constrained Decoding for Translation and Monolingual Rewriting**J. Edward Hu, Huda Khayrallah, Ryan Culkin, et al.*2019 · 198 citations*](https://md.research.elamur.ai/free/en/papers/hu-2019-improved-lexically-constrained-decoding-translation/)
687. [**Improving Passage Retrieval with Zero-Shot Question Generation**Devendra Sachan, Mike Lewis, Mandar Joshi, et al.*2022 · 197 citations*](https://md.research.elamur.ai/free/en/papers/sachan-2022-improving-passage-retrieval-zero-shot/)
688. [**COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining**Yu Meng, Chenyan Xiong, Payal Bajaj, et al.*2021 · 196 citations*](https://md.research.elamur.ai/free/en/papers/meng-2021-coco-lm-correcting-contrasting-text/)
689. [**Structured Pruning of Large Language Models**Ziheng Wang, Jeremy Wohlwend, Tao Lei*2020 · 196 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-structured-pruning-large-language-models/)
690. [**Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning**Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.*2022 · 195 citations*](https://md.research.elamur.ai/free/en/papers/alabi-2022-adapting-pre-trained-language-models/)
691. [**Results of the WMT20 Metrics Shared Task**Nitika Mathur, Johnny Wei, Markus Freitag, et al.*2020 · 195 citations*](https://md.research.elamur.ai/free/en/papers/mathur-2020-results-wmt20-metrics-shared-task/)
692. [**InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction**Xiao Wang, Weikang Zhou, Can Zu, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-instructuie-multi-task-instruction-tuning/)
693. [**Time-Aware Language Models as Temporal Knowledge Bases**Bhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.*2022 · 194 citations*](https://md.research.elamur.ai/free/en/papers/dhingra-2022-time-aware-language-models-as/)
694. [**End-to-End Slot Alignment and Recognition for Cross-Lingual NLU**Weijia Xu, Batool Haider, Saab Mansour*2020 · 194 citations*](https://md.research.elamur.ai/free/en/papers/xu-2020-end-end-slot-alignment-recognition/)
695. [**Generative Data Augmentation for Commonsense Reasoning**Yiben Yang, Chaitanya Malaviya, Jared Fernandez, et al.*2020 · 194 citations*](https://md.research.elamur.ai/free/en/papers/yang-2020-generative-data-augmentation-commonsense-reasoning/)
696. [**What Can We Learn from Collective Human Opinions on Natural Language Inference Data?**Yixin Nie, Xiang Zhou, Mohit Bansal*2020 · 193 citations*](https://md.research.elamur.ai/free/en/papers/nie-2020-what-can-we-learn-collective/)
697. [**MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning**Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.*2023 · 192 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-minigpt-v2-large-language-model/)
698. [**Exploring and Predicting Transferability across NLP Tasks**Tu Vu, Tong Wang, Tsendsuren Munkhdalai, et al.*2020 · 192 citations*](https://md.research.elamur.ai/free/en/papers/vu-2020-exploring-predicting-transferability-across-nlp/)
699. [**Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts**Yue Guo, Yi Yang, Ahmed Abbasi*2022 · 191 citations*](https://md.research.elamur.ai/free/en/papers/guo-2022-auto-debias-debiasing-masked-language/)
700. [**Towards Making the Most of ChatGPT for Machine Translation**Keqin Peng, Liang Ding, Qihuang Zhong, et al.*2023 · 190 citations*](https://md.research.elamur.ai/free/en/papers/peng-2023-making-most-chatgpt-machine-translation/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/6/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) … [6](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/6/) **7** [8](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/)

- [← back to](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) — BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding