---
title: "Who cites BERT: Pre-training of Deep Bidirectional…"
description: "23,422 papers of the Elamur Research library cite «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/9/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/9/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [BERT: Pre-training of Deep Bidirectional…](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) / [cited by](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) / page 9

# Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 9 of 15 · 801–900 · [← the paper](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) … [8](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) **9** [10](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/10/)

801. [**MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition**David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, et al.*2022 · 150 citations*](https://md.research.elamur.ai/free/en/papers/adelani-2022-masakhaner-2-0-africa-centric/)
802. [**Pre-Training BERT on Arabic Tweets: Practical Considerations**Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, et al.*2021 · 150 citations*](https://md.research.elamur.ai/free/en/papers/abdelali-2021-pre-training-bert-arabic-tweets/)
803. [**Generation-Augmented Retrieval for Open-domain Question Answering**Yuning Mao, Pengcheng He, Xiaodong Liu, et al.*2020 · 150 citations*](https://md.research.elamur.ai/free/en/papers/mao-2020-generation-augmented-retrieval-open-domain/)
804. [**Language Model Tokenizers Introduce Unfairness Between Languages**Aleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.*2023 · 149 citations*](https://md.research.elamur.ai/free/en/papers/petrov-2023-language-model-tokenizers-introduce-unfairness/)
805. [**HyperTree Proof Search for Neural Theorem Proving**Guillaume Lample, Marie-Anne Lachaux, Thibaut Lavril, et al.*2022 · 149 citations*](https://md.research.elamur.ai/free/en/papers/lample-2022-hypertree-proof-search-neural-theorem/)
806. [**ProsocialDialog: A Prosocial Backbone for Conversational Agents**Hyunwoo Kim, Youngjae Yu, Liwei Jiang, et al.*2022 · 149 citations*](https://md.research.elamur.ai/free/en/papers/kim-2022-prosocialdialog-prosocial-backbone-conversational-agents/)
807. [**Investigating Pretrained Language Models for Graph-to-Text Generation**Leonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, et al.*2021 · 149 citations*](https://md.research.elamur.ai/free/en/papers/ribeiro-2021-investigating-pretrained-language-models-graph/)
808. [**TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questions**Qiang Ning, Hao Wu, Rujun Han, et al.*2020 · 149 citations*](https://md.research.elamur.ai/free/en/papers/ning-2020-torque-reading-comprehension-dataset-temporal/)
809. [**Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**Jun Zhang, Jue Wang, Huan Li, et al.*2024 · 146 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-draft-verify-lossless-large-language/)
810. [**SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic**Ibrahim Abu Farha, Silviu Vlad Oprea, Steven Wilson, et al.*2022 · 146 citations*](https://md.research.elamur.ai/free/en/papers/farha-2022-semeval-2022-task-6-isarcasmeval/)
811. [**Word-Level Coreference Resolution**Vladimir Dobrovolskii*2021 · 146 citations*](https://md.research.elamur.ai/free/en/papers/dobrovolskii-2021-word-level-coreference-resolution/)
812. [**Fact-Checking Complex Claims with Program-Guided Reasoning**Liangming Pan, Xiaobao Wu, Xinyuan Lu, et al.*2023 · 145 citations*](https://md.research.elamur.ai/free/en/papers/pan-2023-fact-checking-complex-claims-program/)
813. [**The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset**Hugo Laurençon, Lucile Saulnier, Thomas Wang, et al.*2023 · 145 citations*](https://md.research.elamur.ai/free/en/papers/lauren-ccon-2023-bigscience-roots-corpus-1-6tb/)
814. [**Efficient Second-Order TreeCRF for Neural Dependency Parsing**Yu Zhang, Zhenghua Li, Min Zhang*2020 · 145 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2020-efficient-second-order-treecrf-neural/)
815. [**Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing**Zhangchen Xu, Fengqing Jiang, Luyao Niu, et al.*2024 · 144 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-magpie-alignment-data-synthesis-scratch/)
816. [**Unified Demonstration Retriever for In-Context Learning**Xiaonan Li, Kai Lv, Hang Yan, et al.*2023 · 144 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-unified-demonstration-retriever-context-learning/)
817. [**Is GPT-3 a Good Data Annotator?**Bosheng Ding, Chengwei Qin, Linlin Liu, et al.*2022 · 144 citations*](https://md.research.elamur.ai/free/en/papers/ding-2022-gpt-3-good-data-annotator/)
818. [**GLUCOSE: GeneraLized and COntextualized Story Explanations**Nasrin Mostafazadeh, Aditya Kalyanpur, Lori Moon, et al.*2020 · 144 citations*](https://md.research.elamur.ai/free/en/papers/mostafazadeh-2020-glucose-generalized-contextualized-story-explanations/)
819. [**Revealing the Myth of Higher-Order Inference in Coreference Resolution**Liyan Xu, Jinho D. Choi*2020 · 144 citations*](https://md.research.elamur.ai/free/en/papers/xu-2020-revealing-myth-higher-order-inference/)
820. [**UNQOVERing Stereotyping Biases via Underspecified Questions**Tao Li, Daniel Khashabi, Tushar Khot, et al.*2020 · 144 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-unqovering-stereotyping-biases-underspecified-questions/)
821. [**Rethinking embedding coupling in pre-trained language models**Hyung Won Chung, Thibault Févry, Henry Tsai, et al.*2020 · 142 citations*](https://md.research.elamur.ai/free/en/papers/chung-2020-rethinking-embedding-coupling-pre-trained/)
822. [**A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation**Tianyu Liu, Yizhe Zhang, Chris Brockett, et al.*2022 · 140 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-token-level-reference-free-hallucination/)
823. [**Paragraph-level Simplification of Medical Texts**Ashwin Devaraj, Iain Marshall, Byron Wallace, et al.*2021 · 139 citations*](https://md.research.elamur.ai/free/en/papers/devaraj-2021-paragraph-level-simplification-medical-texts/)
824. [**A Report on the 2020 VUA and TOEFL Metaphor Detection Shared Task**Chee Wee (Ben) Leong, Beata Beigman Klebanov, Chris Hamill, et al.*2020 · 138 citations*](https://md.research.elamur.ai/free/en/papers/leong-2020-report-2020-vua-toefl-metaphor/)
825. [**Efficient Training of Language Models to Fill in the Middle**Mohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.*2022 · 137 citations*](https://md.research.elamur.ai/free/en/papers/bavarian-2022-efficient-training-language-models-fill/)
826. [**Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models**Bernd Bohnet, Vinh Q. Tran, Pat Verga, et al.*2022 · 136 citations*](https://md.research.elamur.ai/free/en/papers/bohnet-2022-attributed-question-answering-evaluation-modeling/)
827. [**Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension**Ying Xu, Dakuo Wang, Mo Yu, et al.*2022 · 136 citations*](https://md.research.elamur.ai/free/en/papers/xu-2022-fantastic-questions-where-find-them/)
828. [**Byte Pair Encoding is Suboptimal for Language Model Pretraining**Kaj Bostrom, Greg Durrett*2020 · 136 citations*](https://md.research.elamur.ai/free/en/papers/bostrom-2020-byte-pair-encoding-is-suboptimal/)
829. [**SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects**David Ifeoluwa Adelani, Hannah Liu, Xiaoyu Shen, et al.*2023 · 135 citations*](https://md.research.elamur.ai/free/en/papers/adelani-2023-sib-200-simple-inclusive-big/)
830. [**Affective and Contextual Embedding for Sarcasm Detection**Nastaran Babanejad, Heidar Davoudi, Aijun An, et al.*2020 · 135 citations*](https://md.research.elamur.ai/free/en/papers/babanejad-2020-affective-contextual-embedding-sarcasm-detection/)
831. [**Simple and Effective Masked Diffusion Language Models**Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.*2024 · 134 citations*](https://md.research.elamur.ai/free/en/papers/sahoo-2024-simple-effective-masked-diffusion-language/)
832. [**Few-Shot Self-Rationalization with Natural Language Prompts**Ana Marasovic, Iz Beltagy, Doug Downey, et al.*2022 · 134 citations*](https://md.research.elamur.ai/free/en/papers/marasovic-2022-few-shot-self-rationalization-natural/)
833. [**Enhancing Zero-shot and Few-shot Stance Detection with Commonsense Knowledge Graph**Rui Liu, Zheng Lin, Yutong Tan, et al.*2021 · 134 citations*](https://md.research.elamur.ai/free/en/papers/liu-2021-enhancing-zero-shot-few-shot/)
834. [**Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning**Pan Lu, Ran Gong, Shibiao Jiang, et al.*2021 · 134 citations*](https://md.research.elamur.ai/free/en/papers/lu-2021-inter-gps-interpretable-geometry-problem/)
835. [**Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches**Shane Storks, Qiaozi Gao, Joyce Y. Chai*2019 · 134 citations*](https://md.research.elamur.ai/free/en/papers/storks-2019-recent-advances-natural-language-inference/)
836. [**TICO-19: the Translation Initiative for COvid-19**Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou, et al.*2020 · 133 citations*](https://md.research.elamur.ai/free/en/papers/anastasopoulos-2020-tico-19-translation-initiative-covid/)
837. [**Next Sentence Prediction helps Implicit Discourse Relation Classification within and across Domains**Wei Shi, Vera Demberg*2019 · 133 citations*](https://md.research.elamur.ai/free/en/papers/shi-2019-next-sentence-prediction-helps-implicit/)
838. [**Long-context LLMs Struggle with Long In-context Learning**Tianle Li, Ge Zhang, Quy Duc Do, et al.*2024 · 132 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-long-context-llms-struggle-long/)
839. [**Formal Mathematics Statement Curriculum Learning**Stanislas Polu, Jesse Michael Han, Kunhao Zheng, et al.*2022 · 132 citations*](https://md.research.elamur.ai/free/en/papers/polu-2022-formal-mathematics-statement-curriculum-learning/)
840. [**Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement**Hui Liu, Wenya Wang, Haoliang Li*2022 · 132 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-multi-modal-sarcasm-detection-hierarchical/)
841. [**Task-aware Retrieval with Instructions**Akari Asai, Timo Schick, Patrick Lewis, et al.*2023 · 131 citations*](https://md.research.elamur.ai/free/en/papers/asai-2023-task-aware-retrieval-instructions/)
842. [**Extracting Latent Steering Vectors from Pretrained Language Models**Nishant Subramani, Nivedita Suresh, Matthew Peters*2022 · 131 citations*](https://md.research.elamur.ai/free/en/papers/subramani-2022-extracting-latent-steering-vectors-pretrained/)
843. [**Learning Compact Metrics for MT**Amy Pu, Hyung Won Chung, Ankur Parikh, et al.*2021 · 130 citations*](https://md.research.elamur.ai/free/en/papers/pu-2021-learning-compact-metrics-mt/)
844. [**An Analysis of Natural Language Inference Benchmarks through the Lens of Negation**Md Mosharaf Hossain, Venelin Kovatchev, Pranoy Dutta, et al.*2020 · 130 citations*](https://md.research.elamur.ai/free/en/papers/hossain-2020-analysis-natural-language-inference-benchmarks/)
845. [**Analyzing Transformers in Embedding Space**Guy Dar, Mor Geva, Ankit Gupta, et al.*2023 · 129 citations*](https://md.research.elamur.ai/free/en/papers/dar-2023-analyzing-transformers-embedding-space/)
846. [**Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark**Joel Niklaus, Ilias Chalkidis, Matthias Stürmer*2021 · 129 citations*](https://md.research.elamur.ai/free/en/papers/niklaus-2021-swiss-judgment-prediction-multilingual-legal/)
847. [**Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition**Vered Shwartz, Ido Dagan*2019 · 129 citations*](https://md.research.elamur.ai/free/en/papers/shwartz-2019-still-pain-neck-evaluating-text/)
848. [**Sequence Parallelism: Long Sequence Training from System Perspective**Shenggui Li, Fuzhao Xue, Chaitanya Baranwal, et al.*2023 · 128 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-sequence-parallelism-long-sequence-training/)
849. [**Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages**Kevin Heffernan, Onur Çelebi, Holger Schwenk*2022 · 127 citations*](https://md.research.elamur.ai/free/en/papers/heffernan-2022-bitext-mining-distilled-sentence-representations/)
850. [**NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis**Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.*2022 · 127 citations*](https://md.research.elamur.ai/free/en/papers/muhammad-2022-naijasenti-nigerian-twitter-sentiment-corpus/)
851. [**Arabic aspect based sentiment analysis using bidirectional GRU based models**Mohammed M.Abdelgwad, Taysir Hassan A Soliman, Ahmed I.Taloba, et al.*2021 · 127 citations*](https://md.research.elamur.ai/free/en/papers/m-abdelgwad-2021-arabic-aspect-based-sentiment-analysis/)
852. [**Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors**Liyan Tang, Tanya Goyal, Alex Fabbri, et al.*2023 · 126 citations*](https://md.research.elamur.ai/free/en/papers/tang-2023-understanding-factual-errors-summarization-errors/)
853. [**Interpretable Neural Predictions with Differentiable Binary Variables**Jasmijn Bastings, Wilker Aziz, Ivan Titov*2019 · 126 citations*](https://md.research.elamur.ai/free/en/papers/bastings-2019-interpretable-neural-predictions-differentiable-binary/)
854. [**Adversarial Learning for Zero-Shot Stance Detection on Social Media**Emily Allaway, Malavika Srikanth, Kathleen McKeown*2021 · 124 citations*](https://md.research.elamur.ai/free/en/papers/allaway-2021-adversarial-learning-zero-shot-stance/)
855. [**Large Language Model Alignment: A Survey**Tianhao Shen, Renren Jin, Yufei Huang, et al.*2023 · 123 citations*](https://md.research.elamur.ai/free/en/papers/shen-2023-large-language-model-alignment-survey/)
856. [**Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages**Libo Qin, Qiguang Chen, Fuxuan Wei, et al.*2023 · 122 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-cross-lingual-prompting-improving-zero/)
857. [**LEVER: Learning to Verify Language-to-Code Generation with Execution**Ansong Ni, Srini Iyer, Dragomir Radev, et al.*2023 · 122 citations*](https://md.research.elamur.ai/free/en/papers/ni-2023-lever-learning-verify-language-code/)
858. [**LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain**Joel Niklaus, Veton Matoshi, Pooja Rani, et al.*2023 · 122 citations*](https://md.research.elamur.ai/free/en/papers/niklaus-2023-lextreme-multi-lingual-multi-task/)
859. [**EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language Inference**Abhilasha Ravichander, Aakanksha Naik, Carolyn Rose, et al.*2019 · 122 citations*](https://md.research.elamur.ai/free/en/papers/ravichander-2019-equate-benchmark-evaluation-framework-quantitative/)
860. [**Generative Judge for Evaluating Alignment**Junlong Li, Shichao Sun, Weizhe Yuan, et al.*2023 · 121 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-generative-judge-evaluating-alignment/)
861. [**Automated evaluation of written discourse coherence using GPT-4**Ben Naismith, Phoebe Mulcaire, Jill Burstein*2023 · 120 citations*](https://md.research.elamur.ai/free/en/papers/naismith-2023-automated-evaluation-written-discourse-coherence/)
862. [**Transformer-Patcher: One Mistake worth One Neuron**Zeyu Huang, Yikang Shen, Xiaofeng Zhang, et al.*2023 · 120 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-transformer-patcher-one-mistake-worth/)
863. [**High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics**Markus Freitag, David Grangier, Qijun Tan, et al.*2022 · 120 citations*](https://md.research.elamur.ai/free/en/papers/freitag-2022-high-quality-rather-than-high/)
864. [**AlphaMath Almost Zero: Process Supervision without Process**Guoxin Chen, Minpeng Liao, Chengxi Li, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/chen-2024-alphamath-almost-zero-process-supervision/)
865. [**Knowledge Enhanced Masked Language Model for Stance Detection**Kornraphop Kawintiranon, Lisa Singh*2021 · 119 citations*](https://md.research.elamur.ai/free/en/papers/kawintiranon-2021-knowledge-enhanced-masked-language-model/)
866. [**Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering**Jinheon Baek, Alham Fikri Aji, Amir Saffari*2023 · 118 citations*](https://md.research.elamur.ai/free/en/papers/baek-2023-knowledge-augmented-language-model-prompting/)
867. [**I-BERT: Integer-only BERT Quantization**Sehoon Kim, Amir Gholami, Zhewei Yao, et al.*2021 · 118 citations*](https://md.research.elamur.ai/free/en/papers/kim-2021-i-bert-integer-only-bert/)
868. [**Encode, Tag, Realize: High-Precision Text Editing**Eric Malmi, Sebastian Krause, Sascha Rothe, et al.*2019 · 118 citations*](https://md.research.elamur.ai/free/en/papers/malmi-2019-encode-tag-realize-high-precision/)
869. [**Pretraining Language Models with Human Preferences**Tomasz Korbak, Kejian Shi, Angelica Chen, et al.*2023 · 117 citations*](https://md.research.elamur.ai/free/en/papers/korbak-2023-pretraining-language-models-human-preferences/)
870. [**MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases**Louis Martin, Angela Fan, Éric de la Clergerie, et al.*2022 · 117 citations*](https://md.research.elamur.ai/free/en/papers/martin-2022-muss-multilingual-unsupervised-sentence-simplification/)
871. [**ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic**Fajri Koto, Haonan Li, Sara Shatnawi, et al.*2024 · 116 citations*](https://md.research.elamur.ai/free/en/papers/koto-2024-arabicmmlu-assessing-massive-multitask-language/)
872. [**Intrinsic Bias Metrics Do Not Correlate with Application Bias**Seraphina Goldfarb-Tarrant, Rebecca Marchant, Ricardo Muñoz Sánchez, et al.*2021 · 116 citations*](https://md.research.elamur.ai/free/en/papers/tarrant-2021-intrinsic-bias-metrics-do-not/)
873. [**Entity Linking in 100 Languages**Jan A. Botha, Zifei Shan, Daniel Gillick*2020 · 114 citations*](https://md.research.elamur.ai/free/en/papers/botha-2020-entity-linking-100-languages/)
874. [**MLSUM: The Multilingual Summarization Corpus**Thomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, et al.*2020 · 114 citations*](https://md.research.elamur.ai/free/en/papers/scialom-2020-mlsum-multilingual-summarization-corpus/)
875. [**ALLaM: Large Language Models for Arabic and English**M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/bari-2024-allam-large-language-models-arabic/)
876. [**Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and Negation**Atticus Geiger, Kyle Richardson, Christopher Potts*2020 · 112 citations*](https://md.research.elamur.ai/free/en/papers/geiger-2020-neural-natural-language-inference-models/)
877. [**Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus**Isaac Caswell, Theresa Breiner, Daan van Esch, et al.*2020 · 111 citations*](https://md.research.elamur.ai/free/en/papers/caswell-2020-language-id-wild-unexpected/)
878. [**Certifying LLM Safety against Adversarial Prompting**Aounon Kumar, Chirag Agarwal, Suraj Srinivas, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/kumar-2023-certifying-llm-safety-against-adversarial/)
879. [**AMR-To-Text Generation with Graph Transformer**Tianming Wang, Xiaojun Wan, Hanqi Jin*2020 · 108 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-amr-text-generation-graph-transformer/)
880. [**Physics of Language Models: Part 3.1, Knowledge Storage and Extraction**Zeyuan Allen-Zhu, Yuanzhi Li*2023 · 107 citations*](https://md.research.elamur.ai/free/en/papers/allen-zhu-2023-physics-language-models-part-3/)
881. [**French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than English**Aurélie Névéol, Yoann Dupont, Julien Bezançon, et al.*2022 · 107 citations*](https://md.research.elamur.ai/free/en/papers/neveol-2022-french-crows-pairs-extending-challenge/)
882. [**End-to-End Bias Mitigation by Modelling Biases in Corpora**Rabeeh Karimi Mahabadi, Yonatan Belinkov, James Henderson*2020 · 107 citations*](https://md.research.elamur.ai/free/en/papers/mahabadi-2020-end-end-bias-mitigation-modelling/)
883. [**LEDGAR: A Large-Scale Multi-label Corpus for Text Classification of Legal Provisions in Contracts**Don Tuggener, Pius von Däniken, Thomas Peetz, et al.*2020 · 107 citations*](https://md.research.elamur.ai/free/en/papers/tuggener-2020-ledgar-large-scale-multi-label/)
884. [**TokenSkip: Controllable Chain-of-Thought Compression in LLMs**Heming Xia, Chak Tou Leong, Wenjie Wang, et al.*2025 · 105 citations*](https://md.research.elamur.ai/free/en/papers/xia-2025-tokenskip-controllable-chain-thought-compression/)
885. [**Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation**Verna Dankers, Christopher Lucas, Ivan Titov*2022 · 105 citations*](https://md.research.elamur.ai/free/en/papers/dankers-2022-can-transformer-be-too-compositional/)
886. [**Playing with Words at the National Library of Sweden — Making a Swedish BERT**Martin Malmsten, Love Borjeson, Chris Haffenden*2020 · 105 citations*](https://md.research.elamur.ai/free/en/papers/malmsten-2020-playing-words-national-library-sweden/)
887. [**LENS: A Learnable Evaluation Metric for Text Simplification**Mounica Maddela, Yao Dou, David Heineman, et al.*2023 · 103 citations*](https://md.research.elamur.ai/free/en/papers/maddela-2023-lens-learnable-evaluation-metric-text/)
888. [**An Annotated Dataset of Coreference in English Literature**David Bamman, Olivia Lewke, Anya Mansoor*2020 · 103 citations*](https://md.research.elamur.ai/free/en/papers/bamman-2020-annotated-dataset-coreference-english-literature/)
889. [**Uncertain Natural Language Inference**Tongfei Chen, Zhengping Jiang, Adam Poliak, et al.*2020 · 103 citations*](https://md.research.elamur.ai/free/en/papers/chen-2020-uncertain-natural-language-inference/)
890. [**Tokenizer Choice For LLM Training: Negligible or Crucial?**Mehdi Ali, Michael Fromm, Klaudia Thellmann, et al.*2024 · 102 citations*](https://md.research.elamur.ai/free/en/papers/ali-2024-tokenizer-choice-llm-training-negligible/)
891. [**Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction**Zhanming Jie, Jierui Li, Wei Lu*2022 · 102 citations*](https://md.research.elamur.ai/free/en/papers/jie-2022-learning-reason-deductively-math-word/)
892. [**Scaling Laws for Transfer**Danny Hernandez, Jared Kaplan, Tom Henighan, et al.*2021 · 102 citations*](https://md.research.elamur.ai/free/en/papers/hernandez-2021-scaling-laws-transfer/)
893. [**Findings of the WMT 2019 Shared Task on Automatic Post-Editing**Rajen Chatterjee, Christian Federmann, Matteo Negri, et al.*2019 · 102 citations*](https://md.research.elamur.ai/free/en/papers/chatterjee-2019-findings-wmt-2019-shared-task/)
894. [**Probing Natural Language Inference Models through Semantic Fragments**Kyle Richardson, Hai Hu, Lawrence S. Moss, et al.*2019 · 102 citations*](https://md.research.elamur.ai/free/en/papers/richardson-2019-probing-natural-language-inference-models/)
895. [**Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words**Valentin, Hofmann*2021 · 101 citations*](https://md.research.elamur.ai/free/en/papers/hofmann-2021-superbizarre-derivational/)
896. [**UniTE: Unified Translation Evaluation**Yu Wan, Dayiheng Liu, Baosong Yang, et al.*2022 · 100 citations*](https://md.research.elamur.ai/free/en/papers/wan-2022-unite-unified-translation-evaluation/)
897. [**Inverse Scaling: When Bigger Isn't Better**Ian R. McKenzie, Alexander Lyzhov, Michael Pieler, et al.*2023 · 99 citations*](https://md.research.elamur.ai/free/en/papers/mckenzie-2023-inverse-scaling-bigger-isn-t/)
898. [**Emojis as Anchors to Detect Arabic Offensive Language and Hate Speech**Hamdy Mubarak, Sabit Hassan, Shammur Absar Chowdhury*2022 · 96 citations*](https://md.research.elamur.ai/free/en/papers/mubarak-2022-emojis-anchors-detect-arabic-offensive/)
899. [**Cross-Domain Label-Adaptive Stance Detection**Momchil Hardalov, Arnav Arora, Preslav Nakov, et al.*2021 · 96 citations*](https://md.research.elamur.ai/free/en/papers/hardalov-2021-cross-domain-label-adaptive-stance/)
900. [**LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation**Gustavo Aguilar, Sudipta Kar, Thamar Solorio*2020 · 96 citations*](https://md.research.elamur.ai/free/en/papers/aguilar-2020-lince-centralized-benchmark-linguistic-code/)

[← prev](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) [1](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/) … [8](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/) **9** [10](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/10/)

- [← back to](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) — BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding