---
title: "Who cites RoBERTa: A — page 6 — 9,837 citing papers"
description: "9,837 papers of the Elamur Research library cite «RoBERTa: A Robustly Optimized BERT Pretraining Approach», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [RoBERTa: A Robustly Optimized BERT Pretraining…](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) / [cited by](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) / page 6

# Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 6 of 15 · 501–600 · [← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [5](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/) **6** [7](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/)

501. **[MAGE: Machine-generated Text Detection in the Wild](https://md.research.elamur.ai/free/en/papers/li-2024-mage-machine-generated-text-detection/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yafu Li, Qintong Li, Leyang Cui, et al.*2024 · 129 citations*
502. **[Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark](https://md.research.elamur.ai/free/en/papers/niklaus-2021-swiss-judgment-prediction-multilingual-legal/) [Natural Legal Language Processing Workshop](https://md.research.elamur.ai/free/en/venues/nllp/)**Joel Niklaus, Ilias Chalkidis, Matthias Stürmer*2021 · 129 citations*
503. **[Open-Domain Question Answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Danqi Chen, Wen-tau Yih*2020 · 129 citations*
504. **[Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data](https://md.research.elamur.ai/free/en/papers/shum-2023-automatic-prompt-augmentation-selection-chain/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Kashun Shum, Shizhe Diao, Tong Zhang*2023 · 128 citations*
505. **[MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data](https://md.research.elamur.ai/free/en/papers/zhao-2022-multihiertt-numerical-reasoning-over-multi/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yilun Zhao, Yunxiang Li, Chenying Li, et al.*2022 · 128 citations*
506. [**A Comprehensive Assessment of Dialog Evaluation Metrics The First Workshop on Evaluations and Assessments of Neural Conversation Systems**Yi-Ting Yeh, Maxine Eskenazi, Shikib Mehri*2021 · 128 citations*](https://md.research.elamur.ai/free/en/papers/yeh-2021-comprehensive-assessment-dialog-evaluation-metrics/)
507. **[Zero-shot Event Extraction via Transfer Learning: Challenges and Insights](https://md.research.elamur.ai/free/en/papers/lyu-2021-zero-shot-event-extraction-transfer/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Qing Lyu, Hongming Zhang, Elior Sulem, et al.*2021 · 128 citations*
508. **[NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/muhammad-2022-naijasenti-nigerian-twitter-sentiment-corpus/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.*2022 · 127 citations*
509. **[Exposing the limits of Zero-shot Cross-lingual Hate Speech Detection](https://md.research.elamur.ai/free/en/papers/nozza-2021-exposing-limits-zero-shot-cross/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Debora Nozza*2021 · 127 citations*
510. [**Nomic Embed: Training a Reproducible Long Context Text Embedder arXiv:2402.01613**Zach Nussbaum, John X. Morris, Brandon Duderstadt, et al.*2024 · 126 citations*](https://md.research.elamur.ai/free/en/papers/nussbaum-2024-nomic-embed-training-reproducible-long/)
511. [**LEVER: Learning to Verify Language-to-Code Generation with Execution arXiv:2302.08468**Ansong Ni, Srini Iyer, Dragomir Radev, et al.*2023 · 126 citations*](https://md.research.elamur.ai/free/en/papers/ni-2023-lever-learning-verify-language-code/)
512. [**H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models arXiv:2306.14048**Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.*2023 · 124 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/)
513. [**Large Language Model Alignment: A Survey arXiv:2309.15025**Tianhao Shen, Renren Jin, Yufei Huang, et al.*2023 · 124 citations*](https://md.research.elamur.ai/free/en/papers/shen-2023-large-language-model-alignment-survey/)
514. **[An Improved Baseline for Sentence-level Relation Extraction](https://md.research.elamur.ai/free/en/papers/zhou-2022-improved-baseline-sentence-level-relation/) [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/)**Wenxuan Zhou, Muhao Chen*2022 · 124 citations*
515. **[ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts](https://md.research.elamur.ai/free/en/papers/asai-2022-attempt-parameter-efficient-multi-task/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Akari Asai, Mohammadreza Salehi, Matthew Peters, et al.*2022 · 122 citations*
516. **[Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color](https://md.research.elamur.ai/free/en/papers/abdou-2021-can-language-models-encode-perceptual/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, et al.*2021 · 122 citations*
517. **[I-BERT: Integer-only BERT Quantization](https://md.research.elamur.ai/free/en/papers/kim-2021-i-bert-integer-only-bert/) [International Conference on Machine Learning (ICML)](https://md.research.elamur.ai/free/en/venues/international-conference-on-machine-learning/)**Sehoon Kim, Amir Gholami, Zhewei Yao, et al.*2021 · 122 citations*
518. [**Pretraining Language Models with Human Preferences arXiv:2302.08582**Tomasz Korbak, Kejian Shi, Angelica Chen, et al.*2023 · 121 citations*](https://md.research.elamur.ai/free/en/papers/korbak-2023-pretraining-language-models-human-preferences/)
519. **[ParaDetox: Detoxification with Parallel Data](https://md.research.elamur.ai/free/en/papers/logacheva-2022-paradetox-detoxification-parallel-data/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Varvara Logacheva, Daryna Dementieva, Sergey Ustyantsev, et al.*2022 · 121 citations*
520. **[DocNLI: A Large-scale Dataset for Document-level Natural Language Inference](https://md.research.elamur.ai/free/en/papers/yin-2021-docnli-large-scale-dataset-document/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Wenpeng Yin, Dragomir Radev, Caiming Xiong*2021 · 121 citations*
521. [**Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Text arXiv:2401.12070**Abhimanyu Hans, Avi Schwarzschild, Valeriia Cherepanova, et al.*2024 · 120 citations*](https://md.research.elamur.ai/free/en/papers/hans-2024-spotting-llms-binoculars-zero-shot/)
522. **[Knowledge of cultural moral norms in large language models](https://md.research.elamur.ai/free/en/papers/ramezani-2023-knowledge-cultural-moral-norms-large/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Aida Ramezani, Yang Xu*2023 · 120 citations*
523. [**Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews arXiv:2403.07183**Weixin Liang, Zachary Izzo, Yaohui Zhang, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/liang-2024-monitoring-ai-modified-content/)
524. [**Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering arXiv:2306.04136**Jinheon Baek, Alham Fikri Aji, Amir Saffari*2023 · 119 citations*](https://md.research.elamur.ai/free/en/papers/baek-2023-knowledge-augmented-language-model-prompting/)
525. **[Logical Fallacy Detection](https://md.research.elamur.ai/free/en/papers/jin-2022-logical-fallacy-detection/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhijing Jin, Abhinav Lalwani, Tejas Vaidhya, et al.*2022 · 119 citations*
526. **[Knowledge Enhanced Masked Language Model for Stance Detection](https://md.research.elamur.ai/free/en/papers/kawintiranon-2021-knowledge-enhanced-masked-language-model/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Kornraphop Kawintiranon, Lisa Singh*2021 · 119 citations*
527. **[Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors](https://md.research.elamur.ai/free/en/papers/zhang-2023-aligning-instruction-tasks-unlocks-large/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Kai Zhang, Bernal Jimenez Gutierrez, Yu Su*2023 · 118 citations*
528. [**Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation arXiv:2212.07981**Yixin Liu, Alexander R. Fabbri, Pengfei Liu, et al.*2022 · 117 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-revisiting-gold-standard-grounding-summarization/)
529. [**Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model arXiv:1912.09637**Wenhan Xiong, Jingfei Du, William Yang Wang, et al.*2019 · 117 citations*](https://md.research.elamur.ai/free/en/papers/xiong-2019-pretrained-encyclopedia-weakly-supervised-knowledge/)
530. [**Physics of Language Models: Part 3.1, Knowledge Storage and Extraction arXiv:2309.14316**Zeyuan Allen-Zhu, Yuanzhi Li*2023 · 116 citations*](https://md.research.elamur.ai/free/en/papers/allen-zhu-2023-physics-language-models-part-3/)
531. **[Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias](https://md.research.elamur.ai/free/en/papers/bartl-2020-unmasking-contextual-stereotypes-measuring-mitigating/) [Workshop on Gender Bias in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/gebnlp/)**Marion Bartl, Malvina Nissim, Albert Gatt*2020 · 116 citations*
532. **[Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features](https://md.research.elamur.ai/free/en/papers/lee-2021-pushing-text-readability-assessment-transformer/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Bruce W. Lee, Yoo Sung Jang, Jason Lee*2021 · 115 citations*
533. **[WNUT-2020 Task 2: Identification of Informative COVID-19 English Tweets](https://md.research.elamur.ai/free/en/papers/nguyen-2020-wnut-2020-task-2-identification/) [Workshop on Noisy User-generated Text](https://md.research.elamur.ai/free/en/venues/wnut/)**Dat Quoc Nguyen, Thanh Vu, Afshin Rahimi, et al.*2020 · 115 citations*
534. **[Testing the Ability of Language Models to Interpret Figurative Language](https://md.research.elamur.ai/free/en/papers/liu-2022-testing-ability-language-models-interpret/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Emmy Liu, Chenxuan Cui, Kenneth Zheng, et al.*2022 · 114 citations*
535. **[Aspect-Controllable Opinion Summarization](https://md.research.elamur.ai/free/en/papers/amplayo-2021-aspect-controllable-opinion-summarization/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Reinald Kim Amplayo, Stefanos Angelidis, Mirella Lapata*2021 · 114 citations*
536. **[WiCE: Real-World Entailment for Claims in Wikipedia](https://md.research.elamur.ai/free/en/papers/kamoi-2023-wice-real-world-entailment-claims/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, et al.*2023 · 113 citations*
537. [**Efficient Large Scale Language Modeling with Mixtures of Experts arXiv:2112.10684**Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al.*2021 · 113 citations*](https://md.research.elamur.ai/free/en/papers/artetxe-2021-efficient-large-scale-language-modeling/)
538. **[Logic-Guided Data Augmentation and Regularization for Consistent Question Answering](https://md.research.elamur.ai/free/en/papers/asai-2020-logic-guided-data-augmentation-regularization/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Akari Asai, Hannaneh Hajishirzi*2020 · 113 citations*
539. **[On the Ability and Limitations of Transformers to Recognize Formal Languages](https://md.research.elamur.ai/free/en/papers/bhattamishra-2020-ability-limitations-transformers-recognize-formal/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Satwik Bhattamishra, Kabir Ahuja, Navin Goyal*2020 · 113 citations*
540. **[RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models](https://md.research.elamur.ai/free/en/papers/yang-2021-rap-robustness-aware-perturbations-defending/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Wenkai Yang, Yankai Lin, Peng Li, et al.*2021 · 112 citations*
541. [**Transformer Language Models without Positional Encodings Still Learn Positional Information arXiv:2203.16634**Adi Haviv, Ori Ram, Ofir Press, et al.*2022 · 111 citations*](https://md.research.elamur.ai/free/en/papers/haviv-2022-transformer-language-models-positional-encodings/)
542. **[Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions](https://md.research.elamur.ai/free/en/papers/aliannejadi-2021-building-evaluating-open-domain-dialogue/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, et al.*2021 · 111 citations*
543. **[RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors](https://md.research.elamur.ai/free/en/papers/dugan-2024-raid-shared-benchmark-robust-evaluation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.*2024 · 110 citations*
544. **[GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLP](https://md.research.elamur.ai/free/en/papers/khondaker-2023-gptaraeval-comprehensive-evaluation-chatgpt-arabic/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Md Tawkat Islam Khondaker, Abdul Waheed, El Moatez Billah Nagoudi, et al.*2023 · 110 citations*
545. **[Copyright Violations and Large Language Models](https://md.research.elamur.ai/free/en/papers/karamolegkou-2023-copyright-violations-large-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Antonia Karamolegkou, Jiaang Li, Li Zhou, et al.*2023 · 109 citations*
546. **[ConSeC: Word Sense Disambiguation as Continuous Sense Comprehension](https://md.research.elamur.ai/free/en/papers/barba-2021-consec-word-sense-disambiguation-as/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Edoardo Barba, Luigi Procopio, Roberto Navigli*2021 · 109 citations*
547. **[CausaLM: Causal Model Explanation Through Counterfactual Language Models](https://md.research.elamur.ai/free/en/papers/feder-2021-causalm-causal-model-explanation-through/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Amir Feder, Nadav Oved, Uri Shalit, et al.*2021 · 107 citations*
548. **[An Empirical Study of Pre-trained Transformers for Arabic Information Extraction](https://md.research.elamur.ai/free/en/papers/lan-2020-empirical-study-pre-trained-transformers/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Wuwei Lan, Yang Chen, Wei Xu, et al.*2020 · 107 citations*
549. **[SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval](https://md.research.elamur.ai/free/en/papers/wang-2023-simlm-pre-training-representation-bottleneck/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Liang Wang, Nan Yang, Xiaolong Huang, et al.*2023 · 106 citations*
550. **[CDLM: Cross-Document Language Modeling](https://md.research.elamur.ai/free/en/papers/caciularu-2021-cdlm-cross-document-language-modeling/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Avi Caciularu, Arman Cohan, Iz Beltagy, et al.*2021 · 106 citations*
551. **[Evaluating the Evaluation of Diversity in Natural Language Generation](https://md.research.elamur.ai/free/en/papers/tevet-2021-evaluating-evaluation-diversity-natural-language/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Guy Tevet, Jonathan Berant*2021 · 106 citations*
552. **[Multi-SimLex: A Large-Scale Evaluation of Multilingual and Crosslingual Lexical Semantic Similarity](https://md.research.elamur.ai/free/en/papers/vulic-2020-multi-simlex-large-scale-evaluation/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Ivan Vulić, Simon Baker, Edoardo Maria Ponti, et al.*2020 · 106 citations*
553. [**Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering Proceedings of the First Workshop on Commonsense Inference in Natural Language Processing**Kaixin Ma, Jonathan Francis, Quanyang Lu, et al.*2019 · 105 citations*](https://md.research.elamur.ai/free/en/papers/ma-2019-generalizable-neuro-symbolic-systems-commonsense/)
554. [**A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity arXiv:2305.13169**Shayne Longpre, Gregory Yauney, Emily Reif, et al.*2023 · 104 citations*](https://md.research.elamur.ai/free/en/papers/longpre-2023-pretrainer-s-guide-training-data/)
555. **[LENS: A Learnable Evaluation Metric for Text Simplification](https://md.research.elamur.ai/free/en/papers/maddela-2023-lens-learnable-evaluation-metric-text/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mounica Maddela, Yao Dou, David Heineman, et al.*2023 · 104 citations*
556. **[Investigating Reasons for Disagreement in Natural Language Inference](https://md.research.elamur.ai/free/en/papers/jiang-2022-investigating-reasons-disagreement-natural-language/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nan-Jiang Jiang, Marie-Catherine de Marneffe*2022 · 104 citations*
557. **[Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank](https://md.research.elamur.ai/free/en/papers/chau-2020-parsing-multilingual-bert-small-corpus/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Ethan C. Chau, Lucy H. Lin, Noah A. Smith*2020 · 104 citations*
558. **[Who Wrote this Code? Watermarking for Code Generation](https://md.research.elamur.ai/free/en/papers/lee-2024-who-wrote-this-code-watermarking/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Taehyun Lee, Seokhee Hong, Jaewoo Ahn, et al.*2024 · 103 citations*
559. [**AnglE-optimized Text Embeddings arXiv:2309.12871**Xianming Li, Jing Li*2023 · 103 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-angle-optimized-text-embeddings/)
560. **[PRover: Proof Generation for Interpretable Reasoning over Rules](https://md.research.elamur.ai/free/en/papers/saha-2020-prover-proof-generation-interpretable-reasoning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Swarnadeep Saha, Sayan Ghosh, Shashank Srivastava, et al.*2020 · 103 citations*
561. [**Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction**Zhanming Jie, Jierui Li, Wei Lu*2022 · 102 citations*](https://md.research.elamur.ai/free/en/papers/jie-2022-learning-reason-deductively-math-word/)
562. [**minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models arXiv:2203.13112**Kanishka Misra*2022 · 102 citations*](https://md.research.elamur.ai/free/en/papers/misra-2022-minicons-enabling-flexible-behavioral-representational/)
563. **[On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark](https://md.research.elamur.ai/free/en/papers/sun-2022-safety-conversational-models-taxonomy-dataset/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Hao Sun, Guangxuan Xu, Jiawen Deng, et al.*2022 · 102 citations*
564. **[Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation](https://md.research.elamur.ai/free/en/papers/deng-2021-compression-transduction-creation-unified-framework/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Mingkai Deng, Bowen Tan, Zhengzhong Liu, et al.*2021 · 102 citations*
565. [**Dataless Knowledge Fusion by Merging Weights of Language Models arXiv:2212.09849**Xisen Jin, Xiang Ren, Daniel Preotiuc-Pietro, et al.*2022 · 101 citations*](https://md.research.elamur.ai/free/en/papers/jin-2022-dataless-knowledge-fusion-merging-weights/)
566. **[I like fish, especially dolphins: Addressing Contradictions in Dialogue Modeling](https://md.research.elamur.ai/free/en/papers/nie-2021-i-like-fish-especially-dolphins/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yixin Nie, Mary Williamson, Mohit Bansal, et al.*2021 · 101 citations*
567. **[Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark](https://md.research.elamur.ai/free/en/papers/dziri-2022-evaluating-attribution-dialogue-systems-begin/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nouha Dziri, Hannah Rashkin, Tal Linzen, et al.*2022 · 100 citations*
568. [**VeRA: Vector-based Random Matrix Adaptation arXiv:2310.11454**Dawid J. Kopiczko, Tijmen Blankevoort, Yuki M. Asano*2023 · 99 citations*](https://md.research.elamur.ai/free/en/papers/kopiczko-2023-vera-vector-based-random-matrix/)
569. **[Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasets](https://md.research.elamur.ai/free/en/papers/wu-2022-generating-data-mitigate-spurious-correlations/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuxiang Wu, Matt Gardner, Pontus Stenetorp, et al.*2022 · 99 citations*
570. [**Provable Robust Watermarking for AI-Generated Text arXiv:2306.17439**Xuandong Zhao, Prabhanjan Ananth, Lei Li, et al.*2023 · 98 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-provable-robust-watermarking-ai-generated/)
571. **[Understanding by Understanding Not: Modeling Negation in Language Models](https://md.research.elamur.ai/free/en/papers/hosseini-2021-understanding-understanding-not-modeling-negation/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, et al.*2021 · 98 citations*
572. [**Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge arXiv:2006.06609**Alon Talmor, Oyvind Tafjord, Peter Clark, et al.*2020 · 98 citations*](https://md.research.elamur.ai/free/en/papers/talmor-2020-leap-thought-teaching-pre-trained/)
573. [**LoRA+: Efficient Low Rank Adaptation of Large Models arXiv:2402.12354**Soufiane Hayou, Nikhil Ghosh, Bin Yu*2024 · 97 citations*](https://md.research.elamur.ai/free/en/papers/hayou-2024-lora-efficient-low-rank-adaptation/)
574. [**A Survey of Confidence Estimation and Calibration in Large Language Models arXiv:2311.08298**Jiahui Geng, Fengyu Cai, Yuxia Wang, et al.*2023 · 97 citations*](https://md.research.elamur.ai/free/en/papers/geng-2023-survey-confidence-estimation-calibration-large/)
575. **[AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/antoun-2021-araelectra-pre-training-text-discriminators/) [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/)**Wissam Antoun, Fady Baly, Hazem Hajj*2021 · 97 citations*
576. **[Modeling Framing in Immigration Discourse on Social Media](https://md.research.elamur.ai/free/en/papers/mendelsohn-2021-modeling-framing-immigration-discourse-social/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Julia Mendelsohn, Ceren Budak, David Jurgens*2021 · 97 citations*
577. [**Are Transformers universal approximators of sequence-to-sequence functions? arXiv:1912.10077**Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, et al.*2019 · 97 citations*](https://md.research.elamur.ai/free/en/papers/yun-2019-transformers-universal-approximators-sequence-sequence/)
578. [**The Platonic Representation Hypothesis arXiv:2405.07987**Minyoung Huh, Brian Cheung, Tongzhou Wang, et al.*2024 · 96 citations*](https://md.research.elamur.ai/free/en/papers/huh-2024-platonic-representation-hypothesis/)
579. **[MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction](https://md.research.elamur.ai/free/en/papers/wang-2022-maven-ere-unified-large-scale/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xiaozhi Wang, Yulin Chen, Ning Ding, et al.*2022 · 96 citations*
580. **[True Few-Shot Learning with Prompts–-A Real-World Perspective](https://md.research.elamur.ai/free/en/papers/schick-2022-true-few-shot-learning-prompts/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Timo Schick, Hinrich Schütze*2022 · 96 citations*
581. **[Cross-Domain Label-Adaptive Stance Detection](https://md.research.elamur.ai/free/en/papers/hardalov-2021-cross-domain-label-adaptive-stance/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Momchil Hardalov, Arnav Arora, Preslav Nakov, et al.*2021 · 96 citations*
582. **[Probing Across Time: What Does RoBERTa Know and When?](https://md.research.elamur.ai/free/en/papers/liu-2021-probing-across-time-what-does/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Leo Z. Liu, Yizhong Wang, Jungo Kasai, et al.*2021 · 96 citations*
583. [**ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identification arXiv:2303.03953**Taja Kuzman, Igor Mozetič, Nikola Ljubešic*2023 · 95 citations*](https://md.research.elamur.ai/free/en/papers/kuzman-2023-chatgpt-beginning-end-manual-linguistic/)
584. [**Auto-GPT for Online Decision Making: Benchmarks and Additional Opinions arXiv:2306.02224**Hui Yang, Sifu Yue, Yunzhong He*2023 · 94 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-auto-gpt-online-decision-making/)
585. **[Efficient Long-Text Understanding with Short-Text Models](https://md.research.elamur.ai/free/en/papers/ivgi-2023-efficient-long-text-understanding-short/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Maor Ivgi, Uri Shaham, Jonathan Berant*2023 · 94 citations*
586. [**CommonsenseQA 2.0: Exposing the Limits of AI through Gamification arXiv:2201.05320**Alon Talmor, Ori Yoran, Ronan Le Bras, et al.*2022 · 94 citations*](https://md.research.elamur.ai/free/en/papers/talmor-2022-commonsenseqa-2-0-exposing-limits/)
587. **[SciFact-Open: Towards open-domain scientific claim verification](https://md.research.elamur.ai/free/en/papers/wadden-2022-scifact-open-open-domain-scientific/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**David Wadden, Kyle Lo, Bailey Kuehl, et al.*2022 · 94 citations*
588. **[Tailor: Generating and Perturbing Text with Semantic Controls](https://md.research.elamur.ai/free/en/papers/ross-2022-tailor-generating-perturbing-text-semantic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Alexis Ross, Tongshuang Wu, Hao Peng, et al.*2022 · 93 citations*
589. **[Exploring the Potential of ChatGPT on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations](https://md.research.elamur.ai/free/en/papers/chan-2024-exploring-potential-chatgpt-sentence-level/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Chunkit Chan, Cheng Jiayang, Weiqi Wang, et al.*2024 · 92 citations*
590. **[A Report on the 2020 Sarcasm Detection Shared Task](https://md.research.elamur.ai/free/en/papers/ghosh-2020-report-2020-sarcasm-detection-shared/) [Workshop on Figurative Language Processing](https://md.research.elamur.ai/free/en/venues/figlang/)**Debanjan Ghosh, Avijit Vajpayee, Smaranda Muresan*2020 · 92 citations*
591. **[WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models](https://md.research.elamur.ai/free/en/papers/minixhofer-2022-wechsel-effective-initialization-subword-embeddings/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz*2022 · 91 citations*
592. **[TransQuest: Translation Quality Estimation with Cross-lingual Transformers](https://md.research.elamur.ai/free/en/papers/ranasinghe-2020-transquest-translation-quality-estimation-cross/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov*2020 · 91 citations*
593. **[Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Models](https://md.research.elamur.ai/free/en/papers/qi-2023-cross-lingual-consistency-factual-knowledge/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jirui Qi, Raquel Fernández, Arianna Bisazza*2023 · 90 citations*
594. **[BERT Busters: Outlier Dimensions that Disrupt Transformers](https://md.research.elamur.ai/free/en/papers/kovaleva-2021-bert-busters-outlier-dimensions-that/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Olga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, et al.*2021 · 90 citations*
595. **[Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes](https://md.research.elamur.ai/free/en/papers/kim-2021-perspective-taking-pragmatics-generating-empathetic/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Hyunwoo Kim, Byeongchang Kim, Gunhee Kim*2021 · 90 citations*
596. [**Mapping the Increasing Use of LLMs in Scientific Papers arXiv:2404.01268**Weixin Liang, Yaohui Zhang, Zhengxuan Wu, et al.*2024 · 89 citations*](https://md.research.elamur.ai/free/en/papers/liang-2024-mapping-increasing-use-llms/)
597. **[Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Prediction](https://md.research.elamur.ai/free/en/papers/troiano-2023-dimensional-modeling-emotions-text-appraisal/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Enrica Troiano, Laura Oberländer, Roman Klinger*2023 · 89 citations*
598. [**Small Language Models: Survey, Measurements, and Insights arXiv:2409.15790**Zhenyan Lu, Xiang Li, Dongqi Cai, et al.*2024 · 88 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-small-language-models-survey-measurements/)
599. [**Retrieval-Augmented Generation with Graphs (GraphRAG) arXiv:2501.00309**Haoyu Han, Yu Wang, Harry Shomer, et al.*2025 · 87 citations*](https://md.research.elamur.ai/free/en/papers/han-2025-retrieval-augmented-generation-graphs-graphrag/)
600. [**A Survey of Large Language Models in Medicine: Progress, Application, and Challenge arXiv:2311.05112**Hongjian Zhou, Fenglin Liu, Boyang Gu, et al.*2023 · 87 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2023-survey-large-language-models-medicine/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [5](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/) **6** [7](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/)

- [← back to](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) — RoBERTa: A Robustly Optimized BERT Pretraining Approach