---
title: "Who cites RoBERTa: A — page 7 — 9,837 citing papers"
description: "9,837 papers of the Elamur Research library cite «RoBERTa: A Robustly Optimized BERT Pretraining Approach», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [RoBERTa: A Robustly Optimized BERT Pretraining…](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) / [cited by](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) / page 7

# Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 7 of 15 · 601–700 · [← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [6](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) **7** [8](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/8/) [9](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/9/) [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/8/)

601. **[Exploring Amharic Sentiment Analysis from Social Media Texts: Building Annotation Tools and Classification Models](https://md.research.elamur.ai/free/en/papers/yimam-2020-exploring-amharic-sentiment-analysis-social/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Seid Muhie Yimam, Hizkiel Mitiku Alemayehu, Abinew Ayele, et al.*2020 · 87 citations*
602. **[Retrieval-Augmented Generation for Natural Language Processing: A Survey](https://md.research.elamur.ai/free/en/papers/wu-2024-retrieval-augmented-generation-natural-language/) [Artificial Intelligence Review](https://md.research.elamur.ai/free/en/venues/artificial-intelligence-review/)**Shangyu Wu, Ying Xiong, Yufei Cui, et al.*2024 · 86 citations*
603. [**A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics arXiv:2310.05694**Kai He, Rui Mao, Qika Lin, et al.*2023 · 86 citations*](https://md.research.elamur.ai/free/en/papers/he-2023-survey-large-language-models-healthcare/)
604. **[The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMs](https://md.research.elamur.ai/free/en/papers/ruis-2022-goldilocks-pragmatic-understanding-fine-tuning/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Laura Ruis, Akbir Khan, Stella Biderman, et al.*2022 · 86 citations*
605. **[Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI](https://md.research.elamur.ai/free/en/papers/tian-2021-diagnosing-first-order-logical-reasoning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jidong Tian, Yitian Li, Wenqing Chen, et al.*2021 · 86 citations*
606. **[R^3: Reverse, Retrieve, and Rank for Sarcasm Generation with Commonsense Knowledge](https://md.research.elamur.ai/free/en/papers/chakrabarty-2020-r-textasciicircum3-reverse-retrieve-rank/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tuhin Chakrabarty, Debanjan Ghosh, Smaranda Muresan, et al.*2020 · 86 citations*
607. **[Finding Skill Neurons in Pre-trained Transformer-based Language Models](https://md.research.elamur.ai/free/en/papers/wang-2022-finding-skill-neurons-pre-trained/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, et al.*2022 · 85 citations*
608. **[Co-GAT: A Co-Interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment Classification](https://md.research.elamur.ai/free/en/papers/qin-2020-co-gat-co-interactive-graph/) [Proceedings of the AAAI Conference on Artificial Intelligence](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/)**Libo Qin, Zhouyang Li, Wanxiang Che, et al.*2020 · 85 citations*
609. **[Neural Machine Translation Doesn't Translate Gender Coreference Right Unless You Make It](https://md.research.elamur.ai/free/en/papers/saunders-2020-neural-machine-translation-doesn-t/) [Workshop on Gender Bias in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/gebnlp/)**Danielle Saunders, Rosie Sallis, Bill Byrne*2020 · 85 citations*
610. [**ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing arXiv:2306.00622**Ryan Liu, Nihar B. Shah*2023 · 84 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-reviewergpt-exploratory-study-using/)
611. **[Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models](https://md.research.elamur.ai/free/en/papers/kim-2023-tree-clarifications-answering-ambiguous-questions/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Gangwoo Kim, Sungdong Kim, Byeongguk Jeon, et al.*2023 · 84 citations*
612. **[The Geometry of Multilingual Language Model Representations](https://md.research.elamur.ai/free/en/papers/chang-2022-geometry-multilingual-language-model-representations/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen*2022 · 84 citations*
613. **[DOC: Improving Long Story Coherence With Detailed Outline Control](https://md.research.elamur.ai/free/en/papers/yang-2023-doc-improving-long-story-coherence/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Kevin Yang, Dan Klein, Nanyun Peng, et al.*2023 · 83 citations*
614. **[LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development](https://md.research.elamur.ai/free/en/papers/chalkidis-2023-lexfiles-legallama-facilitating-english-multinational/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ilias Chalkidis, Nicolas Garneau, Catalina Goanta, et al.*2023 · 83 citations*
615. **[ORCA: A Challenging Benchmark for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/elmadany-2023-orca-challenging-benchmark-arabic-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**AbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed*2023 · 83 citations*
616. [**Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks arXiv:2310.10844**Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.*2023 · 83 citations*](https://md.research.elamur.ai/free/en/papers/shayegani-2023-survey-vulnerabilities-large-language-models/)
617. **[Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment](https://md.research.elamur.ai/free/en/papers/tanwar-2023-multilingual-llms-are-better-cross/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Eshaan Tanwar, Subhabrata Dutta, Manish Borthakur, et al.*2023 · 82 citations*
618. [**Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models arXiv:2307.14539**Erfan Shayegani, Yue Dong, Nael Abu-Ghazaleh*2023 · 81 citations*](https://md.research.elamur.ai/free/en/papers/shayegani-2023-jailbreak-pieces-compositional-adversarial-attacks/)
619. **[Are Pretrained Language Models Symbolic Reasoners over Knowledge?](https://md.research.elamur.ai/free/en/papers/kassner-2020-are-pretrained-language-models-symbolic/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Nora Kassner, Benno Krojer, Hinrich Schütze*2020 · 81 citations*
620. [**Large Language Models in Law: A Survey arXiv:2312.03718**Jinqi Lai, Wensheng Gan, Jiayang Wu, et al.*2023 · 80 citations*](https://md.research.elamur.ai/free/en/papers/lai-2023-large-language-models-law-survey/)
621. **[Mitigating Label Biases for In-context Learning](https://md.research.elamur.ai/free/en/papers/fei-2023-mitigating-label-biases-context-learning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yu Fei, Yifan Hou, Zeming Chen, et al.*2023 · 80 citations*
622. **[AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization](https://md.research.elamur.ai/free/en/papers/eddine-2022-arabart-pretrained-arabic-sequence-sequence/) [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/)**Moussa Kamal Eddine, Nadi Tomeh, Nizar Habash, et al.*2022 · 80 citations*
623. **[Intrinsic Dimension Estimation for Robust Detection of AI-Generated Texts](https://md.research.elamur.ai/free/en/papers/tulchinskii-2023-intrinsic-dimension-estimation-robust-detection/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, et al.*2023 · 79 citations*
624. [**LEGO-Prover: Neural Theorem Proving with Growing Libraries arXiv:2310.00656**Haiming Wang, Huajian Xin, Chuanyang Zheng, et al.*2023 · 79 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-lego-prover-neural-theorem-proving/)
625. **[Multilingual Language Models are not Multicultural: A Case Study in Emotion](https://md.research.elamur.ai/free/en/papers/havaldar-2023-multilingual-language-models-are-not/) [Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis](https://md.research.elamur.ai/free/en/venues/wassa/)**Shreya Havaldar, Sunny Rai, Bhumika Singhal, et al.*2023 · 79 citations*
626. **[AraGPT2: Pre-Trained Transformer for Arabic Language Generation](https://md.research.elamur.ai/free/en/papers/antoun-2021-aragpt2-pre-trained-transformer-arabic/) [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/)**Wissam Antoun, Fady Baly, Hazem Hajj*2021 · 79 citations*
627. **[Language models are not naysayers: An analysis of language models on negation benchmarks](https://md.research.elamur.ai/free/en/papers/truong-2023-language-models-naysayers-analysis-language/) [Joint Conference on Lexical and Computational Semantics (*SEM)](https://md.research.elamur.ai/free/en/venues/starsem/)**Thinh Hung Truong, Timothy Baldwin, Karin Verspoor, et al.*2023 · 78 citations*
628. **[Explanation-Based Human Debugging of NLP Models: A Survey](https://md.research.elamur.ai/free/en/papers/lertvittayakumjorn-2021-explanation-based-human-debugging-nlp/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Piyawat Lertvittayakumjorn, Francesca Toni*2021 · 77 citations*
629. **[Measuring Political Bias in Large Language Models: What Is Said and How It Is Said](https://md.research.elamur.ai/free/en/papers/bang-2024-measuring-political-bias-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yejin Bang, Delong Chen, Nayeon Lee, et al.*2024 · 76 citations*
630. **[Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory](https://md.research.elamur.ai/free/en/papers/cheng-2023-lift-yourself-up-retrieval-augmented/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Xin Cheng, Di Luo, Xiuying Chen, et al.*2023 · 76 citations*
631. [**Multi-VALUE: A Framework for Cross-Dialectal English NLP**Caleb Ziems, William Held, Jingfeng Yang, et al.*2023 · 76 citations*](https://md.research.elamur.ai/free/en/papers/ziems-2023-multi-value-framework-cross-dialectal/)
632. **[Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text Summarization](https://md.research.elamur.ai/free/en/papers/laskar-2022-domain-adaptation-pre-trained-transformers/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang*2022 · 76 citations*
633. **[WikiAsp: A Dataset for Multi-domain Aspect-based Summarization](https://md.research.elamur.ai/free/en/papers/hayashi-2021-wikiasp-dataset-multi-domain-aspect/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Hiroaki Hayashi, Prashant Budania, Peng Wang, et al.*2021 · 76 citations*
634. **[Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions](https://md.research.elamur.ai/free/en/papers/chen-2025-benchmarking-large-language-models-answering/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Hanjie Chen, Zhouxiang Fang, Yash Singla, et al.*2025 · 75 citations*
635. **[GPTEval: A Survey on Assessments of ChatGPT and GPT-4](https://md.research.elamur.ai/free/en/papers/mao-2024-gpteval-survey-assessments-chatgpt-gpt/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Rui Mao, Guanyi Chen, Xulang Zhang, et al.*2024 · 75 citations*
636. [**Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents arXiv:2310.19923**Michael Gunther, Jackmin Ong, Isabelle Mohr, et al.*2023 · 75 citations*](https://md.research.elamur.ai/free/en/papers/gunther-2023-jina-embeddings-2-8192-token/)
637. **[ReFT: Representation Finetuning for Language Models](https://md.research.elamur.ai/free/en/papers/wu-2024-reft-representation-finetuning-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Zhengxuan Wu, Aryaman Arora, Zheng Wang, et al.*2024 · 74 citations*
638. **[Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations](https://md.research.elamur.ai/free/en/papers/sinclair-2022-structural-persistence-language-models-priming/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Arabella Sinclair, Jaap Jumelet, Willem Zuidema, et al.*2022 · 74 citations*
639. [**Annotation Error Detection: Analyzing the Past and Present for a More Coherent Future**Jan-Christoph Klie, Bonnie Webber, Iryna Gurevych*2023 · 73 citations*](https://md.research.elamur.ai/free/en/papers/klie-2023-annotation-error-detection-analyzing-past/)
640. [**Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation arXiv:2307.15337**Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.*2023 · 72 citations*](https://md.research.elamur.ai/free/en/papers/ning-2023-skeleton-thought-prompting-llms-efficient/)
641. **[Unveiling the Implicit Toxicity in Large Language Models](https://md.research.elamur.ai/free/en/papers/wen-2023-unveiling-implicit-toxicity-large-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jiaxin Wen, Pei Ke, Hao Sun, et al.*2023 · 72 citations*
642. [**The SIGMORPHON 2022 Shared Task on Morpheme Segmentation**Khuyagbaatar Batsuren, Gabor Bella, Aryaman Arora*2022 · 71 citations*](https://md.research.elamur.ai/free/en/papers/batsuren-2022-morpheme-segmentation/)
643. [**CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark arXiv:2106.08087**Ningyu Zhang, Mosha Chen, Zhen Bi, et al.*2021 · 71 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2021-cblue-chinese-biomedical-language/)
644. **[Conditional Generation with a Question-Answering Blueprint](https://md.research.elamur.ai/free/en/papers/narayan-2023-conditional-generation-question-answering-blueprint/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Shashi Narayan, Joshua Maynez, Reinald Kim Amplayo, et al.*2023 · 70 citations*
645. **[POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection](https://md.research.elamur.ai/free/en/papers/liu-2022-politics-pretraining-same-story-article/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yujian Liu, Xinliang Frederick Zhang, David Wegsman, et al.*2022 · 70 citations*
646. **[English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too](https://md.research.elamur.ai/free/en/papers/phang-2020-english-intermediate-task-training-improves/) [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/)**Jason Phang, Iacer Calixto, Phu Mon Htut, et al.*2020 · 70 citations*
647. **[NormBank: A Knowledge Bank of Situational Social Norms](https://md.research.elamur.ai/free/en/papers/ziems-2023-normbank-knowledge-bank-situational-social/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, et al.*2023 · 69 citations*
648. [**Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning arXiv:2309.05444**Ted Zadouri, Ahmet Ustun, Arash Ahmadian, et al.*2023 · 69 citations*](https://md.research.elamur.ai/free/en/papers/zadouri-2023-pushing-mixture-experts-limit-extremely/)
649. **[It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning](https://md.research.elamur.ai/free/en/papers/tikhonov-2021-it-s-all-heads-attention/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Alexey Tikhonov, Max Ryabinin*2021 · 69 citations*
650. [**CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese arXiv:2001.04351**Liang Xu, Yu tong, Qianqian Dong, et al.*2020 · 69 citations*](https://md.research.elamur.ai/free/en/papers/xu-2020-cluener2020-fine-grained-named/)
651. **[Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric](https://md.research.elamur.ai/free/en/papers/vernikos-2022-embarrassingly-easy-document-level-mt/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Giorgos Vernikos, Brian Thompson, Prashant Mathur, et al.*2022 · 68 citations*
652. [**IMPLI: Investigating NLI Models' Performance on Figurative Language**Kevin Stowe, Prasetya Utama, Iryna Gurevych*2022 · 68 citations*](https://md.research.elamur.ai/free/en/papers/stowe-2022-impli-investigating-nli-models-performance/)
653. **[ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Text](https://md.research.elamur.ai/free/en/papers/hasanain-2023-araieval-shared-task-persuasion-techniques/) [Arabic Natural Language Processing Conference (ArabicNLP)](https://md.research.elamur.ai/free/en/venues/arabicnlp/)**Maram Hasanain, Firoj Alam, Hamdy Mubarak, et al.*2023 · 67 citations*
654. **[FORK: A Bite-Sized Test Set for Probing Culinary Cultural Biases in Commonsense Reasoning Models](https://md.research.elamur.ai/free/en/papers/palta-2023-fork-bite-sized-test-set/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Shramay Palta, Rachel Rudinger*2023 · 67 citations*
655. **[The Devil in Linear Transformer](https://md.research.elamur.ai/free/en/papers/qin-2022-devil-linear-transformer/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhen Qin, Xiaodong Han, Weixuan Sun, et al.*2022 · 67 citations*
656. [**VALUE: Understanding Dialect Disparity in NLU**Caleb Ziems, Jiaao Chen, Camille Harris, et al.*2022 · 67 citations*](https://md.research.elamur.ai/free/en/papers/ziems-2022-value-understanding-dialect-disparity-nlu/)
657. [**CREPE: Open-Domain Question Answering with False Presuppositions**Xinyan Yu, Sewon Min, Luke Zettlemoyer, et al.*2023 · 66 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-crepe-open-domain-question-answering/)
658. **[Dynamic Routing Transformer Network for Multimodal Sarcasm Detection](https://md.research.elamur.ai/free/en/papers/tian-2023-dynamic-routing-transformer-network-multimodal/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuan Tian, Nan Xu, Ruike Zhang, et al.*2023 · 66 citations*
659. **[MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System](https://md.research.elamur.ai/free/en/papers/qin-2023-mmsd2-0-reliable-multi-modal/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Libo Qin, Shijue Huang, Qiguang Chen, et al.*2023 · 65 citations*
660. [**Evaluation of OpenAI o1: Opportunities and Challenges of AGI arXiv:2409.18486**Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.*2024 · 64 citations*](https://md.research.elamur.ai/free/en/papers/zhong-2024-evaluation-openai-o1-opportunities-challenges/)
661. [**OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models arXiv:2402.01739**Fuzhao Xue, Zian Zheng, Yao Fu, et al.*2024 · 64 citations*](https://md.research.elamur.ai/free/en/papers/xue-2024-openmoe-early-effort-open-mixture/)
662. **[NLPeer: A Unified Resource for the Computational Study of Peer Review](https://md.research.elamur.ai/free/en/papers/dycke-2023-nlpeer-unified-resource-computational-study/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Nils Dycke, Ilia Kuznetsov, Iryna Gurevych*2023 · 64 citations*
663. **[Morphology Matters: A Multilingual Language Modeling Analysis](https://md.research.elamur.ai/free/en/papers/park-2021-morphology-matters-multilingual-language-modeling/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Hyunji Hayley Park, Katherine J. Zhang, Coleman Haley, et al.*2021 · 64 citations*
664. **[The Pragmatics behind Politics: Modelling Metaphor, Framing and Emotion in Political Discourse](https://md.research.elamur.ai/free/en/papers/cabot-2020-pragmatics-behind-politics-modelling-metaphor/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Pere-Lluís Huguet Cabot, Verna Dankers, David Abadi, et al.*2020 · 64 citations*
665. **[Cross-document Coreference Resolution over Predicted Mentions](https://md.research.elamur.ai/free/en/papers/cattan-2021-cross-document-coreference-resolution-over/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Arie Cattan, Alon Eirew, Gabriel Stanovsky, et al.*2021 · 63 citations*
666. [**ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation arXiv:2112.12731**Shuohuan Wang, Yu Sun, Yang Xiang, et al.*2021 · 63 citations*](https://md.research.elamur.ai/free/en/papers/wang-2021-ernie-3-0-titan/)
667. **[Figurative Language in Recognizing Textual Entailment](https://md.research.elamur.ai/free/en/papers/chakrabarty-2021-figurative-language-recognizing-textual-entailment/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Tuhin Chakrabarty, Debanjan Ghosh, Adam Poliak, et al.*2021 · 63 citations*
668. **[Understanding Transformer Memorization Recall Through Idioms](https://md.research.elamur.ai/free/en/papers/haviv-2023-understanding-transformer-memorization-recall-through/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Adi Haviv, Ido Cohen, Jacob Gidron, et al.*2023 · 62 citations*
669. **[The better your Syntax, the better your Semantics? Probing Pretrained Language Models for the English Comparative Correlative](https://md.research.elamur.ai/free/en/papers/weissweiler-2022-better-your-syntax-better-your/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, et al.*2022 · 62 citations*
670. [**Building a Bridge: A Method for Image-Text Sarcasm Detection Without Pretraining on Image-Text Data Proceedings of the First International Workshop on Natural Language Processing Beyond Text**Xinyu Wang, Xiaowen Sun, Tan Yang, et al.*2020 · 62 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-building-bridge-method-image-text/)
671. **[SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization](https://md.research.elamur.ai/free/en/papers/naseem-2026-semeval-2026-task-9-detecting/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Usman Naseem, Robert Geislinger, Ada Ren, et al.*2026 · 61 citations*
672. **[Automatic Story Generation: Challenges and Attempts](https://md.research.elamur.ai/free/en/papers/alabdulkarim-2021-automatic-story-generation-challenges-attempts/) [Workshop on Narrative Understanding](https://md.research.elamur.ai/free/en/venues/nuse/)**Amal Alabdulkarim, Siyan Li, Xiangyu Peng*2021 · 61 citations*
673. **[A Family of Pretrained Transformer Language Models for Russian](https://md.research.elamur.ai/free/en/papers/zmitrovich-2024-family-pretrained-transformer-language-models/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Dmitry Zmitrovich, Aleksandr Abramov, Andrey Kalmykov, et al.*2024 · 60 citations*
674. [**Making Text Embedders Few-Shot Learners arXiv:2409.15700**Chaofan Li, MingHao Qin, Shitao Xiao, et al.*2024 · 60 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-making-text-embedders-few-shot/)
675. **[Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks](https://md.research.elamur.ai/free/en/papers/asai-2022-evidentiality-guided-generation-knowledge-intensive/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Akari Asai, Matt Gardner, Hannaneh Hajishirzi*2022 · 60 citations*
676. **[Improving Multi-Party Dialogue Discourse Parsing via Domain Integration](https://md.research.elamur.ai/free/en/papers/liu-2021-improving-multi-party-dialogue-discourse/) [Workshop on Computational Approaches to Discourse (CODI)](https://md.research.elamur.ai/free/en/venues/codi/)**Zhengyuan Liu, Nancy Chen*2021 · 60 citations*
677. [**mmBERT: A Modern Multilingual Encoder with Annealed Language Learning arXiv:2509.06888**Marc Marone, Orion Weller, William Fleshman, et al.*2025 · 59 citations*](https://md.research.elamur.ai/free/en/papers/marone-2025-mmbert-modern-multilingual-encoder-annealed/)
678. [**Rho-1: Not All Tokens Are What You Need arXiv:2404.07965**Zhenghao Lin, Zhibin Gou, Yeyun Gong, et al.*2024 · 59 citations*](https://md.research.elamur.ai/free/en/papers/lin-2024-rho-1-all-tokens-need/)
679. [**Temporal Reasoning in Natural Language Inference**Siddharth Vashishtha, Adam Poliak, Yash Kumar Lal, et al.*2020 · 59 citations*](https://md.research.elamur.ai/free/en/papers/vashishtha-2020-temporal-reasoning-natural-language-inference/)
680. [**LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning arXiv:2308.03303**Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.*2023 · 58 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-lora-fa-efficient-effective-low/)
681. **[Stance Detection on Social Media with Background Knowledge](https://md.research.elamur.ai/free/en/papers/li-2023-stance-detection-social-media-background/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ang Li, Bin Liang, Jingqian Zhao, et al.*2023 · 58 citations*
682. **[What Does My QA Model Know? Devising Controlled Probes Using Expert Knowledge](https://md.research.elamur.ai/free/en/papers/richardson-2020-what-does-my-qa-model/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Kyle Richardson, Ashish Sabharwal*2020 · 58 citations*
683. [**Dialect prejudice predicts AI decisions about people's character, employability, and criminality arXiv:2403.00742**Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.*2024 · 57 citations*](https://md.research.elamur.ai/free/en/papers/hofmann-2024-dialect-prejudice-predicts-ai-decisions/)
684. [**AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level**Amit Seker, Elron Bandel, Dan Bareket, et al.*2022 · 57 citations*](https://md.research.elamur.ai/free/en/papers/seker-2022-alephbert-language-model-pre-training/)
685. [**AlephBERT: A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With**Amit Seker, Elron Bandel, Dan Bareket, et al.*2021 · 57 citations*](https://md.research.elamur.ai/free/en/papers/seker-2021-alephbert-hebrew-large-pre-trained/)
686. **[Target-Aware Data Augmentation for Stance Detection](https://md.research.elamur.ai/free/en/papers/li-2021-target-aware-data-augmentation-stance/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Yingjie Li, Cornelia Caragea*2021 · 56 citations*
687. **[Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs](https://md.research.elamur.ai/free/en/papers/misra-2024-language-models-learn-rare-phenomena/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Kanishka Misra, Kyle Mahowald*2024 · 55 citations*
688. **[SciAgent: Tool-augmented Language Models for Scientific Reasoning](https://md.research.elamur.ai/free/en/papers/ma-2024-sciagent-tool-augmented-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yubo Ma, Zhibin Gou, Junheng Hao, et al.*2024 · 55 citations*
689. **[DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agents](https://md.research.elamur.ai/free/en/papers/nair-2023-dera-enhancing-large-language-model/) [Workshop on Clinical Natural Language Processing (Clinical NLP) @ LREC](https://md.research.elamur.ai/free/en/venues/clinicalnlp/)**Varun Nair, Elliot Schumacher, Geoffrey Tso, et al.*2023 · 55 citations*
690. [**In-context Learning with Retrieved Demonstrations for Language Models: A Survey arXiv:2401.11624**Man Luo, Xin Xu, Yue Liu, et al.*2024 · 54 citations*](https://md.research.elamur.ai/free/en/papers/luo-2024-context-learning-retrieved-demonstrations-language/)
691. **[Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Review](https://md.research.elamur.ai/free/en/papers/kuznetsov-2022-revise-resubmit-intertextual-model-text/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Ilia Kuznetsov, Jan Buchmann, Max Eichler, et al.*2022 · 54 citations*
692. [**FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark arXiv:2107.07498**Liang Xu, Xiaojing Lu, Chenyang Yuan, et al.*2021 · 54 citations*](https://md.research.elamur.ai/free/en/papers/xu-2021-fewclue-chinese-few-shot/)
693. [**Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models — A Survey arXiv:2404.01869**Philipp Mondorf, Barbara Plank*2024 · 53 citations*](https://md.research.elamur.ai/free/en/papers/mondorf-2024-accuracy-evaluating-reasoning-behavior-large/)
694. **[A Better Way to Do Masked Language Model Scoring](https://md.research.elamur.ai/free/en/papers/kauf-2023-better-way-do-masked-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Carina Kauf, Anna A. Ivanova*2023 · 53 citations*
695. [**From English To Foreign Languages: Transferring Pre-trained Language Models arXiv:2002.07306**Ke Tran*2020 · 53 citations*](https://md.research.elamur.ai/free/en/papers/tran-2020-english-foreign-languages-transferring-pre/)
696. [**Explore, Establish, Exploit: Red Teaming Language Models from Scratch arXiv:2306.09442**Stephen Casper, Jason Lin, Joe Kwon, et al.*2023 · 52 citations*](https://md.research.elamur.ai/free/en/papers/casper-2023-explore-establish-exploit-red-teaming/)
697. [**Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR**Juri Opitz, Anette Frank*2021 · 51 citations*](https://md.research.elamur.ai/free/en/papers/opitz-2021-decomposable-metric-explainable-evaluation-text/)
698. **[ConjNLI: Natural Language Inference Over Conjunctive Sentences](https://md.research.elamur.ai/free/en/papers/saha-2020-conjnli-natural-language-inference-over/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Swarnadeep Saha, Yixin Nie, Mohit Bansal*2020 · 51 citations*
699. **[Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models](https://md.research.elamur.ai/free/en/papers/cao-2022-theory-grounded-measurement-u-s/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Yang Trista Cao, Anna Sotnikova, Hal Daumé III, et al.*2022 · 50 citations*
700. **[From Word Types to Tokens and Back: A Survey of Approaches to Word Meaning Representation and Interpretation](https://md.research.elamur.ai/free/en/papers/apidianaki-2023-word-types-tokens-back-survey/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Marianna Apidianaki*2023 · 49 citations*

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [6](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) **7** [8](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/8/) [9](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/9/) [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/8/)

- [← back to](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) — RoBERTa: A Robustly Optimized BERT Pretraining Approach