---
title: "Who cites RoBERTa: A — page 5 — 9,837 citing papers"
description: "9,837 papers of the Elamur Research library cite «RoBERTa: A Robustly Optimized BERT Pretraining Approach», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [RoBERTa: A Robustly Optimized BERT Pretraining…](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) / [cited by](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) / page 5

# Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 5 of 15 · 401–500 · [← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [4](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) **5** [6](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/)

401. [**Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization arXiv:2210.01241**Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kiante Brantley, et al.*2022 · 174 citations*](https://md.research.elamur.ai/free/en/papers/ramamurthy-2022-reinforcement-learning-natural-language-processing/)
402. **[KGPT: Knowledge-Grounded Pre-Training for Data-to-Text Generation](https://md.research.elamur.ai/free/en/papers/chen-2020-kgpt-knowledge-grounded-pre-training/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Wenhu Chen, Yu Su, Xifeng Yan, et al.*2020 · 174 citations*
403. [**AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning arXiv:2303.10512**Qingru Zhang, Minshuo Chen, Alexander Bukharin, et al.*2023 · 173 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-adalora-adaptive-budget-allocation-parameter/)
404. **[DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Text](https://md.research.elamur.ai/free/en/papers/su-2023-detectllm-leveraging-log-rank-information/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Jinyan Su, Terry Zhuo, Di Wang, et al.*2023 · 172 citations*
405. **[ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering](https://md.research.elamur.ai/free/en/papers/chen-2022-convfinqa-exploring-chain-numerical-reasoning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhiyu Chen, Shiyang Li, Charese Smiley, et al.*2022 · 172 citations*
406. **[Self-training Improves Pre-training for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/du-2021-self-training-improves-pre-training/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Jingfei Du, Edouard Grave, Beliz Gunel, et al.*2021 · 172 citations*
407. **[SemEval-2021 Task 5: Toxic Spans Detection](https://md.research.elamur.ai/free/en/papers/pavlopoulos-2021-semeval-2021-task-5-toxic/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**John Pavlopoulos, Jeffrey Sorensen, Léo Laugier, et al.*2021 · 172 citations*
408. [**Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity arXiv:2310.07521**Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.*2023 · 171 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-factuality-large-language-models/)
409. **[The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive Remediations](https://md.research.elamur.ai/free/en/papers/rawte-2023-troubling-emergence-hallucination-large-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, et al.*2023 · 171 citations*
410. [**Binding Language Models in Symbolic Languages arXiv:2210.02875**Zhoujun Cheng, Tianbao Xie, Peng Shi, et al.*2022 · 170 citations*](https://md.research.elamur.ai/free/en/papers/cheng-2022-binding-language-models-symbolic-languages/)
411. **[On Generative Spoken Language Modeling from Raw Audio](https://md.research.elamur.ai/free/en/papers/lakhotia-2021-generative-spoken-language-modeling-raw/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Kushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, et al.*2021 · 170 citations*
412. [**GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts arXiv:2309.10253**Jiahao Yu, Xingwei Lin, Zheng Yu, et al.*2023 · 169 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-gptfuzzer-red-teaming-large-language/)
413. **[Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation](https://md.research.elamur.ai/free/en/papers/tan-2022-document-level-relation-extraction-adaptive/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Qingyu Tan, Ruidan He, Lidong Bing, et al.*2022 · 169 citations*
414. **[COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic](https://md.research.elamur.ai/free/en/papers/saakyan-2021-covid-fact-fact-extraction-verification/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Arkadiy Saakyan, Tuhin Chakrabarty, Smaranda Muresan*2021 · 169 citations*
415. [**Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing**Minh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, et al.*2021 · 169 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2021-trankit-light-weight-transformer-based/)
416. [**GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher arXiv:2308.06463**Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, et al.*2023 · 168 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-gpt-4-too-smart-safe/)
417. **[Factuality Enhanced Language Models for Open-Ended Text Generation](https://md.research.elamur.ai/free/en/papers/lee-2022-factuality-enhanced-language-models-open/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Nayeon Lee, Wei Ping, Peng Xu, et al.*2022 · 168 citations*
418. **[QuALITY: Question Answering with Long Input Texts, Yes!](https://md.research.elamur.ai/free/en/papers/pang-2022-quality-question-answering-long-input/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, et al.*2022 · 167 citations*
419. **[“I'm sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset](https://md.research.elamur.ai/free/en/papers/smith-2022-i-m-sorry-hear-that/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Eric Michael Smith, Melissa Hall, Melanie Kambadur, et al.*2022 · 167 citations*
420. **[Label Verbalization and Entailment for Effective Zero and Few-Shot Relation Extraction](https://md.research.elamur.ai/free/en/papers/sainz-2021-label-verbalization-entailment-effective-zero/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Oscar Sainz, Oier Lopez de Lacalle, Gorka Labaka, et al.*2021 · 167 citations*
421. **[Structure-Grounded Pretraining for Text-to-SQL](https://md.research.elamur.ai/free/en/papers/deng-2021-structure-grounded-pretraining-text-sql/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, et al.*2021 · 167 citations*
422. **[MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents](https://md.research.elamur.ai/free/en/papers/tang-2024-minicheck-efficient-fact-checking-llms/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Liyan Tang, Philippe Laban, Greg Durrett*2024 · 166 citations*
423. **[AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages](https://md.research.elamur.ai/free/en/papers/ebrahimi-2022-americasnli-evaluating-zero-shot-natural/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, et al.*2022 · 164 citations*
424. **[BabyBERTa: Learning More Grammar With Small-Scale Child-Directed Language](https://md.research.elamur.ai/free/en/papers/huebner-2021-babyberta-learning-more-grammar-small/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Philip A. Huebner, Elior Sulem, Fisher Cynthia, et al.*2021 · 164 citations*
425. **[ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation](https://md.research.elamur.ai/free/en/papers/xiao-2020-ernie-gen-enhanced-multi/) [International Joint Conference on Artificial Intelligence](https://md.research.elamur.ai/free/en/venues/international-joint-conference-on-artificial-intelligence/)**Dongling Xiao, Han Zhang, Yukun Li, et al.*2020 · 163 citations*
426. **[On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment](https://md.research.elamur.ai/free/en/papers/wang-2020-negative-interference-multilingual-models-findings/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zirui Wang, Zachary C. Lipton, Yulia Tsvetkov*2020 · 162 citations*
427. [**ChatGPT as a Factual Inconsistency Evaluator for Text Summarization arXiv:2303.15621**Zheheng Luo, Qianqian Xie, Sophia Ananiadou*2023 · 161 citations*](https://md.research.elamur.ai/free/en/papers/luo-2023-chatgpt-factual-inconsistency-evaluator-text/)
428. **[Larger-Scale Transformers for Multilingual Masked Language Modeling](https://md.research.elamur.ai/free/en/papers/goyal-2021-larger-scale-transformers-multilingual-masked/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Naman Goyal, Jingfei Du, Myle Ott, et al.*2021 · 161 citations*
429. [**PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation arXiv:2104.12369**Wei Zeng, Xiaozhe Ren, Teng Su, et al.*2021 · 161 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2021-pangu-alpha-large-scale/)
430. [**Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition**Paloma Jeretic, Alex Warstadt, Suvrat Bhooshan, et al.*2020 · 161 citations*](https://md.research.elamur.ai/free/en/papers/jeretic-2020-are-natural-language-inference-models/)
431. **[MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer](https://md.research.elamur.ai/free/en/papers/chalkidis-2021-multieurlex-multi-lingual-multi-label/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ilias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos*2021 · 160 citations*
432. **[A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness](https://md.research.elamur.ai/free/en/papers/wang-2024-comprehensive-survey-small-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Fali Wang, Zhiwei Zhang, Xianren Zhang, et al.*2024 · 159 citations*
433. [**Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding arXiv:2210.03347**Kenton Lee, Mandar Joshi, Iulia Turc, et al.*2022 · 158 citations*](https://md.research.elamur.ai/free/en/papers/lee-2022-pix2struct-screenshot-parsing-pretraining-visual/)
434. **[SemEval-2020 Task 4: Commonsense Validation and Explanation](https://md.research.elamur.ai/free/en/papers/wang-2020-semeval-2020-task-4-commonsense/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Cunxiang Wang, Shuailong Liang, Yili Jin, et al.*2020 · 158 citations*
435. **[Understanding tables with intermediate pre-training](https://md.research.elamur.ai/free/en/papers/eisenschlos-2020-understanding-tables-intermediate-pre-training/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Julian Eisenschlos, Syrine Krichene, Thomas Müller*2020 · 158 citations*
436. [**Lawyer LLaMA Technical Report arXiv:2305.15062**Quzhe Huang, Mingxu Tao, Chen Zhang, et al.*2023 · 157 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-lawyer-llama-technical-report/)
437. **[RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases](https://md.research.elamur.ai/free/en/papers/choi-2021-ryansql-recursively-applying-sketch-based/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**DongHyun Choi, Myeong Cheol Shin, EungGyun Kim, et al.*2021 · 157 citations*
438. **[Probing Pre-Trained Language Models for Cross-Cultural Differences in Values](https://md.research.elamur.ai/free/en/papers/arora-2023-probing-pre-trained-language-models/) [Workshop on Cross-Cultural Considerations in NLP](https://md.research.elamur.ai/free/en/venues/c3nlp/)**Arnav Arora, Lucie-aimée Kaffee, Isabelle Augenstein*2023 · 156 citations*
439. **[Towards a Cleaner Document-Oriented Multilingual Crawled Corpus](https://md.research.elamur.ai/free/en/papers/abadji-2022-towards-cleaner-document-oriented-multilingual/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Julien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.*2022 · 156 citations*
440. [**ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning arXiv:2212.07919**Olga Golovneva, Moya Chen, Spencer Poff, et al.*2022 · 155 citations*](https://md.research.elamur.ai/free/en/papers/golovneva-2022-roscoe-suite-metrics-scoring-step/)
441. **[CLEVE: Contrastive Pre-training for Event Extraction](https://md.research.elamur.ai/free/en/papers/wang-2021-cleve-contrastive-pre-training-event/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ziqi Wang, Xiaozhi Wang, Xu Han, et al.*2021 · 155 citations*
442. **[Explaining NLP Models via Minimal Contrastive Editing (MiCE)](https://md.research.elamur.ai/free/en/papers/ross-2021-explaining-nlp-models-minimal-contrastive/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Alexis Ross, Ana Marasović, Matthew Peters*2021 · 155 citations*
443. **[Fine-Tuning Language Models with Just Forward Passes](https://md.research.elamur.ai/free/en/papers/malladi-2023-fine-tuning-language-models-just/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Sadhika Malladi, Tianyu Gao, Eshaan Nichani, et al.*2023 · 153 citations*
444. **[Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding](https://md.research.elamur.ai/free/en/papers/dziri-2021-neural-path-hunter-reducing-hallucination/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Nouha Dziri, Andrea Madotto, Osmar Zaïane, et al.*2021 · 152 citations*
445. **[Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning](https://md.research.elamur.ai/free/en/papers/lin-2020-exploring-versatile-generative-language-model/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhaojiang Lin, Andrea Madotto, Pascale Fung*2020 · 152 citations*
446. [**TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questions**Qiang Ning, Hao Wu, Rujun Han, et al.*2020 · 152 citations*](https://md.research.elamur.ai/free/en/papers/ning-2020-torque-reading-comprehension-dataset-temporal/)
447. **[Revisiting DocRED - Addressing the False Negative Problem in Relation Extraction](https://md.research.elamur.ai/free/en/papers/tan-2022-revisiting-docred-addressing-false-negative/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Qingyu Tan, Lu Xu, Lidong Bing, et al.*2022 · 151 citations*
448. **[Investigating Pretrained Language Models for Graph-to-Text Generation](https://md.research.elamur.ai/free/en/papers/ribeiro-2021-investigating-pretrained-language-models-graph/) [Workshop on Natural Language Processing for Conversational AI](https://md.research.elamur.ai/free/en/venues/nlp4convai/)**Leonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, et al.*2021 · 151 citations*
449. [**A Review on Language Models as Knowledge Bases arXiv:2204.06031**Badr AlKhamissi, Millicent Li, Asli Celikyilmaz, et al.*2022 · 150 citations*](https://md.research.elamur.ai/free/en/papers/alkhamissi-2022-review-language-models-knowledge-bases/)
450. **[CPM: A Large-scale Generative Chinese Pre-trained Language Model](https://md.research.elamur.ai/free/en/papers/zhang-2020-cpm-large-scale-generative/) [AI Open](https://md.research.elamur.ai/free/en/venues/ai-open/)**Zhengyan Zhang, Xu Han, Hao Zhou, et al.*2020 · 150 citations*
451. **[INFOTABS: Inference on Tables as Semi-structured Data](https://md.research.elamur.ai/free/en/papers/gupta-2020-infotabs-inference-tables-as-semi/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Vivek Gupta, Maitrey Mehta, Pegah Nokhiz, et al.*2020 · 150 citations*
452. **[BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data](https://md.research.elamur.ai/free/en/papers/song-2021-bob-bert-over-bert-training/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Haoyu Song, Yan Wang, Kaiyan Zhang, et al.*2021 · 149 citations*
453. **[Context-faithful Prompting for Large Language Models](https://md.research.elamur.ai/free/en/papers/zhou-2023-context-faithful-prompting-large-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Wenxuan Zhou, Sheng Zhang, Hoifung Poon, et al.*2023 · 148 citations*
454. [**Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature arXiv:2310.05130**Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, et al.*2023 · 148 citations*](https://md.research.elamur.ai/free/en/papers/bao-2023-fast-detectgpt-efficient-zero-shot/)
455. **[Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation](https://md.research.elamur.ai/free/en/papers/mosbach-2023-few-shot-fine-tuning-vs/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Marius Mosbach, Tiago Pimentel, Shauli Ravfogel, et al.*2023 · 148 citations*
456. **[Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?](https://md.research.elamur.ai/free/en/papers/pham-2021-out-order-how-important-is/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Thang Pham, Trung Bui, Long Mai, et al.*2021 · 148 citations*
457. [**OCNLI: Original Chinese Natural Language Inference arXiv:2010.05444**Hai Hu, Kyle Richardson, Liang Xu, et al.*2020 · 148 citations*](https://md.research.elamur.ai/free/en/papers/hu-2020-ocnli-original-chinese-natural/)
458. [**AudioLDM: Text-to-Audio Generation with Latent Diffusion Models arXiv:2301.12503**Haohe Liu, Zehua Chen, Yi Yuan, et al.*2023 · 147 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-audioldm-text-audio-generation-latent/)
459. [**Is GPT-3 a Good Data Annotator? arXiv:2212.10450**Bosheng Ding, Chengwei Qin, Linlin Liu, et al.*2022 · 147 citations*](https://md.research.elamur.ai/free/en/papers/ding-2022-gpt-3-good-data-annotator/)
460. **[Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders](https://md.research.elamur.ai/free/en/papers/liu-2021-fast-effective-self-supervised-transforming/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Fangyu Liu, Ivan Vulić, Anna Korhonen, et al.*2021 · 147 citations*
461. **[Fact-Checking Complex Claims with Program-Guided Reasoning](https://md.research.elamur.ai/free/en/papers/pan-2023-fact-checking-complex-claims-program/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Liangming Pan, Xiaobao Wu, Xinyuan Lu, et al.*2023 · 146 citations*
462. **[Unified Demonstration Retriever for In-Context Learning](https://md.research.elamur.ai/free/en/papers/li-2023-unified-demonstration-retriever-context-learning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Xiaonan Li, Kai Lv, Hang Yan, et al.*2023 · 146 citations*
463. **[Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks](https://md.research.elamur.ai/free/en/papers/mireshghallah-2022-quantifying-privacy-risks-masked-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Fatemehsadat Mireshghallah, Kartik Goyal, Archit Uniyal, et al.*2022 · 146 citations*
464. [**SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic**Ibrahim Abu Farha, Silviu Vlad Oprea, Steven Wilson, et al.*2022 · 146 citations*](https://md.research.elamur.ai/free/en/papers/farha-2022-semeval-2022-task-6-isarcasmeval/)
465. **[Word-Level Coreference Resolution](https://md.research.elamur.ai/free/en/papers/dobrovolskii-2021-word-level-coreference-resolution/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Vladimir Dobrovolskii*2021 · 146 citations*
466. **[RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder](https://md.research.elamur.ai/free/en/papers/xiao-2022-retromae-pre-training-retrieval-oriented/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Shitao Xiao, Zheng Liu, Yingxia Shao, et al.*2022 · 145 citations*
467. **[UNQOVERing Stereotyping Biases via Underspecified Questions](https://md.research.elamur.ai/free/en/papers/li-2020-unqovering-stereotyping-biases-underspecified-questions/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Tao Li, Daniel Khashabi, Tushar Khot, et al.*2020 · 145 citations*
468. [**MiniLLM: On-Policy Distillation of Large Language Models arXiv:2306.08543**Yuxian Gu, Li Dong, Furu Wei, et al.*2023 · 144 citations*](https://md.research.elamur.ai/free/en/papers/gu-2023-minillm-policy-distillation-large-language/)
469. **[In-Context Learning for Few-Shot Dialogue State Tracking](https://md.research.elamur.ai/free/en/papers/hu-2022-context-learning-few-shot-dialogue/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yushi Hu, Chia-Hsuan Lee, Tianbao Xie, et al.*2022 · 144 citations*
470. **[Iteratively Prompt Pre-trained Language Models for Chain of Thought](https://md.research.elamur.ai/free/en/papers/wang-2022-iteratively-prompt-pre-trained-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Boshi Wang, Xiang Deng, Huan Sun*2022 · 144 citations*
471. **[Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generation](https://md.research.elamur.ai/free/en/papers/ma-2021-zero-shot-neural-passage-retrieval/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Ji Ma, Ivan Korotkov, Yinfei Yang, et al.*2021 · 144 citations*
472. [**Rethinking with Retrieval: Faithful Large Language Model Inference arXiv:2301.00303**Hangfeng He, Hongming Zhang, Dan Roth*2023 · 143 citations*](https://md.research.elamur.ai/free/en/papers/he-2023-rethinking-retrieval-faithful-large-language/)
473. [**Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness arXiv:2304.11633**Bo Li, Gexiang Fang, Yang Yang, et al.*2023 · 142 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-evaluating-chatgpt-s-information-extraction/)
474. **[A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation](https://md.research.elamur.ai/free/en/papers/liu-2022-token-level-reference-free-hallucination/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tianyu Liu, Yizhe Zhang, Chris Brockett, et al.*2022 · 142 citations*
475. **[SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense](https://md.research.elamur.ai/free/en/papers/meaney-2021-semeval-2021-task-7-hahackathon/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**J. A. Meaney, Steven Wilson, Luis Chiruzzo, et al.*2021 · 142 citations*
476. [**Rethinking embedding coupling in pre-trained language models arXiv:2010.12821**Hyung Won Chung, Thibault Févry, Henry Tsai, et al.*2020 · 142 citations*](https://md.research.elamur.ai/free/en/papers/chung-2020-rethinking-embedding-coupling-pre-trained/)
477. **[Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable Features](https://md.research.elamur.ai/free/en/papers/rashkin-2021-increasing-faithfulness-knowledge-grounded-dialogue/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Hannah Rashkin, David Reitter, Gaurav Singh Tomar, et al.*2021 · 141 citations*
478. **[Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases](https://md.research.elamur.ai/free/en/papers/cao-2021-knowledgeable-or-educated-guess-revisiting/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Boxi Cao, Hongyu Lin, Xianpei Han, et al.*2021 · 141 citations*
479. **[Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension](https://md.research.elamur.ai/free/en/papers/bartolo-2020-beat-ai-investigating-adversarial-human/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Max Bartolo, Alastair Roberts, Johannes Welbl, et al.*2020 · 141 citations*
480. **[TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation](https://md.research.elamur.ai/free/en/papers/uchendu-2021-turingbench-benchmark-environment-turing-test/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Adaku Uchendu, Zeyu Ma, Thai Le, et al.*2021 · 140 citations*
481. **[All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality](https://md.research.elamur.ai/free/en/papers/timkey-2021-all-bark-no-bite-rogue/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**William Timkey, Marten van Schijndel*2021 · 139 citations*
482. **[ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning](https://md.research.elamur.ai/free/en/papers/qin-2021-erica-improving-entity-relation-understanding/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yujia Qin, Yankai Lin, Ryuichi Takanobu, et al.*2021 · 139 citations*
483. **[FaithDial: A Faithful Benchmark for Information-Seeking Dialogue](https://md.research.elamur.ai/free/en/papers/dziri-2022-faithdial-faithful-benchmark-information-seeking/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nouha Dziri, Ehsan Kamalloo, Sivan Milton, et al.*2022 · 138 citations*
484. **[AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning](https://md.research.elamur.ai/free/en/papers/wang-2022-adamix-mixture-adaptations-parameter-efficient/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, et al.*2022 · 135 citations*
485. **[Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models](https://md.research.elamur.ai/free/en/papers/yang-2021-be-careful-about-poisoned-word/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Wenkai Yang, Lei Li, Zhiyuan Zhang, et al.*2021 · 135 citations*
486. **[UnNatural Language Inference](https://md.research.elamur.ai/free/en/papers/sinha-2021-unnatural-language-inference/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, et al.*2021 · 135 citations*
487. **[Affective and Contextual Embedding for Sarcasm Detection](https://md.research.elamur.ai/free/en/papers/babanejad-2020-affective-contextual-embedding-sarcasm-detection/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Nastaran Babanejad, Heidar Davoudi, Aijun An, et al.*2020 · 135 citations*
488. [**Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches arXiv:1904.01172**Shane Storks, Qiaozi Gao, Joyce Y. Chai*2019 · 135 citations*](https://md.research.elamur.ai/free/en/papers/storks-2019-recent-advances-natural-language-inference/)
489. **[SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval](https://md.research.elamur.ai/free/en/papers/li-2023-sailer-structure-aware-pre-trained/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Haitao Li, Qingyao Ai, Jia Chen, et al.*2023 · 134 citations*
490. [**When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset arXiv:2104.08671**Lucia Zheng, Neel Guha, Brandon R. Anderson, et al.*2021 · 134 citations*](https://md.research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/)
491. **[Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset](https://md.research.elamur.ai/free/en/papers/henderson-2022-pile-law-learning-responsible-data/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Peter Henderson, Mark S. Krass, Lucia Zheng, et al.*2022 · 133 citations*
492. **[Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics](https://md.research.elamur.ai/free/en/papers/czarnowska-2021-quantifying-social-biases-nlp-generalization/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Paula Czarnowska, Yogarshi Vyas, Kashif Shah*2021 · 133 citations*
493. **[Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion](https://md.research.elamur.ai/free/en/papers/shuster-2022-language-models-that-seek-knowledge/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, et al.*2022 · 132 citations*
494. **[What to Pre-Train on? Efficient Intermediate Task Selection](https://md.research.elamur.ai/free/en/papers/poth-2021-what-pre-train-efficient-intermediate/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Clifton Poth, Jonas Pfeiffer, Andreas Rücklé, et al.*2021 · 132 citations*
495. **[Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics](https://md.research.elamur.ai/free/en/papers/bhargava-2021-generalization-nli-ways-not-go/) [Workshop on Insights from Negative Results in NLP](https://md.research.elamur.ai/free/en/venues/insights/)**Prajjwal Bhargava, Aleksandr Drozd, Anna Rogers*2021 · 131 citations*
496. **[Syntax-Guided Controlled Generation of Paraphrases](https://md.research.elamur.ai/free/en/papers/kumar-2020-syntax-guided-controlled-generation-paraphrases/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Ashutosh Kumar, Kabir Ahuja, Raghuram Vadapalli, et al.*2020 · 131 citations*
497. **[A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems](https://md.research.elamur.ai/free/en/papers/yi-2024-survey-recent-advances-llm-based/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Zihao Yi, Jiarui Ouyang, Zhe Xu, et al.*2024 · 130 citations*
498. **[Analyzing Transformers in Embedding Space](https://md.research.elamur.ai/free/en/papers/dar-2023-analyzing-transformers-embedding-space/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Guy Dar, Mor Geva, Ankit Gupta, et al.*2023 · 130 citations*
499. **[Controllable Natural Language Generation with Contrastive Prefixes](https://md.research.elamur.ai/free/en/papers/qian-2022-controllable-natural-language-generation-contrastive/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Jing Qian, Li Dong, Yelong Shen, et al.*2022 · 130 citations*
500. [**An Analysis of Natural Language Inference Benchmarks through the Lens of Negation**Md Mosharaf Hossain, Venelin Kovatchev, Pranoy Dutta, et al.*2020 · 130 citations*](https://md.research.elamur.ai/free/en/papers/hossain-2020-analysis-natural-language-inference-benchmarks/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) … [4](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) **5** [6](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/)

- [← back to](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) — RoBERTa: A Robustly Optimized BERT Pretraining Approach