---
title: "Who cites RoBERTa: A — page 3 — 9,837 citing papers"
description: "9,837 papers of the Elamur Research library cite «RoBERTa: A Robustly Optimized BERT Pretraining Approach», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/3/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/3/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [RoBERTa: A Robustly Optimized BERT Pretraining…](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) / [cited by](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) / page 3

# Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 3 of 15 · 201–300 · [← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/2/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) [2](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/2/) **3** [4](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/)

201. [**LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention arXiv:2303.16199**Renrui Zhang, Jiaming Han, Chris Liu, et al.*2023 · 333 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-llama-adapter-efficient-fine-tuning/)
202. **[SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/tian-2020-skep-sentiment-knowledge-enhanced-pre/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Hao Tian, Can Gao, Xinyan Xiao, et al.*2020 · 333 citations*
203. [**ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation arXiv:2107.02137**Yu Sun, Shuohuan Wang, Shikun Feng, et al.*2021 · 332 citations*](https://md.research.elamur.ai/free/en/papers/sun-2021-ernie-3-0-large/)
204. [**GraphCodeBERT: Pre-training Code Representations with Data Flow arXiv:2009.08366**Daya Guo, Shuo Ren, Shuai Lu, et al.*2021 · 332 citations*](https://md.research.elamur.ai/free/en/papers/guo-2021-graphcodebert-pre-training-code-representations/)
205. **[TimeLMs: Diachronic Language Models from Twitter](https://md.research.elamur.ai/free/en/papers/loureiro-2022-timelms-diachronic-language-models-twitter/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Daniel Loureiro, Francesco Barbieri, Leonardo Neves, et al.*2022 · 331 citations*
206. **[Language Is Not All You Need: Aligning Perception with Language Models](https://md.research.elamur.ai/free/en/papers/huang-2023-language-all-need-aligning-perception/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shaohan Huang, Li Dong, Wenhui Wang, et al.*2023 · 330 citations*
207. **[Unsupervised Domain Clusters in Pretrained Language Models](https://md.research.elamur.ai/free/en/papers/aharoni-2020-unsupervised-domain-clusters-pretrained-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Roee Aharoni, Yoav Goldberg*2020 · 330 citations*
208. **[Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval](https://md.research.elamur.ai/free/en/papers/gao-2022-unsupervised-corpus-aware-language-model/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Luyu Gao, Jamie Callan*2022 · 328 citations*
209. **[Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection](https://md.research.elamur.ai/free/en/papers/vidgen-2021-learning-worst-dynamically-generated-datasets/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Bertie Vidgen, Tristan Thrush, Zeerak Waseem, et al.*2021 · 325 citations*
210. **[LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion](https://md.research.elamur.ai/free/en/papers/jiang-2023-llm-blender-ensembling-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Dongfu Jiang, Xiang Ren, Bill Yuchen Lin*2023 · 321 citations*
211. **[How many data points is a prompt worth?](https://md.research.elamur.ai/free/en/papers/scao-2021-how-many-data-points-is/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Teven Le Scao, Alexander Rush*2021 · 320 citations*
212. **[Probing Pretrained Language Models for Lexical Semantics](https://md.research.elamur.ai/free/en/papers/vulic-2020-probing-pretrained-language-models-lexical/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, et al.*2020 · 320 citations*
213. [**WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation arXiv:2201.05955**Alisa Liu, Swabha Swayamdipta, Noah A. Smith, et al.*2022 · 317 citations*](https://md.research.elamur.ai/free/en/papers/liu-2022-wanli-worker-ai-collaboration-natural/)
214. **[Double Graph Based Reasoning for Document-level Relation Extraction](https://md.research.elamur.ai/free/en/papers/zeng-2020-double-graph-based-reasoning-document/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Shuang Zeng, Runxin Xu, Baobao Chang, et al.*2020 · 314 citations*
215. **[Explainable Automated Fact-Checking for Public Health Claims](https://md.research.elamur.ai/free/en/papers/kotonya-2020-explainable-automated-fact-checking-public/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Neema Kotonya, Francesca Toni*2020 · 314 citations*
216. **[A Transformer-based approach to Irony and Sarcasm detection](https://md.research.elamur.ai/free/en/papers/potamias-2019-transformer-based-approach-irony-sarcasm/) [Neural Computing and Applications](https://md.research.elamur.ai/free/en/venues/neural-computing-and-applications/)**Rolandos Alexandros Potamias, Georgios Siolas, Andreas - Georgios Stafylopatis*2019 · 312 citations*
217. [**S2ORC: The Semantic Scholar Open Research Corpus arXiv:1911.02782**Kyle Lo, Lucy Lu Wang, Mark Neumann, et al.*2019 · 312 citations*](https://md.research.elamur.ai/free/en/papers/lo-2019-s2orc-semantic-scholar-open-research/)
218. **[From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models](https://md.research.elamur.ai/free/en/papers/feng-2023-pretraining-data-language-models-downstream/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Shangbin Feng, Chan Young Park, Yuhan Liu, et al.*2023 · 311 citations*
219. **[Byte Pair Encoding is Suboptimal for Language Model Pretraining](https://md.research.elamur.ai/free/en/papers/bostrom-2020-byte-pair-encoding-is-suboptimal/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Kaj Bostrom, Greg Durrett*2020 · 310 citations*
220. **[UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning](https://md.research.elamur.ai/free/en/papers/li-2021-unimo-unified-modal-understanding-generation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Wei Li, Can Gao, Guocheng Niu, et al.*2021 · 308 citations*
221. **[Muppet: Massive Multi-task Representations with Pre-Finetuning](https://md.research.elamur.ai/free/en/papers/aghajanyan-2021-muppet-massive-multi-task-representations/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.*2021 · 307 citations*
222. **[AugGPT: Leveraging ChatGPT for Text Data Augmentation](https://md.research.elamur.ai/free/en/papers/dai-2023-auggpt-leveraging-chatgpt-text-data/) [IEEE Transactions on Big Data](https://md.research.elamur.ai/free/en/venues/ieee-transactions-on-big-data/)**Haixing Dai; Zhengliang Liu; Wenxiong Liao; Xiaoke Huang; Yihan Cao; Zihao Wu; Lin Zhao; Shaochen Xu; Wei Liu; Ninghao Liu; Sheng Li; Dajiang Zhu; Hongmin Cai; Lichao Sun; Quanzheng Li; Dinggang Shen; Tianming Liu;, Xiang Li*2023 · 306 citations*
223. [**Can AI-Generated Text be Reliably Detected? arXiv:2303.11156**Vinu Sankar Sadasivan, Aounon Kumar, Sriram Balasubramanian, et al.*2023 · 306 citations*](https://md.research.elamur.ai/free/en/papers/sadasivan-2023-ai-generated-text-reliably-detected/)
224. **[SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer](https://md.research.elamur.ai/free/en/papers/vu-2022-spot-better-frozen-model-adaptation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tu Vu, Brian Lester, Noah Constant, et al.*2022 · 306 citations*
225. **[SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization](https://md.research.elamur.ai/free/en/papers/jiang-2020-smart-robust-efficient-fine-tuning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Haoming Jiang, Pengcheng He, Weizhu Chen, et al.*2020 · 304 citations*
226. [**Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language arXiv:2204.00598**Andy Zeng, Maria Attarian, Brian Ichter, et al.*2022 · 302 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2022-socratic-models-composing-zero-shot/)
227. **[Want To Reduce Labeling Cost? GPT-3 Can Help](https://md.research.elamur.ai/free/en/papers/wang-2021-want-reduce-labeling-cost-gpt/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Shuohang Wang, Yang Liu, Yichong Xu, et al.*2021 · 300 citations*
228. **[Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering](https://md.research.elamur.ai/free/en/papers/feng-2020-scalable-multi-hop-relational-reasoning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, et al.*2020 · 300 citations*
229. [**FlauBERT: Unsupervised Language Model Pre-training for French arXiv:1912.05372**Hang Le, Loïc Vial, Jibril Frej, et al.*2019 · 299 citations*](https://md.research.elamur.ai/free/en/papers/le-2019-flaubert-unsupervised-language-model-pre/)
230. **[Entity-Based Knowledge Conflicts in Question Answering](https://md.research.elamur.ai/free/en/papers/longpre-2021-entity-based-knowledge-conflicts-question/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Shayne Longpre, Kartik Perisetla, Anthony Chen, et al.*2021 · 298 citations*
231. **[Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little](https://md.research.elamur.ai/free/en/papers/sinha-2021-masked-language-modeling-distributional-hypothesis/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Koustuv Sinha, Robin Jia, Dieuwke Hupkes, et al.*2021 · 297 citations*
232. **[BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla](https://md.research.elamur.ai/free/en/papers/bhattacharjee-2022-banglabert-language-model-pretraining-benchmarks/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Abhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, et al.*2022 · 296 citations*
233. **[AdapterDrop: On the Efficiency of Adapters in Transformers](https://md.research.elamur.ai/free/en/papers/ruckle-2021-adapterdrop-efficiency-adapters-transformers/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Andreas Rücklé, Gregor Geigle, Max Glockner, et al.*2021 · 296 citations*
234. **[Text Classification via Large Language Models](https://md.research.elamur.ai/free/en/papers/sun-2023-text-classification-large-language-models/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Xiaofei Sun, Xiaoya Li, Jiwei Li, et al.*2023 · 292 citations*
235. **[QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization](https://md.research.elamur.ai/free/en/papers/fabbri-2022-qafacteval-improved-qa-based-factual/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Alexander Fabbri, Chien-Sheng Wu, Wenhao Liu, et al.*2022 · 292 citations*
236. [**A Review of Large Language Models and Autonomous Agents in Chemistry arXiv:2407.01603**Mayk Caldas Ramos, Christopher J. Collison, Andrew D. White*2024 · 288 citations*](https://md.research.elamur.ai/free/en/papers/ramos-2024-review-large-language-models-autonomous/)
237. **[PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them](https://md.research.elamur.ai/free/en/papers/lewis-2021-paq-65-million-probably-asked/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Patrick Lewis, Yuxiang Wu, Linqing Liu, et al.*2021 · 288 citations*
238. **[Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders](https://md.research.elamur.ai/free/en/papers/wang-2020-two-are-better-than-one/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jue Wang, Wei Lu*2020 · 288 citations*
239. [**An Explanation of In-context Learning as Implicit Bayesian Inference arXiv:2111.02080**Sang Michael Xie, Aditi Raghunathan, Percy Liang, et al.*2021 · 286 citations*](https://md.research.elamur.ai/free/en/papers/xie-2021-explanation-context-learning-implicit-bayesian/)
240. [**ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning arXiv:2002.04326**Weihao Yu, Zihang Jiang, Yanfei Dong, et al.*2020 · 286 citations*](https://md.research.elamur.ai/free/en/papers/yu-2020-reclor-reading-comprehension-dataset-requiring/)
241. **[USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation](https://md.research.elamur.ai/free/en/papers/mehri-2020-usr-unsupervised-reference-free-evaluation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Shikib Mehri, Maxine Eskenazi*2020 · 286 citations*
242. **[AlignScore: Evaluating Factual Consistency with A Unified Alignment Function](https://md.research.elamur.ai/free/en/papers/zha-2023-alignscore-evaluating-factual-consistency-unified/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuheng Zha, Yichi Yang, Ruichen Li, et al.*2023 · 284 citations*
243. **[Spelling Error Correction with Soft-Masked BERT](https://md.research.elamur.ai/free/en/papers/zhang-2020-spelling-error-correction-soft-masked/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Shaohua Zhang, Haoran Huang, Jicong Liu, et al.*2020 · 284 citations*
244. **[Contextualized Perturbation for Textual Adversarial Attack](https://md.research.elamur.ai/free/en/papers/li-2021-contextualized-perturbation-textual-adversarial-attack/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Dianqi Li, Yizhe Zhang, Hao Peng, et al.*2021 · 283 citations*
245. **[Fine-grained Fact Verification with Kernel Graph Attention Network](https://md.research.elamur.ai/free/en/papers/liu-2020-fine-grained-fact-verification-kernel/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Zhenghao Liu, Chenyan Xiong, Maosong Sun, et al.*2020 · 283 citations*
246. **[XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation](https://md.research.elamur.ai/free/en/papers/ruder-2021-xtreme-r-more-challenging-nuanced/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Sebastian Ruder, Noah Constant, Jan Botha, et al.*2021 · 281 citations*
247. **[Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?](https://md.research.elamur.ai/free/en/papers/pruksachatkun-2020-intermediate-task-transfer-learning-pretrained/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yada Pruksachatkun, Jason Phang, Haokun Liu, et al.*2020 · 281 citations*
248. **[Large Language Models for Mathematical Reasoning: Progresses and Challenges](https://md.research.elamur.ai/free/en/papers/ahn-2024-large-language-models-mathematical-reasoning/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Janice Ahn, Rishu Verma, Renze Lou, et al.*2024 · 280 citations*
249. [**Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering arXiv:1911.10470**Akari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, et al.*2019 · 280 citations*](https://md.research.elamur.ai/free/en/papers/asai-2019-learning-retrieve-reasoning-paths-over/)
250. **[OpenPrompt: An Open-source Framework for Prompt-learning](https://md.research.elamur.ai/free/en/papers/ding-2022-openprompt-open-source-framework-prompt/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ning Ding, Shengding Hu, Weilin Zhao, et al.*2022 · 279 citations*
251. **[TRUE: Re-evaluating Factual Consistency Evaluation](https://md.research.elamur.ai/free/en/papers/honovich-2022-true-re-evaluating-factual-consistency/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Or Honovich, Roee Aharoni, Jonathan Herzig, et al.*2022 · 279 citations*
252. **[A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions](https://md.research.elamur.ai/free/en/papers/wu-2025-survey-llm-generated-text-detection/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Junchao Wu, Shu Yang, Runzhe Zhan, et al.*2025 · 277 citations*
253. **[RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL](https://md.research.elamur.ai/free/en/papers/li-2023-resdsql-decoupling-schema-linking-skeleton/) [Proceedings of the AAAI Conference on Artificial Intelligence](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/)**Haoyang Li, Jing Zhang, Cuiping Li, et al.*2023 · 277 citations*
254. **[Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models](https://md.research.elamur.ai/free/en/papers/wu-2021-polyjuice-generating-counterfactuals-explaining-evaluating/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, et al.*2021 · 277 citations*
255. **[Graph Retrieval-Augmented Generation: A Survey](https://md.research.elamur.ai/free/en/papers/peng-2024-graph-retrieval-augmented-generation-survey/) [ACM Transactions on Information Systems](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-information-systems/)**Boci Peng, Yun Zhu, Yongchao Liu, et al.*2024 · 276 citations*
256. **[Text Classification Using Label Names Only: A Language Model Self-Training Approach](https://md.research.elamur.ai/free/en/papers/meng-2020-text-classification-label-names-only/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yu Meng, Yunyi Zhang, Jiaxin Huang, et al.*2020 · 274 citations*
257. **[XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond](https://md.research.elamur.ai/free/en/papers/barbieri-2022-xlm-t-multilingual-language-models/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Francesco Barbieri, Luis Espinosa Anke, Jose Camacho-Collados*2022 · 271 citations*
258. [**Towards Understanding and Mitigating Social Biases in Language Models arXiv:2106.13219**Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, et al.*2021 · 271 citations*](https://md.research.elamur.ai/free/en/papers/liang-2021-towards-understanding-mitigating-social-biases/)
259. **[Attention is Not Only a Weight: Analyzing Transformers with Vector Norms](https://md.research.elamur.ai/free/en/papers/kobayashi-2020-attention-is-not-only-weight/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, et al.*2020 · 270 citations*
260. **[DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings](https://md.research.elamur.ai/free/en/papers/chuang-2022-diffcse-difference-based-contrastive-learning/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Yung-Sung Chuang, Rumen Dangovski, Hongyin Luo, et al.*2022 · 269 citations*
261. **[ConveRT: Efficient and Accurate Conversational Representations from Transformers](https://md.research.elamur.ai/free/en/papers/henderson-2020-convert-efficient-accurate-conversational-representations/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Matthew Henderson, Iñigo Casanueva, Nikola Mrkšić, et al.*2020 · 269 citations*
262. **[Injecting Numerical Reasoning Skills into Language Models](https://md.research.elamur.ai/free/en/papers/geva-2020-injecting-numerical-reasoning-skills-into/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mor Geva, Ankit Gupta, Jonathan Berant*2020 · 269 citations*
263. [**CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review arXiv:2103.06268**Dan Hendrycks, Collin Burns, Anya Chen, et al.*2021 · 268 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-cuad-expert-annotated-nlp-dataset/)
264. **[IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/wilie-2020-indonlu-benchmark-resources-evaluating-indonesian/) [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/)**Bryan Wilie, Karissa Vincentio, Genta Indra Winata, et al.*2020 · 266 citations*
265. [**BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models NeurIPS 2021 Datasets and Benchmarks**Nandan Thakur, Nils Reimers, Andreas Rücklé, et al.*2021 · 265 citations*](https://md.research.elamur.ai/free/en/papers/thakur-2021-beir-heterogenous-benchmark-zero/)
266. **[Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing](https://md.research.elamur.ai/free/en/papers/lin-2020-bridging-textual-tabular-data-cross/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Xi Victoria Lin, Richard Socher, Caiming Xiong*2020 · 263 citations*
267. **[How Can We Accelerate Progress Towards Human-like Linguistic Generalization?](https://md.research.elamur.ai/free/en/papers/linzen-2020-how-can-we-accelerate-progress/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tal Linzen*2020 · 263 citations*
268. **[LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models](https://md.research.elamur.ai/free/en/papers/li-2023-llama-vid-image-worth-2/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Yanwei Li, Chengyao Wang, Jiaya Jia*2023 · 262 citations*
269. **[The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants](https://md.research.elamur.ai/free/en/papers/bandarkar-2023-belebele-benchmark-parallel-reading-comprehension/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.*2023 · 262 citations*
270. **[TLDR: Extreme Summarization of Scientific Documents](https://md.research.elamur.ai/free/en/papers/cachola-2020-tldr-extreme-summarization-scientific-documents/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Isabel Cachola, Kyle Lo, Arman Cohan, et al.*2020 · 262 citations*
271. **[Towards Debiasing Sentence Representations](https://md.research.elamur.ai/free/en/papers/liang-2020-debiasing-sentence-representations/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Paul Pu Liang, Irene Mengze Li, Emily Zheng, et al.*2020 · 262 citations*
272. [**DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale arXiv:2201.05596**Samyam Rajbhandari, Conglong Li, Zhewei Yao, et al.*2022 · 261 citations*](https://md.research.elamur.ai/free/en/papers/rajbhandari-2022-deepspeed-moe-advancing-mixture-experts/)
273. **[Condenser: a Pre-training Architecture for Dense Retrieval](https://md.research.elamur.ai/free/en/papers/gao-2021-condenser-pre-training-architecture-dense/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Luyu Gao, Jamie Callan*2021 · 261 citations*
274. **[Fairseq S2T: Fast Speech-to-Text Modeling with Fairseq](https://md.research.elamur.ai/free/en/papers/wang-2020-fairseq-s2t-fast-speech-text/) [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/)**Changhan Wang, Yun Tang, Xutai Ma, et al.*2020 · 259 citations*
275. [**LexGLUE: A Benchmark Dataset for Legal Language Understanding in English arXiv:2110.00976**Ilias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras*2021 · 258 citations*](https://md.research.elamur.ai/free/en/papers/chalkidis-2021-lexglue-benchmark-dataset-legal-language/)
276. **[Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks](https://md.research.elamur.ai/free/en/papers/mahabadi-2021-parameter-efficient-multi-task-fine/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, et al.*2021 · 258 citations*
277. [**Multilingual is not enough: BERT for Finnish arXiv:1912.07076**Antti Virtanen, Jenna Kanerva, Rami Ilo, et al.*2019 · 258 citations*](https://md.research.elamur.ai/free/en/papers/virtanen-2019-multilingual-enough-bert-finnish/)
278. **[Fine-Tuning LLaMA for Multi-Stage Text Retrieval](https://md.research.elamur.ai/free/en/papers/ma-2023-fine-tuning-llama-multi-stage/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Xueguang Ma, Liang Wang, Nan Yang, et al.*2023 · 257 citations*
279. [**The Curse of Recursion: Training on Generated Data Makes Models Forget arXiv:2305.17493**Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, et al.*2023 · 255 citations*](https://md.research.elamur.ai/free/en/papers/shumailov-2023-curse-recursion-training-generated-data/)
280. **[Generating Datasets with Pretrained Language Models](https://md.research.elamur.ai/free/en/papers/schick-2021-generating-datasets-pretrained-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Timo Schick, Hinrich Schutze*2021 · 254 citations*
281. **[Analyzing Leakage of Personally Identifiable Information in Language Models](https://md.research.elamur.ai/free/en/papers/lukas-2023-analyzing-leakage-personally-identifiable-information/) [Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and Privacy](https://md.research.elamur.ai/free/en/venues/proceedings-ieee-symposium-on-security-and-privacy-proceedings-of-the-ieee/)**Nils Lukas, Ahmed Salem, Robert Sim, et al.*2023 · 252 citations*
282. **[ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanation](https://md.research.elamur.ai/free/en/papers/malik-2021-ildc-cjpe-indian-legal-documents/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Vijit Malik, Rishabh Sanjay, Shubham Kumar Nigam, et al.*2021 · 251 citations*
283. [**MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers arXiv:2102.01454**Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, et al.*2021 · 251 citations*](https://md.research.elamur.ai/free/en/papers/pillutla-2021-mauve-measuring-gap-between-neural/)
284. **[COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List](https://md.research.elamur.ai/free/en/papers/gao-2021-coil-revisit-exact-lexical-match/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Luyu Gao, Zhuyun Dai, Jamie Callan*2021 · 250 citations*
285. **[Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings](https://md.research.elamur.ai/free/en/papers/bommasani-2020-interpreting-pretrained-contextualized-representations-reductions/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Rishi Bommasani, Kelly Davis, Claire Cardie*2020 · 250 citations*
286. **[Automatic Detection of Machine Generated Text: A Critical Survey](https://md.research.elamur.ai/free/en/papers/jawahar-2020-automatic-detection-machine-generated-text/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Ganesh Jawahar, Muhammad Abdul-Mageed, Laks Lakshmanan V.S.*2020 · 247 citations*
287. [**E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT arXiv:1911.03681**Nina Poerner, Ulli Waltinger, Hinrich Schutze*2019 · 247 citations*](https://md.research.elamur.ai/free/en/papers/poerner-2019-e-bert-efficient-yet-effective/)
288. **[Knowledge-Grounded Dialogue Generation with Pre-trained Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2020-knowledge-grounded-dialogue-generation-pre/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xueliang Zhao, Wei Wu, Can Xu, et al.*2020 · 246 citations*
289. **[ASQA: Factoid Questions Meet Long-Form Answers](https://md.research.elamur.ai/free/en/papers/stelmakh-2022-asqa-factoid-questions-meet-long/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, et al.*2022 · 245 citations*
290. **[ZeroGen: Efficient Zero-shot Learning via Dataset Generation](https://md.research.elamur.ai/free/en/papers/ye-2022-zerogen-efficient-zero-shot-learning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jiacheng Ye, Jiahui Gao, Qintong Li, et al.*2022 · 245 citations*
291. [**OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization arXiv:2212.12017**Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, et al.*2022 · 244 citations*](https://md.research.elamur.ai/free/en/papers/iyer-2022-opt-iml-scaling-language-model/)
292. [**CLUE: A Chinese Language Understanding Evaluation Benchmark arXiv:2004.05986**Liang Xu, Hai Hu, Xuanwei Zhang, et al.*2020 · 244 citations*](https://md.research.elamur.ai/free/en/papers/xu-2020-clue-chinese-language-understanding/)
293. **[In-context Examples Selection for Machine Translation](https://md.research.elamur.ai/free/en/papers/agrawal-2023-context-examples-selection-machine-translation/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Sweta Agrawal, Chunting Zhou, Mike Lewis, et al.*2023 · 243 citations*
294. **[Hierarchical Graph Network for Multi-hop Question Answering](https://md.research.elamur.ai/free/en/papers/fang-2020-hierarchical-graph-network-multi-hop/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yuwei Fang, Siqi Sun, Zhe Gan, et al.*2020 · 243 citations*
295. **[Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations](https://md.research.elamur.ai/free/en/papers/li-2023-synthetic-data-generation-large-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhuoyan Li, Hangxiao Zhu, Zhuoran Lu, et al.*2023 · 242 citations*
296. [**BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage arXiv:2208.03188**Kurt Shuster, Jing Xu, Mojtaba Komeili, et al.*2022 · 241 citations*](https://md.research.elamur.ai/free/en/papers/shuster-2022-blenderbot-3-deployed-conversational-agent/)
297. **[Pretrained Language Models for Biomedical and Clinical Tasks: Understanding and Extending the State-of-the-Art](https://md.research.elamur.ai/free/en/papers/lewis-2020-pretrained-language-models-biomedical-clinical/) [Workshop on Clinical Natural Language Processing (Clinical NLP) @ LREC](https://md.research.elamur.ai/free/en/venues/clinicalnlp/)**Patrick Lewis, Myle Ott, Jingfei Du, et al.*2020 · 241 citations*
298. **[BERT-of-Theseus: Compressing BERT by Progressive Module Replacing](https://md.research.elamur.ai/free/en/papers/xu-2020-bert-theseus-compressing-bert-progressive/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Canwen Xu, Wangchunshu Zhou, Tao Ge, et al.*2020 · 240 citations*
299. **[Curriculum Learning for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/xu-2020-curriculum-learning-natural-language-understanding/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Benfeng Xu, Licheng Zhang, Zhendong Mao, et al.*2020 · 240 citations*
300. **[MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems](https://md.research.elamur.ai/free/en/papers/lin-2020-mintl-minimalist-transfer-learning-task/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhaojiang Lin, Andrea Madotto, Genta Indra Winata, et al.*2020 · 240 citations*

[← prev](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/2/) [1](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/) [2](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/2/) **3** [4](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/) … [10](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/10/) … [15](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/15/) [next →](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/)

- [← back to](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/) — RoBERTa: A Robustly Optimized BERT Pretraining Approach