---
title: "Who cites Antonio B. Torralba — 2,708 papers of our library"
description: "2,708 papers of the Elamur Research library cite the works of Antonio B. Among them: BERT: Pre-training of Deep Bidirectional Transformers…"
canonical: "https://research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Antonio B. Torralba](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/) / cited by

# Who cites Antonio B. Torralba

2,894 citations of their works from 2,708 papers of our library (of the 149,439 whose bibliographies we read) · 535 with a page here, the most cited first · page 1 of 6 · 1–100 · [← Antonio B. Torralba](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/)

**1** [2](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/2/) … [6](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/6/) [next →](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/2/)

1. **[BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Jacob Devlin, Ming-Wei Chang, Kenton Lee, et al.*2019 · 56,209 citations*
2. **[Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Nils Reimers, Iryna Gurevych*2019 · 17,096 citations*
3. [**Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer arXiv:1910.10683**Colin Raffel, Noam Shazeer, Adam Roberts, et al.*2019 · 11,325 citations*](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)
4. [**RoBERTa: A Robustly Optimized BERT Pretraining Approach arXiv:1907.11692**Yinhan Liu, Myle Ott, Naman Goyal, et al.*2019 · 9,837 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)
5. [**Learning Transferable Visual Models From Natural Language Supervision arXiv:2103.00020**Alec Radford, Jong Wook Kim, Chris Hallacy, et al.*2021 · 8,767 citations*](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
6. **[GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/) [EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/emnlp-workshop-blackboxnlp-analyzing-and-interpreting-neural-networks-for-nlp/)**Alex Wang, Amanpreet Singh, Julian Michael, et al.*2018 · 7,276 citations*
7. [**Representation Learning with Contrastive Predictive Coding arXiv:1807.03748**Aaron van den Oord, Yazhe Li, Oriol Vinyals*2018 · 7,022 citations*](https://md.research.elamur.ai/free/en/papers/oord-2018-representation-learning-contrastive-predictive-coding/)
8. [**DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter arXiv:1910.01108**Victor Sanh, Lysandre Debut, Julien Chaumond, et al.*2019 · 6,751 citations*](https://md.research.elamur.ai/free/en/papers/sanh-2019-distilbert-distilled-version-bert-smaller/)
9. **[Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://md.research.elamur.ai/free/en/papers/selvaraju-2016-grad-cam-visual-explanations-deep/) [International Journal of Computer Vision](https://md.research.elamur.ai/free/en/venues/international-journal-of-computer-vision/)**Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, et al.*2016 · 6,394 citations*
10. **[Survey of Hallucination in Natural Language Generation](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Ziwei Ji, Nayeon Lee, Rita Frieske, et al.*2022 · 5,974 citations*
11. **[EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks](https://md.research.elamur.ai/free/en/papers/tan-2019-efficientnet-rethinking-model-scaling-convolutional/) [International Conference on Machine Learning (ICML)](https://md.research.elamur.ai/free/en/venues/international-conference-on-machine-learning/)**Mingxing Tan, Quoc V. Le*2019 · 5,416 citations*
12. **[SimCSE: Simple Contrastive Learning of Sentence Embeddings](https://md.research.elamur.ai/free/en/papers/gao-2021-simcse-simple-contrastive-learning-sentence/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tianyu Gao, Xingcheng Yao, Danqi Chen*2021 · 3,942 citations*
13. [**Longformer: The Long-Document Transformer arXiv:2004.05150**Iz Beltagy, Matthew E. Peters, Arman Cohan*2020 · 3,880 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/)
14. [**XLNet: Generalized Autoregressive Pretraining for Language Understanding arXiv:1906.08237**Zhilin Yang, Zihang Dai, Yiming Yang, et al.*2019 · 3,857 citations*](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
15. [**Scaling Laws for Neural Language Models arXiv:2001.08361**Jared Kaplan, Sam McCandlish, Tom Henighan, et al.*2020 · 3,434 citations*](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/)
16. **[Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/) [IEEE International Conference on Computer Vision (ICCV)](https://md.research.elamur.ai/free/en/venues/ieee-international-conference-on-computer-vision-iccv/)**Yukun Zhu, Ryan Kiros, Richard Zemel, et al.*2015 · 3,083 citations*
17. [**RoFormer: Enhanced Transformer with Rotary Position Embedding arXiv:2104.09864**Jianlin Su, Yu Lu, Shengfeng Pan, et al.*2021 · 3,028 citations*](https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/)
18. **[Language Models as Knowledge Bases?](https://md.research.elamur.ai/free/en/papers/petroni-2019-language-models-as-knowledge-bases/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.*2019 · 3,028 citations*
19. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
20. [**ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942**Zhenzhong Lan, Mingda Chen, Sebastian Goodman, et al.*2019 · 2,806 citations*](https://md.research.elamur.ai/free/en/papers/lan-2019-albert-lite-bert-self-supervised/)
21. [**Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing arXiv:2007.15779**Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon*2020 · 2,674 citations*](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/)
22. **[SpanBERT: Improving Pre-training by Representing and Predicting Spans](https://md.research.elamur.ai/free/en/papers/joshi-2019-spanbert-improving-pre-training-representing/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Mandar Joshi, Danqi Chen, Yinhan Liu, et al.*2019 · 2,616 citations*
23. [**ReAct: Synergizing Reasoning and Acting in Language Models arXiv:2210.03629**Shunyu Yao, Jeffrey Zhao, Dian Yu, et al.*2022 · 2,591 citations*](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/)
24. [**Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding arXiv:2205.11487**Chitwan Saharia, William Chan, Saurabh Saxena, et al.*2022 · 2,533 citations*](https://md.research.elamur.ai/free/en/papers/saharia-2022-photorealistic-text-image-diffusion-models/)
25. **[Generating Sentences from a Continuous Space](https://md.research.elamur.ai/free/en/papers/bowman-2016-generating-sentences-continuous-space/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, et al.*2016 · 2,435 citations*
26. [**ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks arXiv:1908.02265**Jiasen Lu, Dhruv Batra, Devi Parikh, et al.*2019 · 2,302 citations*](https://md.research.elamur.ai/free/en/papers/lu-2019-vilbert-pretraining-task-agnostic-visiolinguistic/)
27. [**SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems arXiv:1905.00537**Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.*2019 · 2,227 citations*](https://md.research.elamur.ai/free/en/papers/wang-2019-superglue-stickier-benchmark-general-purpose/)
28. [**DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654**Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.*2020 · 1,828 citations*](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/)
29. **[SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation](https://md.research.elamur.ai/free/en/papers/cer-2017-semeval-2017-task-1-semantic/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Daniel Cer, Mona Diab, Eneko Agirre, et al.*2017 · 1,828 citations*
30. [**Layer Normalization arXiv:1607.06450**Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton*2016 · 1,819 citations*](https://md.research.elamur.ai/free/en/papers/ba-2016-layer-normalization/)
31. [**A Structured Self-attentive Sentence Embedding arXiv:1703.03130**Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, et al.*2017 · 1,797 citations*](https://md.research.elamur.ai/free/en/papers/lin-2017-structured-self-attentive-sentence-embedding/)
32. [**Pre-trained Models for Natural Language Processing: A Survey arXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897**Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.*2020 · 1,759 citations*](https://md.research.elamur.ai/free/en/papers/qiu-2020-pre-trained-models-natural-language/)
33. [**OPT: Open Pre-trained Transformer Language Models arXiv:2205.01068**Susan Zhang, Stephen Roller, Naman Goyal, et al.*2022 · 1,755 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
34. **[How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation](https://md.research.elamur.ai/free/en/papers/liu-2016-how-not-evaluate-your-dialogue/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Chia-Wei Liu, Ryan Lowe, Iulian Serban, et al.*2016 · 1,752 citations*
35. [**Universal Sentence Encoder arXiv:1803.11175**Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.*2018 · 1,629 citations*](https://md.research.elamur.ai/free/en/papers/cer-2018-universal-sentence-encoder/)
36. [**REALM: Retrieval-Augmented Language Model Pre-Training arXiv:2002.08909**Kelvin Guu, Kenton Lee, Zora Tung, et al.*2020 · 1,580 citations*](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/)
37. **[Universal Sentence Encoder for English](https://md.research.elamur.ai/free/en/papers/cer-2018-universal-sentence-encoder-english/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.*2018 · 1,546 citations*
38. [**Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer arXiv:1612.03928**Sergey Zagoruyko, Nikos Komodakis*2016 · 1,542 citations*](https://md.research.elamur.ai/free/en/papers/zagoruyko-2016-paying-more-attention-attention-improving/)
39. [**DINOv2: Learning Robust Visual Features without Supervision arXiv:2304.07193**Maxime Oquab, Timothee Darcet, Theo Moutakanni, et al.*2023 · 1,513 citations*](https://md.research.elamur.ai/free/en/papers/oquab-2023-dinov2-learning-robust-visual-features/)
40. [**Unified Language Model Pre-training for Natural Language Understanding and Generation arXiv:1905.03197**Li Dong, Nan Yang, Wenhui Wang, et al.*2019 · 1,422 citations*](https://md.research.elamur.ai/free/en/papers/dong-2019-unified-language-model-pre-training/)
41. **[Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments](https://md.research.elamur.ai/free/en/papers/anderson-2017-vision-language-navigation-interpreting-visually/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Peter Anderson, Qi Wu, Damien Teney, et al.*2017 · 1,414 citations*
42. **[VideoBERT: A Joint Model for Video and Language Representation Learning](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/) [IEEE/CVF International Conference on Computer Vision (ICCV)](https://md.research.elamur.ai/free/en/venues/ieee-cvf-international-conference-on-computer-vision-iccv/)**Chen Sun, Austin Myers, Carl Vondrick, et al.*2019 · 1,345 citations*
43. [**LaMDA: Language Models for Dialog Applications arXiv:2201.08239**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,344 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
44. **[BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions](https://md.research.elamur.ai/free/en/papers/clark-2019-boolq-exploring-surprising-difficulty-natural/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Christopher Clark, Kenton Lee, Ming-Wei Chang, et al.*2019 · 1,330 citations*
45. **[Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation](https://md.research.elamur.ai/free/en/papers/reimers-2020-making-monolingual-sentence-embeddings-multilingual/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Nils Reimers, Iryna Gurevych*2020 · 1,322 citations*
46. [**DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing arXiv:2111.09543**Pengcheng He, Jianfeng Gao, Weizhu Chen*2021 · 1,320 citations*](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/)
47. **[RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models](https://md.research.elamur.ai/free/en/papers/gehman-2020-realtoxicityprompts-evaluating-neural-toxic-degeneration/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Samuel Gehman, Suchin Gururangan, Maarten Sap, et al.*2020 · 1,306 citations*
48. [**AraBERT: Transformer-based Model for Arabic Language Understanding arXiv:2003.00104**Wissam Antoun, Fady Baly, Hazem Hajj*2020 · 1,304 citations*](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
49. [**CTRL: A Conditional Transformer Language Model for Controllable Generation arXiv:1909.05858**Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.*2019 · 1,291 citations*](https://md.research.elamur.ai/free/en/papers/keskar-2019-ctrl-conditional-transformer-language-model/)
50. **[Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering](https://md.research.elamur.ai/free/en/papers/goyal-2016-making-v-vqa-matter-elevating/) [International Journal of Computer Vision](https://md.research.elamur.ai/free/en/venues/international-journal-of-computer-vision/)**Yash Goyal, Tejas Khot, Douglas Summers-Stay, et al.*2016 · 1,281 citations*
51. **[The Rise and Potential of Large Language Model Based Agents: A Survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/) [Science China Information Sciences](https://md.research.elamur.ai/free/en/venues/science-china-information-sciences/)**Zhiheng Xi, Wenxiang Chen, Xin Guo, et al.*2023 · 1,272 citations*
52. **[Aspect Level Sentiment Classification with Deep Memory Network](https://md.research.elamur.ai/free/en/papers/tang-2016-aspect-level-sentiment-classification-deep/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Duyu Tang, Bing Qin, Ting Liu*2016 · 1,197 citations*
53. [**MASS: Masked Sequence to Sequence Pre-training for Language Generation arXiv:1905.02450**Kaitao Song, Xu Tan, Tao Qin, et al.*2019 · 1,143 citations*](https://md.research.elamur.ai/free/en/papers/song-2019-mass-masked-sequence-sequence-pre/)
54. **[StereoSet: Measuring stereotypical bias in pretrained language models](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Moin Nadeem, Anna Bethke, Siva Reddy*2021 · 1,141 citations*
55. **[SemEval-2018 Task 1: Affect in Tweets](https://md.research.elamur.ai/free/en/papers/mohammad-2018-semeval-2018-task-1-affect/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Saif Mohammad, Felipe Bravo-Marquez, Mohammad Salameh, et al.*2018 · 1,094 citations*
56. [**VL-BERT: Pre-training of Generic Visual-Linguistic Representations arXiv:1908.08530**Weijie Su, Xizhou Zhu, Yue Cao, et al.*2019 · 1,066 citations*](https://md.research.elamur.ai/free/en/papers/su-2019-vl-bert-pre-training-generic/)
57. **[Vision-Language Models for Vision Tasks: A Survey](https://md.research.elamur.ai/free/en/papers/zhang-2023-vision-language-models-vision-tasks/) [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://md.research.elamur.ai/free/en/venues/ieee-transactions-on-pattern-analysis-and-machine-intelligence/)**Jingyi Zhang, Jiaxing Huang, Sheng Jin, et al.*2023 · 1,047 citations*
58. **[What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties](https://md.research.elamur.ai/free/en/papers/conneau-2018-what-you-can-cram-into/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Alexis Conneau, German Kruszewski, Guillaume Lample, et al.*2018 · 1,045 citations*
59. [**The NarrativeQA Reading Comprehension Challenge**Tomáš Kočiský, Jonathan Schwarz, Phil Blunsom, et al.*2018 · 1,042 citations*](https://md.research.elamur.ai/free/en/papers/kocisky-2018-narrativeqa-reading-comprehension-challenge/)
60. **[Big Bird: Transformers for Longer Sequences](https://md.research.elamur.ai/free/en/papers/zaheer-2020-big-bird-transformers-longer-sequences/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Manzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.*2020 · 1,023 citations*
61. **[Linguistic Knowledge and Transferability of Contextual Representations](https://md.research.elamur.ai/free/en/papers/liu-2019-linguistic-knowledge-transferability-contextual-representations/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Nelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.*2019 · 1,021 citations*
62. **[Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction](https://md.research.elamur.ai/free/en/papers/sun-2021-direct-voxel-grid-optimization-super/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Cheng Sun, Min Sun, Hwann-Tzong Chen*2021 · 1,016 citations*
63. **[MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices](https://md.research.elamur.ai/free/en/papers/sun-2020-mobilebert-compact-task-agnostic-bert/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.*2020 · 1,016 citations*
64. **[Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2023-siren-s-song-ai-ocean/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Yue Zhang, Yafu Li, Leyang Cui, et al.*2023 · 977 citations*
65. [**ERNIE: Enhanced Representation through Knowledge Integration arXiv:1904.09223**Yu Sun, Shuohuan Wang, Yukun Li, et al.*2019 · 962 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-ernie-enhanced-representation-through-knowledge/)
66. [**MPNet: Masked and Permuted Pre-training for Language Understanding arXiv:2004.09297**Kaitao Song, Xu Tan, Tao Qin, et al.*2020 · 957 citations*](https://md.research.elamur.ai/free/en/papers/song-2020-mpnet-masked-permuted-pre-training/)
67. [**Patient Knowledge Distillation for BERT Model Compression arXiv:1908.09355**Siqi Sun, Yu Cheng, Zhe Gan, et al.*2019 · 947 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-patient-knowledge-distillation-bert-model/)
68. [**Do As I Can, Not As I Say: Grounding Language in Robotic Affordances arXiv:2204.01691**Michael Ahn, Anthony Brohan, Noah Brown, et al.*2022 · 941 citations*](https://md.research.elamur.ai/free/en/papers/ahn-2022-i-i-say-grounding-language/)
69. **[CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models](https://md.research.elamur.ai/free/en/papers/nangia-2020-crows-pairs-challenge-dataset-measuring/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Nikita Nangia, Clara Vania, Rasika Bhalerao, et al.*2020 · 897 citations*
70. **[TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP](https://md.research.elamur.ai/free/en/papers/morris-2020-textattack-framework-adversarial-attacks-data/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**John X. Morris, Eli Lifland, Jin Yong Yoo, et al.*2020 · 863 citations*
71. **[DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding](https://md.research.elamur.ai/free/en/papers/shen-2017-disan-directional-self-attention-network/) [Proceedings of the AAAI Conference on Artificial Intelligence](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/)**Tao Shen, Tianyi Zhou, Guodong Long, et al.*2017 · 854 citations*
72. **[Semi-supervised sequence tagging with bidirectional language models](https://md.research.elamur.ai/free/en/papers/peters-2017-semi-supervised-sequence-tagging-bidirectional/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Matthew E. Peters, Waleed Ammar, Chandra Bhagavatula, et al.*2017 · 795 citations*
73. **[Can Large Language Models Transform Computational Social Science?](https://md.research.elamur.ai/free/en/papers/ziems-2023-large-language-models-transform-computational/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Caleb Ziems, William Held, Omar Shaikh, et al.*2023 · 790 citations*
74. **[Learning Distributed Representations of Sentences from Unlabelled Data](https://md.research.elamur.ai/free/en/papers/hill-2016-learning-distributed-representations-sentences-unlabelled/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Felix Hill, Kyunghyun Cho, Anna Korhonen*2016 · 765 citations*
75. **[SentEval: An Evaluation Toolkit for Universal Sentence Representations](https://md.research.elamur.ai/free/en/papers/conneau-2018-senteval-evaluation-toolkit-universal-sentence/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Alexis Conneau, Douwe Kiela*2018 · 747 citations*
76. [**ProgPrompt: Generating Situated Robot Task Plans using Large Language Models arXiv:2209.11302**Ishika Singh, Valts Blukis, Arsalan Mousavian, et al.*2022 · 735 citations*](https://md.research.elamur.ai/free/en/papers/singh-2022-progprompt-generating-situated-robot-task/)
77. **[Transfer Learning in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/ruder-2019-transfer-learning-natural-language-processing/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.*2019 · 708 citations*
78. **[CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society](https://md.research.elamur.ai/free/en/papers/li-2023-camel-communicative-agents-mind/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, et al.*2023 · 706 citations*
79. **[SPECTER: Document-level Representation Learning using Citation-informed Transformers](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Arman Cohan, Sergey Feldman, Iz Beltagy, et al.*2020 · 697 citations*
80. **[TVQA: Localized, Compositional Video Question Answering](https://md.research.elamur.ai/free/en/papers/lei-2018-tvqa-localized-compositional-video-question/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jie Lei, Licheng Yu, Mohit Bansal, et al.*2018 · 687 citations*
81. [**Well-Read Students Learn Better: On the Importance of Pre-training Compact Models arXiv:1908.08962**Iulia Turc, Ming-Wei Chang, Kenton Lee, et al.*2019 · 678 citations*](https://md.research.elamur.ai/free/en/papers/turc-2019-well-read-students-learn-better/)
82. **[context2vec: Learning Generic Context Embedding with Bidirectional LSTM](https://md.research.elamur.ai/free/en/papers/melamud-2016-context2vec-learning-generic-context-embedding/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Oren Melamud, Jacob Goldberger, Ido Dagan*2016 · 673 citations*
83. [**A Corpus for Reasoning About Natural Language Grounded in Photographs (NLVR2)**Alane Suhr, Stephanie Zhou, Ally Zhang, et al.*2019 · 670 citations*](https://md.research.elamur.ai/free/en/papers/suhr-2019-corpus-reasoning-natural-language-grounded/)
84. [**K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters arXiv:2002.01808**Ruize Wang, Duyu Tang, Nan Duan, et al.*2020 · 666 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-k-adapter-infusing-knowledge-pre/)
85. **[Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate](https://md.research.elamur.ai/free/en/papers/liang-2023-encouraging-divergent-thinking-large-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tian Liang, Zhiwei He, Wenxiang Jiao, et al.*2023 · 651 citations*
86. **[ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer](https://md.research.elamur.ai/free/en/papers/yan-2021-consert-contrastive-framework-self-supervised/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuanmeng Yan, Rumei Li, Sirui Wang, et al.*2021 · 647 citations*
87. **[Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond](https://md.research.elamur.ai/free/en/papers/artetxe-2018-massively-multilingual-sentence-embeddings-zero/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Mikel Artetxe, Holger Schwenk*2018 · 635 citations*
88. [**MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework arXiv:2308.00352**Sirui Hong, Mingchen Zhuge, Jiaqi Chen, et al.*2023 · 630 citations*](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/)
89. [**e-SNLI: Natural Language Inference with Natural Language Explanations arXiv:1812.01193**Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, et al.*2018 · 622 citations*](https://md.research.elamur.ai/free/en/papers/camburu-2018-e-snli-natural-language-inference/)
90. [**AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation arXiv:2308.08155**Qingyun Wu, Gagan Bansal, Jieyu Zhang, et al.*2023 · 606 citations*](https://md.research.elamur.ai/free/en/papers/wu-2023-autogen-enabling-next-gen-llm/)
91. [**What do you learn from context? Probing for sentence structure in contextualized word representations arXiv:1905.06316**Ian Tenney, Patrick Xia, Berlin Chen, et al.*2019 · 602 citations*](https://md.research.elamur.ai/free/en/papers/tenney-2019-learn-context-probing-sentence-structure/)
92. [**Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks arXiv:1608.04207**Yossi Adi, Einat Kermany, Yonatan Belinkov, et al.*2016 · 599 citations*](https://md.research.elamur.ai/free/en/papers/adi-2016-fine-grained-analysis-sentence-embeddings/)
93. **[Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models](https://md.research.elamur.ai/free/en/papers/ni-2021-sentence-t5-scalable-sentence-encoders/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Jianmo Ni, Gustavo Hernandez Abrego, Noah Constant, et al.*2021 · 583 citations*
94. **[Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems](https://md.research.elamur.ai/free/en/papers/kiritchenko-2018-examining-gender-race-bias-two/) [Joint Conference on Lexical and Computational Semantics (*SEM)](https://md.research.elamur.ai/free/en/venues/starsem/)**Svetlana Kiritchenko, Saif Mohammad*2018 · 579 citations*
95. [**An efficient framework for learning sentence representations arXiv:1803.02893**Lajanugen Logeswaran, Honglak Lee*2018 · 577 citations*](https://md.research.elamur.ai/free/en/papers/logeswaran-2018-efficient-framework-learning-sentence-representations/)
96. [**Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters arXiv:2408.03314**Charlie Snell, Jaehoon Lee, Kelvin Xu, et al.*2024 · 567 citations*](https://md.research.elamur.ai/free/en/papers/snell-2024-scaling-llm-test-time-compute/)
97. [**MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models arXiv:2309.12284**Longhui Yu, Weisen Jiang, Han Shi, et al.*2023 · 565 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-metamath-bootstrap-your-own-mathematical/)
98. **[Inferring and Executing Programs for Visual Reasoning](https://md.research.elamur.ai/free/en/papers/johnson-2017-inferring-executing-programs-visual-reasoning/) [IEEE International Conference on Computer Vision (ICCV)](https://md.research.elamur.ai/free/en/venues/ieee-international-conference-on-computer-vision-iccv/)**Justin Johnson, Bharath Hariharan, Laurens van der Maaten, et al.*2017 · 557 citations*
99. [**The Natural Language Decathlon: Multitask Learning as Question Answering arXiv:1806.08730**Bryan McCann, Nitish Shirish Keskar, Caiming Xiong, et al.*2018 · 545 citations*](https://md.research.elamur.ai/free/en/papers/mccann-2018-natural-language-decathlon-multitask-learning/)
100. [**Machine Comprehension Using Match-LSTM and Answer Pointer arXiv:1608.07905**Shuohang Wang, Jing Jiang*2016 · 541 citations*](https://md.research.elamur.ai/free/en/papers/wang-2016-machine-comprehension-using-match-lstm/)

**1** [2](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/2/) … [6](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/6/) [next →](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/) — Antonio B. Torralba