---
title: "Who cites Adaptive Input Representations — 129 citing papers"
description: "129 papers of the Elamur Research library cite «Adaptive Input Representations for Neural Language Modeling», found in their bibliographies…"
canonical: "https://research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Adaptive Input Representations for Neural…](https://md.research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/) / cited by

# Who cites «Adaptive Input Representations for Neural Language Modeling»

129 papers of our library cite it (of the 149,439 whose bibliographies we read) · 28 with a page here, the most cited first · [← back to «Adaptive Input Representations for Neural Language Modeling»](https://md.research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/)

1. [**An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale arXiv:2010.11929**Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.*2020 · 23,726 citations*](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/)
2. **[fairseq: A Fast, Extensible Toolkit for Sequence Modeling](https://md.research.elamur.ai/free/en/papers/ott-2019-fairseq-fast-extensible-toolkit-sequence/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Myle Ott, Sergey Edunov, Alexei Baevski, et al.*2019 · 3,984 citations*
3. [**XLNet: Generalized Autoregressive Pretraining for Language Understanding arXiv:1906.08237**Zhilin Yang, Zihang Dai, Yiming Yang, et al.*2019 · 3,857 citations*](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
4. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
5. [**ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942**Zhenzhong Lan, Mingda Chen, Sebastian Goodman, et al.*2019 · 2,806 citations*](https://md.research.elamur.ai/free/en/papers/lan-2019-albert-lite-bert-self-supervised/)
6. **[Multimodal Transformer for Unaligned Multimodal Language Sequences](https://md.research.elamur.ai/free/en/papers/tsai-2019-multimodal-transformer-unaligned-multimodal-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.*2019 · 2,193 citations*
7. **[wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.*2020 · 1,421 citations*
8. **[A Comprehensive Overview of Large Language Models](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Humza Naveed, Asad Ullah Khan, Shi Qiu, et al.*2023 · 1,287 citations*
9. **[Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model](https://md.research.elamur.ai/free/en/papers/fabbri-2019-multi-news-large-scale-multi/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Alexander Fabbri, Irene Li, Tianwei She, et al.*2019 · 750 citations*
10. **[Efficient Content-Based Sparse Attention with Routing Transformers](https://md.research.elamur.ai/free/en/papers/roy-2020-efficient-content-based-sparse-attention/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Aurko Roy, Mohammad Saffar, Ashish Vaswani, et al.*2020 · 677 citations*
11. [**Reducing Transformer Depth on Demand with Structured Dropout arXiv:1909.11556**Angela Fan, Edouard Grave, Armand Joulin*2019 · 560 citations*](https://md.research.elamur.ai/free/en/papers/fan-2019-reducing-transformer-depth-demand-structured/)
12. [**Neural Text Generation with Unlikelihood Training arXiv:1908.04319**Sean Welleck, Ilia Kulikov, Stephen Roller, et al.*2019 · 513 citations*](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/)
13. **[Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space](https://md.research.elamur.ai/free/en/papers/geva-2022-transformer-feed-forward-layers-build/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Mor Geva, Avi Caciularu, Kevin Ro Wang, et al.*2022 · 346 citations*
14. [**Compressive Transformers for Long-Range Sequence Modelling arXiv:1911.05507**Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.*2019 · 340 citations*](https://md.research.elamur.ai/free/en/papers/rae-2019-compressive-transformers-long-range-sequence/)
15. [**Cloze-driven Pretraining of Self-attention Networks arXiv:1903.07785**Alexei Baevski, Sergey Edunov, Yinhan Liu, et al.*2019 · 286 citations*](https://md.research.elamur.ai/free/en/papers/baevski-2019-cloze-driven-pretraining-self-attention/)
16. **[Understanding the Difficulty of Training Transformers](https://md.research.elamur.ai/free/en/papers/liu-2020-understanding-difficulty-training-transformers/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Liyuan Liu, Xiaodong Liu, Jianfeng Gao, et al.*2020 · 231 citations*
17. **[Structured Pruning of Large Language Models](https://md.research.elamur.ai/free/en/papers/wang-2020-structured-pruning-large-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ziheng Wang, Jeremy Wohlwend, Tao Lei*2020 · 202 citations*
18. **[On The Evaluation of Machine Translation Systems Trained With Back-Translation](https://md.research.elamur.ai/free/en/papers/edunov-2020-evaluation-machine-translation-systems-trained/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, et al.*2020 · 140 citations*
19. **[Efficient Nearest Neighbor Language Models](https://md.research.elamur.ai/free/en/papers/he-2021-efficient-nearest-neighbor-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick*2021 · 130 citations*
20. [**A Systematic Evaluation of Large Language Models of Code arXiv:2202.13169**Frank F. Xu, Uri Alon, Graham Neubig, et al.*2022 · 125 citations*](https://md.research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/)
21. **[XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models](https://md.research.elamur.ai/free/en/papers/liang-2023-xlm-v-overcoming-vocabulary-bottleneck/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Davis Liang, Hila Gonen, Yuning Mao, et al.*2023 · 120 citations*
22. [**Efficient Large Scale Language Modeling with Mixtures of Experts arXiv:2112.10684**Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al.*2021 · 113 citations*](https://md.research.elamur.ai/free/en/papers/artetxe-2021-efficient-large-scale-language-modeling/)
23. [**Transformer Language Models without Positional Encodings Still Learn Positional Information arXiv:2203.16634**Adi Haviv, Ori Ram, Ofir Press, et al.*2022 · 111 citations*](https://md.research.elamur.ai/free/en/papers/haviv-2022-transformer-language-models-positional-encodings/)
24. [**Linear Transformers Are Secretly Fast Weight Programmers arXiv:2102.11174**Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber*2021 · 111 citations*](https://md.research.elamur.ai/free/en/papers/schlag-2021-linear-transformers-secretly-fast-weight/)
25. **[Simple and Effective Noisy Channel Modeling for Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/yee-2019-simple-effective-noisy-channel-modeling/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Kyra Yee, Yann Dauphin, Michael Auli*2019 · 104 citations*
26. [**Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens arXiv:2401.17377**Jiacheng Liu, Sewon Min, Luke Zettlemoyer, et al.*2024 · 62 citations*](https://md.research.elamur.ai/free/en/papers/liu-2024-infini-gram-scaling-unbounded-n/)
27. [**MiniMax-01: Scaling Foundation Models with Lightning Attention arXiv:2501.08313**MiniMax, Aonian Li, Bangwei Gong, et al.*2025 · 50 citations*](https://md.research.elamur.ai/free/en/papers/minimax-2025-minimax-01-scaling-foundation/)
28. [**ERNIE-Doc: A Retrospective Long-Document Modeling Transformer arXiv:2012.15688**Siyu Ding, Junyuan Shang, Shuohuan Wang, et al.*2020 · 27 citations*](https://md.research.elamur.ai/free/en/papers/ding-2020-ernie-doc-retrospective-long/)

101 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/) — Adaptive Input Representations for Neural Language Modeling