---
title: "Naman Goyal — all works — Elamur Research"
description: "All 27 works of Naman Goyal in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/naman-goyal/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/naman-goyal/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/) / all works

# Naman Goyal — all works

27 works · [← Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/)

1. **[BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mike Lewis, Yinhan Liu, Naman Goyal, et al.*2020 · 12,856 citations*
2. [**RoBERTa: A Robustly Optimized BERT Pretraining Approach arXiv:1907.11692**Yinhan Liu, Myle Ott, Naman Goyal, et al.*2019 · 9,837 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/)
3. [**LLaMA: Open and Efficient Foundation Language Models arXiv:2302.13971**Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.*2023 · 9,603 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
4. **[Unsupervised Cross-lingual Representation Learning at Scale ↗](https://aclanthology.org/2020.acl-main.747/) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yet**Alexis Conneau et al.*2020 · 9,468 citations*
5. [**Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks arXiv:2005.11401**Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.*2020 · 6,256 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/)
6. **[Multilingual Denoising Pre-training for Neural Machine Translation ↗](https://aclanthology.org/2020.tacl-1.47/) Transactions of the Association for Computational Linguistics · no summary yet**Yinhan Liu et al.*2020 · 2,616 citations*
7. [**OPT: Open Pre-trained Transformer Language Models arXiv:2205.01068**Susan Zhang, Stephen Roller, Naman Goyal, et al.*2022 · 1,755 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
8. **[Recipes for Building an Open-Domain Chatbot](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Stephen Roller, Emily Dinan, Naman Goyal, et al.*2021 · 1,214 citations*
9. **[XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale](https://md.research.elamur.ai/free/en/papers/babu-2021-xls-r-self-supervised-cross/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Arun Babu, Changhan Wang, Andros Tjandra, et al.*2021 · 807 citations*
10. **[The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation ↗](https://aclanthology.org/2022.tacl-1.30/) Transactions of the Association for Computational Linguistics · no summary yet**Naman Goyal et al.*2022 · 770 citations*
11. [**Few-shot Learning with Multilingual Language Models arXiv:2112.10668**Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al.*2021 · 500 citations*](https://md.research.elamur.ai/free/en/papers/lin-2021-few-shot-learning-multilingual-language/)
12. **[The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants](https://md.research.elamur.ai/free/en/papers/bandarkar-2023-belebele-benchmark-parallel-reading-comprehension/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.*2023 · 262 citations*
13. **[Multilingual Translation from Denoising Pre-Training](https://md.research.elamur.ai/free/en/papers/tang-2021-multilingual-translation-denoising-pre-training/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yuqing Tang, Chau Tran, Xian Li, et al.*2021 · 220 citations*
14. **[BASE Layers: Simplifying Training of Large, Sparse Models ↗](https://arxiv.org/abs/2103.16716) arXiv:2103.16716 · no summary yet**Mike Lewis et al.*2021 · 177 citations*
15. **[Lifting the Curse of Multilinguality by Pre-training Modular Transformers](https://md.research.elamur.ai/free/en/papers/pfeiffer-2022-lifting-curse-multilinguality-pre-training/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, et al.*2022 · 174 citations*
16. **[Larger-Scale Transformers for Multilingual Masked Language Modeling](https://md.research.elamur.ai/free/en/papers/goyal-2021-larger-scale-transformers-multilingual-masked/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Naman Goyal, Jingfei Du, Myle Ott, et al.*2021 · 161 citations*
17. **[Multilingual Autoregressive Entity Linking ↗](https://aclanthology.org/2022.tacl-1.16/) Transactions of the Association for Computational Linguistics · no summary yet**Nicola De Cao et al.*2022 · 153 citations*
18. **[Few-shot Learning with Multilingual Generative Language Models ↗](https://aclanthology.org/2022.emnlp-main.616/) Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yet**Xi Victoria Lin et al.*2022 · 133 citations*
19. **[XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models](https://md.research.elamur.ai/free/en/papers/liang-2023-xlm-v-overcoming-vocabulary-bottleneck/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Davis Liang, Hila Gonen, Yuning Mao, et al.*2023 · 120 citations*
20. **[Efficient Large Scale Language Modeling with Mixtures of Experts ↗](https://arxiv.org/abs/2112.10684) arXiv:2112.10684 · no summary yet**Mikel Artetxe et al.*2021 · 113 citations*
21. **[Better Fine-Tuning by Reducing Representational Collapse ↗](https://arxiv.org/abs/2008.03156) arXiv (Cornell University) · no summary yet**Armen Aghajanyan et al.*2020 · 109 citations*
22. **[CM3: A Causal Masked Multimodal Model of the Internet ↗](https://arxiv.org/abs/2201.07520) arXiv (Cornell University) · no summary yet**Armen Aghajanyan et al.*2022 · 104 citations*
23. **[Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment](https://md.research.elamur.ai/free/en/papers/koehn-2020-findings-wmt-2020-shared-task/) [Conference on Machine Translation (WMT)](https://md.research.elamur.ai/free/en/venues/wmt/)**Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, et al.*2020 · 101 citations*
24. [**Scaling Laws for Generative Mixed-Modal Language Models arXiv:2301.03728**Armen Aghajanyan, Lili Yu, Alexis Conneau, et al.*2023 · 45 citations*](https://md.research.elamur.ai/free/en/papers/aghajanyan-2023-scaling-laws-generative-mixed-modal/)
25. **[How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training? ↗](https://aclanthology.org/2022.amta-research.8/) Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track) · no summary yet**Shiyue Zhang et al.*2022 · 25 citations*
26. **[On the Role of Bidirectionality in Language Model Pre-Training ↗](https://aclanthology.org/2022.findings-emnlp.293/) Findings of the Association for Computational Linguistics: EMNLP 2022 · no summary yet**Mikel Artetxe et al.*2022 · 17 citations*
27. **[A Theory on Adam Instability in Large-Scale Machine Learning ↗](https://arxiv.org/abs/2304.09871) arXiv:2304.09871 · no summary yet**Igor Molybog et al.*2023 · 15 citations*