--- title: "Naman Goyal — papers of 2021 — 7 papers, the most cited first" description: "Naman Goyal — papers of 2021: 7 papers on Elamur Research, the most cited first — what each work is about in our own words." canonical: "https://research.elamur.ai/free/en/authors/naman-goyal/year/2021/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/naman-goyal/year/2021/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/) / 2021 # Naman Goyal — papers of 2021 — 7 papers, the most cited first 7 papers · [all years of Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/#years) **[Recipes for Building an Open-Domain Chatbot](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Stephen Roller, Emily Dinan, Naman Goyal, et al.*2021 · 1,214 citations* **[XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale](https://md.research.elamur.ai/free/en/papers/babu-2021-xls-r-self-supervised-cross/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Arun Babu, Changhan Wang, Andros Tjandra, et al.*2021 · 807 citations* - [Few-shot Learning with Multilingual Language Models arXiv:2112.10668](https://md.research.elamur.ai/free/en/papers/lin-2021-few-shot-learning-multilingual-language/) — Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al. · 2021 · 500 citations **[Multilingual Translation from Denoising Pre-Training](https://md.research.elamur.ai/free/en/papers/tang-2021-multilingual-translation-denoising-pre-training/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yuqing Tang, Chau Tran, Xian Li, et al.*2021 · 220 citations* - [BASE Layers: Simplifying Training of Large, Sparse Models arXiv:2103.16716](https://md.research.elamur.ai/free/en/papers/lewis-2021-base-layers-simplifying-training-large/) — Mike Lewis, Shruti Bhosale, Tim Dettmers, et al. · 2021 · 177 citations **[Larger-Scale Transformers for Multilingual Masked Language Modeling](https://md.research.elamur.ai/free/en/papers/goyal-2021-larger-scale-transformers-multilingual-masked/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Naman Goyal, Jingfei Du, Myle Ott, et al.*2021 · 161 citations* - [Efficient Large Scale Language Modeling with Mixtures of Experts arXiv:2112.10684](https://md.research.elamur.ai/free/en/papers/artetxe-2021-efficient-large-scale-language-modeling/) — Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al. · 2021 · 113 citations