--- title: "Colin Raffel — papers of 2021 — 5 papers, the most cited first" description: "Colin Raffel — papers of 2021: 5 papers on Elamur Research, the most cited first — what each work is about in our own words." canonical: "https://research.elamur.ai/free/en/authors/colin-raffel/year/2021/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/colin-raffel/year/2021/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Colin Raffel](https://md.research.elamur.ai/free/en/authors/colin-raffel/) / 2021 # Colin Raffel — papers of 2021 — 5 papers, the most cited first 5 papers · [all years of Colin Raffel](https://md.research.elamur.ai/free/en/authors/colin-raffel/#years) **[mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer](https://md.research.elamur.ai/free/en/papers/xue-2021-mt5-massively-multilingual-pre-trained/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Linting Xue, Noah Constant, Adam Roberts, et al.*2021 · 3,226 citations* - [Multitask Prompted Training Enables Zero-Shot Task Generalization arXiv:2110.08207](https://md.research.elamur.ai/free/en/papers/sanh-2021-multitask-prompted-training-enables-zero/) — Victor Sanh, Albert Webson, Colin Raffel, et al. · 2021 · 1,612 citations **[Merging Models with Fisher-Weighted Averaging](https://md.research.elamur.ai/free/en/papers/matena-2021-merging-models-fisher-weighted-averaging/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Michael Matena, Colin Raffel*2021 · 208 citations* - [Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP arXiv:2112.10508](https://md.research.elamur.ai/free/en/papers/mielke-2021-between-words-characters-brief-history/) — Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky, et al. · 2021 · 191 citations **[Improving and Simplifying Pattern Exploiting Training](https://md.research.elamur.ai/free/en/papers/tam-2021-improving-simplifying-pattern-exploiting-training/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Derek Tam, Rakesh R. Menon, Mohit Bansal, et al.*2021 · 189 citations*