---
title: "Sebastian Ruder — papers of 2021 — Elamur Research"
description: "Sebastian Ruder — papers of 2021: 7 papers on Elamur Research, the most cited first — what each work is about in our own words."
canonical: "https://research.elamur.ai/free/en/authors/sebastian-ruder/year/2021/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/sebastian-ruder/year/2021/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Sebastian Ruder](https://md.research.elamur.ai/free/en/authors/sebastian-ruder/) / 2021

# Sebastian Ruder — papers of 2021 — Elamur Research

7 papers · [all years of Sebastian Ruder](https://md.research.elamur.ai/free/en/authors/sebastian-ruder/#years)

**[How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.*2021 · 449 citations*

**[MasakhaNER: Named Entity Recognition for African Languages](https://md.research.elamur.ai/free/en/papers/adelani-2021-masakhaner-named-entity-recognition-african/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**David Ifeoluwa Adelani, Jade Abbott, Graham Neubig, et al.*2021 · 431 citations*

**[XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation](https://md.research.elamur.ai/free/en/papers/ruder-2021-xtreme-r-more-challenging-nuanced/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Sebastian Ruder, Noah Constant, Jan Botha, et al.*2021 · 281 citations*

**[Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks](https://md.research.elamur.ai/free/en/papers/mahabadi-2021-parameter-efficient-multi-task-fine/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, et al.*2021 · 258 citations*

- [Charformer: Fast Character Transformers via Gradient-based Subword Tokenization arXiv:2106.12672](https://md.research.elamur.ai/free/en/papers/tay-2021-charformer-fast-character-transformers-gradient/) — Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al. · 2021 · 186 citations

**[UNKs Everywhere: Adapting Multilingual Language Models to New Scripts](https://md.research.elamur.ai/free/en/papers/pfeiffer-2021-unks-everywhere-adapting-multilingual-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*2021 · 176 citations*

**[MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer](https://md.research.elamur.ai/free/en/papers/ansell-2021-mad-g-multilingual-adapter-generation/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, et al.*2021 · 130 citations*