---
title: "Sebastian Ruder — all works — Elamur Research"
description: "All 46 works of Sebastian Ruder in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/sebastian-ruder/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/sebastian-ruder/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Sebastian Ruder](https://md.research.elamur.ai/free/en/authors/sebastian-ruder/) / all works

# Sebastian Ruder — all works

46 works · [← Sebastian Ruder](https://md.research.elamur.ai/free/en/authors/sebastian-ruder/)

1. **[Universal Language Model Fine-tuning for Text Classification ↗](https://aclanthology.org/P18-1031/) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Jeremy Howard, Sebastian Ruder*2018 · 4,841 citations*
2. [**An Overview of Multi-Task Learning in Deep Neural Networks arXiv:1706.05098**Sebastian Ruder*2017 · 2,520 citations*](https://md.research.elamur.ai/free/en/papers/ruder-2017-overview-multi-task-learning-deep/)
3. **[On the Cross-lingual Transferability of Monolingual Representations](https://md.research.elamur.ai/free/en/papers/artetxe-2020-cross-lingual-transferability-monolingual-representations/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mikel Artetxe, Sebastian Ruder, Dani Yogatama*2020 · 1,179 citations*
4. **[MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-mad-x-adapter-based-framework/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*2020 · 839 citations*
5. **[AdapterHub: A Framework for Adapting Transformers](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-adapterhub-framework-adapting-transformers/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.*2020 · 754 citations*
6. **[XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ↗](https://openalex.org/W3035579820) International Conference on Machine Learning · no summary yet**Junjie Hu et al.*2020 · 726 citations*
7. **[Transfer Learning in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/ruder-2019-transfer-learning-natural-language-processing/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.*2019 · 708 citations*
8. [**XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization arXiv:2003.11080**Junjie Hu, Sebastian Ruder, Aditya Siddhant, et al.*2020 · 558 citations*](https://md.research.elamur.ai/free/en/papers/hu-2020-xtreme-massively-multilingual-multi-task/)
9. **[To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks](https://md.research.elamur.ai/free/en/papers/peters-2019-tune-tune-adapting-pretrained-representations/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Matthew E. Peters, Sebastian Ruder, Noah A. Smith*2019 · 522 citations*
10. [**Language Models are Multilingual Chain-of-Thought Reasoners arXiv:2210.03057**Freda Shi, Mirac Suzgun, Markus Freitag, et al.*2022 · 494 citations*](https://md.research.elamur.ai/free/en/papers/shi-2022-language-models-multilingual-chain-thought/)
11. **[How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.*2021 · 449 citations*
12. **[MasakhaNER: Named Entity Recognition for African Languages](https://md.research.elamur.ai/free/en/papers/adelani-2021-masakhaner-named-entity-recognition-african/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**David Ifeoluwa Adelani, Jade Abbott, Graham Neubig, et al.*2021 · 431 citations*
13. [**Long Range Arena: A Benchmark for Efficient Transformers arXiv:2011.04006**Yi Tay, Mostafa Dehghani, Samira Abnar, et al.*2020 · 414 citations*](https://md.research.elamur.ai/free/en/papers/tay-2020-long-range-arena-benchmark-efficient/)
14. **[On the Limitations of Unsupervised Bilingual Dictionary Induction](https://md.research.elamur.ai/free/en/papers/sogaard-2018-limitations-unsupervised-bilingual-dictionary-induction/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Anders Søgaard, Sebastian Ruder, Ivan Vulić*2018 · 401 citations*
15. **[A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis ↗](https://aclanthology.org/D16-1103/) Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yet**Sebastian Ruder, Parsa Ghaffari, John G. Breslin*2016 · 335 citations*
16. **[XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation](https://md.research.elamur.ai/free/en/papers/ruder-2021-xtreme-r-more-challenging-nuanced/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Sebastian Ruder, Noah Constant, Jan Botha, et al.*2021 · 281 citations*
17. **[How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions ↗](https://doi.org/10.18653/v1/p19-1070) ACL 2019 (Florence) · no summary yet**Goran Glavas et al.*2019 · 277 citations*
18. **[Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks](https://md.research.elamur.ai/free/en/papers/mahabadi-2021-parameter-efficient-multi-task-fine/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, et al.*2021 · 258 citations*
19. **[Strong Baselines for Neural Semi-Supervised Learning under Domain Shift](https://md.research.elamur.ai/free/en/papers/ruder-2018-strong-baselines-neural-semi-supervised/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Sebastian Ruder, Barbara Plank*2018 · 229 citations*
20. [**Charformer: Fast Character Transformers via Gradient-based Subword Tokenization arXiv:2106.12672**Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.*2021 · 186 citations*](https://md.research.elamur.ai/free/en/papers/tay-2021-charformer-fast-character-transformers-gradient/)
21. **[UNKs Everywhere: Adapting Multilingual Language Models to New Scripts](https://md.research.elamur.ai/free/en/papers/pfeiffer-2021-unks-everywhere-adapting-multilingual-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*2021 · 176 citations*
22. **[MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition](https://md.research.elamur.ai/free/en/papers/adelani-2022-masakhaner-2-0-africa-centric/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, et al.*2022 · 151 citations*
23. **[IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation ↗](https://aclanthology.org/2021.emnlp-main.699/) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yet**Samuel Cahyawijaya et al.*2021 · 150 citations*
24. **[One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia ↗](https://aclanthology.org/2022.acl-long.500/) Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Alham Fikri Aji et al.*2022 · 146 citations*
25. **[AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages](https://md.research.elamur.ai/free/en/papers/muhammad-2023-afrisenti-twitter-sentiment-analysis-benchmark/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, et al.*2023 · 143 citations*
26. [**Rethinking embedding coupling in pre-trained language models arXiv:2010.12821**Hyung Won Chung, Thibault Févry, Henry Tsai, et al.*2020 · 142 citations*](https://md.research.elamur.ai/free/en/papers/chung-2020-rethinking-embedding-coupling-pre-trained/)
27. **[MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer](https://md.research.elamur.ai/free/en/papers/ansell-2021-mad-g-multilingual-adapter-generation/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, et al.*2021 · 130 citations*
28. **[MultiFiT: Efficient Multi-lingual Language Model Fine-tuning ↗](https://aclanthology.org/D19-1572/) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yet**Julian Eisenschlos et al.*2019 · 130 citations*
29. **[NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/muhammad-2022-naijasenti-nigerian-twitter-sentiment-corpus/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.*2022 · 127 citations*
30. **[INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis ↗](https://aclanthology.org/S16-1053/) Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · no summary yet**Sebastian Ruder, Parsa Ghaffari, John G. Breslin*2016 · 127 citations*
31. **[Unsupervised Cross-Lingual Representation Learning ↗](https://aclanthology.org/P19-4007/) Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts · no summary yet**Sebastian Ruder, Anders Søgaard, Ivan Vulić*2019 · 108 citations*
32. **[A Call for More Rigor in Unsupervised Cross-lingual Learning ↗](https://aclanthology.org/2020.acl-main.658/) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yet**Mikel Artetxe et al.*2020 · 104 citations*
33. **[Learning to select data for transfer learning with Bayesian Optimization](https://md.research.elamur.ai/free/en/papers/ruder-2017-learning-select-data-transfer-learning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Sebastian Ruder, Barbara Plank*2017 · 97 citations*
34. **[NusaCrowd: Open Source Initiative for Indonesian NLP Resources ↗](https://aclanthology.org/2023.findings-acl.868/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Samuel Cahyawijaya et al.*2023 · 95 citations*
35. **[BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer](https://md.research.elamur.ai/free/en/papers/asai-2024-buffet-benchmarking-large-language-models/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Akari Asai, Sneha Kudugunta, Xinyan Yu, et al.*2024 · 86 citations*
36. **[Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation](https://md.research.elamur.ai/free/en/papers/wang-2022-expanding-pretrained-models-thousands-more/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Xinyi Wang, Sebastian Ruder, Graham Neubig*2022 · 73 citations*
37. **[Multi-view Subword Regularization ↗](https://aclanthology.org/2021.naacl-main.40/) Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Xinyi Wang, Sebastian Ruder, Graham Neubig*2021 · 72 citations*
38. **[Understanding and Mitigating Language Confusion in LLMs](https://md.research.elamur.ai/free/en/papers/marchisio-2024-understanding-mitigating-language-confusion-llms/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, et al.*2024 · 57 citations*
39. **[QAmeleon: Multilingual QA with Only 5 Examples](https://md.research.elamur.ai/free/en/papers/agrawal-2023-qameleon-multilingual-qa-only-5/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Priyanka Agrawal, Chris Alberti, Fantine Huot, et al.*2023 · 45 citations*
40. **[Efficient Test Time Adapter Ensembling for Low-resource Language Varieties ↗](https://aclanthology.org/2021.findings-emnlp.63/) Findings of the Association for Computational Linguistics: EMNLP 2021 · no summary yet**Xinyi Wang et al.*2021 · 45 citations*
41. **[FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding ↗](https://aclanthology.org/2022.acl-long.38/) Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Yanan Zheng et al.*2022 · 34 citations*
42. **[M-RewardBench: Evaluating Reward Models in Multilingual Settings](https://md.research.elamur.ai/free/en/papers/gureja-2025-m-rewardbench-evaluating-reward-models/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Srishti Gureja, Lester James V. Miranda, Shayekh Bin Islam, et al.*2025 · 28 citations*
43. **[XTREME-S: Evaluating Cross-lingual Speech Representations ↗](https://doi.org/10.21437/interspeech.2022-10007) Interspeech (USB) · no summary yet**Alexis Conneau et al.*2022 · 28 citations*
44. **[AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic](https://md.research.elamur.ai/free/en/papers/robinson-2025-al-qasida-analyzing-llm-quality/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Nathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, et al.*2025 · 14 citations*
45. **[The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs](https://md.research.elamur.ai/free/en/papers/nawrot-2026-sparse-frontier-sparse-attention-trade/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Piotr Nawrot, Jianing Li, Renjie Huang, et al.*2026 · 10 citations*
46. **[Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL](https://md.research.elamur.ai/free/en/papers/wu-2026-parallel-sft-improving-zero-shot/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhaofeng Wu, Shiqi Wang, Boya Peng, et al.*2026*