--- title: "Orion Weller — author profile and papers — Elamur Research" description: "Orion Weller, Johns Hopkins University: 4 papers on Elamur Research (2019–2025), h-index 13 — affiliations, topics, co-authors and who…" canonical: "https://research.elamur.ai/free/en/authors/orion-weller/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/orion-weller/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Orion Weller # Orion Weller Orion Weller has 4 papers in our library, in 2019–2025, most of them on [Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/), [Efficient models & compression](https://md.research.elamur.ai/free/en/topics/efficient-models/); often with [Antoine Chaffin](https://md.research.elamur.ai/free/en/authors/antoine-chaffin/), [Benjamin Van Durme](https://md.research.elamur.ai/free/en/authors/benjamin-van-durme/), [Faisal Ladhak](https://md.research.elamur.ai/free/en/authors/faisal-ladhak/). 4 papers in our library · 2019–2025 [OpenAlex](https://openalex.org/A5056096860) · [ORCID](https://orcid.org/0000-0003-4148-5430) · [Wikidata](https://www.wikidata.org/wiki/Q130935612) · [**h-index 13**](https://openalex.org/authors/A5056096860) · [74 works](https://openalex.org/works?filter=author.id:A5056096860) · [736 citations](https://openalex.org/works?filter=author.id:A5056096860&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 4 works in our library](https://md.research.elamur.ai/free/en/authors/orion-weller/#papers) · [🔗 Cited 884 times in our library](https://md.research.elamur.ai/free/en/authors/orion-weller/cited-by/) · [6 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #2791](https://md.research.elamur.ai/free/en/paper-stars/page/28/#star-2791) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Orion+Weller) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Orion+Weller) · [dblp](https://dblp.org/search?q=Orion+Weller) · [ACL Anthology](https://aclanthology.org/search/?q=Orion+Weller) ## Affiliations [🎓**Johns Hopkins University** Baltimore · United States 2021–2026 · 45 papers*current*](https://md.research.elamur.ai/free/en/universities/johns-hopkins-university/) · [🎓**Brigham Young University** Provo · United States 2019–2022 · 10 papers](https://md.research.elamur.ai/free/en/universities/brigham-young-university/) · [🔬**Allen Institute for Artificial Intelligence** Seattle · United States 2024 · 4 papers](https://md.research.elamur.ai/free/en/labs/allen-institute-for-artificial-intelligence/) · [🎓**University of Glasgow** Glasgow · United Kingdom 2024–2025 · 3 papers](https://md.research.elamur.ai/free/en/universities/university-of-glasgow/) · [🎓**Yale University** New Haven · United States 2024–2025 · 3 papers](https://md.research.elamur.ai/free/en/universities/yale-university/) · [🎓**University of Arizona** Tucson · United States 2024 · 3 papers](https://md.research.elamur.ai/free/en/universities/university-of-arizona/) · [🎓**Institut Polytechnique de Paris** Palaiseau · France 2024–2025 · 2 papers](https://md.research.elamur.ai/free/en/universities/institut-polytechnique-de-paris/) · [🎓**Télécom Paris** Palaiseau · France 2024–2025 · 2 papers](https://md.research.elamur.ai/free/en/universities/telecom-paris/) · [🎓**University of Maryland, College Park** College Park · United States 2023–2024 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-maryland-college-park/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Concepts, shelves and topics Of its works in our library: the number of works on each and its rating among them. 📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · [Psychology · 1 work](https://md.research.elamur.ai/free/en/shelves/psychology/) · [Social Psychology · 1 work](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) 🧭 Topics 2 Research subjects and languages the work is about.[Efficient models & compression · 1 work](https://md.research.elamur.ai/free/en/topics/efficient-models/) · [Multilingual & cross-lingual NLP · 1 work](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) ## Works by year ### 2020s [**2025** 1 paper mmBERT: A Modern Multilingual Encoder with Annealed Language Learning](https://md.research.elamur.ai/free/en/papers/marone-2025-mmbert-modern-multilingual-encoder-annealed/) · [**2024** 1 paper Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/) · [**2020** 1 paper Learning from Task Descriptions](https://md.research.elamur.ai/free/en/papers/weller-2020-learning-task-descriptions/) ### 2010s [**2019** 1 paper Humor Detection: A Transformer Gets the Last Laugh](https://md.research.elamur.ai/free/en/papers/weller-2019-humor-detection-transformer-gets-last/) ## Papers The most cited first (OpenAlex and our library). 1. **[Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/)** *(2024 · 355 citations)* BERT-style encoders still power many retrieval, classification and RAG pipelines, yet most deployments rely on old models. 2. **[Humor Detection: A Transformer Gets the Last Laugh](https://md.research.elamur.ai/free/en/papers/weller-2019-humor-detection-transformer-gets-last/)** *(2019 · 165 citations)* The paper moves past simply spotting jokes in text and asks a harder question: can a model predict whether a joke will actually be judged funny? The authors build a rated-joke dataset by repeatedly scraping Reddit's r/Jokes forum and updating upvote counts. 3. **[Learning from Task Descriptions](https://md.research.elamur.ai/free/en/papers/weller-2020-learning-task-descriptions/)** *(2020 · 111 citations)* Most NLP systems learn a new task only after seeing thousands of labeled examples. Humans can often do the same task just by reading instructions. The authors propose "learning from task descriptions" as a general framework for this. A model receives both an input and a natural-language description of the task, and… 4. **[mmBERT: A Modern Multilingual Encoder with Annealed Language Learning](https://md.research.elamur.ai/free/en/papers/marone-2025-mmbert-modern-multilingual-encoder-annealed/)** *(2025 · 59 citations)* Multilingual encoder-only models have seen little progress in recent years, and XLM-R remains the default choice despite being more than six years old. ## All works 10 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them. 1. [**Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference**Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.*arXiv:2412.13663 · 355 citations*](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/) 2. **[Humor Detection: A Transformer Gets the Last Laugh](https://md.research.elamur.ai/free/en/papers/weller-2019-humor-detection-transformer-gets-last/)**Orion Weller, Kevin Seppi*[Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/) · 165 citations* 3. **[Learning from Task Descriptions](https://md.research.elamur.ai/free/en/papers/weller-2020-learning-task-descriptions/)**Orion Weller, Nicholas Lourie, Matt Gardner, et al.*[Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/) · 111 citations* 4. [**mmBERT: A Modern Multilingual Encoder with Annealed Language Learning**Marc Marone, Orion Weller, William Fleshman, et al.*arXiv:2509.06888 · 59 citations*](https://md.research.elamur.ai/free/en/papers/marone-2025-mmbert-modern-multilingual-encoder-annealed/) 5. **[“According to . . . “: Prompting Language Models Improves Quoting from Pre-Training Data](https://aclanthology.org/2024.eacl-long.140/) · original ↗ · no summary yet · Proceedings of the 18th Conference of the European Chapter of the Association…**Orion Weller et al.*2024 · 44 citations* 6. **[FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions](https://aclanthology.org/2025.naacl-long.597/) · original ↗ · no summary yet · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of…**Orion Weller et al.*2025 · 39 citations* 7. **[CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation](https://aclanthology.org/2025.findings-naacl.441/) · original ↗ · no summary yet · Findings of the Association for Computational Linguistics: NAACL 2025**Abe Bohan Hou et al.*2025 · 28 citations* 8. **[Can Humor Prediction Datasets be used for Humor Generation? Humorous Headline Generation via Style Transfer](https://aclanthology.org/2020.figlang-1.25/) · original ↗ · no summary yet · Proceedings of the Second Workshop on Figurative Language Processing**Orion Weller, Nancy Fulda, Kevin Seppi*2020 · 23 citations* 9. **[CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation](https://arxiv.org/abs/2406.17186) · original ↗ · no summary yet · arXiv:2406.17186**Abe Bohan Hou et al.*2024 · 21 citations* 10. **[Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic](https://aclanthology.org/2024.emnlp-main.531/) · original ↗ · no summary yet · Proceedings of the 2024 Conference on Empirical Methods in Natural Language…**Nathaniel Weir et al.*2024 · 7 citations* ## Co-authors here 7 co-authors with a page, the most papers together first. - [Antoine Chaffin](https://md.research.elamur.ai/free/en/authors/antoine-chaffin/) - [Benjamin Van Durme](https://md.research.elamur.ai/free/en/authors/benjamin-van-durme/) - [Faisal Ladhak](https://md.research.elamur.ai/free/en/authors/faisal-ladhak/) - [Kevin Seppi](https://md.research.elamur.ai/free/en/authors/kevin-seppi/) - [Matt Gardner](https://md.research.elamur.ai/free/en/authors/matt-gardner/) - [Matthew Peters](https://md.research.elamur.ai/free/en/authors/matthew-peters/) - [Nicholas Lourie](https://md.research.elamur.ai/free/en/authors/nicholas-lourie/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/) ×3: [EMNLP 2020](https://md.research.elamur.ai/free/en/venues/emnlp/2020/), [EMNLP 2019](https://md.research.elamur.ai/free/en/venues/emnlp/2019/) - [Nature](https://md.research.elamur.ai/free/en/venues/nature/) - Findings of the Association for Computational Linguistics… - Proceedings of the 18th Conference of the European Chapter… - Proceedings of the 2025 Conference of the Nations of the… - Proceedings of the Second Workshop on Figurative Language… ## Cited by Papers of our library cite their works 884 times (of the 141,840 papers whose bibliographies we read); [60 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/orion-weller/cited-by/). Updated 24 October 2026