--- title: "Neil Houlsby — author profile and papers — Elamur Research" description: "Neil Houlsby: 3 papers on Elamur Research (2020–2022), h-index 37 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/neil-houlsby/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/neil-houlsby/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Neil Houlsby # Neil Houlsby Neil Houlsby has 3 papers in our library, in 2020–2022; often with [Basil Mustafa](https://md.research.elamur.ai/free/en/authors/basil-mustafa/), [Joan Puigcerver](https://md.research.elamur.ai/free/en/authors/joan-puigcerver/), [Mostafa Dehghani](https://md.research.elamur.ai/free/en/authors/mostafa-dehghani/). 3 papers in our library · 2020–2022 [OpenAlex](https://openalex.org/A5068878643) · [**h-index 37**](https://openalex.org/authors/A5068878643) · [89 works](https://openalex.org/works?filter=author.id:A5068878643) · [30,402 citations](https://openalex.org/works?filter=author.id:A5068878643&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 3 works in our library](https://md.research.elamur.ai/free/en/authors/neil-houlsby/#papers) · [🔗 Cited 7,255 times in our library](https://md.research.elamur.ai/free/en/authors/neil-houlsby/cited-by/) · [6 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #100](https://md.research.elamur.ai/free/en/paper-stars/#star-100) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Neil+Houlsby) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Neil+Houlsby) · [dblp](https://dblp.org/search?q=Neil+Houlsby) · [ACL Anthology](https://aclanthology.org/search/?q=Neil+Houlsby) ## Affiliations [🏢**Google** Mountain View · United States 2018–2024 · 35 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**University of Cambridge** Cambridge · United Kingdom 2012–2021 · 13 papers](https://md.research.elamur.ai/free/en/universities/university-of-cambridge/) · [🏢**Google** Zurich · Switzerland 2015–2022 · 5 papers](https://md.research.elamur.ai/free/en/companies/google-switzerland/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Computer Science · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 💡 Concepts 1 Key ideas and methods explained on our concept pages.[Transformer and attention · 1 work](https://md.research.elamur.ai/free/en/concepts/transformer/) ## Works by year ### 2020s [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/neil-houlsby/year/2022/) · [**2021** 1 paper](https://md.research.elamur.ai/free/en/authors/neil-houlsby/year/2021/) · [**2020** 1 paper](https://md.research.elamur.ai/free/en/authors/neil-houlsby/year/2020/) ## Papers The most cited first (OpenAlex and our library). 1. **[An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/)** *(2020 · 23,726 citations)* In 2020, image recognition still relied mainly on convolutional networks. Earlier efforts to use self-attention in vision either kept a CNN backbone or used custom attention patterns that ran slowly on modern accelerators. The authors ask whether an almost unchanged NLP-style Transformer encoder can classify images… 2. **[Scaling Vision with Sparse Mixture of Experts](https://md.research.elamur.ai/free/en/papers/riquelme-2021-scaling-vision-sparse-mixture-experts/)** *(2021 · 128 citations)* Large vision networks are usually dense: each parameter touches every input, so growing capacity drives up compute. 3. **[Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints](https://md.research.elamur.ai/free/en/papers/komatsuzaki-2022-sparse-upcycling-training-mixture-experts/)** *(2022 · 98 citations)* Training large neural networks from random initialization is very expensive, so most practitioners keep reusing a small set of dense models. ## All works 9 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them. 1. [**An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale arXiv:2010.11929**Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.*2020 · 23,726 citations*](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/) 2. **[MLP-Mixer: An all-MLP Architecture for Vision ↗](https://arxiv.org/abs/2105.01601) arXiv (Cornell University) · no summary yet**Ilya Tolstikhin et al.*2021 · 1,513 citations* 3. **[Scaling Vision Transformers ↗](https://doi.org/10.1109/cvpr52688.2022.01179) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Xiaohua Zhai et al.*2022 · 1,005 citations* 4. **[Self-Supervised GANs via Auxiliary Rotation Loss ↗](https://doi.org/10.1109/cvpr.2019.01243) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Ting Chen et al.*2019 · 320 citations* 5. **[Scaling Vision Transformers to 22 Billion Parameters ↗](https://arxiv.org/abs/2302.05442) arXiv:2302.05442 · no summary yet**Mostafa Dehghani et al.*2023 · 217 citations* 6. [**Scaling Vision with Sparse Mixture of Experts arXiv:2106.05974**Carlos Riquelme, Joan Puigcerver, Basil Mustafa, et al.*2021 · 128 citations*](https://md.research.elamur.ai/free/en/papers/riquelme-2021-scaling-vision-sparse-mixture-experts/) 7. [**Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints arXiv:2212.05055**Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, et al.*2022 · 98 citations*](https://md.research.elamur.ai/free/en/papers/komatsuzaki-2022-sparse-upcycling-training-mixture-experts/) 8. **[The Benchmark Lottery ↗](https://arxiv.org/abs/2107.07002) arXiv:2107.07002 · no summary yet**Mostafa Dehghani et al.*2021 · 50 citations* 9. **[A Filtering Approach to Stochastic Variational Inference ↗](https://openalex.org/W2124450745) no summary yet**Neil Houlsby, David M. Blei*2015 · 3 citations* ## Co-authors here 12 of 18 co-authors with a page, the most papers together first. - [Basil Mustafa](https://md.research.elamur.ai/free/en/authors/basil-mustafa/) ×2 - [Joan Puigcerver](https://md.research.elamur.ai/free/en/authors/joan-puigcerver/) ×2 - [Mostafa Dehghani](https://md.research.elamur.ai/free/en/authors/mostafa-dehghani/) ×2 - [Alexander Kolesnikov](https://md.research.elamur.ai/free/en/authors/alexander-kolesnikov/) - [Andre Susano Pinto](https://md.research.elamur.ai/free/en/authors/andre-susano-pinto/) - [Aran Komatsuzaki](https://md.research.elamur.ai/free/en/authors/aran-komatsuzaki/) - [Carlos Riquelme](https://md.research.elamur.ai/free/en/authors/carlos-riquelme/) - [Daniel Keysers](https://md.research.elamur.ai/free/en/authors/daniel-keysers/) - [Dirk Weissenborn](https://md.research.elamur.ai/free/en/authors/dirk-weissenborn/) - [Georg Heigold](https://md.research.elamur.ai/free/en/authors/georg-heigold/) - [Jakob Uszkoreit](https://md.research.elamur.ai/free/en/authors/jakob-uszkoreit/) - [James Lee-Thorp](https://md.research.elamur.ai/free/en/authors/james-lee-thorp/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×2 ## Cited by Papers of our library cite their works 7,255 times (of the 149,439 papers whose bibliographies we read); [1,136 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/neil-houlsby/cited-by/). Updated 2 November 2026