--- title: "Torsten Hoefler · Microsoft — author profile and papers" description: "Torsten Hoefler, Microsoft: 2 papers on Elamur Research (2018–2024), h-index 59 — affiliations, topics, co-authors and who cites them in our…" canonical: "https://research.elamur.ai/free/en/authors/torsten-hoefler/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/torsten-hoefler/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Torsten Hoefler # Torsten Hoefler Torsten Hoefler has 2 papers in our library, in 2018–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Amirkeivan Mohtashami](https://md.research.elamur.ai/free/en/authors/amirkeivan-mohtashami/), [Bo Li](https://md.research.elamur.ai/free/en/authors/bo-li/), [Dan Alistarh](https://md.research.elamur.ai/free/en/authors/dan-alistarh/). 2 papers in our library · 2018–2024 [OpenAlex](https://openalex.org/A5026990786) · [ORCID](https://orcid.org/0000-0002-1333-9797) · [**h-index 59**](https://openalex.org/authors/A5026990786) · [606 works](https://openalex.org/works?filter=author.id:A5026990786) · [13,606 citations](https://openalex.org/works?filter=author.id:A5026990786&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/torsten-hoefler/#papers) · [🔗 Cited 829 times in our library](https://md.research.elamur.ai/free/en/authors/torsten-hoefler/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4124](https://md.research.elamur.ai/free/en/paper-stars/page/42/#star-4124) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Torsten+Hoefler) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Torsten+Hoefler) · [dblp](https://dblp.org/search?q=Torsten+Hoefler) · [ACL Anthology](https://aclanthology.org/search/?q=Torsten+Hoefler) ## Affiliations [🎓**ETH Zurich** Zurich · Switzerland 2012–2026 · 490 papers*current*](https://md.research.elamur.ai/free/en/universities/eth-zurich/) · [🏢**Microsoft** Redmond · United States 2022–2026 · 13 papers*current*](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🔬**CSCS - Swiss National Supercomputing Centre** Lugano 2024–2026 · 5 papers*current*](https://ror.org/04rzmms09) · [🎓**Institute of Science and Technology Austria** Klosterneuburg · Austria 2020–2026 · 2 papers*current*](https://md.research.elamur.ai/free/en/universities/institute-of-science-and-technology-austria/) · [🎓**University of Illinois Urbana-Champaign** Urbana · United States 2010–2017 · 44 papers](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) · [🎓**Indiana University** Bloomington · United States 2006–2010 · 34 papers](https://md.research.elamur.ai/free/en/universities/indiana-university/) · [🎓**Indiana University Bloomington** Bloomington · United States 2006–2010 · 32 papers](https://md.research.elamur.ai/free/en/universities/indiana-university-bloomington/) · [🎓**Chemnitz University of Technology** Chemnitz · Germany 2005–2008 · 21 papers](https://ror.org/00a208s56) · [🔬**National Center for Supercomputing Applications** Urbana · United States 2010–2012 · 9 papers](https://ror.org/03r10zj06) · [🔬**Lawrence Livermore National Laboratory** Livermore · United States 2012–2016 · 3 papers](https://md.research.elamur.ai/free/en/labs/lawrence-livermore-national-laboratory/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 10 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 8 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Hardware and Architecture · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/hardware-and-architecture/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Engineering · 1 work](https://md.research.elamur.ai/free/en/shelves/engineering/) · [Electrical and Electronic Engineering · 1 work](https://md.research.elamur.ai/free/en/shelves/engineering/electrical-and-electronic-engineering/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/torsten-hoefler/year/2024/) ### 2010s [**2018** 1 paper](https://md.research.elamur.ai/free/en/authors/torsten-hoefler/year/2018/) ## Papers The most cited first (OpenAlex and our library). 1. **[Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis](https://md.research.elamur.ai/free/en/papers/nun-2018-demystifying-parallel-distributed-deep-learning/)** *(2018 · 275 citations)* Training modern deep neural networks has become so computationally heavy that it effectively requires high-performance clusters. 2. **[QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs](https://md.research.elamur.ai/free/en/papers/ashkboos-2024-quarot-outlier-free-4-bit/)** *(2024 · 254 citations)* Quantizing large language models to 4 bits is hard because activations contain outliers: individual channels whose values are many times larger than the rest. ## All works 4 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Graph of Thoughts: Solving Elaborate Problems with Large Language Models ↗](https://doi.org/10.1609/aaai.v38i16.29720) arXiv:2308.09687 · Proceedings of the AAAI Conference on Artificial Intelligence 2024 (AAAI'24) · no summary yet**Maciej Besta et al.*2023 · 1,025 citations* 2. **[Demystifying Parallel and Distributed Deep Learning ↗](https://doi.org/10.1145/3320060) ACM Computing Surveys · no summary yet**Tal Ben‐Nun, Torsten Hoefler*2019 · 589 citations* 3. [**Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis ACM Computing Surveys 2019**Tal Ben-Nun, Torsten Hoefler*2018 · 275 citations*](https://md.research.elamur.ai/free/en/papers/nun-2018-demystifying-parallel-distributed-deep-learning/) 4. **[QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs](https://md.research.elamur.ai/free/en/papers/ashkboos-2024-quarot-outlier-free-4-bit/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.*2024 · 254 citations* ## Co-authors here 4 co-authors with a page, the most papers together first. - [Amirkeivan Mohtashami](https://md.research.elamur.ai/free/en/authors/amirkeivan-mohtashami/) - [Bo Li](https://md.research.elamur.ai/free/en/authors/bo-li/) - [Dan Alistarh](https://md.research.elamur.ai/free/en/authors/dan-alistarh/) - [Martin Jaggi](https://md.research.elamur.ai/free/en/authors/martin-jaggi/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - ACM Computing Surveys 2019 ×2 - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/) - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/): [NeurIPS 2024](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/) ## Cited by Papers of our library cite their works 829 times (of the 149,439 papers whose bibliographies we read); [186 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/torsten-hoefler/cited-by/). Updated 2 November 2026