--- title: "Shaden Smith — author profile and papers — Elamur Research" description: "Shaden Smith, Microsoft: 2 papers on Elamur Research (2021–2022), h-index 22 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/shaden-smith/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/shaden-smith/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Shaden Smith # Shaden Smith Shaden Smith has 2 papers in our library, in 2021–2022, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/), [GPU & parallel computing](https://md.research.elamur.ai/free/en/topics/gpu-parallel-computing/); often with [Samyam Rajbhandari](https://md.research.elamur.ai/free/en/authors/samyam-rajbhandari/), [Brandon Norick](https://md.research.elamur.ai/free/en/authors/brandon-norick/), [Jared Casper](https://md.research.elamur.ai/free/en/authors/jared-casper/). 2 papers in our library · 2021–2022 [OpenAlex](https://openalex.org/A5089950471) · [ORCID](https://orcid.org/0000-0003-4072-9990) · [**h-index 22**](https://openalex.org/authors/A5089950471) · [39 works](https://openalex.org/works?filter=author.id:A5089950471) · [2,814 citations](https://openalex.org/works?filter=author.id:A5089950471&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/shaden-smith/#papers) · [🔗 Cited 1,849 times in our library](https://md.research.elamur.ai/free/en/authors/shaden-smith/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #2972](https://md.research.elamur.ai/free/en/paper-stars/page/30/#star-2972) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Shaden+Smith) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Shaden+Smith) · [dblp](https://dblp.org/search?q=Shaden+Smith) · [ACL Anthology](https://aclanthology.org/search/?q=Shaden+Smith) ## Affiliations [🏢**Microsoft** Redmond · United States 2020–2024 · 6 papers*current*](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🎓**University of Minnesota** Minneapolis · United States 2014–2021 · 17 papers](https://md.research.elamur.ai/free/en/universities/university-of-minnesota/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 6 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Hardware and Architecture · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/hardware-and-architecture/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) 🧭 Topics 3 Research subjects and languages the work is about.[GPU & parallel computing · 1 work](https://md.research.elamur.ai/free/en/topics/gpu-parallel-computing/) · [Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Text generation · 1 work](https://md.research.elamur.ai/free/en/topics/text-generation/) ## Works by year ### 2020s [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/shaden-smith/year/2022/) · [**2021** 1 paper](https://md.research.elamur.ai/free/en/authors/shaden-smith/year/2021/) ## Papers The most cited first (OpenAlex and our library). 1. **[Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/)** *(2022 · 615 citations)* The paper describes how Microsoft and NVIDIA trained Megatron-Turing NLG 530B (MT-NLG), a dense, left-to-right autoregressive transformer with 530 billion parameters. 2. **[ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning](https://md.research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/)** *(2021 · 254 citations)* Dense model sizes have grown roughly a thousandfold in three years, while single-GPU memory has grown only about fivefold. ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗](https://arxiv.org/abs/2211.05100) arXiv:2211.05100 · no summary yet**BigScience Workshop et al.*2022 · 1,606 citations* 2. [**Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model arXiv:2201.11990**Shaden Smith, Mostofa Patwary, Brandon Norick, et al.*2022 · 615 citations*](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/) 3. [**ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning SC 2021**Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, et al.*2021 · 254 citations*](https://md.research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/) ## Co-authors here 11 co-authors with a page, the most papers together first. - [Samyam Rajbhandari](https://md.research.elamur.ai/free/en/authors/samyam-rajbhandari/) ×2 - [Brandon Norick](https://md.research.elamur.ai/free/en/authors/brandon-norick/) - [Jared Casper](https://md.research.elamur.ai/free/en/authors/jared-casper/) - [Jeff Rasley](https://md.research.elamur.ai/free/en/authors/jeff-rasley/) - [Mostofa Patwary](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/) - [Olatunji Ruwase](https://md.research.elamur.ai/free/en/authors/olatunji-ruwase/) - [Rewon Child](https://md.research.elamur.ai/free/en/authors/rewon-child/) - [Shrimai Prabhumoye](https://md.research.elamur.ai/free/en/authors/shrimai-prabhumoye/) - [Vijay Korthikanti](https://md.research.elamur.ai/free/en/authors/vijay-korthikanti/) - [Yuxiong He](https://md.research.elamur.ai/free/en/authors/yuxiong-he/) - [Zhun Liu](https://md.research.elamur.ai/free/en/authors/zhun-liu/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - SC 2021 ## Cited by Papers of our library cite their works 1,849 times (of the 149,439 papers whose bibliographies we read); [400 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/shaden-smith/cited-by/). Updated 2 November 2026