---
title: "Samyam Rajbhandari — papers"
description: "Samyam Rajbhandari: 4 papers in the Elamur Research library (2021–2023) — our summary of each, its ideas, references and who cites it."
canonical: "https://research.elamur.ai/free/en/authors/samyam-rajbhandari/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/samyam-rajbhandari/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Samyam Rajbhandari

# Samyam Rajbhandari

4 papers on this site (2021–2023)

[OpenAlex](https://openalex.org/A5069595628) · [ORCID](https://orcid.org/0000-0002-0386-8759) · h-index 21 · 60 works · 4295 citations (openalex-snapshot, 2026-10-14)

Profile data from OpenAlex; authors with the same name are not always told apart.

- [DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models](https://md.research.elamur.ai/free/en/papers/jacobs-2023-deepspeed-ulysses-system-optimizations-enabling/) — Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al. · 2023
- [DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale](https://md.research.elamur.ai/free/en/papers/rajbhandari-2022-deepspeed-moe-advancing-mixture-experts/) — Samyam Rajbhandari, Conglong Li, Zhewei Yao, et al. · 2022
- [Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/) — Shaden Smith, Mostofa Patwary, Brandon Norick, et al. · 2022
- [ZeRO-Offload: Democratizing Billion-Scale Model Training](https://md.research.elamur.ai/free/en/papers/ren-2021-zero-offload-democratizing-billion-scale/) — Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al. · 2021