--- title: "Shuaiwen Leon Song — author profile and papers in our library" description: "Shuaiwen Leon Song: 2 papers on Elamur Research (2019–2023), h-index 27 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/shuaiwen-leon-song/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/shuaiwen-leon-song/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Shuaiwen Leon Song # Shuaiwen Leon Song Shuaiwen Leon Song has 2 papers in our library, in 2019–2023, most of them on [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/), [GPU & parallel computing](https://md.research.elamur.ai/free/en/topics/gpu-parallel-computing/); often with [Ang Li](https://md.research.elamur.ai/free/en/authors/ang-li/), [Masahiro Tanaka](https://md.research.elamur.ai/free/en/authors/masahiro-tanaka/), [Minjia Zhang](https://md.research.elamur.ai/free/en/authors/minjia-zhang/). 2 papers in our library · 2019–2023 [OpenAlex](https://openalex.org/A5043209884) · [ORCID](https://orcid.org/0000-0002-8402-1436) · [Wikidata](https://www.wikidata.org/wiki/Q130851011) · [**h-index 27**](https://openalex.org/authors/A5043209884) · [123 works](https://openalex.org/works?filter=author.id:A5043209884) · [3,103 citations](https://openalex.org/works?filter=author.id:A5043209884&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/#papers) · [🔗 Cited 226 times in our library](https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4099](https://md.research.elamur.ai/free/en/paper-stars/page/41/#star-4099) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Shuaiwen+Leon+Song) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Shuaiwen+Leon+Song) · [dblp](https://dblp.org/search?q=Shuaiwen+Leon+Song) · [ACL Anthology](https://aclanthology.org/search/?q=Shuaiwen+Leon+Song) ## Affiliations [🔬**Pacific Northwest National Laboratory** Richland · United States 2013–2020 · 48 papers](https://md.research.elamur.ai/free/en/labs/pacific-northwest-national-laboratory/) · [🎓**The University of Sydney** Sydney · Australia 2019–2024 · 40 papers](https://md.research.elamur.ai/free/en/universities/the-university-of-sydney/) · [🎓**Virginia Tech** Blacksburg · United States 2009–2013 · 12 papers](https://md.research.elamur.ai/free/en/universities/virginia-tech/) · [🎓**William & Mary** Williamsburg · United States 2017–2018 · 5 papers](https://md.research.elamur.ai/free/en/universities/william-mary/) · [🏢**Microsoft** Redmond · United States 2023–2024 · 4 papers](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🤝**Association for Computing Machinery** New York · United States 2016–2021 · 2 papers](https://ror.org/03wsadn68) · [🎓**University of Washington** Seattle · United States 2021 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-washington/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Hardware and Architecture · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/hardware-and-architecture/) · [Computer Networks and Communications · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-networks-and-communications/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Artificial Intelligence · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 2 Research subjects and languages the work is about.[Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [GPU & parallel computing · 1 work](https://md.research.elamur.ai/free/en/topics/gpu-parallel-computing/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/year/2023/) ### 2010s [**2019** 1 paper](https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/year/2019/) ## Papers The most cited first (OpenAlex and our library). 1. **[Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect](https://md.research.elamur.ai/free/en/papers/li-2019-evaluating-modern-gpu-interconnect-pcie/)** *(2019 · 372 citations)* Multi-GPU computing is now essential for deep learning, big data and large-scale simulation. However, practitioners have little solid knowledge of how GPUs are wired together inside and across servers, or how much that wiring affects real workloads. The authors run a systematic empirical study of modern GPU… 2. **[DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models](https://md.research.elamur.ai/free/en/papers/jacobs-2023-deepspeed-ulysses-system-optimizations-enabling/)** *(2023 · 162 citations)* Standard LLM training parallelism splits work by batch (data parallelism), hidden size (tensor parallelism), or depth (pipeline parallelism). ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. [**Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect arXiv:1903.04611**Ang Li, Shuaiwen Leon Song, Jieyang Chen, et al.*2019 · 372 citations*](https://md.research.elamur.ai/free/en/papers/li-2019-evaluating-modern-gpu-interconnect-pcie/) 2. [**DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models arXiv:2309.14509**Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.*2023 · 162 citations*](https://md.research.elamur.ai/free/en/papers/jacobs-2023-deepspeed-ulysses-system-optimizations-enabling/) 3. **[When RL Meets Adaptive Speculative Training: A Unified Training-Serving System ↗](https://arxiv.org/abs/2602.06932) arXiv (Cornell University) · no summary yet**Junxiong Wang et al.*2026* ## Co-authors here 6 co-authors with a page, the most papers together first. - [Ang Li](https://md.research.elamur.ai/free/en/authors/ang-li/) - [Masahiro Tanaka](https://md.research.elamur.ai/free/en/authors/masahiro-tanaka/) - [Minjia Zhang](https://md.research.elamur.ai/free/en/authors/minjia-zhang/) - [Samyam Rajbhandari](https://md.research.elamur.ai/free/en/authors/samyam-rajbhandari/) - [Xu Liu](https://md.research.elamur.ai/free/en/authors/xu-liu/) - [Yuxiong He](https://md.research.elamur.ai/free/en/authors/yuxiong-he/) ## Cited by Papers of our library cite their works 226 times (of the 149,439 papers whose bibliographies we read); [26 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/cited-by/). Updated 2 November 2026