--- title: "Mostofa Patwary — author profile and papers" description: "Mostofa Patwary, Boston University: 2 papers on Elamur Research (2020–2022), h-index 18 — affiliations, topics, co-authors and who cites them in our…" canonical: "https://research.elamur.ai/free/en/authors/mostofa-patwary/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/mostofa-patwary/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Mostofa Patwary # Mostofa Patwary 2 papers on this site · 2020–2022 current affiliation [Boston University](https://ror.org/05qwgg493), Boston, United States; [Nvidia (United Kingdom)](https://ror.org/02kr42612), Reading, United Kingdom; [Nvidia (United States)](https://ror.org/03jdj4y14), Santa Clara, United States; [Carnegie Mellon University](https://ror.org/05x2bcf33), Pittsburgh, United States Mostofa Patwary has 2 papers on this site, in 2020–2022, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/), [Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/); often with [Bryan Catanzaro](https://md.research.elamur.ai/free/en/authors/bryan-catanzaro/), [Jared Casper](https://md.research.elamur.ai/free/en/authors/jared-casper/), [Mohammad Shoeybi](https://md.research.elamur.ai/free/en/authors/mohammad-shoeybi/). [OpenAlex](https://openalex.org/A5031170568) · [**h-index 18**](https://openalex.org/authors/A5031170568) · [73 works](https://openalex.org/works?filter=author.id:A5031170568) · [3 041 citations](https://openalex.org/works?filter=author.id:A5031170568&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [2 works on this site](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/#papers) · [1 023 citations in our library](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/cited-by/) · 14 more works in our library The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Mostofa+Patwary) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Mostofa+Patwary) · [dblp](https://dblp.org/search?q=Mostofa+Patwary) · [ACL Anthology](https://aclanthology.org/search/?q=Mostofa+Patwary) ## Affiliations - [Nvidia (United States)](https://ror.org/03jdj4y14) · Santa Clara, United States —current · 2020–2026 on 18 papers - [Nvidia (United Kingdom)](https://ror.org/02kr42612) · Reading, United Kingdom —current · 2020–2026 on 15 papers - [Boston University](https://ror.org/05qwgg493) · Boston, United States —current · 2024–2026 on 4 papers - [Carnegie Mellon University](https://ror.org/05x2bcf33) · Pittsburgh, United States —current · 2024–2026 on 3 papers - [Stanford University](https://ror.org/00f54p054) · Stanford, United States —2024–2025 on 2 papers - [Hong Kong University of Science and Technology](https://ror.org/00q4vv597) · Hong Kong, Hong Kong —2020–2023 on 7 papers - [Baidu (China)](https://ror.org/03vs3wt56) · Beijing, China —2019 on 2 papers - [Intel (United States)](https://ror.org/01ek73717) · Santa Clara, United States —2015–2017 on 3 papers From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed. ## Topics [Language models & pretraining 1](https://md.research.elamur.ai/free/en/topics/language-models/) · [Question answering 1](https://md.research.elamur.ai/free/en/topics/question-answering/) · [Text generation 1](https://md.research.elamur.ai/free/en/topics/text-generation/) ## Papers The most cited first (OpenAlex and our library). 1. **[Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/)** *(2022 · 595 citations)* Large language models keep growing, and training them hits two limits. Their parameters no longer fit in one GPU's memory, and without careful co-design of software and hardware the training time becomes impractical. In a joint Microsoft–NVIDIA effort, the authors describe how they trained Megatron-Turing NLG 530B… 2. **[Training Question Answering Models From Synthetic Data](https://md.research.elamur.ai/free/en/papers/puri-2020-training-question-answering-models-synthetic/)** *(2020 · 206 citations)* Extractive QA systems depend on costly human-annotated data, and question-answer pairs produced automatically have traditionally been much weaker than those written by people. The authors tackle this gap with large pretrained transformers. Their pipeline has three stages: ## Also in our library 14 more works of theirs are in our library without a page here yet; they will appear as we publish them. ## Co-authors here 8 co-authors with a page, the most papers together first. - [Bryan Catanzaro](https://md.research.elamur.ai/free/en/authors/bryan-catanzaro/) - [Jared Casper](https://md.research.elamur.ai/free/en/authors/jared-casper/) - [Mohammad Shoeybi](https://md.research.elamur.ai/free/en/authors/mohammad-shoeybi/) - [Raul Puri](https://md.research.elamur.ai/free/en/authors/raul-puri/) - [Samyam Rajbhandari](https://md.research.elamur.ai/free/en/authors/samyam-rajbhandari/) - [Shrimai Prabhumoye](https://md.research.elamur.ai/free/en/authors/shrimai-prabhumoye/) - [Vijay Korthikanti](https://md.research.elamur.ai/free/en/authors/vijay-korthikanti/) - [Zhun Liu](https://md.research.elamur.ai/free/en/authors/zhun-liu/) ## Cited by Papers of our library cite their works 1 023 times (of the 140 884 papers whose bibliographies we read); [86 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/cited-by/).