--- title: "Suvrit Sra — author profile and papers — Elamur Research" description: "Suvrit Sra, Technical University of Munich: 2 papers on Elamur Research (2023), h-index 46 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/suvrit-sra/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/suvrit-sra/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Suvrit Sra # Suvrit Sra Suvrit Sra has 2 papers in our library, in 2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Kwangjun Ahn](https://md.research.elamur.ai/free/en/authors/kwangjun-ahn/), [Xiang Cheng](https://md.research.elamur.ai/free/en/authors/xiang-cheng/), [Chulhee Yun](https://md.research.elamur.ai/free/en/authors/chulhee-yun/). 2 papers in our library · 2023 [OpenAlex](https://openalex.org/A5058767558) · [ORCID](https://orcid.org/0000-0001-8516-4925) · [Wikidata](https://www.wikidata.org/wiki/Q56589650) · [**h-index 46**](https://openalex.org/authors/A5058767558) · [327 works](https://openalex.org/works?filter=author.id:A5058767558) · [9,110 citations](https://openalex.org/works?filter=author.id:A5058767558&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/suvrit-sra/#papers) · [🔗 Cited 41 times in our library](https://md.research.elamur.ai/free/en/authors/suvrit-sra/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #9809](https://md.research.elamur.ai/free/en/paper-stars/page/99/#star-9809) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Suvrit+Sra) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Suvrit+Sra) · [dblp](https://dblp.org/search?q=Suvrit+Sra) · [ACL Anthology](https://aclanthology.org/search/?q=Suvrit+Sra) ## Affiliations [🎓**Technical University of Munich** Munich · Germany 2024–2026 · 8 papers*current*](https://md.research.elamur.ai/free/en/universities/technical-university-of-munich/) · [🎓**Massachusetts Institute of Technology** Cambridge · United States 2014–2023 · 99 papersEmployment since 2015](https://md.research.elamur.ai/free/en/universities/massachusetts-institute-of-technology/) · [🔬**Max Planck Society** Munich · Germany 2003–2015 · 34 papers](https://md.research.elamur.ai/free/en/labs/max-planck-society/) · [🔬**Max Planck Institute for Biological Cybernetics** Tübingen · Germany 2003–2014 · 33 papers](https://ror.org/026nmvv73) · [🔬**Max Planck Institute for Intelligent Systems** Stuttgart · Germany 2011–2015 · 25 papers](https://md.research.elamur.ai/free/en/labs/max-planck-institute-for-intelligent-systems/) · [🎓**The University of Texas at Austin** Austin · United States 2003–2008 · 14 papersEducation](https://md.research.elamur.ai/free/en/universities/the-university-of-texas-at-austin/) · [🎓**Umeå University** Umeå · Sweden 2021–2025 · 6 papers](https://md.research.elamur.ai/free/en/universities/umea-university/) · [🎓**Carnegie Mellon University** Pittsburgh · United States 2014–2015 · 6 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🎓**Tsinghua University** Beijing · China 2021–2023 · 3 papers](https://md.research.elamur.ai/free/en/universities/tsinghua-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/suvrit-sra/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[Transformers learn to implement preconditioned gradient descent for in-context learning](https://md.research.elamur.ai/free/en/papers/ahn-2023-transformers-learn-implement-preconditioned-gradient/)** *(2023 · 37 citations)* The paper asks whether transformers merely can represent optimization algorithms or whether ordinary training actually drives them to do so. 2. **[Linear attention is (maybe) all you need (to understand transformer optimization)](https://md.research.elamur.ai/free/en/papers/ahn-2023-linear-attention-maybe-all-need/)** *(2023 · 10 citations)* Training Transformers is notoriously hard. Plain SGD lags well behind adaptive optimizers such as Adam, and the loss landscape shows unusual properties that classical optimization theory does not account for. Full Transformers are too complex to analyze directly, so the authors look for the simplest model that still… ## All works 4 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Proximal stochastic methods for nonsmooth nonconvex finite-sum optimization ↗](https://openalex.org/W2556623528) neural information processing systems · no summary yet**Sashank Jakkam Reddi et al.*2016 · 96 citations* 2. **[A Generic Approach for Escaping Saddle points ↗](https://arxiv.org/abs/1709.01434) arXiv (Cornell University) · no summary yet**Sashank Jakkam Reddi et al.*2017 · 52 citations* 3. **[Transformers learn to implement preconditioned gradient descent for in-context learning](https://md.research.elamur.ai/free/en/papers/ahn-2023-transformers-learn-implement-preconditioned-gradient/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Kwangjun Ahn, Xiang Cheng, Hadi Daneshmand, et al.*2023 · 37 citations* 4. [**Linear attention is (maybe) all you need (to understand transformer optimization) arXiv:2310.01082**Kwangjun Ahn, Xiang Cheng, Minhak Song, et al.*2023 · 10 citations*](https://md.research.elamur.ai/free/en/papers/ahn-2023-linear-attention-maybe-all-need/) ## Co-authors here 3 co-authors with a page, the most papers together first. - [Kwangjun Ahn](https://md.research.elamur.ai/free/en/authors/kwangjun-ahn/) ×2 - [Xiang Cheng](https://md.research.elamur.ai/free/en/authors/xiang-cheng/) ×2 - [Chulhee Yun](https://md.research.elamur.ai/free/en/authors/chulhee-yun/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/): [NeurIPS 2023](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2023/) - neural information processing systems ## Cited by Papers of our library cite their works 41 times (of the 149,439 papers whose bibliographies we read); [12 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/suvrit-sra/cited-by/). Updated 3 November 2026