--- title: "Sanjiv Kumar — author profile and papers — Elamur Research" description: "Sanjiv Kumar, KLE Academy of Higher Education and Research: 3 papers on Elamur Research (2019–2023), h-index 45 — affiliations, topics…" canonical: "https://research.elamur.ai/free/en/authors/sanjiv-kumar/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/sanjiv-kumar/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Sanjiv Kumar # Sanjiv Kumar Sanjiv Kumar has 3 papers in our library, in 2019–2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Ankit Singh Rawat](https://md.research.elamur.ai/free/en/authors/ankit-singh-rawat/), [Sashank Jakkam Reddi](https://md.research.elamur.ai/free/en/authors/sashank-jakkam-reddi/), [Manzil Zaheer](https://md.research.elamur.ai/free/en/authors/manzil-zaheer/). 3 papers in our library · 2019–2023 [OpenAlex](https://openalex.org/A5018301052) · [ORCID](https://orcid.org/0000-0002-4080-1414) · [**h-index 45**](https://openalex.org/authors/A5018301052) · [257 works](https://openalex.org/works?filter=author.id:A5018301052) · [11,039 citations](https://openalex.org/works?filter=author.id:A5018301052&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 3 works in our library](https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/#papers) · [🔗 Cited 332 times in our library](https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/cited-by/) · [3 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #1715](https://md.research.elamur.ai/free/en/paper-stars/page/18/#star-1715) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Sanjiv+Kumar) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Sanjiv+Kumar) · [dblp](https://dblp.org/search?q=Sanjiv+Kumar) · [ACL Anthology](https://aclanthology.org/search/?q=Sanjiv+Kumar) ## Affiliations [🎓**K.L.E. Academy of Higher Education and Research Institute of Physiotherapy, Belagavi** Belagavi · India 2012–2026 · 39 papers*current*](https://ror.org/028xjgf42) · [🎓**KLE Academy of Higher Education and Research** Belagavi · India 2012–2026 · 32 papers*current*](https://ror.org/03aam9155) · [🏢**Google** Mountain View · United States 2007–2025 · 105 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**Carnegie Mellon University** Pittsburgh · United States 1999–2006 · 13 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🎓**King George's Medical University** Lucknow · India 2023 · 3 papers](https://ror.org/00gvw6327) · [🏢**Google DeepMind** London · United Kingdom 2025 · 2 papers](https://md.research.elamur.ai/free/en/companies/google-deepmind/) · [🏢**Abu Dhabi National Oil** Abu Dhabi · United Arab Emirates 2022–2024 · 2 papers](https://ror.org/010e8pt90) · [🎓**Princeton University** Princeton · United States 2023–2024 · 2 papers](https://md.research.elamur.ai/free/en/universities/princeton-university/) · [🏢**Saudi Aramco** Dhahran · Saudi Arabia 2014–2022 · 2 papers](https://md.research.elamur.ai/free/en/companies/saudi-aramco/) · [🏢**Saudi Aramco** Houston · United States 2014–2022 · 2 papers](https://ror.org/035n7q728) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 15 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 6 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Science · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/mathematics/) · [Numerical Analysis · 1 work](https://md.research.elamur.ai/free/en/shelves/mathematics/numerical-analysis/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/year/2023/) ### 2010s [**2019** 2 papers](https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/year/2019/) ## Papers The most cited first (OpenAlex and our library). 1. **[On the Convergence of Adam and Beyond](https://md.research.elamur.ai/free/en/papers/reddi-2019-convergence-adam/)** *(2019 · 1,598 citations)* Adaptive optimizers such as RMSProp, Adam, AdaDelta and NAdam scale each gradient coordinate by the root of an exponential moving average of past squared gradients. 2. **[Large Language Models with Controllable Working Memory](https://md.research.elamur.ai/free/en/papers/li-2023-large-language-models-controllable-working/)** *(2023 · 158 citations)* LLMs often receive a supporting context in the prompt, but it is unclear how that text interacts with facts stored in their weights. 3. **[Are Transformers universal approximators of sequence-to-sequence functions?](https://md.research.elamur.ai/free/en/papers/yun-2019-transformers-universal-approximators-sequence-sequence/)** *(2019 · 97 citations)* Transformers are widely used for NLP, but it has been unclear which sequence-to-sequence mappings they can actually represent. ## All works 6 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them. 1. [**On the Convergence of Adam and Beyond arXiv:1904.09237**Sashank J. Reddi, Satyen Kale, Sanjiv Kumar*2019 · 1,598 citations*](https://md.research.elamur.ai/free/en/papers/reddi-2019-convergence-adam/) 2. **[Learning Binary Codes for High-Dimensional Data Using Bilinear Projections ↗](https://doi.org/10.1109/cvpr.2013.69) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Yunchao Gong et al.*2013 · 168 citations* 3. **[Large Language Models with Controllable Working Memory](https://md.research.elamur.ai/free/en/papers/li-2023-large-language-models-controllable-working/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Daliang Li, Ankit Singh Rawat, Manzil Zaheer, et al.*2023 · 158 citations* 4. [**Are Transformers universal approximators of sequence-to-sequence functions? arXiv:1912.10077**Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, et al.*2019 · 97 citations*](https://md.research.elamur.ai/free/en/papers/yun-2019-transformers-universal-approximators-sequence-sequence/) 5. **[On sampling-based approximate spectral decomposition ↗](https://doi.org/10.1145/1553374.1553446) International Conference on Machine Learning · no summary yet**Sanjiv Kumar, Mehryar Mohri, Ameet Talwalkar*2009 · 88 citations* 6. **[Reasoning with Latent Thoughts: On the Power of Looped Transformers ↗](https://arxiv.org/abs/2502.17416) arXiv:2502.17416 · no summary yet**Nikunj Saunshi et al.*2025 · 44 citations* ## Co-authors here 5 co-authors with a page, the most papers together first. - [Ankit Singh Rawat](https://md.research.elamur.ai/free/en/authors/ankit-singh-rawat/) ×2 - [Sashank Jakkam Reddi](https://md.research.elamur.ai/free/en/authors/sashank-jakkam-reddi/) ×2 - [Manzil Zaheer](https://md.research.elamur.ai/free/en/authors/manzil-zaheer/) - [Satyen Kale](https://md.research.elamur.ai/free/en/authors/satyen-kale/) - [Xin Wang](https://md.research.elamur.ai/free/en/authors/xin-wang/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/): [Findings of the Association for Computational Linguistics 2023](https://md.research.elamur.ai/free/en/venues/findings/2023/) - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - International Conference on Machine Learning ## Cited by Papers of our library cite their works 332 times (of the 149,439 papers whose bibliographies we read); [64 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/cited-by/). Updated 2 November 2026