--- title: "Sharan Narang — author profile and papers" description: "Sharan Narang: 5 papers on Elamur Research (2017–2023), h-index 22 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/sharan-narang/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/sharan-narang/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Sharan Narang # Sharan Narang Sharan Narang works on large neural language models and on how their behaviour changes as models and datasets grow. Their papers here return to a few linked questions: how predictably accuracy improves with more data and parameters, how pretraining objectives and architectures compare under controlled conditions, and how the way a model generates text affects its reasoning. The typical method is large-scale empirical study, training many models or a single very large Transformer and measuring the results across varied benchmarks. The most cited work is [Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/). It recasts every language task as mapping input text to output text and uses that shared setup to compare pretraining objectives, architectures, unlabeled corpora and fine-tuning strategies. It also introduces the C4 web corpus. [Self-Consistency Improves Chain of Thought Reasoning in Language Models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/) proposes a training-free decoding method. It samples many reasoning paths and keeps the answer most of them agree on. [PaLM: Scaling Language Modeling with Pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/) describes training a very large dense decoder-only model and tests its few-shot ability across language, code and multilingual tasks. An earlier study, Deep Learning Scaling is Predictable, Empirically, fitted learning curves for speech recognition, image classification, language modeling and translation. It showed that the exponents predicted by classical theory do not match real deep networks. The newest work turns the scaling question toward model design. [Scaling Laws vs Model Architectures](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/) examines whether the assumptions a design encodes, its inductive bias, alter how the model scales, both during pretraining and once finetuned. It questions the habit of judging new architectures at one model size only. Narang's papers here carry bylines from [Google](https://md.research.elamur.ai/free/en/companies/google/) between 2019 and 2023, and earlier from [Baidu](https://md.research.elamur.ai/free/en/companies/baidu/) in 2017. Co-authors who recur include [Aakanksha Chowdhery](https://md.research.elamur.ai/free/en/authors/aakanksha-chowdhery/), [Hyung Won Chung](https://md.research.elamur.ai/free/en/authors/hyung-won-chung/), Adam Roberts and Yanqi Zhou. The work falls mainly under [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), with a strand on reasoning. Sharan Narang has 5 papers in our library, in 2017–2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/); often with [Aakanksha Chowdhery](https://md.research.elamur.ai/free/en/authors/aakanksha-chowdhery/), [Adam Roberts](https://md.research.elamur.ai/free/en/authors/adam-roberts/), [Hyung Won Chung](https://md.research.elamur.ai/free/en/authors/hyung-won-chung/). 5 papers in our library · 2017–2023 [OpenAlex](https://openalex.org/A5079540764) · [**h-index 22**](https://openalex.org/authors/A5079540764) · [43 works](https://openalex.org/works?filter=author.id:A5079540764) · [14,340 citations](https://openalex.org/works?filter=author.id:A5079540764&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 5 works in our library](https://md.research.elamur.ai/free/en/authors/sharan-narang/#papers) · [🔗 13,067 citations in our library](https://md.research.elamur.ai/free/en/authors/sharan-narang/cited-by/) · [3 more in our library without a page yet](#also) · [⭐ Paper Star rank #125](https://md.research.elamur.ai/free/en/paper-stars/page/2/#star-125) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Sharan+Narang) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Sharan+Narang) · [dblp](https://dblp.org/search?q=Sharan+Narang) · [ACL Anthology](https://aclanthology.org/search/?q=Sharan+Narang) ## Affiliations [🏢**Google** Mountain View · United States 2019–2023 · 12 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🏢**Baidu** Beijing · China 2017 · 3 papers](https://md.research.elamur.ai/free/en/companies/baidu/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed. ## Topics [Language models & pretraining (2)](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning (1)](https://md.research.elamur.ai/free/en/topics/reasoning/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/) · [**2022** 2 papers](https://md.research.elamur.ai/free/en/authors/sharan-narang/year/2022/) ### 2010s [**2019** 1 paper](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/) · [**2017** 1 paper](https://md.research.elamur.ai/free/en/papers/hestness-2017-deep-learning-scaling-predictable-empirically/) ## Papers The most cited first (OpenAlex and our library). 1. **[Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)** *(2019 · 7,433 citations)* The authors from Google propose a unified view of transfer learning in NLP. They cast every language task as the conversion of input text into output text: translation, classification, question answering, summarization. This makes it possible to use a single model, a single loss function and the same hyperparameters… 2. **[Self-Consistency Improves Chain of Thought Reasoning in Language Models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/)** *(2022 · 3,035 citations)* Chain-of-thought prompting helps large language models with multi-step reasoning, but it usually decodes just one greedy path, so a single mistake in that path makes the final answer wrong. 3. **[PaLM: Scaling Language Modeling with Pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)** *(2022 · 2,603 citations)* The authors investigate how the size of a language model affects its ability to solve tasks from a few examples (few-shot), without task-specific fine-tuning. 4. **[Deep Learning Scaling is Predictable, Empirically](https://md.research.elamur.ai/free/en/papers/hestness-2017-deep-learning-scaling-predictable-empirically/)** *(2017 · 497 citations)* Practitioners widely assume that more data and bigger models improve accuracy, but there was no reliable way to forecast how much gain a given increase in training data would bring. 5. **[Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/)** *(2023 · 79 citations)* Most work on scaling laws studies only the standard Transformer. New architectures are also often judged at a single model size, such as "base", on the assumption that their gains carry over to other scales. This paper tests that assumption. The authors ask whether the inductive bias built into an architecture… ## Also in our library 3 more works of theirs are in our library without a page here yet; they will appear as we publish them. ## Co-authors here 12 of 32 co-authors with a page, the most papers together first. - [Aakanksha Chowdhery](https://md.research.elamur.ai/free/en/authors/aakanksha-chowdhery/) ×2 - [Adam Roberts](https://md.research.elamur.ai/free/en/authors/adam-roberts/) ×2 - [Hyung Won Chung](https://md.research.elamur.ai/free/en/authors/hyung-won-chung/) ×2 - [Yanqi Zhou](https://md.research.elamur.ai/free/en/authors/yanqi-zhou/) ×2 - [Charles Sutton](https://md.research.elamur.ai/free/en/authors/charles-sutton/) - [Colin Raffel](https://md.research.elamur.ai/free/en/authors/colin-raffel/) - [Dale Schuurmans](https://md.research.elamur.ai/free/en/authors/dale-schuurmans/) - [Dani Yogatama](https://md.research.elamur.ai/free/en/authors/dani-yogatama/) - [Denny Zhou](https://md.research.elamur.ai/free/en/authors/denny-zhou/) - [Donald Metzler](https://md.research.elamur.ai/free/en/authors/donald-metzler/) - [Ed Chi](https://md.research.elamur.ai/free/en/authors/ed-chi/) - [Greg Diamos](https://md.research.elamur.ai/free/en/authors/greg-diamos/) ## Cited by Papers of our library cite their works 13,067 times (of the 140,884 papers whose bibliographies we read); [895 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/sharan-narang/cited-by/).