--- title: "Punit Singh Koura — author profile and papers in our library" description: "Punit Singh Koura: 2 papers on Elamur Research (2022–2023), h-index 7 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/punit-singh-koura/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/punit-singh-koura/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Punit Singh Koura # Punit Singh Koura Punit Singh Koura has 2 papers in our library, in 2022–2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Andrew Poulton](https://md.research.elamur.ai/free/en/authors/andrew-poulton/), [Daniel Simig](https://md.research.elamur.ai/free/en/authors/daniel-simig/), [Diana Liskovich](https://md.research.elamur.ai/free/en/authors/diana-liskovich/). 2 papers in our library · 2022–2023 [OpenAlex](https://openalex.org/A5051808640) · [**h-index 7**](https://openalex.org/authors/A5051808640) · [12 works](https://openalex.org/works?filter=author.id:A5051808640) · [3,819 citations](https://openalex.org/works?filter=author.id:A5051808640&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/punit-singh-koura/#papers) · [🔗 Cited 7,794 times in our library](https://md.research.elamur.ai/free/en/authors/punit-singh-koura/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #6119](https://md.research.elamur.ai/free/en/paper-stars/page/62/#star-6119) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Punit+Singh+Koura) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Punit+Singh+Koura) · [dblp](https://dblp.org/search?q=Punit+Singh+Koura) · [ACL Anthology](https://aclanthology.org/search/?q=Punit+Singh+Koura) ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/punit-singh-koura/year/2023/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/punit-singh-koura/year/2022/) ## Papers The most cited first (OpenAlex and our library). 1. **[OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization](https://md.research.elamur.ai/free/en/papers/iyer-2022-opt-iml-scaling-language-model/)** *(2022 · 244 citations)* Instruction-tuning means fine-tuning a large language model on many tasks phrased as instructions. It is known to help zero- and few-shot transfer, but it was unclear how individual design choices affect results. The authors examine these choices at scale. They merged 8 existing task collections into OPT-IML Bench… 2. **[A Theory on Adam Instability in Large-Scale Machine Learning](https://md.research.elamur.ai/free/en/papers/molybog-2023-theory-adam-instability-large-scale/)** *(2023 · 15 citations)* Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained. ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. [**OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization arXiv:2212.12017**Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, et al.*2022 · 244 citations*](https://md.research.elamur.ai/free/en/papers/iyer-2022-opt-iml-scaling-language-model/) 2. **[Few-shot Learning with Multilingual Generative Language Models ↗](https://aclanthology.org/2022.emnlp-main.616/) Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yet**Xi Victoria Lin et al.*2022 · 133 citations* 3. [**A Theory on Adam Instability in Large-Scale Machine Learning arXiv:2304.09871**Igor Molybog, Peter Albert, Moya Chen, et al.*2023 · 15 citations*](https://md.research.elamur.ai/free/en/papers/molybog-2023-theory-adam-instability-large-scale/) ## Co-authors here 12 of 18 co-authors with a page, the most papers together first. - [Andrew Poulton](https://md.research.elamur.ai/free/en/authors/andrew-poulton/) - [Daniel Simig](https://md.research.elamur.ai/free/en/authors/daniel-simig/) - [Diana Liskovich](https://md.research.elamur.ai/free/en/authors/diana-liskovich/) - [Igor Molybog](https://md.research.elamur.ai/free/en/authors/igor-molybog/) - [Kurt Shuster](https://md.research.elamur.ai/free/en/authors/kurt-shuster/) - [Moya Chen](https://md.research.elamur.ai/free/en/authors/moya-chen/) - [Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/) - [Peter Albert](https://md.research.elamur.ai/free/en/authors/peter-albert/) - [Ping Yu](https://md.research.elamur.ai/free/en/authors/ping-yu/) - [Qing Liu](https://md.research.elamur.ai/free/en/authors/qing-liu/) - [Ramakanth Pasunuru](https://md.research.elamur.ai/free/en/authors/ramakanth-pasunuru/) - [Sharan Narang](https://md.research.elamur.ai/free/en/authors/sharan-narang/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing ## Cited by Papers of our library cite their works 7,794 times (of the 149,439 papers whose bibliographies we read); [1,639 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/punit-singh-koura/cited-by/). Updated 3 November 2026