--- title: "Igor Molybog — author profile and papers — Elamur Research" description: "Igor Molybog, University of Hawaiʻi at Mānoa: 2 papers on Elamur Research (2023), h-index 6 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/igor-molybog/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/igor-molybog/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Igor Molybog # Igor Molybog Igor Molybog has 2 papers in our library, in 2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Andrew Poulton](https://md.research.elamur.ai/free/en/authors/andrew-poulton/), [Barlas Oguz](https://md.research.elamur.ai/free/en/authors/barlas-oguz/), [Diana Liskovich](https://md.research.elamur.ai/free/en/authors/diana-liskovich/). 2 papers in our library · 2023 [OpenAlex](https://openalex.org/A5041560478) · [ORCID](https://orcid.org/0000-0001-7251-3532) · [Wikidata](https://www.wikidata.org/wiki/Q130856127) · [**h-index 6**](https://openalex.org/authors/A5041560478) · [26 works](https://openalex.org/works?filter=author.id:A5041560478) · [2,663 citations](https://openalex.org/works?filter=author.id:A5041560478&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/igor-molybog/#papers) · [🔗 Cited 7,262 times in our library](https://md.research.elamur.ai/free/en/authors/igor-molybog/cited-by/) · [⭐ Paper Stars ranking: #6751](https://md.research.elamur.ai/free/en/paper-stars/page/68/#star-6751) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Igor+Molybog) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Igor+Molybog) · [dblp](https://dblp.org/search?q=Igor+Molybog) · [ACL Anthology](https://aclanthology.org/search/?q=Igor+Molybog) ## Affiliations [🎓**University of Hawaiʻi at Mānoa** Honolulu · United States 2024–2026 · 7 papers*current*](https://md.research.elamur.ai/free/en/universities/university-of-hawai-i-at-manoa/) · [🎓**University of California, Berkeley** Berkeley · United States 2018–2021 · 7 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/igor-molybog/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[Effective Long-Context Scaling of Foundation Models](https://md.research.elamur.ai/free/en/papers/xiong-2023-effective-long-context-scaling-foundation/)** *(2023 · 184 citations)* In 2023, strong long-input handling was mostly available through proprietary APIs. Earlier open attempts to extend context were usually judged only by perplexity or synthetic probes, and they often lost quality on short tasks. This Meta paper introduces Llama 2 Long, a family of 7B–70B models built by continuing to… 2. **[A Theory on Adam Instability in Large-Scale Machine Learning](https://md.research.elamur.ai/free/en/papers/molybog-2023-theory-adam-instability-large-scale/)** *(2023 · 15 citations)* Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained. ## Co-authors here 12 of 18 co-authors with a page, the most papers together first. - [Andrew Poulton](https://md.research.elamur.ai/free/en/authors/andrew-poulton/) - [Barlas Oguz](https://md.research.elamur.ai/free/en/authors/barlas-oguz/) - [Diana Liskovich](https://md.research.elamur.ai/free/en/authors/diana-liskovich/) - [Han Fang](https://md.research.elamur.ai/free/en/authors/han-fang/) - [Hejia Zhang](https://md.research.elamur.ai/free/en/authors/hejia-zhang/) - [Jingyu Liu](https://md.research.elamur.ai/free/en/authors/jingyu-liu/) - [Louis Martin](https://md.research.elamur.ai/free/en/authors/louis-martin/) - [Madian Khabsa](https://md.research.elamur.ai/free/en/authors/madian-khabsa/) - [Moya Chen](https://md.research.elamur.ai/free/en/authors/moya-chen/) - [Naman Goyal](https://md.research.elamur.ai/free/en/authors/naman-goyal/) - [Peter Albert](https://md.research.elamur.ai/free/en/authors/peter-albert/) - [Prajjwal Bhargava](https://md.research.elamur.ai/free/en/authors/prajjwal-bhargava/) ## Cited by Papers of our library cite their works 7,262 times (of the 149,439 papers whose bibliographies we read); [1,540 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/igor-molybog/cited-by/). Updated 3 November 2026