--- title: "Nathan Godey — author profile and papers — Elamur Research" description: "Nathan Godey, Institut national de recherche en sciences et technologies du numérique: 2 papers on Elamur Research (2024–2026), h-index…" canonical: "https://research.elamur.ai/free/en/authors/nathan-godey/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/nathan-godey/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Nathan Godey # Nathan Godey Nathan Godey has 2 papers in our library, in 2024–2026, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Éric Villemonte De La Clergerie](https://md.research.elamur.ai/free/en/authors/eric-villemonte-de-la-clergerie/), [Benoit Sagot](https://md.research.elamur.ai/free/en/authors/benoit-sagot/), [Rian Touchent](https://md.research.elamur.ai/free/en/authors/rian-touchent/). 2 papers in our library · 2024–2026 [OpenAlex](https://openalex.org/A5071654594) · [ORCID](https://orcid.org/0000-0001-8319-8128) · [**h-index 2**](https://openalex.org/authors/A5071654594) · [28 works](https://openalex.org/works?filter=author.id:A5071654594) · [9 citations](https://openalex.org/works?filter=author.id:A5071654594&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/nathan-godey/#papers) · [🔗 Cited 14 times in our library](https://md.research.elamur.ai/free/en/authors/nathan-godey/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #10060](https://md.research.elamur.ai/free/en/paper-stars/page/101/#star-10060) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Nathan+Godey) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Nathan+Godey) · [dblp](https://dblp.org/search?q=Nathan+Godey) · [ACL Anthology](https://aclanthology.org/search/?q=Nathan+Godey) ## Affiliations [🎓**Cornell University** Ithaca · United States 2026 · 8 papers*current*](https://md.research.elamur.ai/free/en/universities/cornell-university/) · [🔬**ALMANACH: Modélisation et analyse linguistique automatique et humanités computationnelles** Paris · France 2022–2026 · 7 papers*current*](https://md.research.elamur.ai/free/en/labs/almanach-modelisation-et-analyse-linguistique-automatique-et-humanites/) · [🔬**Institut national de recherche en sciences et technologies du numérique** Le Chesnay-Rocquencourt · France 2022–2026 · 7 papers*current*](https://md.research.elamur.ai/free/en/labs/institut-national-de-recherche-en-sciences-et-technologies-du-numerique/) · [🎓**Cornell Tech** New York · United States 2026 · 1 paper*current*](https://md.research.elamur.ai/free/en/universities/cornell-tech/) · [🔬**Harvard University Press** Cambridge · United States 2026 · 1 paper*current*](https://ror.org/006v7bf86) · [🎓**Sorbonne Université** Paris · France 2022–2024 · 7 papers](https://md.research.elamur.ai/free/en/universities/sorbonne-universite/) · [🔬**Centre Inria de Paris** Paris · France 2022–2024 · 3 papers](https://md.research.elamur.ai/free/en/labs/centre-inria-de-paris/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 6 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Biochemistry, Genetics and Molecular Biology · 1 work](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/) · [Molecular Biology · 1 work](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/molecular-biology/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2026** 1 paper](https://md.research.elamur.ai/free/en/authors/nathan-godey/year/2026/) · [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/nathan-godey/year/2024/) ## Papers The most cited first (OpenAlex and our library). 1. **[Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck](https://md.research.elamur.ai/free/en/papers/godey-2024-why-small-language-models-underperform/)** *(2024 · 9 citations)* Small language models are cheaper to train and serve. However, the Pythia suite showed that when they are trained on very large corpora, they can saturate: late in pretraining, their loss rises and then stagnates. The authors attribute this to the softmax bottleneck. A linear prediction head built on a small hidden… 2. **[Biomed-Enriched: Data-Efficient Biomedical Pretraining via Paragraph-Level Annotation](https://md.research.elamur.ai/free/en/papers/touchent-2026-biomed-enriched-data-efficient-biomedical/)** *(2026)* Scientific articles in PubMed Central are internally uneven. Clinical case descriptions and pedagogical review passages appear alongside methods boilerplate and low-information text. Filtering whole documents, as FineWeb-Edu does for web pages, therefore throws away useful material. The authors instead label PMC Open… ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. [**Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck arXiv:2404.07647**Nathan Godey, Eric de la Clergerie, Benoit Sagot*2024 · 9 citations*](https://md.research.elamur.ai/free/en/papers/godey-2024-why-small-language-models-underperform/) 2. **[Gaperon: A Peppered English-French Generative Language Model Suite ↗](https://aclanthology.org/2026.findings-acl.1955/) Findings of the Association for Computational Linguistics: ACL 2026 · no summary yet**Nathan Godey et al.*2026 · 5 citations* 3. **[Biomed-Enriched: Data-Efficient Biomedical Pretraining via Paragraph-Level Annotation](https://md.research.elamur.ai/free/en/papers/touchent-2026-biomed-enriched-data-efficient-biomedical/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Rian Touchent, Nathan Godey, Éric Villemonte de la Clergerie*2026* ## Co-authors here 3 co-authors with a page, the most papers together first. - [Éric Villemonte De La Clergerie](https://md.research.elamur.ai/free/en/authors/eric-villemonte-de-la-clergerie/) ×2 - [Benoit Sagot](https://md.research.elamur.ai/free/en/authors/benoit-sagot/) - [Rian Touchent](https://md.research.elamur.ai/free/en/authors/rian-touchent/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/): [Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/) - Findings of the Association for Computational Linguistics: ACL 2026 ## Cited by Papers of our library cite their works 14 times (of the 149,439 papers whose bibliographies we read); [5 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/nathan-godey/cited-by/). Updated 1 November 2026