--- title: "Niklas Nolte — author profile and papers — Elamur Research" description: "Niklas Nolte, The NSF AI Institute for Artificial Intelligence and Fundamental Interactions: 2 papers on Elamur Research (2022–2024), h-index…" canonical: "https://research.elamur.ai/free/en/authors/niklas-nolte/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/niklas-nolte/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Niklas Nolte # Niklas Nolte Niklas Nolte has 2 papers in our library, in 2022–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Beidi Chen](https://md.research.elamur.ai/free/en/authors/beidi-chen/), [Eric J. Michaud](https://md.research.elamur.ai/free/en/authors/eric-j-michaud/), [Leon Bottou](https://md.research.elamur.ai/free/en/authors/leon-bottou/). 2 papers in our library · 2022–2024 [OpenAlex](https://openalex.org/A5112958169) · [ORCID](https://orcid.org/0000-0003-2536-4209) · [**h-index 52**](https://openalex.org/authors/A5112958169) · [1,197 works](https://openalex.org/works?filter=author.id:A5112958169) · [11,979 citations](https://openalex.org/works?filter=author.id:A5112958169&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/niklas-nolte/#papers) · [🔗 Cited 101 times in our library](https://md.research.elamur.ai/free/en/authors/niklas-nolte/cited-by/) · [⭐ Paper Stars ranking: #7748](https://md.research.elamur.ai/free/en/paper-stars/page/78/#star-7748) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Niklas+Nolte) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Niklas+Nolte) · [dblp](https://dblp.org/search?q=Niklas+Nolte) · [ACL Anthology](https://aclanthology.org/search/?q=Niklas+Nolte) ## Affiliations [🎓**Massachusetts Institute of Technology** Cambridge · United States 2021–2026 · 177 papers*current*](https://md.research.elamur.ai/free/en/universities/massachusetts-institute-of-technology/) · [🔬**The NSF AI Institute for Artificial Intelligence and Fundamental Interactions** Cambridge · United States 2022–2026 · 4 papers*current*](https://md.research.elamur.ai/free/en/labs/the-nsf-ai-institute-for-artificial-intelligence-and-fundamental-interactions/) · [🔬**European Organization for Nuclear Research** Geneva · Switzerland 2018–2021 · 104 papers](https://ror.org/01ggx4157) · [🔬**Laboratoire d’Annecy de Physique des Particules** Annecy · France 2019–2024 · 13 papers](https://ror.org/049nhh297) · [🎓**TU Dortmund University** Dortmund · Germany 2019–2023 · 11 papers](https://md.research.elamur.ai/free/en/universities/tu-dortmund-university/) · [🔬**Centre National de la Recherche Scientifique** Paris · France 2021–2024 · 8 papers](https://md.research.elamur.ai/free/en/labs/centre-national-de-la-recherche-scientifique/) · [🔬**Institut National de Physique Nucléaire et de Physique des Particules** Paris · France 2021–2024 · 8 papers](https://ror.org/03fd77x13) · [🎓**Université Savoie Mont Blanc** Chambéry · France 2021–2024 · 8 papers](https://ror.org/04gqg1a07) · [🔬**Istituto Nazionale di Fisica Nucleare, Sezione di Cagliari** Monserrato · Italy 2023–2024 · 5 papers](https://ror.org/03paz5966) · [🎓**RWTH Aachen University** Aachen · Germany 2020–2023 · 5 papers](https://md.research.elamur.ai/free/en/universities/rwth-aachen-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 22 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/niklas-nolte/year/2024/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/niklas-nolte/year/2022/) ## Papers The most cited first (OpenAlex and our library). 1. **[MagicPIG: LSH Sampling for Efficient LLM Generation](https://md.research.elamur.ai/free/en/papers/chen-2024-magicpig-lsh-sampling-efficient-llm/)** *(2024 · 68 citations)* Serving long-context LLMs is constrained by the KV cache. It consumes GPU memory and makes decoding memory-bound. Many speedups keep only the highest-scoring keys (TopK attention). The authors show this is a biased estimator that breaks down when attention is spread out, as in aggregation tasks like common- or… 2. **[Towards Understanding Grokking: An Effective Theory of Representation Learning](https://md.research.elamur.ai/free/en/papers/liu-2022-towards-understanding-grokking-effective-theory/)** *(2022 · 65 citations)* Grokking is the behavior where a neural network fits its training data early but only begins to generalize much later. ## Co-authors here 11 co-authors with a page, the most papers together first. - [Beidi Chen](https://md.research.elamur.ai/free/en/authors/beidi-chen/) - [Eric J. Michaud](https://md.research.elamur.ai/free/en/authors/eric-j-michaud/) - [Leon Bottou](https://md.research.elamur.ai/free/en/authors/leon-bottou/) - [Matthijs Douze](https://md.research.elamur.ai/free/en/authors/matthijs-douze/) - [Max Tegmark](https://md.research.elamur.ai/free/en/authors/max-tegmark/) - [Yang Zhou](https://md.research.elamur.ai/free/en/authors/yang-zhou/) - [Yuandong Tian](https://md.research.elamur.ai/free/en/authors/yuandong-tian/) - [Zhihao Jia](https://md.research.elamur.ai/free/en/authors/zhihao-jia/) - [Zhuoming Chen](https://md.research.elamur.ai/free/en/authors/zhuoming-chen/) - [Zihao Ye](https://md.research.elamur.ai/free/en/authors/zihao-ye/) - [Ziming Liu](https://md.research.elamur.ai/free/en/authors/ziming-liu/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/): [NeurIPS 2022](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2022/) ## Cited by Papers of our library cite their works 101 times (of the 149,439 papers whose bibliographies we read); [23 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/niklas-nolte/cited-by/). Updated 3 November 2026