--- title: "Sanmi Koyejo · Stanford Health Care — author profile and papers" description: "Sanmi Koyejo, Stanford Health Care: 4 papers on Elamur Research (2023–2025), h-index 12 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/sanmi-koyejo/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/sanmi-koyejo/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Sanmi Koyejo # Sanmi Koyejo Sanmi Koyejo has 4 papers in our library, in 2023–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/); often with [Brando Miranda](https://md.research.elamur.ai/free/en/authors/brando-miranda/), [Ahmet Üstün](https://md.research.elamur.ai/free/en/authors/ahmet-ustun/), [Alex Wang](https://md.research.elamur.ai/free/en/authors/alex-wang/). 4 papers in our library · 2023–2025 [OpenAlex](https://openalex.org/A5091266570) · [ORCID](https://orcid.org/0000-0002-4023-419X) · [Wikidata](https://www.wikidata.org/wiki/Q25654777) · [**h-index 12**](https://openalex.org/authors/A5091266570) · [170 works](https://openalex.org/works?filter=author.id:A5091266570) · [7,232 citations](https://openalex.org/works?filter=author.id:A5091266570&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 4 works in our library](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/#papers) · [🔗 Cited 917 times in our library](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/cited-by/) · [23 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #5096](https://md.research.elamur.ai/free/en/paper-stars/page/51/#star-5096) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Sanmi+Koyejo) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Sanmi+Koyejo) · [dblp](https://dblp.org/search?q=Sanmi+Koyejo) · [ACL Anthology](https://aclanthology.org/search/?q=Sanmi+Koyejo) ## Affiliations [🎓**Stanford University** Stanford · United States 2014–2026 · 174 papersEmployment since 2022 · Assistant Professor, Computer Science*current*](https://md.research.elamur.ai/free/en/universities/stanford-university/) · [🏥**Stanford Medicine** Stanford · United States 2023–2026 · 4 papers*current*](https://md.research.elamur.ai/free/en/hospitals/stanford-medicine/) · [🎓**Carnegie Mellon University** Pittsburgh · United States 2011–2026 · 2 papers*current*](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🏥**Stanford Health Care** Stanford · United States 2024–2026 · 2 papers*current*](https://ror.org/019wqcg20) · [🎓**University of Illinois Urbana-Champaign** Urbana · United States 2014–2024 · 60 papersEmployment since 2015](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) · [🏢**Google** Mountain View · United States 2019–2025 · 18 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**The University of Texas at Austin** Austin · United States 2009–2015 · 16 papersEducation](https://md.research.elamur.ai/free/en/universities/the-university-of-texas-at-austin/) · [🏢**Google DeepMind** London · United Kingdom 2024 · 3 papers](https://md.research.elamur.ai/free/en/companies/google-deepmind/) · [🎓**New Jersey Institute of Technology** Newark · United States Education](https://md.research.elamur.ai/free/en/universities/new-jersey-institute-of-technology/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 10 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 9 The field of science this work belongs to (OpenAlex fields).[Computer Science · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/mathematics/) · [Computational Theory and Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computational-theory-and-mathematics/) · [Safety Research · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/) 🧭 Topics 3 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Reasoning · 1 work](https://md.research.elamur.ai/free/en/topics/reasoning/) ## Works by year ### 2020s [**2025** 1 paper](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/year/2025/) · [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/year/2024/) · [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[Are Emergent Abilities of Large Language Models a Mirage?](https://md.research.elamur.ai/free/en/papers/schaeffer-2023-emergent-abilities-large-language-models/)** *(2023 · 342 citations)* The paper asks whether the "emergent abilities" reported for large language models are real. These are skills that seem to appear suddenly and unpredictably once models pass some size. The authors argue that this sharpness often comes from how performance is scored, not from abrupt changes inside the models. Using a… 2. **[The Leaderboard Illusion](https://md.research.elamur.ai/free/en/papers/singh-2025-leaderboard-illusion/)** *(2025 · 22 citations)* Chatbot Arena has become the main public leaderboard for ranking LLMs through crowdsourced pairwise votes. 3. **[Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4](https://md.research.elamur.ai/free/en/papers/aniva-2024-pantograph-machine-machine-interaction-interface/)** *(2024 · 14 citations)* Machine learning agents that search for proofs in Lean 4 depend on an interface to the proof assistant. The standard Language Server Protocol was built for humans: it tracks cursor positions and offers no easy way to collect tactic data or to leave proof gaps for automation. Pantograph is an API and REPL written… 4. **[Learning to (Learn at Test Time)](https://md.research.elamur.ai/free/en/papers/sun-2023-learning-learn-test-time/)** *(2023 · 6 citations)* Test-time training (TTT) adapts a model to each individual input through a self-supervised objective. Until now, picking an auxiliary task whose improvement actually helps the main task has depended on manual design and trial and error. Sun et al. recast supervised learning as a two-level meta-learning problem, which… ## All works 27 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them. 1. **[Examples are not enough, learn to criticize! Criticism for Interpretability ↗](https://openalex.org/W2551974706) neural information processing systems · no summary yet**Been Kim, Rajiv Khanna, Sanmi Koyejo*2016 · 527 citations* 2. **[Are Emergent Abilities of Large Language Models a Mirage?](https://md.research.elamur.ai/free/en/papers/schaeffer-2023-emergent-abilities-large-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Rylan Schaeffer, Brando Miranda, Sanmi Koyejo*2023 · 342 citations* 3. **[Rethinking machine unlearning for large language models ↗](https://doi.org/10.1038/s42256-025-00985-0) Nature Machine Intelligence · no summary yet**Sijia Liu et al.*2025 · 197 citations* 4. **[Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data ↗](https://arxiv.org/abs/2404.01413) arXiv (Cornell University) · no summary yet**Matthias Gerstgrasser et al.*2024 · 44 citations* 5. **[Advancing science- and evidence-based AI policy ↗](https://doi.org/10.1126/science.adu8449) Science · no summary yet**Rishi Bommasani et al.*2025 · 25 citations* 6. **[The Leaderboard Illusion](https://md.research.elamur.ai/free/en/papers/singh-2025-leaderboard-illusion/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shivalika Singh, Yiyang Nan, Alex Wang, et al.*2025 · 22 citations* 7. **[Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research ↗](https://doi.org/10.52202/085713-2990) neural information processing systems · no summary yet**A. Feder Cooper et al.*2025 · 17 citations* 8. **[Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4](https://md.research.elamur.ai/free/en/papers/aniva-2024-pantograph-machine-machine-interaction-interface/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Leni Aniva, Chuyue Sun, Brando Miranda, et al.*2024 · 14 citations* 9. **[Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy, Research, and Practice ↗](https://doi.org/10.2139/ssrn.5060253) SSRN Electronic Journal · no summary yet**A. Feder Cooper et al.*2025 · 12 citations* 10. **[End-to-End Test-Time Training for Long Context ↗](https://arxiv.org/abs/2512.23675) arXiv (Cornell University) · no summary yet**Arnuv Tandon et al.*2025 · 10 citations* 11. **[Extracting books from production language models ↗](https://arxiv.org/abs/2601.02671) arXiv (Cornell University) · no summary yet**Ahmed Ahmed et al.*2026 · 8 citations* 12. **[UQ: Assessing Language Models on Unsolved Questions ↗](https://arxiv.org/abs/2508.17580) arXiv (Cornell University) · no summary yet**Nie, Fan et al.*2025 · 6 citations* 13. [**Learning to (Learn at Test Time) arXiv:2310.13807**Yu Sun, Xinhao Li, Karan Dalal, et al.*2023 · 6 citations*](https://md.research.elamur.ai/free/en/papers/sun-2023-learning-learn-test-time/) 14. **[SWE-chat: Coding Agent Interactions From Real Users in the Wild ↗](https://arxiv.org/abs/2604.20779) arXiv (Cornell University) · no summary yet**Joachim Baumann et al.*2026 · 5 citations* 15. **[SpecEval: Evaluating Model Adherence to Behavior Specifications ↗](https://arxiv.org/abs/2509.02464) arXiv (Cornell University) · no summary yet**Ahmed Abdelmoamen Ahmed et al.*2025 · 3 citations* 16. **[Language Models May Verbatim Complete Text They Were Not Explicitly Trained On ↗](https://arxiv.org/abs/2503.17514) arXiv (Cornell University) · no summary yet**Ken Ziyu Liu et al.*2025 · 3 citations* 17. **[Reliable and Efficient Amortized Model-based Evaluation ↗](https://arxiv.org/abs/2503.13335) arXiv (Cornell University) · no summary yet**Sang Truong et al.*2025 · 3 citations* 18. **[Shaping AI's Impact on Billions of Lives ↗](https://arxiv.org/abs/2412.02730) arXiv (Cornell University) · no summary yet**Mariano-Florentino Cuéllar et al.*2024 · 2 citations* 19. **[Inference-Time Control for Trustworthy Large Language Models ↗](https://doi.org/10.20944/preprints202605.1041.v1) Preprints.org · no summary yet**Yuyang Bai et al.*2026* 20. **[DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents ↗](https://arxiv.org/abs/2605.04808) arXiv (Cornell University) · no summary yet**Zhaorun Chen et al.*2026* 21. **[Verbalizing Subliminal Learning Effects Using Text Optimization ↗](https://arxiv.org/abs/2609.16927) arXiv (Cornell University) · no summary yet**Nathan Hu, Sanmi Koyejo, Christopher E. Potts*2026* 22. **[Verifiable, Articulable, and Tacit Components of Preference ↗](https://arxiv.org/abs/2610.03025) arXiv (Cornell University) · no summary yet**Alexander Spangher et al.*2026* 23. **[Neural Nonmyopic Bayesian Optimization in Dynamic Cost Settings ↗](https://arxiv.org/abs/2601.06505) arXiv (Cornell University) · no summary yet**Sang Truong et al.*2026* 24. **[The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant Context ↗](https://arxiv.org/abs/2607.12963) arXiv (Cornell University) · no summary yet**Yanzhe Zhang, Sanmi Koyejo, Diyi Yang*2026* 25. **[Structured Prompts Improve Evaluation of Language Models ↗](https://arxiv.org/abs/2511.20836) arXiv (Cornell University) · no summary yet**Asad Aali et al.*2025* [See all 27 works by Sanmi Koyejo →](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/works/) ## Co-authors here 12 of 20 co-authors with a page, the most papers together first. - [Brando Miranda](https://md.research.elamur.ai/free/en/authors/brando-miranda/) ×2 - [Ahmet Üstün](https://md.research.elamur.ai/free/en/authors/ahmet-ustun/) - [Alex Wang](https://md.research.elamur.ai/free/en/authors/alex-wang/) - [Beyza Ermis](https://md.research.elamur.ai/free/en/authors/beyza-ermis/) - [Carlos Guestrin](https://md.research.elamur.ai/free/en/authors/carlos-guestrin/) - [Chuyue Sun](https://md.research.elamur.ai/free/en/authors/chuyue-sun/) - [Clark Barrett](https://md.research.elamur.ai/free/en/authors/clark-barrett/) - [Daniel D'Souza](https://md.research.elamur.ai/free/en/authors/daniel-d-souza/) - [Marzieh Fadaee](https://md.research.elamur.ai/free/en/authors/marzieh-fadaee/) - [Noah A. Smith](https://md.research.elamur.ai/free/en/authors/noah-a-smith/) - [Rylan Schaeffer](https://md.research.elamur.ai/free/en/authors/rylan-schaeffer/) - [Sayash Kapoor](https://md.research.elamur.ai/free/en/authors/sayash-kapoor/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) ×3: [NeurIPS 2025](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2025/), [NeurIPS 2023](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2023/) - neural information processing systems ×2 - [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/): [Lecture notes in computer science 2024](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/2024/) - Nature Machine Intelligence - Preprints.org - SSRN Electronic Journal - Science - Stanford Digital Repository ## Cited by Papers of our library cite their works 917 times (of the 149,439 papers whose bibliographies we read); [247 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/sanmi-koyejo/cited-by/). Updated 3 November 2026