--- title: "Rafael Rafailov · Stanford University — author profile and papers" description: "Rafael Rafailov, Stanford University: 2 papers on Elamur Research (2023–2024), h-index 12 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/rafael-rafailov/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/rafael-rafailov/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Rafael Rafailov # Rafael Rafailov Rafael Rafailov has 2 papers in our library, in 2023–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Chelsea Finn](https://md.research.elamur.ai/free/en/authors/chelsea-finn/), [Stefano Ermon](https://md.research.elamur.ai/free/en/authors/stefano-ermon/), [Christopher D. Manning](https://md.research.elamur.ai/free/en/authors/christopher-d-manning/). 2 papers in our library · 2023–2024 [OpenAlex](https://openalex.org/A5028522433) · [**h-index 12**](https://openalex.org/authors/A5028522433) · [53 works](https://openalex.org/works?filter=author.id:A5028522433) · [1,303 citations](https://openalex.org/works?filter=author.id:A5028522433&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/rafael-rafailov/#papers) · [🔗 Cited 2,855 times in our library](https://md.research.elamur.ai/free/en/authors/rafael-rafailov/cited-by/) · [7 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #968](https://md.research.elamur.ai/free/en/paper-stars/page/10/#star-968) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Rafael+Rafailov) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Rafael+Rafailov) · [dblp](https://dblp.org/search?q=Rafael+Rafailov) · [ACL Anthology](https://aclanthology.org/search/?q=Rafael+Rafailov) ## Affiliations [🎓**Stanford University** Stanford · United States 2020–2026 · 33 papers*current*](https://md.research.elamur.ai/free/en/universities/stanford-university/) · [🏢**Google DeepMind** London · United Kingdom 2023–2024 · 2 papers](https://md.research.elamur.ai/free/en/companies/google-deepmind/) · [🎓**Harvard University** Cambridge · United States 2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/harvard-university/) · [🎓**University of California, Berkeley** Berkeley · United States 2012–2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 5 more institutions on single bylines are not listed. ## Concepts, shelves and topics Of its works in our library: the number of works on each and its rating among them. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) 💡 Concepts 1 Key ideas and methods explained on our concept pages.[Language model · 1 work](https://md.research.elamur.ai/free/en/concepts/language-model/) ## Works by year ### 2020s [**2024** 1 paper Disentangling Length from Quality in Direct Preference Optimization](https://md.research.elamur.ai/free/en/papers/park-2024-disentangling-length-quality-direct-preference/) · [**2023** 1 paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/) ## Papers The most cited first (OpenAlex and our library). 1. **[Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/)** *(2023 · 2,775 citations)* The paper proposes a way to align a large language model with human preferences without the complex RLHF pipeline. 2. **[Disentangling Length from Quality in Direct Preference Optimization](https://md.research.elamur.ai/free/en/papers/park-2024-disentangling-length-quality-direct-preference/)** *(2024 · 99 citations)* The paper looks at verbosity exploitation in Direct Preference Optimization (DPO). Classical RLHF is known to push models toward longer answers, but this had not been studied for DPO, which trains offline and has no explicit reward model. Existing length-control methods therefore cannot be applied to it directly. ## All works 9 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. [**Direct Preference Optimization: Your Language Model is Secretly a Reward Model arXiv:2305.18290**Rafael Rafailov, Archit Sharma, Eric Mitchell, et al.*2023 · 2,775 citations*](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/) 2. **[Disentangling Length from Quality in Direct Preference Optimization](https://md.research.elamur.ai/free/en/papers/park-2024-disentangling-length-quality-direct-preference/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Ryan Park, Rafael Rafailov, Stefano Ermon, et al.*2024 · 99 citations* 3. **[From r to Q*: Your Language Model is Secretly a Q-Function](https://arxiv.org/abs/2404.12358) arXiv:2404.12358 · original ↗ · no summary yet**Rafael Rafailov et al.*2024 · 67 citations* 4. **[Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents](https://arxiv.org/abs/2408.07199) arXiv:2408.07199 · original ↗ · no summary yet**Pranav Putta et al.*2024 · 57 citations* 5. **[Generative Reward Models](https://arxiv.org/abs/2410.12832) arXiv:2410.12832 · original ↗ · no summary yet**Dakota Mahan et al.*2024 · 55 citations* 6. **[Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thought](https://arxiv.org/abs/2501.04682) arXiv:2501.04682 · original ↗ · no summary yet**Violet Xiang et al.*2025 · 44 citations* 7. **[Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models](https://arxiv.org/abs/2502.17387) arXiv:2502.17387 · original ↗ · no summary yet**Alon Albalak et al.*2025 · 42 citations* 8. **[An Emulator for Fine-Tuning Large Language Models using Small Language Models](https://arxiv.org/abs/2310.12962) arXiv:2310.12962 · original ↗ · no summary yet**Eric Mitchell et al.*2023 · 33 citations* 9. **[Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels](https://arxiv.org/abs/2404.14313) arXiv:2404.14313 · original ↗ · no summary yet**Jan-Philipp Franken et al.*2024 · 15 citations* ## Co-authors here 4 co-authors with a page, the most papers together first. - [Chelsea Finn](https://md.research.elamur.ai/free/en/authors/chelsea-finn/) ×2 - [Stefano Ermon](https://md.research.elamur.ai/free/en/authors/stefano-ermon/) ×2 - [Christopher D. Manning](https://md.research.elamur.ai/free/en/authors/christopher-d-manning/) - [Eric Mitchell](https://md.research.elamur.ai/free/en/authors/eric-mitchell/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/): [Findings of the Association for Computational Linguistics 2024](https://md.research.elamur.ai/free/en/venues/findings/2024/) ## Cited by Papers of our library cite their works 2,855 times (of the 141,840 papers whose bibliographies we read); [145 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/rafael-rafailov/cited-by/). Updated 24 October 2026