---
title: "Rebecca Roelofs — author profile and papers"
description: "Rebecca Roelofs: 2 papers on Elamur Research (2022–2024) — affiliations, topics, co-authors and who cites them in our library."
canonical: "https://research.elamur.ai/free/en/authors/rebecca-roelofs/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/rebecca-roelofs/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Rebecca Roelofs

# Rebecca Roelofs

2 papers on this site · 2022–2024

Rebecca Roelofs has 2 papers on this site, in 2022–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Ali Farhadi](https://md.research.elamur.ai/free/en/authors/ali-farhadi/), [Ari S. Morcos](https://md.research.elamur.ai/free/en/authors/ari-s-morcos/), [Avi Singh](https://md.research.elamur.ai/free/en/authors/avi-singh/).

No OpenAlex profile matched yet.

[2 works on this site](https://md.research.elamur.ai/free/en/authors/rebecca-roelofs/#papers) · [420 citations in our library](https://md.research.elamur.ai/free/en/authors/rebecca-roelofs/cited-by/)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Rebecca+Roelofs) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Rebecca+Roelofs) · [dblp](https://dblp.org/search?q=Rebecca+Roelofs) · [ACL Anthology](https://aclanthology.org/search/?q=Rebecca+Roelofs)

## Topics

[Language models & pretraining 1](https://md.research.elamur.ai/free/en/topics/language-models/)

## Works by year

### 2020s

[**2024** 1 paper](https://md.research.elamur.ai/free/en/papers/kumar-2024-training-language-models-self-correct/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/papers/wortsman-2022-model-soups-averaging-weights-multiple/)

## Papers

The most cited first (OpenAlex and our library).

1. **[Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time](https://md.research.elamur.ai/free/en/papers/wortsman-2022-model-soups-averaging-weights-multiple/)** *(2022 · 474 citations)* When fine-tuning a large pre-trained network, the usual practice is to run a hyperparameter sweep, keep the single checkpoint that scores best on validation data, and discard the rest.
2. **[Training Language Models to Self-Correct via Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/kumar-2024-training-language-models-self-correct/)** *(2024 · 151 citations)* Large language models rarely fix their own mistakes when they get no outside feedback, a setting called intrinsic self-correction.

## Co-authors here

12 of 13 co-authors with a page, the most papers together first.

- [Ali Farhadi](https://md.research.elamur.ai/free/en/authors/ali-farhadi/)
- [Ari S. Morcos](https://md.research.elamur.ai/free/en/authors/ari-s-morcos/)
- [Avi Singh](https://md.research.elamur.ai/free/en/authors/avi-singh/)
- [Aviral Kumar](https://md.research.elamur.ai/free/en/authors/aviral-kumar/)
- [Gabriel Ilharco](https://md.research.elamur.ai/free/en/authors/gabriel-ilharco/)
- [John D Co-Reyes](https://md.research.elamur.ai/free/en/authors/john-d-co-reyes/)
- [Lei M Zhang](https://md.research.elamur.ai/free/en/authors/lei-m-zhang/)
- [Ludwig Schmidt](https://md.research.elamur.ai/free/en/authors/ludwig-schmidt/)
- [Mitchell Wortsman](https://md.research.elamur.ai/free/en/authors/mitchell-wortsman/)
- [Rishabh Agarwal](https://md.research.elamur.ai/free/en/authors/rishabh-agarwal/)
- [Samir Yitzhak Gadre](https://md.research.elamur.ai/free/en/authors/samir-yitzhak-gadre/)
- [Simon Kornblith](https://md.research.elamur.ai/free/en/authors/simon-kornblith/)

## Cited by

Papers of our library cite their works 420 times (of the 140 884 papers whose bibliographies we read); [24 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/rebecca-roelofs/cited-by/).