--- title: "Jack W. Rae — author profile and papers — Elamur Research" description: "Jack W. Rae: 2 papers on Elamur Research (2019), h-index 22 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/jack-w-rae/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/jack-w-rae/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Jack W. Rae # Jack W. Rae Jack W. Rae has 2 papers in our library, in 2019, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/), [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/); often with [Anna Potapenko](https://md.research.elamur.ai/free/en/authors/anna-potapenko/), [Dani Yogatama](https://md.research.elamur.ai/free/en/authors/dani-yogatama/), [Huan Zhang](https://md.research.elamur.ai/free/en/authors/huan-zhang/). 2 papers in our library · 2019 [OpenAlex](https://openalex.org/A5008158115) · [**h-index 22**](https://openalex.org/authors/A5008158115) · [31 works](https://openalex.org/works?filter=author.id:A5008158115) · [3,891 citations](https://openalex.org/works?filter=author.id:A5008158115&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/jack-w-rae/#papers) · [🔗 Cited 17,168 times in our library](https://md.research.elamur.ai/free/en/authors/jack-w-rae/cited-by/) · [7 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4558](https://md.research.elamur.ai/free/en/paper-stars/page/46/#star-4558) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Jack+W.+Rae) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Jack+W.+Rae) · [dblp](https://dblp.org/search?q=Jack+W.+Rae) · [ACL Anthology](https://aclanthology.org/search/?q=Jack+W.+Rae) ## Affiliations [🏢**Google** Mountain View · United States 2016–2022 · 12 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🏢**Google DeepMind** London · United Kingdom 2016–2021 · 10 papers](https://md.research.elamur.ai/free/en/companies/google-deepmind/) · [🎓**University College London** London · United Kingdom 2018–2021 · 9 papers](https://md.research.elamur.ai/free/en/universities/university-college-london/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Safety Research · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/) 🧭 Topics 3 Research subjects and languages the work is about.[Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Sentiment & emotion · 1 work](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) ## Works by year ### 2010s [**2019** 2 papers](https://md.research.elamur.ai/free/en/authors/jack-w-rae/year/2019/) ## Papers The most cited first (OpenAlex and our library). 1. **[Compressive Transformers for Long-Range Sequence Modelling](https://md.research.elamur.ai/free/en/papers/rae-2019-compressive-transformers-long-range-sequence/)** *(2019 · 340 citations)* Transformer language models keep detailed activations of past tokens, but storing and attending over long histories gets expensive. 2. **[Reducing Sentiment Bias in Language Models via Counterfactual Evaluation](https://md.research.elamur.ai/free/en/papers/huang-2019-reducing-sentiment-bias-language-models/)** *(2019 · 104 citations)* The paper examines whether text produced by large language models carries sentiment bias, where the tone of a continuation shifts depending on which country, occupation or person name appears in the prompt. ## All works 9 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Scaling Language Models: Methods, Analysis & Insights from Training Gopher ↗](https://arxiv.org/abs/2112.11446) arXiv:2112.11446 · no summary yet**Jack W. Rae et al.*2021 · 928 citations* 2. **[Improving language models by retrieving from trillions of tokens ↗](https://arxiv.org/abs/2112.04426) arXiv:2112.04426 · no summary yet**Sebastian Borgeaud et al.*2021 · 869 citations* 3. [**Compressive Transformers for Long-Range Sequence Modelling arXiv:1911.05507**Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.*2019 · 340 citations*](https://md.research.elamur.ai/free/en/papers/rae-2019-compressive-transformers-long-range-sequence/) 4. **[Unsupervised Predictive Memory in a Goal-Directed Agent ↗](https://arxiv.org/abs/1803.10760) arXiv (Cornell University) · no summary yet**Greg Wayne et al.*2018 · 140 citations* 5. **[Unified Scaling Laws for Routed Language Models ↗](https://arxiv.org/abs/2202.01169) arXiv (Cornell University) · no summary yet**Aidan Clark et al.*2022 · 111 citations* 6. [**Reducing Sentiment Bias in Language Models via Counterfactual Evaluation arXiv:1911.03064**Po-Sen Huang, Huan Zhang, Ray Jiang, et al.*2019 · 104 citations*](https://md.research.elamur.ai/free/en/papers/huang-2019-reducing-sentiment-bias-language-models/) 7. **[Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes ↗](https://arxiv.org/abs/1610.09027) arXiv (Cornell University) · no summary yet**Jack W. Rae et al.*2016 · 81 citations* 8. **[Relational recurrent neural networks ↗](https://arxiv.org/abs/1806.01822) arXiv (Cornell University) · no summary yet**Adam Santoro et al.*2018 · 43 citations* 9. **[Memory-based Parameter Adaptation ↗](https://arxiv.org/abs/1802.10542) arXiv (Cornell University) · no summary yet**Pablo Sprechmann et al.*2018 · 42 citations* ## Co-authors here 9 co-authors with a page, the most papers together first. - [Anna Potapenko](https://md.research.elamur.ai/free/en/authors/anna-potapenko/) - [Dani Yogatama](https://md.research.elamur.ai/free/en/authors/dani-yogatama/) - [Huan Zhang](https://md.research.elamur.ai/free/en/authors/huan-zhang/) - [Johannes Welbl](https://md.research.elamur.ai/free/en/authors/johannes-welbl/) - [Po-Sen Huang](https://md.research.elamur.ai/free/en/authors/po-sen-huang/) - [Pushmeet Kohli](https://md.research.elamur.ai/free/en/authors/pushmeet-kohli/) - [Robert Stanforth](https://md.research.elamur.ai/free/en/authors/robert-stanforth/) - [Timothy Lillicrap](https://md.research.elamur.ai/free/en/authors/timothy-lillicrap/) - [Vishal Maini](https://md.research.elamur.ai/free/en/authors/vishal-maini/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) ## Cited by Papers of our library cite their works 17,168 times (of the 149,439 papers whose bibliographies we read); [3,050 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/jack-w-rae/cited-by/). Updated 2 November 2026