---
title: "Richard S. Zemel — author profile and papers in our library"
description: "Richard S. Zemel, Columbia University: 5 papers on Elamur Research (2014–2024), h-index 63 — affiliations, topics, co-authors and who…"
canonical: "https://research.elamur.ai/free/en/authors/richard-s-zemel/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/richard-s-zemel/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Richard S. Zemel

# Richard S. Zemel

Richard S. Zemel has 5 papers in our library, in 2014–2024, most of them on [Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/), [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/); often with [Ruslan Salakhutdinov](https://md.research.elamur.ai/free/en/authors/ruslan-salakhutdinov/), [Ryan Kiros](https://md.research.elamur.ai/free/en/authors/ryan-kiros/), [Aaron Courville](https://md.research.elamur.ai/free/en/authors/aaron-courville/).

5 papers in our library · 2014–2024

[OpenAlex](https://openalex.org/A5000111344) · [ORCID](https://orcid.org/0000-0001-9353-7509) · [Wikidata](https://www.wikidata.org/wiki/Q130883746) · [**h-index 63**](https://openalex.org/authors/A5000111344) · [260 works](https://openalex.org/works?filter=author.id:A5000111344) · [33,386 citations](https://openalex.org/works?filter=author.id:A5000111344&sort=cited_by_count:desc) OpenAlex, 2026-10-14

[📄 5 works in our library](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/#papers) · [🔗 Cited 4,711 times in our library](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/cited-by/) · [210 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #233](https://md.research.elamur.ai/free/en/paper-stars/page/3/#star-233)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Richard+S.+Zemel) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Richard+S.+Zemel) · [dblp](https://dblp.org/search?q=Richard+S.+Zemel) · [ACL Anthology](https://aclanthology.org/search/?q=Richard+S.+Zemel)

## Affiliations

[🎓**Columbia University** New York · United States 2020–2026 · 19 papers*current*](https://md.research.elamur.ai/free/en/universities/columbia-university/) · [🎓**University of Toronto** Toronto · Canada 1990–2023 · 135 papers](https://md.research.elamur.ai/free/en/universities/university-of-toronto/) · [🔬**Vector Institute** Toronto · Canada 2017–2023 · 26 papers](https://md.research.elamur.ai/free/en/labs/vector-institute/) · [🔬**Canadian Institute for Advanced Research** Toronto · Canada 2014–2019 · 17 papers](https://md.research.elamur.ai/free/en/labs/canadian-institute-for-advanced-research/) · [🏢**Amazon** Seattle · United States 2022–2025 · 12 papers](https://md.research.elamur.ai/free/en/companies/amazon/) · [🎓**University of Arizona** Tucson · United States 1997–2000 · 8 papers](https://md.research.elamur.ai/free/en/universities/university-of-arizona/) · [🤝**Salk Institute for Biological Studies** La Jolla · United States 1993–1998 · 6 papers](https://ror.org/03xez1567) · [🎓**Carnegie Mellon University** Pittsburgh · United States 1994–2002 · 4 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🎓**University of Colorado Boulder** Boulder · United States 1991–2021 · 3 papers](https://md.research.elamur.ai/free/en/universities/university-of-colorado-boulder/) · [🎓**University of Rochester** Rochester · United States 2002–2003 · 3 papers](https://md.research.elamur.ai/free/en/universities/university-of-rochester/)

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 11 more institutions on single bylines are not listed.

## Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Computer Science · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Computer Vision and Pattern Recognition · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Artificial Intelligence · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Safety Research · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/)

🧭 Topics 7 Research subjects and languages the work is about.[Vision & language · 2 works](https://md.research.elamur.ai/free/en/topics/multimodal/) · [Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Bias, fairness & safety · 1 work](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · [English · 1 work](https://md.research.elamur.ai/free/en/topics/english/) · [Multilingual & cross-lingual NLP · 1 work](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · [Semitic languages · 1 work](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · [Sentiment & emotion · 1 work](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/)

## Works by year

### 2020s

[**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/year/2024/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/year/2022/)

### 2010s

[**2015** 2 papers](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/year/2015/) · [**2014** 1 paper](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/year/2014/)

## Papers

The most cited first (OpenAlex and our library).

1. **[Show, Attend and Tell: Neural Image Caption Generation with Visual Attention](https://md.research.elamur.ai/free/en/papers/xu-2015-show-attend-tell-neural-image/)** *(2015 · 7,670 citations)* The paper tackles automatic image captioning: producing a natural-language sentence that describes a photo.
2. **[Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/)** *(2015 · 3,083 citations)* The paper asks whether novels can supply rich, story-level descriptions for film footage, going far beyond the short captions found in existing vision-language datasets.
3. **[Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models](https://md.research.elamur.ai/free/en/papers/kiros-2014-unifying-visual-semantic-embeddings-multimodal/)** *(2014 · 1,371 citations)* The paper addresses automatic image description: learning to match images with sentences and to write new captions.
4. **[FLIRT: Feedback Loop In-context Red Teaming](https://md.research.elamur.ai/free/en/papers/mehrabi-2024-flirt-feedback-loop-context-red/)** *(2024 · 42 citations)* The paper tackles automated red teaming: finding inputs that push generative models into producing unsafe content, without expensive human probing.
5. **[Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabic](https://md.research.elamur.ai/free/en/papers/camara-2022-mapping-multilingual-margins-intersectional-biases/)** *(2022 · 33 citations)* The paper asks whether sentiment and emotion systems treat people differently depending on gender, race or ethnicity, and on combinations of these.

## All works

215 works of theirs in our library, the most cited first; 5 with a page here, the others link their original until we summarise them.

1. [**Show, Attend and Tell: Neural Image Caption Generation with Visual Attention arXiv:1502.03044**Kelvin Xu, Jimmy Ba, Ryan Kiros, et al.*2015 · 7,670 citations*](https://md.research.elamur.ai/free/en/papers/xu-2015-show-attend-tell-neural-image/)
2. **[Prototypical Networks for Few-shot Learning ↗](https://arxiv.org/abs/1703.05175) arXiv:1703.05175 · no summary yet**Jake Snell, Kevin Swersky, Richard S. Zemel*2017 · 5,249 citations*
3. **[Fairness through awareness ↗](https://doi.org/10.1145/2090236.2090255) no summary yet**Cynthia Dwork et al.*2012 · 3,499 citations*
4. **[Siamese Neural Networks for One-shot Image Recognition ↗](https://www.cs.toronto.edu/~rsalakhu/papers/oneshot1.pdf) ICML 2015 Deep Learning Workshop · no summary yet**Gregory Koch, Richard Zemel, Ruslan Salakhutdinov*2015 · 3,175 citations*
5. [**Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books arXiv:1506.06724**Yukun Zhu, Ryan Kiros, Richard Zemel, et al.*2015 · 3,083 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/)
6. **[Shortcut Learning in Deep Neural Networks ↗](https://doi.org/10.1038/s42256-020-00257-z) arXiv:2004.07780 · no summary yet**Robert Geirhos et al.*2020 · 2,366 citations*
7. **[Advances in Neural Information Processing Systems 5 ↗](https://openalex.org/W2598912124) no summary yet**Richard S. Zemel, Christopher K. I. Williams, Michael C. Mozer*1993 · 1,854 citations*
8. [**Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models arXiv:1411.2539**Ryan Kiros, Ruslan Salakhutdinov, Richard S. Zemel*2014 · 1,371 citations*](https://md.research.elamur.ai/free/en/papers/kiros-2014-unifying-visual-semantic-embeddings-multimodal/)
9. **[Skip-Thought Vectors ↗](https://arxiv.org/abs/1506.06726) arXiv (Cornell University) · no summary yet**Ryan Kiros et al.*2015 · 1,267 citations*
10. **[The Helmholtz Machine ↗](https://doi.org/10.1162/neco.1995.7.5.889) Neural Computation · no summary yet**Peter Dayan et al.*1995 · 1,202 citations*
11. **[Autoencoders, Minimum Description Length and Helmholtz Free Energy ↗](https://openalex.org/W2102409316) no summary yet**Geoffrey E. Hinton, Richard S. Zemel*1993 · 1,073 citations*
12. **[Multiscale conditional random fields for image labeling ↗](https://doi.org/10.1109/cvpr.2004.1315232) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Xuming He, Richard S. Zemel, Miguel Á. Carreira-Perpiñán*2004 · 838 citations*
13. **[Understanding the Effective Receptive Field in Deep Convolutional Neural Networks ↗](https://arxiv.org/abs/1701.04128) arXiv (Cornell University) · no summary yet**Wenjie Luo et al.*2017 · 771 citations*
14. **[Information processing with population codes ↗](https://doi.org/10.1038/35039062) Nature reviews. Neuroscience · no summary yet**Alexandre Pouget, Peter Dayan, Richard S. Zemel*2000 · 753 citations*
15. **[Meta-Learning for Semi-Supervised Few-Shot Classification ↗](https://arxiv.org/abs/1803.00676) arXiv (Cornell University) · no summary yet**Mengye Ren et al.*2018 · 742 citations*
16. **[Gated Graph Sequence Neural Networks ↗](https://arxiv.org/abs/1511.05493) arXiv:1511.05493 · no summary yet**Yujia Li et al.*2015 · 576 citations*
17. **[Exploring Models and Data for Image Question Answering ↗](https://arxiv.org/abs/1505.02074) arXiv:1505.02074 · no summary yet**Mengye Ren, Ryan Kiros, Richard Zemel*2015 · 455 citations*
18. **[I NFERENCE AND C OMPUTATION WITH P OPULATION C ODES ↗](https://doi.org/10.1146/annurev.neuro.26.041002.131112) Annual Review of Neuroscience · no summary yet**Alexandre Pouget, Peter Dayan, Richard S. Zemel*2003 · 434 citations*
19. **[Probabilistic Interpretation of Population Codes ↗](https://doi.org/10.1162/089976698300017818) Neural Computation · no summary yet**Richard S. Zemel, Peter Dayan, Alexandre Pouget*1998 · 324 citations*
20. **[Collaborative prediction and ranking with non-random missing data ↗](https://doi.org/10.1145/1639714.1639717) ACM Conference on Recommender Systems (RecSys) · no summary yet**Benjamin M. Marlin, Richard S. Zemel*2009 · 317 citations*
21. **[End-to-End Instance Segmentation with Recurrent Attention ↗](https://doi.org/10.1109/cvpr.2017.39) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Mengye Ren, Richard S. Zemel*2017 · 305 citations*
22. **[Causal Effect Inference with Deep Latent-Variable Models ↗](https://arxiv.org/abs/1705.08821) UvA-DARE (University of Amsterdam) · no summary yet**Christos Louizos et al.*2017 · 290 citations*
23. **[Neural Relational Inference for Interacting Systems ↗](https://hdl.handle.net/11245.1/0f5e9586-b2ff-4344-a05b-a0d82ef41414) UvA-DARE (University of Amsterdam) · no summary yet**Thomas Kipf et al.*2018 · 281 citations*
24. **[Learning Adversarially Fair and Transferable Representations ↗](https://arxiv.org/abs/1802.06309) arXiv (Cornell University) · no summary yet**David Madras et al.*2018 · 204 citations*
25. **[Object-based attention and occlusion: Evidence from normal participants and a computational model. ↗](https://doi.org/10.1037//0096-1523.24.4.1011) Journal of Experimental Psychology Human Perception & Performance · no summary yet**Marlene Behrmann, Richard S. Zemel, Michael C. Mozer*1998 · 195 citations*

[See all 215 works by Richard S. Zemel →](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/works/)

## Co-authors here

12 of 15 co-authors with a page, the most papers together first.

- [Ruslan Salakhutdinov](https://md.research.elamur.ai/free/en/authors/ruslan-salakhutdinov/) ×3
- [Ryan Kiros](https://md.research.elamur.ai/free/en/authors/ryan-kiros/) ×3
- [Aaron Courville](https://md.research.elamur.ai/free/en/authors/aaron-courville/)
- [Antonio B. Torralba](https://md.research.elamur.ai/free/en/authors/antonio-b-torralba/)
- [Aram Galstyan](https://md.research.elamur.ai/free/en/authors/aram-galstyan/)
- [Emily Allaway](https://md.research.elamur.ai/free/en/authors/emily-allaway/)
- [Jimmy Lei Ba](https://md.research.elamur.ai/free/en/authors/jimmy-lei-ba/)
- [Kai-Wei Chang](https://md.research.elamur.ai/free/en/authors/kai-wei-chang/)
- [Kelvin Xu](https://md.research.elamur.ai/free/en/authors/kelvin-xu/)
- [Kyunghyun Cho](https://md.research.elamur.ai/free/en/authors/kyunghyun-cho/)
- [Ninareh Mehrabi](https://md.research.elamur.ai/free/en/authors/ninareh-mehrabi/)
- [Palash Goyal](https://md.research.elamur.ai/free/en/authors/palash-goyal/)

## Venues

Where their works here were published, the most works first, with the editions of those that have a page.

- Neural Computation ×9
- neural information processing systems ×9
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×6
- International Conference on Machine Learning ×6
- The MIT Press eBooks ×5
- International Conference on Learning Representations ×4
- [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/) ×3: [EMNLP 2024](https://md.research.elamur.ai/free/en/venues/emnlp/2024/)
- International Conference on Artificial Intelligence and Statistics ×3
- Journal of Experimental Psychology Human Perception & Performance ×3
- Lecture notes in computer science ×3
- Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) ×3
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) ×2

## Cited by

Papers of our library cite their works 4,711 times (of the 149,439 papers whose bibliographies we read); [554 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/richard-s-zemel/cited-by/).

Updated 30 October 2026