--- title: "Geoffrey E. Hinton · Microsoft — author profile and papers" description: "Geoffrey E. Hinton, Microsoft: 6 papers on Elamur Research (2012–2020), h-index 145 — affiliations, topics, co-authors and who cites them…" canonical: "https://research.elamur.ai/free/en/authors/geoffrey-e-hinton/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/geoffrey-e-hinton/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Geoffrey E. Hinton # Geoffrey E. Hinton Geoffrey E. Hinton has 6 papers in our library, in 2012–2020; often with [Mohammad Norouzi](https://md.research.elamur.ai/free/en/authors/mohammad-norouzi/), [Simon Kornblith](https://md.research.elamur.ai/free/en/authors/simon-kornblith/), [Honglak Lee](https://md.research.elamur.ai/free/en/authors/honglak-lee/). 6 papers in our library · 2012–2020 [OpenAlex](https://openalex.org/A5108093963) · [**h-index 145**](https://openalex.org/authors/A5108093963) · [560 works](https://openalex.org/works?filter=author.id:A5108093963) · [501,635 citations](https://openalex.org/works?filter=author.id:A5108093963&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 6 works in our library](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/#papers) · [🔗 Cited 11,868 times in our library](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/cited-by/) · [60 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #66](https://md.research.elamur.ai/free/en/paper-stars/#star-66) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Geoffrey+E.+Hinton) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Geoffrey+E.+Hinton) · [dblp](https://dblp.org/search?q=Geoffrey+E.+Hinton) · [ACL Anthology](https://aclanthology.org/search/?q=Geoffrey+E.+Hinton) ## Affiliations [🎓**University of Toronto** Toronto · Canada 1987–2026 · 194 papers*current*](https://md.research.elamur.ai/free/en/universities/university-of-toronto/) · [🏢**Microsoft** Redmond · United States 2026 · 2 papers*current*](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🏢**Google** Mountain View · United States 2014–2023 · 33 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**University College London** London · United Kingdom 1999–2013 · 23 papers](https://md.research.elamur.ai/free/en/universities/university-college-london/) · [🔬**Gatsby Computational Neuroscience Unit** London · United Kingdom 1999–2013 · 20 papers](https://ror.org/0269epf40) · [🎓**Carnegie Mellon University** Pittsburgh · United States 1983–1988 · 19 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🔬**Canadian Institute for Advanced Research** Toronto · Canada 1989–2005 · 7 papers](https://md.research.elamur.ai/free/en/labs/canadian-institute-for-advanced-research/) · [🔬**Vector Institute** Toronto · Canada 2019–2024 · 6 papers](https://md.research.elamur.ai/free/en/labs/vector-institute/) · [🏢**Google DeepMind** London · United Kingdom 2016–2023 · 3 papers](https://md.research.elamur.ai/free/en/companies/google-deepmind/) · [🎓**University of California San Diego** San Diego · United States 1979–1980 · 3 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-san-diego/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 8 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Computer Science · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/mathematics/) 💡 Concepts 3 Key ideas and methods explained on our concept pages.[Artificial intelligence · 1 work](https://md.research.elamur.ai/free/en/concepts/artificial-intelligence/) · [Machine learning · 1 work](https://md.research.elamur.ai/free/en/concepts/machine-learning/) · [Natural language processing · 1 work](https://md.research.elamur.ai/free/en/concepts/natural-language-processing/) ## Works by year ### 2020s [**2020** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2020/) ### 2010s [**2019** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2019/) · [**2017** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2017/) · [**2016** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2016/) · [**2015** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2015/) · [**2012** 1 paper](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/year/2012/) ## Papers The most cited first (OpenAlex and our library). 1. **[Distilling the Knowledge in a Neural Network](https://md.research.elamur.ai/free/en/papers/hinton-2015-distilling-knowledge-neural-network/)** *(2015 · 15,229 citations)* Averaging many models or training one huge, heavily regularized net gives strong accuracy, but such systems are too slow and expensive to serve to many users. 2. **[A Simple Framework for Contrastive Learning of Visual Representations](https://md.research.elamur.ai/free/en/papers/chen-2020-simple-framework-contrastive-learning-visual/)** *(2020 · 8,000 citations)* The paper asks how far a deliberately plain recipe can take self-supervised image representation learning. 3. **[ImageNet Classification with Deep Convolutional Neural Networks](https://md.research.elamur.ai/free/en/papers/krizhevsky-2012-imagenet-classification-deep-convolutional/)** *(2012 · 2,801 citations)* The authors worked on image classification from the ImageNet LSVRC-2010 contest. The training set contained about 1.2 million photographs in 1000 classes. They built a deep convolutional network (CNN) with five convolutional and three fully connected layers. The network has approximately 60 million parameters. To… 4. **[Layer Normalization](https://md.research.elamur.ai/free/en/papers/ba-2016-layer-normalization/)** *(2016 · 1,819 citations)* Batch normalization speeds up training of deep networks, but it estimates its statistics from the mini-batch. 5. **[Similarity of Neural Network Representations Revisited](https://md.research.elamur.ai/free/en/papers/kornblith-2019-similarity-neural-network-representations-revisited/)** *(2019 · 679 citations)* The paper asks how to tell whether two neural network layers, inside one model or across separately trained models, encode the same information. 6. **[Regularizing Neural Networks by Penalizing Confident Output Distributions](https://md.research.elamur.ai/free/en/papers/pereyra-2017-regularizing-neural-networks-penalizing-confident/)** *(2017 · 496 citations)* Most regularizers for deep networks work on weights or hidden activations. This paper regularizes the output distribution instead. The authors add a confidence penalty to the training loss: the negative log-likelihood minus β times the entropy of the softmax prediction, which discourages overly peaked outputs. They… ## All works 66 works of theirs in our library, the most cited first; 6 with a page here, the others link their original until we summarise them. 1. **[Dropout: A Simple Way to Prevent Neural Networks from Overfitting ↗](https://jmlr.org/papers/v15/srivastava14a.html) JMLR 15(56):1929–1958 · no summary yet**Nitish Srivastava et al.*2014 · 34,422 citations* 2. **[Reducing the Dimensionality of Data with Neural Networks ↗](https://doi.org/10.1126/science.1127647) Science · no summary yet**Geoffrey E. Hinton, Ruslan Salakhutdinov*2006 · 21,029 citations* 3. [**Distilling the Knowledge in a Neural Network arXiv:1503.02531**Geoffrey Hinton, Oriol Vinyals, Jeff Dean*2015 · 15,229 citations*](https://md.research.elamur.ai/free/en/papers/hinton-2015-distilling-knowledge-neural-network/) 4. **[Speech recognition with deep recurrent neural networks ↗](https://doi.org/10.1109/icassp.2013.6638947) IEEE International Conference on Acoustics Speech and Signal Processing · no summary yet**Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton*2013 · 8,998 citations* 5. [**A Simple Framework for Contrastive Learning of Visual Representations arXiv:2002.05709**Ting Chen, Simon Kornblith, Mohammad Norouzi, et al.*2020 · 8,000 citations*](https://md.research.elamur.ai/free/en/papers/chen-2020-simple-framework-contrastive-learning-visual/) 6. **[Improving neural networks by preventing co-adaptation of feature detectors ↗](https://arxiv.org/abs/1207.0580) arXiv:1207.0580 · no summary yet**Geoffrey E. Hinton et al.*2012 · 6,645 citations* 7. [**ImageNet Classification with Deep Convolutional Neural Networks NeurIPS 2012**Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton*2012 · 2,801 citations*](https://md.research.elamur.ai/free/en/papers/krizhevsky-2012-imagenet-classification-deep-convolutional/) 8. **[Restricted Boltzmann machines for collaborative filtering ↗](https://doi.org/10.1145/1273496.1273596) International Conference on Machine Learning · no summary yet**Ruslan Salakhutdinov, Andriy Mnih, Geoffrey E. Hinton*2007 · 1,865 citations* 9. [**Layer Normalization arXiv:1607.06450**Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton*2016 · 1,819 citations*](https://md.research.elamur.ai/free/en/papers/ba-2016-layer-normalization/) 10. **[Deep Boltzmann machines ↗](https://openalex.org/W189596042) no summary yet**Ruslan Salakhutdinov, Geoffrey E. Hinton*2009 · 1,728 citations* 11. **[Neighbourhood Components Analysis ↗](https://openalex.org/W2144935315) no summary yet**Jacob Goldberger et al.*2004 · 1,676 citations* 12. **[The Helmholtz Machine ↗](https://doi.org/10.1162/neco.1995.7.5.889) Neural Computation · no summary yet**Peter Dayan et al.*1995 · 1,202 citations* 13. **[Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer ↗](https://arxiv.org/abs/1701.06538) arXiv:1701.06538 · no summary yet**Noam Shazeer et al.*2017 · 1,111 citations* 14. **[Autoencoders, Minimum Description Length and Helmholtz Free Energy ↗](https://openalex.org/W2102409316) no summary yet**Geoffrey E. Hinton, Richard S. Zemel*1993 · 1,073 citations* 15. **[Grammar as a Foreign Language ↗](https://arxiv.org/abs/1412.7449) arXiv:1412.7449 · no summary yet**Oriol Vinyals et al.*2014 · 687 citations* 16. [**Similarity of Neural Network Representations Revisited arXiv:1905.00414**Simon Kornblith, Mohammad Norouzi, Honglak Lee, et al.*2019 · 679 citations*](https://md.research.elamur.ai/free/en/papers/kornblith-2019-similarity-neural-network-representations-revisited/) 17. **[A Simple Way to Initialize Recurrent Networks of Rectified Linear Units ↗](https://arxiv.org/abs/1504.00941) arXiv (Cornell University) · no summary yet**Quoc Viet Le, Navdeep Jaitly, Geoffrey E. Hinton*2015 · 571 citations* 18. [**Regularizing Neural Networks by Penalizing Confident Output Distributions arXiv:1701.06548**Gabriel Pereyra, George Tucker, Jan Chorowski, et al.*2017 · 496 citations*](https://md.research.elamur.ai/free/en/papers/pereyra-2017-regularizing-neural-networks-penalizing-confident/) 19. **[An Efficient Learning Procedure for Deep Boltzmann Machines ↗](https://doi.org/10.1162/neco_a_00311) Neural Computation · no summary yet**Ruslan Salakhutdinov, Geoffrey E. Hinton*2012 · 485 citations* 20. **[Replicated Softmax: an Undirected Topic Model ↗](https://openalex.org/W2100002341) neural information processing systems · no summary yet**Geoffrey E. Hinton, Ruslan Salakhutdinov*2009 · 443 citations* 21. **[On rectified linear units for speech processing ↗](https://doi.org/10.1109/icassp.2013.6638312) IEEE International Conference on Acoustics Speech and Signal Processing · no summary yet**Matthew D. Zeiler et al.*2013 · 440 citations* 22. **[Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure ↗](https://openalex.org/W205159212) no summary yet**Ruslan Salakhutdinov, Geoffrey E. Hinton*2007 · 434 citations* 23. **[Exponential Family Harmoniums with an Application to Information Retrieval ↗](https://openalex.org/W2124914669) no summary yet**Max Welling, Michal Rosen‐Zvi, Geoffrey E. Hinton*2004 · 413 citations* 24. **[Managing extreme AI risks amid rapid progress ↗](https://doi.org/10.1126/science.adn0117) Science · no summary yet**Yoshua Bengio et al.*2024 · 382 citations* 25. **[Lookahead Optimizer: k steps forward, 1 step back ↗](https://arxiv.org/abs/1907.08610) arXiv (Cornell University) · no summary yet**Michael R. Zhang et al.*2019 · 380 citations* [See all 66 works by Geoffrey E. Hinton →](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/works/) ## Co-authors here 11 co-authors with a page, the most papers together first. - [Mohammad Norouzi](https://md.research.elamur.ai/free/en/authors/mohammad-norouzi/) ×2 - [Simon Kornblith](https://md.research.elamur.ai/free/en/authors/simon-kornblith/) ×2 - [Honglak Lee](https://md.research.elamur.ai/free/en/authors/honglak-lee/) - [Ilya Sutskever](https://md.research.elamur.ai/free/en/authors/ilya-sutskever/) - [Jamie Kiros](https://md.research.elamur.ai/free/en/authors/jamie-kiros/) - [Jan Chorowski](https://md.research.elamur.ai/free/en/authors/jan-chorowski/) - [Jeff Dean](https://md.research.elamur.ai/free/en/authors/jeff-dean/) - [Jimmy Lei Ba](https://md.research.elamur.ai/free/en/authors/jimmy-lei-ba/) - [Łukasz Kaiser](https://md.research.elamur.ai/free/en/authors/lukasz-kaiser/) - [Oriol Vinyals](https://md.research.elamur.ai/free/en/authors/oriol-vinyals/) - [Ting Chen](https://md.research.elamur.ai/free/en/authors/ting-chen/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - Neural Computation ×5 - neural information processing systems ×4 - International Conference on Machine Learning ×3 - IEEE International Conference on Acoustics Speech and Signal Processing ×2 - Science ×2 - Cognitive Science - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Transactions on Neural Networks - JMLR 15(56):1929–1958 - Lecture notes in computer science - NeurIPS 2012 - The MIT Press eBooks ## Cited by Papers of our library cite their works 11,868 times (of the 149,439 papers whose bibliographies we read); [1,026 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/geoffrey-e-hinton/cited-by/). Updated 1 November 2026