--- title: "Marcin Andrychowicz · Google — author profile and papers" description: "Marcin Andrychowicz, Google: 2 papers on Elamur Research (2015–2017), h-index 23 — affiliations, topics, co-authors and who cites them in…" canonical: "https://research.elamur.ai/free/en/authors/marcin-andrychowicz/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/marcin-andrychowicz/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Marcin Andrychowicz # Marcin Andrychowicz Marcin Andrychowicz has 2 papers in our library, in 2015–2017; often with [Alex Ray](https://md.research.elamur.ai/free/en/authors/alex-ray/), [Ilya Sutskever](https://md.research.elamur.ai/free/en/authors/ilya-sutskever/), [Pieter Abbeel](https://md.research.elamur.ai/free/en/authors/pieter-abbeel/). 2 papers in our library · 2015–2017 [OpenAlex](https://openalex.org/A5091819924) · [**h-index 23**](https://openalex.org/authors/A5091819924) · [41 works](https://openalex.org/works?filter=author.id:A5091819924) · [4,817 citations](https://openalex.org/works?filter=author.id:A5091819924&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/marcin-andrychowicz/#papers) · [🔗 Cited 348 times in our library](https://md.research.elamur.ai/free/en/authors/marcin-andrychowicz/cited-by/) · [7 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4525](https://md.research.elamur.ai/free/en/paper-stars/page/46/#star-4525) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Marcin+Andrychowicz) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Marcin+Andrychowicz) · [dblp](https://dblp.org/search?q=Marcin+Andrychowicz) · [ACL Anthology](https://aclanthology.org/search/?q=Marcin+Andrychowicz) ## Affiliations [🏢**Google** Mountain View · United States 2015–2023 · 10 papers*current*](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**University of Warsaw** Warsaw · Poland 2012–2016 · 15 papers](https://md.research.elamur.ai/free/en/universities/university-of-warsaw/) · [🏢**OpenAI** San Francisco · United States 2017–2018 · 3 papers](https://md.research.elamur.ai/free/en/companies/openai/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Control and Systems Engineering · 1 work](https://md.research.elamur.ai/free/en/shelves/engineering/control-and-systems-engineering/) · [Engineering · 1 work](https://md.research.elamur.ai/free/en/shelves/engineering/) · [Biochemistry, Genetics and Molecular Biology · 1 work](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/) · [Computational Theory and Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computational-theory-and-mathematics/) · [Molecular Biology · 1 work](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/molecular-biology/) ## Works by year ### 2010s [**2017** 1 paper](https://md.research.elamur.ai/free/en/authors/marcin-andrychowicz/year/2017/) · [**2015** 1 paper](https://md.research.elamur.ai/free/en/authors/marcin-andrychowicz/year/2015/) ## Papers The most cited first (OpenAlex and our library). 1. **[Hindsight Experience Replay](https://md.research.elamur.ai/free/en/papers/andrychowicz-2017-hindsight-experience-replay/)** *(2017 · 421 citations)* Reinforcement learning (RL) struggles with tasks in which the reward is sparse and binary. The agent almost never observes success, so developers have to hand-craft complex reward functions. The authors from OpenAI propose Hindsight Experience Replay (HER). This technique makes it possible to learn from failed… 2. **[Neural Random-Access Machines](https://md.research.elamur.ai/free/en/papers/kurach-2015-neural-random-access-machines/)** *(2015 · 50 citations)* Kurach, Andrychowicz and Sutskever (Google) ask whether a neural network can learn pointer-based algorithms, which store addresses, follow them and edit memory, using only input-output pairs and backpropagation. ## All works 9 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Overcoming Exploration in Reinforcement Learning with Demonstrations ↗](https://doi.org/10.1109/icra.2018.8463162) Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · no summary yet**Ashvin Nair et al.*2018 · 708 citations* 2. **[Solving Rubik's Cube with a Robot Hand ↗](https://arxiv.org/abs/1910.07113) arXiv:1910.07113 · no summary yet**OpenAI et al.*2019 · 647 citations* 3. [**Hindsight Experience Replay arXiv:1707.01495**Marcin Andrychowicz, Filip Wolski, Alex Ray, et al.*2017 · 421 citations*](https://md.research.elamur.ai/free/en/papers/andrychowicz-2017-hindsight-experience-replay/) 4. **[Asymmetric Actor Critic for Image-Based Robot Learning ↗](https://doi.org/10.15607/rss.2018.xiv.008) arXiv:1710.06542 · no summary yet**Lerrel Pinto et al.*2018 · 370 citations* 5. **[Parameter Space Noise for Exploration ↗](https://arxiv.org/abs/1706.01905) arXiv (Cornell University) · no summary yet**Matthias Plappert et al.*2017 · 370 citations* 6. **[One-Shot Imitation Learning ↗](https://openalex.org/W2963094133) neural information processing systems · no summary yet**Yan Duan et al.*2017 · 235 citations* 7. **[Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research ↗](https://arxiv.org/abs/1802.09464) arXiv (Cornell University) · no summary yet**Matthias Plappert et al.*2018 · 192 citations* 8. **[Domain Randomization and Generative Models for Robotic Grasping ↗](https://doi.org/10.1109/iros.2018.8593933) IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · no summary yet**Joshua Tobin et al.*2018 · 160 citations* 9. [**Neural Random-Access Machines arXiv:1511.06392**Karol Kurach, Marcin Andrychowicz, Ilya Sutskever*2015 · 50 citations*](https://md.research.elamur.ai/free/en/papers/kurach-2015-neural-random-access-machines/) ## Co-authors here 4 co-authors with a page, the most papers together first. - [Alex Ray](https://md.research.elamur.ai/free/en/authors/alex-ray/) - [Ilya Sutskever](https://md.research.elamur.ai/free/en/authors/ilya-sutskever/) - [Pieter Abbeel](https://md.research.elamur.ai/free/en/authors/pieter-abbeel/) - [Wojciech Zaremba](https://md.research.elamur.ai/free/en/authors/wojciech-zaremba/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) - Proceedings - IEEE International Conference on Robotics and Automation/Proceedings - neural information processing systems ## Cited by Papers of our library cite their works 348 times (of the 149,439 papers whose bibliographies we read); [59 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/marcin-andrychowicz/cited-by/). Updated 3 November 2026