--- title: "Pablo Samuel Castro — author profile and papers in our library" description: "Pablo Samuel Castro, Mila - Quebec Artificial Intelligence Institute: 2 papers on Elamur Research (2021–2023), h-index 20 — affiliations, topics…" canonical: "https://research.elamur.ai/free/en/authors/pablo-samuel-castro/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/pablo-samuel-castro/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Pablo Samuel Castro # Pablo Samuel Castro Pablo Samuel Castro has 2 papers in our library, in 2021–2023; often with [Aaron Courville](https://md.research.elamur.ai/free/en/authors/aaron-courville/), [Jordan Terry](https://md.research.elamur.ai/free/en/authors/jordan-terry/), [Lucas Willems](https://md.research.elamur.ai/free/en/authors/lucas-willems/). 2 papers in our library · 2021–2023 [OpenAlex](https://openalex.org/A5068291173) · [ORCID](https://orcid.org/0000-0002-3206-336X) · [**h-index 20**](https://openalex.org/authors/A5068291173) · [103 works](https://openalex.org/works?filter=author.id:A5068291173) · [2,055 citations](https://openalex.org/works?filter=author.id:A5068291173&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/pablo-samuel-castro/#papers) · [🔗 Cited 80 times in our library](https://md.research.elamur.ai/free/en/authors/pablo-samuel-castro/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #8069](https://md.research.elamur.ai/free/en/paper-stars/page/81/#star-8069) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Pablo+Samuel+Castro) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Pablo+Samuel+Castro) · [dblp](https://dblp.org/search?q=Pablo+Samuel+Castro) · [ACL Anthology](https://aclanthology.org/search/?q=Pablo+Samuel+Castro) ## Affiliations [🎓**Université de Montréal** Montreal · Canada 2021–2026 · 19 papers*current*](https://md.research.elamur.ai/free/en/universities/universite-de-montreal/) · [🔬**Mila - Quebec Artificial Intelligence Institute** Montreal · Canada 2024–2026 · 14 papers*current*](https://md.research.elamur.ai/free/en/labs/mila-quebec-artificial-intelligence-institute/) · [🏢**Google** Mountain View · United States 2013–2025 · 31 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**McGill University** Montreal · Canada 2007–2024 · 10 papers](https://md.research.elamur.ai/free/en/universities/mcgill-university/) · [🎓**Télécom SudParis** Évry-Courcouronnes · France 2012–2015 · 6 papers](https://md.research.elamur.ai/free/en/universities/telecom-sudparis/) · [🔬**Centre National de la Recherche Scientifique** Paris · France 2012–2015 · 4 papers](https://md.research.elamur.ai/free/en/labs/centre-national-de-la-recherche-scientifique/) · [🔬**Institut Mines-Télécom** Palaiseau · France 2012–2013 · 3 papers](https://ror.org/025vp2923) · [🔬**Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux** Évry-Courcouronnes · France 2012–2013 · 3 papers](https://ror.org/05d29yv45) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 2 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/pablo-samuel-castro/year/2023/) · [**2021** 1 paper](https://md.research.elamur.ai/free/en/authors/pablo-samuel-castro/year/2021/) ## Papers The most cited first (OpenAlex and our library). 1. **[Deep Reinforcement Learning at the Edge of the Statistical Precipice](https://md.research.elamur.ai/free/en/papers/agarwal-2021-deep-reinforcement-learning-edge-statistical/)** *(2021 · 90 citations)* The authors examine how reliably algorithms are compared in deep RL when only a few runs per task are available. 2. **[Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks](https://md.research.elamur.ai/free/en/papers/chevalier-boisvert-2023-minigrid-miniworld-modular-customizable-reinforcement/)** *(2023 · 25 citations)* Popular RL benchmark suites such as Gym and dm_control mostly test motor control or visual perception. They are poorly suited to studying goal-directed reasoning or instruction following, and adding new objectives to them is hard. The authors present Minigrid, a collection of 2D GridWorld tasks, and Miniworld, a set… ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Autonomous navigation of stratospheric balloons using reinforcement learning ↗](https://doi.org/10.1038/s41586-020-2939-8) Nature · no summary yet**Marc G. Bellemare et al.*2020 · 296 citations* 2. [**Deep Reinforcement Learning at the Edge of the Statistical Precipice arXiv:2108.13264**Rishabh Agarwal, Max Schwarzer, Pablo Samuel Castro, et al.*2021 · 90 citations*](https://md.research.elamur.ai/free/en/papers/agarwal-2021-deep-reinforcement-learning-edge-statistical/) 3. [**Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks arXiv:2306.13831**Maxime Chevalier-Boisvert, Bolun Dai, Mark Towers, et al.*2023 · 25 citations*](https://md.research.elamur.ai/free/en/papers/chevalier-boisvert-2023-minigrid-miniworld-modular-customizable-reinforcement/) ## Co-authors here 8 co-authors with a page, the most papers together first. - [Aaron Courville](https://md.research.elamur.ai/free/en/authors/aaron-courville/) - [Jordan Terry](https://md.research.elamur.ai/free/en/authors/jordan-terry/) - [Lucas Willems](https://md.research.elamur.ai/free/en/authors/lucas-willems/) - [Marc G. Bellemare](https://md.research.elamur.ai/free/en/authors/marc-g-bellemare/) - [Mark Towers](https://md.research.elamur.ai/free/en/authors/mark-towers/) - [Maxime Chevalier-Boisvert](https://md.research.elamur.ai/free/en/authors/maxime-chevalier-boisvert/) - [Rishabh Agarwal](https://md.research.elamur.ai/free/en/authors/rishabh-agarwal/) - [Salem Lahlou](https://md.research.elamur.ai/free/en/authors/salem-lahlou/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - Nature ## Cited by Papers of our library cite their works 80 times (of the 149,439 papers whose bibliographies we read); [16 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/pablo-samuel-castro/cited-by/). Updated 3 November 2026