--- title: "Ivan Stelmakh — author profile and papers — Elamur Research" description: "Ivan Stelmakh, New Economic School: 2 papers on Elamur Research (2022–2023), h-index 10 — affiliations, topics, co-authors and who…" canonical: "https://research.elamur.ai/free/en/authors/ivan-stelmakh/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/ivan-stelmakh/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Ivan Stelmakh # Ivan Stelmakh Ivan Stelmakh has 2 papers in our library, in 2022–2023; often with [Alekh Agarwal](https://md.research.elamur.ai/free/en/authors/alekh-agarwal/), [Alexander Goldberg](https://md.research.elamur.ai/free/en/authors/alexander-goldberg/), [Alice Oh](https://md.research.elamur.ai/free/en/authors/alice-oh/). 2 papers in our library · 2022–2023 [OpenAlex](https://openalex.org/A5047633303) · [ORCID](https://orcid.org/0000-0002-9237-7379) · [**h-index 10**](https://openalex.org/authors/A5047633303) · [23 works](https://openalex.org/works?filter=author.id:A5047633303) · [268 citations](https://openalex.org/works?filter=author.id:A5047633303&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/ivan-stelmakh/#papers) · [🔗 Cited 200 times in our library](https://md.research.elamur.ai/free/en/authors/ivan-stelmakh/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #5930](https://md.research.elamur.ai/free/en/paper-stars/page/60/#star-5930) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Ivan+Stelmakh) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Ivan+Stelmakh) · [dblp](https://dblp.org/search?q=Ivan+Stelmakh) · [ACL Anthology](https://aclanthology.org/search/?q=Ivan+Stelmakh) ## Affiliations [🎓**New Economic School** Moscow · Russia 2023–2025 · 6 papers*current*](https://ror.org/033904843) · [🎓**Carnegie Mellon University** Pittsburgh · United States 2018–2023 · 15 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 10 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Decision Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/decision-sciences/) · [Experimental and Cognitive Psychology · 1 work](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · [History and Philosophy of Science · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/history-and-philosophy-of-science/) · [Psychology · 1 work](https://md.research.elamur.ai/free/en/shelves/psychology/) · [Statistics, Probability and Uncertainty · 1 work](https://md.research.elamur.ai/free/en/shelves/decision-sciences/statistics-probability-and-uncertainty/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/ivan-stelmakh/year/2023/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/ivan-stelmakh/year/2022/) ## Papers The most cited first (OpenAlex and our library). 1. **[ASQA: Factoid Questions Meet Long-Form Answers](https://md.research.elamur.ai/free/en/papers/stelmakh-2022-asqa-factoid-questions-meet-long/)** *(2022 · 245 citations)* Long-form question answering has advanced slowly compared with short factoid QA. Two things hold it back: good training data is scarce, and there is no clear standard for what makes an answer good. The authors address this with ASQA, built from ambiguous questions in AmbigQA. Each question is paired with a… 2. **[Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments](https://md.research.elamur.ai/free/en/papers/goldberg-2023-peer-reviews-peer-reviews/)** *(2023 · 32 citations)* Conferences, journals and funding bodies often score individual peer reviews. They use these scores to reward strong reviewers or as the outcome measure in experiments on the review process. This paper tests whether such scores can be trusted. At NeurIPS 2022, the authors recruited paper authors, reviewers and… ## All works 4 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[ASQA: Factoid Questions Meet Long-Form Answers](https://md.research.elamur.ai/free/en/papers/stelmakh-2022-asqa-factoid-questions-meet-long/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, et al.*2022 · 245 citations* 2. **[Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments](https://md.research.elamur.ai/free/en/papers/goldberg-2023-peer-reviews-peer-reviews/) [PLoS ONE](https://md.research.elamur.ai/free/en/venues/plos-one/)**Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho, et al.*2023 · 32 citations* 3. **[How do authors’ perceptions of their papers compare with co-authors’ perceptions and peer-review decisions? ↗](https://doi.org/10.1371/journal.pone.0300710) PLoS ONE · no summary yet**Charvi Rastogi et al.*2022 · 11 citations* 4. **[A Gold Standard Dataset for the Reviewer Assignment Problem ↗](https://arxiv.org/abs/2303.16750) arXiv (Cornell University) · no summary yet**Ivan Stelmakh et al.*2023 · 7 citations* ## Co-authors here 8 co-authors with a page, the most papers together first. - [Alekh Agarwal](https://md.research.elamur.ai/free/en/authors/alekh-agarwal/) - [Alexander Goldberg](https://md.research.elamur.ai/free/en/authors/alexander-goldberg/) - [Alice Oh](https://md.research.elamur.ai/free/en/authors/alice-oh/) - [Bhuwan Dhingra](https://md.research.elamur.ai/free/en/authors/bhuwan-dhingra/) - [Kyunghyun Cho](https://md.research.elamur.ai/free/en/authors/kyunghyun-cho/) - [Ming-Wei Chang](https://md.research.elamur.ai/free/en/authors/ming-wei-chang/) - [Nihar B. Shah](https://md.research.elamur.ai/free/en/authors/nihar-b-shah/) - [Yi Luan](https://md.research.elamur.ai/free/en/authors/yi-luan/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [PLoS ONE](https://md.research.elamur.ai/free/en/venues/plos-one/) ×2: [PLoS ONE 2023](https://md.research.elamur.ai/free/en/venues/plos-one/2023/) - [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/): [EMNLP 2022](https://md.research.elamur.ai/free/en/venues/emnlp/2022/) ## Cited by Papers of our library cite their works 200 times (of the 149,439 papers whose bibliographies we read); [60 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/ivan-stelmakh/cited-by/). Updated 3 November 2026