--- title: "Nishant Balepur — author profile and papers — Elamur Research" description: "Nishant Balepur, New York University: 4 papers on Elamur Research (2024–2025), h-index 4 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/nishant-balepur/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/nishant-balepur/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Nishant Balepur # Nishant Balepur Nishant Balepur has 4 papers in our library, in 2024–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/); often with [Rachel Rudinger](https://md.research.elamur.ai/free/en/authors/rachel-rudinger/), [Jordan Boyd-Graber](https://md.research.elamur.ai/free/en/authors/jordan-boyd-graber/), [Abhilasha Ravichander](https://md.research.elamur.ai/free/en/authors/abhilasha-ravichander/). 4 papers in our library · 2024–2025 [OpenAlex](https://openalex.org/A5091963084) · [**h-index 4**](https://openalex.org/authors/A5091963084) · [57 works](https://openalex.org/works?filter=author.id:A5091963084) · [139 citations](https://openalex.org/works?filter=author.id:A5091963084&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 4 works in our library](https://md.research.elamur.ai/free/en/authors/nishant-balepur/#papers) · [🔗 Cited 209 times in our library](https://md.research.elamur.ai/free/en/authors/nishant-balepur/cited-by/) · [9 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #5090](https://md.research.elamur.ai/free/en/paper-stars/page/51/#star-5090) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Nishant+Balepur) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Nishant+Balepur) · [dblp](https://dblp.org/search?q=Nishant+Balepur) · [ACL Anthology](https://aclanthology.org/search/?q=Nishant+Balepur) ## Affiliations [🎓**University of Maryland, College Park** College Park · United States 2023–2026 · 41 papers*current*](https://md.research.elamur.ai/free/en/universities/university-of-maryland-college-park/) · [🎓**New York University** New York · United States 2026 · 4 papers*current*](https://md.research.elamur.ai/free/en/universities/new-york-university/) · [🎓**University of Illinois Urbana-Champaign** Urbana · United States 2023 · 4 papers](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) · [🏢**Adobe Systems** San Jose · United States 2025 · 2 papers](https://md.research.elamur.ai/free/en/companies/adobe-systems/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 8 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Education · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/education/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) 🧭 Topics 2 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) ## Works by year ### 2020s [**2025** 2 papers](https://md.research.elamur.ai/free/en/authors/nishant-balepur/year/2025/) · [**2024** 2 papers](https://md.research.elamur.ai/free/en/authors/nishant-balepur/year/2024/) ## Papers The most cited first (OpenAlex and our library). 1. **[The Prompt Report: A Systematic Survey of Prompt Engineering Techniques](https://md.research.elamur.ai/free/en/papers/schulhoff-2024-prompt-report-systematic-survey-prompt/)** *(2024 · 189 citations)* Prompt engineering has grown quickly, but its literature uses inconsistent terminology and lacks a shared picture of which techniques exist and how they relate. 2. **[Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?](https://md.research.elamur.ai/free/en/papers/balepur-2024-artifacts-or-abduction-how-do/)** *(2024 · 52 citations)* Multiple-choice question answering (MCQA) is widely used to rank LLMs, but it is unclear whether high scores reflect the skills these benchmarks are meant to test. 3. **[Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above](https://md.research.elamur.ai/free/en/papers/balepur-2025-which-these-best-describes-multiple/)** *(2025 · 28 citations)* This position paper asks whether multiple choice question answering (MCQA), the default way of benchmarking LLMs, deserves that status. 4. **[Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas](https://md.research.elamur.ai/free/en/papers/balepur-2025-whose-boat-does-it-float/)** *(2025 · 12 citations)* Standard preference datasets record which of two responses annotators favored but not why. LLMs tuned on them therefore learn one majority notion of quality and adapt poorly when a user states specific needs. The authors treat this as an abductive problem. Given a prompt and a response pair, an LLM writes a short… ## All works 13 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them. 1. [**The Prompt Report: A Systematic Survey of Prompt Engineering Techniques arXiv:2406.06608**Sander Schulhoff, Michael Ilie, Nishant Balepur, et al.*2024 · 189 citations*](https://md.research.elamur.ai/free/en/papers/schulhoff-2024-prompt-report-systematic-survey-prompt/) 2. **[Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?](https://md.research.elamur.ai/free/en/papers/balepur-2024-artifacts-or-abduction-how-do/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Nishant Balepur, Abhilasha Ravichander, Rachel Rudinger*2024 · 52 citations* 3. **[Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above](https://md.research.elamur.ai/free/en/papers/balepur-2025-which-these-best-describes-multiple/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber*2025 · 28 citations* 4. **[Expository Text Generation: Imitate, Retrieve, Paraphrase ↗](https://aclanthology.org/2023.emnlp-main.729/) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yet**Nishant Balepur, Jie Huang, Kevin Chen-Chuan Chang*2023 · 23 citations* 5. **[AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite ↗](https://arxiv.org/abs/2510.21652) arXiv:2510.21652 · no summary yet**Jonathan Bragg et al.*2025 · 19 citations* 6. **[Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas](https://md.research.elamur.ai/free/en/papers/balepur-2025-whose-boat-does-it-float/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Nishant Balepur, Vishakh Padmakumar, Fumeng Yang, et al.*2025 · 12 citations* 7. **[DynaMiTE: Discovering Explosive Topic Evolutions with User Guidance ↗](https://aclanthology.org/2023.findings-acl.14/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Nishant Balepur et al.*2023 · 7 citations* 8. **[BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks ↗](https://aclanthology.org/2026.acl-long.719/) Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Nishant Balepur et al.*2026 · 2 citations* 9. **[Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users ↗](https://aclanthology.org/2026.acl-long.723/) Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Nishant Balepur et al.*2026 · 2 citations* 10. **[DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute ↗](https://arxiv.org/abs/2604.23815) arXiv (Cornell University) · no summary yet**Nishant Balepur et al.*2026 · 1 citation* 11. **[Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation ↗](https://arxiv.org/abs/2608.29887) arXiv (Cornell University) · no summary yet**Nishant Balepur et al.*2026* 12. **[(Im)Paired Programming: Coding Agents Improve Productivity but Harm Understanding ↗](https://arxiv.org/abs/2607.26375) arXiv (Cornell University) · no summary yet**Nishant Balepur et al.*2026* 13. **[VibeJam: A User Study Platform for Web Development with Agents ↗](https://arxiv.org/abs/2608.29889) arXiv (Cornell University) · no summary yet**Nishant Balepur et al.*2026* ## Co-authors here 7 co-authors with a page, the most papers together first. - [Rachel Rudinger](https://md.research.elamur.ai/free/en/authors/rachel-rudinger/) ×3 - [Jordan Boyd-Graber](https://md.research.elamur.ai/free/en/authors/jordan-boyd-graber/) ×2 - [Abhilasha Ravichander](https://md.research.elamur.ai/free/en/authors/abhilasha-ravichander/) - [Chenglei Si](https://md.research.elamur.ai/free/en/authors/chenglei-si/) - [HyoJung Han](https://md.research.elamur.ai/free/en/authors/hyojung-han/) - [Shi Feng](https://md.research.elamur.ai/free/en/authors/shi-feng/) - [Vishakh Padmakumar](https://md.research.elamur.ai/free/en/authors/vishakh-padmakumar/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/) ×5: [ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/) ×2, [ACL 2024](https://md.research.elamur.ai/free/en/venues/acl/2024/) - Findings of the Association for Computational Linguistics: ACL 2023 - Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing ## Cited by Papers of our library cite their works 209 times (of the 149,439 papers whose bibliographies we read); [36 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/nishant-balepur/cited-by/). Updated 30 October 2026