--- title: "Rotem Dror · University of Haifa — author profile and papers" description: "Rotem Dror, University of Haifa: 2 papers on Elamur Research (2021–2025), h-index 13 — affiliations, topics, co-authors and who cites them…" canonical: "https://research.elamur.ai/free/en/authors/rotem-dror/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/rotem-dror/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Rotem Dror # Rotem Dror Rotem Dror has 2 papers in our library, in 2021–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Summarization](https://md.research.elamur.ai/free/en/topics/summarization/), [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/); often with [Dan Roth](https://md.research.elamur.ai/free/en/authors/dan-roth/), [Daniel Deutsch](https://md.research.elamur.ai/free/en/authors/daniel-deutsch/), [Nitay Calderon](https://md.research.elamur.ai/free/en/authors/nitay-calderon/). 2 papers in our library · 2021–2025 [OpenAlex](https://openalex.org/A5089112142) · [ORCID](https://orcid.org/0000-0002-9433-8410) · [**h-index 13**](https://openalex.org/authors/A5089112142) · [47 works](https://openalex.org/works?filter=author.id:A5089112142) · [886 citations](https://openalex.org/works?filter=author.id:A5089112142&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/rotem-dror/#papers) · [🔗 Cited 568 times in our library](https://md.research.elamur.ai/free/en/authors/rotem-dror/cited-by/) · [8 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #5978](https://md.research.elamur.ai/free/en/paper-stars/page/60/#star-5978) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Rotem+Dror) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Rotem+Dror) · [dblp](https://dblp.org/search?q=Rotem+Dror) · [ACL Anthology](https://aclanthology.org/search/?q=Rotem+Dror) ## Affiliations [🎓**University of Haifa** Haifa · Israel 2023–2026 · 14 papersEmployment since 2023 · Assistant Professor, Information Systems*current*](https://md.research.elamur.ai/free/en/universities/university-of-haifa/) · [🎓**Technion – Israel Institute of Technology** Haifa · Israel 2016–2020 · 15 papers](https://md.research.elamur.ai/free/en/universities/technion-israel-institute-of-technology/) · [🎓**University of Pennsylvania** Philadelphia · United States 2021–2023 · 9 papersEmployment · Postdoctoral Researcher, Computer and Information Science](https://md.research.elamur.ai/free/en/universities/university-of-pennsylvania/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 9 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Decision Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/decision-sciences/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · [Law · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/law/) · [Political Science and International Relations · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/political-science-and-international-relations/) · [Statistics, Probability and Uncertainty · 1 work](https://md.research.elamur.ai/free/en/shelves/decision-sciences/statistics-probability-and-uncertainty/) 🧭 Topics 3 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Summarization · 1 work](https://md.research.elamur.ai/free/en/topics/summarization/) ## Works by year ### 2020s [**2025** 1 paper](https://md.research.elamur.ai/free/en/authors/rotem-dror/year/2025/) · [**2021** 1 paper](https://md.research.elamur.ai/free/en/authors/rotem-dror/year/2021/) ## Papers The most cited first (OpenAlex and our library). 1. **[A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods](https://md.research.elamur.ai/free/en/papers/deutsch-2021-statistical-analysis-summarization-evaluation-metrics/)** *(2021 · 117 citations)* Automatic summarization metrics are usually judged by how well their scores correlate with human quality ratings. 2. **[The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs](https://md.research.elamur.ai/free/en/papers/calderon-2025-alternative-annotator-test-llm-as/)** *(2025 · 52 citations)* Researchers increasingly use LLMs instead of people to label data or evaluate model outputs. There is no accepted, statistically grounded way to decide whether this substitution is justified. Common checks such as F1, kappa or correlation have no clear pass/fail threshold and cannot show that an LLM beats a human.… ## All works 10 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[The Hitchhiker's Guide to Testing Statistical Significance in Natural Language Processing ↗](https://aclanthology.org/P18-1128/) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Rotem Dror et al.*2018 · 607 citations* 2. **[Deep Dominance - How to Properly Compare Deep Neural Models ↗](https://aclanthology.org/P19-1266/) Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yet**Rotem Dror, Segev Shlomov, Roi Reichart*2019 · 162 citations* 3. **[A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods](https://md.research.elamur.ai/free/en/papers/deutsch-2021-statistical-analysis-summarization-evaluation-metrics/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Daniel Deutsch, Rotem Dror, Dan Roth*2021 · 117 citations* 4. **[Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets ↗](https://aclanthology.org/Q17-1033/) Transactions of the Association for Computational Linguistics · no summary yet**Rotem Dror et al.*2017 · 98 citations* 5. **[On the Limitations of Reference-Free Evaluations of Generated Text ↗](https://aclanthology.org/2022.emnlp-main.753/) Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yet**Daniel Deutsch, Rotem Dror, Dan Roth*2022 · 69 citations* 6. **[Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics ↗](https://aclanthology.org/2022.naacl-main.442/) Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Daniel Deutsch, Rotem Dror, Dan Roth*2022 · 54 citations* 7. **[The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs](https://md.research.elamur.ai/free/en/papers/calderon-2025-alternative-annotator-test-llm-as/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Nitay Calderon, Roi Reichart, Rotem Dror*2025 · 52 citations* 8. **[RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios ↗](https://aclanthology.org/2022.naacl-demo.7/) Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations · no summary yet**Xinya Du et al.*2022 · 38 citations* 9. **[Zero-Shot On-the-Fly Event Schema Induction ↗](https://aclanthology.org/2023.findings-eacl.53/) Findings of the Association for Computational Linguistics: EACL 2023 · no summary yet**Rotem Dror, Haoyu Wang, Dan Roth*2023 · 32 citations* 10. **[Human-in-the-loop Schema Induction ↗](https://aclanthology.org/2023.acl-demo.1/) Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) · no summary yet**Tianyi Zhang et al.*2023 · 22 citations* ## Co-authors here 4 co-authors with a page, the most papers together first. - [Dan Roth](https://md.research.elamur.ai/free/en/authors/dan-roth/) - [Daniel Deutsch](https://md.research.elamur.ai/free/en/authors/daniel-deutsch/) - [Nitay Calderon](https://md.research.elamur.ai/free/en/authors/nitay-calderon/) - [Roi Reichart](https://md.research.elamur.ai/free/en/authors/roi-reichart/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/) ×4: [ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/) - [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/) ×2: [Transactions of the Association for Computational Linguistics (TACL) 2021](https://md.research.elamur.ai/free/en/venues/tacl/2021/) - Findings of the Association for Computational Linguistics: EACL 2023 - Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations - Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing ## Cited by Papers of our library cite their works 568 times (of the 149,439 papers whose bibliographies we read); [73 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/rotem-dror/cited-by/). Updated 30 October 2026