---
title: "Benjamin Roth · University of Vienna — author profile and papers"
description: "Benjamin Roth, University of Vienna: 6 papers on Elamur Research (2015–2026), h-index 18 — affiliations, topics, co-authors and who cites…"
canonical: "https://research.elamur.ai/free/en/authors/benjamin-roth/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/benjamin-roth/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Benjamin Roth

# Benjamin Roth

Benjamin Roth has 6 papers in our library, in 2015–2026, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/), [Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/); often with [Yuxi Xia](https://md.research.elamur.ai/free/en/authors/yuxi-xia/), [Andreas Stephan](https://md.research.elamur.ai/free/en/authors/andreas-stephan/), [Andrew McCallum](https://md.research.elamur.ai/free/en/authors/andrew-mccallum/).

6 papers in our library · 2015–2026

[OpenAlex](https://openalex.org/A5046895021) · [ORCID](https://orcid.org/0000-0003-0362-0267) · [Wikidata](https://www.wikidata.org/wiki/Q130855162) · [**h-index 18**](https://openalex.org/authors/A5046895021) · [108 works](https://openalex.org/works?filter=author.id:A5046895021) · [1,521 citations](https://openalex.org/works?filter=author.id:A5046895021&sort=cited_by_count:desc) OpenAlex, 2026-10-14

[📄 6 works in our library](https://md.research.elamur.ai/free/en/authors/benjamin-roth/#papers) · [🔗 Cited 162 times in our library](https://md.research.elamur.ai/free/en/authors/benjamin-roth/cited-by/) · [4 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4886](https://md.research.elamur.ai/free/en/paper-stars/page/49/#star-4886)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Benjamin+Roth) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Benjamin+Roth) · [dblp](https://dblp.org/search?q=Benjamin+Roth) · [ACL Anthology](https://aclanthology.org/search/?q=Benjamin+Roth)

## Affiliations

[🎓**University of Vienna** Vienna · Austria 2020–2026 · 44 papersEmployment since 2020 · Digital Philology, Research Group Data Mining and Machine Learning*current*](https://md.research.elamur.ai/free/en/universities/university-of-vienna/) · [🎓**Ludwig-Maximilians-Universität München** Munich · Germany 2016–2021 · 17 papersEmployment 2016–2020 · Center for Information and Language Processing (CIS)](https://md.research.elamur.ai/free/en/universities/ludwig-maximilians-universitat-munchen/) · [🎓**Saarland University** Saarbrücken · Germany 2009–2014 · 16 papers](https://md.research.elamur.ai/free/en/universities/saarland-university/) · [🎓**University of Massachusetts Amherst** Amherst Center · United States 2014–2016 · 8 papers](https://md.research.elamur.ai/free/en/universities/university-of-massachusetts-amherst/)

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine.

## Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 6 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 6 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/)

🧭 Topics 3 Research subjects and languages the work is about.[Knowledge graphs & ontologies · 1 work](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/) · [Language models & pretraining · 3 works](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning · 2 works](https://md.research.elamur.ai/free/en/topics/reasoning/)

💡 Concepts 2 Key ideas and methods explained on our concept pages.[Distributional semantics · 1 work](https://md.research.elamur.ai/free/en/concepts/distributional-semantics/) · [Knowledge graph · 1 work](https://md.research.elamur.ai/free/en/concepts/knowledge-graph/)

## Works by year

### 2020s

[**2026** 3 papers](https://md.research.elamur.ai/free/en/authors/benjamin-roth/year/2026/) · [**2025** 1 paper](https://md.research.elamur.ai/free/en/authors/benjamin-roth/year/2025/) · [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/benjamin-roth/year/2024/)

### 2010s

[**2015** 1 paper](https://md.research.elamur.ai/free/en/authors/benjamin-roth/year/2015/)

## Papers

The most cited first (OpenAlex and our library).

1. **[Compositional Vector Space Models for Knowledge Base Completion](https://md.research.elamur.ai/free/en/papers/neelakantan-2015-compositional-vector-space-models-knowledge/)** *(2015 · 281 citations)* The paper addresses knowledge base completion (KB completion), that is, automatically inferring missing triple facts from those already present in the graph.
2. **[From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks](https://md.research.elamur.ai/free/en/papers/stephan-2024-calculation-adjudication-examining-llm-judges/)** *(2024 · 13 citations)* LLM-as-a-judge is usually validated by measuring agreement with human ratings on open-ended tasks such as summarization, and that agreement is inherently subjective.
3. **[Influences on LLM Calibration: A Study of Response Agreement, Loss Functions, and Prompt Styles](https://md.research.elamur.ai/free/en/papers/xia-2025-influences-llm-calibration-study-response/)** *(2025 · 11 citations)* LLMs often express confidence that does not match how often they are actually right. Earlier calibration methods were usually tested on only a few models and prompt formats. This paper runs a controlled comparison across 12 LLMs from five model families (2B–72B parameters), four prompt styles (Verbalized, Zero-shot…
4. **[Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of Explanations](https://md.research.elamur.ai/free/en/papers/hong-2026-agree-disagree-explain-decomposing-human/)** *(2026 · 3 citations)* NLI datasets often contain conflicting labels for the same premise–hypothesis pair. Earlier work with the LiTEx taxonomy studied only one kind of variation: annotators who pick the same label but justify it differently. This paper extends LiTEx to cases where the labels themselves diverge. One trained annotator…
5. **[Explaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis](https://md.research.elamur.ai/free/en/papers/xia-2026-explaining-generalization-ai-generated-text/)** *(2026 · 2 citations)* Fine-tuned classifiers that flag machine-written text score almost perfectly on data resembling their training material. Their accuracy falls, however, when the prompt, the generating model, or the domain changes. Earlier studies documented these drops but rarely explained them.
6. **[Compact Example-Based Explanations for Language Models](https://md.research.elamur.ai/free/en/papers/schoenegger-2026-compact-example-based-explanations-language/)** *(2026)* Influence estimation methods score how much each training document shaped a language model's output, but people can only inspect a handful of examples.

## All works

10 works of theirs in our library, the most cited first; 6 with a page here, the others link their original until we summarise them.

1. **[Compositional Vector Space Models for Knowledge Base Completion](https://md.research.elamur.ai/free/en/papers/neelakantan-2015-compositional-vector-space-models-knowledge/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Arvind Neelakantan, Benjamin Roth, Andrew McCallum*2015 · 281 citations*
2. **[Joint Aspect and Polarity Classification for Aspect-based Sentiment Analysis with End-to-End Neural Networks ↗](https://aclanthology.org/D18-1139/) Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yet**Martin Schmitt et al.*2018 · 150 citations*
3. **[Multilingual Relation Extraction using Compositional Universal Schema ↗](https://aclanthology.org/N16-1103/) Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Patrick Verga et al.*2016 · 139 citations*
4. **[Evaluating neural network explanation methods using hybrid documents and morphosyntactic agreement ↗](https://aclanthology.org/P18-1032/) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Nina Poerner, Hinrich Schütze, Benjamin Roth*2018 · 105 citations*
5. [**From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks arXiv:2409.04168**Andreas Stephan, Dawei Zhu, Matthias Aßenmacher, et al.*2024 · 13 citations*](https://md.research.elamur.ai/free/en/papers/stephan-2024-calculation-adjudication-examining-llm-judges/)
6. **[Influences on LLM Calibration: A Study of Response Agreement, Loss Functions, and Prompt Styles](https://md.research.elamur.ai/free/en/papers/xia-2025-influences-llm-calibration-study-response/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuxi Xia, Pedro Henrique Luz De Araujo, Klim Zaporojets, et al.*2025 · 11 citations*
7. **[Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of Explanations](https://md.research.elamur.ai/free/en/papers/hong-2026-agree-disagree-explain-decomposing-human/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Pingjun Hong, Beiduo Chen, Siyao Peng, et al.*2026 · 3 citations*
8. **[Explaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis](https://md.research.elamur.ai/free/en/papers/xia-2026-explaining-generalization-ai-generated-text/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Yuxi Xia, Kinga Stańczak, Benjamin Roth*2026 · 2 citations*
9. **[Data Centric Domain Adaptation for Historical Text with OCR Errors ↗](https://arxiv.org/abs/2107.00927) arXiv:2107.00927 · no summary yet**Luisa Marz et al.*2021 · 1 citation*
10. **[Compact Example-Based Explanations for Language Models](https://md.research.elamur.ai/free/en/papers/schoenegger-2026-compact-example-based-explanations-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Loris Schoenegger, Benjamin Roth*2026*

## Co-authors here

12 co-authors with a page, the most papers together first.

- [Yuxi Xia](https://md.research.elamur.ai/free/en/authors/yuxi-xia/) ×2
- [Andreas Stephan](https://md.research.elamur.ai/free/en/authors/andreas-stephan/)
- [Andrew McCallum](https://md.research.elamur.ai/free/en/authors/andrew-mccallum/)
- [Arvind Neelakantan](https://md.research.elamur.ai/free/en/authors/arvind-neelakantan/)
- [Barbara Plank](https://md.research.elamur.ai/free/en/authors/barbara-plank/)
- [Beiduo Chen](https://md.research.elamur.ai/free/en/authors/beiduo-chen/)
- [Dawei Zhu](https://md.research.elamur.ai/free/en/authors/dawei-zhu/)
- [Marie-Catherine de Marneffe](https://md.research.elamur.ai/free/en/authors/marie-catherine-de-marneffe/)
- [Matthias Aßenmacher](https://md.research.elamur.ai/free/en/authors/matthias-a-ssenmacher/)
- [Pingjun Hong](https://md.research.elamur.ai/free/en/authors/pingjun-hong/)
- [Siyao Peng](https://md.research.elamur.ai/free/en/authors/siyao-peng/)
- [Xiaoyu Shen](https://md.research.elamur.ai/free/en/authors/xiaoyu-shen/)

## Venues

Where their works here were published, the most works first, with the editions of those that have a page.

- [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/) ×3: [ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/), [ACL 2015](https://md.research.elamur.ai/free/en/venues/acl/2015/)
- [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/) ×2: [Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/) ×2
- [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/): [EACL 2026](https://md.research.elamur.ai/free/en/venues/eacl/2026/)
- Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing

## Cited by

Papers of our library cite their works 162 times (of the 149,439 papers whose bibliographies we read); [25 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/benjamin-roth/cited-by/).

Updated 1 November 2026