---
title: "Modeling Semantic Relations Expressed by Prepositions (2013)"
description: "Srikumar and Roth instead define 32 abstract relations by merging related senses across 34… 30 references, cited by 23 papers here."
authors: ["Vivek Srikumar", "Dan Roth"]
year: 2013
venue: "Transactions of the Association for Computational Linguistics"
source: "https://aclanthology.org/Q13-1019/"
doi: "10.1162/tacl_a_00223"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/srikumar-2013-modeling-semantic-relations-expressed-prepositions/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/srikumar-2013-modeling-semantic-relations-expressed-prepositions/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2013](https://md.research.elamur.ai/free/en/papers/2013/page/2/) / Modeling Semantic Relations Expressed by Prepositions

# Modeling Semantic Relations Expressed by Prepositions

**Authors:** [Vivek Srikumar](https://md.research.elamur.ai/free/en/authors/vivek-srikumar/) and [Dan Roth](https://md.research.elamur.ai/free/en/authors/dan-roth/) · **Year:** 2013 · **Venue:** [Transactions of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/tacl/) ([Transactions of the Association for Computational Linguistics (TACL) 2013](https://md.research.elamur.ai/free/en/venues/tacl/2013/)) · **Publisher:** [The MIT Press](https://md.research.elamur.ai/free/en/publishers/the-mit-press/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/Q13-1019/) · [PDF](https://aclanthology.org/Q13-1019.pdf) · [DOI 10.1162/tacl\_a\_00223](https://doi.org/10.1162/tacl_a_00223) · [OpenAlex](https://openalex.org/W2160920407)

**Citations:** 53 citations (OpenAlex, 2026-10-14) · [23](https://md.research.elamur.ai/free/en/papers/srikumar-2013-modeling-semantic-relations-expressed-prepositions/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Prepositions are highly ambiguous: one preposition can signal many meanings, and many prepositions can signal the same meaning. Existing sense inventories, such as the Preposition Project used in SemEval 2007, define labels separately for each preposition. This produces many labels and prevents generalization across words. Srikumar and Roth instead define 32 abstract relations by merging related senses across 34 prepositions. Because each sense maps to exactly one relation, the SemEval 2007 sense-annotated data can be converted into a relation-labeled corpus.

Each relation is treated as a predicate whose arguments are the preposition's governor and object, together with the arguments' semantic types (e.g., WordNet hypernyms). The data label only the relation, so the arguments and types are hidden. The authors compare two approaches:
- **Model 1** pools features over all candidate arguments and types.
- **Model 2** models arguments and types as latent variables and learns them with an extended form of latent structural SVM training.

Model 2 reaches 89.43% relation accuracy. Joint inference with a sense predictor raises this to 90.23% and also improves sense prediction. The resulting labels are more transferable, which is useful for question answering and entailment.

## Key points
- **Relation inventory:** 32 relation labels (including an "Other" overflow class) cover 34 single-word transitive prepositions. They replace the 332 per-preposition sense labels of the Preposition Project/SemEval 2007.
- **Argument candidates:** Governor and object candidates come from a dependency parser plus heuristics, such as the previous noun, adjective or verb for the governor and the next noun for the object. Using all candidate generators performs best.
- **Feature sharing:** Sharing features across prepositions raises accuracy from 87.17% to 88.01% (p \< 0.01).
- **Model size:** Model 2 is much sparser than Model 1. In the typed setting it has about 1.0M weights versus 2.57M; in the typed+gen setting it has 2.21M non-zero weights versus 5.41M.
- **Interpretability:** Predicted argument types help explain the chosen label. For example, "experience" + "disease" points to Cause, while "change" + "disease" points to StartState.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Illinois Urbana-Champaign](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) — University, Urbana, United States · 209 works · 71,394 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

## Cite

Cite as: Vivek Srikumar and Dan Roth. 2013. Modeling Semantic Relations Expressed by Prepositions. Transactions of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{srikumar2013modeling,
  title = {{Modeling Semantic Relations Expressed by Prepositions}},
  author = {Vivek Srikumar and Dan Roth},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2013},
  doi = {10.1162/tacl\_a\_00223},
  url = {https://doi.org/10.1162/tacl_a_00223}
}
```

- [← previous Identifying Opinion Subgroups in Arabic Online Discussions](https://md.research.elamur.ai/free/en/papers/jbara-2013-identifying-opinion-subgroups-arabic-online/)
- [next → Annotating the meaning of discourse connectives by looking at their translation: The translation-spotting technique](https://md.research.elamur.ai/free/en/papers/cartoni-2013-annotating-meaning-discourse-connectives-looking/)
- [↑ back to papers of 2013](https://md.research.elamur.ai/free/en/papers/2013/page/2/)

## References

30 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. E. Agirre, T. Baldwin, and D. Martinez. 2008. Improving parsing and PP attachment performance with sense information. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 317–325, Columbus, USA. [find](https://scholar.google.com/scholar?q=E%2E+Agirre%2C+T%2E+Baldwin%2C+and+D%2E+Martinez%2E+2008%2E+Improving+parsing+and+PP+attachment+performance+with+sense+information%2E+In+Proceedings+of+the+Annual+Meeting+of+the+Association+for+Computational+Linguist)
2. T. Baldwin, V. Kordoni, and A. Villavicencio. 2009. Prepositions in applications: A survey and introduction to the special issue. Computational Linguistics, 35(2):119–149. [find](https://scholar.google.com/scholar?q=T%2E+Baldwin%2C+V%2E+Kordoni%2C+and+A%2E+Villavicencio%2E+2009%2E+Prepositions+in+applications%3A+A+survey+and+introduction+to+the+special+issue%2E+Computational+Linguistics%2C+35%282%29%3A119%E2%80%93149%2E)
3. M. Chang, D. Goldwasser, D. Roth, and V. Srikumar. 2010a. Discriminative learning over constrained latent representations. In Proceedings of the Annual Meeting of the North American Association of Computational Linguistics (NAACL), pages 429–437, Los Angeles, USA. [find](https://scholar.google.com/scholar?q=M%2E+Chang%2C+D%2E+Goldwasser%2C+D%2E+Roth%2C+and+V%2E+Srikumar%2E+2010a%2E+Discriminative+learning+over+constrained+latent+representations%2E+In+Proceedings+of+the+Annual+Meeting+of+the+North+American+Association+of+Com)
4. M. Chang, V. Srikumar, D. Goldwasser, and D. Roth. 2010b. Structured output learning with indirect supervision. In Proceedings of the International Conference on Machine Learning (ICML), pages 199–206, Haifa, Israel. [find](https://scholar.google.com/scholar?q=M%2E+Chang%2C+V%2E+Srikumar%2C+D%2E+Goldwasser%2C+and+D%2E+Roth%2E+2010b%2E+Structured+output+learning+with+indirect+supervision%2E+In+Proceedings+of+the+International+Conference+on+Machine+Learning+%28ICML%29%2C+pages+199%E2%80%93206)
5. J. Clarke, V. Srikumar, M. Sammons, and D. Roth. 2012. An NLP Curator (or: How I Learned to Stop Worrying and Love NLP Pipelines). In Proceedings of the International Conference on Language Resources and Evaluation (LREC), pages 3276–3283, Istanbul, Turkey. [find](https://scholar.google.com/scholar?q=J%2E+Clarke%2C+V%2E+Srikumar%2C+M%2E+Sammons%2C+and+D%2E+Roth%2E+2012%2E+An+NLP+Curator+%28or%3A+How+I+Learned+to+Stop+Worrying+and+Love+NLP+Pipelines%29%2E+In+Proceedings+of+the+International+Conference+on+Language+Resources+)
6. J. Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20:37–46. [find](https://scholar.google.com/scholar?q=J%2E+Cohen%2E+1960%2E+A+coefficient+of+agreement+for+nominal+scales%2E+Educational+and+Psychological+Measurement%2C+20%3A37%E2%80%9346%2E)
7. D. Dahlmeier, H. T. Ng, and T. Schultz. 2009. Joint learning of preposition senses and semantic roles of prepositional phrases. In Proceedings of the Conference on Empirical Methods for Natural Language Processing (EMNLP), pages 450–458, Singapore. [find](https://scholar.google.com/scholar?q=D%2E+Dahlmeier%2C+H%2E+T%2E+Ng%2C+and+T%2E+Schultz%2E+2009%2E+Joint+learning+of+preposition+senses+and+semantic+roles+of+prepositional+phrases%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+for+Natural+Langua)
8. D. Das, N. Schneider, D. Chen, and N. Smith. 2010. [Probabilistic frame-semantic parsing](https://md.research.elamur.ai/free/en/papers/das-2010-probabilistic-frame-semantic-parsing/). In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 948– 956, Los Angeles, USA.
9. C. Fillmore, C. Johnson, and M. Petruck. 2003. Background to FrameNet. International Journal of Lexicography, 16(3):235–250. [find](https://scholar.google.com/scholar?q=C%2E+Fillmore%2C+C%2E+Johnson%2C+and+M%2E+Petruck%2E+2003%2E+Background+to+FrameNet%2E+International+Journal+of+Lexicography%2C+16%283%29%3A235%E2%80%93250%2E)
10. D. Gildea and D. Jurafsky. 2002. [Automatic labeling of semantic roles](https://md.research.elamur.ai/free/en/papers/gildea-2002-automatic-labeling-semantic-roles/). Computational Linguistics, 28(3):245–288.
11. Y. Goldberg and M. Elhadad. 2010. An efficient algorithm for easy-first non-directional dependency parsing. In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 742–750, Los Angeles, USA. [find](https://scholar.google.com/scholar?q=Y%2E+Goldberg+and+M%2E+Elhadad%2E+2010%2E+An+efficient+algorithm+for+easy%2Dfirst+non%2Ddirectional+dependency+parsing%2E+In+Proceedings+of+Human+Language+Technologies%3A+The+2010+Annual+Conference+of+the+North+Ameri)
12. D. Hovy, S. Tratz, and E. Hovy. 2010. What’s in a preposition? dimensions of sense disambiguation for an interesting word class. In Coling 2010: Posters, pages 454–462, Beijing, China. [find](https://scholar.google.com/scholar?q=D%2E+Hovy%2C+S%2E+Tratz%2C+and+E%2E+Hovy%2E+2010%2E+What%E2%80%99s+in+a+preposition%3F+dimensions+of+sense+disambiguation+for+an+interesting+word+class%2E+In+Coling+2010%3A+Posters%2C+pages+454%E2%80%93462%2C+Beijing%2C+China%2E)
13. D. Lin. 1998. [Automatic retrieval and clustering of similar words](https://md.research.elamur.ai/free/en/papers/lin-1998-automatic-retrieval-clustering-similar-words/). In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 768–774, Montreal, Canada.
14. K. Litkowski and O. Hargraves. 2005. The Preposition Project. In ACL-SIGSEM Workshop on the Linguistic Dimensions of Prepositions and their Use in Computational Linguistics Formalisms and Applications, pages 171–179, Colchester, UK. [find](https://scholar.google.com/scholar?q=K%2E+Litkowski+and+O%2E+Hargraves%2E+2005%2E+The+Preposition+Project%2E+In+ACL%2DSIGSEM+Workshop+on+the+Linguistic+Dimensions+of+Prepositions+and+their+Use+in+Computational+Linguistics+Formalisms+and+Applications)
15. K. Litkowski and O. Hargraves. 2007. SemEval-2007 Task 06: Word-Sense Disambiguation of Prepositions. In Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval-2007), pages 24– 29, Prague, Czech Republic. [find](https://scholar.google.com/scholar?q=K%2E+Litkowski+and+O%2E+Hargraves%2E+2007%2E+SemEval%2D2007+Task+06%3A+Word%2DSense+Disambiguation+of+Prepositions%2E+In+Proceedings+of+the+Fourth+International+Workshop+on+Semantic+Evaluations+%28SemEval%2D2007%29%2C+pages+)
16. K. Litkowski. 2012. Proposed Next Steps for The Preposition Project. Technical Report 12-01, CL Research. [find](https://scholar.google.com/scholar?q=K%2E+Litkowski%2E+2012%2E+Proposed+Next+Steps+for+The+Preposition+Project%2E+Technical+Report+12%2D01%2C+CL+Research%2E)
17. A. Meyers, R. Reeves, C. Macleod, R. Szekely, V. Zielinska, B. Young, and R. Grishman. 2004. The Nom-Bank project: An interim report. In HLT-NAACL 2004 Workshop: Frontiers in Corpus Annotation, pages 24– 31, Boston, USA. [find](https://scholar.google.com/scholar?q=A%2E+Meyers%2C+R%2E+Reeves%2C+C%2E+Macleod%2C+R%2E+Szekely%2C+V%2E+Zielinska%2C+B%2E+Young%2C+and+R%2E+Grishman%2E+2004%2E+The+Nom%2DBank+project%3A+An+interim+report%2E+In+HLT%2DNAACL+2004+Workshop%3A+Frontiers+in+Corpus+Annotation%2C+pages+)
18. T. O’Hara and J. Wiebe. 2009. Exploiting semantic role resources for preposition disambiguation. Computational Linguistics, 35(2):151–184. [find](https://scholar.google.com/scholar?q=T%2E+O%E2%80%99Hara+and+J%2E+Wiebe%2E+2009%2E+Exploiting+semantic+role+resources+for+preposition+disambiguation%2E+Computational+Linguistics%2C+35%282%29%3A151%E2%80%93184%2E)
19. M. Palmer, D. Gildea, and P. Kingsbury. 2005. [The Proposition Bank: An Annotated Corpus of Semantic Roles](https://md.research.elamur.ai/free/en/papers/palmer-2005-proposition-bank-annotated-corpus-semantic/). Computational Linguistics, 31(1):71–106.
20. M. Palmer, D. Gildea, and N. Xue. 2010. Semantic Role Labeling, volume 3. [find](https://scholar.google.com/scholar?q=M%2E+Palmer%2C+D%2E+Gildea%2C+and+N%2E+Xue%2E+2010%2E+Semantic+Role+Labeling%2C+volume+3%2E)
21. Morgan & Claypool Publishers. V. Punyakanok, D. Roth, and W. Yih. 2008. [The importance of syntactic parsing and inference in semantic role labeling](https://md.research.elamur.ai/free/en/papers/punyakanok-2008-importance-syntactic-parsing-inference-semantic/). Computational Linguistics, 34(2).
22. D. Roth and W. Yih. 2004. [A linear programming formulation for global inference in natural language tasks](https://md.research.elamur.ai/free/en/papers/roth-2004-linear-programming-formulation-global-inference/).
23. In Proceedings of the Annual Conference on Computational Natural Language Learning (CoNLL), pages 1–8, Boston, USA. D. Roth and W. Yih. 2007. Global inference for entity and relation identification via a linear programming formulation. Introduction to Statistical Relational Learning. [find](https://scholar.google.com/scholar?q=In+Proceedings+of+the+Annual+Conference+on+Computational+Natural+Language+Learning+%28CoNLL%29%2C+pages+1%E2%80%938%2C+Boston%2C+USA%2E+D%2E+Roth+and+W%2E+Yih%2E+2007%2E+Global+inference+for+entity+and+relation+identification+vi)
24. V. Srikumar and D. Roth. 2011. A joint model for extended semantic role labeling. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Edinburgh, Scotland. [find](https://scholar.google.com/scholar?q=V%2E+Srikumar+and+D%2E+Roth%2E+2011%2E+A+joint+model+for+extended+semantic+role+labeling%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2C+Edinburgh%2C+Scotland%2E)
25. S. Tratz and D. Hovy. 2009. Disambiguation of preposition sense using linguistically motivated features. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Student Research Worksh… [find](https://scholar.google.com/scholar?q=S%2E+Tratz+and+D%2E+Hovy%2E+2009%2E+Disambiguation+of+preposition+sense+using+linguistically+motivated+features%2E+In+Proceedings+of+Human+Language+Technologies%3A+The+2009+Annual+Conference+of+the+North+American)
26. S. Tratz. 2011. Semantically-enriched Parsing for Natural Language Understanding. Ph.D. thesis, University of Southern California. [find](https://scholar.google.com/scholar?q=S%2E+Tratz%2E+2011%2E+Semantically%2Denriched+Parsing+for+Natural+Language+Understanding%2E+Ph%2ED%2E+thesis%2C+University+of+Southern+California%2E)
27. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. 2004. Support vector machine learning for interdependent and structured output spaces. In Proceedings of the International Conference on Machine Learning (ICML), pages 104–111, Banff, Canada. [find](https://scholar.google.com/scholar?q=I%2E+Tsochantaridis%2C+T%2E+Hofmann%2C+T%2E+Joachims%2C+and+Y%2E+Altun%2E+2004%2E+Support+vector+machine+learning+for+interdependent+and+structured+output+spaces%2E+In+Proceedings+of+the+International+Conference+on+Machi)
28. P. Ye and T. Baldwin. 2006. Semantic role labeling of prepositional phrases. ACM Transactions on Asian Language Information Processing (TALIP), 5(3):228– 244. [find](https://scholar.google.com/scholar?q=P%2E+Ye+and+T%2E+Baldwin%2E+2006%2E+Semantic+role+labeling+of+prepositional+phrases%2E+ACM+Transactions+on+Asian+Language+Information+Processing+%28TALIP%29%2C+5%283%29%3A228%E2%80%93+244%2E)
29. P. Ye and T. Baldwin. 2007. MELB-YB: Preposition sense disambiguation using rich semantic features. In Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval-2007), pages 241– 244, Prague, Czech Republic. [find](https://scholar.google.com/scholar?q=P%2E+Ye+and+T%2E+Baldwin%2E+2007%2E+MELB%2DYB%3A+Preposition+sense+disambiguation+using+rich+semantic+features%2E+In+Proceedings+of+the+Fourth+International+Workshop+on+Semantic+Evaluations+%28SemEval%2D2007%29%2C+pages+24)
30. C. Yu and T. Joachims. 2009. Learning structural SVMs with latent variables. In Proceedings of the International Conference on Machine Learning (ICML), pages 1–8, Montreal, Canada. B. Zapirain, E. Agirre, L. Màrquez, and M. Surdeanu. 2012. [Selectional preferences for semantic role classification](https://md.research.elamur.ai/free/en/papers/zapirain-2013-selectional-preferences-semantic-role-classification/). C…

*Updated 30 October 2026*