---
title: "Extracting Opinion Targets in a Single and — Jakob 2010"
description: "The paper addresses opinion target extraction: finding the words in a sentence that an opinion is about (e.g., a product feature)."
authors: ["Niklas Jakob", "Iryna Gurevych"]
year: 2010
venue: "Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/D10-1101/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/jakob-2010-extracting-opinion-targets-single-cross/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/jakob-2010-extracting-opinion-targets-single-cross/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2010](https://md.research.elamur.ai/free/en/papers/2010/) / Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields

# Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields

**Authors:** Niklas Jakob, [Iryna Gurevych](https://md.research.elamur.ai/free/en/authors/iryna-gurevych/) · **Year:** 2010 · **Venue:** Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/D10-1101/) · [PDF](https://aclanthology.org/D10-1101.pdf) · [OpenAlex](https://openalex.org/W1517771839)

**Citations:** 470 citations (openalex-snapshot · 2026-10-14) · [75](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
The paper addresses opinion target extraction: finding the words in a sentence that an opinion is about (e.g., a product feature). The authors frame this as information extraction and solve it with Conditional Random Fields (CRF). They test it on user-generated text from four domains: movies, web-services, cars and cameras. The data is annotated with opinion targets at the sentence level. The CRF uses a small set of features:

- the token string,
- its POS tag,
- whether the token is directly linked to an opinion expression in the dependency parse,
- whether it lies in the noun phrase closest to an opinion expression.

The baseline is the supervised system of Zhuang et al. (2006). Within a single domain, the CRF beats the baseline in all four domains. The gain is much larger in a cross-domain setting, where the model is trained on some domains and tested on another. This matters because supervised opinion mining usually degrades on new domains. Domain portability had been studied for sentiment polarity, but not for target extraction.

## Key points
- Single-domain F-Measure gains over the Zhuang et al. (2006) baseline are 0.077, 0.126, 0.071 and 0.178 across the four domains.
- Cross-domain gains are much larger: 0.409, 0.242, 0.294 and 0.343 F-Measure.
- The feature set has short names in the result tables (tk = token, pos = POS, dLn = direct dependency to an opinion expression) plus a word-distance noun-phrase heuristic. Tagging uses the Stanford POS Tagger and parsing uses the Stanford Parser.
- Development data was held out: 29 documents (movies), 23 (web-services) and 15 (cars & cameras).
- The cameras dataset is the smallest, yet it is the best single training source for the other three domains. Shrinking the other training sets to the cameras size never improved F-Measure, and combining cars + cameras did not beat cameras alone.

## Interesting ideas
- **Encode linguistic heuristics as features:** "directly attached to an opinion word" and "nearest noun phrase" become token-level features instead of hard rules. The CRF then learns how much to trust each cue, which is a cheap way to inject syntax into a sequence labeler for any span-extraction task.
- **Drop lexical features to transfer:** removing the token string feature kept results stable, or even helped, when the target vocabulary differs between domains. Lexically independent features (POS, dependency relations) are a natural first move for domain transfer, including transfer to new languages or text genres.
- **Systematic train/test domain grid:** training on every domain and domain combination, then testing on held-out domains, shows which sources actually transfer. Here more mixed data was not automatically better, which is a useful evaluation design for any multi-domain corpus.
- **Check for overfitting by matching sizes:** subsampling larger training sets down to the size of the smallest one separates data quantity from domain fit. This simple control is easy to reuse when comparing corpora of unequal size.
- **Watch for gold-input dependence:** three of the features rely on gold opinion expression annotations, and the authors flag this themselves. This is a reminder to measure pipeline error propagation before deploying such features in practice.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/)

## Cited by

Cited by

75 papers of our library cite it (of the 140884 whose bibliographies we read); 3 of them have a page here, 72 not yet.

- [Open Domain Targeted Sentiment](https://md.research.elamur.ai/free/en/papers/mitchell-2013-open-domain-targeted-sentiment/)
- [Recursive Neural Conditional Random Fields for Aspect-based Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/wang-2016-recursive-neural-conditional-random-fields/)
- [Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction](https://md.research.elamur.ai/free/en/papers/xu-2018-double-embeddings-cnn-based-sequence/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{jakob2010extracting,
  title = {{Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields}},
  author = {Jakob, Niklas and Gurevych, Iryna},
  booktitle = {Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing},
  year = {2010},
  url = {https://aclanthology.org/D10-1101/}
}
```

- [← previous Extending BART to Provide a Coreference Resolution System for German](https://md.research.elamur.ai/free/en/papers/broscheit-2010-extending-bart-provide-coreference-resolution/)
- [next → Extracting Parallel Sentences from Comparable Corpora using Document Level Alignment](https://md.research.elamur.ai/free/en/papers/smith-2010-extracting-parallel-sentences-comparable-corpora/)
- [↑ back to papers of 2010](https://md.research.elamur.ai/free/en/papers/2010/)

## References

16 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Anthony Aue and Michael Gamon. 2005. Customizing sentiment classifiers to new domains: A case study. In Proceedings of the 5th International Conference on Recent Advances in Natural Language Processing, Borovets, Bulgaria, September. [find](https://scholar.google.com/scholar?q=Anthony+Aue+and+Michael+Gamon%2E+2005%2E+Customizing+sentiment+classifiers+to+new+domains%3A+A+case+study%2E+In+Proceedings+of+the+5th+International+Conference+on+Recent+Advances+in+Natural+Language+Processin)
2. John Blitzer, Mark Dredze, and Fernando Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 440–447, Prague, Czech Republic, June. [find](https://scholar.google.com/scholar?q=John+Blitzer%2C+Mark+Dredze%2C+and+Fernando+Pereira%2E+2007%2E+Biographies%2C+bollywood%2C+boom%2Dboxes+and+blenders%3A+Domain+adaptation+for+sentiment+classification%2E+In+Proceedings+of+the+45th+Annual+Meeting+of+the) [our card](https://md.research.elamur.ai/free/en/papers/blitzer-2007-biographies-bollywood-boom-boxes-blenders/)
3. Kenneth Bloom, Navendu Garg, and Shlomo Argamon. 2007. Extracting appraisal expressions. In Proceedings of Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, pages 308– 315, Rochester, New York, USA, April. [find](https://scholar.google.com/scholar?q=Kenneth+Bloom%2C+Navendu+Garg%2C+and+Shlomo+Argamon%2E+2007%2E+Extracting+appraisal+expressions%2E+In+Proceedings+of+Human+Language+Technologies+2007%3A+The+Conference+of+the+North+American+Chapter+of+the+Associa)
4. Yejin Choi, Claire Cardie, Ellen Riloff, and Siddharth Patwardhan. 2005. Identifying sources of opinions with conditional random fields and extraction patterns. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pages 355–362, V… [find](https://scholar.google.com/scholar?q=Yejin+Choi%2C+Claire+Cardie%2C+Ellen+Riloff%2C+and+Siddharth+Patwardhan%2E+2005%2E+Identifying+sources+of+opinions+with+conditional+random+fields+and+extraction+patterns%2E+In+Proceedings+of+Human+Language+Techno)
5. James R. Cowie and Wendy G. Lehnert. 1996. Information extraction. Communications of the ACM, 39(1):80–91. [find](https://scholar.google.com/scholar?q=James+R%2E+Cowie+and+Wendy+G%2E+Lehnert%2E+1996%2E+Information+extraction%2E+Communications+of+the+ACM%2C+39%281%29%3A80%E2%80%9391%2E)
6. Hal Daumé III and Daniel Marcu. 2006. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research (JAIR), 26:101–126. [find](https://scholar.google.com/scholar?q=Hal+Daume%CC%81+III+and+Daniel+Marcu%2E+2006%2E+Domain+adaptation+for+statistical+classifiers%2E+Journal+of+Artificial+Intelligence+Research+%28JAIR%29%2C+26%3A101%E2%80%93126%2E)
7. Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 168–177, Seattle, Washington, USA, August. [find](https://scholar.google.com/scholar?q=Minqing+Hu+and+Bing+Liu%2E+2004%2E+Mining+and+summarizing+customer+reviews%2E+In+Proceedings+of+the+10th+ACM+SIGKDD+International+Conference+on+Knowledge+Discovery+and+Data+Mining%2C+pages+168%E2%80%93177%2C+Seattle%2C+W)
8. Jing Jiang and ChengXiang Zhai. 2007. Instance weighting for domain adaptation in nlp. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 264–271, Prague, Czech Republic, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jing+Jiang+and+ChengXiang+Zhai%2E+2007%2E+Instance+weighting+for+domain+adaptation+in+nlp%2E+In+Proceedings+of+the+45th+Annual+Meeting+of+the+Association+of+Computational+Linguistics%2C+pages+264%E2%80%93271%2C+Prague%2C) [our card](https://md.research.elamur.ai/free/en/papers/jiang-2007-instance-weighting-domain-adaptation-nlp/)
9. Jason Kessler and Nicolas Nicolov. 2009. Targeting sentiment expressions through supervised ranking of linguistic configurations. In Proceedings of the Third International AAAI Conference on Weblogs and Social Media, pages 90–97, San Jose, California, USA, May. [find](https://scholar.google.com/scholar?q=Jason+Kessler+and+Nicolas+Nicolov%2E+2009%2E+Targeting+sentiment+expressions+through+supervised+ranking+of+linguistic+configurations%2E+In+Proceedings+of+the+Third+International+AAAI+Conference+on+Weblogs+a)
10. Soo-Min Kim and Eduard Hovy. 2006. Extracting opinions, opinion holders, and topics expressed in online news media text. In Proceedings of the ACL Workshop on Sentiment and Subjectivity in Text, pages 1–8, Sydney, Australia, July. [find](https://scholar.google.com/scholar?q=Soo%2DMin+Kim+and+Eduard+Hovy%2E+2006%2E+Extracting+opinions%2C+opinion+holders%2C+and+topics+expressed+in+online+news+media+text%2E+In+Proceedings+of+the+ACL+Workshop+on+Sentiment+and+Subjectivity+in+Text%2C+pages) [our card](https://md.research.elamur.ai/free/en/papers/kim-2006-extracting-opinions-opinion-holders-topics/)
11. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning, pages 282–289, Williamstown, MA, USA, June. [find](https://scholar.google.com/scholar?q=John+D%2E+Lafferty%2C+Andrew+McCallum%2C+and+Fernando+C%2E+N%2E+Pereira%2E+2001%2E+Conditional+random+fields%3A+Probabilistic+models+for+segmenting+and+labeling+sequence+data%2E+In+Proceedings+of+the+18th+International)
12. Fuchun Peng and Andrew McCallum. 2006. Information extraction from research papers using conditional random fields. Information Processing and Management, 42(4):963–979, July. [find](https://scholar.google.com/scholar?q=Fuchun+Peng+and+Andrew+McCallum%2E+2006%2E+Information+extraction+from+research+papers+using+conditional+random+fields%2E+Information+Processing+and+Management%2C+42%284%29%3A963%E2%80%93979%2C+July%2E)
13. Ana-Maria Popescu and Oren Etzioni. 2005. Extracting product features and opinions from reviews. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pages 339–346, Vancouver, Canada, October. [find](https://scholar.google.com/scholar?q=Ana%2DMaria+Popescu+and+Oren+Etzioni%2E+2005%2E+Extracting+product+features+and+opinions+from+reviews%2E+In+Proceedings+of+Human+Language+Technology+Conference+and+Conference+on+Empirical+Methods+in+Natural+L) [our card](https://md.research.elamur.ai/free/en/papers/popescu-2005-extracting-product-features-opinions-reviews/)
14. Cigdem Toprak, Niklas Jakob, and Iryna Gurevych. 2010. Sentence and expression level annotation of opinions in user-generated discourse. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 575–584, Uppsala, Sweden, July. [find](https://scholar.google.com/scholar?q=Cigdem+Toprak%2C+Niklas+Jakob%2C+and+Iryna+Gurevych%2E+2010%2E+Sentence+and+expression+level+annotation+of+opinions+in+user%2Dgenerated+discourse%2E+In+Proceedings+of+the+48th+Annual+Meeting+of+the+Association+fo)
15. Jeonghee Yi, Tetsuya Nasukawa, Razvan Bunescu, and Wayne Niblack. 2003. Sentiment analyzer: Extracting sentiments about a given topic using natural language processing techniques. In Proceedings of the 3rd IEEE International Conference on Data Mining, pages 427–434, Melbourne, Florida, USA, December… [find](https://scholar.google.com/scholar?q=Jeonghee+Yi%2C+Tetsuya+Nasukawa%2C+Razvan+Bunescu%2C+and+Wayne+Niblack%2E+2003%2E+Sentiment+analyzer%3A+Extracting+sentiments+about+a+given+topic+using+natural+language+processing+techniques%2E+In+Proceedings+of+th)
16. Li Zhuang, Feng Jing, and Xiao-Yan Zhu. 2006. Movie review mining and summarization. In Proceedings of the ACM 15th Conference on Information and Knowledge Management, pages 43–50, Arlington, Virginia, USA, November. [find](https://scholar.google.com/scholar?q=Li+Zhuang%2C+Feng+Jing%2C+and+Xiao%2DYan+Zhu%2E+2006%2E+Movie+review+mining+and+summarization%2E+In+Proceedings+of+the+ACM+15th+Conference+on+Information+and+Knowledge+Management%2C+pages+43%E2%80%9350%2C+Arlington%2C+Virginia)