---
title: "Recognizing Contextual Polarity — Wilson 2009"
description: "Sentiment lexicons list a word's out-of-context (prior) polarity, but an actual occurrence of that word may carry a different, or no, sentiment in its…"
authors: ["Theresa Wilson", "Janyce Wiebe", "Paul Hoffmann"]
year: 2009
venue: "Computational Linguistics"
source: "https://aclanthology.org/J09-3003/"
doi: "10.1162/coli.08-012-r1-06-90"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wilson-2009-recognizing-contextual-polarity-exploration-features/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wilson-2009-recognizing-contextual-polarity-exploration-features/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2009](https://md.research.elamur.ai/free/en/papers/2009/) / Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis

# Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis

**Authors:** [Theresa Wilson](https://md.research.elamur.ai/free/en/authors/theresa-wilson/), [Janyce Wiebe](https://md.research.elamur.ai/free/en/authors/janyce-wiebe/), [Paul Hoffmann](https://md.research.elamur.ai/free/en/authors/paul-hoffmann/) · **Institutions:** [University of Edinburgh](https://md.research.elamur.ai/free/en/universities/university-of-edinburgh/) · [University of Pittsburgh](https://md.research.elamur.ai/free/en/universities/university-of-pittsburgh/) · **Year:** 2009 · **Venue:** Computational Linguistics · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/J09-3003/) · [PDF](https://aclanthology.org/J09-3003.pdf) · [DOI 10.1162/coli.08-012-r1-06-90](https://doi.org/10.1162/coli.08-012-r1-06-90) · [OpenAlex](https://openalex.org/W2146111747)

**Citations:** 722 citations (OpenAlex, 2026-10-14) · [102](https://md.research.elamur.ai/free/en/papers/wilson-2009-recognizing-contextual-polarity-exploration-features/cited-by/) in our library, of the 140884 papers whose bibliographies we read

## Summary
Sentiment lexicons list a word's out-of-context (prior) polarity, but an actual occurrence of that word may carry a different, or no, sentiment in its sentence. Wilson, Wiebe and Hoffmann study how to automatically recognise this contextual polarity at the phrase level. They added contextual polarity labels to the subjective expressions already marked in the MPQA opinion corpus and showed that annotators can apply these labels consistently. They then took a large prior-polarity lexicon and classified each clue instance found in the corpus in two stages. The first stage separates neutral from polar uses, and the second decides between positive and negative. Many linguistically motivated features were tested across several machine learning algorithms. The most accurate results usually came from combining all features. Negation features mattered most for the positive/negative decision. Neutral instances turned out to be the main obstacle. This makes the work a key reference for phrase-level opinion mining, opinion question answering and summarisation.

## Key points
- **Resource:** contextual polarity annotations were layered onto the existing Multi-perspective Question Answering (MPQA) corpus, and an agreement study confirmed the labels are reliable.
- **Frequency of neutral uses:** lexicon words with positive or negative prior polarity occur in neutral contexts far more often than with flipped polarity.
- **Pipeline:** a two-step classifier first labels clue instances as neutral or polar, then assigns positive or negative to the polar ones. Features cover negation (local and long-distance), modality, word sense, syntactic role, diminishers/intensifiers, document topic and interactions between clues.
- **Feature results:** for neutral vs. polar, single features improve only recall or precision, and only the full combination significantly beats the baselines in accuracy. For positive vs. negative, negation features are strongest, followed by features capturing clues modifying each other.
- **Effect of neutral data:** including neutral instances sharply weakens positive/negative features, so better neutral detection is identified as the most promising route to overall gains.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{wilson2009recognizing,
  title = {{Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis}},
  author = {Wilson, Theresa and Wiebe, Janyce and Hoffmann, Paul},
  journal = {Computational Linguistics},
  year = {2009},
  doi = {10.1162/coli.08-012-r1-06-90},
  url = {https://doi.org/10.1162/coli.08-012-r1-06-90}
}
```

- [← previous Reciprocal Rank Fusion Outperforms Condorcet and Individual Rank Learning Methods](https://md.research.elamur.ai/free/en/papers/cormack-2009-reciprocal-rank-fusion-outperforms/)
- [next → Overview of BioNLP'09 Shared Task on Event Extraction](https://md.research.elamur.ai/free/en/papers/kim-2009-overview-bionlp-09-shared-task/)
- [↑ back to papers of 2009](https://md.research.elamur.ai/free/en/papers/2009/)

## References

54 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Andreevskaia, Alina and Sabine Bergler. 2006. Mining WordNet for fuzzy sentiment: Sentiment tag extraction from WordNet glosses. In Proceedings of the 11th Meeting of the European Chapter of the Association for Computational Linguistics (EACL-2006), pages 209–216, Trento. [find](https://scholar.google.com/scholar?q=Andreevskaia%2C+Alina+and+Sabine+Bergler%2E+2006%2E+Mining+WordNet+for+fuzzy+sentiment%3A+Sentiment+tag+extraction+from+WordNet+glosses%2E+In+Proceedings+of+the+11th+Meeting+of+the+European+Chapter+of+the+Assoc)
2. Bai, Xue, Rema Padman, and Edoardo Airoldi. 2005. On learning parsimonious models for extracting consumer opinions. In Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS’05) - Track 3, page 75.2, Waikoloa, HI. [find](https://scholar.google.com/scholar?q=Bai%2C+Xue%2C+Rema+Padman%2C+and+Edoardo+Airoldi%2E+2005%2E+On+learning+parsimonious+models+for+extracting+consumer+opinions%2E+In+Proceedings+of+the+38th+Annual+Hawaii+International+Conference+on+System+Sciences)
3. Banfield, Ann. 1982. Unspeakable Sentences. Routledge and Kegan Paul, Boston. [find](https://scholar.google.com/scholar?q=Banfield%2C+Ann%2E+1982%2E+Unspeakable+Sentences%2E+Routledge+and+Kegan+Paul%2C+Boston%2E)
4. Beineke, Philip, Trevor Hastie, and Shivakumar Vaithyanathan. 2004. The sentimental factor: Improving review classification via human-provided information. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pages 263–270, Barcelona. [find](https://scholar.google.com/scholar?q=Beineke%2C+Philip%2C+Trevor+Hastie%2C+and+Shivakumar+Vaithyanathan%2E+2004%2E+The+sentimental+factor%3A+Improving+review+classification+via+human%2Dprovided+information%2E+In+Proceedings+of+the+42nd+Annual+Meeting+of)
5. Cohen, William W. 1996. Learning trees and rules with set-valued features. In Proceedings of the 13th National Conference on Artificial Intelligence, pages 709–717, Portland, OR. [find](https://scholar.google.com/scholar?q=Cohen%2C+William+W%2E+1996%2E+Learning+trees+and+rules+with+set%2Dvalued+features%2E+In+Proceedings+of+the+13th+National+Conference+on+Artificial+Intelligence%2C+pages+709%E2%80%93717%2C+Portland%2C+OR%2E)
6. Collins, Michael. 1997. Three generative, lexicalised models for statistical parsing. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics (ACL-97), pages 16–23, Madrid. [find](https://scholar.google.com/scholar?q=Collins%2C+Michael%2E+1997%2E+Three+generative%2C+lexicalised+models+for+statistical+parsing%2E+In+Proceedings+of+the+35th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28ACL%2D97%29%2C+pages+16%E2%80%9323%2C+) [our card](https://md.research.elamur.ai/free/en/papers/collins-1997-three-generative-lexicalised-models-statistical/)
7. Daelemans, Walter, Véronique Hoste, Fien De Meulder, and Bart Naudts. 2003a. Combined optimization of feature selection and algorithm parameter interaction in machine learning of language. In Proceedings of the 14th European Conference on Machine Learning (ECML-2003), pages 84–95, Cavtat-Dubrovnik. [find](https://scholar.google.com/scholar?q=Daelemans%2C+Walter%2C+Ve%CC%81ronique+Hoste%2C+Fien+De+Meulder%2C+and+Bart+Naudts%2E+2003a%2E+Combined+optimization+of+feature+selection+and+algorithm+parameter+interaction+in+machine+learning+of+language%2E+In+Proceed)
8. Daelemans, Walter, Jakub Zavrel, Ko van der Sloot, and Antal van den Bosch. 2003b. TiMBL: Tilburg Memory Based Learner, version 5.0 Reference Guide. ILK Technical Report 03-10, Induction of Linguistic Knowledge Research Group, Tilburg University. Available at [http://ilk.uvt](http://ilk.uvt). nl/downloads/pub/papers/… [↗](http://ilk.uvt)
9. Das, Sanjiv Ranjan and Mike Y. Chen. 2001. Yahoo! for Amazon: Sentiment parsing from small talk on the Web. In Proceedings of the August 2001 Meeting of the European Finance Association (EFA), Barcelona, Spain. Available at [http://ssrn.com/abstract=276189](http://ssrn.com/abstract=276189). [↗](http://ssrn.com/abstract=276189)
10. Dave, Kushal, Steve Lawrence, and David M. Pennock. 2003. Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. In Proceedings of the 12th International World Wide Web Conference (WWW2003), Budapest. Available at [http://www2003.org](http://www2003.org). [↗](http://www2003.org)
11. Esuli, Andrea and Fabrizio Sebastiani. 2005. Determining the semantic orientation of terms through gloss analysis. In Proceedings of ACM SIGIR Conference on Information and Knowledge Management (CIKM-05), pages 617–624, Bremen. [find](https://scholar.google.com/scholar?q=Esuli%2C+Andrea+and+Fabrizio+Sebastiani%2E+2005%2E+Determining+the+semantic+orientation+of+terms+through+gloss+analysis%2E+In+Proceedings+of+ACM+SIGIR+Conference+on+Information+and+Knowledge+Management+%28CIKM%2D)
12. Esuli, Andrea and Fabrizio Sebastiani. 2006a. Determining term subjectivity and term orientation for opinion mining. In Proceedings the 11th Meeting of the European Chapter of the Association for Computational Linguistics (EACL-2006), pages 193–200, Trento. [find](https://scholar.google.com/scholar?q=Esuli%2C+Andrea+and+Fabrizio+Sebastiani%2E+2006a%2E+Determining+term+subjectivity+and+term+orientation+for+opinion+mining%2E+In+Proceedings+the+11th+Meeting+of+the+European+Chapter+of+the+Association+for+Comp)
13. Esuli, Andrea and Fabrizio Sebastiani. 2006b. SentiWordNet: A publicly available lexical resource for opinion mining. In Proceedings of LREC-06, the 5th Conference on Language Resources and Evaluation, pages 417–422, Genoa. [find](https://scholar.google.com/scholar?q=Esuli%2C+Andrea+and+Fabrizio+Sebastiani%2E+2006b%2E+SentiWordNet%3A+A+publicly+available+lexical+resource+for+opinion+mining%2E+In+Proceedings+of+LREC%2D06%2C+the+5th+Conference+on+Language+Resources+and+Evaluation) [our card](https://md.research.elamur.ai/free/en/papers/esuli-2006-sentiwordnet-publicly-available-lexical-resource/)
14. Gamon, Michael. 2004. Sentiment classification on customer feedback data: Noisy data, large feature vectors, and the role of linguistic analysis. In Proceedings of the 20th International Conference on Computational Linguistics (COLING-2004), pages 611–617, Geneva. [find](https://scholar.google.com/scholar?q=Gamon%2C+Michael%2E+2004%2E+Sentiment+classification+on+customer+feedback+data%3A+Noisy+data%2C+large+feature+vectors%2C+and+the+role+of+linguistic+analysis%2E+In+Proceedings+of+the+20th+International+Conference+on)
15. Grefenstette, Gregory, Yan Qu, James G. Shanahan, and David A. Evans. 2004. Coupling niche browsers and affect analysis for an opinion mining application. In Proceedings of the Conference Recherche d’Information Assistee par Ordinateur (RIAO-2004), pages 186–194, Avignon. [find](https://scholar.google.com/scholar?q=Grefenstette%2C+Gregory%2C+Yan+Qu%2C+James+G%2E+Shanahan%2C+and+David+A%2E+Evans%2E+2004%2E+Coupling+niche+browsers+and+affect+analysis+for+an+opinion+mining+application%2E+In+Proceedings+of+the+Conference+Recherche+d%E2%80%99)
16. Hatzivassiloglou, Vasileios and Kathy McKeown. 1997. Predicting the semantic orientation of adjectives. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics (ACL-97), pages 174–181, Madrid. [find](https://scholar.google.com/scholar?q=Hatzivassiloglou%2C+Vasileios+and+Kathy+McKeown%2E+1997%2E+Predicting+the+semantic+orientation+of+adjectives%2E+In+Proceedings+of+the+35th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28ACL%2D)
17. Hoste, Véronique. 2005. Optimization Issues in Machine Learning of Coreference Resolution. Ph.D. thesis, Language Technology Group, University of Antwerp. [find](https://scholar.google.com/scholar?q=Hoste%2C+Ve%CC%81ronique%2E+2005%2E+Optimization+Issues+in+Machine+Learning+of+Coreference+Resolution%2E+Ph%2ED%2E+thesis%2C+Language+Technology+Group%2C+University+of+Antwerp%2E)
18. Hu, Minqing and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining 2004 (KDD-2004), pages 168–177, Seattle, WA. [find](https://scholar.google.com/scholar?q=Hu%2C+Minqing+and+Bing+Liu%2E+2004%2E+Mining+and+summarizing+customer+reviews%2E+In+Proceedings+of+ACM+SIGKDD+Conference+on+Knowledge+Discovery+and+Data+Mining+2004+%28KDD%2D2004%29%2C+pages+168%E2%80%93177%2C+Seattle%2C+WA%2E)
19. Hummel, Robert A. and Steven W. Zucker. 1983. On the foundations of relaxation labeling processes. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 5(3):167–187. [find](https://scholar.google.com/scholar?q=Hummel%2C+Robert+A%2E+and+Steven+W%2E+Zucker%2E+1983%2E+On+the+foundations+of+relaxation+labeling+processes%2E+IEEE+Transactions+on+Pattern+Analysis+and+Machine+Intelligence+%28PAMI%29%2C+5%283%29%3A167%E2%80%93187%2E)
20. Joachims, Thorsten. 1999. Making large-scale SVM learning practical. In B. Scholkopf, C. Burgess, and A. Smola, editors, Advances in Kernel Methods – Support Vector Learning, pages 169–184. MIT Press, Cambridge, MA. [find](https://scholar.google.com/scholar?q=Joachims%2C+Thorsten%2E+1999%2E+Making+large%2Dscale+SVM+learning+practical%2E+In+B%2E+Scholkopf%2C+C%2E+Burgess%2C+and+A%2E+Smola%2C+editors%2C+Advances+in+Kernel+Methods+%E2%80%93+Support+Vector+Learning%2C+pages+169%E2%80%93184%2E+MIT+Press%2C)
21. Kaji, Nobuhiro and Masaru Kitsuregawa. 2006. Automatic construction of polarity-tagged corpus from HTML documents. In Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions, pages 452–459, Sydney. [find](https://scholar.google.com/scholar?q=Kaji%2C+Nobuhiro+and+Masaru+Kitsuregawa%2E+2006%2E+Automatic+construction+of+polarity%2Dtagged+corpus+from+HTML+documents%2E+In+Proceedings+of+the+COLING%2FACL+2006+Main+Conference+Poster+Sessions%2C+pages+452%E2%80%93459%2C)
22. Kamps, Jaap and Maarten Marx. 2002. Words with attitude. In Proceedings of the 1st International Conference on Global WordNet, pages 332–341, Mysore. [find](https://scholar.google.com/scholar?q=Kamps%2C+Jaap+and+Maarten+Marx%2E+2002%2E+Words+with+attitude%2E+In+Proceedings+of+the+1st+International+Conference+on+Global+WordNet%2C+pages+332%E2%80%93341%2C+Mysore%2E)
23. Kanayama, Hiroshi and Tetsuya Nasukawa. 2006. Fully automatic lexicon expansion for domain-oriented sentiment analysis. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2006), pages 355–363, Sydney. [find](https://scholar.google.com/scholar?q=Kanayama%2C+Hiroshi+and+Tetsuya+Nasukawa%2E+2006%2E+Fully+automatic+lexicon+expansion+for+domain%2Doriented+sentiment+analysis%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Language+Proces)
24. Kennedy, Alistair and Diana Inkpen. 2006. Sentiment classification of movie reviews using contextual valence shifters. Computational Intelligence, 22(2):110–125. [find](https://scholar.google.com/scholar?q=Kennedy%2C+Alistair+and+Diana+Inkpen%2E+2006%2E+Sentiment+classification+of+movie+reviews+using+contextual+valence+shifters%2E+Computational+Intelligence%2C+22%282%29%3A110%E2%80%93125%2E)
25. Kim, Soo-Min and Eduard Hovy. 2004. Determining the sentiment of opinions. In Proceedings of the 20th International Conference on Computational Linguistics (COLING-2004), pages 1267–1373, Geneva. [find](https://scholar.google.com/scholar?q=Kim%2C+Soo%2DMin+and+Eduard+Hovy%2E+2004%2E+Determining+the+sentiment+of+opinions%2E+In+Proceedings+of+the+20th+International+Conference+on+Computational+Linguistics+%28COLING%2D2004%29%2C+pages+1267%E2%80%931373%2C+Geneva%2E) [our card](https://md.research.elamur.ai/free/en/papers/kim-2004-determining-sentiment-opinions/)
26. Koppel, Moshe and Jonathan Schler. 2006. The importance of neutral examples for learning sentiment. Computational Intelligence, 22(2):100–109. [find](https://scholar.google.com/scholar?q=Koppel%2C+Moshe+and+Jonathan+Schler%2E+2006%2E+The+importance+of+neutral+examples+for+learning+sentiment%2E+Computational+Intelligence%2C+22%282%29%3A100%E2%80%93109%2E)
27. Maybury, Mark T., editor. 2004. New Directions in Question Answering. American Association for Artificial Intelligence, Menlo Park, CA. [find](https://scholar.google.com/scholar?q=Maybury%2C+Mark+T%2E%2C+editor%2E+2004%2E+New+Directions+in+Question+Answering%2E+American+Association+for+Artificial+Intelligence%2C+Menlo+Park%2C+CA%2E)
28. Morinaga, Satoshi, Kenji Yamanishi, Kenji Tateishi, and Toshikazu Fukushima. 2002. Mining product reputations on the Web. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002), pages 341–349, Edmonton. [find](https://scholar.google.com/scholar?q=Morinaga%2C+Satoshi%2C+Kenji+Yamanishi%2C+Kenji+Tateishi%2C+and+Toshikazu+Fukushima%2E+2002%2E+Mining+product+reputations+on+the+Web%2E+In+Proceedings+of+the+8th+ACM+SIGKDD+International+Conference+on+Knowledge+Dis)
29. Mullen, Tony and Nigel Collier. 2004. Sentiment analysis using support vector machines with diverse information sources. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2004), pages 412–418, Barcelona. [find](https://scholar.google.com/scholar?q=Mullen%2C+Tony+and+Nigel+Collier%2E+2004%2E+Sentiment+analysis+using+support+vector+machines+with+diverse+information+sources%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Language+Proce)
30. Nasukawa, Tetsuya and Jeonghee Yi. 2003. Sentiment analysis: Capturing favorability using natural language processing. In Proceedings of the 2nd International Conference on Knowledge Capture (K-CAP 2003), pages 70–77, Sanibel Island, FL. [find](https://scholar.google.com/scholar?q=Nasukawa%2C+Tetsuya+and+Jeonghee+Yi%2E+2003%2E+Sentiment+analysis%3A+Capturing+favorability+using+natural+language+processing%2E+In+Proceedings+of+the+2nd+International+Conference+on+Knowledge+Capture+%28K%2DCAP+20)
31. Pang, Bo, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2002), pages 79–86, Philadelphia, PA. [find](https://scholar.google.com/scholar?q=Pang%2C+Bo%2C+Lillian+Lee%2C+and+Shivakumar+Vaithyanathan%2E+2002%2E+Thumbs+up%3F+Sentiment+classification+using+machine+learning+techniques%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Langu) [our card](https://md.research.elamur.ai/free/en/papers/pang-2002-thumbs-up-sentiment-classification-machine/)
32. Polanyi, Livia and Annie Zaenen. 2004. Contextual valence shifters. In Working Notes of the AAAI Spring Symposium on Exploring Attitude and Affect in Text: Theories and Applications, pages 106–111, The AAAI Press, Menlo Park, CA. [find](https://scholar.google.com/scholar?q=Polanyi%2C+Livia+and+Annie+Zaenen%2E+2004%2E+Contextual+valence+shifters%2E+In+Working+Notes+of+the+AAAI+Spring+Symposium+on+Exploring+Attitude+and+Affect+in+Text%3A+Theories+and+Applications%2C+pages+106%E2%80%93111%2C+Th)
33. Popescu, Ana-Maria and Oren Etzioni. 2005. Extracting product features and opinions from reviews. In Proceedings of the Human Language Technologies Conference/Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP-2005), pages 339–346, Vancouver. [find](https://scholar.google.com/scholar?q=Popescu%2C+Ana%2DMaria+and+Oren+Etzioni%2E+2005%2E+Extracting+product+features+and+opinions+from+reviews%2E+In+Proceedings+of+the+Human+Language+Technologies+Conference%2FConference+on+Empirical+Methods+in+Natura) [our card](https://md.research.elamur.ai/free/en/papers/popescu-2005-extracting-product-features-opinions-reviews/)
34. Quirk, Randolph, Sidney Greenbaum, Geoffry Leech, and Jan Svartvik. 1985. A Comprehensive Grammar of the English Language. Longman, New York. [find](https://scholar.google.com/scholar?q=Quirk%2C+Randolph%2C+Sidney+Greenbaum%2C+Geoffry+Leech%2C+and+Jan+Svartvik%2E+1985%2E+A+Comprehensive+Grammar+of+the+English+Language%2E+Longman%2C+New+York%2E)
35. Riloff, Ellen and Janyce Wiebe. 2003. Learning extraction patterns for subjective expressions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2003), pages 105–112, Sapporo. [find](https://scholar.google.com/scholar?q=Riloff%2C+Ellen+and+Janyce+Wiebe%2E+2003%2E+Learning+extraction+patterns+for+subjective+expressions%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%2D2003%29%2C+pages+) [our card](https://md.research.elamur.ai/free/en/papers/riloff-2003-learning-extraction-patterns-subjective-expressions/)
36. Schapire, Robert E. and Yoram Singer. 2000. BoosTexter: A boosting-based system for text categorization. Machine Learning, 39(2/3):135–168. [find](https://scholar.google.com/scholar?q=Schapire%2C+Robert+E%2E+and+Yoram+Singer%2E+2000%2E+BoosTexter%3A+A+boosting%2Dbased+system+for+text+categorization%2E+Machine+Learning%2C+39%282%2F3%29%3A135%E2%80%93168%2E)
37. Spertus, Ellen. 1997. Smokey: Automatic recognition of hostile messages. In Proceedings of the 8th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-97), pages 1058–1065, Providence, RI. [find](https://scholar.google.com/scholar?q=Spertus%2C+Ellen%2E+1997%2E+Smokey%3A+Automatic+recognition+of+hostile+messages%2E+In+Proceedings+of+the+8th+Annual+Conference+on+Innovative+Applications+of+Artificial+Intelligence+%28IAAI%2D97%29%2C+pages+1058%E2%80%931065%2C+P)
38. Stone, Philip J., Dexter C. Dunphy, Marshall S. Smith, and Daniel M. Ogilvie. 1966. The General Inquirer: A Computer Approach to Content Analysis. MIT Press, Cambridge, MA. [find](https://scholar.google.com/scholar?q=Stone%2C+Philip+J%2E%2C+Dexter+C%2E+Dunphy%2C+Marshall+S%2E+Smith%2C+and+Daniel+M%2E+Ogilvie%2E+1966%2E+The+General+Inquirer%3A+A+Computer+Approach+to+Content+Analysis%2E+MIT+Press%2C+Cambridge%2C+MA%2E)
39. Stoyanov, Veselin, Claire Cardie, and Janyce Wiebe. 2005. Multi-perspective question answering using the OpQA corpus. In Proceedings of the Human Language Technologies Conference/ Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP-2005), pages 923–930, Vancouver. [find](https://scholar.google.com/scholar?q=Stoyanov%2C+Veselin%2C+Claire+Cardie%2C+and+Janyce+Wiebe%2E+2005%2E+Multi%2Dperspective+question+answering+using+the+OpQA+corpus%2E+In+Proceedings+of+the+Human+Language+Technologies+Conference%2F+Conference+on+Empiri)
40. Suzuki, Yasuhiro, Hiroya Takamura, and Manabu Okumura. 2006. Application of semi-supervised learning to evaluative expression classification. In Proceedings of the 7th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2006), pages 502–513, Mexico City. [find](https://scholar.google.com/scholar?q=Suzuki%2C+Yasuhiro%2C+Hiroya+Takamura%2C+and+Manabu+Okumura%2E+2006%2E+Application+of+semi%2Dsupervised+learning+to+evaluative+expression+classification%2E+In+Proceedings+of+the+7th+International+Conference+on+Inte)
41. Takamura, Hiroya, Takashi Inui, and Manabu Okumura. 2005. Extracting emotional polarity of words using spin model. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL-05), pages 133–140, Ann Arbor, MI. [find](https://scholar.google.com/scholar?q=Takamura%2C+Hiroya%2C+Takashi+Inui%2C+and+Manabu+Okumura%2E+2005%2E+Extracting+emotional+polarity+of+words+using+spin+model%2E+In+Proceedings+of+the+43rd+Annual+Meeting+of+the+Association+for+Computational+Lingui)
42. Tong, Richard. 2001. An operational system for detecting and tracking opinions in online discussions. In Working Notes of the SIGIR Workshop on Operational Text Classification, pages 1–6, New Orleans, LA. [find](https://scholar.google.com/scholar?q=Tong%2C+Richard%2E+2001%2E+An+operational+system+for+detecting+and+tracking+opinions+in+online+discussions%2E+In+Working+Notes+of+the+SIGIR+Workshop+on+Operational+Text+Classification%2C+pages+1%E2%80%936%2C+New+Orleans%2C)
43. Turney, Peter. 2002. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-02), pages 417–424, Philadelphia, PA. [find](https://scholar.google.com/scholar?q=Turney%2C+Peter%2E+2002%2E+Thumbs+up+or+thumbs+down%3F+Semantic+orientation+applied+to+unsupervised+classification+of+reviews%2E+In+Proceedings+of+the+40th+Annual+Meeting+of+the+Association+for+Computational+Li) [our card](https://md.research.elamur.ai/free/en/papers/turney-2002-thumbs-up-or-thumbs-down/)
44. Turney, Peter and Michael L. Littman. 2003. Measuring praise and criticism: Inference of semantic orientation from association. ACM Transactions on Information Systems (TOIS), 21(4):315–346. [find](https://scholar.google.com/scholar?q=Turney%2C+Peter+and+Michael+L%2E+Littman%2E+2003%2E+Measuring+praise+and+criticism%3A+Inference+of+semantic+orientation+from+association%2E+ACM+Transactions+on+Information+Systems+%28TOIS%29%2C+21%284%29%3A315%E2%80%93346%2E)
45. Whitelaw, Casey, Navendu Garg, and Shlomo Argamon. 2005. Using appraisal groups for sentiment analysis. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management (CIKM-2005), pages 625–631, Bremen. [find](https://scholar.google.com/scholar?q=Whitelaw%2C+Casey%2C+Navendu+Garg%2C+and+Shlomo+Argamon%2E+2005%2E+Using+appraisal+groups+for+sentiment+analysis%2E+In+Proceedings+of+the+14th+ACM+International+Conference+on+Information+and+Knowledge+Management+)
46. Wiebe, Janyce. 1994. Tracking point of view in narrative. Computational Linguistics, 20(2):233–287. [find](https://scholar.google.com/scholar?q=Wiebe%2C+Janyce%2E+1994%2E+Tracking+point+of+view+in+narrative%2E+Computational+Linguistics%2C+20%282%29%3A233%E2%80%93287%2E)
47. Wiebe, Janyce, Rebecca Bruce, and Thomas O’Hara. 1999. Development and use of a gold standard data set for subjectivity classifications. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL-99), pages 246–253, College Park, MD. [find](https://scholar.google.com/scholar?q=Wiebe%2C+Janyce%2C+Rebecca+Bruce%2C+and+Thomas+O%E2%80%99Hara%2E+1999%2E+Development+and+use+of+a+gold+standard+data+set+for+subjectivity+classifications%2E+In+Proceedings+of+the+37th+Annual+Meeting+of+the+Association+fo)
48. Wiebe, Janyce and Rada Mihalcea. 2006. Word sense and subjectivity. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 1065–1072, Sydney. [find](https://scholar.google.com/scholar?q=Wiebe%2C+Janyce+and+Rada+Mihalcea%2E+2006%2E+Word+sense+and+subjectivity%2E+In+Proceedings+of+the+21st+International+Conference+on+Computational+Linguistics+and+44th+Annual+Meeting+of+the+Association+for+Comp)
49. Wiebe, Janyce and Ellen Riloff. 2005. Creating subjective and objective sentence classifiers from unannotated texts. In Proceedings of the 6th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2005), pages 486–497, Mexico City. [find](https://scholar.google.com/scholar?q=Wiebe%2C+Janyce+and+Ellen+Riloff%2E+2005%2E+Creating+subjective+and+objective+sentence+classifiers+from+unannotated+texts%2E+In+Proceedings+of+the+6th+International+Conference+on+Intelligent+Text+Processing+a)
50. Wiebe, Janyce, Theresa Wilson, and Claire Cardie. 2005. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation (formerly Computers and the Humanities), 39(2/3):164–210. [find](https://scholar.google.com/scholar?q=Wiebe%2C+Janyce%2C+Theresa+Wilson%2C+and+Claire+Cardie%2E+2005%2E+Annotating+expressions+of+opinions+and+emotions+in+language%2E+Language+Resources+and+Evaluation+%28formerly+Computers+and+the+Humanities%29%2C+39%282%2F3%29%3A)
51. Wilson, Theresa, Janyce Wiebe, and Paul Hoffmann. 2005. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of the Human Language Technologies Conference/ Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP-2005), pages 347–354, Vancouver. [find](https://scholar.google.com/scholar?q=Wilson%2C+Theresa%2C+Janyce+Wiebe%2C+and+Paul+Hoffmann%2E+2005%2E+Recognizing+contextual+polarity+in+phrase%2Dlevel+sentiment+analysis%2E+In+Proceedings+of+the+Human+Language+Technologies+Conference%2F+Conference+on+) [our card](https://md.research.elamur.ai/free/en/papers/wilson-2005-recognizing-contextual-polarity-phrase-level/)
52. Xia, Fei and Martha Palmer. 2001. Converting dependency structures to phrase structures. In Proceedings of the Human Language Technology Conference (HLT-2001), pages 1–5, San Diego, CA. [find](https://scholar.google.com/scholar?q=Xia%2C+Fei+and+Martha+Palmer%2E+2001%2E+Converting+dependency+structures+to+phrase+structures%2E+In+Proceedings+of+the+Human+Language+Technology+Conference+%28HLT%2D2001%29%2C+pages+1%E2%80%935%2C+San+Diego%2C+CA%2E)
53. Yi, Jeonghee, Tetsuya Nasukawa, Razvan Bunescu, and Wayne Niblack. 2003. Sentiment analyzer: Extracting sentiments about a given topic using natural language processing techniques. In Proceedings of the 3rd IEEE International Conference on Data Mining (ICDM’03), pages 427–434, Melbourne, FL. [find](https://scholar.google.com/scholar?q=Yi%2C+Jeonghee%2C+Tetsuya+Nasukawa%2C+Razvan+Bunescu%2C+and+Wayne+Niblack%2E+2003%2E+Sentiment+analyzer%3A+Extracting+sentiments+about+a+given+topic+using+natural+language+processing+techniques%2E+In+Proceedings+of+t)
54. Yu, Hong and Vasileios Hatzivassiloglou. 2003. Towards answering opinion questions: Separating facts from opinions and identifying the polarity of opinion sentences. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2003), pages 129–136, Sapporo. [find](https://scholar.google.com/scholar?q=Yu%2C+Hong+and+Vasileios+Hatzivassiloglou%2E+2003%2E+Towards+answering+opinion+questions%3A+Separating+facts+from+opinions+and+identifying+the+polarity+of+opinion+sentences%2E+In+Proceedings+of+the+Conference+o) [our card](https://md.research.elamur.ai/free/en/papers/yu-2003-answering-opinion-questions-separating-facts/)