---
title: "Classifying Sentences as Speech Acts in Message — Qadir 2011"
description: "Message board posts mix factual, expository content with conversational moves aimed at readers, such as greetings, requests for help and promises to…"
authors: ["Ashequl Qadir", "Ellen Riloff"]
year: 2011
venue: "Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/D11-1069/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/qadir-2011-classifying-sentences-as-speech-acts/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/qadir-2011-classifying-sentences-as-speech-acts/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2011](https://md.research.elamur.ai/free/en/papers/2011/) / Classifying Sentences as Speech Acts in Message Board Posts

# Classifying Sentences as Speech Acts in Message Board Posts

**Authors:** [Ashequl Qadir](https://md.research.elamur.ai/free/en/authors/ashequl-qadir/), [Ellen Riloff](https://md.research.elamur.ai/free/en/authors/ellen-riloff/) · **Year:** 2011 · **Venue:** Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/D11-1069/) · [PDF](https://aclanthology.org/D11-1069.pdf) · [OpenAlex](https://openalex.org/W2122491924)

**Citations:** 70 citations (openalex-snapshot · 2026-10-14) · [11](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary

Message board posts mix factual, expository content with conversational moves aimed at readers, such as greetings, requests for help and promises to follow up. Qadir and Riloff tackle two tasks on this hybrid genre. The first is separating sentences that carry a speech act from purely informative ones. The second is assigning speech act sentences to four of Searle's (1976) categories: Commissives, Directives, Expressives and Representatives. Declarations were left out because they almost never occurred.

The authors wrote annotation guidelines adapted to forum language and labelled posts from a veterinary medicine message board. They then trained sentence classifiers on unigrams, a compact set of lexical and syntactic cues, lists of speech act terms drawn from outside sources, and semantic class features tailored to the domain.

Speech act filtering, Directives and Expressives were recognised well, although simple heuristics such as question marks also work for these. Commissives benefited most from the richer features, while Representatives remained the hardest class. The features rely only on POS tags and, apart from the semantic ones, are domain-independent. This makes the approach practical for noisy web text and useful for information extraction, question tracking and summarisation.

## Key points

- Data: message board posts from the veterinary medicine domain, annotated at the sentence level with four Searle classes; Representatives were rare, covering only 2.91% of sentences, and had the lowest inter-annotator agreement.
- A reduced "minimal lexsyn" set of 10 features worked better than the full lexical/syntactic set. It comprises 4 Tense+Person features, Early Punctuation, a sentence-initial Modal/Verb feature and 4 Sentence Position features.
- Semantic features for TEST and DRUG categories came from a Basilisk lexicon and a semantic tagger. Together they raised Commissive F-score from 41% to 48%, likely because tests and drugs stand in for the doctor's future actions.
- Adding speech act clue words gave small recall gains for Expressives (+3%) and Representatives (+2%) but slightly hurt Commissives.
- The method requires no parsing, only part-of-speech tags. Proposed future work includes segmenting sentences into clauses and extracting the exact speech act expressions.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Speech act theory](https://md.research.elamur.ai/free/en/topics/speech-act-theory/) · [Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/)

## Cited by

Cited by

11 papers of our library cite it (of the 140673 whose bibliographies we read); 2 of them have a page here, 9 not yet.

- [Speech Act Modeling of Written Asynchronous Conversations with Task-Specific Embeddings and Conditional Structured Models](https://md.research.elamur.ai/free/en/papers/joty-2016-speech-act-modeling-written-asynchronous/)
- [Modeling Speech Acts in Asynchronous Conversations: A Neural-CRF Approach](https://md.research.elamur.ai/free/en/papers/joty-2018-modeling-speech-acts-asynchronous-conversations/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{qadir2011classifying,
  title = {{Classifying Sentences as Speech Acts in Message Board Posts}},
  author = {Qadir, Ashequl and Riloff, Ellen},
  booktitle = {Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing},
  year = {2011},
  url = {https://aclanthology.org/D11-1069/}
}
```

- [← previous Chinese Discourse Relation Recognition](https://md.research.elamur.ai/free/en/papers/huang-2011-chinese-discourse-relation-recognition/)
- [next → Collecting Highly Parallel Data for Paraphrase Evaluation](https://md.research.elamur.ai/free/en/papers/chen-2011-collecting-highly-parallel-data-paraphrase/)
- [↑ back to papers of 2011](https://md.research.elamur.ai/free/en/papers/2011/)

## References

21 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. James Allen. 1995. Natural language understanding (2nd ed.). Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, USA. [find](https://scholar.google.com/scholar?q=James+Allen%2E+1995%2E+Natural+language+understanding+%282nd+ed%2E%29%2E+Benjamin%2DCummings+Publishing+Co%2E%2C+Inc%2E%2C+Redwood+City%2C+CA%2C+USA%2E)
2. Jean Carletta. 1996. Assessing agreement on classification tasks: the kappa statistic. Comput. Linguist., 22:249–254, June. [↗](https://doi.org/10.48550/arxiv.cmp-lg/9602004) [our card](https://md.research.elamur.ai/free/en/papers/carletta-1996-assessing-agreement-classification-tasks-kappa/)
3. Vitor R. Carvalho and William W. Cohen. 2005. On the collective classification of email ”speech acts”. In SI-GIR ’05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 345–352, New York, NY, USA. ACM Press. [find](https://scholar.google.com/scholar?q=Vitor+R%2E+Carvalho+and+William+W%2E+Cohen%2E+2005%2E+On+the+collective+classification+of+email+%E2%80%9Dspeech+acts%E2%80%9D%2E+In+SI%2DGIR+%E2%80%9905%3A+Proceedings+of+the+28th+annual+international+ACM+SIGIR+conference+on+Research+and+)
4. Vitor R. Carvalho and William W. Cohen. 2006. Improving ”email speech acts” analysis via n-gram selection. In Proceedings of the HLT-NAACL 2006 Workshop on Analyzing Conversations in Text and Speech, ACTS ’09, pages 35–41, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Vitor+R%2E+Carvalho+and+William+W%2E+Cohen%2E+2006%2E+Improving+%E2%80%9Demail+speech+acts%E2%80%9D+analysis+via+n%2Dgram+selection%2E+In+Proceedings+of+the+HLT%2DNAACL+2006+Workshop+on+Analyzing+Conversations+in+Text+and+Speech%2C+)
5. William W. Cohen, Vitor R. Carvalho, and Tom M. Mitchell. 2004. Learning to classify email into “speech acts”. In EMNLP, pages 309–316. ACL. [find](https://scholar.google.com/scholar?q=William+W%2E+Cohen%2C+Vitor+R%2E+Carvalho%2C+and+Tom+M%2E+Mitchell%2E+2004%2E+Learning+to+classify+email+into+%E2%80%9Cspeech+acts%E2%80%9D%2E+In+EMNLP%2C+pages+309%E2%80%93316%2E+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/cohen-2004-learning-classify-email-into-speech/)
6. Jade Goldstein and Roberta Evans Sabin. 2006. Using speech acts to categorize email and identify email genres. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences - Volume 03, pages 50.2–, Washington, DC, USA. IEEE Computer Society. [find](https://scholar.google.com/scholar?q=Jade+Goldstein+and+Roberta+Evans+Sabin%2E+2006%2E+Using+speech+acts+to+categorize+email+and+identify+email+genres%2E+In+Proceedings+of+the+39th+Annual+Hawaii+International+Conference+on+System+Sciences+%2D+Vo)
7. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten. 2009. The weka data mining software: an update. SIGKDD Explor. Newsl., 11:10–18, November. [↗](https://doi.org/10.1145/1656274.1656278)
8. Ruihong Huang and Ellen Riloff. 2010. Inducing domain-specific semantic class taggers from (almost) nothing. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, ACL ’10, pages 275–285, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ruihong+Huang+and+Ellen+Riloff%2E+2010%2E+Inducing+domain%2Dspecific+semantic+class+taggers+from+%28almost%29+nothing%2E+In+Proceedings+of+the+48th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C)
9. Minwoo Jeong, Chin-Yew Lin, and Gary Geunbae Lee. 2009. Semi-supervised speech act recognition in emails and forums. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3, EMNLP ’09, pages 1250–1259, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Minwoo+Jeong%2C+Chin%2DYew+Lin%2C+and+Gary+Geunbae+Lee%2E+2009%2E+Semi%2Dsupervised+speech+act+recognition+in+emails+and+forums%2E+In+Proceedings+of+the+2009+Conference+on+Empirical+Methods+in+Natural+Language+Proc)
10. Andrew Lampert, Robert Dale, and Cecile Paris. 2006. Classifying speech acts using verbal response modes. In Proceedings of the 2006 Australasian Language Technology Workshop (ALTW2006), pages 34–41. Sydney Australia : ALTA. [find](https://scholar.google.com/scholar?q=Andrew+Lampert%2C+Robert+Dale%2C+and+Cecile+Paris%2E+2006%2E+Classifying+speech+acts+using+verbal+response+modes%2E+In+Proceedings+of+the+2006+Australasian+Language+Technology+Workshop+%28ALTW2006%29%2C+pages+34%E2%80%9341%2E+)
11. Tara McIntosh. 2010. Unsupervised discovery of negative categories in lexicon bootstrapping. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP ’10, pages 356–365, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Tara+McIntosh%2E+2010%2E+Unsupervised+discovery+of+negative+categories+in+lexicon+bootstrapping%2E+In+Proceedings+of+the+2010+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+EMNLP+%E2%80%9910%2C+pages)
12. John Mildinhall and Jan Noyes. 2008. Toward a stochastic speech act model of email behavior. In CEAS. [find](https://scholar.google.com/scholar?q=John+Mildinhall+and+Jan+Noyes%2E+2008%2E+Toward+a+stochastic+speech+act+model+of+email+behavior%2E+In+CEAS%2E)
13. Jacqueline Nastri, Jorge Pena, and Jeffrey T. Hancock. 2006. The construction of away messages: A speech act analysis. J. Computer-Mediated Communication, pages 1025–1045. [↗](https://doi.org/10.1111/j.1083-6101.2006.00306.x)
14. Sujith Ravi and Jihie Kim. 2007. Profiling student interactions in threaded discussions with speech act classifiers. In Proceeding of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work, pages 357–364, Amsterdam, The Netherlands, The Netherlands. IOS Press. [find](https://scholar.google.com/scholar?q=Sujith+Ravi+and+Jihie+Kim%2E+2007%2E+Profiling+student+interactions+in+threaded+discussions+with+speech+act+classifiers%2E+In+Proceeding+of+the+2007+conference+on+Artificial+Intelligence+in+Education%3A+Build)
15. Ellen Riloff, Janyce Wiebe, and Theresa Wilson. 2003. Learning subjective nouns using extraction pattern bootstrapping. In Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4, CONLL ’03, pages 25–32, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ellen+Riloff%2C+Janyce+Wiebe%2C+and+Theresa+Wilson%2E+2003%2E+Learning+subjective+nouns+using+extraction+pattern+bootstrapping%2E+In+Proceedings+of+the+seventh+conference+on+Natural+language+learning+at+HLT%2DNAA) [our card](https://md.research.elamur.ai/free/en/papers/riloff-2003-learning-subjective-nouns-extraction-pattern/)
16. John R. Searle. 1976. A classification of illocutionary acts. Language in Society, 5(1):pp. 1–23. [↗](https://doi.org/10.1017/s0047404500006837)
17. Michael Thelen and Ellen Riloff. 2002. A bootstrapping method for learning semantic lexicons using extraction pattern contexts. In Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10, EMNLP ’02, pages 214–221, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Michael+Thelen+and+Ellen+Riloff%2E+2002%2E+A+bootstrapping+method+for+learning+semantic+lexicons+using+extraction+pattern+contexts%2E+In+Proceedings+of+the+ACL%2D02+conference+on+Empirical+methods+in+natural+) [our card](https://md.research.elamur.ai/free/en/papers/thelen-2002-bootstrapping-method-learning-semantic-lexicons/)
18. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1, NAACL ’03, pages 173–180, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kristina+Toutanova%2C+Dan+Klein%2C+Christopher+D%2E+Manning%2C+and+Yoram+Singer%2E+2003%2E+Feature%2Drich+part%2Dof%2Dspeech+tagging+with+a+cyclic+dependency+network%2E+In+Proceedings+of+the+2003+Conference+of+the+North+) [our card](https://md.research.elamur.ai/free/en/papers/toutanova-2003-feature-rich-part-speech-tagging/)
19. Douglas P. Twitchell and Jay F. Nunamaker Jr. 2004. Speech act profiling: a probabilistic method for analyzing persistent conversations and their participants. In System Sciences, 2004. Proceedings of the 37th Annual Hawaii International Conference on, pages 1–10, January. [find](https://scholar.google.com/scholar?q=Douglas+P%2E+Twitchell+and+Jay+F%2E+Nunamaker+Jr%2E+2004%2E+Speech+act+profiling%3A+a+probabilistic+method+for+analyzing+persistent+conversations+and+their+participants%2E+In+System+Sciences%2C+2004%2E+Proceedings+of)
20. Douglas P. Twitchell, Mark Adkins, Jay F. Nunamaker Jr., and Judee K. Burgoon. 2004. Using speech act theory to model conversations for automated classification and retrieval. In Proceedings of the International Working Conference Language Action Perspective Communication Modelling (LAP 2004), pages 121–130. [find](https://scholar.google.com/scholar?q=Douglas+P%2E+Twitchell%2C+Mark+Adkins%2C+Jay+F%2E+Nunamaker+Jr%2E%2C+and+Judee+K%2E+Burgoon%2E+2004%2E+Using+speech+act+theory+to+model+conversations+for+automated+classification+and+retrieval%2E+In+Proceedings+of+the+In)
21. A. Wierzbicka. 1987. English speech act verbs: a semantic dictionary. Academic Press, Sydney, Orlando. [find](https://scholar.google.com/scholar?q=A%2E+Wierzbicka%2E+1987%2E+English+speech+act+verbs%3A+a+semantic+dictionary%2E+Academic+Press%2C+Sydney%2C+Orlando%2E)