---
title: "Broad-Coverage Sense Disambiguation and — Ciaramita 2006"
description: "The paper argues that named entity recognition uses too few categories to be broadly useful, while fine-grained word sense disambiguation over Wordnet…"
authors: ["Massimiliano Ciaramita", "Yasemin Altun"]
year: 2006
venue: "Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/W06-1670/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ciaramita-2006-broad-coverage-sense-disambiguation-information/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ciaramita-2006-broad-coverage-sense-disambiguation-information/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/) / Broad-Coverage Sense Disambiguation and Information Extraction with a Supersense Sequence Tagger

# Broad-Coverage Sense Disambiguation and Information Extraction with a Supersense Sequence Tagger

**Authors:** [Massimiliano Ciaramita](https://md.research.elamur.ai/free/en/authors/massimiliano-ciaramita/), Yasemin Altun · **Year:** 2006 · **Venue:** Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W06-1670/) · [PDF](https://aclanthology.org/W06-1670.pdf) · [OpenAlex](https://openalex.org/W2051390224)

**Citations:** 204 citations (OpenAlex, 2026-10-14) · [91](https://md.research.elamur.ai/free/en/papers/ciaramita-2006-broad-coverage-sense-disambiguation-information/cited-by/) in our library, of the 140884 papers whose bibliographies we read

## Summary
The paper argues that named entity recognition uses too few categories to be broadly useful, while fine-grained word sense disambiguation over Wordnet synsets has too many classes and too little training data to beat simple baselines. The authors propose a middle ground. They tag nouns and verbs with the 41 Wordnet lexicographer classes, called supersenses. This tagset still gives partial sense disambiguation and also contains NER-style classes such as person, location, group and time. They treat supersense tagging as sequence labeling and train a discriminative HMM in the style of Collins (2002) on the hand-annotated Semcor corpus. They evaluate on held-out Semcor data and on the Senseval-3 English all-words data. The tagger clearly beats the strong first-sense heuristic on both. According to the authors, this is the first convincing gain over that baseline in the realistic all-words setting. The work shows that coarse but meaningful semantic labels can be learned robustly with standard tagging machinery, which unifies extended NER and WSD in a single tool. The tagger was released as free software.

## Key points
- The tagset has 41 supersenses from Wordnet 2.0: 26 for nouns and 15 for verbs. For example, the 10 synsets of the noun "box" collapse into 6 supersenses.
- Compared with the first-sense baseline, the tagger gains 10.71 points on Semcor (31.19% error reduction) and 6.45 points on Senseval-3 (17.96% error reduction).
- For context, the Senseval-3 all-words task had a baseline of 62.40%. Only 4 of 26 participating systems beat it, and the best reached 65.2% F-score.
- On the NER-like classes in Semcor (person, group, location, time), which include common nouns as well as names, the average F-score is 82.46%.
- On Senseval-3, the tagger loses to the baseline on noun.person (73.06 vs 83.97 F) and on verb.cognition. The main reason is an annotation mismatch: Semcor tags named entities, but Senseval does not.

## Interesting ideas
- **Use an existing coarse layer of a lexicon as the label set.** Grouping senses by Wordnet's lexicographer files removes hard, subtle distinctions while keeping the major ones. A similar coarse grouping in another language's wordnet or lexicon could make sense tagging trainable with limited data.
- **Merge NER and WSD into one tagging task.** A single sequence tagger can label both proper and common nouns, plus verbs, with semantic classes. The result is an "extended NER" that also marks frequently neglected types such as artifacts, or verb classes that hint at relations between entities.
- **Model label dependencies along the sentence.** Most WSD systems label each word in isolation. A sequence model can instead use neighboring senses, for example a coordinated motion verb and communication verb. This is cheap to try wherever semantic labels are likely correlated within a sentence.
- **Always measure against the first-sense heuristic and report error reduction.** Comparing a random-sense baseline with a most-frequent-sense baseline shows how strong the frequency prior really is. Error-reduction figures make gains comparable across datasets.
- **Check that training and test annotation guidelines match.** The drop on noun.person came from Senseval leaving named entities unannotated. Per-class breakdowns help expose this kind of guideline mismatch, rather than mistaking it for model failure.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Word sense disambiguation](https://md.research.elamur.ai/free/en/topics/word-sense-disambiguation/) · [Information extraction](https://md.research.elamur.ai/free/en/topics/information-extraction/)

## Institutions

- [Toyota Technological Institute at Chicago](https://md.research.elamur.ai/free/en/universities/toyota-technological-institute-at-chicago/) — University, Chicago, United States · 22 works · 9 297 citations
- [National Research Council](https://md.research.elamur.ai/free/en/ngos/national-research-council/) — Nonprofit, Rome, Italy · 8 works · 7 336 citations

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{ciaramita2006broad,
  title = {{Broad-Coverage Sense Disambiguation and Information Extraction with a Supersense Sequence Tagger}},
  author = {Ciaramita, Massimiliano and Altun, Yasemin},
  booktitle = {Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing},
  year = {2006},
  doi = {10.3115/1610075.1610158},
  url = {https://doi.org/10.3115/1610075.1610158}
}
```

- [← previous Get out the vote: Determining support or opposition from Congressional floor-debate transcripts](https://md.research.elamur.ai/free/en/papers/thomas-2006-get-out-vote-determining-support/)
- [next → Labeled Pseudo-Projective Dependency Parsing with Support Vector Machines](https://md.research.elamur.ai/free/en/papers/nivre-2006-labeled-pseudo-projective-dependency-parsing/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/)

## References

29 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Y. Altun, T. Hofmann, and M. Johnson. 2003. Discriminative Learning for Label Sequences via Boosting. In Proceedings of NIPS 2003. [find](https://scholar.google.com/scholar?q=Y%2E+Altun%2C+T%2E+Hofmann%2C+and+M%2E+Johnson%2E+2003%2E+Discriminative+Learning+for+Label+Sequences+via+Boosting%2E+In+Proceedings+of+NIPS+2003%2E)
2. T. Brants. 2002. TnT - A Statistical Part-of-Speech Tagger. In Proceedings of ANLP 2000. [find](https://scholar.google.com/scholar?q=T%2E+Brants%2E+2002%2E+TnT+%2D+A+Statistical+Part%2Dof%2DSpeech+Tagger%2E+In+Proceedings+of+ANLP+2000%2E) [our card](https://md.research.elamur.ai/free/en/papers/brants-2000-tnt-statistical-part-speech-tagger/)
3. X. Carreras, L. Marquez, and L. Padro. 2002. Named Entity Extraction Using AdaBoost. In Proceedings of CONLL 2002. [find](https://scholar.google.com/scholar?q=X%2E+Carreras%2C+L%2E+Marquez%2C+and+L%2E+Padro%2E+2002%2E+Named+Entity+Extraction+Using+AdaBoost%2E+In+Proceedings+of+CONLL+2002%2E)
4. M. Ciaramita and M. Johnson. 2003. Supersense Tagging of Unknown Nouns in WordNet. In Proceedings of EMNLP 2003. [find](https://scholar.google.com/scholar?q=M%2E+Ciaramita+and+M%2E+Johnson%2E+2003%2E+Supersense+Tagging+of+Unknown+Nouns+in+WordNet%2E+In+Proceedings+of+EMNLP+2003%2E) [our card](https://md.research.elamur.ai/free/en/papers/aclbulk-2003-ciaramita-supersense-tagging-unknown-nouns-wordnet/)
5. M. Ciaramita, T. Hofmann, and M. Johnson. 2003. Hierarchical Semantic Classification: Word Sense Disambiguation with World Knowledge. In Proceedings of IJCAI 2003. [find](https://scholar.google.com/scholar?q=M%2E+Ciaramita%2C+T%2E+Hofmann%2C+and+M%2E+Johnson%2E+2003%2E+Hierarchical+Semantic+Classification%3A+Word+Sense+Disambiguation+with+World+Knowledge%2E+In+Proceedings+of+IJCAI+2003%2E)
6. M. Ciaramita, S. Sloman, M. Johnson, and E. Upfal. 2005. Hierarchical Preferences in a Broad-Coverage Lexical Taxonomy. In Proceedings of CogSci 2005. [find](https://scholar.google.com/scholar?q=M%2E+Ciaramita%2C+S%2E+Sloman%2C+M%2E+Johnson%2C+and+E%2E+Upfal%2E+2005%2E+Hierarchical+Preferences+in+a+Broad%2DCoverage+Lexical+Taxonomy%2E+In+Proceedings+of+CogSci+2005%2E)
7. M. Collins. 2002. Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms. In Proceedings of EMNLP 2002, pages 1–8. [find](https://scholar.google.com/scholar?q=M%2E+Collins%2E+2002%2E+Discriminative+Training+Methods+for+Hidden+Markov+Models%3A+Theory+and+Experiments+with+Perceptron+Algorithms%2E+In+Proceedings+of+EMNLP+2002%2C+pages+1%E2%80%938%2E) [our card](https://md.research.elamur.ai/free/en/papers/collins-2002-discriminative-training-methods-hidden-markov/)
8. J. Curran. 2005. Supersense Tagging of Unknown Nouns Using Semantic Similarity. In Proceedings of ACL 2005, pages 26–33. [find](https://scholar.google.com/scholar?q=J%2E+Curran%2E+2005%2E+Supersense+Tagging+of+Unknown+Nouns+Using+Semantic+Similarity%2E+In+Proceedings+of+ACL+2005%2C+pages+26%E2%80%9333%2E) [our card](https://md.research.elamur.ai/free/en/papers/aclbulk-2005-curran-supersense-tagging-unknown-nouns-semantic/)
9. C. de Loupy, M. El-Beze, and P.F. Marteau. 1998. Word Sense Disambiguation Using HMM Tagger. In Proceedings of LREC 1998, pages 1255–1258. [find](https://scholar.google.com/scholar?q=C%2E+de+Loupy%2C+M%2E+El%2DBeze%2C+and+P%2EF%2E+Marteau%2E+1998%2E+Word+Sense+Disambiguation+Using+HMM+Tagger%2E+In+Proceedings+of+LREC+1998%2C+pages+1255%E2%80%931258%2E)
10. B. Decadt, V. Hoste, W. Daelemans, and A. van der Bosch. 2004. GAMBL, Genetic Algorithm Optimization of Memory-Based WSD. In Proceedings of SENSEVAL-3/ACL 2004. [find](https://scholar.google.com/scholar?q=B%2E+Decadt%2C+V%2E+Hoste%2C+W%2E+Daelemans%2C+and+A%2E+van+der+Bosch%2E+2004%2E+GAMBL%2C+Genetic+Algorithm+Optimization+of+Memory%2DBased+WSD%2E+In+Proceedings+of+SENSEVAL%2D3%2FACL+2004%2E)
11. S. Dingare, M. Nissim, J. Finkel, C. Manning, and C. Grover. 2005. A System for Identifying Named Entities in Biomedical Text: How Results from Two Evaluations Reflect on Both the System and the Evaluations. Comparative and Functional Genomics, 6:77–85. [find](https://scholar.google.com/scholar?q=S%2E+Dingare%2C+M%2E+Nissim%2C+J%2E+Finkel%2C+C%2E+Manning%2C+and+C%2E+Grover%2E+2005%2E+A+System+for+Identifying+Named+Entities+in+Biomedical+Text%3A+How+Results+from+Two+Evaluations+Reflect+on+Both+the+System+and+the+Evalu)
12. C. Fellbaum, editor. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge. [find](https://scholar.google.com/scholar?q=C%2E+Fellbaum%2C+editor%2E+1998%2E+WordNet%3A+An+Electronic+Lexical+Database%2E+MIT+Press%2C+Cambridge%2E)
13. R. Florian, A. Ittycheriah, H. Jing, and T. Zhang. 2003. Named Entity Extraction through Classifier Combination. In Proceedings of CONLL 2003. [find](https://scholar.google.com/scholar?q=R%2E+Florian%2C+A%2E+Ittycheriah%2C+H%2E+Jing%2C+and+T%2E+Zhang%2E+2003%2E+Named+Entity+Extraction+through+Classifier+Combination%2E+In+Proceedings+of+CONLL+2003%2E)
14. W. Gale, K. Church, and D. Yarowsky. 1992. One Sense per Discourse. In Proceedings of the DARPA Workshop on Speech and Natural Language. [find](https://scholar.google.com/scholar?q=W%2E+Gale%2C+K%2E+Church%2C+and+D%2E+Yarowsky%2E+1992%2E+One+Sense+per+Discourse%2E+In+Proceedings+of+the+DARPA+Workshop+on+Speech+and+Natural+Language%2E)
15. J. Kazama, T. Makino, Y. Ohta, and J. Tsujii. 2002. Tuning Support Vector Machines for Biomedical Named Entity Recognition. In Proceedings of the Workshop on Natural Language Processing in the Biomedical Domain (ACL 2002). [find](https://scholar.google.com/scholar?q=J%2E+Kazama%2C+T%2E+Makino%2C+Y%2E+Ohta%2C+and+J%2E+Tsujii%2E+2002%2E+Tuning+Support+Vector+Machines+for+Biomedical+Named+Entity+Recognition%2E+In+Proceedings+of+the+Workshop+on+Natural+Language+Processing+in+the+Biomedi)
16. T. Koo and M. Collins. 2005. Hidden-Variable Models for Discriminative Reranking. In Proceedings of EMNLP 2005. [find](https://scholar.google.com/scholar?q=T%2E+Koo+and+M%2E+Collins%2E+2005%2E+Hidden%2DVariable+Models+for+Discriminative+Reranking%2E+In+Proceedings+of+EMNLP+2005%2E)
17. H. Kuc̆era and W. Francis. 1967. Computational Analysis of Present-Day American English. Brown University Press, Providence, RI. [find](https://scholar.google.com/scholar?q=H%2E+Kuc%CC%86era+and+W%2E+Francis%2E+1967%2E+Computational+Analysis+of+Present%2DDay+American+English%2E+Brown+University+Press%2C+Providence%2C+RI%2E)
18. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of ICML 2001, pages 282–289. [find](https://scholar.google.com/scholar?q=J%2E+Lafferty%2C+A%2E+McCallum%2C+and+F%2E+Pereira%2E+2001%2E+Conditional+Random+Fields%3A+Probabilistic+Models+for+Segmenting+and+Labeling+Sequence+Data%2E+In+Proceedings+of+ICML+2001%2C+pages+282%E2%80%93289%2E)
19. A. McCallum, D. Freitag, and F. Pereira. 2000. Maximum Entropy Markov Models for Information Extraction and Segmentation. In Proceedings of ICML 2000, pages 591–598. [find](https://scholar.google.com/scholar?q=A%2E+McCallum%2C+D%2E+Freitag%2C+and+F%2E+Pereira%2E+2000%2E+Maximum+Entropy+Markov+Models+for+Information+Extraction+and+Segmentation%2E+In+Proceedings+of+ICML+2000%2C+pages+591%E2%80%93598%2E)
20. D. McCarthy, R. Koeling, and J. Carroll. 2004. Finding Predominant Senses in Untagged Text. In Proceedings of ACL 2004. [find](https://scholar.google.com/scholar?q=D%2E+McCarthy%2C+R%2E+Koeling%2C+and+J%2E+Carroll%2E+2004%2E+Finding+Predominant+Senses+in+Untagged+Text%2E+In+Proceedings+of+ACL+2004%2E) [our card](https://md.research.elamur.ai/free/en/papers/onto-2004-mccarthy-finding-predominant-word-senses-untagged/)
21. R. Mihalcea and E. Faruque. 2004. SenseLearner: Minimally Supervised Word Sense Disambiguation for All Words in Open Text. In Proceedings of SENSEVAL-3/ACL 2004. [find](https://scholar.google.com/scholar?q=R%2E+Mihalcea+and+E%2E+Faruque%2E+2004%2E+SenseLearner%3A+Minimally+Supervised+Word+Sense+Disambiguation+for+All+Words+in+Open+Text%2E+In+Proceedings+of+SENSEVAL%2D3%2FACL+2004%2E)
22. G.A. Miller, C. Leacock, T. Randee, and R. Bunker. 1993. A Semantic Concordance. In Proceedings of the 3 DARPA Workshop on Human Language Technology, pages 303–308. [find](https://scholar.google.com/scholar?q=G%2EA%2E+Miller%2C+C%2E+Leacock%2C+T%2E+Randee%2C+and+R%2E+Bunker%2E+1993%2E+A+Semantic+Concordance%2E+In+Proceedings+of+the+3+DARPA+Workshop+on+Human+Language+Technology%2C+pages+303%E2%80%93308%2E) [our card](https://md.research.elamur.ai/free/en/papers/miller-1993-semantic-concordance/)
23. A. Molina, F. Pla, and E. Segarra. 2002. A Hidden Markov Model Approach to Word Sense Dsi-ambiguation. In Proceedings of IBERAMIA 2002. [find](https://scholar.google.com/scholar?q=A%2E+Molina%2C+F%2E+Pla%2C+and+E%2E+Segarra%2E+2002%2E+A+Hidden+Markov+Model+Approach+to+Word+Sense+Dsi%2Dambiguation%2E+In+Proceedings+of+IBERAMIA+2002%2E)
24. A. Molina, F. Pla, and E. Segarra. 2004. WSD System Based on Specialized Hidden Markov Model (upv-shmm-eaw). In Proceedings of SENSEVAL-3/ACL 2004. [find](https://scholar.google.com/scholar?q=A%2E+Molina%2C+F%2E+Pla%2C+and+E%2E+Segarra%2E+2004%2E+WSD+System+Based+on+Specialized+Hidden+Markov+Model+%28upv%2Dshmm%2Deaw%29%2E+In+Proceedings+of+SENSEVAL%2D3%2FACL+2004%2E)
25. Y. Ohta, Y. Tateisi, J. Kim, H. Mima, and J. Tsujii. 2002. The GENIA Corpus: An Annotated Research Abstract Corpus in the Molecular Biology Domain. In Proceedings of HLT 2002. [find](https://scholar.google.com/scholar?q=Y%2E+Ohta%2C+Y%2E+Tateisi%2C+J%2E+Kim%2C+H%2E+Mima%2C+and+J%2E+Tsujii%2E+2002%2E+The+GENIA+Corpus%3A+An+Annotated+Research+Abstract+Corpus+in+the+Molecular+Biology+Domain%2E+In+Proceedings+of+HLT+2002%2E)
26. B. Rosario and M. Hearst. 2004. Classifying Semantic Relations in Bioscience Text. In Proceedings of ACL 2004). [find](https://scholar.google.com/scholar?q=B%2E+Rosario+and+M%2E+Hearst%2E+2004%2E+Classifying+Semantic+Relations+in+Bioscience+Text%2E+In+Proceedings+of+ACL+2004%29%2E)
27. F. Segond, A. Schiller, G. Grefenstette, and J.P. Chanod. 1997. An Experiment in Semantic Tagging Using Hidden Markov Model. In Proceedings of the Workshop on Automatic Information Extraction and Building of Lexical Semantic Resources (ACL/EACL 1997), pages 78–81. [find](https://scholar.google.com/scholar?q=F%2E+Segond%2C+A%2E+Schiller%2C+G%2E+Grefenstette%2C+and+J%2EP%2E+Chanod%2E+1997%2E+An+Experiment+in+Semantic+Tagging+Using+Hidden+Markov+Model%2E+In+Proceedings+of+the+Workshop+on+Automatic+Information+Extraction+and+Buil)
28. F. Sha and F. Pereira. 2003. Shallow Parsing with Conditional Random Fields. In Proceedings of HLT-NAACL 2003, pages 213–220. [find](https://scholar.google.com/scholar?q=F%2E+Sha+and+F%2E+Pereira%2E+2003%2E+Shallow+Parsing+with+Conditional+Random+Fields%2E+In+Proceedings+of+HLT%2DNAACL+2003%2C+pages+213%E2%80%93220%2E)
29. B. Snyder and M. Palmer. 2004. The english All-Words Tasks. In Proceedings of SENSEVAL-3/ACL 2004. [find](https://scholar.google.com/scholar?q=B%2E+Snyder+and+M%2E+Palmer%2E+2004%2E+The+english+All%2DWords+Tasks%2E+In+Proceedings+of+SENSEVAL%2D3%2FACL+2004%2E)