---
title: "Classifier Optimization and Combination in the English All Words"
description: "The paper describes the CNTS-Antwerp entry to the SENSEVAL-2 English all words task. Cited by 7 papers here."
authors: ["Véronique Hoste", "Anne Kool", "Walter Daelemans"]
year: 2001
venue: "Proceedings of SENSEVAL-2 Second International Workshop on Evaluating Word Sense Disambiguation Systems"
source: "https://aclanthology.org/S01-1020/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/hoste-2001-classifier-optimization-combination-english-all/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/hoste-2001-classifier-optimization-combination-english-all/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2001](https://md.research.elamur.ai/free/en/papers/2001/) / Classifier Optimization and Combination in the English All Words Task

# Classifier Optimization and Combination in the English All Words Task

**Authors:** [Véronique Hoste](https://md.research.elamur.ai/free/en/authors/veronique-hoste/), Anne Kool and [Walter Daelemans](https://md.research.elamur.ai/free/en/authors/walter-daelemans/) · **Year:** 2001 · **Venue:** [Proceedings of SENSEVAL-2 Second International Workshop on Evaluating Word Sense Disambiguation Systems](https://md.research.elamur.ai/free/en/venues/senseval-2-international-workshop-on-evaluating-word-sense-disambiguation/) ([SENSEVAL-2 International Workshop on Evaluating Word Sense Disambiguation Systems 2001](https://md.research.elamur.ai/free/en/venues/senseval-2-international-workshop-on-evaluating-word-sense-disambiguation/2001/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/S01-1020/) · [PDF](https://aclanthology.org/S01-1020.pdf) · [OpenAlex](https://openalex.org/W142000222)

**Citations:** 20 citations (OpenAlex, 2026-10-14) · [7](https://md.research.elamur.ai/free/en/papers/hoste-2001-classifier-optimization-combination-english-all/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper describes the CNTS-Antwerp entry to the SENSEVAL-2 English all words task. The goal was to test whether supervised word sense disambiguation, which had worked well on small lexical samples, could cover every content word in running text. The system uses a "word expert" design. Each word form-POS pair with enough SemCor training examples gets its own small ensemble: two TiMBL memory-based learners (one on local context, one on keyword features) and a Ripper rule learner. Words with a single WordNet1.7 sense, or with too few examples, get the WordNet sense or the most frequent sense. Every expert's parameters were tuned separately by cross-validation, and majority and weighted voting were compared with the single classifiers. On the 2,473 test words the system reached 63.61% fine-grained and 64.54% coarse-grained accuracy. Nouns scored best and verbs worst. Tuned memory-based learning usually beat both Ripper and the voting schemes. This suggests that per-word, cross-validated model choice is practical even with limited data.

## Key points
- Training data is the SemCor corpus shipped with WordNet1.6: 409,990 word forms, of which 190,481 carry sense tags. The test set is three articles with 2,473 words to tag. Tokenization, lemmatization and tagging were done in-house with MBT, which was trained on the Wall Street Journal.
- Routing:
  - About 20% of test words have only one WordNet1.7 sense and get it directly.
  - Ambiguous words with fewer than 11 SemCor occurrences get the most frequent sense.
  - The rest, over 60% of test words, are handled by 568 word experts.
- Features and tuning:
  - The first TiMBL learner sees a ±3 word window with POS tags, plus the lemma and POS of the focus word.
  - The second TiMBL learner uses binary keyword features. These come from a three-sentence context, filtered by count and probability thresholds (set to 3 and 0.001), and from the WordNet example sentences.
  - Ripper gets the local context plus a set-valued bag of context content words.
- Optimization:
  - The first learner used backward sequential selection, four feature-weighting options and k from 1 to 19, evaluated by leave-one-out.
  - The keyword learner used 10-fold CV over k, weighting schemes and distance metrics.
  - Ripper kept its default settings.
- Results by POS, fine-grained: nouns 74.51%, verbs 47.83%, adjectives 62.58%, adverbs 73.42%. All 86 "unknown" items, which had no applicable WordNet sense, were wrong.

## Interesting ideas
- Instead of one global model, each ambiguous lemma-POS pair gets its own classifier and its own tuned settings, so hard words and easy words are not forced into the same configuration.
- A frequency threshold sends rare words to a safe default (the most frequent sense) and only trains models where data supports it; this makes coverage complete and the fallback explicit.
- Gloss example sentences from the lexicon are mined as extra keyword evidence, turning dictionary content into training signal without new annotation.
- Voting was evaluated against single classifiers per word rather than assumed to help, and often a single tuned learner won.
- Separating results by POS and by "unknown/no applicable sense" items shows where errors really come from (verbs, out-of-inventory items).

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (frames): Sense choice for VerbNet/FrameNet frame assignment could use small per-verb experts, each with its own inspectable features, instead of one opaque disambiguator.
- **I2** (world): When mapping words to WordNet/ontology nodes, Mova could record whether a sense came from a trained expert or a frequency default, keeping the explanation honest.
- **I3** (learn): WordNet/FrameNet example sentences could seed silver training data for sense or frame classifiers before any LLM teacher is consulted.
- **I4** (learn): When combining witness parsers for silver data, Mova should measure per-construction whether agreement voting actually beats the best single witness instead of always voting.
- **I5** (answer): Evaluation reports could split accuracy by category and count items outside the inventory separately, acting as a built-in negative control.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Antwerp](https://md.research.elamur.ai/free/en/universities/university-of-antwerp/) — University, Antwerp, Belgium · 17 works · 3,490 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,263 works

## Cite

Cite as: Véronique Hoste, Anne Kool and Walter Daelemans. 2001. Classifier Optimization and Combination in the English All Words Task. Proceedings of SENSEVAL-2 Second International Workshop on Evaluating Word Sense Disambiguation Systems.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{hoste2001classifier,
  title = {{Classifier Optimization and Combination in the English All Words Task}},
  author = {Véronique Hoste, Anne Kool and Walter Daelemans},
  booktitle = {Proceedings of SENSEVAL-2 Second International Workshop on Evaluating Word Sense Disambiguation Systems},
  year = {2001},
  url = {https://aclanthology.org/S01-1020/}
}
```

- [← previous Melodic Cues to Turn-Taking in English: Evidence from Perception](https://md.research.elamur.ai/free/en/papers/wichmann-2001-melodic-cues-turn-taking-english/)
- [next → Annotating Anaphoric and Bridging Relations with MMAX](https://md.research.elamur.ai/free/en/papers/mueller-2001-annotating-anaphoric-bridging-relations-mmax/)
- [↑ back to papers of 2001](https://md.research.elamur.ai/free/en/papers/2001/)

*Updated 30 October 2026*