--- title: "Representing Text Chunks — Sang 1999" description: "The paper asks whether the way noun phrase chunks are encoded as per-word tags changes how well a learner can find them." authors: ["Erik F. Tjong Kim Sang", "Jorn Veenstra"] year: 1999 venue: "Ninth Conference of the European Chapter of the Association for Computational Linguistics" source: "https://aclanthology.org/E99-1023/" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/sang-1999-representing-text-chunks/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sang-1999-representing-text-chunks/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [1999](https://md.research.elamur.ai/free/en/papers/1999/) / Representing Text Chunks # Representing Text Chunks **Authors:** [Erik F. Tjong Kim Sang](https://md.research.elamur.ai/free/en/authors/erik-f-tjong-kim-sang/), Jorn Veenstra · **Year:** 1999 · **Venue:** Ninth Conference of the European Chapter of the Association for Computational Linguistics · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/) **Links:** [Publisher's page](https://aclanthology.org/E99-1023/) · [PDF](https://aclanthology.org/E99-1023.pdf) · [OpenAlex](https://openalex.org/W2008830554) **Citations:** 456 citations (openalex-snapshot · 2026-10-14) · [113](#cited-by) in our library, of the 140884 papers whose bibliographies we read ## Summary The paper asks whether the way noun phrase chunks are encoded as per-word tags changes how well a learner can find them. Ramshaw and Marcus (1995) had turned baseNP chunking into a tagging problem. The authors compare seven encodings of that task: - four complete schemes: IOB1, IOB2, IOE1 and IOE2; - three combinations of partial schemes: separate opening- and closing-bracket taggers, and an inside/outside tagger paired with one bracket type. As the learner they use memory-based learning (IB1-IG from TiMBL). Their tuning steps were: - choosing word/POS context windows; - adding a cascaded second stage that uses neighbouring predicted chunk tags; - merging outputs from several first-stage runs; - adjusting the number of nearest neighbours. All tuning was done by cross-validation on WSJ section 15. The choice of encoding turned out to matter only slightly; the differences were not significant. Even so, the tuned IOB1 configuration beat the previous best result on the standard Ramshaw and Marcus benchmark. Different encodings also favoured precision or recall, which is relevant for downstream applications. ## Key points - **Benchmark data:** the Ramshaw and Marcus baseNP data, POS-tagged with the Brill tagger. - Training: 211,727 words from WSJ sections 15–18. - Test: 47,377 words from WSJ section 20. - Tuning: 5-fold cross-validation on section 15 (50,442 words). - **Main result:** IOB1 reached F(β=1) = 92.37, against the earlier best of 92.03. All but two of the seven formats exceeded that earlier figure. - **Larger setting:** the authors trained on WSJ sections 2–21 and tested on section 0, using only the first-stage IOB1 setup (three words and three POS tags on each side, k=3). This gave F = 93.81, compared with 93.3 reported by Ramshaw and Marcus. - **Precision/recall trade-off:** the opening-plus-closing bracket combination had the highest precision (93.66%) but the lowest recall (90.81%). - **Feature sensitivity:** IB1-IG weights features by information gain, yet redundant features still hurt it. Setting k=3 instead of the usual default also improved results. ## Interesting ideas - **Split the problem into partial taggers.** Separate models can predict chunk starts, chunk ends and inside/outside status, and their outputs can then be merged. Each sub-model can use its own context window, for example more left context for starts and more right context for ends. This is a cheap way to get asymmetry in any span-detection task. - **Drop the focus prediction in a cascade.** When stacking a second classifier on first-stage predictions, the authors left out the predicted tag of the current word. That feature is right so often that it would dominate the weighting and drown out the other inputs, so only neighbouring predicted tags were kept. This is a useful guard against over-reliance on one strong feature in stacked models. - **Combine first-stage runs with different context sizes.** Feeding a second stage the outputs of several first-stage runs, each with a different context size, gives it information from different window widths. This works as a lightweight ensemble. - **Treat the encoding as a choice in its own right.** Picking the tagging scheme can serve as a precision/recall knob for downstream needs, rather than being fixed by convention. This is relevant to NER or span annotation in any language. - **Feature selection matters even with learned weights.** Feature weighting does not make a model immune to redundant inputs, so an explicit search over features and parameters is still worthwhile. The authors suggest hill-climbing for this search. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/) Topics: [Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/) ## Cited by Cited by 113 papers of our library cite it (of the 140884 whose bibliographies we read); 6 of them have a page here, 107 not yet. - [Wojood: Nested Arabic Named Entity Corpus and Recognition using BERT](https://md.research.elamur.ai/free/en/papers/jarrar-2022-wojood-nested-arabic-named-entity/) - [ANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer](https://md.research.elamur.ai/free/en/papers/jibril-2022-anec-amharic-named-entity-corpus/) - [Chunking with Support Vector Machines](https://md.research.elamur.ai/free/en/papers/kudo-2001-chunking-support-vector-machines/) - [Token-based Chunking of Turn-internal Dialogue Act Sequences](https://md.research.elamur.ai/free/en/papers/lendvai-2007-token-based-chunking-turn-internal/) - [End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF](https://md.research.elamur.ai/free/en/papers/ma-2016-end-end-sequence-labeling-bi/) - [Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders](https://md.research.elamur.ai/free/en/papers/wang-2020-two-are-better-than-one/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{sang1999representing, title = {{Representing Text Chunks}}, author = {Sang, Erik F. Tjong Kim and Veenstra, Jorn}, booktitle = {Ninth Conference of the European Chapter of the Association for Computational Linguistics}, year = {1999}, doi = {10.3115/977035.977059}, url = {https://doi.org/10.3115/977035.977059} } ``` - [← previous Noun Phrase Coreference as Clustering](https://md.research.elamur.ai/free/en/papers/cardie-1999-noun-phrase-coreference-as-clustering/) - [next → Resolving Discourse Deictic Anaphora in Dialogues](https://md.research.elamur.ai/free/en/papers/prag-1999-eckert-resolving-discourse-deictic-anaphora-dialogues/) - [↑ back to papers of 1999](https://md.research.elamur.ai/free/en/papers/1999/) ## References 8 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Steven Abney. 1991. Parsing by chunks. In Principle-Based Parsing. Kluwer Academic Publishers,. [find](https://scholar.google.com/scholar?q=Steven+Abney%2E+1991%2E+Parsing+by+chunks%2E+In+Principle%2DBased+Parsing%2E+Kluwer+Academic+Publishers%2C%2E) 2. Shlomo Argamon, Ido Dagan, and Yuval Krymolowski. 1998. A memory-based approach to learning shallow natural language patterns. In Proceedings of the 17th International Conference on Computational Linguistics (COLING-ACL '98). [find](https://scholar.google.com/scholar?q=Shlomo+Argamon%2C+Ido+Dagan%2C+and+Yuval+Krymolowski%2E+1998%2E+A+memory%2Dbased+approach+to+learning+shallow+natural+language+patterns%2E+In+Proceedings+of+the+17th+International+Conference+on+Computational+Ling) 3. Claire Cardie and David Pierce. 1998. Error-driven pruning of treebank grammars for base noun phrase identification. In Proceedings of the 17th International Conference on Computational Linguistics (COLING-ACL '98). [find](https://scholar.google.com/scholar?q=Claire+Cardie+and+David+Pierce%2E+1998%2E+Error%2Ddriven+pruning+of+treebank+grammars+for+base+noun+phrase+identification%2E+In+Proceedings+of+the+17th+International+Conference+on+Computational+Linguistics+%28C) 4. Walter Daelemans, Jakub Zavrel, Ko van der Sloot, and Antal van d e n Bosch. 1998. TiMBL: Tilburg Memory Based Learner - version 1.0 - Reference Guide. ILK, Tilburg University, The Netherlands. [http://ilk.kub.nl/'ilk/papers/ilk9803.ps.gz](http://ilk.kub.nl/'ilk/papers/ilk9803.ps.gz). [↗](http://ilk.kub.nl/'ilk/papers/ilk9803.ps.gz) 5. Walter Daelemans, Antal van den Bosch, and Jakub Zavrel. 1999. Forgetting exceptions is harmful in language learning. Machine Learning, 11. [find](https://scholar.google.com/scholar?q=Walter+Daelemans%2C+Antal+van+den+Bosch%2C+and+Jakub+Zavrel%2E+1999%2E+Forgetting+exceptions+is+harmful+in+language+learning%2E+Machine+Learning%2C+11%2E) 6. Lance A. Ramshaw and Mitchell P. Marcus. 1995. Text chunking using transformation-based learning. In Proceedings of the Third A CL Workshop on Very Large Corpora. [find](https://scholar.google.com/scholar?q=Lance+A%2E+Ramshaw+and+Mitchell+P%2E+Marcus%2E+1995%2E+Text+chunking+using+transformation%2Dbased+learning%2E+In+Proceedings+of+the+Third+A+CL+Workshop+on+Very+Large+Corpora%2E) [our card](https://md.research.elamur.ai/free/en/papers/ramshaw-1995-text-chunking-transformation-based-learning/) 7. Adwait Ratnaparkhi. 1998. Maximum Entropy Models for Natural Language Ambiguity Resolution. PhD thesis Computer and Information Science, University of Pennsylvania. [find](https://scholar.google.com/scholar?q=Adwait+Ratnaparkhi%2E+1998%2E+Maximum+Entropy+Models+for+Natural+Language+Ambiguity+Resolution%2E+PhD+thesis+Computer+and+Information+Science%2C+University+of+Pennsylvania%2E) 8. Jorn Veenstra. 1998. Fast np chunking using memory-based learning techniques. In BENELEARN-98: Proceedings of the Eigth Belgian-Dutch Conference on Machine Learning. ATO-DLO, Wageningen, report 352. [find](https://scholar.google.com/scholar?q=Jorn+Veenstra%2E+1998%2E+Fast+np+chunking+using+memory%2Dbased+learning+techniques%2E+In+BENELEARN%2D98%3A+Proceedings+of+the+Eigth+Belgian%2DDutch+Conference+on+Machine+Learning%2E+ATO%2DDLO%2C+Wageningen%2C+report+352%2E)