---
title: "Comparing Linguistic Interpretation Schemes for English Corpora"
description: "The AMALGAM project (Automatic Mapping Among Lexico-Grammatical Annotation Models) addresses a practical problem in… 46 references."
authors: ["Eric Atwell", "George Demetriou", "John Hughes", "Amanda Schiffrin", "Clive Souter", "Sean Wilcock"]
year: 2000
venue: "Proceedings of the COLING-2000 Workshop on Linguistically Interpreted Corpora"
source: "https://aclanthology.org/W00-1901/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/atwell-2000-comparing-linguistic-interpretation-schemes-english/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/atwell-2000-comparing-linguistic-interpretation-schemes-english/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2000](https://md.research.elamur.ai/free/en/papers/2000/) / Comparing Linguistic Interpretation Schemes for English Corpora

# Comparing Linguistic Interpretation Schemes for English Corpora

**Authors:** [Eric Atwell](https://md.research.elamur.ai/free/en/authors/eric-atwell/), George Demetriou, [John Hughes](https://md.research.elamur.ai/free/en/authors/john-hughes/), Amanda Schiffrin, [Clive Souter](https://md.research.elamur.ai/free/en/authors/clive-souter/) and Sean Wilcock · **Year:** 2000 · **Venue:** Proceedings of the COLING-2000 Workshop on Linguistically Interpreted Corpora · **Publisher:** [International Committee on Computational Linguistics (ICCL)](https://md.research.elamur.ai/free/en/publishers/international-committee-on-computational-linguistics-iccl/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W00-1901/) · [PDF](https://aclanthology.org/W00-1901.pdf) · [OpenAlex](https://openalex.org/W1533120995)

**Citations:** 1 citations (OpenAlex, 2026-10-14)

## Summary
The AMALGAM project (Automatic Mapping Among Lexico-Grammatical Annotation Models) addresses a practical problem in English corpus linguistics. Many annotated corpora exist, but each uses its own part-of-speech tagset and parsing scheme, which makes them hard to compare or reuse together.

The team built several resources:
- documentation for eight PoS tagsets, illustrated with examples from their source corpora;
- a 180-sentence multi-tagged corpus drawn from three genres and checked by experts in each scheme;
- one shared "corpus-neutral" tokenizer;
- a family of Brill taggers, retrained once for each scheme;
- a MultiTreebank that shows a single sentence analysed under many parsing schemes;
- a free email tagging service.

On their own training corpora the taggers scored well. On the mixed-genre test sample every tagger lost accuracy, which suggests the schemes are not truly generic.

The authors draw two conclusions. Tagsets are too varied to merge into one standard, and full parsing schemes are even further apart. They also argue that scoring parsers by bracket matching penalises richer analyses. The work matters because it shows how to compare annotation schemes on shared text rather than in the abstract.

## Key points
- **Eight PoS tagsets compared:** Brown, ICE, LLC, LOB, parts, POW, SEC and UPenn.
- **Multi-tagged corpus:** 60 sentences each from COLT (teenager speech, 407 words), SEC (radio broadcasts, 2016 words) and IPSM (software manuals, 1016 words), for 3439 words in total.
- **Accuracy on source corpora:** the retrained Brill tagger reached between 90.59% (ICE) and 97.43% (Brown) on 10,000 words of each source corpus.
- **Accuracy on the proofread multi-tagged corpus:** results were lower across the board (Brown 94.3, UPenn 93.1, ICE 89.6, parts 86.7, LLC 86.6, POW 86.4). The COLT speech data was generally the hardest.
- **MultiTreebank:** the same sentence is parsed under ENGCG, L-ATR, LOB-TREEBANK, ALICE, POW, SEC, Despar, SUSANNE and Principar.
- **Scoring parsing schemes:** schemes were rated against the EAGLES syntactic annotation layers (a–h).
- **Email service usage:** running since December 1996, it handled 19,839 messages and over 628 MB of text by December 1999.

## Interesting ideas
- Instead of writing rules that translate one tagset into another, the authors retagged the raw words with a tagger trained on the target scheme. Earlier attempts had shown that one-to-many and many-to-many tag correspondences caused more errors than simply ignoring the source tags.
- A single shared tokenizer was used for all schemes to keep comparisons fair, and the known clashes it causes were listed explicitly (enclitics, possessives, multiword expressions such as "for example").
- Taggers were tested not only on held-out data from their own corpus but also on an expert-proofread sample spanning very different genres. The accuracy drop on that sample served as a measure of how generic each scheme really is.
- ICE tags write the major category first, with features in brackets after it, such as N(com,sing). Users found this format more intuitive, and it can be reduced to coarse categories just by dropping the brackets.
- The EAGLES layers act as a checklist for profiling what a scheme encodes: bracketing, labels, dependencies, functions, subclasses, deep information, rank, and spoken-language features. The checklist makes it clear that comparing schemes only on bracketing is unfair.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tree): when converting between UD dialects or legacy treebanks, where a relation maps ambiguously, reparse from tokens with a target-dialect model rather than forcing hand-written mapping rules.
- **I2** (tokens): keep one canonical tokenization for crate en and maintain a documented table of where each external corpus tokenizes differently, so mismatches are not counted as tagger errors.
- **I3** (learn): add a small hand-checked cross-genre set (speech-like text, manuals, tales) to evaluation, and treat the gap from in-domain scores as an explicit metric.
- **I4** (tokens): keep UPOS and FEATS cleanly separable in every explanation shown to users, so a coarse view and a fine view come from the same annotation.
- **I5** (learn): profile each witness parser by which layers it actually provides, and weight its votes in silver-data agreement only on the layers it really encodes.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Leeds](https://md.research.elamur.ai/free/en/universities/university-of-leeds/) — University, Leeds, United Kingdom · 42 works · 1,823 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (1): [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,379 works

## Cite

Cite as: Eric Atwell, George Demetriou, John Hughes, Amanda Schiffrin, Clive Souter and Sean Wilcock. 2000. Comparing Linguistic Interpretation Schemes for English Corpora. Proceedings of the COLING-2000 Workshop on Linguistically Interpreted Corpora.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{atwell2000comparing,
  title = {{Comparing Linguistic Interpretation Schemes for English Corpora}},
  author = {Eric Atwell, George Demetriou, John Hughes, Amanda Schiffrin, Clive Souter and Sean Wilcock},
  booktitle = {Proceedings of the COLING-2000 Workshop on Linguistically Interpreted Corpora},
  year = {2000},
  doi = {10.13140/2.1.4391.5203},
  url = {https://doi.org/10.13140/2.1.4391.5203}
}
```

- [← previous Bible translation as mediator of Hebrew impact on target languages: the Estonian bible translation by Johannes Gutslaff](https://md.research.elamur.ai/free/en/papers/ross-2000-bible-translation-mediator-hebrew-impact/)
- [next → DP: A Detector for Presuppositions in survey questions](https://md.research.elamur.ai/free/en/papers/hastings-2000-dp-detector-presuppositions-survey-questions/)
- [↑ back to papers of 2000](https://md.research.elamur.ai/free/en/papers/2000/)

## References

46 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Aarts, Jan. 1996. A tribute to W. Nelson Francis and Henry Kucera: grammatical annotation. ICAME Journal 20:104-107. [find](https://scholar.google.com/scholar?q=Aarts%2C+Jan%2E+1996%2E+A+tribute+to+W%2E+Nelson+Francis+and+Henry+Kucera%3A+grammatical+annotation%2E+ICAME+Journal+20%3A104%2D107%2E)
2. Aarts, Jan, Hans van Halteren and Nelleke Oostdijk. 1996. The TOSCA analysis system. In C. Koster and E Oltmans (eds). Proceedings of the first AGFL workshop. 181-191. Technical Report CSI-R9604, Computing Science Institute, University of Nijmegen. [find](https://scholar.google.com/scholar?q=Aarts%2C+Jan%2C+Hans+van+Halteren+and+Nelleke+Oostdijk%2E+1996%2E+The+TOSCA+analysis+system%2E+In+C%2E+Koster+and+E+Oltmans+%28eds%29%2E+Proceedings+of+the+first+AGFL+workshop%2E+181%2D191%2E+Technical+Report+CSI%2DR9604%2C+Comp)
3. Andersen, Gisle, and Anna-Brita Stenstrom. 1996. COLT: a progress report. ICAME Journal 20:133-136. [find](https://scholar.google.com/scholar?q=Andersen%2C+Gisle%2C+and+Anna%2DBrita+Stenstrom%2E+1996%2E+COLT%3A+a+progress+report%2E+ICAME+Journal+20%3A133%2D136%2E)
4. Atwell, Eric. 1982. LOB Corpus tagging project: post-edit handbook. Department of Linguistics and Modern English Language, University of Lancaster. [find](https://scholar.google.com/scholar?q=Atwell%2C+Eric%2E+1982%2E+LOB+Corpus+tagging+project%3A+post%2Dedit+handbook%2E+Department+of+Linguistics+and+Modern+English+Language%2C+University+of+Lancaster%2E)
5. Atwell, Eric. 1983. Constituent Likelihood grammar. ICAME Journal 7:34-66. [find](https://scholar.google.com/scholar?q=Atwell%2C+Eric%2E+1983%2E+Constituent+Likelihood+grammar%2E+ICAME+Journal+7%3A34%2D66%2E)
6. Atwell, Eric. 1996. Comparative evaluation of grammatical annotation models. In (Sutcliffe et al 1997), 25-46. [find](https://scholar.google.com/scholar?q=Atwell%2C+Eric%2E+1996%2E+Comparative+evaluation+of+grammatical+annotation+models%2E+In+%28Sutcliffe+et+al+1997%29%2C+25%2D46%2E)
7. Atwell, Eric, John Hughes and Clive Souter. 1994. AMALGAM: Automatic Mapping Among Lexico-Grammatical Annotation Models. In Judith Klavans and Philip Resnik (eds.), The balancing act - combining symbolic and statistical approaches to language. Proceedings of the workshop in conjunction with the 32nd annual meeting of the Association for Computational Linguistics. New Mexico State University, Las Cruces, New Mexico, USA. [find](https://scholar.google.com/scholar?q=Atwell%2C+Eric%2C+John+Hughes+and+Clive+Souter%2E+1994%2E+AMALGAM%3A+Automatic+Mapping+Among+Lexico%2DGrammatical+Annotation+Models%2E+In+Judith+Klavans+and+Philip+Resnik+%28eds%2E%29%2C+The+balancing+act+%2D+combining+symbo)
8. Atwell, Eric, George Demetriou, John Hughes, Amanda Schiffrin, Clive Souter, and Sean Wilcock. 2000. A comparative evaluation of modern English corpus grammatical annotation schemes. ICAME Journal 24, to appear. [find](https://scholar.google.com/scholar?q=Atwell%2C+Eric%2C+George+Demetriou%2C+John+Hughes%2C+Amanda+Schiffrin%2C+Clive+Souter%2C+and+Sean+Wilcock%2E+2000%2E+A+comparative+evaluation+of+modern+English+corpus+grammatical+annotation+schemes%2E+ICAME+Journal+24%2C)
9. Belmore, Nancy. 1991. Tagging Brown with the LOB tagging suite. ICAME Journal 15:63-86. [find](https://scholar.google.com/scholar?q=Belmore%2C+Nancy%2E+1991%2E+Tagging+Brown+with+the+LOB+tagging+suite%2E+ICAME+Journal+15%3A63%2D86%2E)
10. Benello, J., A. Mackie and J. Anderson. 1989. Syntactic category disambiguation with neural networks. Computer Speech and Language 3:203-217. [find](https://scholar.google.com/scholar?q=Benello%2C+J%2E%2C+A%2E+Mackie+and+J%2E+Anderson%2E+1989%2E+Syntactic+category+disambiguation+with+neural+networks%2E+Computer+Speech+and+Language+3%3A203%2D217%2E)
11. Black, William, and Philip Neal. 1996. Using ALICE to analyse a software manual corpus. In (Sutcliffe et al 1996), 47-56. [find](https://scholar.google.com/scholar?q=Black%2C+William%2C+and+Philip+Neal%2E+1996%2E+Using+ALICE+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+47%2D56%2E)
12. Booth, Barbara. 1985. Revising CLAWS. ICAME Journal 9:29-35. [find](https://scholar.google.com/scholar?q=Booth%2C+Barbara%2E+1985%2E+Revising+CLAWS%2E+ICAME+Journal+9%3A29%2D35%2E)
13. Brill, Eric. 1993. A Corpus-based approach to language learning. PhD thesis, Department of Computer and Information Science, University of Pennsylvania. [find](https://scholar.google.com/scholar?q=Brill%2C+Eric%2E+1993%2E+A+Corpus%2Dbased+approach+to+language+learning%2E+PhD+thesis%2C+Department+of+Computer+and+Information+Science%2C+University+of+Pennsylvania%2E)
14. Briscoe, Edward and John Carroll. 1993. Generalised probabilistic LR parsing of natural language (corpora) with unification-based grammars. Computational Linguistics 19:25-60. [find](https://scholar.google.com/scholar?q=Briscoe%2C+Edward+and+John+Carroll%2E+1993%2E+Generalised+probabilistic+LR+parsing+of+natural+language+%28corpora%29+with+unification%2Dbased+grammars%2E+Computational+Linguistics+19%3A25%2D60%2E)
15. EAGLES (1996), WWW site for European Advisory Group on Language Engineering Standards, [http://www.ilc.pi.cnr.it/EAGLES96/home.html](http://www.ilc.pi.cnr.it/EAGLES96/home.html) Specifically: Leech, Geoffrey, Ruthanna Barnett and Peter Kahrel, EAGLES Final Report and guidelines for the syntactic annotation of corpora, EAGLES Report EAG-TCWG-SASG/1.5. [↗](http://www.ilc.pi.cnr.it/EAGLES96/home.html)
16. Eeg-Olofsson, Mats. 1991. Word-class tagging: Some computational tools. PhD thesis. Department of Linguistics and Phonetics, University of Lund, Sweden. [find](https://scholar.google.com/scholar?q=Eeg%2DOlofsson%2C+Mats%2E+1991%2E+Word%2Dclass+tagging%3A+Some+computational+tools%2E+PhD+thesis%2E+Department+of+Linguistics+and+Phonetics%2C+University+of+Lund%2C+Sweden%2E)
17. Elliott, John, and Eric Atwell. 2000. Is there anybody out there?: the detection of intelligent and generic language-like features. In Journal of the British Interplanetary Society, 53:1/2, 13-22. [find](https://scholar.google.com/scholar?q=Elliott%2C+John%2C+and+Eric+Atwell%2E+2000%2E+Is+there+anybody+out+there%3F%3A+the+detection+of+intelligent+and+generic+language%2Dlike+features%2E+In+Journal+of+the+British+Interplanetary+Society%2C+53%3A1%2F2%2C+13%2D22%2E)
18. Elliott, John, Eric Atwell, and Bill Whyte. 2000. Language identification in unknown signals. Proc COLING’2000. [find](https://scholar.google.com/scholar?q=Elliott%2C+John%2C+Eric+Atwell%2C+and+Bill+Whyte%2E+2000%2E+Language+identification+in+unknown+signals%2E+Proc+COLING%E2%80%992000%2E)
19. Garside, Roger. 1996. The robust tagging of unrestricted text: the BNC experience. In Jenny Thomas and Mick Short (eds) Using corpora for language research: studies in the honour of Geoffrey Leech, 167-180. London: Longman. [find](https://scholar.google.com/scholar?q=Garside%2C+Roger%2E+1996%2E+The+robust+tagging+of+unrestricted+text%3A+the+BNC+experience%2E+In+Jenny+Thomas+and+Mick+Short+%28eds%29+Using+corpora+for+language+research%3A+studies+in+the+honour+of+Geoffrey+Leech%2C+16)
20. Greene, Barbara and Gerald Rubin. 1981. Automatic grammatical tagging of English. Providence, R.I.: Department of Linguistics, Brown University. [find](https://scholar.google.com/scholar?q=Greene%2C+Barbara+and+Gerald+Rubin%2E+1981%2E+Automatic+grammatical+tagging+of+English%2E+Providence%2C+R%2EI%2E%3A+Department+of+Linguistics%2C+Brown+University%2E)
21. Greenbaum, Sidney. 1993. The tagset for the International Corpus of English. In Clive Souter and Eric Atwell (eds) Corpus-based Computational Linguistics. 11-24. Amsterdam: Rodopi. [find](https://scholar.google.com/scholar?q=Greenbaum%2C+Sidney%2E+1993%2E+The+tagset+for+the+International+Corpus+of+English%2E+In+Clive+Souter+and+Eric+Atwell+%28eds%29+Corpus%2Dbased+Computational+Linguistics%2E+11%2D24%2E+Amsterdam%3A+Rodopi%2E)
22. Grefenstette, Gregory. 1996. Using the SEXTANT low-level parser to analyse a software manual corpus. In (Sutcliffe et al 1996), 139-158. [find](https://scholar.google.com/scholar?q=Grefenstette%2C+Gregory%2E+1996%2E+Using+the+SEXTANT+low%2Dlevel+parser+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+139%2D158%2E)
23. Hughes, John and Eric Atwell. 1994. The automated evaluation of inferred word classifications. In Anthony Cohn (ed.), Proceedings of the European Conference on Artificial Intelligence (ECAI). 535-539. Chichester, John Wiley. [find](https://scholar.google.com/scholar?q=Hughes%2C+John+and+Eric+Atwell%2E+1994%2E+The+automated+evaluation+of+inferred+word+classifications%2E+In+Anthony+Cohn+%28ed%2E%29%2C+Proceedings+of+the+European+Conference+on+Artificial+Intelligence+%28ECAI%29%2E+535%2D539%2E)
24. Hughes, John, Clive Souter and Eric Atwell. 1995. Automatic extraction of tagset mappings from parallel-annotated corpora. In From texts to tags: issues in multilingual language analysis. Proceedings of SIGDAT workshop in conjunction with the 7th Conference of the European Chapter of the Association for Computational Linguistics. University College Dublin, Ireland. [find](https://scholar.google.com/scholar?q=Hughes%2C+John%2C+Clive+Souter+and+Eric+Atwell%2E+1995%2E+Automatic+extraction+of+tagset+mappings+from+parallel%2Dannotated+corpora%2E+In+From+texts+to+tags%3A+issues+in+multilingual+language+analysis%2E+Proceedings+)
25. Johansson, Stig, Eric Atwell, Roger Garside and Geoffrey Leech. 1986. The Tagged LOB corpus: users’ manual. Bergen University, Norway: ICAME, The Norwegian Computing Centre for the Humanities. Available from [http://www.hit.uib.no/icame/lobman/lob-cont.html](http://www.hit.uib.no/icame/lobman/lob-cont.html) [↗](http://www.hit.uib.no/icame/lobman/lob-cont.html)
26. Karlsson, Fred, Atro Voutilainen, Juha Heikkila, and Arto Anttila. 1995. Constraint Grammar: a language-independent system for parsing unrestricted text. Berlin: Mouton de Gruyter. [find](https://scholar.google.com/scholar?q=Karlsson%2C+Fred%2C+Atro+Voutilainen%2C+Juha+Heikkila%2C+and+Arto+Anttila%2E+1995%2E+Constraint+Grammar%3A+a+language%2Dindependent+system+for+parsing+unrestricted+text%2E+Berlin%3A+Mouton+de+Gruyter%2E)
27. Kyto, Merja and Atro Voutilainen. 1995. Applying the Constraint Grammar parser of English to the Helsinki corpus. ICAME Journal 19:23-48. [find](https://scholar.google.com/scholar?q=Kyto%2C+Merja+and+Atro+Voutilainen%2E+1995%2E+Applying+the+Constraint+Grammar+parser+of+English+to+the+Helsinki+corpus%2E+ICAME+Journal+19%3A23%2D48%2E)
28. Leech, Geoffrey, Roger Garside and Eric Atwell. 1983. The automatic grammatical tagging of the LOB corpus. ICAME Journal 7:13-33. [find](https://scholar.google.com/scholar?q=Leech%2C+Geoffrey%2C+Roger+Garside+and+Eric+Atwell%2E+1983%2E+The+automatic+grammatical+tagging+of+the+LOB+corpus%2E+ICAME+Journal+7%3A13%2D33%2E)
29. Lin, Dekang. 1994. PRNCIPAR – an efficient, broad-coverage, principle-based parser. Proceedings of COLING-94, Kyoto. 482-488. [find](https://scholar.google.com/scholar?q=Lin%2C+Dekang%2E+1994%2E+PRNCIPAR+%E2%80%93+an+efficient%2C+broad%2Dcoverage%2C+principle%2Dbased+parser%2E+Proceedings+of+COLING%2D94%2C+Kyoto%2E+482%2D488%2E)
30. Lin, Dekang. 1996. Using PRINCIPAR to analyse a software manual corpus. In (Sutcliffe et al 1996), 103-118. man 1986. parts. The on-line Unix manual. [find](https://scholar.google.com/scholar?q=Lin%2C+Dekang%2E+1996%2E+Using+PRINCIPAR+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+103%2D118%2E+man+1986%2E+parts%2E+The+on%2Dline+Unix+manual%2E)
31. Marcus, Mitch, M Marcinkiewicz, and Barbara Santorini. 1993. [Building a large annotated corpus of English: the Penn Treebank](https://md.research.elamur.ai/free/en/papers/marcus-1993-building-large-annotated-corpus-english/). Computational Linguistics 19:313-330.
32. O'Donoghue, Tim. 1991. Taking a parsed corpus to the cleaners: the EPOW corpus. ICAME Journal 15:55-62 [find](https://scholar.google.com/scholar?q=O%27Donoghue%2C+Tim%2E+1991%2E+Taking+a+parsed+corpus+to+the+cleaners%3A+the+EPOW+corpus%2E+ICAME+Journal+15%3A55%2D62)
33. Oostdijk, Nelleke. 1996. Using the TOSCA analysis system to analyse a software manual corpus. In (Sutcliffe et al 1996), 179-206. [find](https://scholar.google.com/scholar?q=Oostdijk%2C+Nelleke%2E+1996%2E+Using+the+TOSCA+analysis+system+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+179%2D206%2E)
34. Osborne, Miles. 1996. Using the Robust Alvey Natural Language Toolkit to analyse a software manual corpus. In (Sutcliffe et al 1996), 119-138. [find](https://scholar.google.com/scholar?q=Osborne%2C+Miles%2E+1996%2E+Using+the+Robust+Alvey+Natural+Language+Toolkit+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+119%2D138%2E)
35. Owen, M. 1987. Evaluating automatic grammatical tagging of text. ICAME Journal 11:18-26. [find](https://scholar.google.com/scholar?q=Owen%2C+M%2E+1987%2E+Evaluating+automatic+grammatical+tagging+of+text%2E+ICAME+Journal+11%3A18%2D26%2E)
36. Qiao, Hong Liang and Renje Huang. 1998. Design and implementation of AGTS probabilistic tagger. ICAME Journal 22: 23-48. [find](https://scholar.google.com/scholar?q=Qiao%2C+Hong+Liang+and+Renje+Huang%2E+1998%2E+Design+and+implementation+of+AGTS+probabilistic+tagger%2E+ICAME+Journal+22%3A+23%2D48%2E)
37. Santorini, Barbara. 1990. Part-of-speech tagging guidelines for the Penn Treebank project. Technical report MS-CIS-90-47. University of Pennsylvania: Department of Computer and Information Science. [find](https://scholar.google.com/scholar?q=Santorini%2C+Barbara%2E+1990%2E+Part%2Dof%2Dspeech+tagging+guidelines+for+the+Penn+Treebank+project%2E+Technical+report+MS%2DCIS%2D90%2D47%2E+University+of+Pennsylvania%3A+Department+of+Computer+and+Information+Science%2E)
38. Sleator, D. and Temperley, D. 1991. [Parsing English with a Link grammar](https://md.research.elamur.ai/free/en/papers/sleator-1993-parsing-english-link-grammar/). Technical Report CMU-CS-91-196. School of Computer Science, Carnegie Mellon University.
39. Souter, Clive. 1989a. The COMMUNAL project: extracting a grammar from the Polytechnic of Wales corpus. ICAME Journal 13:20-27. [find](https://scholar.google.com/scholar?q=Souter%2C+Clive%2E+1989a%2E+The+COMMUNAL+project%3A+extracting+a+grammar+from+the+Polytechnic+of+Wales+corpus%2E+ICAME+Journal+13%3A20%2D27%2E)
40. Souter, Clive. 1989b A short handbook to the Polytechnic of Wales Corpus. Bergen University, Norway: ICAME, The Norwegian Computing Centre for the Humanities. Available from [http://kht.hit.uib.no/icame/manuals/pow.html](http://kht.hit.uib.no/icame/manuals/pow.html) [↗](http://kht.hit.uib.no/icame/manuals/pow.html)
41. Sutcliffe, Richard, Heinz-Detlev Koch and Annette McElligott (eds.). 1996. Industrial parsing of software manuals. Amsterdam: Rodopi. [find](https://scholar.google.com/scholar?q=Sutcliffe%2C+Richard%2C+Heinz%2DDetlev+Koch+and+Annette+McElligott+%28eds%2E%29%2E+1996%2E+Industrial+parsing+of+software+manuals%2E+Amsterdam%3A+Rodopi%2E)
42. Sutcliffe, Richard, and Annette McElligott. 1996. Using the Link parser of Sleator and Temperley to analyse a software manual corpus. In (Sutcliffe et al 1996), 89-102. [find](https://scholar.google.com/scholar?q=Sutcliffe%2C+Richard%2C+and+Annette+McElligott%2E+1996%2E+Using+the+Link+parser+of+Sleator+and+Temperley+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+89%2D102%2E)
43. Taylor, Lolita and Gerry Knowles. 1988. Manual of information to accompany the SEC corpus: The machine readable corpus of spoken English. University of Lancaster: Unit for Computer Research on the English Language. Available from [http://kht.hit.uib.no/icame/manuals/sec/INDEX.HTM](http://kht.hit.uib.no/icame/manuals/sec/INDEX.HTM) [↗](http://kht.hit.uib.no/icame/manuals/sec/INDEX.HTM)
44. Teahan, Bill. 1998. Modelling English text. PhD Thesis, Department of Computer Science, University of Waikato, New Zealand. [find](https://scholar.google.com/scholar?q=Teahan%2C+Bill%2E+1998%2E+Modelling+English+text%2E+PhD+Thesis%2C+Department+of+Computer+Science%2C+University+of+Waikato%2C+New+Zealand%2E)
45. Ting, Christopher, and Peh Li Shiuan. 1996. Using a dependency structure parser without any grammar formalism to analyse a software manual corpus. In (Sutcliffe et al 1996), 159-178. [find](https://scholar.google.com/scholar?q=Ting%2C+Christopher%2C+and+Peh+Li+Shiuan%2E+1996%2E+Using+a+dependency+structure+parser+without+any+grammar+formalism+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+159%2D178%2E)
46. Voutilainen, Atro, and Timo Jarvinen. 1996. Using the English Constraint Grammar Parser to analyse a software manual corpus. In (Sutcliffe et al 1996), 57-88. [find](https://scholar.google.com/scholar?q=Voutilainen%2C+Atro%2C+and+Timo+Jarvinen%2E+1996%2E+Using+the+English+Constraint+Grammar+Parser+to+analyse+a+software+manual+corpus%2E+In+%28Sutcliffe+et+al+1996%29%2C+57%2D88%2E)

*Updated 2 November 2026*