---
title: "Kolmogorov complexity of morphs and constructions in English — Ehret 2014"
description: "The author builds on Juola's method, which estimates text complexity through compression, and proposes a variant of… 43 references, cited by 1 paper here."
authors: ["Katharina Ehret"]
year: 2014
venue: "Linguistic Issues in Language Technology"
source: "https://aclanthology.org/2014.lilt-11.3/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ehret-2014-kolmogorov-complexity-morphs-constructions-english/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ehret-2014-kolmogorov-complexity-morphs-constructions-english/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2014](https://md.research.elamur.ai/free/en/papers/2014/page/2/) / Kolmogorov complexity of morphs and constructions in English

# Kolmogorov complexity of morphs and constructions in English

**Authors:** Katharina Ehret · **Year:** 2014 · **Venue:** Linguistic Issues in Language Technology · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/2014.lilt-11.3/) · [PDF](https://aclanthology.org/2014.lilt-11.3.pdf) · [OpenAlex](https://openalex.org/W2280068240)

**Citations:** 9 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 140,884 papers whose bibliographies we read

## Summary
The paper contributes to the debate on linguistic complexity: whether all languages are equally complex and how that complexity should be measured. The author builds on Juola's method, which estimates text complexity through compression, and proposes a variant of it called "targeted manipulation." Kolmogorov complexity is approximated with the gzip archiver. To measure morphological or syntactic complexity, the text is deliberately distorted by random deletions before compression. The compression of the original texts is then compared with that of texts in which particular grammatical devices have been altered. In this way the contribution of ten features of English is estimated: morphs (–ing, –ed, the genitive 's, plural –s, 3rd person –s) and constructions (progressive, perfect, passive, will, going to). The corpus covers three genres. It turned out that a larger number of marker types increases morphological complexity but decreases syntactic complexity, because markers make textual patterns more predictable. The results agree with traditional qualitative complexity metrics. Thus, information-theoretic methods yield linguistically meaningful answers even for individual grammatical phenomena.

## Key points
- The corpus contains 42,026 words in three roughly equal parts of ~14 thousand words each: *Alice's Adventures in Wonderland* (fiction), the Gospel of Mark, English Standard Version translation (religious text), and the author's own newspaper Euro-Congo corpus (articles collected from December 2011 to February 2012).
- Complexity is approximated using gzip (a compressor of the Lempel-Ziv family). For morphological distortion, 10% of the characters of the text are randomly deleted; for syntactic distortion, 10% of the elements are likewise deleted. Differences between text versions were tested with the Tukey HSD test.
- The progressive, perfect, and passive constructions increase both morphological and syntactic complexity. The future markers will and going to are an exception, so analytic invariant markers proved simpler than inflectional morphosyntactic patterns.
- The complexity of features is largely independent of their frequency in the corpus. However, going to occurs only 13 times, and this case shows that the method performs poorly for rare phenomena.
- Among the limitations, the author names two. The method does not take into account the relation between form and meaning. In addition, it depends on written text and orthographic conventions.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/)

## Institutions

- [University of Freiburg](https://md.research.elamur.ai/free/en/universities/university-of-freiburg/) — University, Freiburg im Breisgau, Germany · 3 works · 851 citations

## Cite

Cite as: Katharina Ehret. 2014. Kolmogorov complexity of morphs and constructions in English. Linguistic Issues in Language Technology.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{ehret2014kolmogorov,
  title = {{Kolmogorov complexity of morphs and constructions in English}},
  author = {Katharina Ehret},
  booktitle = {Linguistic Issues in Language Technology},
  year = {2014},
  doi = {10.33011/lilt.v11i.1363},
  url = {https://doi.org/10.33011/lilt.v11i.1363}
}
```

- [← previous Developing an interlingual translation lexicon using WordNets and Grammatical Framework](https://md.research.elamur.ai/free/en/papers/virk-2014-developing-interlingual-translation-lexicon-wordnets/)
- [next → Negation scope and spelling variation for text-mining of Danish electronic patient records](https://md.research.elamur.ai/free/en/papers/thomas-2014-negation-scope-spelling-variation-text/)
- [↑ back to papers of 2014](https://md.research.elamur.ai/free/en/papers/2014/page/2/)

## References

43 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Arends, Jacques. 2001. Simple grammars, complex languages. Linguistic Typology 5(2/3):180–182. [find](https://scholar.google.com/scholar?q=Arends%2C+Jacques%2E+2001%2E+Simple+grammars%2C+complex+languages%2E+Linguistic+Typology+5%282%2F3%29%3A180%E2%80%93182%2E)
2. Baayen, R. Harald. 2008. Analyzing Linguistic Data: A Practical Introduction to Statistics Using R. Cambridge: Cambridge University Press. [find](https://scholar.google.com/scholar?q=Baayen%2C+R%2E+Harald%2E+2008%2E+Analyzing+Linguistic+Data%3A+A+Practical+Introduction+to+Statistics+Using+R%2E+Cambridge%3A+Cambridge+University+Press%2E)
3. Bailey, Nathalie, Carolyn Madden, and Stephen D. Krashen. 1974. Is there a ”natural sequence” in adult second language learning? Language Learning 24(2):235–243. [find](https://scholar.google.com/scholar?q=Bailey%2C+Nathalie%2C+Carolyn+Madden%2C+and+Stephen+D%2E+Krashen%2E+1974%2E+Is+there+a+%E2%80%9Dnatural+sequence%E2%80%9D+in+adult+second+language+learning%3F+Language+Learning+24%282%29%3A235%E2%80%93243%2E)
4. Bakker, Dik. 1998. Flexibility and consistency in word order patterns in the languages of europe. In A. Siewierska, ed., Constituent order in the languages of Europe, pages 384–419. Berlin: Mouton de Gruyter. [find](https://scholar.google.com/scholar?q=Bakker%2C+Dik%2E+1998%2E+Flexibility+and+consistency+in+word+order+patterns+in+the+languages+of+europe%2E+In+A%2E+Siewierska%2C+ed%2E%2C+Constituent+order+in+the+languages+of+Europe%2C+pages+384%E2%80%93419%2E+Berlin%3A+Mouton+de+)
5. Bane, Max. 2008. Quantifying and measuring morphological complexity. In Charles B. Chang and Hannah J. Haynie, eds., Proceedings of the 26th West Coast Conference on Formal Linguistics, pages 69–76. Somerville, MA: Cascadilla Proceedings Project. [find](https://scholar.google.com/scholar?q=Bane%2C+Max%2E+2008%2E+Quantifying+and+measuring+morphological+complexity%2E+In+Charles+B%2E+Chang+and+Hannah+J%2E+Haynie%2C+eds%2E%2C+Proceedings+of+the+26th+West+Coast+Conference+on+Formal+Linguistics%2C+pages+69%E2%80%9376%2E+S)
6. Bickerton, Derek. 1995. Language and Human Behaviour . Seattle: University of Washington Press. [find](https://scholar.google.com/scholar?q=Bickerton%2C+Derek%2E+1995%2E+Language+and+Human+Behaviour+%2E+Seattle%3A+University+of+Washington+Press%2E)
7. Brown, Roger. 1973. A First Language. The Early Stages. Cambridge, Mass.: Harvard University Press. [find](https://scholar.google.com/scholar?q=Brown%2C+Roger%2E+1973%2E+A+First+Language%2E+The+Early+Stages%2E+Cambridge%2C+Mass%2E%3A+Harvard+University+Press%2E)
8. Crystal, David. 1987. The Cambridge Encyclopedia of Language. Cambridge: Cambridge University Press. [find](https://scholar.google.com/scholar?q=Crystal%2C+David%2E+1987%2E+The+Cambridge+Encyclopedia+of+Language%2E+Cambridge%3A+Cambridge+University+Press%2E)
9. Dahl, Östen. 2004. The growth and maintenance of linguistic complexity. Amsterdam, Philadelphia: John Benjamins. [find](https://scholar.google.com/scholar?q=Dahl%2C+O%CC%88sten%2E+2004%2E+The+growth+and+maintenance+of+linguistic+complexity%2E+Amsterdam%2C+Philadelphia%3A+John+Benjamins%2E)
10. de Villiers, Jill and Peter de Villiers. 1973. A cross-sectional study of the acquisition of grammatical morphemes in child speech. Journal of Psycholinguistic Research 2(3):267–278. Ehret, Katharina. in preparation. Exploring information-theoretic methods to assess linguistic complexity in English. Ph.D. thesis, Freiburg. Ehret, Katharina and Benedikt Szmrecsanyi. to appear. An information-theoretic approach to assess linguistic complexity. In R. Baechler and G. Seiler, eds., Complexity and Isolation. Berlin: de Gruyter. [find](https://scholar.google.com/scholar?q=de+Villiers%2C+Jill+and+Peter+de+Villiers%2E+1973%2E+A+cross%2Dsectional+study+of+the+acquisition+of+grammatical+morphemes+in+child+speech%2E+Journal+of+Psycholinguistic+Research+2%283%29%3A267%E2%80%93278%2E+Ehret%2C+Katharina%2E)
11. Goldschneider, Jennifer and Robert M. DeKeyser. 2005. Explaining the ”natural order of l2 morpheme acquisition” in english: A meta-analysis of multiple determinants. Language Learning 55(S1):27–77. [find](https://scholar.google.com/scholar?q=Goldschneider%2C+Jennifer+and+Robert+M%2E+DeKeyser%2E+2005%2E+Explaining+the+%E2%80%9Dnatural+order+of+l2+morpheme+acquisition%E2%80%9D+in+english%3A+A+meta%2Danalysis+of+multiple+determinants%2E+Language+Learning+55%28S1%29%3A27%E2%80%9377%2E)
12. Hockett, Charles Francis. 1958. A course in modern linguistics. New York: Macmillan. 58005007 illus. 22 cm. [find](https://scholar.google.com/scholar?q=Hockett%2C+Charles+Francis%2E+1958%2E+A+course+in+modern+linguistics%2E+New+York%3A+Macmillan%2E+58005007+illus%2E+22+cm%2E)
13. Juola, Patrick. 1998. Measuring linguistic complexity: the morphological tier. Journal of Quantitative Linguistics 5(3):206–213. [find](https://scholar.google.com/scholar?q=Juola%2C+Patrick%2E+1998%2E+Measuring+linguistic+complexity%3A+the+morphological+tier%2E+Journal+of+Quantitative+Linguistics+5%283%29%3A206%E2%80%93213%2E)
14. Juola, Patrick. 2008. Assessing linguistic complexity. In M. Miestamo, K. Sinnemäki, and F. Karlsson, eds., Language Complexity: Typology, Contact, Change, pages 89–107. Amsterdam, Philadelphia: Benjamins. [find](https://scholar.google.com/scholar?q=Juola%2C+Patrick%2E+2008%2E+Assessing+linguistic+complexity%2E+In+M%2E+Miestamo%2C+K%2E+Sinnema%CC%88ki%2C+and+F%2E+Karlsson%2C+eds%2E%2C+Language+Complexity%3A+Typology%2C+Contact%2C+Change%2C+pages+89%E2%80%93107%2E+Amsterdam%2C+Philadelphia%3A+Benj)
15. Kolmogorov, Andrej N. 1965. Three approaches to the quantitative definition of information. Problemy Peredachi Informatsii 1(1):3–11. [find](https://scholar.google.com/scholar?q=Kolmogorov%2C+Andrej+N%2E+1965%2E+Three+approaches+to+the+quantitative+definition+of+information%2E+Problemy+Peredachi+Informatsii+1%281%29%3A3%E2%80%9311%2E)
16. Kortmann, Bernd and Benedikt Szmrecsanyi, eds. 2012. Linguistic Complexity: Second Language Acquisition, Indigenization, Contact. Lingua & Litterae. Berlin/Boston: Walter de Gruyter. [find](https://scholar.google.com/scholar?q=Kortmann%2C+Bernd+and+Benedikt+Szmrecsanyi%2C+eds%2E+2012%2E+Linguistic+Complexity%3A+Second+Language+Acquisition%2C+Indigenization%2C+Contact%2E+Lingua+%26+Litterae%2E+Berlin%2FBoston%3A+Walter+de+Gruyter%2E)
17. Krashen, Stephen D., Victoria Sferlazza, Lorna Feldman, and Ann Fathman. 1976. Adult performance on the SLOPE test: More evidence for a natural sequence in adult second language acquisition. Language Learning 26(1):145–151. [find](https://scholar.google.com/scholar?q=Krashen%2C+Stephen+D%2E%2C+Victoria+Sferlazza%2C+Lorna+Feldman%2C+and+Ann+Fathman%2E+1976%2E+Adult+performance+on+the+SLOPE+test%3A+More+evidence+for+a+natural+sequence+in+adult+second+language+acquisition%2E+Language+)
18. Kusters, Wouter. 2003. Linguistic Complexity: The Influence of Social Change on Verbal Inflection. Utrecht: LOT. [find](https://scholar.google.com/scholar?q=Kusters%2C+Wouter%2E+2003%2E+Linguistic+Complexity%3A+The+Influence+of+Social+Change+on+Verbal+Inflection%2E+Utrecht%3A+LOT%2E)
19. Kusters, Wouter. 2008. Complexity in linguistic theory, language learning and language change. In M. Miestamo, K. Sinnemäki, and F. Karlsson, eds., Language Complexity: Typology, Contact, Change, pages 3–21. Amsterdam, Philadelphia: Benjamins. [find](https://scholar.google.com/scholar?q=Kusters%2C+Wouter%2E+2008%2E+Complexity+in+linguistic+theory%2C+language+learning+and+language+change%2E+In+M%2E+Miestamo%2C+K%2E+Sinnema%CC%88ki%2C+and+F%2E+Karlsson%2C+eds%2E%2C+Language+Complexity%3A+Typology%2C+Contact%2C+Change%2C+pag)
20. Li, Ming, Xin Chen, Xin Li, Bin Ma, and Paul M. B Vitányi. 2004. The similarity metric. IEEE Transactions on Information Theory 50(12):3250– 3264. [find](https://scholar.google.com/scholar?q=Li%2C+Ming%2C+Xin+Chen%2C+Xin+Li%2C+Bin+Ma%2C+and+Paul+M%2E+B+Vita%CC%81nyi%2E+2004%2E+The+similarity+metric%2E+IEEE+Transactions+on+Information+Theory+50%2812%29%3A3250%E2%80%93+3264%2E)
21. Li, Ming and Paul M. B Vitanyi. 1997. An introduction to Kolmogorov complexity and its applications. New York: Springer. 96042357 Ming Li, Paul Vitányi. ill. ; 25 cm. Graduate texts in computer science Includes bibliographical references (p. [591]-617) and index. [find](https://scholar.google.com/scholar?q=Li%2C+Ming+and+Paul+M%2E+B+Vitanyi%2E+1997%2E+An+introduction+to+Kolmogorov+complexity+and+its+applications%2E+New+York%3A+Springer%2E+96042357+Ming+Li%2C+Paul+Vita%CC%81nyi%2E+ill%2E+%3B+25+cm%2E+Graduate+texts+in+computer+scien)
22. McWhorter, John. 2001a. What people ask david gil and why: Rejoinder to the replies. Linguistic Typology 5(2/3). [find](https://scholar.google.com/scholar?q=McWhorter%2C+John%2E+2001a%2E+What+people+ask+david+gil+and+why%3A+Rejoinder+to+the+replies%2E+Linguistic+Typology+5%282%2F3%29%2E)
23. McWhorter, John. 2001b. The world’s simplest grammars are creole grammars. Linguistic Typology 6:125–166. [find](https://scholar.google.com/scholar?q=McWhorter%2C+John%2E+2001b%2E+The+world%E2%80%99s+simplest+grammars+are+creole+grammars%2E+Linguistic+Typology+6%3A125%E2%80%93166%2E)
24. McWhorter, John. 2012. Complexity hotspot. In B. Kortmann and B. Szmrecsanyi, eds., Linguistic Complexity: Second Language Acquisition, Indigenization, Contact, Linguae & Litterae, pages 243–246. Berlin/Boston: Walter de Gruyter. [find](https://scholar.google.com/scholar?q=McWhorter%2C+John%2E+2012%2E+Complexity+hotspot%2E+In+B%2E+Kortmann+and+B%2E+Szmrecsanyi%2C+eds%2E%2C+Linguistic+Complexity%3A+Second+Language+Acquisition%2C+Indigenization%2C+Contact%2C+Linguae+%26+Litterae%2C+pages+243%E2%80%93246%2E+Berl)
25. Miestamo, Matti. 2006. On the feasibility of complexity metrics. In K. Kerge and M.-M. Sepper, eds., Finest Linguistics. Proceedings of the Annual Finnish and Estonian Conference of Linguistics [Publications of the Department of Estonian of Tallinn University 8] , pages 11–26. Tallinn: Tallinna Ülikooli Kirjastus. [find](https://scholar.google.com/scholar?q=Miestamo%2C+Matti%2E+2006%2E+On+the+feasibility+of+complexity+metrics%2E+In+K%2E+Kerge+and+M%2E%2DM%2E+Sepper%2C+eds%2E%2C+Finest+Linguistics%2E+Proceedings+of+the+Annual+Finnish+and+Estonian+Conference+of+Linguistics+%5BPubli)
26. Miestamo, Matti. 2009. Implicational hierarchies and grammatical complexity. In G. Sampson, D. Gil, and P. Trudgill, eds., Language Complexity as an Evolving Variable, pages 80–97. Oxford: Oxford University Press. [find](https://scholar.google.com/scholar?q=Miestamo%2C+Matti%2E+2009%2E+Implicational+hierarchies+and+grammatical+complexity%2E+In+G%2E+Sampson%2C+D%2E+Gil%2C+and+P%2E+Trudgill%2C+eds%2E%2C+Language+Complexity+as+an+Evolving+Variable%2C+pages+80%E2%80%9397%2E+Oxford%3A+Oxford+Univ)
27. Miestamo, Matti, Kaius Sinnemki, and Fred Karlsson, eds. 2008. Language complexity: typology, contact, change. Amsterdam, Philadelphia: Benjamins. [find](https://scholar.google.com/scholar?q=Miestamo%2C+Matti%2C+Kaius+Sinnemki%2C+and+Fred+Karlsson%2C+eds%2E+2008%2E+Language+complexity%3A+typology%2C+contact%2C+change%2E+Amsterdam%2C+Philadelphia%3A+Benjamins%2E)
28. Moscoso del Prado Martin, Fermin, Aleksandar Kostic, and R. Harald Baayen. 2004. Putting the bits together: an information theoretical perspective on morphological processing. Cognition 94(1):1–18. [find](https://scholar.google.com/scholar?q=Moscoso+del+Prado+Martin%2C+Fermin%2C+Aleksandar+Kostic%2C+and+R%2E+Harald+Baayen%2E+2004%2E+Putting+the+bits+together%3A+an+information+theoretical+perspective+on+morphological+processing%2E+Cognition+94%281%29%3A1%E2%80%9318%2E)
29. Nichols, Johanna. 2009. Linguistic complexity: a comprehensive definition and survey. In G. Sampson, D. Gil, and P. Trudgill, eds., Language Complexity as an Evolving Variable, pages 64–79. Oxford: Oxford University Press. [find](https://scholar.google.com/scholar?q=Nichols%2C+Johanna%2E+2009%2E+Linguistic+complexity%3A+a+comprehensive+definition+and+survey%2E+In+G%2E+Sampson%2C+D%2E+Gil%2C+and+P%2E+Trudgill%2C+eds%2E%2C+Language+Complexity+as+an+Evolving+Variable%2C+pages+64%E2%80%9379%2E+Oxford%3A+Ox)
30. O’Grady, William, Michael Dobrovolsky, and Mark Aronoff. 1997. Contemporary Linguistics: An Introduction. New York: St. Martin’s Press, 3rd edn. [find](https://scholar.google.com/scholar?q=O%E2%80%99Grady%2C+William%2C+Michael+Dobrovolsky%2C+and+Mark+Aronoff%2E+1997%2E+Contemporary+Linguistics%3A+An+Introduction%2E+New+York%3A+St%2E+Martin%E2%80%99s+Press%2C+3rd+edn%2E)
31. Rosansky, Ellen. 1976. Methods and morphemes in second language acquisition research. Language Learning 26(2):409–425. [find](https://scholar.google.com/scholar?q=Rosansky%2C+Ellen%2E+1976%2E+Methods+and+morphemes+in+second+language+acquisition+research%2E+Language+Learning+26%282%29%3A409%E2%80%93425%2E)
32. Sadeniemi, Markus, Kimmo Kettunen, Tiina Lindh-Knuutila, and Timo Honkela. 2008. Complexity of european union languages: A comparative approach. Journal of Quantitative Linguistics 15(2):185–211. [find](https://scholar.google.com/scholar?q=Sadeniemi%2C+Markus%2C+Kimmo+Kettunen%2C+Tiina+Lindh%2DKnuutila%2C+and+Timo+Honkela%2E+2008%2E+Complexity+of+european+union+languages%3A+A+comparative+approach%2E+Journal+of+Quantitative+Linguistics+15%282%29%3A185%E2%80%93211%2E)
33. Salomon, David. 2007. Data Compression. The complete Reference.. London: Springer Verlag, 4th edn. [find](https://scholar.google.com/scholar?q=Salomon%2C+David%2E+2007%2E+Data+Compression%2E+The+complete+Reference%2E%2E+London%3A+Springer+Verlag%2C+4th+edn%2E)
34. Sampson, Geoffrey. 2009. A linguistic axiom challenged. In G. Sampson, D. Gil, and P. Trudgill, eds., Language Complexity as an Evolving Variable, pages 1–18. Oxford: Oxford University Press. [find](https://scholar.google.com/scholar?q=Sampson%2C+Geoffrey%2E+2009%2E+A+linguistic+axiom+challenged%2E+In+G%2E+Sampson%2C+D%2E+Gil%2C+and+P%2E+Trudgill%2C+eds%2E%2C+Language+Complexity+as+an+Evolving+Variable%2C+pages+1%E2%80%9318%2E+Oxford%3A+Oxford+University+Press%2E)
35. Shannon, Claude E. 1948. A mathematical theory of communication. Bell System Technical Journal 27:379–423. [find](https://scholar.google.com/scholar?q=Shannon%2C+Claude+E%2E+1948%2E+A+mathematical+theory+of+communication%2E+Bell+System+Technical+Journal+27%3A379%E2%80%93423%2E)
36. Shosted, Ryan K. 2006. Correlating complexity: A typological approach. Journal of Linguistic Typology 10:1–40. [find](https://scholar.google.com/scholar?q=Shosted%2C+Ryan+K%2E+2006%2E+Correlating+complexity%3A+A+typological+approach%2E+Journal+of+Linguistic+Typology+10%3A1%E2%80%9340%2E)
37. Szmrecsanyi, Benedikt. 2009. Typological parameters of intralingual variability: Grammatical analyticity versus syntheticity in varieties of english. Language Variation and Change 21(3):319–353. [find](https://scholar.google.com/scholar?q=Szmrecsanyi%2C+Benedikt%2E+2009%2E+Typological+parameters+of+intralingual+variability%3A+Grammatical+analyticity+versus+syntheticity+in+varieties+of+english%2E+Language+Variation+and+Change+21%283%29%3A319%E2%80%93353%2E)
38. Szmrecsanyi, Benedikt and Bernd Kortmann. 2009. Between simplification and complexification: non-standard varieties of english around the world. In G. Sampson, D. Gil, and P. Trudgill, eds., Language Complexity as an Evolving Variable, pages 64–79. Oxford: Oxford University Press. [find](https://scholar.google.com/scholar?q=Szmrecsanyi%2C+Benedikt+and+Bernd+Kortmann%2E+2009%2E+Between+simplification+and+complexification%3A+non%2Dstandard+varieties+of+english+around+the+world%2E+In+G%2E+Sampson%2C+D%2E+Gil%2C+and+P%2E+Trudgill%2C+eds%2E%2C+Language+)
39. Toutanova, Kristina, Dan Klein, Chirstopher Manning, and Yoram Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies pages 252–259. [our card](https://md.research.elamur.ai/free/en/papers/toutanova-2003-feature-rich-part-speech-tagging/)
40. Trudgill, Peter. 2001. Contact and simplification: Historical baggage and directionality in linguistic change. Linguistic Typology 5(2/3):371–374. [find](https://scholar.google.com/scholar?q=Trudgill%2C+Peter%2E+2001%2E+Contact+and+simplification%3A+Historical+baggage+and+directionality+in+linguistic+change%2E+Linguistic+Typology+5%282%2F3%29%3A371%E2%80%93374%2E)
41. Trudgill, Peter. 2004. Linguistic and social typology: The austronesian migrations and phoneme inventories. Linguistic Typology 8:305–320. [find](https://scholar.google.com/scholar?q=Trudgill%2C+Peter%2E+2004%2E+Linguistic+and+social+typology%3A+The+austronesian+migrations+and+phoneme+inventories%2E+Linguistic+Typology+8%3A305%E2%80%93320%2E)
42. van der Lubbe, J. C. A. 1997. Information theory. Cambridge [England] ; New York: Cambridge University Press. 96009421 J.C.A. van der Lubbe ; translated by Hendrik Jan Hoeve and Steve Gee. ill. ; 24 cm. Includes bibliographical references (p. 345-346) and index. [find](https://scholar.google.com/scholar?q=van+der+Lubbe%2C+J%2E+C%2E+A%2E+1997%2E+Information+theory%2E+Cambridge+%5BEngland%5D+%3B+New+York%3A+Cambridge+University+Press%2E+96009421+J%2EC%2EA%2E+van+der+Lubbe+%3B+translated+by+Hendrik+Jan+Hoeve+and+Steve+Gee%2E+ill%2E+%3B+24+c)
43. Ziv, Jacob and Abraham Lempel. 1977. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory IT-23(3):337–343. [find](https://scholar.google.com/scholar?q=Ziv%2C+Jacob+and+Abraham+Lempel%2E+1977%2E+A+universal+algorithm+for+sequential+data+compression%2E+IEEE+Transactions+on+Information+Theory+IT%2D23%283%29%3A337%E2%80%93343%2E)