---
title: "A Stochastic Finite-State Word-Segmentation — Sproat 1996"
description: "Written Chinese does not mark word boundaries with spaces, so any downstream system, such as text-to-speech, translation, or retrieval, must first…"
authors: ["Richard W. Sproat", "Chilin Shih", "William Gale", "Nancy Chang"]
year: 1996
venue: "Computational Linguistics"
source: "https://aclanthology.org/J96-3004/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sproat-1996-stochastic-finite-state-word-segmentation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sproat-1996-stochastic-finite-state-word-segmentation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [1996](https://md.research.elamur.ai/free/en/papers/1996/) / A Stochastic Finite-State Word-Segmentation Algorithm for Chinese

# A Stochastic Finite-State Word-Segmentation Algorithm for Chinese

**Authors:** [Richard W. Sproat](https://md.research.elamur.ai/free/en/authors/richard-sproat/), Chilin Shih, [William Gale](https://md.research.elamur.ai/free/en/authors/william-a-gale/), Nancy Chang · **Institutions:** [University of Cambridge](https://md.research.elamur.ai/free/en/universities/university-of-cambridge/) · [Harvard University](https://md.research.elamur.ai/free/en/universities/harvard-university/) · [AT&T](https://md.research.elamur.ai/free/en/companies/at-t/) · **Year:** 1996 · **Venue:** Computational Linguistics · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/J96-3004/) · [PDF](https://aclanthology.org/J96-3004.pdf) · [OpenAlex](https://openalex.org/W1558333962)

**Citations:** 319 citations (OpenAlex, 2026-10-14) · [91](https://md.research.elamur.ai/free/en/papers/sproat-1996-stochastic-finite-state-word-segmentation/cited-by/) in our library, of the 140884 papers whose bibliographies we read

## Summary
Written Chinese does not mark word boundaries with spaces, so any downstream system, such as text-to-speech, translation, or retrieval, must first recover words from strings of hanzi. Sproat and colleagues at Bell Laboratories frame segmentation as a search over weighted finite-state transducers. The model combines a static dictionary with sub-models for words that no word list can fully cover: morphological derivatives, Chinese personal names, and transliterated foreign names. Costs for unseen items of these types are estimated with the Good-Turing method. Resources include a text corpus from United Informatics, the BDC 'Behavior Chinese-English Electronic Dictionary', and name corpora. Because the system was built for the Bell Labs Mandarin TTS system, it also outputs pronunciations. Its segmentations were compared against those of several human annotators, who themselves disagree on a single correct segmentation, and the system was judged to perform well (the exact figures fall in the portion of the text not provided). The work matters because it shows that segmentation can sit in one uniform, extensible weighted-FST framework that plugs directly into larger speech and language pipelines.

## Key points
- Segmentation matters for Mandarin TTS for several reasons:
  - homographic hanzi are pronounced differently depending on the word they belong to;
  - Third Tone Sandhi and Northern-dialect tone neutralization apply at the word level;
  - part-of-speech-based prosody requires word units.
- The Good-Turing method assigns likelihoods to unseen derived words and personal names, so the segmenter handles items absent from the lexicon.
- As deployed within Bell Labs' Mandarin TTS, the transducer contains roughly 32,000 states and 209,000 arcs. Inverting it, so that it maps phonemes to hanzi, makes it usable for speech recognition.
- Reduplication patterns cannot be modeled directly by finite-state machinery and must be pre-expanded into the lexicon. These include A-not-A questions (e.g., gaol-bu4-gaol-xing4) and AABB adverbs.
- By comparison, Gan's earlier system was tested with only a few hundred lexicon words and thirty sentences. The authors argue that its classifier and modal-verb cues could be approximated with finite-state local grammars.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Tokenization & segmentation](https://md.research.elamur.ai/free/en/topics/tokenization/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{sproat1996stochastic,
  title = {{A Stochastic Finite-State Word-Segmentation Algorithm for Chinese}},
  author = {Sproat, Richard W. and Shih, Chilin and Gale, William and Chang, Nancy},
  journal = {Computational Linguistics},
  year = {1996},
  doi = {10.3115/981732.981742},
  url = {https://doi.org/10.3115/981732.981742}
}
```

- [← previous Motivations and Methods for Text Simplification](https://md.research.elamur.ai/free/en/papers/chandrasekar-1996-motivations-methods-text-simplification/)
- [next → Chart Generation](https://md.research.elamur.ai/free/en/papers/kay-1996-chart-generation/)
- [↑ back to papers of 1996](https://md.research.elamur.ai/free/en/papers/1996/)

## References

52 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Antworth, Evan. 1990. PC-KIMMO: A Two-Level Processor for Morphological Analysis. Occasional Publications in Academic Computing, 16. Summer Institute of Linguistics, Dallas, TX. [find](https://scholar.google.com/scholar?q=Antworth%2C+Evan%2E+1990%2E+PC%2DKIMMO%3A+A+Two%2DLevel+Processor+for+Morphological+Analysis%2E+Occasional+Publications+in+Academic+Computing%2C+16%2E+Summer+Institute+of+Linguistics%2C+Dallas%2C+TX%2E)
2. Baayen, Harald. 1989. A Corpus-Based Approach to Morphological Productivity: Statistical Analysis and Psycholinguistic Interpretation. Ph.D. thesis, Free University, Amsterdam. [find](https://scholar.google.com/scholar?q=Baayen%2C+Harald%2E+1989%2E+A+Corpus%2DBased+Approach+to+Morphological+Productivity%3A+Statistical+Analysis+and+Psycholinguistic+Interpretation%2E+Ph%2ED%2E+thesis%2C+Free+University%2C+Amsterdam%2E)
3. Becker, Richard, John Chambers, and Allan Wilks. 1988. The New S Language. Wadsworth and Brooks, Pacific Grove. [find](https://scholar.google.com/scholar?q=Becker%2C+Richard%2C+John+Chambers%2C+and+Allan+Wilks%2E+1988%2E+The+New+S+Language%2E+Wadsworth+and+Brooks%2C+Pacific+Grove%2E)
4. Chang, Chao-Huang and Cheng-Der Chen. 1993. A study on integrating Chinese word segmentation and part-of-speech tagging. Communications of the Chinese and Oriental Languages Information Processing Society, 3(2):69-77. [find](https://scholar.google.com/scholar?q=Chang%2C+Chao%2DHuang+and+Cheng%2DDer+Chen%2E+1993%2E+A+study+on+integrating+Chinese+word+segmentation+and+part%2Dof%2Dspeech+tagging%2E+Communications+of+the+Chinese+and+Oriental+Languages+Information+Processing+Soc)
5. Chang, Jyun-Shen, C.-D. Chen, and Shun-De Chen. 1991. Xianzhishi manzu ji jilu zuijiahua de zhongwen duanci fangfa [Chinese word segmentation through constraint satisfaction and statistical optimization]. In Proceedings of ROCLING IV, pages 147-165, Taipei. ROCLING. [find](https://scholar.google.com/scholar?q=Chang%2C+Jyun%2DShen%2C+C%2E%2DD%2E+Chen%2C+and+Shun%2DDe+Chen%2E+1991%2E+Xianzhishi+manzu+ji+jilu+zuijiahua+de+zhongwen+duanci+fangfa+%5BChinese+word+segmentation+through+constraint+satisfaction+and+statistical+optimizati)
6. Chang, Jyun-Shen, Shun-De Chen, Ying Zheng, Xian-Zhong Liu, and Shu-Jin Ke. 1992. Large-corpus-based methods for Chinese personal name recognition. [find](https://scholar.google.com/scholar?q=Chang%2C+Jyun%2DShen%2C+Shun%2DDe+Chen%2C+Ying+Zheng%2C+Xian%2DZhong+Liu%2C+and+Shu%2DJin+Ke%2E+1992%2E+Large%2Dcorpus%2Dbased+methods+for+Chinese+personal+name+recognition%2E)
7. Journal of Chinese Information Processing, 6(3):7-15. [find](https://scholar.google.com/scholar?q=Journal+of+Chinese+Information+Processing%2C+6%283%29%3A7%2D15%2E)
8. Chao, Yuen-Ren. 1968. A Grammar of Spoken Chinese. University of California Press, Berkeley, CA. [find](https://scholar.google.com/scholar?q=Chao%2C+Yuen%2DRen%2E+1968%2E+A+Grammar+of+Spoken+Chinese%2E+University+of+California+Press%2C+Berkeley%2C+CA%2E)
9. Chen, Keh-Jiann and Shing-Huan Liu. 1992. Word identification for Mandarin Chinese sentences. In Proceedings of COLING-92, pages 101-107. COLING. [find](https://scholar.google.com/scholar?q=Chen%2C+Keh%2DJiann+and+Shing%2DHuan+Liu%2E+1992%2E+Word+identification+for+Mandarin+Chinese+sentences%2E+In+Proceedings+of+COLING%2D92%2C+pages+101%2D107%2E+COLING%2E)
10. Church, Kenneth and William Gale. 1991. A comparison of the enhanced Good-Turing and deleted estimation methods for estimating probabilities of English bigrams. Computer Speech and Language, 5(1):19-54. [find](https://scholar.google.com/scholar?q=Church%2C+Kenneth+and+William+Gale%2E+1991%2E+A+comparison+of+the+enhanced+Good%2DTuring+and+deleted+estimation+methods+for+estimating+probabilities+of+English+bigrams%2E+Computer+Speech+and+Language%2C+5%281%29%3A19%2D5)
11. Church, Kenneth and Patrick Hanks. 1989. Word association norms, mutual information and lexicography. In 27th Annual Meeting of the Association for Computational Linguistics, pages 76-83, Morristown, NJ. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Church%2C+Kenneth+and+Patrick+Hanks%2E+1989%2E+Word+association+norms%2C+mutual+information+and+lexicography%2E+In+27th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+76%2D83%2C+Morristown%2C+) [our card](https://md.research.elamur.ai/free/en/papers/church-1990-word-association-norms-mutual-information/)
12. DeFrancis, John. 1984. The Chinese Language. University of Hawaii Press, Honolulu. [find](https://scholar.google.com/scholar?q=DeFrancis%2C+John%2E+1984%2E+The+Chinese+Language%2E+University+of+Hawaii+Press%2C+Honolulu%2E)
13. Fan, C.-K. and W.-H. Tsai. 1988. Automatic word identification in Chinese sentences by the relaxation technique. Computer Processing of Chinese and Oriental Languages, 4:33-56. [find](https://scholar.google.com/scholar?q=Fan%2C+C%2E%2DK%2E+and+W%2E%2DH%2E+Tsai%2E+1988%2E+Automatic+word+identification+in+Chinese+sentences+by+the+relaxation+technique%2E+Computer+Processing+of+Chinese+and+Oriental+Languages%2C+4%3A33%2D56%2E)
14. Fung, Pascale and Dekai Wu. 1994. Statistical augmentation of a Chinese machine-readable dictionary. In WVLC-94, Second Annual Workshop on Very Large Corpora. [find](https://scholar.google.com/scholar?q=Fung%2C+Pascale+and+Dekai+Wu%2E+1994%2E+Statistical+augmentation+of+a+Chinese+machine%2Dreadable+dictionary%2E+In+WVLC%2D94%2C+Second+Annual+Workshop+on+Very+Large+Corpora%2E)
15. Gan, Kok-Wee. 1994. Integrating Word Boundary Disambiguation with Sentence Understanding. Ph.D. thesis, National University of Singapore. [find](https://scholar.google.com/scholar?q=Gan%2C+Kok%2DWee%2E+1994%2E+Integrating+Word+Boundary+Disambiguation+with+Sentence+Understanding%2E+Ph%2ED%2E+thesis%2C+National+University+of+Singapore%2E)
16. Gu, Ping and Yuhang Mao. 1994. Hanyu zidong fenci de jinlin pipei suanfa ji qi zai QHFY hanying jiqi fanyi xitong zhong de shixian [The adjacent matching algorithm of Chinese automatic word segmentation and its implementation in the QHFY Chinese-English system]. In International Conference on Chines… [find](https://scholar.google.com/scholar?q=Gu%2C+Ping+and+Yuhang+Mao%2E+1994%2E+Hanyu+zidong+fenci+de+jinlin+pipei+suanfa+ji+qi+zai+QHFY+hanying+jiqi+fanyi+xitong+zhong+de+shixian+%5BThe+adjacent+matching+algorithm+of+Chinese+automatic+word+segmentati)
17. Hirschberg, Julia. 1993. Pitch accent in context: Predicting intonational prominence from text. Art~'cial Intelligence, 63:305-340. [find](https://scholar.google.com/scholar?q=Hirschberg%2C+Julia%2E+1993%2E+Pitch+accent+in+context%3A+Predicting+intonational+prominence+from+text%2E+Art%7E%27cial+Intelligence%2C+63%3A305%2D340%2E)
18. Huang, Chu-Ren, Kathleen Ahrens, and Keh-jiann Chen. 1993. A data-driven approach to psychological reality of the mental lexicon: Two studies on Chinese corpus linguistics. Presented at the conference on Language and its Psychobiological Bases, December. [find](https://scholar.google.com/scholar?q=Huang%2C+Chu%2DRen%2C+Kathleen+Ahrens%2C+and+Keh%2Djiann+Chen%2E+1993%2E+A+data%2Ddriven+approach+to+psychological+reality+of+the+mental+lexicon%3A+Two+studies+on+Chinese+corpus+linguistics%2E+Presented+at+the+conference)
19. Kaplan, Ronald and Martin Kay. 1994. Regular models of phonological rule systems. Computational Linguistics, 20:331-378. [find](https://scholar.google.com/scholar?q=Kaplan%2C+Ronald+and+Martin+Kay%2E+1994%2E+Regular+models+of+phonological+rule+systems%2E+Computational+Linguistics%2C+20%3A331%2D378%2E)
20. Karttunen, Lauri, Ronald Kaplan, and Annie Zaenen. 1992. Two-level morphology with composition. In COLING-92, pages 141-148. COLING. [find](https://scholar.google.com/scholar?q=Karttunen%2C+Lauri%2C+Ronald+Kaplan%2C+and+Annie+Zaenen%2E+1992%2E+Two%2Dlevel+morphology+with+composition%2E+In+COLING%2D92%2C+pages+141%2D148%2E+COLING%2E)
21. Koskenniemi, Kimmo. 1983. Two-Level Morphology: A General Computational Model for Word-Form Recognition and Production. Ph.D. thesis, University of Helsinki, Helsinki. [find](https://scholar.google.com/scholar?q=Koskenniemi%2C+Kimmo%2E+1983%2E+Two%2DLevel+Morphology%3A+A+General+Computational+Model+for+Word%2DForm+Recognition+and+Production%2E+Ph%2ED%2E+thesis%2C+University+of+Helsinki%2C+Helsinki%2E)
22. Kupiec, Julian. 1992. Robust part-of-speech tagging using a hidden Markov model. Computer Speech and Language. Submitted. [find](https://scholar.google.com/scholar?q=Kupiec%2C+Julian%2E+1992%2E+Robust+part%2Dof%2Dspeech+tagging+using+a+hidden+Markov+model%2E+Computer+Speech+and+Language%2E+Submitted%2E)
23. Li, B.Y., S. Lin, C.F. Sun, and M.S. Sun. 1991. Yi zhong zhuyao shiyong yuliaoku biaoji jinxing qiyi jiaozheng de zuida pipei hanyu zidong fenci suanfa sheji [A maximum-matching word segmentation algorithm using corpus tags for disambiguation]. In ROCLING IV, pages 135-146, Taipei. ROCLING. [find](https://scholar.google.com/scholar?q=Li%2C+B%2EY%2E%2C+S%2E+Lin%2C+C%2EF%2E+Sun%2C+and+M%2ES%2E+Sun%2E+1991%2E+Yi+zhong+zhuyao+shiyong+yuliaoku+biaoji+jinxing+qiyi+jiaozheng+de+zuida+pipei+hanyu+zidong+fenci+suanfa+sheji+%5BA+maximum%2Dmatching+word+segmentation+algo)
24. Li, Charles and Sandra Thompson. 1981. Mandarin Chinese: A Functional Reference Grammar. University of California Press, Berkeley, CA. [find](https://scholar.google.com/scholar?q=Li%2C+Charles+and+Sandra+Thompson%2E+1981%2E+Mandarin+Chinese%3A+A+Functional+Reference+Grammar%2E+University+of+California+Press%2C+Berkeley%2C+CA%2E)
25. Liang, Nanyuan. 1986. Shumian hanyu zidong fenci xitong-CDWS [A written Chinese automatic segmentation system-CDWS]. Journal of Chinese Information Processing, 1(1):44-52. [find](https://scholar.google.com/scholar?q=Liang%2C+Nanyuan%2E+1986%2E+Shumian+hanyu+zidong+fenci+xitong%2DCDWS+%5BA+written+Chinese+automatic+segmentation+system%2DCDWS%5D%2E+Journal+of+Chinese+Information+Processing%2C+1%281%29%3A44%2D52%2E)
26. Lin, Ming-Yu, Tung-Hui Chiang, and Keh-Yi Su. 1993. A preliminary study on unknown word problem in Chinese word segmentation. In ROCLING 6, pages 119-141. ROCLING. [find](https://scholar.google.com/scholar?q=Lin%2C+Ming%2DYu%2C+Tung%2DHui+Chiang%2C+and+Keh%2DYi+Su%2E+1993%2E+A+preliminary+study+on+unknown+word+problem+in+Chinese+word+segmentation%2E+In+ROCLING+6%2C+pages+119%2D141%2E+ROCLING%2E)
27. Mohri, Mehryar. 1993. Analyse et representation par automates de structures syntaxiques compos~es. Ph.D. thesis, University of Paris 7, Paris. [find](https://scholar.google.com/scholar?q=Mohri%2C+Mehryar%2E+1993%2E+Analyse+et+representation+par+automates+de+structures+syntaxiques+compos%7Ees%2E+Ph%2ED%2E+thesis%2C+University+of+Paris+7%2C+Paris%2E)
28. Mohri, Mehryar. 1995. Minimization algorithms for sequential transducers. Theoretical Computer Science. Submitted. [find](https://scholar.google.com/scholar?q=Mohri%2C+Mehryar%2E+1995%2E+Minimization+algorithms+for+sequential+transducers%2E+Theoretical+Computer+Science%2E+Submitted%2E)
29. Nagata, Masaaki. 1994. A stochastic Japanese morphological analyzer using a forward-DP backward A* N-best search algorithm. In Proceedings of COLING-94, pages 201-207. COLING. [find](https://scholar.google.com/scholar?q=Nagata%2C+Masaaki%2E+1994%2E+A+stochastic+Japanese+morphological+analyzer+using+a+forward%2DDP+backward+A%2A+N%2Dbest+search+algorithm%2E+In+Proceedings+of+COLING%2D94%2C+pages+201%2D207%2E+COLING%2E)
30. Nie, Jian-Yun, Wanying Jin, and Marie-Louise Hannan. 1994. A hybrid approach to unknown word detection and segmentation of Chinese. In International Conference on Chinese Computing, Singapore. [find](https://scholar.google.com/scholar?q=Nie%2C+Jian%2DYun%2C+Wanying+Jin%2C+and+Marie%2DLouise+Hannan%2E+1994%2E+A+hybrid+approach+to+unknown+word+detection+and+segmentation+of+Chinese%2E+In+International+Conference+on+Chinese+Computing%2C+Singapore%2E)
31. Peng, Z.-Y. and J-S. Chang. 1993. Zhongwen cihui qiyi zhi yanjiu--duanci yu cixing biaoshi [Research on Chinese lexical ambiguity--segmentation and part-of-speech tagging]. In ROCLING 6, pages 173-193. ROCLING. [find](https://scholar.google.com/scholar?q=Peng%2C+Z%2E%2DY%2E+and+J%2DS%2E+Chang%2E+1993%2E+Zhongwen+cihui+qiyi+zhi+yanjiu%2D%2Dduanci+yu+cixing+biaoshi+%5BResearch+on+Chinese+lexical+ambiguity%2D%2Dsegmentation+and+part%2Dof%2Dspeech+tagging%5D%2E+In+ROCLING+6%2C+pages+173%2D193)
32. Pereira, Fernando, Michael Riley, and Richard Sproat. 1994. Weighted rational transductions and their application to human language processing. In ARPA Workshop on Human Language Technology, pages 249-254. Advanced Research Projects Agency, March 8-11. [find](https://scholar.google.com/scholar?q=Pereira%2C+Fernando%2C+Michael+Riley%2C+and+Richard+Sproat%2E+1994%2E+Weighted+rational+transductions+and+their+application+to+human+language+processing%2E+In+ARPA+Workshop+on+Human+Language+Technology%2C+pages+249)
33. PRCNSC, 1994. Contemporary Chinese Language Word Segmentation SpecS'cation for Information Processing. People's Republic of China National Standards Committee. In Chinese. [find](https://scholar.google.com/scholar?q=PRCNSC%2C+1994%2E+Contemporary+Chinese+Language+Word+Segmentation+SpecS%27cation+for+Information+Processing%2E+People%27s+Republic+of+China+National+Standards+Committee%2E+In+Chinese%2E)
34. ROCLING. 1993. Jisuan yuyanxue tongxun [Computational linguistics communications]. Newsletter of the Republic of China Computational Linguistics Society (ROCLING), April. In Chinese. [find](https://scholar.google.com/scholar?q=ROCLING%2E+1993%2E+Jisuan+yuyanxue+tongxun+%5BComputational+linguistics+communications%5D%2E+Newsletter+of+the+Republic+of+China+Computational+Linguistics+Society+%28ROCLING%29%2C+April%2E+In+Chinese%2E)
35. Shih, Chilin. 1986. The Prosodic Domain of Tone Sandhi in Chinese. Ph.D. thesis, UCSD, La Jolla, CA. [find](https://scholar.google.com/scholar?q=Shih%2C+Chilin%2E+1986%2E+The+Prosodic+Domain+of+Tone+Sandhi+in+Chinese%2E+Ph%2ED%2E+thesis%2C+UCSD%2C+La+Jolla%2C+CA%2E)
36. Sproat, Richard. 1992. Morphology and Computation. MIT Press, Cambridge, MA. [find](https://scholar.google.com/scholar?q=Sproat%2C+Richard%2E+1992%2E+Morphology+and+Computation%2E+MIT+Press%2C+Cambridge%2C+MA%2E)
37. Sproat, Richard. 1994. English noun-phrase accent prediction for text-to-speech. Computer Speech and Language, 8:79-94. [find](https://scholar.google.com/scholar?q=Sproat%2C+Richard%2E+1994%2E+English+noun%2Dphrase+accent+prediction+for+text%2Dto%2Dspeech%2E+Computer+Speech+and+Language%2C+8%3A79%2D94%2E)
38. Sproat, Richard. 1995. A finite-state architecture for tokenization and grapheme-to-phoneme conversion for multilingual text analysis. In Susan Armstrong and Evelyne Tzoukermann, editors, Proceedings of the EACL SIGDAT Workshop, pages 65-72, Dublin, Ireland. Association for Computational Linguistics… [find](https://scholar.google.com/scholar?q=Sproat%2C+Richard%2E+1995%2E+A+finite%2Dstate+architecture+for+tokenization+and+grapheme%2Dto%2Dphoneme+conversion+for+multilingual+text+analysis%2E+In+Susan+Armstrong+and+Evelyne+Tzoukermann%2C+editors%2C+Proceedings+)
39. Sproat, Richard and Chilin Shih. 1990. A statistical method for finding word boundaries in Chinese text. Computer Processing of Chinese and Oriental Languages, 4:336-351. [find](https://scholar.google.com/scholar?q=Sproat%2C+Richard+and+Chilin+Shih%2E+1990%2E+A+statistical+method+for+finding+word+boundaries+in+Chinese+text%2E+Computer+Processing+of+Chinese+and+Oriental+Languages%2C+4%3A336%2D351%2E)
40. Sproat, Richard and Chilin Shih. 1995. A corpus-based analysis of Mandarin nominal root compounds. Journal of East Asian Linguistics, 4(1):1-23. [find](https://scholar.google.com/scholar?q=Sproat%2C+Richard+and+Chilin+Shih%2E+1995%2E+A+corpus%2Dbased+analysis+of+Mandarin+nominal+root+compounds%2E+Journal+of+East+Asian+Linguistics%2C+4%281%29%3A1%2D23%2E)
41. Tang, Ting-Chih. 1988. Hanyu Cifa Jura Lunji [Studies on Chinese Morphology and Syntax], volume 2. Student Book Company, Taipei. In Chinese. [find](https://scholar.google.com/scholar?q=Tang%2C+Ting%2DChih%2E+1988%2E+Hanyu+Cifa+Jura+Lunji+%5BStudies+on+Chinese+Morphology+and+Syntax%5D%2C+volume+2%2E+Student+Book+Company%2C+Taipei%2E+In+Chinese%2E)
42. Tang, Ting-Chih. 1989. Hanyu Cifa Jura X~qi [Studies on Chinese Morphology and Syntax: 2], volume 2. Student Book Company, Taipei. In Chinese. [find](https://scholar.google.com/scholar?q=Tang%2C+Ting%2DChih%2E+1989%2E+Hanyu+Cifa+Jura+X%7Eqi+%5BStudies+on+Chinese+Morphology+and+Syntax%3A+2%5D%2C+volume+2%2E+Student+Book+Company%2C+Taipei%2E+In+Chinese%2E)
43. Torgerson, Warren. 1958. Theory and Methods of Scaling. Wiley, New York. [find](https://scholar.google.com/scholar?q=Torgerson%2C+Warren%2E+1958%2E+Theory+and+Methods+of+Scaling%2E+Wiley%2C+New+York%2E)
44. Tzoukermann, Evelyne and Mark Liberman. 1990. A finite-state morphological processor for Spanish. In COLING-90, Volume 3, pages 3: 277-286. COLING. [find](https://scholar.google.com/scholar?q=Tzoukermann%2C+Evelyne+and+Mark+Liberman%2E+1990%2E+A+finite%2Dstate+morphological+processor+for+Spanish%2E+In+COLING%2D90%2C+Volume+3%2C+pages+3%3A+277%2D286%2E+COLING%2E)
45. Wang, Liang-Jyh, Wei-Chuan Li, and Chao-Huang Chang. 1992. Recognizing unregistered names for Mandarin word identification. In Proceedings of COLING-92, pages 1239-1243. COLING. [find](https://scholar.google.com/scholar?q=Wang%2C+Liang%2DJyh%2C+Wei%2DChuan+Li%2C+and+Chao%2DHuang+Chang%2E+1992%2E+Recognizing+unregistered+names+for+Mandarin+word+identification%2E+In+Proceedings+of+COLING%2D92%2C+pages+1239%2D1243%2E+COLING%2E)
46. Wang, Michelle and Julia Hirschberg. 1992. Automatic classification of intonational phrase boundaries. Computer Speech and Language, 6:175-196. [find](https://scholar.google.com/scholar?q=Wang%2C+Michelle+and+Julia+Hirschberg%2E+1992%2E+Automatic+classification+of+intonational+phrase+boundaries%2E+Computer+Speech+and+Language%2C+6%3A175%2D196%2E)
47. Wang, Yongheng, Haiju Su, and Yan Mo. 1990. Automatic processing of Chinese words. Journal of Chinese Information Processing, 4(4):1-11. [find](https://scholar.google.com/scholar?q=Wang%2C+Yongheng%2C+Haiju+Su%2C+and+Yan+Mo%2E+1990%2E+Automatic+processing+of+Chinese+words%2E+Journal+of+Chinese+Information+Processing%2C+4%284%29%3A1%2D11%2E)
48. Wieger, L. 1965. Chinese Characters. Dover, New York. Republication of second edition, published 1927 by Catholic Mission Press. [find](https://scholar.google.com/scholar?q=Wieger%2C+L%2E+1965%2E+Chinese+Characters%2E+Dover%2C+New+York%2E+Republication+of+second+edition%2C+published+1927+by+Catholic+Mission+Press%2E)
49. Wu, Dekai and Pascale Fung. 1994. Improving Chinese tokenization with linguistic filters on statistical lexical acquisition. In Proceedings of the Fourth Conference on Applied Natural Language Processing, pages 180-181, Stuttgart, October. [find](https://scholar.google.com/scholar?q=Wu%2C+Dekai+and+Pascale+Fung%2E+1994%2E+Improving+Chinese+tokenization+with+linguistic+filters+on+statistical+lexical+acquisition%2E+In+Proceedings+of+the+Fourth+Conference+on+Applied+Natural+Language+Process)
50. Wu, Zimin and Gwyneth Tseng. 1993. Chinese text segmentation for text retrieval: Achievements and problems. [find](https://scholar.google.com/scholar?q=Wu%2C+Zimin+and+Gwyneth+Tseng%2E+1993%2E+Chinese+text+segmentation+for+text+retrieval%3A+Achievements+and+problems%2E)
51. Journal of the American Society for Information Science, 44(9):532-542. [find](https://scholar.google.com/scholar?q=Journal+of+the+American+Society+for+Information+Science%2C+44%289%29%3A532%2D542%2E)
52. Yeh, Ching-long and Hsi-Jian Lee. 1991. Rule-based word identification for Mandarin Chinese sentences--a unification approach. Computer Processing of Chinese and Oriental Languages, 5(2):97-118. [find](https://scholar.google.com/scholar?q=Yeh%2C+Ching%2Dlong+and+Hsi%2DJian+Lee%2E+1991%2E+Rule%2Dbased+word+identification+for+Mandarin+Chinese+sentences%2D%2Da+unification+approach%2E+Computer+Processing+of+Chinese+and+Oriental+Languages%2C+5%282%29%3A97%2D118%2E)