---
title: "Part-of-Speech Tagging for English-Spanish Code-Switched Text — Solorio 2008"
description: "The paper addresses POS tagging of conversational text where speakers alternate between English… 96.36% accuracy. 39 references, cited by 68 papers here."
authors: ["Thamar Solorio", "Yang Liu"]
year: 2008
venue: "Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/D08-1110/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/solorio-2008-part-speech-tagging-english-spanish/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/solorio-2008-part-speech-tagging-english-spanish/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2008](https://md.research.elamur.ai/free/en/papers/2008/) / Part-of-Speech Tagging for English-Spanish Code-Switched Text

# Part-of-Speech Tagging for English-Spanish Code-Switched Text

**Authors:** [Thamar Solorio](https://md.research.elamur.ai/free/en/authors/thamar-solorio/) and [Yang Liu](https://md.research.elamur.ai/free/en/authors/yang-liu/) · **Year:** 2008 · **Venue:** Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/D08-1110/) · [PDF](https://aclanthology.org/D08-1110.pdf) · [OpenAlex](https://openalex.org/W2145867197)

**Citations:** 124 citations (OpenAlex, 2026-10-14) · [68](https://md.research.elamur.ai/free/en/papers/solorio-2008-part-speech-tagging-english-spanish/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
The paper addresses POS tagging of conversational text where speakers alternate between English and Spanish ("Spanglish"), a setting with no dedicated tagger and almost no annotated data. The authors recorded about 39 minutes of conversation among three bilingual university staff members and transcribed it into 922 sentences (~8k words). Each token was manually tagged with a merged inventory built from the English and Spanish Tree Tagger tag sets. Instead of training a tagger from nothing, they reuse the two monolingual Tree Taggers and compare three ways of combining them: simple selection heuristics, choosing a tagger according to word-level language identification, and a machine-learning (SVM) classifier whose features come from both taggers' outputs. Language identification beat every heuristic. The learned combination did best and even surpassed an oracle that always picks the better of the two monolingual tags. The SVM was also notably more robust on sentences containing intrasentential switches. This matters because it shows that strong monolingual tools can be adapted to mixed-language text with only a small in-domain corpus.

## Key points
- **Dataset:** a spoken Spanglish corpus with these properties:
  - 922 sentences, about 8k tokens, 1,516 distinct word forms;
  - English-dominant: 6,020 English tokens versus roughly 2k Spanish tokens;
  - 239 manually identified switches, of which 129 are intrasentential.
- **Base taggers:** the English and Spanish versions of the Tree Tagger. The English model was trained on the Penn Treebank and reports 96.36% accuracy. The Spanish model uses 75 tags and was trained on the CRATER corpus.
- **Oracle errors:** the oracle still made 445 errors, and about half of them (233) fell in sentences containing code-switches.
- **Language-identification errors:** the dictionary-based method made 787 errors, nearly 70% of them in code-switched sentences. A large share stemmed from words that exist in both English and Spanish, for example "con", "a", "no" and "me".
- **SVM and CRF comparison:**
  - The SVM fixed 223 of the oracle's errors and 481 of the language-identification method's errors, but introduced 105 errors of its own.
  - A CRF trained from scratch in MALLET reached only 81% average accuracy, which is below the language-identification heuristic.

## Interesting ideas
- **Use monolingual taggers as feature generators.** Their tags, tag probabilities, foreign-word tags and "unknown" lemma markers can be fed to a classifier rather than trusting either tagger directly. This suits any low-resource mixed-language task, such as Ukrainian-Russian surzhyk.
- **Benchmark against a pick-the-best oracle.** An oracle that always chooses the correct monolingual output shows how much combining can gain. Beating it reveals that a learner can fix errors present in both base systems.
- **Treat lemmatization failure as a language signal.** When a tagger cannot lemmatize a word, that is cheap evidence the word comes from the other language. This is useful for token-level language identification without extra resources.
- **Break errors down by sentence type.** Separating errors in switched versus monolingual sentences exposes exactly where a method struggles. It is a simple diagnostic that transfers to evaluating any code-mixed NLP system.
- **Compare reuse against a from-scratch baseline.** Training a CRF on the small corpus confirms that reusing existing resources beats learning from scratch when in-domain data is scarce. This check is worth repeating whenever a new tiny corpus is built.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [🔤 Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/)

## Institutions

- [The University of Texas at Dallas](https://md.research.elamur.ai/free/en/universities/the-university-of-texas-at-dallas/) — University, Richardson, United States · 34 works · 3,985 citations

## Cite

Cite as: Thamar Solorio and Yang Liu. 2008. Part-of-Speech Tagging for English-Spanish Code-Switched Text. Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{solorio2008part,
  title = {{Part-of-Speech Tagging for English-Spanish Code-Switched Text}},
  author = {Thamar Solorio and Yang Liu},
  booktitle = {Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing},
  year = {2008},
  doi = {10.3115/1613715.1613852},
  url = {https://doi.org/10.3115/1613715.1613852}
}
```

- [← previous BART: A Modular Toolkit for Coreference Resolution](https://md.research.elamur.ai/free/en/papers/versley-2008-bart-modular-toolkit-coreference-resolution/)
- [next → Learning Morphology with Morfette](https://md.research.elamur.ai/free/en/papers/chrupala-2008-learning-morphology-morfette/)
- [↑ back to papers of 2008](https://md.research.elamur.ai/free/en/papers/2008/)

## References

39 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ardila, A. (2005) Spanglish: an anglicized dialect. Hispanic Journal of Behavioral Sciences, 27(1): 60–81. [find](https://scholar.google.com/scholar?q=Ardila%2C+A%2E+%282005%29+Spanglish%3A+an+anglicized+dialect%2E+Hispanic+Journal+of+Behavioral+Sciences%2C+27%281%29%3A+60%E2%80%9381%2E)
2. Brants, T. (2000) TnT - a statistical part-of-speech tagger. In Sixth Applied Natural Language Processing Conference ANLP-2000 Seatle, WA. [our card](https://md.research.elamur.ai/free/en/papers/brants-2000-tnt-statistical-part-speech-tagger/)
3. Brill, E. (1990) A simple rule-based part-of-speech tagger. In 3rd Conference on Applied Natural Language Processing, pp. 152–155. Trento, Italy. [our card](https://md.research.elamur.ai/free/en/papers/brill-1992-simple-rule-based-part-speech/)
4. Carreras, X. and Padró, L. (2002) A flexible distributed architecture for natural language analyzers. In Third International Conference on Language Resources and Evaluation, LREC-02, pp. 1813–1817. Las Palmas de Gran Canaria, Spain. [find](https://scholar.google.com/scholar?q=Carreras%2C+X%2E+and+Padro%CC%81%2C+L%2E+%282002%29+A+flexible+distributed+architecture+for+natural+language+analyzers%2E+In+Third+International+Conference+on+Language+Resources+and+Evaluation%2C+LREC%2D02%2C+pp%2E+1813%E2%80%931817%2E+L)
5. Charniak, E. (1993) Equations for part-of-speech tagging. In 11th National Conference on AI, pp. 784–789. [find](https://scholar.google.com/scholar?q=Charniak%2C+E%2E+%281993%29+Equations+for+part%2Dof%2Dspeech+tagging%2E+In+11th+National+Conference+on+AI%2C+pp%2E+784%E2%80%93789%2E)
6. Ervin, S. and Osgood, C. (1954) Second language learning and bilingualism. Journal of abnormal and social phsychology, Supplement 49, pp. 139–146. [find](https://scholar.google.com/scholar?q=Ervin%2C+S%2E+and+Osgood%2C+C%2E+%281954%29+Second+language+learning+and+bilingualism%2E+Journal+of+abnormal+and+social+phsychology%2C+Supplement+49%2C+pp%2E+139%E2%80%93146%2E)
7. Espinosa, A. (1917) Speech mixture in New Mexico: the influence of English language on New Mexican Spanish. In H. Stevens and H. Bolton, (eds.), The Pacific Ocean in History, pp. 408–428. [find](https://scholar.google.com/scholar?q=Espinosa%2C+A%2E+%281917%29+Speech+mixture+in+New+Mexico%3A+the+influence+of+English+language+on+New+Mexican+Spanish%2E+In+H%2E+Stevens+and+H%2E+Bolton%2C+%28eds%2E%29%2C+The+Pacific+Ocean+in+History%2C+pp%2E+408%E2%80%93428%2E)
8. Franco, J.C. and Solorio T. (2007) Baby-steps towards building a Spanglish language model. In 8th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing-2007, pp. 75–84. Mexico City, Mexico. [find](https://scholar.google.com/scholar?q=Franco%2C+J%2EC%2E+and+Solorio+T%2E+%282007%29+Baby%2Dsteps+towards+building+a+Spanglish+language+model%2E+In+8th+International+Conference+on+Computational+Linguistics+and+Intelligent+Text+Processing%2C+CICLing%2D2007%2C+p)
9. Friedman, J., Hastie, T., and Tibshirani, R. (1998) Additive logistic regression: a statistical view of boosting. Technical Report, Stanford University. [find](https://scholar.google.com/scholar?q=Friedman%2C+J%2E%2C+Hastie%2C+T%2E%2C+and+Tibshirani%2C+R%2E+%281998%29+Additive+logistic+regression%3A+a+statistical+view+of+boosting%2E+Technical+Report%2C+Stanford+University%2E)
10. Godfrey, J., Holliman, E. and McDaniel, J. (1992) Switchboard: Telephone speech corpus for research development. In ICASSP, pp. 517–520, San Francisco, CA, USA. [find](https://scholar.google.com/scholar?q=Godfrey%2C+J%2E%2C+Holliman%2C+E%2E+and+McDaniel%2C+J%2E+%281992%29+Switchboard%3A+Telephone+speech+corpus+for+research+development%2E+In+ICASSP%2C+pp%2E+517%E2%80%93520%2C+San+Francisco%2C+CA%2C+USA%2E)
11. Goyal, P., Mital, Manav R., Mukerjee, A., Raina, Achla M., Sharma, D., Shukla, P. and Vikram, K. (2003) A bilingual parser for Hindi, English and code-switching structures. In Computational Linguistics for South Asian Languages –Expanding Synergies with Europe, EACL-2003 Workshop, Budapest, Hungary. [find](https://scholar.google.com/scholar?q=Goyal%2C+P%2E%2C+Mital%2C+Manav+R%2E%2C+Mukerjee%2C+A%2E%2C+Raina%2C+Achla+M%2E%2C+Sharma%2C+D%2E%2C+Shukla%2C+P%2E+and+Vikram%2C+K%2E+%282003%29+A+bilingual+parser+for+Hindi%2C+English+and+code%2Dswitching+structures%2E+In+Computational+Linguistic)
12. Grosjean, F. (1982) Life with Two Languages: An Introduction to Bilingualism. Harvard University Press. [find](https://scholar.google.com/scholar?q=Grosjean%2C+F%2E+%281982%29+Life+with+Two+Languages%3A+An+Introduction+to+Bilingualism%2E+Harvard+University+Press%2E)
13. Gumperz, J. J. and Hernandez-Chavez, E. (1971) Cognitive aspects of bilingual communication. Oxford University Press, London. [find](https://scholar.google.com/scholar?q=Gumperz%2C+J%2E+J%2E+and+Hernandez%2DChavez%2C+E%2E+%281971%29+Cognitive+aspects+of+bilingual+communication%2E+Oxford+University+Press%2C+London%2E)
14. Gumperz, J. J. (1964) Linguistic and social interaction in two communities. In John J. Gumperz (ed.), Language in social groups, pp. 151–176, Stanford. Stanford University Press. [find](https://scholar.google.com/scholar?q=Gumperz%2C+J%2E+J%2E+%281964%29+Linguistic+and+social+interaction+in+two+communities%2E+In+John+J%2E+Gumperz+%28ed%2E%29%2C+Language+in+social+groups%2C+pp%2E+151%E2%80%93176%2C+Stanford%2E+Stanford+University+Press%2E)
15. Gumperz, J. J. (1971) Bilingualism, bidialectism and classroom interaction. In Language in social groups, pp. 311–339, Stanford. Stanford University Press. [find](https://scholar.google.com/scholar?q=Gumperz%2C+J%2E+J%2E+%281971%29+Bilingualism%2C+bidialectism+and+classroom+interaction%2E+In+Language+in+social+groups%2C+pp%2E+311%E2%80%93339%2C+Stanford%2E+Stanford+University+Press%2E)
16. Joshi, A. K. (1982) Processing of sentences with intrasentential code-switching. In Ján Horecký (ed.), COLING-82, pp. 145–150, Prague. [find](https://scholar.google.com/scholar?q=Joshi%2C+A%2E+K%2E+%281982%29+Processing+of+sentences+with+intrasentential+code%2Dswitching%2E+In+Ja%CC%81n+Horecky%CC%81+%28ed%2E%29%2C+COLING%2D82%2C+pp%2E+145%E2%80%93150%2C+Prague%2E)
17. Kucera, H. and Francis, W. N. (1967) Computational analysis of present-day American English. Brown University Press. [find](https://scholar.google.com/scholar?q=Kucera%2C+H%2E+and+Francis%2C+W%2E+N%2E+%281967%29+Computational+analysis+of+present%2Dday+American+English%2E+Brown+University+Press%2E)
18. Lafferty, J. and McCallum, A. and Pereira F. (2001) Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In 18th ICML, pp. 282–289. MA, USA. [find](https://scholar.google.com/scholar?q=Lafferty%2C+J%2E+and+McCallum%2C+A%2E+and+Pereira+F%2E+%282001%29+Conditional+random+fields%3A+Probabilistic+models+for+segmenting+and+labeling+sequence+data%2E+In+18th+ICML%2C+pp%2E+282%E2%80%93289%2E+MA%2C+USA%2E)
19. Lipski, J. M. (1978) Code-switching and the problem of bilingual competence. In M. Paradis (ed.), Aspects of bilingualism, pp. 250–264, Columbia, SC. Hornbeam. [find](https://scholar.google.com/scholar?q=Lipski%2C+J%2E+M%2E+%281978%29+Code%2Dswitching+and+the+problem+of+bilingual+competence%2E+In+M%2E+Paradis+%28ed%2E%29%2C+Aspects+of+bilingualism%2C+pp%2E+250%E2%80%93264%2C+Columbia%2C+SC%2E+Hornbeam%2E)
20. McCallum, A. (2002) MALLET: A Machine Learning for Language Toolkit. Retrieved January 7, 2008 from [http://mallet.cs.umass.edu](http://mallet.cs.umass.edu) [↗](http://mallet.cs.umass.edu)
21. Paul, D. B. and Baker, J. M. (1992) The design of the Wall Street Journal-based CSR corpus. In HLT’91: workshop on speech and Natural Language pp. 357– 362, Morristown, NJ, USA. [find](https://scholar.google.com/scholar?q=Paul%2C+D%2E+B%2E+and+Baker%2C+J%2E+M%2E+%281992%29+The+design+of+the+Wall+Street+Journal%2Dbased+CSR+corpus%2E+In+HLT%E2%80%9991%3A+workshop+on+speech+and+Natural+Language+pp%2E+357%E2%80%93+362%2C+Morristown%2C+NJ%2C+USA%2E)
22. Poplack, S., Sankoff, D. and Miller, C. (1988) The social correlates and linguistic processes of lexical borrowing and assimilation. Linguistics, 26(1): 47–104. [find](https://scholar.google.com/scholar?q=Poplack%2C+S%2E%2C+Sankoff%2C+D%2E+and+Miller%2C+C%2E+%281988%29+The+social+correlates+and+linguistic+processes+of+lexical+borrowing+and+assimilation%2E+Linguistics%2C+26%281%29%3A+47%E2%80%93104%2E)
23. Poplack, S. (1980) Sometimes I’ll start a sentence in Spanish y termino en español: toward a typology of code-switching. Linguistics, 18(7/8): 581–618. [find](https://scholar.google.com/scholar?q=Poplack%2C+S%2E+%281980%29+Sometimes+I%E2%80%99ll+start+a+sentence+in+Spanish+y+termino+en+espan%CC%83ol%3A+toward+a+typology+of+code%2Dswitching%2E+Linguistics%2C+18%287%2F8%29%3A+581%E2%80%93618%2E)
24. Poplack, S. (1981) Syntactic structure and social function of code-switching. In R. Duran (ed.), Latino discourse and communicative behavior, pp. 169–184, Norwood, NJ. Ablex. [find](https://scholar.google.com/scholar?q=Poplack%2C+S%2E+%281981%29+Syntactic+structure+and+social+function+of+code%2Dswitching%2E+In+R%2E+Duran+%28ed%2E%29%2C+Latino+discourse+and+communicative+behavior%2C+pp%2E+169%E2%80%93184%2C+Norwood%2C+NJ%2E+Ablex%2E)
25. Quinlan, J. R. (1986) Induction of decision trees. Machine Learning, 1: 81–106. [find](https://scholar.google.com/scholar?q=Quinlan%2C+J%2E+R%2E+%281986%29+Induction+of+decision+trees%2E+Machine+Learning%2C+1%3A+81%E2%80%93106%2E)
26. Ratnaparkhi, A. (1996) A maximum entropy model for part-of-speech tagging. In EMNLP, pp. 133–142, Philadelphia, PA, May. [our card](https://md.research.elamur.ai/free/en/papers/ratnaparkhi-1996-maximum-entropy-model-part-speech/)
27. Rosner, M. and Farrugia, P. (2007) A tagging algorithm for mixed language identification in a noisy domain. [find](https://scholar.google.com/scholar?q=Rosner%2C+M%2E+and+Farrugia%2C+P%2E+%282007%29+A+tagging+algorithm+for+mixed+language+identification+in+a+noisy+domain%2E)
28. In INTERSPEECH 2007, pp. 190–193, Antwerp, Belgium. [find](https://scholar.google.com/scholar?q=In+INTERSPEECH+2007%2C+pp%2E+190%E2%80%93193%2C+Antwerp%2C+Belgium%2E)
29. Sankoff, D. (1968) Social aspects of multilingualism in New Guinea. Ph.D. thesis, McGill University. [find](https://scholar.google.com/scholar?q=Sankoff%2C+D%2E+%281968%29+Social+aspects+of+multilingualism+in+New+Guinea%2E+Ph%2ED%2E+thesis%2C+McGill+University%2E)
30. Sankoff, D. (1981) A formal grammar for codeswitching. Papers in Linguistics: International Journal of Human communications, 14(1): 3–46. [find](https://scholar.google.com/scholar?q=Sankoff%2C+D%2E+%281981%29+A+formal+grammar+for+codeswitching%2E+Papers+in+Linguistics%3A+International+Journal+of+Human+communications%2C+14%281%29%3A+3%E2%80%9346%2E)
31. Sankoff, D. (1998a) A formal production-based explanation of the facts of code-switching. Bilingualism, Language and Cognition, 1: 39–50. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Sankoff%2C+D%2E+%281998a%29+A+formal+production%2Dbased+explanation+of+the+facts+of+code%2Dswitching%2E+Bilingualism%2C+Language+and+Cognition%2C+1%3A+39%E2%80%9350%2E+Cambridge+University+Press%2E)
32. Sankoff, D. (1998b) The production of code-mixed discourse. In 36th ACL, volume I, pp. 8–21, Montreal, Quebec, Canada. [find](https://scholar.google.com/scholar?q=Sankoff%2C+D%2E+%281998b%29+The+production+of+code%2Dmixed+discourse%2E+In+36th+ACL%2C+volume+I%2C+pp%2E+8%E2%80%9321%2C+Montreal%2C+Quebec%2C+Canada%2E)
33. Schmid, H. (1994) Probabilistic part-of-speech tagging using decision trees. In International Conference on New Methods in Language Processing, Manchester, UK. [find](https://scholar.google.com/scholar?q=Schmid%2C+H%2E+%281994%29+Probabilistic+part%2Dof%2Dspeech+tagging+using+decision+trees%2E+In+International+Conference+on+New+Methods+in+Language+Processing%2C+Manchester%2C+UK%2E)
34. Schölkopf, B. and Smola, A. J. (2002) Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press. [find](https://scholar.google.com/scholar?q=Scho%CC%88lkopf%2C+B%2E+and+Smola%2C+A%2E+J%2E+%282002%29+Learning+with+Kernels%3A+Support+Vector+Machines%2C+Regularization%2C+Optimization+and+Beyond%2E+MIT+Press%2E)
35. Toribio, A. J. (2001a) Accessing Spanish-English code-switching competence. International Journal of Bilingualism, 5(4):403–436. [find](https://scholar.google.com/scholar?q=Toribio%2C+A%2E+J%2E+%282001a%29+Accessing+Spanish%2DEnglish+code%2Dswitching+competence%2E+International+Journal+of+Bilingualism%2C+5%284%29%3A403%E2%80%93436%2E)
36. Toribio, A. J. (2001b) On the emergence of bilingual code-switching competence. Bilingual Language and Cognition, 4(3):203–231. [find](https://scholar.google.com/scholar?q=Toribio%2C+A%2E+J%2E+%282001b%29+On+the+emergence+of+bilingual+code%2Dswitching+competence%2E+Bilingual+Language+and+Cognition%2C+4%283%29%3A203%E2%80%93231%2E)
37. U.S. Census Bureau. (2003) Language use and English speaking ability: 2000. Retrieved October 30, 2006 from [http://www.census.gov/prod/2003pubs/c2kbr-29.pdf](http://www.census.gov/prod/2003pubs/c2kbr-29.pdf). [↗](http://www.census.gov/prod/2003pubs/c2kbr-29.pdf)
38. Witten, I. H. and Frank, E. (1999) Data Mining, Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann. [find](https://scholar.google.com/scholar?q=Witten%2C+I%2E+H%2E+and+Frank%2C+E%2E+%281999%29+Data+Mining%2C+Practical+Machine+Learning+Tools+and+Techniques+with+Java+Implementations%2E+Morgan+Kaufmann%2E)
39. Wolpert, D. H. (1992) Stacked Generalization. Neural Networks, 5(2):241–259. [find](https://scholar.google.com/scholar?q=Wolpert%2C+D%2E+H%2E+%281992%29+Stacked+Generalization%2E+Neural+Networks%2C+5%282%29%3A241%E2%80%93259%2E)