---
title: "What to do about bad language on the — Eisenstein 2013"
description: "This survey asks why language on social media departs so sharply from the edited text NLP systems are trained on."
authors: ["Jacob Eisenstein"]
year: 2013
venue: "Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies"
source: "https://aclanthology.org/N13-1037/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/eisenstein-2013-what-do-about-bad-language/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/eisenstein-2013-what-do-about-bad-language/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2013](https://md.research.elamur.ai/free/en/papers/2013/) / What to do about bad language on the internet

# What to do about bad language on the internet

**Authors:** [Jacob Eisenstein](https://md.research.elamur.ai/free/en/authors/jacob-eisenstein/) · **Year:** 2013 · **Venue:** Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/N13-1037/) · [PDF](https://aclanthology.org/N13-1037.pdf) · [OpenAlex](https://openalex.org/W2101761627)

**Citations:** 319 citations (OpenAlex, 2026-10-14) · [150](https://md.research.elamur.ai/free/en/papers/eisenstein-2013-what-do-about-bad-language/cited-by/) in our library, of the 140884 papers whose bibliographies we read

## Summary
This survey asks why language on social media departs so sharply from the edited text NLP systems are trained on. It also asks whether the field's two standard responses fit what researchers in computer-mediated communication know about online writing. Those responses are normalization (mapping non-standard forms to standard ones) and domain adaptation (treating social media as a target domain). Eisenstein reviews possible explanations for non-standard writing: illiteracy, length limits, input devices, pragmatic functions, and social identity. He tests the length-limit explanation on one million English tweets. He also measures lexical similarity between several Twitter samples, political blogs, Infinite Jest and the Penn Treebank using out-of-vocabulary bigram rates. Shortened forms turn out to appear in shorter tweets, not near the 140-character cap. All social media corpora are far from the PTB, but they also differ among themselves and change over time. He argues that normalization wrongly treats one variety as the norm, and that domain adaptation wrongly treats a medium as a single domain. He proposes using author metadata to guide more flexible, socially aware adaptation.

## Key points
- Performance drops sharply on Twitter:
  - The Stanford POS tagger falls from about 97% on WSJ to about 85%.
  - The CoNLL-trained Stanford NER falls from 86% to 44% F-measure.
  - Four parsers lose accuracy by double digits.
- In a one-million-tweet dataset, messages containing ur, wit, goin, kno and bout are shorter on average than those containing the standard forms. For example, tweets with "bout" average about 74.5 characters, versus about 88.9 for "about". The gap is far larger than the one or two characters a shortening saves.
- Existing literacy studies show that writers of non-standard text usually also command formal registers. Many non-standard features correlate with age, gender, race and location, and some (ctfu, hella, finna) carry regional or social identity.
- OOV bigram rates make the Penn Treebank the clear outlier among all corpora compared.
  - Twitter subsets resemble each other most: the maximum is 33.4% between Twitter-# and Twitter-@.
  - Even this exceeds the 27.8% rate between two random Twitter samples from the same month.
  - Blog posts were no closer to the PTB than blog comments.
- Named entities in tweets were replaced with a special token using the CMU Twitter POS tagger. This keeps changing entity mentions from inflating vocabulary drift.

## Interesting ideas
- **Test a folk explanation with a simple corpus statistic.** If a constraint such as a character limit really caused a behaviour, the behaviour should cluster where the constraint binds. Checking the average length of messages that contain a form is a cheap falsification test that could be reused for many claimed causes of linguistic variation.
- **Use a cross-corpus OOV matrix as a similarity map.** One corpus supplies the dictionary and another supplies the tokens, giving an asymmetric distance measure. A baseline of two samples from the same source shows how much difference counts as large. This is a quick way to decide which source data is closest to a new target before annotating or adapting.
- **Separate subsets of a medium by usage type.** Splitting tweets that start with a hashtag from tweets that start with an @-mention shows that one platform contains distinct varieties. The same idea applies to any platform where a single model would otherwise average over very different communicative uses.
- **Mask named entities before measuring vocabulary change.** Replacing entities with a placeholder keeps measurements of language change from being dominated by shifting topics and names. This is useful for any study of lexical drift over time.
- **Use metadata as an input to adaptation, not a prediction target.** Instead of predicting who an author is from their language, models could condition on social metadata to adapt to many varieties at once. This avoids forcing all text into a single standard or a single target domain.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{eisenstein2013what,
  title = {{What to do about bad language on the internet}},
  author = {Eisenstein, Jacob},
  booktitle = {Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies},
  year = {2013},
  url = {https://aclanthology.org/N13-1037/}
}
```

- [← previous Learning Whom to Trust with MACE](https://md.research.elamur.ai/free/en/papers/hovy-2013-learning-whom-trust-mace/)
- [next → Findings of the 2013 Workshop on Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/bojar-2013-findings-2013-workshop-statistical-machine/)
- [↑ back to papers of 2013](https://md.research.elamur.ai/free/en/papers/2013/)

## References

76 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Noor Ali-Hasan and Lada Adamic. 2007. Expressing social relationships on the blog through links and comments. In Proceedings of ICWSM. [find](https://scholar.google.com/scholar?q=Noor+Ali%2DHasan+and+Lada+Adamic%2E+2007%2E+Expressing+social+relationships+on+the+blog+through+links+and+comments%2E+In+Proceedings+of+ICWSM%2E)
2. American Society of Newspaper Editors. 1999. 1999 Newsroom Census: Minority Employment Inches up in Daily Newspapers. American Society of Newspaper Editors, Reston, VA. [find](https://scholar.google.com/scholar?q=American+Society+of+Newspaper+Editors%2E+1999%2E+1999+Newsroom+Census%3A+Minority+Employment+Inches+up+in+Daily+Newspapers%2E+American+Society+of+Newspaper+Editors%2C+Reston%2C+VA%2E)
3. Jannis Androutsopoulos. 2011. Language change and digital media: a review of conceptions and evidence. In Nikolas Coupland and Tore Kristiansen, editors, Standard Languages and Language Standards in a Changing Europe. Novus, Oslo. [find](https://scholar.google.com/scholar?q=Jannis+Androutsopoulos%2E+2011%2E+Language+change+and+digital+media%3A+a+review+of+conceptions+and+evidence%2E+In+Nikolas+Coupland+and+Tore+Kristiansen%2C+editors%2C+Standard+Languages+and+Language+Standards+in+a)
4. Jacques Anis. 2007. Neography: Unconventional spelling in French SMS text messages. In Brenda Danet and Susan C. Herring, editors, The multilingual internet: Language, culture, and communication online, pages 87 – 115. Oxford University Press. [find](https://scholar.google.com/scholar?q=Jacques+Anis%2E+2007%2E+Neography%3A+Unconventional+spelling+in+French+SMS+text+messages%2E+In+Brenda+Danet+and+Susan+C%2E+Herring%2C+editors%2C+The+multilingual+internet%3A+Language%2C+culture%2C+and+communication+onlin)
5. Shlomo Argamon, Moshe Koppel, James W. Pennebaker, and Jonathan Schler. 2007. Mining the blogosphere: age, gender, and the varieties of self-expression. First Monday, 12(9). [find](https://scholar.google.com/scholar?q=Shlomo+Argamon%2C+Moshe+Koppel%2C+James+W%2E+Pennebaker%2C+and+Jonathan+Schler%2E+2007%2E+Mining+the+blogosphere%3A+age%2C+gender%2C+and+the+varieties+of+self%2Dexpression%2E+First+Monday%2C+12%289%29%2E)
6. AiTi Aw, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for SMS text normalization. In Proceedings of ACL, pages 33–40. [find](https://scholar.google.com/scholar?q=AiTi+Aw%2C+Min+Zhang%2C+Juan+Xiao%2C+and+Jian+Su%2E+2006%2E+A+phrase%2Dbased+statistical+model+for+SMS+text+normalization%2E+In+Proceedings+of+ACL%2C+pages+33%E2%80%9340%2E)
7. Lars Backstrom, Eric Sun, and Cameron Marlow. 2010. Find me if you can: improving geographical prediction with social and spatial proximity. In Proceedings of WWW, pages 61–70. [find](https://scholar.google.com/scholar?q=Lars+Backstrom%2C+Eric+Sun%2C+and+Cameron+Marlow%2E+2010%2E+Find+me+if+you+can%3A+improving+geographical+prediction+with+social+and+spatial+proximity%2E+In+Proceedings+of+WWW%2C+pages+61%E2%80%9370%2E)
8. David Bamman, Jacob Eisenstein, and Tyler Schnoebelen. 2012. Gender in twitter: Styles, stances, and social networks. Technical Report 1210.4567, arXiv, October. [find](https://scholar.google.com/scholar?q=David+Bamman%2C+Jacob+Eisenstein%2C+and+Tyler+Schnoebelen%2E+2012%2E+Gender+in+twitter%3A+Styles%2C+stances%2C+and+social+networks%2E+Technical+Report+1210%2E4567%2C+arXiv%2C+October%2E)
9. Edward Benson, Aria Haghighi, and Regina Barzilay. 2011. Event discovery in social media feeds. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Edward+Benson%2C+Aria+Haghighi%2C+and+Regina+Barzilay%2E+2011%2E+Event+discovery+in+social+media+feeds%2E+In+Proceedings+of+ACL%2E)
10. Shane Bergsma, Paul McNamee, Mossaab Bagdouri, Clayton Fink, and Theresa Wilson. 2012. Language identification for creating language-specific twitter Blog-body 47.1 47.8 49.6 [find](https://scholar.google.com/scholar?q=Shane+Bergsma%2C+Paul+McNamee%2C+Mossaab+Bagdouri%2C+Clayton+Fink%2C+and+Theresa+Wilson%2E+2012%2E+Language+identification+for+creating+language%2Dspecific+twitter+Blog%2Dbody+47%2E1+47%2E8+49%2E6)
11. Blog-comment 48.6 49.9 51.0 27.2 Infinite-Jest 54.0 56.3 54.7 49.1 53.0 PTB 63.9 66.4 66.2 48.0 48.4 55.5 30.2 48.3 64.5 47.4 61.9 71.9 collections. In Proceedings of the Second Workshop on Language in Social Media, pages 65–74, June. [find](https://scholar.google.com/scholar?q=Blog%2Dcomment+48%2E6+49%2E9+51%2E0+27%2E2+Infinite%2DJest+54%2E0+56%2E3+54%2E7+49%2E1+53%2E0+PTB+63%2E9+66%2E4+66%2E2+48%2E0+48%2E4+55%2E5+30%2E2+48%2E3+64%2E5+47%2E4+61%2E9+71%2E9+collections%2E+In+Proceedings+of+the+Second+Workshop+on+Language+i)
12. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python. O’Reilly Media, Incorporated. danah boyd and Kate Crawford. 2012. Critical questions for big data. Information, Communication & Society, 15(5):662–679, May. [find](https://scholar.google.com/scholar?q=Steven+Bird%2C+Ewan+Klein%2C+and+Edward+Loper%2E+2009%2E+Natural+language+processing+with+Python%2E+O%E2%80%99Reilly+Media%2C+Incorporated%2E+danah+boyd+and+Kate+Crawford%2E+2012%2E+Critical+questions+for+big+data%2E+Information)
13. Samuel Brody and Nicholas Diakopoulos. 2011. Cooooooooooooooollllllllllllll!!!!!!!!!!!!!!: using word lengthening to detect sentiment in microblogs. In Proceedings of EMNLP. [find](https://scholar.google.com/scholar?q=Samuel+Brody+and+Nicholas+Diakopoulos%2E+2011%2E+Cooooooooooooooollllllllllllll%21%21%21%21%21%21%21%21%21%21%21%21%21%21%3A+using+word+lengthening+to+detect+sentiment+in+microblogs%2E+In+Proceedings+of+EMNLP%2E)
14. Mary Bucholtz and Kira Hall. 2005. Identity and interaction: A sociocultural linguistic approach. Discourse studies, 7(4-5):585–614. [find](https://scholar.google.com/scholar?q=Mary+Bucholtz+and+Kira+Hall%2E+2005%2E+Identity+and+interaction%3A+A+sociocultural+linguistic+approach%2E+Discourse+studies%2C+7%284%2D5%29%3A585%E2%80%93614%2E)
15. John D. Burger and John C. Henderson. 2006. An exploration of observable features related to blogger age. In AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs. [find](https://scholar.google.com/scholar?q=John+D%2E+Burger+and+John+C%2E+Henderson%2E+2006%2E+An+exploration+of+observable+features+related+to+blogger+age%2E+In+AAAI+Spring+Symposium%3A+Computational+Approaches+to+Analyzing+Weblogs%2E)
16. John D. Burger, John C. Henderson, George Kim, and Guido Zarrella. 2011. Discriminating gender on twitter. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=John+D%2E+Burger%2C+John+C%2E+Henderson%2C+George+Kim%2C+and+Guido+Zarrella%2E+2011%2E+Discriminating+gender+on+twitter%2E+In+Proceedings+of+the+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2E) [our card](https://md.research.elamur.ai/free/en/papers/burger-2011-discriminating-gender-twitter/)
17. Monojit Choudhury, Rahul Saraf, Vijit Jain, Animesh Mukherjee, Sudeshna Sarkar, and Anupam Basu. 2007. Investigation and modeling of the structure of texting language. International Journal on Document Analysis and Recognition, 10(3):157–174. [find](https://scholar.google.com/scholar?q=Monojit+Choudhury%2C+Rahul+Saraf%2C+Vijit+Jain%2C+Animesh+Mukherjee%2C+Sudeshna+Sarkar%2C+and+Anupam+Basu%2E+2007%2E+Investigation+and+modeling+of+the+structure+of+texting+language%2E+International+Journal+on+Documen)
18. Lauren B. Collister. 2011. *-repair in online discourse. Journal of Pragmatics, 43(3):918–921, February. [find](https://scholar.google.com/scholar?q=Lauren+B%2E+Collister%2E+2011%2E+%2A%2Drepair+in+online+discourse%2E+Journal+of+Pragmatics%2C+43%283%29%3A918%E2%80%93921%2C+February%2E)
19. Lauren B. Collister. 2012. The discourse deictics ˆ and \\<-- in a world of warcraft community. Discourse, Context & Media, 1(1):9–19, March. [find](https://scholar.google.com/scholar?q=Lauren+B%2E+Collister%2E+2012%2E+The+discourse+deictics+%CB%86+and+%5C%3C%2D%2D+in+a+world+of+warcraft+community%2E+Discourse%2C+Context+%26+Media%2C+1%281%29%3A9%E2%80%9319%2C+March%2E)
20. Paul Cook and Suzanne Stevenson. 2009. An unsupervised model for text message normalization. In Proceedings of the NAACL-HLT Workshop on Computational Approaches to Linguistic Creativity, pages 71– 78. [find](https://scholar.google.com/scholar?q=Paul+Cook+and+Suzanne+Stevenson%2E+2009%2E+An+unsupervised+model+for+text+message+normalization%2E+In+Proceedings+of+the+NAACL%2DHLT+Workshop+on+Computational+Approaches+to+Linguistic+Creativity%2C+pages+71%E2%80%93+78)
21. Nikolas Coupland. 2007. Style (Key Topics in Sociolinguistics). Cambridge University Press, July. [find](https://scholar.google.com/scholar?q=Nikolas+Coupland%2E+2007%2E+Style+%28Key+Topics+in+Sociolinguistics%29%2E+Cambridge+University+Press%2C+July%2E)
22. William M. Darling, Michael J. Paul, and Fei Song. 2012. Unsupervised part-of-speech tagging in noisy and esoteric domains with a syntactic-semantic bayesian hmm. In Proceedings of EACL Workshop on Semantic Analysis in Social Media. [find](https://scholar.google.com/scholar?q=William+M%2E+Darling%2C+Michael+J%2E+Paul%2C+and+Fei+Song%2E+2012%2E+Unsupervised+part%2Dof%2Dspeech+tagging+in+noisy+and+esoteric+domains+with+a+syntactic%2Dsemantic+bayesian+hmm%2E+In+Proceedings+of+EACL+Workshop+on+Se)
23. Eli Dresner and Susan C. Herring. 2010. Functions of the non-verbal in cmc: Emoticons and illocutionary force. Communication Theory, 20(3):249–268. [find](https://scholar.google.com/scholar?q=Eli+Dresner+and+Susan+C%2E+Herring%2E+2010%2E+Functions+of+the+non%2Dverbal+in+cmc%3A+Emoticons+and+illocutionary+force%2E+Communication+Theory%2C+20%283%29%3A249%E2%80%93268%2E)
24. Michelle Drouin and Claire Davis. 2009. R u txting? is the use of text speak hurting your literacy? Journal of Literacy Research, 41(1):46–67. [find](https://scholar.google.com/scholar?q=Michelle+Drouin+and+Claire+Davis%2E+2009%2E+R+u+txting%3F+is+the+use+of+text+speak+hurting+your+literacy%3F+Journal+of+Literacy+Research%2C+41%281%29%3A46%E2%80%9367%2E)
25. John W. Du Bois. 2007. The stance triangle. In Robert Engelbretson, editor, Stancetaking in discourse, pages 139–182. John Benjamins Publishing Company, Amsterdam/Philadelphia. [find](https://scholar.google.com/scholar?q=John+W%2E+Du+Bois%2E+2007%2E+The+stance+triangle%2E+In+Robert+Engelbretson%2C+editor%2C+Stancetaking+in+discourse%2C+pages+139%E2%80%93182%2E+John+Benjamins+Publishing+Company%2C+Amsterdam%2FPhiladelphia%2E)
26. Penelope Eckert and Sally McConnell-Ginet. 2003. Language and Gender. Cambridge University Press, New York. [find](https://scholar.google.com/scholar?q=Penelope+Eckert+and+Sally+McConnell%2DGinet%2E+2003%2E+Language+and+Gender%2E+Cambridge+University+Press%2C+New+York%2E)
27. Penelope Eckert. 2000. Linguistic variation as social practice. Blackwell. [find](https://scholar.google.com/scholar?q=Penelope+Eckert%2E+2000%2E+Linguistic+variation+as+social+practice%2E+Blackwell%2E)
28. Penelope Eckert. 2008. Variation and the indexical field. Journal of Sociolinguistics, 12(4):453–476. [find](https://scholar.google.com/scholar?q=Penelope+Eckert%2E+2008%2E+Variation+and+the+indexical+field%2E+Journal+of+Sociolinguistics%2C+12%284%29%3A453%E2%80%93476%2E)
29. Jacob Eisenstein, Brendan O’Connor, Noah A. Smith, and Eric P. Xing. 2010. A latent variable model for geographic lexical variation. In Proceedings of EMNLP. [find](https://scholar.google.com/scholar?q=Jacob+Eisenstein%2C+Brendan+O%E2%80%99Connor%2C+Noah+A%2E+Smith%2C+and+Eric+P%2E+Xing%2E+2010%2E+A+latent+variable+model+for+geographic+lexical+variation%2E+In+Proceedings+of+EMNLP%2E)
30. Jacob Eisenstein, Noah A. Smith, and Eric P. Xing. 2011. Discovering sociolinguistic associations with structured sparsity. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Jacob+Eisenstein%2C+Noah+A%2E+Smith%2C+and+Eric+P%2E+Xing%2E+2011%2E+Discovering+sociolinguistic+associations+with+structured+sparsity%2E+In+Proceedings+of+ACL%2E)
31. Jacob Eisenstein, Brendan O’Connor, Noah A. Smith, and Eric P. Xing. 2012. Mapping the geographical diffusion of new words. Technical Report 1210.5268, arXiv. [find](https://scholar.google.com/scholar?q=Jacob+Eisenstein%2C+Brendan+O%E2%80%99Connor%2C+Noah+A%2E+Smith%2C+and+Eric+P%2E+Xing%2E+2012%2E+Mapping+the+geographical+diffusion+of+new+words%2E+Technical+Report+1210%2E5268%2C+arXiv%2E)
32. Jacob Eisenstein. 2013. Phonological factors in social media writing. In Proceedings of the NAACL Workshop on Language Analysis in Social Media. [find](https://scholar.google.com/scholar?q=Jacob+Eisenstein%2E+2013%2E+Phonological+factors+in+social+media+writing%2E+In+Proceedings+of+the+NAACL+Workshop+on+Language+Analysis+in+Social+Media%2E)
33. Tim Finin, Will Murnane, Anand Karandikar, Nicholas Keller, Justin Martineau, and Mark Dredze. 2010. Annotating named entities in twitter data with crowdsourcing. In Proceedings of the NAACL HLT Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk. [find](https://scholar.google.com/scholar?q=Tim+Finin%2C+Will+Murnane%2C+Anand+Karandikar%2C+Nicholas+Keller%2C+Justin+Martineau%2C+and+Mark+Dredze%2E+2010%2E+Annotating+named+entities+in+twitter+data+with+crowdsourcing%2E+In+Proceedings+of+the+NAACL+HLT+Works)
34. Jenny R. Finkel, Trond Grenager, and Christopher Manning. 2005. Incorporating non-local information into information extraction systems by gibbs sampling. In Proceedings of ACL, pages 363–370. [find](https://scholar.google.com/scholar?q=Jenny+R%2E+Finkel%2C+Trond+Grenager%2C+and+Christopher+Manning%2E+2005%2E+Incorporating+non%2Dlocal+information+into+information+extraction+systems+by+gibbs+sampling%2E+In+Proceedings+of+ACL%2C+pages+363%E2%80%93370%2E) [our card](https://md.research.elamur.ai/free/en/papers/finkel-2005-incorporating-non-local-information-into/)
35. Jennifer Foster, Ozlem Cetinoglu, Joachim Wagner, Joseph Le Roux, Joakim Nivre, Deirdre Hogan, and Josef van Genabith. 2011. From news to comment: Resources and benchmarks for parsing the language of web 2.0. In Proceedings of IJCNLP. [find](https://scholar.google.com/scholar?q=Jennifer+Foster%2C+Ozlem+Cetinoglu%2C+Joachim+Wagner%2C+Joseph+Le+Roux%2C+Joakim+Nivre%2C+Deirdre+Hogan%2C+and+Josef+van+Genabith%2E+2011%2E+From+news+to+comment%3A+Resources+and+benchmarks+for+parsing+the+language+of+)
36. Kevin Gimpel, Nathan Schneider, Brendan O’Connor, Dipanjan Das, Daniel Mills, Jacob Eisenstein, Michael Heilman, Dani Yogatama, Jeffrey Flanigan, and Noah A. Smith. 2011. Part-of-speech tagging for twitter: annotation, features, and experiments. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Kevin+Gimpel%2C+Nathan+Schneider%2C+Brendan+O%E2%80%99Connor%2C+Dipanjan+Das%2C+Daniel+Mills%2C+Jacob+Eisenstein%2C+Michael+Heilman%2C+Dani+Yogatama%2C+Jeffrey+Flanigan%2C+and+Noah+A%2E+Smith%2E+2011%2E+Part%2Dof%2Dspeech+tagging+for+tw) [our card](https://md.research.elamur.ai/free/en/papers/gimpel-2011-part-speech-tagging-twitter-annotation/)
37. Scott A. Golder and Michael W. Macy. 2011. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science, 333(6051):1878–1881, September. [find](https://scholar.google.com/scholar?q=Scott+A%2E+Golder+and+Michael+W%2E+Macy%2E+2011%2E+Diurnal+and+seasonal+mood+vary+with+work%2C+sleep%2C+and+daylength+across+diverse+cultures%2E+Science%2C+333%286051%29%3A1878%E2%80%931881%2C+September%2E)
38. Stephan Gouws, Dirk Hovy, and Donald Metzler. 2011a. Unsupervised mining of lexical variants from noisy text. In Proceedings of the First workshop on Unsupervised Learning in NLP, pages 82–90, July. [find](https://scholar.google.com/scholar?q=Stephan+Gouws%2C+Dirk+Hovy%2C+and+Donald+Metzler%2E+2011a%2E+Unsupervised+mining+of+lexical+variants+from+noisy+text%2E+In+Proceedings+of+the+First+workshop+on+Unsupervised+Learning+in+NLP%2C+pages+82%E2%80%9390%2C+July%2E)
39. Stephan Gouws, Donald Metzler, Congxing Cai, and Eduard Hovy. 2011b. Contextual bearing on linguistic variation in social media. In Proceedings of the ACL Workshop on Language in Social Media. [find](https://scholar.google.com/scholar?q=Stephan+Gouws%2C+Donald+Metzler%2C+Congxing+Cai%2C+and+Eduard+Hovy%2E+2011b%2E+Contextual+bearing+on+linguistic+variation+in+social+media%2E+In+Proceedings+of+the+ACL+Workshop+on+Language+in+Social+Media%2E)
40. Lisa Green. 2002. African American English. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Lisa+Green%2E+2002%2E+African+American+English%2E+Cambridge+University+Press%2E)
41. Bo Han and Timothy Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a\# twitter. In Proceedings of ACL, volume 1. [find](https://scholar.google.com/scholar?q=Bo+Han+and+Timothy+Baldwin%2E+2011%2E+Lexical+normalisation+of+short+text+messages%3A+Makn+sens+a%5C%23+twitter%2E+In+Proceedings+of+ACL%2C+volume+1%2E) [our card](https://md.research.elamur.ai/free/en/papers/han-2011-lexical-normalisation-short-text-messages/)
42. Bo Han, Paul Cook, and Timothy Baldwin. 2012. Automatically constructing a normalisation dictionary for microblogs. In Proceedings of EMNLP. [find](https://scholar.google.com/scholar?q=Bo+Han%2C+Paul+Cook%2C+and+Timothy+Baldwin%2E+2012%2E+Automatically+constructing+a+normalisation+dictionary+for+microblogs%2E+In+Proceedings+of+EMNLP%2E)
43. Yuheng Hu, Kartik Talamadupula, and Subbarao Kambhampati. 2013. Dude, srsly?: The surprisingly formal nature of twitter’s language. In Proceedings of ICWSM. [find](https://scholar.google.com/scholar?q=Yuheng+Hu%2C+Kartik+Talamadupula%2C+and+Subbarao+Kambhampati%2E+2013%2E+Dude%2C+srsly%3F%3A+The+surprisingly+formal+nature+of+twitter%E2%80%99s+language%2E+In+Proceedings+of+ICWSM%2E)
44. Barbara Johnstone, Jennifer Andrus, and Andrew E Danielson. 2006. Mobility, indexicality, and the enregisterment of pittsburghese. Journal of English Linguistics, 34(2):77–104. [find](https://scholar.google.com/scholar?q=Barbara+Johnstone%2C+Jennifer+Andrus%2C+and+Andrew+E+Danielson%2E+2006%2E+Mobility%2C+indexicality%2C+and+the+enregisterment+of+pittsburghese%2E+Journal+of+English+Linguistics%2C+34%282%29%3A77%E2%80%93104%2E)
45. Lucy Jones. 2010. The changing face of spelling on the internet. Technical report, The English Spelling Society. [find](https://scholar.google.com/scholar?q=Lucy+Jones%2E+2010%2E+The+changing+face+of+spelling+on+the+internet%2E+Technical+report%2C+The+English+Spelling+Society%2E)
46. William Labov. 1972. Sociolinguistic patterns. Philadelphia: University of Pennsylvania Press. [find](https://scholar.google.com/scholar?q=William+Labov%2E+1972%2E+Sociolinguistic+patterns%2E+Philadelphia%3A+University+of+Pennsylvania+Press%2E)
47. William Labov. 2001. Principles of linguistic change. Vol.2 : Social factors. Blackwell Publishers, Oxford. [find](https://scholar.google.com/scholar?q=William+Labov%2E+2001%2E+Principles+of+linguistic+change%2E+Vol%2E2+%3A+Social+factors%2E+Blackwell+Publishers%2C+Oxford%2E)
48. Fei Liu, Fuliang Weng, Bingqing Wang, and Yang Liu. 2011a. Insertion, deletion, or substitution? normalizing text messages without pre-categorization nor supervision. In Proceedings of ACL, pages 71–76. [find](https://scholar.google.com/scholar?q=Fei+Liu%2C+Fuliang+Weng%2C+Bingqing+Wang%2C+and+Yang+Liu%2E+2011a%2E+Insertion%2C+deletion%2C+or+substitution%3F+normalizing+text+messages+without+pre%2Dcategorization+nor+supervision%2E+In+Proceedings+of+ACL%2C+pages+71%E2%80%937)
49. Xiaohua Liu, Shaodian Zhang, Furu Wei, and Ming Zhou. 2011b. Recognizing named entities in tweets. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Xiaohua+Liu%2C+Shaodian+Zhang%2C+Furu+Wei%2C+and+Ming+Zhou%2E+2011b%2E+Recognizing+named+entities+in+tweets%2E+In+Proceedings+of+ACL%2E)
50. Xiaohua Liu, Ming Zhou, Xiangyang Zhou, Zhongyang Fu, and Furu Wei. 2012. Joint inference of named entity recognition and normalization for tweets. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Xiaohua+Liu%2C+Ming+Zhou%2C+Xiangyang+Zhou%2C+Zhongyang+Fu%2C+and+Furu+Wei%2E+2012%2E+Joint+inference+of+named+entity+recognition+and+normalization+for+tweets%2E+In+Proceedings+of+ACL%2E)
51. David McClosky, Eugene Charniak, and Mark Johnson. 2010. Automatic domain adaptation for parsing. In Proceedings of NAACL, pages 28–36, June. [find](https://scholar.google.com/scholar?q=David+McClosky%2C+Eugene+Charniak%2C+and+Mark+Johnson%2E+2010%2E+Automatic+domain+adaptation+for+parsing%2E+In+Proceedings+of+NAACL%2C+pages+28%E2%80%9336%2C+June%2E)
52. Robert Munro and Christopher D. Manning. 2012. Short message communications: users, topics, and in-language processing. In Proceedings of the 2nd ACM Symposium on Computing for Development. [find](https://scholar.google.com/scholar?q=Robert+Munro+and+Christopher+D%2E+Manning%2E+2012%2E+Short+message+communications%3A+users%2C+topics%2C+and+in%2Dlanguage+processing%2E+In+Proceedings+of+the+2nd+ACM+Symposium+on+Computing+for+Development%2E)
53. Mor Naaman, Hila Becker, and Luis Gravano. 2011. Hip and trendy: Characterizing emerging trends on twitter. Journal of the American Society for Information Science and Technology, 62(5):902–918. [find](https://scholar.google.com/scholar?q=Mor+Naaman%2C+Hila+Becker%2C+and+Luis+Gravano%2E+2011%2E+Hip+and+trendy%3A+Characterizing+emerging+trends+on+twitter%2E+Journal+of+the+American+Society+for+Information+Science+and+Technology%2C+62%285%29%3A902%E2%80%93918%2E)
54. Olutobi Owoputi, Brendan O’Connor, Chris Dyer, Kevin Gimpel, Nathan Schneider, and Noah A. Smith. 2013. Improved part-of-speech tagging for online conversational text with word clusters. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Olutobi+Owoputi%2C+Brendan+O%E2%80%99Connor%2C+Chris+Dyer%2C+Kevin+Gimpel%2C+Nathan+Schneider%2C+and+Noah+A%2E+Smith%2E+2013%2E+Improved+part%2Dof%2Dspeech+tagging+for+online+conversational+text+with+word+clusters%2E+In+Proceeding) [our card](https://md.research.elamur.ai/free/en/papers/owoputi-2013-improved-part-speech-tagging-online/)
55. John C. Paolillo. 1996. Language choice on soc.culture.punjab. Electronic Journal of Communication/La Revue Electronique de Communication, 6(3). [find](https://scholar.google.com/scholar?q=John+C%2E+Paolillo%2E+1996%2E+Language+choice+on+soc%2Eculture%2Epunjab%2E+Electronic+Journal+of+Communication%2FLa+Revue+Electronique+de+Communication%2C+6%283%29%2E)
56. John C. Paolillo. 1999. The virtual speech community: Social network and language variation on irc. Journal of Computer-Mediated Communication, 4(4):0. [find](https://scholar.google.com/scholar?q=John+C%2E+Paolillo%2E+1999%2E+The+virtual+speech+community%3A+Social+network+and+language+variation+on+irc%2E+Journal+of+Computer%2DMediated+Communication%2C+4%284%29%3A0%2E)
57. John C. Paolillo. 2001. Language variation on internet relay chat: A social network approach. Journal of Sociolinguistics, 5(2):180–213. [find](https://scholar.google.com/scholar?q=John+C%2E+Paolillo%2E+2001%2E+Language+variation+on+internet+relay+chat%3A+A+social+network+approach%2E+Journal+of+Sociolinguistics%2C+5%282%29%3A180%E2%80%93213%2E)
58. Slav Petrov and Ryan McDonald. 2012. Overview of the 2012 shared task on parsing the web. In Notes of the First Workshop on Syntactic Analysis of Non-Canonical Language (SANCL). [find](https://scholar.google.com/scholar?q=Slav+Petrov+and+Ryan+McDonald%2E+2012%2E+Overview+of+the+2012+shared+task+on+parsing+the+web%2E+In+Notes+of+the+First+Workshop+on+Syntactic+Analysis+of+Non%2DCanonical+Language+%28SANCL%29%2E)
59. Daniel Ramage, Sue Dumais, and D. Liebling. 2010. Characterizing microblogs with topic models. In Proceedings of ICWSM. [find](https://scholar.google.com/scholar?q=Daniel+Ramage%2C+Sue+Dumais%2C+and+D%2E+Liebling%2E+2010%2E+Characterizing+microblogs+with+topic+models%2E+In+Proceedings+of+ICWSM%2E)
60. Delip Rao, David Yarowsky, Abhishek Shreevats, and Manaswi Gupta. 2010. Classifying latent user attributes in twitter. In Proceedings of Workshop on Search and mining user-generated contents. [find](https://scholar.google.com/scholar?q=Delip+Rao%2C+David+Yarowsky%2C+Abhishek+Shreevats%2C+and+Manaswi+Gupta%2E+2010%2E+Classifying+latent+user+attributes+in+twitter%2E+In+Proceedings+of+Workshop+on+Search+and+mining+user%2Dgenerated+contents%2E)
61. Alan Ritter, Colin Cherry, and Bill Dolan. 2010. Unsupervised modeling of twitter conversations. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Alan+Ritter%2C+Colin+Cherry%2C+and+Bill+Dolan%2E+2010%2E+Unsupervised+modeling+of+twitter+conversations%2E+In+Proceedings+of+NAACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/ritter-2010-unsupervised-modeling-twitter-conversations/)
62. Alan Ritter, Sam Clark, Mausam, and Oren Etzioni. 2011. Named entity recognition in tweets: an experimental study. In Proceedings of EMNLP. [find](https://scholar.google.com/scholar?q=Alan+Ritter%2C+Sam+Clark%2C+Mausam%2C+and+Oren+Etzioni%2E+2011%2E+Named+entity+recognition+in+tweets%3A+an+experimental+study%2E+In+Proceedings+of+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/ritter-2011-named-entity-recognition-tweets-experimental/)
63. Sara Rosenthal and Kathleen McKeown. 2011. Age prediction in blogs: A study of style, content, and online behavior in pre- and Post-Social media generations. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Sara+Rosenthal+and+Kathleen+McKeown%2E+2011%2E+Age+prediction+in+blogs%3A+A+study+of+style%2C+content%2C+and+online+behavior+in+pre%2D+and+Post%2DSocial+media+generations%2E+In+Proceedings+of+ACL%2E)
64. Takeshi Sakaki, Makoto Okazaki, and Yutaka Matsuo. 2010. Earthquake shakes twitter users: real-time event detection by social sensors. In Proceedings of WWW, pages 851–860. [find](https://scholar.google.com/scholar?q=Takeshi+Sakaki%2C+Makoto+Okazaki%2C+and+Yutaka+Matsuo%2E+2010%2E+Earthquake+shakes+twitter+users%3A+real%2Dtime+event+detection+by+social+sensors%2E+In+Proceedings+of+WWW%2C+pages+851%E2%80%93860%2E)
65. Christina Sauper, Aria Haghighi, and Regina Barzilay. 2011. Content models with attitude. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Christina+Sauper%2C+Aria+Haghighi%2C+and+Regina+Barzilay%2E+2011%2E+Content+models+with+attitude%2E+In+Proceedings+of+ACL%2E)
66. Beaux Sharifi, Mark-Anthony Hutton, and Jugal Kalita. 2010. Summarizing microblogs automatically. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Beaux+Sharifi%2C+Mark%2DAnthony+Hutton%2C+and+Jugal+Kalita%2E+2010%2E+Summarizing+microblogs+automatically%2E+In+Proceedings+of+NAACL%2E)
67. Aaron Smith and Joanna Brewer. 2012. Twitter use 2012. Technical report, Pew Research Center, May. [find](https://scholar.google.com/scholar?q=Aaron+Smith+and+Joanna+Brewer%2E+2012%2E+Twitter+use+2012%2E+Technical+report%2C+Pew+Research+Center%2C+May%2E)
68. Richard Sproat, Alan W Black, Stanley Chen, Shankar Kumar, Mari Ostendorf, and Christopher Richards. 2001. Normalization of non-standard words. Computer Speech & Language, 15(3):287–333. [find](https://scholar.google.com/scholar?q=Richard+Sproat%2C+Alan+W+Black%2C+Stanley+Chen%2C+Shankar+Kumar%2C+Mari+Ostendorf%2C+and+Christopher+Richards%2E+2001%2E+Normalization+of+non%2Dstandard+words%2E+Computer+Speech+%26+Language%2C+15%283%29%3A287%E2%80%93333%2E)
69. Sali A. Tagliamonte and Derek Denis. 2008. Linguistic ruin? lol! instant messaging and teen language. American Speech, 83(1):3–34, March. [find](https://scholar.google.com/scholar?q=Sali+A%2E+Tagliamonte+and+Derek+Denis%2E+2008%2E+Linguistic+ruin%3F+lol%21+instant+messaging+and+teen+language%2E+American+Speech%2C+83%281%29%3A3%E2%80%9334%2C+March%2E)
70. Mike Thelwall. 2009. Homophily in MySpace. J. Am. Soc. Inf. Sci., 60(2):219–231. [find](https://scholar.google.com/scholar?q=Mike+Thelwall%2E+2009%2E+Homophily+in+MySpace%2E+J%2E+Am%2E+Soc%2E+Inf%2E+Sci%2E%2C+60%282%29%3A219%E2%80%93231%2E)
71. Crispin Thurlow. 2006. From statistical panic to moral panic: The metadiscursive construction and popular exaggeration of new media language in the print media. J. Computer-Mediated Communication, pages 667–701. [find](https://scholar.google.com/scholar?q=Crispin+Thurlow%2E+2006%2E+From+statistical+panic+to+moral+panic%3A+The+metadiscursive+construction+and+popular+exaggeration+of+new+media+language+in+the+print+media%2E+J%2E+Computer%2DMediated+Communication%2C+pag)
72. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Kristina+Toutanova%2C+Dan+Klein%2C+Christopher+D%2E+Manning%2C+and+Yoram+Singer%2E+2003%2E+Feature%2Drich+part%2Dof%2Dspeech+tagging+with+a+cyclic+dependency+network%2E+In+Proceedings+of+NAACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/toutanova-2003-feature-rich-part-speech-tagging/)
73. Byron Wallace. 2012. Multiple narrative disentanglement: Unraveling infinite jest. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Byron+Wallace%2E+2012%2E+Multiple+narrative+disentanglement%3A+Unraveling+infinite+jest%2E+In+Proceedings+of+NAACL%2E)
74. Joseph B. Walther and Kyle P. D’Addario. 2001. The impacts of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3):324–347. [find](https://scholar.google.com/scholar?q=Joseph+B%2E+Walther+and+Kyle+P%2E+D%E2%80%99Addario%2E+2001%2E+The+impacts+of+emoticons+on+message+interpretation+in+computer%2Dmediated+communication%2E+Social+Science+Computer+Review%2C+19%283%29%3A324%E2%80%93347%2E)
75. Benjamin Wing and Jason Baldridge. 2011. Simple supervised document geolocation with geodesic grids. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Benjamin+Wing+and+Jason+Baldridge%2E+2011%2E+Simple+supervised+document+geolocation+with+geodesic+grids%2E+In+Proceedings+of+ACL%2E)
76. Tae Yano, William W. Cohen, and Noah A. Smith. 2009. Predicting response to political blog posts with topic models. In Proceedings of NAACL. [find](https://scholar.google.com/scholar?q=Tae+Yano%2C+William+W%2E+Cohen%2C+and+Noah+A%2E+Smith%2E+2009%2E+Predicting+response+to+political+blog+posts+with+topic+models%2E+In+Proceedings+of+NAACL%2E)