---
title: "The Illinois-Columbia System in the CoNLL-2014 Shared Task"
description: "This paper presents the Illinois-Columbia entry to the CoNLL-2014 shared task on correcting… 18 references, cited by 30 papers here."
authors: ["Alla Rozovskaya", "Kai-Wei Chang", "Mark Sammons", "Dan Roth", "Nizar Habash"]
year: 2014
venue: "Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task"
source: "https://aclanthology.org/W14-1704/"
doi: "10.3115/v1/w14-1704"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/rozovskaya-2014-illinois-columbia-system-conll-2014/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rozovskaya-2014-illinois-columbia-system-conll-2014/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2014](https://md.research.elamur.ai/free/en/papers/2014/page/2/) / The Illinois-Columbia System in the CoNLL-2014 Shared Task

# The Illinois-Columbia System in the CoNLL-2014 Shared Task

**Authors:** [Alla Rozovskaya](https://md.research.elamur.ai/free/en/authors/alla-rozovskaya/), [Kai-Wei Chang](https://md.research.elamur.ai/free/en/authors/kai-wei-chang/), [Mark Sammons](https://md.research.elamur.ai/free/en/authors/mark-sammons/), [Dan Roth](https://md.research.elamur.ai/free/en/authors/dan-roth/) and [Nizar Habash](https://md.research.elamur.ai/free/en/authors/nizar-habash/) · **Year:** 2014 · **Venue:** [Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task](https://md.research.elamur.ai/free/en/venues/conll/) ([CoNLL 2014](https://md.research.elamur.ai/free/en/venues/conll/2014/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W14-1704/) · [PDF](https://aclanthology.org/W14-1704.pdf) · [DOI 10.3115/v1/w14-1704](https://doi.org/10.3115/v1/w14-1704) · [OpenAlex](https://openalex.org/W2127672659)

**Citations:** 64 citations (OpenAlex, 2026-10-14) · [30](https://md.research.elamur.ai/free/en/papers/rozovskaya-2014-illinois-columbia-system-conll-2014/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
This paper presents the Illinois-Columbia entry to the CoNLL-2014 shared task on correcting grammatical mistakes in essays by non-native English writers. Unlike the 2013 edition, the 2014 task evaluated every error type in the data. Errors are rare even in learner text, so systems struggle to find them without many false alarms. The authors started from the Illinois system that won CoNLL-2013. That system uses separate confusion-set classifiers for articles, prepositions, noun number, verb agreement and verb form. Some classifiers are trained on learner text with the Averaged Perceptron, and others on native n-gram counts with Naïve Bayes. The team made three additions: new modules for word form, punctuation/capitalization and tone errors; combined models that merge learner-trained and native-trained classifiers; and joint inference to handle errors that interact. Training used the NUCLE corpus, and the CoNLL-2013 test set served as development data. The system placed second on the original test annotations and first on the revised ones. This shows that the error-specific classifier design can be extended to broad error coverage.

## Key points
- **Data:** about 1.2M words of teacher-corrected NUCLE essays from the National University of Singapore, using 28 error categories. Roughly 30K words from the CoNLL-2013 test set served as development data.
- **Error sparsity:** only about 2% of prepositions in the training data are wrong. Error inflation (adding artificial errors to training data) was used to raise recall.
- **Development F0.5 gains:**
  - The baseline scored 33.17.
  - Model combination raised this to 34.92.
  - New error modules raised it to 37.09.
  - Joint inference gave a final 37.13.
- **Test results:**
  - Original annotations: P 41.78, R 24.88, F0.5 36.79.
  - Revised annotations: P 52.44, R 29.89, F0.5 45.57.
- **Coverage gaps:** the system does not handle wrong collocation (Wci) or local redundancy (Rloc-). The error analysis points to cascading POS-tagging mistakes and sentences with multiple errors as frequent sources of failure.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Columbia University](https://md.research.elamur.ai/free/en/universities/columbia-university/) — University, New York, United States · 254 works · 56,747 citations
- [University of Illinois Urbana-Champaign](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) — University, Urbana, United States · 209 works · 71,394 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

## Cite

Cite as: Alla Rozovskaya, Kai-Wei Chang, Mark Sammons, Dan Roth and Nizar Habash. 2014. The Illinois-Columbia System in the CoNLL-2014 Shared Task. Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{rozovskaya2014illinois,
  title = {{The Illinois-Columbia System in the CoNLL-2014 Shared Task}},
  author = {Alla Rozovskaya, Kai-Wei Chang, Mark Sammons, Dan Roth and Nizar Habash},
  booktitle = {Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task},
  year = {2014},
  doi = {10.3115/v1/w14-1704},
  url = {https://doi.org/10.3115/v1/w14-1704}
}
```

- [← previous Building a Corpus for Palestinian Arabic: a Preliminary Study](https://md.research.elamur.ai/free/en/papers/jarrar-2014-building-corpus-palestinian-arabic-preliminary/)
- [next → A Conventional Orthography for Tunisian Arabic](https://md.research.elamur.ai/free/en/papers/zribi-2014-conventional-orthography-tunisian-arabic/)
- [↑ back to papers of 2014](https://md.research.elamur.ai/free/en/papers/2014/page/2/)

## References

18 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. T. Brants and A. Franz. 2006. Web 1T 5-gram Version 1. Linguistic Data Consortium, Philadelphia, PA. [find](https://scholar.google.com/scholar?q=T%2E+Brants+and+A%2E+Franz%2E+2006%2E+Web+1T+5%2Dgram+Version+1%2E+Linguistic+Data+Consortium%2C+Philadelphia%2C+PA%2E)
2. A. J. Carlson, J. Rosen, and D. Roth. 2001. Scaling up context sensitive text correction. In IAAI. [find](https://scholar.google.com/scholar?q=A%2E+J%2E+Carlson%2C+J%2E+Rosen%2C+and+D%2E+Roth%2E+2001%2E+Scaling+up+context+sensitive+text+correction%2E+In+IAAI%2E)
3. D. Dahlmeier and H.T. Ng. 2012. Better evaluation for grammatical error correction. In NAACL, pages 568–572, Montréal, Canada, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=D%2E+Dahlmeier+and+H%2ET%2E+Ng%2E+2012%2E+Better+evaluation+for+grammatical+error+correction%2E+In+NAACL%2C+pages+568%E2%80%93572%2C+Montre%CC%81al%2C+Canada%2C+June%2E+Association+for+Computational+Linguistics%2E)
4. D. Dahlmeier, H.T. Ng, and S.M. Wu. 2013. [Building a large annotated corpus of learner english: The nus corpus of learner english](https://md.research.elamur.ai/free/en/papers/dahlmeier-2013-building-large-annotated-corpus-learner/). In Proc. of the NAACL HLT 2013 Eighth Workshop on Innovative Use of NLP for Building Educational Applications, Atlanta, Georgia, June. Association for Computational Ling…
5. R. Dale and A. Kilgarriff. 2011. [find](https://scholar.google.com/scholar?q=R%2E+Dale+and+A%2E+Kilgarriff%2E+2011%2E)
6. [Helping Our Own: The HOO 2011 pilot shared task](https://md.research.elamur.ai/free/en/papers/dale-2011-helping-our-own-hoo-2011/). In Proceedings of the 13th European Workshop on Natural Language Generation.
7. R. Dale, I. Anisimoff, and G. Narroway. 2012. A report on the preposition and determiner error correction shared task. In Proc. of the NAACL HLT 2012 Seventh Workshop on Innovative Use of NLP for Building Educational Applications, Montreal, Canada, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=R%2E+Dale%2C+I%2E+Anisimoff%2C+and+G%2E+Narroway%2E+2012%2E+A+report+on+the+preposition+and+determiner+error+correction+shared+task%2E+In+Proc%2E+of+the+NAACL+HLT+2012+Seventh+Workshop+on+Innovative+Use+of+NLP+for+Buil)
8. Marie-Catherine de Marneffe, Anna N. Rafferty, and Christopher D. Manning. 2008. [Finding contradictions in text](https://md.research.elamur.ai/free/en/papers/marneffe-2008-finding-contradictions-text/). In ACL.
9. Yoav Freund and Robert E. Schapire. 1996. Experiments with a new boosting algorithm. In Proc. 13th International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Yoav+Freund+and+Robert+E%2E+Schapire%2E+1996%2E+Experiments+with+a+new+boosting+algorithm%2E+In+Proc%2E+13th+International+Conference+on+Machine+Learning%2E)
10. A. R. Golding and D. Roth. 1999. A Winnow based approach to context-sensitive spelling correction. Machine Learning. [find](https://scholar.google.com/scholar?q=A%2E+R%2E+Golding+and+D%2E+Roth%2E+1999%2E+A+Winnow+based+approach+to+context%2Dsensitive+spelling+correction%2E+Machine+Learning%2E)
11. H.T. Ng, S.M. Wu, Y. Wu, C. Hadiwinoto, and J. Tetreault. 2013. The conll-2013 shared task on grammatical error correction. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task, pages 1–12, Sofia, Bulgaria, August. Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=H%2ET%2E+Ng%2C+S%2EM%2E+Wu%2C+Y%2E+Wu%2C+C%2E+Hadiwinoto%2C+and+J%2E+Tetreault%2E+2013%2E+The+conll%2D2013+shared+task+on+grammatical+error+correction%2E+In+Proceedings+of+the+Seventeenth+Conference+on+Computational+Natural+Langua)
12. H. T. Ng, S. M. Wu, T. Briscoe, C. Hadiwinoto, R. H. Susanto, and C. Bryant. 2014. The CoNLL-2014 shared task on grammatical error correction. In Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task, Baltimore, Maryland, USA, June. Association for Computat… [find](https://scholar.google.com/scholar?q=H%2E+T%2E+Ng%2C+S%2E+M%2E+Wu%2C+T%2E+Briscoe%2C+C%2E+Hadiwinoto%2C+R%2E+H%2E+Susanto%2C+and+C%2E+Bryant%2E+2014%2E+The+CoNLL%2D2014+shared+task+on+grammatical+error+correction%2E+In+Proceedings+of+the+Eighteenth+Conference+on+Computatio)
13. V. Punyakanok and D. Roth. 2001. The use of classifiers in sequential inference. In NIPS. [find](https://scholar.google.com/scholar?q=V%2E+Punyakanok+and+D%2E+Roth%2E+2001%2E+The+use+of+classifiers+in+sequential+inference%2E+In+NIPS%2E)
14. A. Rozovskaya and D. Roth. 2011. Algorithm selection and model adaptation for esl correction tasks. In ACL. [find](https://scholar.google.com/scholar?q=A%2E+Rozovskaya+and+D%2E+Roth%2E+2011%2E+Algorithm+selection+and+model+adaptation+for+esl+correction+tasks%2E+In+ACL%2E)
15. A. Rozovskaya and D. Roth. 2013. Joint learning and inference for grammatical error correction. In EMNLP, 10. [find](https://scholar.google.com/scholar?q=A%2E+Rozovskaya+and+D%2E+Roth%2E+2013%2E+Joint+learning+and+inference+for+grammatical+error+correction%2E+In+EMNLP%2C+10%2E)
16. A. Rozovskaya, M. Sammons, and D. Roth. 2012. The UI system in the HOO 2012 shared task on error correction. In Proc. of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) Workshop on Innovative Use of NLP for Building Educational Application… [find](https://scholar.google.com/scholar?q=A%2E+Rozovskaya%2C+M%2E+Sammons%2C+and+D%2E+Roth%2E+2012%2E+The+UI+system+in+the+HOO+2012+shared+task+on+error+correction%2E+In+Proc%2E+of+the+Annual+Conference+of+the+North+American+Chapter+of+the+Association+for+Comp)
17. A. Rozovskaya, K.-W. Chang, M. Sammons, and D. Roth. 2013. The University of Illinois system in the CoNLL-2013 shared task. In CoNLL Shared Task. [find](https://scholar.google.com/scholar?q=A%2E+Rozovskaya%2C+K%2E%2DW%2E+Chang%2C+M%2E+Sammons%2C+and+D%2E+Roth%2E+2013%2E+The+University+of+Illinois+system+in+the+CoNLL%2D2013+shared+task%2E+In+CoNLL+Shared+Task%2E)
18. A. Rozovskaya, D. Roth, and V. Srikumar. 2014. Correcting grammatical verb errors. In EACL. [find](https://scholar.google.com/scholar?q=A%2E+Rozovskaya%2C+D%2E+Roth%2C+and+V%2E+Srikumar%2E+2014%2E+Correcting+grammatical+verb+errors%2E+In+EACL%2E)

*Updated 29 October 2026*