---
title: "How Furiously Can Colorless Green Ideas Sleep? Sentence"
description: "The paper examines how surrounding text shapes human judgments of sentence naturalness, and… 50 references, cited by 28 papers here."
authors: ["Jey Han Lau", "Carlos Armendariz", "Shalom Lappin", "Matthew Purver", "Chang Shu"]
year: 2020
venue: "Transactions of the Association for Computational Linguistics"
source: "https://aclanthology.org/2020.tacl-1.20/"
doi: "10.1162/tacl_a_00315"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/lau-2020-how-furiously-can-colorless-green/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/lau-2020-how-furiously-can-colorless-green/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/6/) / How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context

# How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context

**Authors:** [Jey Han Lau](https://md.research.elamur.ai/free/en/authors/jey-han-lau/), Carlos Armendariz, [Shalom Lappin](https://md.research.elamur.ai/free/en/authors/shalom-lappin/), [Matthew Purver](https://md.research.elamur.ai/free/en/authors/matthew-purver/) and [Chang Shu](https://md.research.elamur.ai/free/en/authors/chang-shu/) · **Year:** 2020 · **Venue:** [Transactions of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/tacl/) ([Transactions of the Association for Computational Linguistics (TACL) 2020](https://md.research.elamur.ai/free/en/venues/tacl/2020/)) · **Publisher:** [The MIT Press](https://md.research.elamur.ai/free/en/publishers/the-mit-press/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.tacl-1.20/) · [PDF](https://aclanthology.org/2020.tacl-1.20.pdf) · [DOI 10.1162/tacl\_a\_00315](https://doi.org/10.1162/tacl_a_00315) · [OpenAlex](https://openalex.org/W3035807844)

**Citations:** 41 citations (OpenAlex, 2026-10-14) · [28](https://md.research.elamur.ai/free/en/papers/lau-2020-how-furiously-can-colorless-green/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper examines how surrounding text shapes human judgments of sentence naturalness, and whether unsupervised language models can predict those judgments. The authors took 50 English Wikipedia sentences and created degraded variants with round-trip machine translation using Moses. They then collected crowdsourced ratings on Amazon Mechanical Turk under three conditions: the sentence alone, the sentence after its real three-sentence preceding context, and the sentence after an unrelated passage from another article. A topic-identification step ensured that workers actually read the context.

Context of either kind compressed the ratings: weak sentences scored higher and strong ones lower. The authors attribute this to cognitive load. Real context also raised scores across the board compared with random context, which points to a separate discourse coherence effect.

In the modeling experiments, bidirectional transformers such as BERT clearly beat left-to-right recurrent models. The strongest model reached roughly human-level agreement, setting a new state of the art for unsupervised acceptability prediction. This questions whether left-to-right processing is the right bias for these models.

## Key points
- **Test set:** 250 sentences, made up of 50 originals plus round-trip translations through Czech, Spanish, German and French. The contexts were left untranslated.
- **Annotation design:**
  - 25 HITs of 10 sentences each, with 20 annotators per HIT.
  - A 4-point naturalness scale, from bad (1) to good (4).
  - Disjoint worker groups for each of the three conditions (H∅, H+, H−).
  - Filtering removed 504 ratings, about 3.9% of the total.
- **Correlations between conditions (Pearson's r):** ratings with real context (H+) correlated at 0.940 with no-context ratings (H∅), and ratings with random context (H−) correlated at 0.911 with H∅. The two context conditions, H− and H+, correlated at 0.891 with each other.
- **Compression effect:** when context was added, highly rated sentences dropped by about 0.08 on average, while poorly rated ones rose by about 0.45.
- **Coherence effect:** real context gave consistently higher ratings than random context (one-tailed Wilcoxon signed-rank test, p = 1.9 × 10⁻⁸). Bidirectional models outperformed unidirectional ones (e.g., TDLM) by a wide margin.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [The University of Melbourne](https://md.research.elamur.ai/free/en/universities/the-university-of-melbourne/) — University, Melbourne, Australia · 100 works · 22,618 citations
- [Queen Mary University of London](https://md.research.elamur.ai/free/en/universities/queen-mary-university-of-london/) — University, London, United Kingdom · 54 works · 3,542 citations
- [University of Gothenburg](https://md.research.elamur.ai/free/en/universities/university-of-gothenburg/) — University, Gothenburg, Sweden · 34 works · 1,625 citations
- [King's College London](https://md.research.elamur.ai/free/en/universities/king-s-college-london/) — University, London, United Kingdom · 42 works · 1,617 citations
- [Jožef Stefan Institute](https://md.research.elamur.ai/free/en/labs/jozef-stefan-institute/) — Research institute, Ljubljana, Slovenia · 17 works · 2,165 citations
- [Jožef Stefan International Postgraduate School](https://md.research.elamur.ai/free/en/universities/jozef-stefan-international-postgraduate-school/) — University, Ljubljana, Slovenia · 11 works · 1,776 citations
- [University of Nottingham Ningbo China](https://md.research.elamur.ai/free/en/universities/university-of-nottingham-ningbo-china/) — University, Ningbo, China · 3 works · 216 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🧠 Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/) · 165 works · [🧠 Cognitive Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/cognitive-neuroscience/) · 164 works

## Cite

Cite as: Jey Han Lau, Carlos Armendariz, Shalom Lappin, Matthew Purver and Chang Shu. 2020. How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context. Transactions of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{lau2020how,
  title = {{How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context}},
  author = {Jey Han Lau, Carlos Armendariz, Shalom Lappin, Matthew Purver and Chang Shu},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.1162/tacl\_a\_00315},
  url = {https://doi.org/10.1162/tacl_a_00315}
}
```

- [← previous CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese](https://md.research.elamur.ai/free/en/papers/xu-2020-cluener2020-fine-grained-named/)
- [next → Implicit Discourse Relation Classification: We Need to Talk about Evaluation](https://md.research.elamur.ai/free/en/papers/kim-2020-implicit-discourse-relation-classification-we/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/6/)

## References

50 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. David Adger. 2003. Core Syntax: A Minimalist Approach, Oxford University Press, United Kingdom. [find](https://scholar.google.com/scholar?q=David+Adger%2E+2003%2E+Core+Syntax%3A+A+Minimalist+Approach%2C+Oxford+University+Press%2C+United+Kingdom%2E)
2. John R. Anderson. 1996. ACT: A simple theory of complex cognition. American Psychologist, 51:355–365. \#\# 6 Conclusions and Future Work We found that processing context induces a cognitive load for humans, which creates a compression effect on the distribution of acceptability ratings. We also showed… [find](https://scholar.google.com/scholar?q=John+R%2E+Anderson%2E+1996%2E+ACT%3A+A+simple+theory+of+complex+cognition%2E+American+Psychologist%2C+51%3A355%E2%80%93365%2E+%5C%23%5C%23+6+Conclusions+and+Future+Work+We+found+that+processing+context+induces+a+cognitive+load+for+h)
3. Nicholas Asher and Alex Lascarides. 2003. Logics of Conversation, Cambridge University Press. [find](https://scholar.google.com/scholar?q=Nicholas+Asher+and+Alex+Lascarides%2E+2003%2E+Logics+of+Conversation%2C+Cambridge+University+Press%2E)
4. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. [A neural probabilistic language model](https://md.research.elamur.ai/free/en/papers/bengio-2003-neural-probabilistic-language-model/). The Journal of Machine Learning Research, 3:1137–1155.
5. Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186. Minneapolis, Minnesota. [find](https://scholar.google.com/scholar?q=Human+Language+Technologies%2C+Volume+1+%28Long+and+Short+Papers%29%2C+pages+4171%E2%80%934186%2E+Minneapolis%2C+Minnesota%2E)
6. Jean-Philippe Bernardy, Shalom Lappin, and Jey Han Lau. 2018. The influence of context on sentence acceptability judgements. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), pages 456–461. Melbourne, Australia. [find](https://scholar.google.com/scholar?q=Jean%2DPhilippe+Bernardy%2C+Shalom+Lappin%2C+and+Jey+Han+Lau%2E+2018%2E+The+influence+of+context+on+sentence+acceptability+judgements%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computatio)
7. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12:2121–2159. [find](https://scholar.google.com/scholar?q=John+Duchi%2C+Elad+Hazan%2C+and+Yoram+Singer%2E+2011%2E+Adaptive+subgradient+methods+for+online+learning+and+stochastic+optimization%2E+Journal+of+Machine+Learning+Research%2C+12%3A2121%E2%80%932159%2E)
8. Thomas G. Bever. 1970, The cognitive basis for linguistic structures, J. R. Hayes, editor, Cognition and the Development of Language, Wiley, New York, pages 279–362. [find](https://scholar.google.com/scholar?q=Thomas+G%2E+Bever%2E+1970%2C+The+cognitive+basis+for+linguistic+structures%2C+J%2E+R%2E+Hayes%2C+editor%2C+Cognition+and+the+Development+of+Language%2C+Wiley%2C+New+York%2C+pages+279%E2%80%93362%2E)
9. Maria Giavazzi, Sara Sambin, Ruth de Diego-Balaguer, Lorna Le Stanc, Anne-Catherine Bachoud-Lévi, and Charlotte Jacquemot. 2018. Structural priming in sentence comprehension: A single prime is enough. PLoS ONE, 13(4):e0194959. [find](https://scholar.google.com/scholar?q=Maria+Giavazzi%2C+Sara+Sambin%2C+Ruth+de+Diego%2DBalaguer%2C+Lorna+Le+Stanc%2C+Anne%2DCatherine+Bachoud%2DLe%CC%81vi%2C+and+Charlotte+Jacquemot%2E+2018%2E+Structural+priming+in+sentence+comprehension%3A+A+single+prime+is+enough)
10. Yuri Bizzoni and Shalom Lappin. 2019. The effect of context on metaphor paraphrase aptness judgments. In Proceedings of the 13th International Conference on Computational Semantics - Long Papers, pages 165–175. Gothenburg, Sweden. [find](https://scholar.google.com/scholar?q=Yuri+Bizzoni+and+Shalom+Lappin%2E+2019%2E+The+effect+of+context+on+metaphor+paraphrase+aptness+judgments%2E+In+Proceedings+of+the+13th+International+Conference+on+Computational+Semantics+%2D+Long+Papers%2C+page)
11. Dwight Bolinger. 1968. Judgments of grammaticality. Lingua, 21:34–40. [find](https://scholar.google.com/scholar?q=Dwight+Bolinger%2E+1968%2E+Judgments+of+grammaticality%2E+Lingua%2C+21%3A34%E2%80%9340%2E)
12. Jonathan Ginzburg. 2012. The Interactive Stance: Meaning for Conversation, Oxford University Press. [find](https://scholar.google.com/scholar?q=Jonathan+Ginzburg%2E+2012%2E+The+Interactive+Stance%3A+Meaning+for+Conversation%2C+Oxford+University+Press%2E)
13. Yvette Graham, Barry Haddow, and Philipp Koehn. 2019. Translationese in machine translation evaluation. CoRR, abs/1906.09833. [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Barry+Haddow%2C+and+Philipp+Koehn%2E+2019%2E+Translationese+in+machine+translation+evaluation%2E+CoRR%2C+abs%2F1906%2E09833%2E)
14. Sidney Greenbaum. 1976. Contextual influence on acceptability judgements. Linguistics, 15(187):5–12. [find](https://scholar.google.com/scholar?q=Sidney+Greenbaum%2E+1976%2E+Contextual+influence+on+acceptability+judgements%2E+Linguistics%2C+15%28187%29%3A5%E2%80%9312%2E)
15. Ronnie Cann, Ruth Kempson, and Matthew Purver. 2007. Context and well-formedness: the dynamics of ellipsis. Research on Language and Computation, 5(3):333–358. [find](https://scholar.google.com/scholar?q=Ronnie+Cann%2C+Ruth+Kempson%2C+and+Matthew+Purver%2E+2007%2E+Context+and+well%2Dformedness%3A+the+dynamics+of+ellipsis%2E+Research+on+Language+and+Computation%2C+5%283%29%3A333%E2%80%93358%2E)
16. Jeroen Groenendijk and Martin Stokhof. 1990. Dynamic Montague grammar. L. Kalman and L. Polos, editors, In Proceedings of the 2nd Symposium on Logic and Language, pages 3–48. Budapest. [find](https://scholar.google.com/scholar?q=Jeroen+Groenendijk+and+Martin+Stokhof%2E+1990%2E+Dynamic+Montague+grammar%2E+L%2E+Kalman+and+L%2E+Polos%2C+editors%2C+In+Proceedings+of+the+2nd+Symposium+on+Logic+and+Language%2C+pages+3%E2%80%9348%2E+Budapest%2E)
17. Mickaël Causse, Vsevolod Peysakhovich, and Eve F. Fabre. 2016. High working memory load impairs language processing during a simulated piloting task: An ERP and pupillometry study. Frontiers in Human Neuroscience, 10:240. [find](https://scholar.google.com/scholar?q=Mickae%CC%88l+Causse%2C+Vsevolod+Peysakhovich%2C+and+Eve+F%2E+Fabre%2E+2016%2E+High+working+memory+load+impairs+language+processing+during+a+simulated+piloting+task%3A+An+ERP+and+pupillometry+study%2E+Frontiers+in+Human)
18. Irene Heim. 1982. The Semantics of Definite and Indefinite Noun Phrases. Ph.D. thesis, University of Massachusetts at Amherst. [find](https://scholar.google.com/scholar?q=Irene+Heim%2E+1982%2E+The+Semantics+of+Definite+and+Indefinite+Noun+Phrases%2E+Ph%2ED%2E+thesis%2C+University+of+Massachusetts+at+Amherst%2E)
19. Wayne Cowart. 1994. Anchoring and grammar effects in judgments of sentence acceptability. Perceptual and Motor Skills, 79(3):1171–1182. [find](https://scholar.google.com/scholar?q=Wayne+Cowart%2E+1994%2E+Anchoring+and+grammar+effects+in+judgments+of+sentence+acceptability%2E+Perceptual+and+Motor+Skills%2C+79%283%29%3A1171%E2%80%931182%2E)
20. Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc V. Le, and Ruslan Salakhutdinov. 2019. Transformer-XL: Attentive language models beyond a fixed-length context. CoRR, abs/1901.02860. [find](https://scholar.google.com/scholar?q=Zihang+Dai%2C+Zhilin+Yang%2C+Yiming+Yang%2C+Jaime+G%2E+Carbonell%2C+Quoc+V%2E+Le%2C+and+Ruslan+Salakhutdinov%2E+2019%2E+Transformer%2DXL%3A+Attentive+language+models+beyond+a+fixed%2Dlength+context%2E+CoRR%2C+abs%2F1901%2E02860%2E)
21. David Denison. 2004. Fuzzy Grammar: A Reader, Oxford University Press, United Kingdom. [find](https://scholar.google.com/scholar?q=David+Denison%2E+2004%2E+Fuzzy+Grammar%3A+A+Reader%2C+Oxford+University+Press%2C+United+Kingdom%2E)
22. Felix Hill, Roi Reichart, and Anna Korhonen. 2015. [SimLex-999: Evaluating semantic models with (genuine) similarity estimation](https://md.research.elamur.ai/free/en/papers/hill-2015-simlex-999-evaluating-semantic-models/). Computational Linguistics, 41:665–695.
23. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation, 9:1735–1780. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+Ju%CC%88rgen+Schmidhuber%2E+1997%2E+Long+short%2Dterm+memory%2E+Neural+Computation%2C+9%3A1735%E2%80%931780%2E)
24. Aine Ito, Martin Corley, and Martin J. Pickering. 2018. A cognitive load delays predictive eye movements similarly during L1 and L2 comprehension. Bilingualism: Language and Cognition, 21(2):251–264. [find](https://scholar.google.com/scholar?q=Aine+Ito%2C+Martin+Corley%2C+and+Martin+J%2E+Pickering%2E+2018%2E+A+cognitive+load+delays+predictive+eye+movements+similarly+during+L1+and+L2+comprehension%2E+Bilingualism%3A+Language+and+Cognition%2C+21%282%29%3A251%E2%80%93264%2E)
25. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Hans Kamp and Uwe Reyle. 199…
26. Urvashi Khandelwal, He He, Peng Qi, and Dan Jurafsky. 2018. Sharp nearby, fuzzy far away: How neural language models use context. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 284–294. Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Urvashi+Khandelwal%2C+He+He%2C+Peng+Qi%2C+and+Dan+Jurafsky%2E+2018%2E+Sharp+nearby%2C+fuzzy+far+away%3A+How+neural+language+models+use+context%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Compu)
27. Andrew Kachites McCallum. 2002. Mallet: A machine learning for language toolkit. [http://mallet.cs.umass.edu](http://mallet.cs.umass.edu). [↗](http://mallet.cs.umass.edu)
28. Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan Černocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH 2010, 11th Annual Conference of the International Speech Communication Association, pages 1045–1048. Makuhari, Japan. [find](https://scholar.google.com/scholar?q=Toma%CC%81s%CC%8C+Mikolov%2C+Martin+Karafia%CC%81t%2C+Luka%CC%81s%CC%8C+Burget%2C+Jan+C%CC%8Cernocky%CC%81%2C+and+Sanjeev+Khudanpur%2E+2010%2E+Recurrent+neural+network+based+language+model%2E+In+INTERSPEECH+2010%2C+11th+Annual+Conference+of+the+Intern)
29. Diederik P. Kingma and Jimmy Ba. 2014. [Adam: A method for stochastic optimization](https://md.research.elamur.ai/free/en/papers/kingma-2014-adam-method-stochastic-optimization/). CoRR, abs/1412.6980.
30. Taku Kudo and John Richardson. 2018. [SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/). In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66–71. Brussels, Belgium.
31. Hyangsook Park, Jun-Su Kang, Sungmook Choi, and Minho Lee. 2013. Analysis of cognitive load for language processing based on brain activities. In Neural Information Processing, pages 561–568. Springer Berlin Heidelberg, Berlin, Heidelberg. [find](https://scholar.google.com/scholar?q=Hyangsook+Park%2C+Jun%2DSu+Kang%2C+Sungmook+Choi%2C+and+Minho+Lee%2E+2013%2E+Analysis+of+cognitive+load+for+language+processing+based+on+brain+activities%2E+In+Neural+Information+Processing%2C+pages+561%E2%80%93568%2E+Springer)
32. Adam Pauls and Dan Klein. 2012. Large-scale syntactic language modeling with treelets. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 959–968. Jeju Island, Korea. [find](https://scholar.google.com/scholar?q=Adam+Pauls+and+Dan+Klein%2E+2012%2E+Large%2Dscale+syntactic+language+modeling+with+treelets%2E+In+Proceedings+of+the+50th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers)
33. Jey Han Lau, Timothy Baldwin, and Trevor Cohn. 2017a. Topically driven neural language model. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 355–365. Vancouver, Canada. [find](https://scholar.google.com/scholar?q=Jey+Han+Lau%2C+Timothy+Baldwin%2C+and+Trevor+Cohn%2E+2017a%2E+Topically+driven+neural+language+model%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long)
34. Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeff+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E)
35. Jey Han Lau, Alexander Clark, and Shalom Lappin. 2015. Unsupervised prediction of acceptability judgements. In Proceedings of the Joint conference of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of… [find](https://scholar.google.com/scholar?q=Jey+Han+Lau%2C+Alexander+Clark%2C+and+Shalom+Lappin%2E+2015%2E+Unsupervised+prediction+of+acceptability+judgements%2E+In+Proceedings+of+the+Joint+conference+of+the+53rd+Annual+Meeting+of+the+Association+for+Com)
36. Daivd Reitter, Frank Keller, and Johanna D. Moore. 2011. A computational cognitive model of syntactic priming. Cognitive Science, 35(4):587–637. [find](https://scholar.google.com/scholar?q=Daivd+Reitter%2C+Frank+Keller%2C+and+Johanna+D%2E+Moore%2E+2011%2E+A+computational+cognitive+model+of+syntactic+priming%2E+Cognitive+Science%2C+35%284%29%3A587%E2%80%93637%2E)
37. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. [Neural machine translation of rare words with subword units](https://md.research.elamur.ai/free/en/papers/sennrich-2016-neural-machine-translation-rare-words/). In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1715–1725. Berlin, Germany.
38. Jey Han Lau, Alexander Clark, and Shalom Lappin. 2017b. Grammaticality, Acceptability, and Probability: A Probabilistic View of Linguistic Knowledge. Cognitive Science, 41:1202–1241. [find](https://scholar.google.com/scholar?q=Jey+Han+Lau%2C+Alexander+Clark%2C+and+Shalom+Lappin%2E+2017b%2E+Grammaticality%2C+Acceptability%2C+and+Probability%3A+A+Probabilistic+View+of+Linguistic+Knowledge%2E+Cognitive+Science%2C+41%3A1202%E2%80%931241%2E)
39. Antonella Sorace and Frank Keller. 2005. Gradience in linguistic data. Lingua, 115:1497–1524. [find](https://scholar.google.com/scholar?q=Antonella+Sorace+and+Frank+Keller%2E+2005%2E+Gradience+in+linguistic+data%2E+Lingua%2C+115%3A1497%E2%80%931524%2E)
40. William Mann and Sandra Thompson. 1988. [Rhetorical structure theory: Toward a functional theory of text organization](https://md.research.elamur.ai/free/en/papers/mann-1988-rhetorical-structure-theory-functional/). Text, 8(3):243–281.
41. Jon Sprouse. 2007. Continuous acceptability, categorical grammaticality, and experimental syntax. Biolinguistics, 1123–134. [find](https://scholar.google.com/scholar?q=Jon+Sprouse%2E+2007%2E+Continuous+acceptability%2C+categorical+grammaticality%2C+and+experimental+syntax%2E+Biolinguistics%2C+1123%E2%80%93134%2E)
42. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. [The Stanford CoreNLP natural language processing toolkit](https://md.research.elamur.ai/free/en/papers/manning-2014-stanford-corenlp-natural-language-processing/). In Asso-John Sweller. 1988. Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2):257–285.
43. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. [Attention is all you need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In Advances in Neural Information Processing Systems 30, pages 5998–6008.
44. Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016. Google’s neural… [find](https://scholar.google.com/scholar?q=Shah%2C+Melvin+Johnson%2C+Xiaobing+Liu%2C+Lukasz+Kaiser%2C+Stephan+Gouws%2C+Yoshikiyo+Kato%2C+Taku+Kudo%2C+Hideto+Kazawa%2C+Keith+Stevens%2C+George+Kurian%2C+Nishant+Patil%2C+Wei+Wang%2C+Cliff+Young%2C+Jason+Smith%2C+Jason+Riesa)
45. Alex Wang and Kyunghyun Cho. 2019. [BERT has a mouth, and it must speak: BERT as a Markov random field language model](https://md.research.elamur.ai/free/en/papers/wang-2019-bert-has-mouth-must-speak/). In Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation, pages 30–36. Association for Computational Linguistics, Minneapolis, Minnesota.
46. Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019. [XLNet: Generalized autoregressive pretraining for language understanding](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/). CoRR, abs/1906.08237.
47. John Warner and Arnold L. Glass. 1987. Context and distance-to-disambiguation effects in ambiguity resolution: Evidence from grammaticality judgments of garden path sentences. Journal of Memory and Language, 26(6):714 – 738. [find](https://scholar.google.com/scholar?q=John+Warner+and+Arnold+L%2E+Glass%2E+1987%2E+Context+and+distance%2Dto%2Ddisambiguation+effects+in+ambiguity+resolution%3A+Evidence+from+grammaticality+judgments+of+garden+path+sentences%2E+Journal+of+Memory+and+La)
48. Yukun Zhu, Ryan Kiros, Rich Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. [Aligning books and movies: Towards story-like visual explanations by watching movies and reading books](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/). In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV…
49. Alex Warstadt, Amanpreet Singh, and Samuel R. Bowman. 2018. Neural network acceptability judgments. CoRR, abs/1805.12471. [find](https://scholar.google.com/scholar?q=Alex+Warstadt%2C+Amanpreet+Singh%2C+and+Samuel+R%2E+Bowman%2E+2018%2E+Neural+network+acceptability+judgments%2E+CoRR%2C+abs%2F1805%2E12471%2E)
50. Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Christina Zlogar and Kathryn Davidson. 2018. Effects of linguistic context on the acceptability of co-speech gestures. Glossa, 3(1):73. [find](https://scholar.google.com/scholar?q=Yonghui+Wu%2C+Mike+Schuster%2C+Zhifeng+Chen%2C+Quoc+V%2E+Le%2C+Mohammad+Norouzi%2C+Wolfgang+Macherey%2C+Maxim+Krikun%2C+Yuan+Cao%2C+Qin+Gao%2C+Klaus+Macherey%2C+Jeff+Klingner%2C+Apurva+Christina+Zlogar+and+Kathryn+Davidson%2E+)

*Updated 29 October 2026*