---
title: "Language Models as Models of Language — Milliere 2024"
description: "The paper releases no corpus, treebank or model and surveys existing research instead. 242 references, cited by 17 papers here."
authors: ["Raphael Milliere"]
year: 2024
venue: "arXiv:2408.07144"
source: "https://arxiv.org/abs/2408.07144"
doi: "10.48550/arxiv.2408.07144"
arxiv: "2408.07144"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/milliere-2024-language-models-models-language/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/milliere-2024-language-models-models-language/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/8/) / Language Models as Models of Language

# Language Models as Models of Language

**Authors:** [Raphael Milliere](https://md.research.elamur.ai/free/en/authors/raphael-milliere/) · **Year:** 2024 · **Venue:** arXiv:2408.07144 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2408.07144) · [PDF](https://arxiv.org/pdf/2408.07144) · [DOI 10.48550/arxiv.2408.07144](https://doi.org/10.48550/arxiv.2408.07144) · [arXiv 2408.07144](https://arxiv.org/abs/2408.07144) · [OpenAlex](https://openalex.org/W4402427509)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · [17](https://md.research.elamur.ai/free/en/papers/milliere-2024-language-models-models-language/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
This chapter is a review and position piece, not an empirical study. It asks whether neural language models belong in theoretical linguistics as accounts of how humans acquire and represent grammar, or whether they are only engineering tools. The paper releases no corpus, treebank or model and surveys existing research instead.

It first traces statistical NLP from Shannon's information theory, through distributional semantics, to Transformer models. It then sorts the evidence on syntax into three groups: behavioural tests on targeted constructions, probing of internal representations, and causal interventions. Millière reads this literature as showing real sensitivity to hierarchical structure, even in models trained on child-scale input.

He argues against dismissing models via the competence/performance distinction. Carefully controlled training setups can turn models into idealized learners that offer how-possibly explanations relevant to poverty-of-stimulus and nativism debates. He also flags a limit: reproducing correct outputs is not the same as explaining cross-linguistic constraints.

For NLP practitioners, the chapter clarifies when experiments with language models can count as linguistic evidence.

## Key points
- **Publication details:** forthcoming chapter in an Oxford handbook volume devoted to philosophical questions about linguistics (eds. Nefdt, Dupre, Stanton; Oxford University Press). The author is at Macquarie University; arXiv v1 is dated 13 Aug 2024.
- **Historical survey:** covers Shannon's next-letter prediction experiments (1951), Weaver's machine-translation memo (1949), and the rule-based systems SHRDLU and LUNAR. It also discusses Harris's distributional hypothesis and Osgood's semantic differential, whose dimensions were evaluation, potency and activity.
- **Taxonomy of methods:**
  - behavioural studies: targeted syntactic tasks, compositionality and recursion;
  - probing: diagnostic and parameter-free, with a discussion of methodological pitfalls;
  - interventional studies: counterfactual interventions and mechanistic interpretability.
- **Theoretical analysis (Section 4):** considers language models as models of performance and of competence, examines in-principle learnability claims, and treats models as model learners and as scientific models. The how-possibly explanation framing draws on Bokulich (2014).
- **Caveats:** the expletive-subject example ("It's raining") is explained in generative theory through case theory and the EPP, and a model that merely produces such sentences explains nothing. The supplied text reports no quantitative benchmarks and no UD/LAS-style resources.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Developmental and Educational Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/developmental-and-educational-psychology/) · 499 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works

## Cite

Cite as: Raphael Milliere. 2024. Language Models as Models of Language. arXiv:2408.07144.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{milliere2024language,
  title = {{Language Models as Models of Language}},
  author = {Raphael Milliere},
  year = {2024},
  doi = {10.48550/arxiv.2408.07144},
  eprint = {2408.07144},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2408.07144}
}
```

- [← previous Humans Learn Language from Situated Communicative Interactions. What about Machines?](https://md.research.elamur.ai/free/en/papers/beuls-2024-humans-learn-language-situated-communicative/)
- [next → MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning](https://md.research.elamur.ai/free/en/papers/yang-2024-moral-moe-augmented-lora-llms/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/8/)

## References

242 references, 50 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, and Yoav Goldberg. [Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks](https://md.research.elamur.ai/free/en/papers/adi-2016-fine-grained-analysis-sentence-embeddings/). In International Conference on Learning Representations, November 2016.
2. Ekin Akyurek and Jacob Andreas. LexSym: Compositionality as Lexical Symmetry. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 639–657, Toronto, Canada, July 2023. Association for Computational Linguistics. doi: 10.18653/v1/202… [find](https://scholar.google.com/scholar?q=Ekin+Akyurek+and+Jacob+Andreas%2E+LexSym%3A+Compositionality+as+Lexical+Symmetry%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29%2C+pages+)
3. Ekin Akyürek, Afra Feyza Akyürek, and Jacob Andreas. Learning to Recombine and Resample Data For Compositional Generalization. In International Conference on Learning Representations, October 2020. [find](https://scholar.google.com/scholar?q=Ekin+Aky%C3%BCrek%2C+Afra+Feyza+Aky%C3%BCrek%2C+and+Jacob+Andreas%2E+Learning+to+Recombine+and+Resample+Data+For+Compositional+Generalization%2E+In+International+Conference+on+Learning+Representations%2C+October+2020%2E)
4. Guillaume Alain and Yoshua Bengio. Understanding intermediate layers using linear classifier probes, November 2018. 16 I am grateful to Emma Borg, Gabe Dupre, Chris Hill, Barry C. Smith, and Charles Rathkopf for comments on previous versions of this chapter. [find](https://scholar.google.com/scholar?q=Guillaume+Alain+and+Yoshua+Bengio%2E+Understanding+intermediate+layers+using+linear+classifier+probes%2C+November+2018%2E+16+I+am+grateful+to+Emma+Borg%2C+Gabe+Dupre%2C+Chris+Hill%2C+Barry+C%2E+Smith%2C+and+Charles+R)
5. Zeyuan Allen-Zhu and Yuanzhi Li. Physics of Language Models: Part 1, Context-Free Grammar, May 2023. [find](https://scholar.google.com/scholar?q=Zeyuan+Allen%2DZhu+and+Yuanzhi+Li%2E+Physics+of+Language+Models%3A+Part+1%2C+Context%2DFree+Grammar%2C+May+2023%2E)
6. Ben Ambridge and Liam Blything. Large language models are better than theoretical linguists at theoretical linguistics. Theoretical Linguistics, 50(1-2):33–48, June 2024. ISSN 1613-4060. doi: 10.1515/tl-2024-2002. — [doi:10.1515/tl-2024-2002](https://doi.org/10.1515/tl-2024-2002) [find](https://scholar.google.com/scholar?q=Ben+Ambridge+and+Liam+Blything%2E+Large+language+models+are+better+than+theoretical+linguists+at+theoretical+linguistics%2E+Theoretical+Linguistics%2C+50%281%2D2%29%3A33%E2%80%9348%2C+June+2024%2E+ISSN+1613%2D4060%2E+doi%3A+10%2E1515%2F)
7. Jacob Andreas. [Good-Enough Compositional Data Augmentation](https://md.research.elamur.ai/free/en/papers/andreas-2020-good-enough-compositional-data-augmentation/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7556–7566, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.676.
8. David Arps, Younes Samih, Laura Kallmeyer, and Hassan Sajjad. Probing for Constituency Structure in Neural Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 6738–6757, Abu Dhabi, United Arab Emirates, December 2022. Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=David+Arps%2C+Younes+Samih%2C+Laura+Kallmeyer%2C+and+Hassan+Sajjad%2E+Probing+for+Constituency+Structure+in+Neural+Language+Models%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2022%2C+pa)
9. Marco Baroni. On the Proper Role of Linguistically Oriented Deep Net Analysis in Linguistic Theorising. In Algebraic Structures in Natural Language. CRC Press, 2022. ISBN 978-1-00-320538-8. [find](https://scholar.google.com/scholar?q=Marco+Baroni%2E+On+the+Proper+Role+of+Linguistically+Oriented+Deep+Net+Analysis+in+Linguistic+Theorising%2E+In+Algebraic+Structures+in+Natural+Language%2E+CRC+Press%2C+2022%2E+ISBN+978%2D1%2D00%2D320538%2D8%2E)
10. Marco Baroni, Raffaella Bernardi, and Roberto Zamparelli. Frege in Space: A Program for Composition Distributional Semantics. Linguistic Issues in Language Technology, 9, 2014. [find](https://scholar.google.com/scholar?q=Marco+Baroni%2C+Raffaella+Bernardi%2C+and+Roberto+Zamparelli%2E+Frege+in+Space%3A+A+Program+for+Composition+Distributional+Semantics%2E+Linguistic+Issues+in+Language+Technology%2C+9%2C+2014%2E)
11. Gašper Beguš, Maksymilian Dąbkowski, and Ryan Rhodes. Large Linguistic Models: Analyzing theoretical linguistic abilities of LLMs, May 2023. [find](https://scholar.google.com/scholar?q=Ga%C5%A1per+Begu%C5%A1%2C+Maksymilian+D%C4%85bkowski%2C+and+Ryan+Rhodes%2E+Large+Linguistic+Models%3A+Analyzing+theoretical+linguistic+abilities+of+LLMs%2C+May+2023%2E)
12. Gašper Beguš, Thomas Lu, and Zili Wang. Basic syntax from speech: Spontaneous concatenation in unsupervised deep neural networks, July 2024. [find](https://scholar.google.com/scholar?q=Ga%C5%A1per+Begu%C5%A1%2C+Thomas+Lu%2C+and+Zili+Wang%2E+Basic+syntax+from+speech%3A+Spontaneous+concatenation+in+unsupervised+deep+neural+networks%2C+July+2024%2E)
13. Lisa Beinborn and Nora Hollenstein. [Cognitive Plausibility in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/matusevych-2024-cognitive-plausibility-natural-language-processing/). Synthesis Lectures on Human Language Technologies. Springer International Publishing, Cham, 2024. ISBN 978-3-031-43259-0 978-3-031-43260-6. doi: 10.1007/978-3-031-43260-6.
14. Yonatan Belinkov. [Probing Classifiers: Promises, Shortcomings, and Advances](https://md.research.elamur.ai/free/en/papers/belinkov-2022-probing-classifiers-promises-shortcomings-advances/). Computational Linguistics, 48(1):207–219, April 2022. ISSN 0891-2017. doi: 10.1162/coli_a_00422.
15. Islam Beltagy, Cuong Chau, Gemma Boleda, Dan Garrette, Katrin Erk, and Raymond Mooney. Montague Meets Markov: Deep Semantics with Probabilistic Logical Form. In Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 1: Proceedings of the Main Conference and the Shared Task: Se… [find](https://scholar.google.com/scholar?q=Islam+Beltagy%2C+Cuong+Chau%2C+Gemma+Boleda%2C+Dan+Garrette%2C+Katrin+Erk%2C+and+Raymond+Mooney%2E+Montague+Meets+Markov%3A+Deep+Semantics+with+Probabilistic+Logical+Form%2E+In+Second+Joint+Conference+on+Lexical+and+)
16. Emily M. Bender and Alexander Koller. [Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data](https://md.research.elamur.ai/free/en/papers/bender-2020-climbing-nlu-meaning-form-understanding/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5185–5198, Online, July 2020. Association for Computational Linguistics. doi: 10.18653…
17. Yoshua Bengio, Réjean Ducharme, and Pascal Vincent. A Neural Probabilistic Language Model. In Advances in Neural Information Processing Systems, volume 13. MIT Press, 2000. [find](https://scholar.google.com/scholar?q=Yoshua+Bengio%2C+R%C3%A9jean+Ducharme%2C+and+Pascal+Vincent%2E+A+Neural+Probabilistic+Language+Model%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+13%2E+MIT+Press%2C+2000%2E)
18. Elika Bergelson, Marisa Casillas, Melanie Soderstrom, Amanda Seidl, Anne S. Warlaumont, and Andrei Amatuni. What Do North American Babies Hear? A large-scale cross-corpus analysis. Developmental Science, 22(1):e12724, 2019. ISSN 1467-7687. doi: 10.1111/desc.12724. — [doi:10.1111/desc.12724](https://doi.org/10.1111/desc.12724) [find](https://scholar.google.com/scholar?q=Elika+Bergelson%2C+Marisa+Casillas%2C+Melanie+Soderstrom%2C+Amanda+Seidl%2C+Anne+S%2E+Warlaumont%2C+and+Andrei+Amatuni%2E+What+Do+North+American+Babies+Hear%3F+A+large%2Dscale+cross%2Dcorpus+analysis%2E+Developmental+Scien)
19. Robert C. Berwick, Paul Pietroski, Beracah Yankama, and Noam Chomsky. Poverty of the Stimulus Revisited. Cognitive Science, 35(7):1207–1242, 2011. ISSN 1551-6709. doi: 10.1111/j.1551-6709.2011.01189.x. — [doi:10.1111/j.1551-6709.2011.01189.x](https://doi.org/10.1111/j.1551-6709.2011.01189.x) [find](https://scholar.google.com/scholar?q=Robert+C%2E+Berwick%2C+Paul+Pietroski%2C+Beracah+Yankama%2C+and+Noam+Chomsky%2E+Poverty+of+the+Stimulus+Revisited%2E+Cognitive+Science%2C+35%287%29%3A1207%E2%80%931242%2C+2011%2E+ISSN+1551%2D6709%2E+doi%3A+10%2E1111%2Fj%2E1551%2D6709%2E2011%2E01189%2Ex)
20. Satwik Bhattamishra, Arkil Patel, Varun Kanade, and Phil Blunsom. Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions, July 2023. [find](https://scholar.google.com/scholar?q=Satwik+Bhattamishra%2C+Arkil+Patel%2C+Varun+Kanade%2C+and+Phil+Blunsom%2E+Simplicity+Bias+in+Transformers+and+their+Ability+to+Learn+Sparse+Boolean+Functions%2C+July+2023%2E)
21. Idan A. Blank. What are large language models supposed to model? Trends in Cognitive Sciences, 27(11):987–989, November 2023. ISSN 1364-6613, 1879-307X. doi: 10.1016/j.tics.2023.08.006. — [doi:10.1016/j.tics.2023.08.006](https://doi.org/10.1016/j.tics.2023.08.006) [find](https://scholar.google.com/scholar?q=Idan+A%2E+Blank%2E+What+are+large+language+models+supposed+to+model%3F+Trends+in+Cognitive+Sciences%2C+27%2811%29%3A987%E2%80%93989%2C+November+2023%2E+ISSN+1364%2D6613%2C+1879%2D307X%2E+doi%3A+10%2E1016%2Fj%2Etics%2E2023%2E08%2E006%2E+%E2%80%94+%5Bdoi%3A10%2E1016)
22. Alisa Bokulich. How the Tiger Bush Got its Stripes: ‘How Possibly’ vs. ‘How Actually’ Model Explanations. The Monist, 97(3):321–338, July 2014. ISSN 0026-9662. doi: 10.5840/monist201497 321. — [doi:10.5840/monist201497](https://doi.org/10.5840/monist201497) [find](https://scholar.google.com/scholar?q=Alisa+Bokulich%2E+How+the+Tiger+Bush+Got+its+Stripes%3A+%E2%80%98How+Possibly%E2%80%99+vs%2E+%E2%80%98How+Actually%E2%80%99+Model+Explanations%2E+The+Monist%2C+97%283%29%3A321%E2%80%93338%2C+July+2014%2E+ISSN+0026%2D9662%2E+doi%3A+10%2E5840%2Fmonist201497+321%2E+%E2%80%94+%5Bdoi%3A10)
23. Gemma Boleda. Distributional Semantics and Linguistic Theory. Annual Review of Linguistics, 6(1): 213–234, 2020. doi: 10.1146/annurev-linguistics-011619-030303. [find](https://scholar.google.com/scholar?q=Gemma+Boleda%2E+Distributional+Semantics+and+Linguistic+Theory%2E+Annual+Review+of+Linguistics%2C+6%281%29%3A+213%E2%80%93234%2C+2020%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D011619%2D030303%2E)
24. Gemma Boleda and Aurélie Herbelot. Formal distributional semantics: Introduction to the special issue. Computational Linguistics, 42(4):619–635, December 2016. ISSN 0891-2017. doi: 10.1162/ COLI_a_00261. [find](https://scholar.google.com/scholar?q=Gemma+Boleda+and+Aur%C3%A9lie+Herbelot%2E+Formal+distributional+semantics%3A+Introduction+to+the+special+issue%2E+Computational+Linguistics%2C+42%284%29%3A619%E2%80%93635%2C+December+2016%2E+ISSN+0891%2D2017%2E+doi%3A+10%2E1162%2F+COLI%5Fa%5F002)
25. Gemma Boleda, Marco Baroni, The Nghia Pham, and Louise McNally. Intensionality was only alleged: On adjective-noun composition in distributional semantics. In Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers, pages 35–46, Potsdam, Germany, March 2… [find](https://scholar.google.com/scholar?q=Gemma+Boleda%2C+Marco+Baroni%2C+The+Nghia+Pham%2C+and+Louise+McNally%2E+Intensionality+was+only+alleged%3A+On+adjective%2Dnoun+composition+in+distributional+semantics%2E+In+Proceedings+of+the+10th+International+Con)
26. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter,… — [Language Models are Few-Shot Learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
27. Cameron Buckner. Morgan’s Canon, meet Hume’s Dictum: Avoiding anthropofabulation in cross-species comparisons. Biology & Philosophy, 28(5):853–871, September 2013. ISSN 1572-8404. doi: 10.1007/s10539-013-9376-0. — [doi:10.1007/s10539-013-9376-0](https://doi.org/10.1007/s10539-013-9376-0) [find](https://scholar.google.com/scholar?q=Cameron+Buckner%2E+Morgan%E2%80%99s+Canon%2C+meet+Hume%E2%80%99s+Dictum%3A+Avoiding+anthropofabulation+in+cross%2Dspecies+comparisons%2E+Biology+%26+Philosophy%2C+28%285%29%3A853%E2%80%93871%2C+September+2013%2E+ISSN+1572%2D8404%2E+doi%3A+10%2E1007%2Fs10539%2D)
28. Cameron Buckner. Deep learning: A philosophical introduction. Philosophy Compass, 14(10):e12625, 2019. ISSN 1747-9991. doi: 10.1111/phc3.12625. — [doi:10.1111/phc3.12625](https://doi.org/10.1111/phc3.12625) [find](https://scholar.google.com/scholar?q=Cameron+Buckner%2E+Deep+learning%3A+A+philosophical+introduction%2E+Philosophy+Compass%2C+14%2810%29%3Ae12625%2C+2019%2E+ISSN+1747%2D9991%2E+doi%3A+10%2E1111%2Fphc3%2E12625%2E+%E2%80%94+%5Bdoi%3A10%2E1111%2Fphc3%2E12625%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1111%2Fphc3%2E)
29. Cameron Buckner. Black Boxes or Unflattering Mirrors? Comparative Bias in the Science of Machine Behaviour. The British Journal for the Philosophy of Science, pages 000–000, April 2021. ISSN 0007-0882. doi: 10.1086/714960. — [doi:10.1086/714960](https://doi.org/10.1086/714960) [find](https://scholar.google.com/scholar?q=Cameron+Buckner%2E+Black+Boxes+or+Unflattering+Mirrors%3F+Comparative+Bias+in+the+Science+of+Machine+Behaviour%2E+The+British+Journal+for+the+Philosophy+of+Science%2C+pages+000%E2%80%93000%2C+April+2021%2E+ISSN+0007%2D0882)
30. Andrew Carnie. Syntax: A Generative Introduction. John Wiley & Sons, April 2021. ISBN 978-1-119-56923-7. [find](https://scholar.google.com/scholar?q=Andrew+Carnie%2E+Syntax%3A+A+Generative+Introduction%2E+John+Wiley+%26+Sons%2C+April+2021%2E+ISBN+978%2D1%2D119%2D56923%2D7%2E)
31. Lucas Georges Gabriel Charpentier and David Samuel. Not all layers are equally as important: Every Layer Counts BERT. In Alex Warstadt, Aaron Mueller, Leshem Choshen, Ethan Wilcox, Chengxu Zhuang, Juan Ciro, Rafael Mosquera, Bhargavi Paranjabe, Adina Williams, Tal Linzen, and Ryan Cotterell, editors… [find](https://scholar.google.com/scholar?q=Lucas+Georges+Gabriel+Charpentier+and+David+Samuel%2E+Not+all+layers+are+equally+as+important%3A+Every+Layer+Counts+BERT%2E+In+Alex+Warstadt%2C+Aaron+Mueller%2C+Leshem+Choshen%2C+Ethan+Wilcox%2C+Chengxu+Zhuang%2C+Jua)
32. Nick Chater, Alexander Clark, John A. Goldsmith, and Amy Perfors. Empiricism and Language Learnability. OUP Oxford, July 2015. ISBN 978-0-19-105358-0. [find](https://scholar.google.com/scholar?q=Nick+Chater%2C+Alexander+Clark%2C+John+A%2E+Goldsmith%2C+and+Amy+Perfors%2E+Empiricism+and+Language+Learnability%2E+OUP+Oxford%2C+July+2015%2E+ISBN+978%2D0%2D19%2D105358%2D0%2E)
33. Rui Chaves. What Don’t RNN Language Models Learn About Filler-Gap Dependencies? In Proceedings of the Society for Computation in Linguistics 2020, pages 1–11, New York, New York, January 2020. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Rui+Chaves%2E+What+Don%E2%80%99t+RNN+Language+Models+Learn+About+Filler%2DGap+Dependencies%3F+In+Proceedings+of+the+Society+for+Computation+in+Linguistics+2020%2C+pages+1%E2%80%9311%2C+New+York%2C+New+York%2C+January+2020%2E+Associa)
34. Angelica Chen, Ravid Schwartz-Ziv, Kyunghyun Cho, Matthew L. Leavitt, and Naomi Saphra. Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs, September 2023. [find](https://scholar.google.com/scholar?q=Angelica+Chen%2C+Ravid+Schwartz%2DZiv%2C+Kyunghyun+Cho%2C+Matthew+L%2E+Leavitt%2C+and+Naomi+Saphra%2E+Sudden+Drops+in+the+Loss%3A+Syntax+Acquisition%2C+Phase+Transitions%2C+and+Simplicity+Bias+in+MLMs%2C+September+2023%2E)
35. Daniil Cherniavskii, Eduard Tulchinskii, Vladislav Mikhailov, Irina Proskurina, Laida Kushnareva, Ekaterina Artemova, Serguei Barannikov, Irina Piontkovskaya, Dmitri Piontkovski, and Evgeny Burnaev. Acceptability Judgements via Examining the Topology of Attention Maps, October 2022. [find](https://scholar.google.com/scholar?q=Daniil+Cherniavskii%2C+Eduard+Tulchinskii%2C+Vladislav+Mikhailov%2C+Irina+Proskurina%2C+Laida+Kushnareva%2C+Ekaterina+Artemova%2C+Serguei+Barannikov%2C+Irina+Piontkovskaya%2C+Dmitri+Piontkovski%2C+and+Evgeny+Burnaev%2E+A)
36. Noam Chomsky. Syntactic Structures. Mouton, 1957. [find](https://scholar.google.com/scholar?q=Noam+Chomsky%2E+Syntactic+Structures%2E+Mouton%2C+1957%2E)
37. Noam Chomsky. On certain formal properties of grammars. Information and Control, 2(2):137–167, June 1959. ISSN 0019-9958. doi: 10.1016/S0019-9958(59)90362-6. — [doi:10.1016/s0019-9958(59)90362-6](https://doi.org/10.1016/s0019-9958%2859%2990362-6) [find](https://scholar.google.com/scholar?q=Noam+Chomsky%2E+On+certain+formal+properties+of+grammars%2E+Information+and+Control%2C+2%282%29%3A137%E2%80%93167%2C+June+1959%2E+ISSN+0019%2D9958%2E+doi%3A+10%2E1016%2FS0019%2D9958%2859%2990362%2D6%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fs0019%2D9958%2859%2990362%2D6%5D%28http)
38. Noam Chomsky. Aspects of the Theory of Syntax. Cambridge, MA, USA: MIT Press, 1965. [find](https://scholar.google.com/scholar?q=Noam+Chomsky%2E+Aspects+of+the+Theory+of+Syntax%2E+Cambridge%2C+MA%2C+USA%3A+MIT+Press%2C+1965%2E)
39. Noam Chomsky. The Minimalist Program. MIT Press, 1995. [find](https://scholar.google.com/scholar?q=Noam+Chomsky%2E+The+Minimalist+Program%2E+MIT+Press%2C+1995%2E)
40. Noam Chomsky, Ian Roberts, and Jeffrey Watumull. Noam Chomsky: The False Promise of ChatGPT. The New York Times, March 2023. ISSN 0362-4331. [find](https://scholar.google.com/scholar?q=Noam+Chomsky%2C+Ian+Roberts%2C+and+Jeffrey+Watumull%2E+Noam+Chomsky%3A+The+False+Promise+of+ChatGPT%2E+The+New+York+Times%2C+March+2023%2E+ISSN+0362%2D4331%2E)
41. Shammur Absar Chowdhury and Roberto Zamparelli. RNN Simulations of Grammaticality Judgments on Long-distance Dependencies. In Proceedings of the 27th International Conference on Computational Linguistics, pages 133–144, Santa Fe, New Mexico, USA, August 2018. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Shammur+Absar+Chowdhury+and+Roberto+Zamparelli%2E+RNN+Simulations+of+Grammaticality+Judgments+on+Long%2Ddistance+Dependencies%2E+In+Proceedings+of+the+27th+International+Conference+on+Computational+Linguist)
42. Morten H. Christiansen and Nick Chater. Toward a connectionist model of recursion in human linguistic performance. Cognitive Science, 23(2):157–205, April 1999. ISSN 0364-0213. doi: 10.1016/S0364-0213(99)00003-8. — [doi:10.1016/s0364-0213(99)00003-8](https://doi.org/10.1016/s0364-0213%2899%2900003-8) [find](https://scholar.google.com/scholar?q=Morten+H%2E+Christiansen+and+Nick+Chater%2E+Toward+a+connectionist+model+of+recursion+in+human+linguistic+performance%2E+Cognitive+Science%2C+23%282%29%3A157%E2%80%93205%2C+April+1999%2E+ISSN+0364%2D0213%2E+doi%3A+10%2E1016%2FS0364%2D0213)
43. Morten H. Christiansen and Nick Chater. Creating Language: Integrating Evolution, Acquisition, and Processing. MIT Press, March 2016. ISBN 978-0-262-03431-9. [find](https://scholar.google.com/scholar?q=Morten+H%2E+Christiansen+and+Nick+Chater%2E+Creating+Language%3A+Integrating+Evolution%2C+Acquisition%2C+and+Processing%2E+MIT+Press%2C+March+2016%2E+ISBN+978%2D0%2D262%2D03431%2D9%2E)
44. Grzegorz Chrupała and Afra Alishahi. Correlating Neural and Symbolic Representations of Language. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 2952–2962, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10.18653/v1/P19-1… [find](https://scholar.google.com/scholar?q=Grzegorz+Chrupa%C5%82a+and+Afra+Alishahi%2E+Correlating+Neural+and+Symbolic+Representations+of+Language%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+2952)
45. Radoslaw M. Cichy and Daniel Kaiser. Deep Neural Networks as Scientific Models. Trends in Cognitive Sciences, 23(4):305–317, April 2019. ISSN 1364-6613, 1879-307X. doi: 10.1016/j.tics.2019.01.009. — [doi:10.1016/j.tics.2019.01.009](https://doi.org/10.1016/j.tics.2019.01.009) [find](https://scholar.google.com/scholar?q=Radoslaw+M%2E+Cichy+and+Daniel+Kaiser%2E+Deep+Neural+Networks+as+Scientific+Models%2E+Trends+in+Cognitive+Sciences%2C+23%284%29%3A305%E2%80%93317%2C+April+2019%2E+ISSN+1364%2D6613%2C+1879%2D307X%2E+doi%3A+10%2E1016%2Fj%2Etics%2E2019%2E01%2E009%2E+%E2%80%94+%5B)
46. Alexander Clark. Learnability. In The Handbook of Language Emergence, chapter 17, pages 377–395. John Wiley & Sons, Ltd, 2015. ISBN 978-1-118-34613-6. doi: 10.1002/9781118346136.ch17. — [doi:10.1002/9781118346136.ch17](https://doi.org/10.1002/9781118346136.ch17) [find](https://scholar.google.com/scholar?q=Alexander+Clark%2E+Learnability%2E+In+The+Handbook+of+Language+Emergence%2C+chapter+17%2C+pages+377%E2%80%93395%2E+John+Wiley+%26+Sons%2C+Ltd%2C+2015%2E+ISBN+978%2D1%2D118%2D34613%2D6%2E+doi%3A+10%2E1002%2F9781118346136%2Ech17%2E+%E2%80%94+%5Bdoi%3A10%2E1002%2F9)
47. Alexander Clark and Shalom Lappin. Linguistic Nativism and the Poverty of the Stimulus. John Wiley & Sons, December 2010. ISBN 978-1-4443-9055-1. [find](https://scholar.google.com/scholar?q=Alexander+Clark+and+Shalom+Lappin%2E+Linguistic+Nativism+and+the+Poverty+of+the+Stimulus%2E+John+Wiley+%26+Sons%2C+December+2010%2E+ISBN+978%2D1%2D4443%2D9055%2D1%2E)
48. Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D. Manning. What Does BERT Look at? An Analysis of BERT’s Attention. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 276–286, Florence, Italy, August 2019. Association for Compu… [find](https://scholar.google.com/scholar?q=Kevin+Clark%2C+Urvashi+Khandelwal%2C+Omer+Levy%2C+and+Christopher+D%2E+Manning%2E+What+Does+BERT+Look+at%3F+An+Analysis+of+BERT%E2%80%99s+Attention%2E+In+Proceedings+of+the+2019+ACL+Workshop+BlackboxNLP%3A+Analyzing+and+Inte)
49. Joseph Coffey, Okko Räsänen, Camila Scaff, and Alejandrina Cristia. The difficulty and importance of estimating the lower and upper bounds of infant speech exposure, June 2024. [find](https://scholar.google.com/scholar?q=Joseph+Coffey%2C+Okko+R%C3%A4s%C3%A4nen%2C+Camila+Scaff%2C+and+Alejandrina+Cristia%2E+The+difficulty+and+importance+of+estimating+the+lower+and+upper+bounds+of+infant+speech+exposure%2C+June+2024%2E)
50. Henry Conklin, Bailin Wang, Kenny Smith, and Ivan Titov. Meta-Learning to Compositionally Generalize. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 3… [find](https://scholar.google.com/scholar?q=Henry+Conklin%2C+Bailin+Wang%2C+Kenny+Smith%2C+and+Ivan+Titov%2E+Meta%2DLearning+to+Compositionally+Generalize%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+the)
51. Alexis Conneau, German Kruszewski, Guillaume Lample, Loïc Barrault, and Marco Baroni. What you can cram into a single $&!\#* vector: Probing sentence embeddings for linguistic properties. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers… — [What you can cram into a single \$&!\#* vector: Probing sentence embeddings for linguistic properties](https://md.research.elamur.ai/free/en/papers/conneau-2018-what-you-can-cram-into/)
52. Louise Connell and Dermot Lynott. What Can Language Models Tell Us About Human Cognition? Current Directions in Psychological Science, 33(3):181–189, June 2024. ISSN 0963-7214. doi: 10.1177/09637214241242746. — [doi:10.1177/09637214241242746](https://doi.org/10.1177/09637214241242746) [find](https://scholar.google.com/scholar?q=Louise+Connell+and+Dermot+Lynott%2E+What+Can+Language+Models+Tell+Us+About+Human+Cognition%3F+Current+Directions+in+Psychological+Science%2C+33%283%29%3A181%E2%80%93189%2C+June+2024%2E+ISSN+0963%2D7214%2E+doi%3A+10%2E1177%2F0963721424)
53. Pablo Contreras Kallens, Ross Deans Kristensen-McLachlan, and Morten H. Christiansen. Large Language Models Demonstrate the Potential of Statistical Learning in Language. Cognitive Science, 47(3):e13256, 2023. ISSN 1551-6709. doi: 10.1111/cogs.13256. — [doi:10.1111/cogs.13256](https://doi.org/10.1111/cogs.13256) [find](https://scholar.google.com/scholar?q=Pablo+Contreras+Kallens%2C+Ross+Deans+Kristensen%2DMcLachlan%2C+and+Morten+H%2E+Christiansen%2E+Large+Language+Models+Demonstrate+the+Potential+of+Statistical+Learning+in+Language%2E+Cognitive+Science%2C+47%283%29%3Ae132)
54. Hannah P. Cowley, Mandy Natter, Karla Gray-Roncal, Rebecca E. Rhodes, Erik C. Johnson, Nathan Drenkow, Timothy M. Shead, Frances S. Chance, Brock Wester, and William Gray-Roncal. A framework for rigorous evaluation of human performance in human and machine learning comparison studies. Scientific Rep… — [doi:10.1038/s41598-022-08078-3](https://doi.org/10.1038/s41598-022-08078-3) [find](https://scholar.google.com/scholar?q=Hannah+P%2E+Cowley%2C+Mandy+Natter%2C+Karla+Gray%2DRoncal%2C+Rebecca+E%2E+Rhodes%2C+Erik+C%2E+Johnson%2C+Nathan+Drenkow%2C+Timothy+M%2E+Shead%2C+Frances+S%2E+Chance%2C+Brock+Wester%2C+and+William+Gray%2DRoncal%2E+A+framework+for+rigor)
55. Alejandrina Cristia, Emmanuel Dupoux, Michael Gurven, and Jonathan Stieglitz. Child-Directed Speech Is Infrequent in a Forager-Farmer Population: A Time Allocation Study. Child Development, 90(3):759–773, May 2019. ISSN 0009-3920. doi: 10.1111/cdev.12974. — [doi:10.1111/cdev.12974](https://doi.org/10.1111/cdev.12974) [find](https://scholar.google.com/scholar?q=Alejandrina+Cristia%2C+Emmanuel+Dupoux%2C+Michael+Gurven%2C+and+Jonathan+Stieglitz%2E+Child%2DDirected+Speech+Is+Infrequent+in+a+Forager%2DFarmer+Population%3A+A+Time+Allocation+Study%2E+Child+Development%2C+90%283%29%3A759%E2%80%93)
56. Róbert Csordás, Kazuki Irie, and Juergen Schmidhuber. The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 619–634, Online and Punta Cana, Dominican Republic, Nove… [find](https://scholar.google.com/scholar?q=R%C3%B3bert+Csord%C3%A1s%2C+Kazuki+Irie%2C+and+Juergen+Schmidhuber%2E+The+Devil+is+in+the+Detail%3A+Simple+Tricks+Improve+Systematic+Generalization+of+Transformers%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Me)
57. Peter W. Culicover and Ray Jackendoff. Simpler Syntax. OUP Oxford, July 2005. ISBN 978-0-19-153380-8. [find](https://scholar.google.com/scholar?q=Peter+W%2E+Culicover+and+Ray+Jackendoff%2E+Simpler+Syntax%2E+OUP+Oxford%2C+July+2005%2E+ISBN+978%2D0%2D19%2D153380%2D8%2E)
58. Maksymilian Dąbkowski and Gašper Beguš. Large language models and (non-)linguistic recursion, June 2023. [find](https://scholar.google.com/scholar?q=Maksymilian+D%C4%85bkowski+and+Ga%C5%A1per+Begu%C5%A1%2E+Large+language+models+and+%28non%2D%29linguistic+recursion%2C+June+2023%2E)
59. Iria de-Dios-Flores and Marcos Garcia. A computational psycholinguistic evaluation of the syntactic abilities of Galician BERT models at the interface of dependency resolution and training time, June 2022. [find](https://scholar.google.com/scholar?q=Iria+de%2DDios%2DFlores+and+Marcos+Garcia%2E+A+computational+psycholinguistic+evaluation+of+the+syntactic+abilities+of+Galician+BERT+models+at+the+interface+of+dependency+resolution+and+training+time%2C+June+)
60. Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, and Richard Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391–407, 1990. ISSN 1097-4571. doi: 10.1002/(SICI)1097-4571(199009)41:6\\<391::AID-ASI1\>3.0.CO;2-9. — [doi:10.1002/(sici)1097-4571(199009)41:6](https://doi.org/10.1002/%28sici%291097-4571%28199009%2941:6) [find](https://scholar.google.com/scholar?q=Scott+Deerwester%2C+Susan+T%2E+Dumais%2C+George+W%2E+Furnas%2C+Thomas+K%2E+Landauer%2C+and+Richard+Harshman%2E+Indexing+by+latent+semantic+analysis%2E+Journal+of+the+American+Society+for+Information+Science%2C+41%286%29%3A391%E2%80%93)
61. Gregoire Deletang, Anian Ruoss, Jordi Grau-Moya, Tim Genewein, Li Kevin Wenliang, Elliot Catt, Chris Cundy, Marcus Hutter, Shane Legg, Joel Veness, and Pedro A. Ortega. [Neural Networks and the Chomsky Hierarchy](https://md.research.elamur.ai/free/en/papers/deletang-2022-neural-networks-chomsky-hierarchy/). In The Eleventh International Conference on Learning Representations, September 2022.
62. Vittoria Dentella, Fritz Günther, and Evelina Leivada. Systematic testing of three Language Models reveals low language accuracy, absence of response stability, and a yes-response bias. Proceedings of the National Academy of Sciences, 120(51):e2309583120, December 2023. doi: 10.1073/pnas.2309583120. — [doi:10.1073/pnas.2309583120](https://doi.org/10.1073/pnas.2309583120) [find](https://scholar.google.com/scholar?q=Vittoria+Dentella%2C+Fritz+G%C3%BCnther%2C+and+Evelina+Leivada%2E+Systematic+testing+of+three+Language+Models+reveals+low+language+accuracy%2C+absence+of+response+stability%2C+and+a+yes%2Dresponse+bias%2E+Proceedings+of)
63. Vittoria Dentella, Fritz Guenther, and Evelina Leivada. Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans, April 2024. [find](https://scholar.google.com/scholar?q=Vittoria+Dentella%2C+Fritz+Guenther%2C+and+Evelina+Leivada%2E+Language+in+Vivo+vs%2E+in+Silico%3A+Size+Matters+but+Larger+Language+Models+Still+Do+Not+Comprehend+Language+on+a+Par+with+Humans%2C+April+2024%2E)
64. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). arXiv:1810.04805 [cs], October 2018.
65. Adrien Doerig, Rowan P. Sommers, Katja Seeliger, Blake Richards, Jenann Ismael, Grace W. Lindsay, Konrad P. Kording, Talia Konkle, Marcel A. J. van Gerven, Nikolaus Kriegeskorte, and Tim C. Kietzmann. The neuroconnectionist research programme. Nature Reviews Neuroscience, 24(7): 431–450, July 2023.… — [doi:10.1038/s41583-023-00705-w](https://doi.org/10.1038/s41583-023-00705-w) [find](https://scholar.google.com/scholar?q=Adrien+Doerig%2C+Rowan+P%2E+Sommers%2C+Katja+Seeliger%2C+Blake+Richards%2C+Jenann+Ismael%2C+Grace+W%2E+Lindsay%2C+Konrad+P%2E+Kording%2C+Talia+Konkle%2C+Marcel+A%2E+J%2E+van+Gerven%2C+Nikolaus+Kriegeskorte%2C+and+Tim+C%2E+Kietzmann%2E)
66. Lucia Donatelli and Alexander Koller. Compositionality in Computational Linguistics. Annual Review of Linguistics, 9(1):463–481, 2023. doi: 10.1146/annurev-linguistics-030521-044439. — [doi:10.1146/annurev-linguistics-030521-044439](https://doi.org/10.1146/annurev-linguistics-030521-044439) [find](https://scholar.google.com/scholar?q=Lucia+Donatelli+and+Alexander+Koller%2E+Compositionality+in+Computational+Linguistics%2E+Annual+Review+of+Linguistics%2C+9%281%29%3A463%E2%80%93481%2C+2023%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D030521%2D044439%2E+%E2%80%94+%5Bdoi%3A10%2E1146%2Fan)
67. Gabe Dupre. Empiricism, syntax, and ontogeny. Philosophical Psychology, 34(7):1011–1046, October 2021a. ISSN 0951-5089. doi: 10.1080/09515089.2021.1937591. — [doi:10.1080/09515089.2021.1937591](https://doi.org/10.1080/09515089.2021.1937591) [find](https://scholar.google.com/scholar?q=Gabe+Dupre%2E+Empiricism%2C+syntax%2C+and+ontogeny%2E+Philosophical+Psychology%2C+34%287%29%3A1011%E2%80%931046%2C+October+2021a%2E+ISSN+0951%2D5089%2E+doi%3A+10%2E1080%2F09515089%2E2021%2E1937591%2E+%E2%80%94+%5Bdoi%3A10%2E1080%2F09515089%2E2021%2E1937591%5D%28https%3A)
68. Gabe Dupre. (What) Can Deep Learning Contribute to Theoretical Linguistics? Minds and Machines, 31(4):617–635, December 2021b. ISSN 1572-8641. doi: 10.1007/s11023-021-09571-w. — [doi:10.1007/s11023-021-09571-w](https://doi.org/10.1007/s11023-021-09571-w) [find](https://scholar.google.com/scholar?q=Gabe+Dupre%2E+%28What%29+Can+Deep+Learning+Contribute+to+Theoretical+Linguistics%3F+Minds+and+Machines%2C+31%284%29%3A617%E2%80%93635%2C+December+2021b%2E+ISSN+1572%2D8641%2E+doi%3A+10%2E1007%2Fs11023%2D021%2D09571%2Dw%2E+%E2%80%94+%5Bdoi%3A10%2E1007%2Fs11023%2D02)
69. Paul Egré. Explanation in Linguistics. Philosophy Compass, 10(7):451–462, 2015. ISSN 1747-9991. doi: 10.1111/phc3.12225. — [doi:10.1111/phc3.12225](https://doi.org/10.1111/phc3.12225) [find](https://scholar.google.com/scholar?q=Paul+Egr%C3%A9%2E+Explanation+in+Linguistics%2E+Philosophy+Compass%2C+10%287%29%3A451%E2%80%93462%2C+2015%2E+ISSN+1747%2D9991%2E+doi%3A+10%2E1111%2Fphc3%2E12225%2E+%E2%80%94+%5Bdoi%3A10%2E1111%2Fphc3%2E12225%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1111%2Fphc3%2E12225%29)
70. Yanai Elazar, Shauli Ravfogel, Alon Jacovi, and Yoav Goldberg. [Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals](https://md.research.elamur.ai/free/en/papers/elazar-2021-amnesic-probing-behavioral-explanation-amnesic/). Transactions of the Association for Computational Linguistics, 9:160–175, March 2021. ISSN 2307-387X. doi: 10.1162/tacl_a_00359.
71. Ronen Eldan and Yuanzhi Li. [TinyStories: How Small Can Language Models Be and Still Speak Coherent English?](https://md.research.elamur.ai/free/en/papers/eldan-2023-tinystories-small-language-models-still/), May 2023.
72. Nelson Elhage, Neel Nanda, Catherine Olsson, Tom Henighan, Nicholas Joseph, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amodei, Tom Brown, Ja… [find](https://scholar.google.com/scholar?q=Nelson+Elhage%2C+Neel+Nanda%2C+Catherine+Olsson%2C+Tom+Henighan%2C+Nicholas+Joseph%2C+Ben+Mann%2C+Amanda+Askell%2C+Yuntao+Bai%2C+Anna+Chen%2C+Tom+Conerly%2C+Nova+DasSarma%2C+Dawn+Drain%2C+Deep+Ganguli%2C+Zac+Hatfield%2DDodds%2C+Da)
73. Jeffrey L. Elman. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7(2):195–225, September 1991. ISSN 1573-0565. doi: 10.1007/BF00114844. — [doi:10.1007/bf00114844](https://doi.org/10.1007/bf00114844) [find](https://scholar.google.com/scholar?q=Jeffrey+L%2E+Elman%2E+Distributed+representations%2C+simple+recurrent+networks%2C+and+grammatical+structure%2E+Machine+Learning%2C+7%282%29%3A195%E2%80%93225%2C+September+1991%2E+ISSN+1573%2D0565%2E+doi%3A+10%2E1007%2FBF00114844%2E+%E2%80%94+%5Bdoi%3A10%2E)
74. Jeffrey L. Elman, Elizabeth A. Bates, Mark H. Johnson, and Annette Karmiloff-Smith. Rethinking Innateness: A Connectionist Perspective on Development. Rethinking Innateness: A Connectionist Perspective on Development. The MIT Press, Cambridge, MA, US, 1996. ISBN 978-0-262-05052-4. [find](https://scholar.google.com/scholar?q=Jeffrey+L%2E+Elman%2C+Elizabeth+A%2E+Bates%2C+Mark+H%2E+Johnson%2C+and+Annette+Karmiloff%2DSmith%2E+Rethinking+Innateness%3A+A+Connectionist+Perspective+on+Development%2E+Rethinking+Innateness%3A+A+Connectionist+Perspectiv)
75. Katrin Erk. Towards a semantics for distributional representations. In Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers, pages 95–106, Potsdam, Germany, March 2013. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Katrin+Erk%2E+Towards+a+semantics+for+distributional+representations%2E+In+Proceedings+of+the+10th+International+Conference+on+Computational+Semantics+%28IWCS+2013%29+%E2%80%93+Long+Papers%2C+pages+95%E2%80%93106%2C+Potsdam%2C+Ger)
76. Katrin Erk. The Probabilistic Turn in Semantics and Pragmatics. Annual Review of Linguistics, 8 (1):101–121, 2022. doi: 10.1146/annurev-linguistics-031120-015515. — [doi:10.1146/annurev-linguistics-031120-015515](https://doi.org/10.1146/annurev-linguistics-031120-015515) [find](https://scholar.google.com/scholar?q=Katrin+Erk%2E+The+Probabilistic+Turn+in+Semantics+and+Pragmatics%2E+Annual+Review+of+Linguistics%2C+8+%281%29%3A101%E2%80%93121%2C+2022%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D031120%2D015515%2E+%E2%80%94+%5Bdoi%3A10%2E1146%2Fannurev%2Dlinguistics%2D03)
77. Linnea Evanson, Yair Lakretz, and Jean-Rémi King. [Language acquisition: Do children and language models follow similar learning stages?](https://md.research.elamur.ai/free/en/papers/evanson-2023-language-acquisition-children-language-models/), June 2023.
78. Martin B. H. Everaert, Marinus A. C. Huybregts, Noam Chomsky, Robert C. Berwick, and Johan J. Bolhuis. Structures, Not Strings: Linguistics as Part of the Cognitive Sciences. Trends in Cognitive Sciences, 19(12):729–743, December 2015. ISSN 1364-6613. doi: 10.1016/j.tics.2015.09.008. — [doi:10.1016/j.tics.2015.09.008](https://doi.org/10.1016/j.tics.2015.09.008) [find](https://scholar.google.com/scholar?q=Martin+B%2E+H%2E+Everaert%2C+Marinus+A%2E+C%2E+Huybregts%2C+Noam+Chomsky%2C+Robert+C%2E+Berwick%2C+and+Johan+J%2E+Bolhuis%2E+Structures%2C+Not+Strings%3A+Linguistics+as+Part+of+the+Cognitive+Sciences%2E+Trends+in+Cognitive+Scien)
79. Chaz Firestone. Performance vs. competence in human–machine comparisons. Proceedings of the National Academy of Sciences, 117(43):26562–26571, October 2020. ISSN 0027-8424, 1091-6490. doi: 10.1073/pnas.1905334117. — [doi:10.1073/pnas.1905334117](https://doi.org/10.1073/pnas.1905334117) [find](https://scholar.google.com/scholar?q=Chaz+Firestone%2E+Performance+vs%2E+competence+in+human%E2%80%93machine+comparisons%2E+Proceedings+of+the+National+Academy+of+Sciences%2C+117%2843%29%3A26562%E2%80%9326571%2C+October+2020%2E+ISSN+0027%2D8424%2C+1091%2D6490%2E+doi%3A+10%2E1073%2Fpna)
80. John R. Firth. A synopsis of linguistic theory, 1930-1955. Studies in linguistic analysis, 1957. [find](https://scholar.google.com/scholar?q=John+R%2E+Firth%2E+A+synopsis+of+linguistic+theory%2C+1930%2D1955%2E+Studies+in+linguistic+analysis%2C+1957%2E)
81. Jerry A. Fodor and Zenon W. Pylyshyn. Connectionism and cognitive architecture: A critical analysis. Cognition, 28(1):3–71, March 1988. ISSN 0010-0277. doi: 10.1016/0010-0277(88)90031-5. — [doi:10.1016/0010-0277(88)90031-5](https://doi.org/10.1016/0010-0277%2888%2990031-5) [find](https://scholar.google.com/scholar?q=Jerry+A%2E+Fodor+and+Zenon+W%2E+Pylyshyn%2E+Connectionism+and+cognitive+architecture%3A+A+critical+analysis%2E+Cognition%2C+28%281%29%3A3%E2%80%9371%2C+March+1988%2E+ISSN+0010%2D0277%2E+doi%3A+10%2E1016%2F0010%2D0277%2888%2990031%2D5%2E+%E2%80%94+%5Bdoi%3A10%2E101)
82. Birte U. Forstmann and Eric-Jan Wagenmakers. Model-Based Cognitive Neuroscience: A Conceptual Introduction. In Birte U. Forstmann and Eric-Jan Wagenmakers, editors, An Introduction to Model-Based Cognitive Neuroscience, pages 139–156. Springer, New York, NY, 2015. ISBN 978-1-4939-2236-9. doi: 10.100… — [doi:10.1007/978-1-4939-2236-9_7](https://doi.org/10.1007/978-1-4939-2236-9_7) [find](https://scholar.google.com/scholar?q=Birte+U%2E+Forstmann+and+Eric%2DJan+Wagenmakers%2E+Model%2DBased+Cognitive+Neuroscience%3A+A+Conceptual+Introduction%2E+In+Birte+U%2E+Forstmann+and+Eric%2DJan+Wagenmakers%2C+editors%2C+An+Introduction+to+Model%2DBased+Cogn)
83. Michael C. Frank. Baby steps in evaluating the capacities of large language models. Nature Reviews Psychology, 2(8):451–452, August 2023a. ISSN 2731-0574. doi: 10.1038/s44159-023-00211-x. — [doi:10.1038/s44159-023-00211-x](https://doi.org/10.1038/s44159-023-00211-x) [find](https://scholar.google.com/scholar?q=Michael+C%2E+Frank%2E+Baby+steps+in+evaluating+the+capacities+of+large+language+models%2E+Nature+Reviews+Psychology%2C+2%288%29%3A451%E2%80%93452%2C+August+2023a%2E+ISSN+2731%2D0574%2E+doi%3A+10%2E1038%2Fs44159%2D023%2D00211%2Dx%2E+%E2%80%94+%5Bdoi%3A10%2E10)
84. Michael C. Frank. Bridging the data gap between children and large language models, June 2023b. [find](https://scholar.google.com/scholar?q=Michael+C%2E+Frank%2E+Bridging+the+data+gap+between+children+and+large+language+models%2C+June+2023b%2E)
85. Michael C. Frank. Large language models as models of human cognition, July 2023c. [find](https://scholar.google.com/scholar?q=Michael+C%2E+Frank%2E+Large+language+models+as+models+of+human+cognition%2C+July+2023c%2E)
86. Richard Futrell, Ethan Wilcox, Takashi Morita, Peng Qian, Miguel Ballesteros, and Roger Levy. [Neural language models as psycholinguistic subjects: Representations of syntactic state](https://md.research.elamur.ai/free/en/papers/futrell-2019-neural-language-models-as-psycholinguistic/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:…
87. Jon Gauthier, Jennifer Hu, Ethan Wilcox, Peng Qian, and Roger Levy. [SyntaxGym: An Online Platform for Targeted Evaluation of Language Models](https://md.research.elamur.ai/free/en/papers/gauthier-2020-syntaxgym-online-platform-targeted-evaluation/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 70–76, Online, July 2020. Association…
88. David Gil. Riau Indonesian as a Pivotless Language. In Tipologija i Teorija Jazyka, Ot Opisanija k Objasneniju, K 60-Letiju Aleksandra Evgen’evicha Kibrika (Typology and Linguistic Theory, From Description to Explanation, For the 60th Birthday of Aleksandr E. Kibrik), pages 187–211. Jazyki russkoj k… [find](https://scholar.google.com/scholar?q=David+Gil%2E+Riau+Indonesian+as+a+Pivotless+Language%2E+In+Tipologija+i+Teorija+Jazyka%2C+Ot+Opisanija+k+Objasneniju%2C+K+60%2DLetiju+Aleksandra+Evgen%E2%80%99evicha+Kibrika+%28Typology+and+Linguistic+Theory%2C+From+Descri)
89. Mario Giulianelli, Jack Harding, Florian Mohnert, Dieuwke Hupkes, and Willem Zuidema. Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Netw… [find](https://scholar.google.com/scholar?q=Mario+Giulianelli%2C+Jack+Harding%2C+Florian+Mohnert%2C+Dieuwke+Hupkes%2C+and+Willem+Zuidema%2E+Under+the+Hood%3A+Using+Diagnostic+Classifiers+to+Investigate+and+Improve+how+Language+Models+Track+Agreement+Inform)
90. E Mark Gold. Language identification in the limit. Information and Control, 10(5):447–474, May 1967. ISSN 0019-9958. doi: 10.1016/S0019-9958(67)91165-5. [find](https://scholar.google.com/scholar?q=E+Mark+Gold%2E+Language+identification+in+the+limit%2E+Information+and+Control%2C+10%285%29%3A447%E2%80%93474%2C+May+1967%2E+ISSN+0019%2D9958%2E+doi%3A+10%2E1016%2FS0019%2D9958%2867%2991165%2D5%2E)
91. Yoav Goldberg. Assessing BERT’s Syntactic Abilities, January 2019. — [Assessing BERT's Syntactic Abilities](https://md.research.elamur.ai/free/en/papers/goldberg-2019-assessing-bert-s-syntactic-abilities/)
92. Kristina Gulordava, Piotr Bojanowski, Edouard Grave, Tal Linzen, and Marco Baroni. [Colorless Green Recurrent Networks Dream Hierarchically](https://md.research.elamur.ai/free/en/papers/gulordava-2018-colorless-green-recurrent-networks-dream/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Lon…
93. Michael Hahn. Theoretical Limitations of Self-Attention in Neural Sequence Models. Transactions of the Association for Computational Linguistics, 8:156–171, January 2020. ISSN 2307-387X. doi: 10.1162/tacl_a_00306. [find](https://scholar.google.com/scholar?q=Michael+Hahn%2E+Theoretical+Limitations+of+Self%2DAttention+in+Neural+Sequence+Models%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+8%3A156%E2%80%93171%2C+January+2020%2E+ISSN+2307%2D387X%2E+doi%3A+10%2E1162%2F)
94. William L. Hamilton, Jure Leskovec, and Dan Jurafsky. [Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change](https://md.research.elamur.ai/free/en/papers/hamilton-2016-diachronic-word-embeddings-reveal-statistical/). In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1489–1501, Berlin, Germany, August 2016. Association…
95. Sophie Hao and Tal Linzen. Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number, October 2023. [find](https://scholar.google.com/scholar?q=Sophie+Hao+and+Tal+Linzen%2E+Verb+Conjugation+in+Transformers+Is+Determined+by+Linear+Encodings+of+Subject+Number%2C+October+2023%2E)
96. Jacqueline Harding. Operationalising Representation in Natural Language Processing, June 2023. [find](https://scholar.google.com/scholar?q=Jacqueline+Harding%2E+Operationalising+Representation+in+Natural+Language+Processing%2C+June+2023%2E)
97. Zellig S. Harris. Distributional Structure. Word, 10:146–162, 1954. doi: 10.1080/00437956.1954.1165 9520. [find](https://scholar.google.com/scholar?q=Zellig+S%2E+Harris%2E+Distributional+Structure%2E+Word%2C+10%3A146%E2%80%93162%2C+1954%2E+doi%3A+10%2E1080%2F00437956%2E1954%2E1165+9520%2E)
98. Marc D. Hauser, Noam Chomsky, and W. Tecumseh Fitch. The Faculty of Language: What Is It, Who Has It, and How Did It Evolve? Science, 298(5598):1569–1579, November 2002. doi: 10.1126/science.298.5598.1569. — [doi:10.1126/science.298.5598.1569](https://doi.org/10.1126/science.298.5598.1569) [find](https://scholar.google.com/scholar?q=Marc+D%2E+Hauser%2C+Noam+Chomsky%2C+and+W%2E+Tecumseh+Fitch%2E+The+Faculty+of+Language%3A+What+Is+It%2C+Who+Has+It%2C+and+How+Did+It+Evolve%3F+Science%2C+298%285598%29%3A1569%E2%80%931579%2C+November+2002%2E+doi%3A+10%2E1126%2Fscience%2E298%2E5598%2E)
99. Aurélie Herbelot and Eva Maria Vecchi. Building a shared world: Mapping distributional to model-theoretic semantic spaces. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 22–32, Lisbon, Portugal, September 2015. Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Aur%C3%A9lie+Herbelot+and+Eva+Maria+Vecchi%2E+Building+a+shared+world%3A+Mapping+distributional+to+model%2Dtheoretic+semantic+spaces%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural+Languag)
100. John Hewitt and Percy Liang. Designing and Interpreting Probes with Control Tasks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 2733–2743, Hong Kong, China, No… [find](https://scholar.google.com/scholar?q=John+Hewitt+and+Percy+Liang%2E+Designing+and+Interpreting+Probes+with+Control+Tasks%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th+International+J)
101. Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, E… — [Training Compute-Optimal Large Language Models](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/)
102. Phu Mon Htut, Jason Phang, Shikha Bordia, and Samuel R. Bowman. Do Attention Heads in BERT Track Syntactic Dependencies?, November 2019. [find](https://scholar.google.com/scholar?q=Phu+Mon+Htut%2C+Jason+Phang%2C+Shikha+Bordia%2C+and+Samuel+R%2E+Bowman%2E+Do+Attention+Heads+in+BERT+Track+Syntactic+Dependencies%3F%2C+November+2019%2E)
103. Jennifer Hu and Michael C. Frank. [Auxiliary task demands mask the capabilities of smaller language models](https://md.research.elamur.ai/free/en/papers/hu-2024-auxiliary-task-demands-mask-capabilities/), April 2024.
104. Jennifer Hu and Roger Levy. Prompt-based methods may underestimate large language models’ linguistic generalizations, May 2023. [find](https://scholar.google.com/scholar?q=Jennifer+Hu+and+Roger+Levy%2E+Prompt%2Dbased+methods+may+underestimate+large+language+models%E2%80%99+linguistic+generalizations%2C+May+2023%2E)
105. Jennifer Hu, Jon Gauthier, Peng Qian, Ethan Wilcox, and Roger Levy. A Systematic Assessment of Syntactic Generalization in Neural Language Models. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1725–1744, Online, July 2020. Association for Computati… [find](https://scholar.google.com/scholar?q=Jennifer+Hu%2C+Jon+Gauthier%2C+Peng+Qian%2C+Ethan+Wilcox%2C+and+Roger+Levy%2E+A+Systematic+Assessment+of+Syntactic+Generalization+in+Neural+Language+Models%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Asso)
106. Jennifer Hu, Kyle Mahowald, Gary Lupyan, Anna Ivanova, and Roger Levy. Language models align with human judgments on key grammatical constructions, January 2024. [find](https://scholar.google.com/scholar?q=Jennifer+Hu%2C+Kyle+Mahowald%2C+Gary+Lupyan%2C+Anna+Ivanova%2C+and+Roger+Levy%2E+Language+models+align+with+human+judgments+on+key+grammatical+constructions%2C+January+2024%2E)
107. Yi Ting Huang, Kathryn Leech, and Meredith L. Rowe. Exploring socioeconomic differences in syntactic development through the lens of real-time processing. Cognition, 159:61–75, February 2017. ISSN 0010-0277. doi: 10.1016/j.cognition.2016.11.004. — [doi:10.1016/j.cognition.2016.11.004](https://doi.org/10.1016/j.cognition.2016.11.004) [find](https://scholar.google.com/scholar?q=Yi+Ting+Huang%2C+Kathryn+Leech%2C+and+Meredith+L%2E+Rowe%2E+Exploring+socioeconomic+differences+in+syntactic+development+through+the+lens+of+real%2Dtime+processing%2E+Cognition%2C+159%3A61%E2%80%9375%2C+February+2017%2E+ISSN+001)
108. Dieuwke Hupkes, Sara Veldhoen, and Willem Zuidema. Visualisation and ’Diagnostic Classifiers’ Reveal How Recurrent and Recursive Neural Networks Process Hierarchical Structure. Journal of Artificial Intelligence Research, 61:907–926, April 2018. ISSN 1076-9757. doi: 10.1613/jair.1.11196. — [doi:10.1613/jair.1.11196](https://doi.org/10.1613/jair.1.11196) [find](https://scholar.google.com/scholar?q=Dieuwke+Hupkes%2C+Sara+Veldhoen%2C+and+Willem+Zuidema%2E+Visualisation+and+%E2%80%99Diagnostic+Classifiers%E2%80%99+Reveal+How+Recurrent+and+Recursive+Neural+Networks+Process+Hierarchical+Structure%2E+Journal+of+Artificial+I)
109. Janellen Huttenlocher, Marina Vasilyeva, Elina Cymerman, and Susan Levine. Language input and child syntax. Cognitive Psychology, 45(3):337–374, November 2002. ISSN 0010-0285. doi: 10.1016/S0010-0285(02)00500-5. — [doi:10.1016/s0010-0285(02)00500-5](https://doi.org/10.1016/s0010-0285%2802%2900500-5) [find](https://scholar.google.com/scholar?q=Janellen+Huttenlocher%2C+Marina+Vasilyeva%2C+Elina+Cymerman%2C+and+Susan+Levine%2E+Language+input+and+child+syntax%2E+Cognitive+Psychology%2C+45%283%29%3A337%E2%80%93374%2C+November+2002%2E+ISSN+0010%2D0285%2E+doi%3A+10%2E1016%2FS0010%2D0285%28)
110. Anna A. Ivanova, John Hewitt, and Noga Zaslavsky. Probing artificial neural networks: Insights from neuroscience, April 2021. [find](https://scholar.google.com/scholar?q=Anna+A%2E+Ivanova%2C+John+Hewitt%2C+and+Noga+Zaslavsky%2E+Probing+artificial+neural+networks%3A+Insights+from+neuroscience%2C+April+2021%2E)
111. Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. [What Does BERT Learn about the Structure of Language?](https://md.research.elamur.ai/free/en/papers/jawahar-2019-what-does-bert-learn-about/) In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3651–3657, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10.18653/v1/P…
112. Julie Kallini, Isabel Papadimitriou, Richard Futrell, Kyle Mahowald, and Christopher Potts. [Mission: Impossible Language Models](https://md.research.elamur.ai/free/en/papers/kallini-2024-mission-impossible-language-models/), January 2024.
113. Jerrold J. Katz and Jerry A. Fodor. The Structure of a Semantic Theory. Language, 39(2):170–210, 1963. ISSN 0097-8507. doi: 10.2307/411200. — [doi:10.2307/411200](https://doi.org/10.2307/411200) [find](https://scholar.google.com/scholar?q=Jerrold+J%2E+Katz+and+Jerry+A%2E+Fodor%2E+The+Structure+of+a+Semantic+Theory%2E+Language%2C+39%282%29%3A170%E2%80%93210%2C+1963%2E+ISSN+0097%2D8507%2E+doi%3A+10%2E2307%2F411200%2E+%E2%80%94+%5Bdoi%3A10%2E2307%2F411200%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E2307%2F411200%29)
114. Roni Katzir. Why large language models are poor theories of human linguistic cognition. A reply to Piantadosi (2023)., April 2023. [find](https://scholar.google.com/scholar?q=Roni+Katzir%2E+Why+large+language+models+are+poor+theories+of+human+linguistic+cognition%2E+A+reply+to+Piantadosi+%282023%29%2E%2C+April+2023%2E)
115. Daniel Keysers, Nathanael Schärli, Nathan Scales, Hylke Buisman, Daniel Furrer, Sergii Kashubin, Nikola Momchev, Danila Sinopalnikov, Lukasz Stafiniak, Tibor Tihon, Dmitry Tsarkov, Xiao Wang, Marc van Zee, and Olivier Bousquet. Measuring Compositional Generalization: A Comprehensive Method on Realis… [find](https://scholar.google.com/scholar?q=Daniel+Keysers%2C+Nathanael+Sch%C3%A4rli%2C+Nathan+Scales%2C+Hylke+Buisman%2C+Daniel+Furrer%2C+Sergii+Kashubin%2C+Nikola+Momchev%2C+Danila+Sinopalnikov%2C+Lukasz+Stafiniak%2C+Tibor+Tihon%2C+Dmitry+Tsarkov%2C+Xiao+Wang%2C+Marc+van)
116. Najoung Kim and Tal Linzen. COGS: A Compositional Generalization Challenge Based on Semantic Interpretation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 9087–9105, Online, November 2020. Association for Computational Linguistics. doi: 10.1… [find](https://scholar.google.com/scholar?q=Najoung+Kim+and+Tal+Linzen%2E+COGS%3A+A+Compositional+Generalization+Challenge+Based+on+Semantic+Interpretation%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28)
117. Najoung Kim, Tal Linzen, and Paul Smolensky. Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models, December 2022. [find](https://scholar.google.com/scholar?q=Najoung+Kim%2C+Tal+Linzen%2C+and+Paul+Smolensky%2E+Uncontrolled+Lexical+Exposure+Leads+to+Overestimation+of+Compositional+Generalization+in+Pretrained+Models%2C+December+2022%2E)
118. Taeuk Kim, Jihun Choi, Daniel Edmiston, and Sang-goo Lee. Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction. In International Conference on Learning Representations, September 2019. [find](https://scholar.google.com/scholar?q=Taeuk+Kim%2C+Jihun+Choi%2C+Daniel+Edmiston%2C+and+Sang%2Dgoo+Lee%2E+Are+Pre%2Dtrained+Language+Models+Aware+of+Phrases%3F+Simple+but+Strong+Baselines+for+Grammar+Induction%2E+In+International+Conference+on+Learning+R)
119. Yoon Kim, Yi-I Chiu, Kentaro Hanaki, Darshan Hegde, and Slav Petrov. [Temporal Analysis of Language through Neural Language Models](https://md.research.elamur.ai/free/en/papers/kim-2014-temporal-analysis-language-through-neural/). In Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science, pages 61–65, Baltimore, MD, USA, June 2014. Association for Computatio…
120. Nikolaus Kriegeskorte, Marieke Mur, and Peter Bandettini. Representational similarity analysis - connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience, 2, 2008. ISSN 1662-5137. [find](https://scholar.google.com/scholar?q=Nikolaus+Kriegeskorte%2C+Marieke+Mur%2C+and+Peter+Bandettini%2E+Representational+similarity+analysis+%2D+connecting+the+branches+of+systems+neuroscience%2E+Frontiers+in+Systems+Neuroscience%2C+2%2C+2008%2E+ISSN+1662%2D)
121. Brenden Lake and Marco Baroni. Generalization without Systematicity: On the Compositional Skills of Sequence-to-Sequence Recurrent Networks. In Proceedings of the 35th International Conference on Machine Learning, pages 2873–2882. PMLR, July 2018. [find](https://scholar.google.com/scholar?q=Brenden+Lake+and+Marco+Baroni%2E+Generalization+without+Systematicity%3A+On+the+Compositional+Skills+of+Sequence%2Dto%2DSequence+Recurrent+Networks%2E+In+Proceedings+of+the+35th+International+Conference+on+Mach)
122. Brenden M Lake. Compositional generalization through meta sequence-to-sequence learning. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019. [find](https://scholar.google.com/scholar?q=Brenden+M+Lake%2E+Compositional+generalization+through+meta+sequence%2Dto%2Dsequence+learning%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+32%2E+Curran+Associates%2C+Inc%2E%2C+2019%2E)
123. Brenden M. Lake and Marco Baroni. Human-like systematic generalization through a meta-learning neural network. Nature, pages 1–7, October 2023. ISSN 1476-4687. doi: 10.1038/s41586-023-06668-3. [find](https://scholar.google.com/scholar?q=Brenden+M%2E+Lake+and+Marco+Baroni%2E+Human%2Dlike+systematic+generalization+through+a+meta%2Dlearning+neural+network%2E+Nature%2C+pages+1%E2%80%937%2C+October+2023%2E+ISSN+1476%2D4687%2E+doi%3A+10%2E1038%2Fs41586%2D023%2D06668%2D3%2E)
124. Kushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Abdelrahman Mohamed, and Emmanuel Dupoux. [On Generative Spoken Language Modeling from Raw Audio](https://md.research.elamur.ai/free/en/papers/lakhotia-2021-generative-spoken-language-modeling-raw/). Transactions of the Association for Computational Linguistics, 9:1336–…
125. Yair Lakretz, Dieuwke Hupkes, Alessandra Vergallito, Marco Marelli, Marco Baroni, and Stanislas Dehaene. Mechanisms for handling nested dependencies in neural-network language models and humans. Cognition, 213:104699, August 2021. ISSN 0010-0277. doi: 10.1016/j.cognition.2021.104 699. — [doi:10.1016/j.cognition.2021.104](https://doi.org/10.1016/j.cognition.2021.104) [find](https://scholar.google.com/scholar?q=Yair+Lakretz%2C+Dieuwke+Hupkes%2C+Alessandra+Vergallito%2C+Marco+Marelli%2C+Marco+Baroni%2C+and+Stanislas+Dehaene%2E+Mechanisms+for+handling+nested+dependencies+in+neural%2Dnetwork+language+models+and+humans%2E+Cogni)
126. Yair Lakretz, Théo Desbordes, Dieuwke Hupkes, and Stanislas Dehaene. Can Transformers Process Recursive Nested Constructions, Like Humans? In Proceedings of the 29th International Conference on Computational Linguistics, pages 3226–3232, Gyeongju, Republic of Korea, October 2022. International Commi… [find](https://scholar.google.com/scholar?q=Yair+Lakretz%2C+Th%C3%A9o+Desbordes%2C+Dieuwke+Hupkes%2C+and+Stanislas+Dehaene%2E+Can+Transformers+Process+Recursive+Nested+Constructions%2C+Like+Humans%3F+In+Proceedings+of+the+29th+International+Conference+on+Comput)
127. Andrew Kyle Lampinen. [Can language models handle recursively nested grammatical structures? A case study on comparing models and humans](https://md.research.elamur.ai/free/en/papers/lampinen-2024-can-language-models-handle-recursively/), February 2023.
128. Thomas K. Landauer and Susan T. Dumais. A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2):211–240, 1997. ISSN 1939-1471. doi: 10.1037/0033-295X.104.2.211. — [doi:10.1037/0033-295x.104.2.211](https://doi.org/10.1037/0033-295x.104.2.211) [find](https://scholar.google.com/scholar?q=Thomas+K%2E+Landauer+and+Susan+T%2E+Dumais%2E+A+solution+to+Plato%E2%80%99s+problem%3A+The+latent+semantic+analysis+theory+of+acquisition%2C+induction%2C+and+representation+of+knowledge%2E+Psychological+Review%2C+104%282%29%3A211%E2%80%93)
129. Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, and Ryan Cotterell. Probing for the Usage of Grammatical Number. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8818–8831, 2022. doi: 10.18653/v 1/2022.acl-long.… [find](https://scholar.google.com/scholar?q=Karim+Lasri%2C+Tiago+Pimentel%2C+Alessandro+Lenci%2C+Thierry+Poibeau%2C+and+Ryan+Cotterell%2E+Probing+for+the+Usage+of+Grammatical+Number%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Comput)
130. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. Nature, 521(7553):436–444, May 2015. ISSN 1476-4687. doi: 10.1038/nature14539. — [doi:10.1038/nature14539](https://doi.org/10.1038/nature14539) [find](https://scholar.google.com/scholar?q=Yann+LeCun%2C+Yoshua+Bengio%2C+and+Geoffrey+Hinton%2E+Deep+learning%2E+Nature%2C+521%287553%29%3A436%E2%80%93444%2C+May+2015%2E+ISSN+1476%2D4687%2E+doi%3A+10%2E1038%2Fnature14539%2E+%E2%80%94+%5Bdoi%3A10%2E1038%2Fnature14539%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1038%2Fnature)
131. Soo-Hwan Lee and Sebastian Schuster. [Can language models capture syntactic associations without surface cues? A case study of reflexive anaphor licensing in English control constructions](https://md.research.elamur.ai/free/en/papers/lee-2022-can-language-models-capture-syntactic/). In Proceedings of the Society for Computation in Linguistics 2022, pages 206–211, online, February 2022. Associa…
132. Evelina Leivada, Vittoria Dentella, and Fritz Günther. Evaluating the Language Abilities of Large Language Models vs. Humans: Three Caveats. Biolinguistics, 18:1–12, April 2024. ISSN 1450-3417. doi: 10.5964/bioling.14391. — [doi:10.5964/bioling.14391](https://doi.org/10.5964/bioling.14391) [find](https://scholar.google.com/scholar?q=Evelina+Leivada%2C+Vittoria+Dentella%2C+and+Fritz+G%C3%BCnther%2E+Evaluating+the+Language+Abilities+of+Large+Language+Models+vs%2E+Humans%3A+Three+Caveats%2E+Biolinguistics%2C+18%3A1%E2%80%9312%2C+April+2024%2E+ISSN+1450%2D3417%2E+doi%3A+1)
133. Alessandro Lenci. Distributional Models of Word Meaning. Annual Review of Linguistics, 4(1): 151–171, 2018. doi: 10.1146/annurev-linguistics-030514-125254. — [doi:10.1146/annurev-linguistics-030514-125254](https://doi.org/10.1146/annurev-linguistics-030514-125254) [find](https://scholar.google.com/scholar?q=Alessandro+Lenci%2E+Distributional+Models+of+Word+Meaning%2E+Annual+Review+of+Linguistics%2C+4%281%29%3A+151%E2%80%93171%2C+2018%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D030514%2D125254%2E+%E2%80%94+%5Bdoi%3A10%2E1146%2Fannurev%2Dlinguistics%2D030514%2D12)
134. Cara Su-Yi Leong and Tal Linzen. Testing learning hypotheses using neural networks by manipulating learning data, July 2024. [find](https://scholar.google.com/scholar?q=Cara+Su%2DYi+Leong+and+Tal+Linzen%2E+Testing+learning+hypotheses+using+neural+networks+by+manipulating+learning+data%2C+July+2024%2E)
135. Michael Lepori and R. Thomas McCoy. Picking BERT’s Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3637–3651, Barcelona, Spain (Online), Decembe… [find](https://scholar.google.com/scholar?q=Michael+Lepori+and+R%2E+Thomas+McCoy%2E+Picking+BERT%E2%80%99s+Brain%3A+Probing+for+Linguistic+Dependencies+in+Contextualized+Embeddings+Using+Representational+Similarity+Analysis%2E+In+Proceedings+of+the+28th+Intern)
136. Roger Levy. Expectation-based syntactic comprehension. Cognition, 106(3):1126–1177, March 2008. ISSN 0010-0277. doi: 10.1016/j.cognition.2007.05.006. — [doi:10.1016/j.cognition.2007.05.006](https://doi.org/10.1016/j.cognition.2007.05.006) [find](https://scholar.google.com/scholar?q=Roger+Levy%2E+Expectation%2Dbased+syntactic+comprehension%2E+Cognition%2C+106%283%29%3A1126%E2%80%931177%2C+March+2008%2E+ISSN+0010%2D0277%2E+doi%3A+10%2E1016%2Fj%2Ecognition%2E2007%2E05%2E006%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fj%2Ecognition%2E2007%2E05%2E006%5D%28https%3A%2F%2Fdo)
137. Bingzhi Li, Guillaume Wisniewski, and Benoit Crabbé. Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 4599–4610, Online and Punta Cana, Dominican Republic, Novemb… [find](https://scholar.google.com/scholar?q=Bingzhi+Li%2C+Guillaume+Wisniewski%2C+and+Benoit+Crabb%C3%A9%2E+Are+Transformers+a+Modern+Version+of+ELIZA%3F+Observations+on+French+Object+Verb+Agreement%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Method)
138. Yongjie Lin, Yi Chern Tan, and Robert Frank. Open Sesame: Getting inside BERT’s Linguistic Knowledge. In Proceedings of the 2019 [ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 241–253, Florence, Italy, August 2019](https://md.research.elamur.ai/free/en/papers/lin-2019-open-sesame-getting-inside-bert/). Association for Computational Linguistics. doi:…
139. Tal Linzen. What can linguistics and deep learning contribute to each other? Response to Pater. Language, 95(1):e99–e108, 2019. ISSN 1535-0665. doi: 10.1353/lan.2019.0015. — [doi:10.1353/lan.2019.0015](https://doi.org/10.1353/lan.2019.0015) [find](https://scholar.google.com/scholar?q=Tal+Linzen%2E+What+can+linguistics+and+deep+learning+contribute+to+each+other%3F+Response+to+Pater%2E+Language%2C+95%281%29%3Ae99%E2%80%93e108%2C+2019%2E+ISSN+1535%2D0665%2E+doi%3A+10%2E1353%2Flan%2E2019%2E0015%2E+%E2%80%94+%5Bdoi%3A10%2E1353%2Flan%2E2019%2E0015)
140. Tal Linzen and Marco Baroni. Syntactic Structure from Deep Learning. Annual Review of Linguistics, 7(1):195–212, 2021. doi: 10.1146/annurev-linguistics-032020-051035. [find](https://scholar.google.com/scholar?q=Tal+Linzen+and+Marco+Baroni%2E+Syntactic+Structure+from+Deep+Learning%2E+Annual+Review+of+Linguistics%2C+7%281%29%3A195%E2%80%93212%2C+2021%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D032020%2D051035%2E)
141. Tal Linzen, Emmanuel Dupoux, and Yoav Goldberg. [Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies](https://md.research.elamur.ai/free/en/papers/linzen-2016-assessing-ability-lstms-learn-syntax/). Transactions of the Association for Computational Linguistics, 4: 521–535, 2016. doi: 10.1162/tacl_a_00115.
142. Bingbin Liu, Jordan T. Ash, Surbhi Goel, Akshay Krishnamurthy, and Cyril Zhang. Transformers Learn Shortcuts to Automata. In The Eleventh International Conference on Learning Representations, September 2022. [find](https://scholar.google.com/scholar?q=Bingbin+Liu%2C+Jordan+T%2E+Ash%2C+Surbhi+Goel%2C+Akshay+Krishnamurthy%2C+and+Cyril+Zhang%2E+Transformers+Learn+Shortcuts+to+Automata%2E+In+The+Eleventh+International+Conference+on+Learning+Representations%2C+Septembe)
143. Nelson F. Liu, Matt Gardner, Yonatan Belinkov, Matthew E. Peters, and Noah A. Smith. [Linguistic Knowledge and Transferability of Contextual Representations](https://md.research.elamur.ai/free/en/papers/liu-2019-linguistic-knowledge-transferability-contextual-representations/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologi…
144. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/). CoRR, abs/1907.11692, 2019b.
145. Gary F. Marcus. Rethinking Eliminative Connectionism. Cognitive Psychology, 37(3):243–282, December 1998. ISSN 0010-0285. doi: 10.1006/cogp.1998.0694. — [doi:10.1006/cogp.1998.0694](https://doi.org/10.1006/cogp.1998.0694) [find](https://scholar.google.com/scholar?q=Gary+F%2E+Marcus%2E+Rethinking+Eliminative+Connectionism%2E+Cognitive+Psychology%2C+37%283%29%3A243%E2%80%93282%2C+December+1998%2E+ISSN+0010%2D0285%2E+doi%3A+10%2E1006%2Fcogp%2E1998%2E0694%2E+%E2%80%94+%5Bdoi%3A10%2E1006%2Fcogp%2E1998%2E0694%5D%28https%3A%2F%2Fdoi%2Eorg%2F10)
146. David Mareček and Rudolf Rosa. From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 263–275, Florence, Italy, August 2019. Association for Computational Lin… [find](https://scholar.google.com/scholar?q=David+Mare%C4%8Dek+and+Rudolf+Rosa%2E+From+Balustrades+to+Pierre+Vinken%3A+Looking+for+Syntax+in+Transformer+Self%2DAttentions%2E+In+Proceedings+of+the+2019+ACL+Workshop+BlackboxNLP%3A+Analyzing+and+Interpreting+Neu)
147. Samuel Marks, Can Rager, Eric J. Michaud, Yonatan Belinkov, David Bau, and Aaron Mueller. Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models, March 2024. [find](https://scholar.google.com/scholar?q=Samuel+Marks%2C+Can+Rager%2C+Eric+J%2E+Michaud%2C+Yonatan+Belinkov%2C+David+Bau%2C+and+Aaron+Mueller%2E+Sparse+Feature+Circuits%3A+Discovering+and+Editing+Interpretable+Causal+Graphs+in+Language+Models%2C+March+2024%2E)
148. Rebecca Marvin and Tal Linzen. Targeted Syntactic Evaluation of Language Models. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1192–1202, Brussels, Belgium, October 2018. Association for Computational Linguistics. doi: 10.18653/v1/D18-1151. [find](https://scholar.google.com/scholar?q=Rebecca+Marvin+and+Tal+Linzen%2E+Targeted+Syntactic+Evaluation+of+Language+Models%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+1192%E2%80%931202%2C+Brussels%2C+B)
149. R. Thomas McCoy and Thomas L. Griffiths. Modeling rapid language learning by distilling Bayesian priors into artificial neural networks, May 2023. [find](https://scholar.google.com/scholar?q=R%2E+Thomas+McCoy+and+Thomas+L%2E+Griffiths%2E+Modeling+rapid+language+learning+by+distilling+Bayesian+priors+into+artificial+neural+networks%2C+May+2023%2E)
150. Louise McNally and Gemma Boleda. Conceptual Versus Referential Affordance in Concept Composition. In James A. Hampton and Yoad Winter, editors, Compositionality and Concepts in Linguistics and Psychology, Language, Cognition, and Mind, pages 245–267. Springer International Publishing, Cham, 2017. IS… — [doi:10.1007/978-3-319-45977-6_10](https://doi.org/10.1007/978-3-319-45977-6_10) [find](https://scholar.google.com/scholar?q=Louise+McNally+and+Gemma+Boleda%2E+Conceptual+Versus+Referential+Affordance+in+Concept+Composition%2E+In+James+A%2E+Hampton+and+Yoad+Winter%2C+editors%2C+Compositionality+and+Concepts+in+Linguistics+and+Psychol)
151. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. [Efficient Estimation of Word Representations in Vector Space](https://md.research.elamur.ai/free/en/papers/mikolov-2013-efficient-estimation-word-representations-vector/). arXiv:1301.3781 [cs], September 2013.
152. Raphaël Millière. Philosophy of cognitive science in the age of deep learning. WIREs Cognitive Science, n/a(n/a):e1684, 2024. ISSN 1939-5086. doi: 10.1002/wcs.1684. — [doi:10.1002/wcs.1684](https://doi.org/10.1002/wcs.1684) [find](https://scholar.google.com/scholar?q=Rapha%C3%ABl+Milli%C3%A8re%2E+Philosophy+of+cognitive+science+in+the+age+of+deep+learning%2E+WIREs+Cognitive+Science%2C+n%2Fa%28n%2Fa%29%3Ae1684%2C+2024%2E+ISSN+1939%2D5086%2E+doi%3A+10%2E1002%2Fwcs%2E1684%2E+%E2%80%94+%5Bdoi%3A10%2E1002%2Fwcs%2E1684%5D%28https%3A%2F%2Fdo)
153. Raphaël Millière and Cameron Buckner. A Philosophical Introduction to Language Models – Part I: Continuity With Classic Debates, January 2024. [find](https://scholar.google.com/scholar?q=Rapha%C3%ABl+Milli%C3%A8re+and+Cameron+Buckner%2E+A+Philosophical+Introduction+to+Language+Models+%E2%80%93+Part+I%3A+Continuity+With+Classic+Debates%2C+January+2024%2E)
154. Raphaël Millière and Charles Rathkopf. Anthropocentric bias and the possibility of artificial cognition, July 2024. [find](https://scholar.google.com/scholar?q=Rapha%C3%ABl+Milli%C3%A8re+and+Charles+Rathkopf%2E+Anthropocentric+bias+and+the+possibility+of+artificial+cognition%2C+July+2024%2E)
155. Kanishka Misra and Kyle Mahowald. [Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs](https://md.research.elamur.ai/free/en/papers/misra-2024-language-models-learn-rare-phenomena/), March 2024.
156. Jeff Mitchell and Jeffrey Bowers. Priorless Recurrent Networks Learn Curiously. In Proceedings of the 28th International Conference on Computational Linguistics, pages 5147–5158, Barcelona, Spain (Online), December 2020. International Committee on Computational Linguistics. doi: 10.18653/v1/2020.col… [find](https://scholar.google.com/scholar?q=Jeff+Mitchell+and+Jeffrey+Bowers%2E+Priorless+Recurrent+Networks+Learn+Curiously%2E+In+Proceedings+of+the+28th+International+Conference+on+Computational+Linguistics%2C+pages+5147%E2%80%935158%2C+Barcelona%2C+Spain+%28Onl)
157. Dimitri Coelho Mollo and Raphaël Millière. [The Vector Grounding Problem](https://md.research.elamur.ai/free/en/papers/mollo-2023-vector-grounding-problem/), April 2023.
158. Andrea Moro. Impossible Languages. MIT Press, August 2016. ISBN 978-0-262-33561-4. [find](https://scholar.google.com/scholar?q=Andrea+Moro%2E+Impossible+Languages%2E+MIT+Press%2C+August+2016%2E+ISBN+978%2D0%2D262%2D33561%2D4%2E)
159. Andrea Moro, Matteo Greco, and Stefano F. Cappa. Large languages, impossible languages and human brains. Cortex, 167:82–85, October 2023. ISSN 0010-9452. doi: 10.1016/j.cortex.2023.07.003. — [doi:10.1016/j.cortex.2023.07.003](https://doi.org/10.1016/j.cortex.2023.07.003) [find](https://scholar.google.com/scholar?q=Andrea+Moro%2C+Matteo+Greco%2C+and+Stefano+F%2E+Cappa%2E+Large+languages%2C+impossible+languages+and+human+brains%2E+Cortex%2C+167%3A82%E2%80%9385%2C+October+2023%2E+ISSN+0010%2D9452%2E+doi%3A+10%2E1016%2Fj%2Ecortex%2E2023%2E07%2E003%2E+%E2%80%94+%5Bdoi%3A10%2E1)
160. Aaron Mueller and Tal Linzen. How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases, May 2023. [find](https://scholar.google.com/scholar?q=Aaron+Mueller+and+Tal+Linzen%2E+How+to+Plant+Trees+in+Language+Models%3A+Data+and+Architectural+Effects+on+the+Emergence+of+Syntactic+Inductive+Biases%2C+May+2023%2E)
161. Aaron Mueller, Garrett Nicolai, Panayiota Petrou-Zeniou, Natalia Talmina, and Tal Linzen. [Cross-Linguistic Syntactic Evaluation of Word Prediction Models](https://md.research.elamur.ai/free/en/papers/mueller-2020-cross-linguistic-syntactic-evaluation-word/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5523–5539, Online, July 2020. Association for C…
162. Aaron Mueller, Robert Frank, Tal Linzen, Luheng Wang, and Sebastian Schuster. Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models. In Findings of the Association for Computational Linguistics: ACL 2022, pages 1352–1368, Dublin, Ireland, May 202… [find](https://scholar.google.com/scholar?q=Aaron+Mueller%2C+Robert+Frank%2C+Tal+Linzen%2C+Luheng+Wang%2C+and+Sebastian+Schuster%2E+Coloring+the+Blank+Slate%3A+Pre%2Dtraining+Imparts+a+Hierarchical+Inductive+Bias+to+Sequence%2Dto%2Dsequence+Models%2E+In+Findings+o)
163. Shikhar Murty, Pratyusha Sharma, Jacob Andreas, and Christopher D. Manning. Characterizing Intrinsic Compositionality in Transformers with Tree Projections, November 2022. [find](https://scholar.google.com/scholar?q=Shikhar+Murty%2C+Pratyusha+Sharma%2C+Jacob+Andreas%2C+and+Christopher+D%2E+Manning%2E+Characterizing+Intrinsic+Compositionality+in+Transformers+with+Tree+Projections%2C+November+2022%2E)
164. Shikhar Murty, Pratyusha Sharma, Jacob Andreas, and Christopher D. Manning. Grokking of Hierarchical Structure in Vanilla Transformers, May 2023. [find](https://scholar.google.com/scholar?q=Shikhar+Murty%2C+Pratyusha+Sharma%2C+Jacob+Andreas%2C+and+Christopher+D%2E+Manning%2E+Grokking+of+Hierarchical+Structure+in+Vanilla+Transformers%2C+May+2023%2E)
165. Neel Nanda, Lawrence Chan, Tom Lieberum, Jess Smith, and Jacob Steinhardt. [Progress measures for grokking via mechanistic interpretability](https://md.research.elamur.ai/free/en/papers/nanda-2023-progress-measures-grokking-mechanistic-interpretability/). In The Eleventh International Conference on Learning Representations, September 2022.
166. Ryan M. Nefdt. The Philosophy of Theoretical Linguistics: A Contemporary Outlook. Cambridge University Press, Cambridge, 2024. ISBN 978-1-316-51425-2. doi: 10.1017/9781009082853. — [doi:10.1017/9781009082853](https://doi.org/10.1017/9781009082853) [find](https://scholar.google.com/scholar?q=Ryan+M%2E+Nefdt%2E+The+Philosophy+of+Theoretical+Linguistics%3A+A+Contemporary+Outlook%2E+Cambridge+University+Press%2C+Cambridge%2C+2024%2E+ISBN+978%2D1%2D316%2D51425%2D2%2E+doi%3A+10%2E1017%2F9781009082853%2E+%E2%80%94+%5Bdoi%3A10%2E1017%2F978100)
167. James Nguyen and Roman Frigg. Scientific Representation. Elements in the Philosophy of Science, August 2022. doi: 10.1017/9781009003575. — [doi:10.1017/9781009003575](https://doi.org/10.1017/9781009003575) [find](https://scholar.google.com/scholar?q=James+Nguyen+and+Roman+Frigg%2E+Scientific+Representation%2E+Elements+in+the+Philosophy+of+Science%2C+August+2022%2E+doi%3A+10%2E1017%2F9781009003575%2E+%E2%80%94+%5Bdoi%3A10%2E1017%2F9781009003575%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1017%2F978100900)
168. Jingcheng Niu, Wenjie Lu, and Gerald Penn. Does BERT Rediscover a Classical NLP Pipeline? In Proceedings of the 29th International Conference on Computational Linguistics, pages 3143– 3153, Gyeongju, Republic of Korea, October 2022. International Committee on Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jingcheng+Niu%2C+Wenjie+Lu%2C+and+Gerald+Penn%2E+Does+BERT+Rediscover+a+Classical+NLP+Pipeline%3F+In+Proceedings+of+the+29th+International+Conference+on+Computational+Linguistics%2C+pages+3143%E2%80%93+3153%2C+Gyeongju%2C+)
169. Peter Norvig. On Chomsky and the Two Cultures of Statistical Learning. In Wolfgang Pietsch, Jörg Wernecke, and Maximilian Ott, editors, Berechenbarkeit der Welt? Philosophie und Wissenschaft im Zeitalter von Big Data, pages 61–83. Springer Fachmedien, Wiesbaden, 2017. ISBN 978-3-658-12153-2. doi: 10… — [doi:10.1007/978-3-658-12153-2_3](https://doi.org/10.1007/978-3-658-12153-2_3) [find](https://scholar.google.com/scholar?q=Peter+Norvig%2E+On+Chomsky+and+the+Two+Cultures+of+Statistical+Learning%2E+In+Wolfgang+Pietsch%2C+J%C3%B6rg+Wernecke%2C+and+Maximilian+Ott%2C+editors%2C+Berechenbarkeit+der+Welt%3F+Philosophie+und+Wissenschaft+im+Zeital)
170. Byung-Doh Oh and William Schuler. Transformer-Based LM Surprisal Predicts Human Reading Times Best with About Two Billion Training Tokens, April 2023. [find](https://scholar.google.com/scholar?q=Byung%2DDoh+Oh+and+William+Schuler%2E+Transformer%2DBased+LM+Surprisal+Predicts+Human+Reading+Times+Best+with+About+Two+Billion+Training+Tokens%2C+April+2023%2E)
171. Chris Olah, Nick Cammarata, Ludwig Schubert, Gabriel Goh, Michael Petrov, and Shan Carter. Zoom In: An Introduction to Circuits. Distill, 5(3):e00024.001, March 2020. ISSN 2476-0757. doi: 10.23915/distill.00024.001. — [doi:10.23915/distill.00024.001](https://doi.org/10.23915/distill.00024.001) [find](https://scholar.google.com/scholar?q=Chris+Olah%2C+Nick+Cammarata%2C+Ludwig+Schubert%2C+Gabriel+Goh%2C+Michael+Petrov%2C+and+Shan+Carter%2E+Zoom+In%3A+An+Introduction+to+Circuits%2E+Distill%2C+5%283%29%3Ae00024%2E001%2C+March+2020%2E+ISSN+2476%2D0757%2E+doi%3A+10%2E23915%2Fdis)
172. Santiago Ontanon, Joshua Ainslie, Zachary Fisher, and Vaclav Cvicek. Making Transformers Solve Compositional Tasks. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3591–3607, Dublin, Ireland, May 2022. Association for Computat… [find](https://scholar.google.com/scholar?q=Santiago+Ontanon%2C+Joshua+Ainslie%2C+Zachary+Fisher%2C+and+Vaclav+Cvicek%2E+Making+Transformers+Solve+Compositional+Tasks%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Computational+Lingu)
173. OpenAI. [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/), March 2023.
174. Charles E. Osgood. The nature and measurement of meaning. Psychological bulletin, 49(3):197–237, May 1952. ISSN 1939-1455. doi: 10.1037/h0055737. — [doi:10.1037/h0055737](https://doi.org/10.1037/h0055737) [find](https://scholar.google.com/scholar?q=Charles+E%2E+Osgood%2E+The+nature+and+measurement+of+meaning%2E+Psychological+bulletin%2C+49%283%29%3A197%E2%80%93237%2C+May+1952%2E+ISSN+1939%2D1455%2E+doi%3A+10%2E1037%2Fh0055737%2E+%E2%80%94+%5Bdoi%3A10%2E1037%2Fh0055737%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1037%2Fh0055)
175. Isabel Papadimitriou and Dan Jurafsky. Pretrain on just structure: Understanding linguistic inductive biases using transfer learning, April 2023. [find](https://scholar.google.com/scholar?q=Isabel+Papadimitriou+and+Dan+Jurafsky%2E+Pretrain+on+just+structure%3A+Understanding+linguistic+inductive+biases+using+transfer+learning%2C+April+2023%2E)
176. Barbara Hall Partee. Montague Grammar, Mental Representations, and Reality. In Stig Kanger and Sven Ōhman, editors, Philosophy and Grammar: Papers on the Occasion of the Quincentennial of Uppsala University, Synthese Library, pages 59–78. Springer Netherlands, Dordrecht, 1981. ISBN 978-94-009-9012-… — [doi:10.1007/978-94-009-9012-8_5](https://doi.org/10.1007/978-94-009-9012-8_5) [find](https://scholar.google.com/scholar?q=Barbara+Hall+Partee%2E+Montague+Grammar%2C+Mental+Representations%2C+and+Reality%2E+In+Stig+Kanger+and+Sven+O%CC%84hman%2C+editors%2C+Philosophy+and+Grammar%3A+Papers+on+the+Occasion+of+the+Quincentennial+of+Uppsala+Uni)
177. Abhinav Patil, Jaap Jumelet, Yu Ying Chiu, Andy Lapastora, Peter Shen, Lexie Wang, Clevis Willrich, and Shane Steinert-Threlkeld. [Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence](https://md.research.elamur.ai/free/en/papers/patil-2024-filtered-corpus-training-fict-shows/), May 2024.
178. Ellie Pavlick. Semantic Structure in Deep Learning. Annual Review of Linguistics, 8(1):447–471, 2022. doi: 10.1146/annurev-linguistics-031120-122924. — [doi:10.1146/annurev-linguistics-031120-122924](https://doi.org/10.1146/annurev-linguistics-031120-122924) [find](https://scholar.google.com/scholar?q=Ellie+Pavlick%2E+Semantic+Structure+in+Deep+Learning%2E+Annual+Review+of+Linguistics%2C+8%281%29%3A447%E2%80%93471%2C+2022%2E+doi%3A+10%2E1146%2Fannurev%2Dlinguistics%2D031120%2D122924%2E+%E2%80%94+%5Bdoi%3A10%2E1146%2Fannurev%2Dlinguistics%2D031120%2D122924%5D%28)
179. Lisa Pearl. How Statistical Learning Can Play Well with Universal Grammar. In A Companion to Chomsky, chapter 17, pages 267–286. John Wiley & Sons, Ltd, 2021. ISBN 978-1-119-59873-2. doi: 10.1002/9781119598732.ch17. — [doi:10.1002/9781119598732.ch17](https://doi.org/10.1002/9781119598732.ch17) [find](https://scholar.google.com/scholar?q=Lisa+Pearl%2E+How+Statistical+Learning+Can+Play+Well+with+Universal+Grammar%2E+In+A+Companion+to+Chomsky%2C+chapter+17%2C+pages+267%E2%80%93286%2E+John+Wiley+%26+Sons%2C+Ltd%2C+2021%2E+ISBN+978%2D1%2D119%2D59873%2D2%2E+doi%3A+10%2E1002%2F9781)
180. Lisa Pearl. Poverty of the Stimulus Without Tears. Language Learning and Development, 18(4): 415–454, October 2022. ISSN 1547-5441, 1547-3341. doi: 10.1080/15475441.2021.1981908. — [doi:10.1080/15475441.2021.1981908](https://doi.org/10.1080/15475441.2021.1981908) [find](https://scholar.google.com/scholar?q=Lisa+Pearl%2E+Poverty+of+the+Stimulus+Without+Tears%2E+Language+Learning+and+Development%2C+18%284%29%3A+415%E2%80%93454%2C+October+2022%2E+ISSN+1547%2D5441%2C+1547%2D3341%2E+doi%3A+10%2E1080%2F15475441%2E2021%2E1981908%2E+%E2%80%94+%5Bdoi%3A10%2E1080%2F154754)
181. Lisa S. Pearl. Modeling syntactic acquisition. In Jon Sprouse, editor, The Oxford Handbook of Experimental Syntax, page 0. Oxford University Press, March 2023. ISBN 978-0-19-879772-2. doi: 10.1093/oxfordhb/9780198797722.013.8. — [doi:10.1093/oxfordhb/9780198797722.013.8](https://doi.org/10.1093/oxfordhb/9780198797722.013.8) [find](https://scholar.google.com/scholar?q=Lisa+S%2E+Pearl%2E+Modeling+syntactic+acquisition%2E+In+Jon+Sprouse%2C+editor%2C+The+Oxford+Handbook+of+Experimental+Syntax%2C+page+0%2E+Oxford+University+Press%2C+March+2023%2E+ISBN+978%2D0%2D19%2D879772%2D2%2E+doi%3A+10%2E1093%2Foxf)
182. Steven Piantadosi. Modern language models refute Chomsky’s approach to language, March 2023. [find](https://scholar.google.com/scholar?q=Steven+Piantadosi%2E+Modern+language+models+refute+Chomsky%E2%80%99s+approach+to+language%2C+March+2023%2E)
183. Steven Piantadosi and Felix Hill. Meaning without reference in large language models, August 2022. [find](https://scholar.google.com/scholar?q=Steven+Piantadosi+and+Felix+Hill%2E+Meaning+without+reference+in+large+language+models%2C+August+2022%2E)
184. Tiago Pimentel, Naomi Saphra, Adina Williams, and Ryan Cotterell. Pareto Probing: Trading Off Accuracy for Complexity. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 3138–3153, Online, November 2020. Association for Computational Linguistics.… [find](https://scholar.google.com/scholar?q=Tiago+Pimentel%2C+Naomi+Saphra%2C+Adina+Williams%2C+and+Ryan+Cotterell%2E+Pareto+Probing%3A+Trading+Off+Accuracy+for+Complexity%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Pr)
185. Steven Pinker and Ray Jackendoff. The faculty of language: What’s special about it? Cognition, 95 (2):201–236, March 2005. ISSN 0010-0277. doi: 10.1016/j.cognition.2004.08.004. — [doi:10.1016/j.cognition.2004.08.004](https://doi.org/10.1016/j.cognition.2004.08.004) [find](https://scholar.google.com/scholar?q=Steven+Pinker+and+Ray+Jackendoff%2E+The+faculty+of+language%3A+What%E2%80%99s+special+about+it%3F+Cognition%2C+95+%282%29%3A201%E2%80%93236%2C+March+2005%2E+ISSN+0010%2D0277%2E+doi%3A+10%2E1016%2Fj%2Ecognition%2E2004%2E08%2E004%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fj%2Ecognit)
186. Steven Pinker and Alan Prince. On language and connectionism: Analysis of a parallel distributed processing model of language acquisition. Cognition, 28(1):73–193, March 1988. ISSN 0010-0277. doi: 10.1016/0010-0277(88)90032-7. — [doi:10.1016/0010-0277(88)90032-7](https://doi.org/10.1016/0010-0277%2888%2990032-7) [find](https://scholar.google.com/scholar?q=Steven+Pinker+and+Alan+Prince%2E+On+language+and+connectionism%3A+Analysis+of+a+parallel+distributed+processing+model+of+language+acquisition%2E+Cognition%2C+28%281%29%3A73%E2%80%93193%2C+March+1988%2E+ISSN+0010%2D0277%2E+doi%3A+10%2E)
187. Christopher Potts. Characterizing English Preposing in PP constructions, August 2023. [find](https://scholar.google.com/scholar?q=Christopher+Potts%2E+Characterizing+English+Preposing+in+PP+constructions%2C+August+2023%2E)
188. Geoffrey K. Pullum and Barbara C. Scholz. Empirical assessment of stimulus poverty arguments. The Linguistic Review, 19(1-2):9–50, June 2002. ISSN 1613-3676. doi: 10.1515/tlir.19.1-2.9. — [doi:10.1515/tlir.19.1-2.9](https://doi.org/10.1515/tlir.19.1-2.9) [find](https://scholar.google.com/scholar?q=Geoffrey+K%2E+Pullum+and+Barbara+C%2E+Scholz%2E+Empirical+assessment+of+stimulus+poverty+arguments%2E+The+Linguistic+Review%2C+19%281%2D2%29%3A9%E2%80%9350%2C+June+2002%2E+ISSN+1613%2D3676%2E+doi%3A+10%2E1515%2Ftlir%2E19%2E1%2D2%2E9%2E+%E2%80%94+%5Bdoi%3A10%2E1515)
189. Yulu Qin, Wentao Wang, and Brenden Lake. [A systematic investigation of learnability from single child linguistic input](https://md.research.elamur.ai/free/en/papers/qin-2024-systematic-investigation-learnability-single-child/). Proceedings of the Annual Meeting of the Cognitive Science Society, 46(0), 2024.
190. Linlu Qiu, Peter Shaw, Panupong Pasupat, Pawel Nowak, Tal Linzen, Fei Sha, and Kristina Toutanova. [Improving Compositional Generalization with Latent Structure and Data Augmentation](https://md.research.elamur.ai/free/en/papers/qiu-2022-improving-compositional-generalization-latent-structure/). In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics:…
191. Jake Quilty-Dunn, Nicolas Porot, and Eric Mandelbaum. The Best Game in Town: The Re-Emergence of the Language of Thought Hypothesis Across the Cognitive Sciences. Behavioral and Brain Sciences, pages 1–55, January 2023. ISSN 0140-525X, 1469-1825. doi: 10.1017/S0140525X22002849. — [doi:10.1017/s0140525x22002849](https://doi.org/10.1017/s0140525x22002849) [find](https://scholar.google.com/scholar?q=Jake+Quilty%2DDunn%2C+Nicolas+Porot%2C+and+Eric+Mandelbaum%2E+The+Best+Game+in+Town%3A+The+Re%2DEmergence+of+the+Language+of+Thought+Hypothesis+Across+the+Cognitive+Sciences%2E+Behavioral+and+Brain+Sciences%2C+pages+)
192. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. Preprint, 2019. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+Language+models+are+unsupervised+multitask+learners%2E+Preprint%2C+2019%2E)
193. Alessandro Raganato and Jörg Tiedemann. [An Analysis of Encoder Representations in Transformer-Based Machine Translation](https://md.research.elamur.ai/free/en/papers/raganato-2018-analysis-encoder-representations-transformer-based/). In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 287–297, Brussels, Belgium, November 2018. Association for Computa…
194. Shauli Ravfogel, Yoav Goldberg, and Francis Tyers. Can LSTM Learn to Capture Agreement? The Case of Basque. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 98–107, Brussels, Belgium, November 2018. Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=Shauli+Ravfogel%2C+Yoav+Goldberg%2C+and+Francis+Tyers%2E+Can+LSTM+Learn+to+Capture+Agreement%3F+The+Case+of+Basque%2E+In+Proceedings+of+the+2018+EMNLP+Workshop+BlackboxNLP%3A+Analyzing+and+Interpreting+Neural+Net)
195. Shauli Ravfogel, Grusha Prasad, Tal Linzen, and Yoav Goldberg. Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction. In Proceedings of the 25th Conference on Computational Natural Language Learning, pages 194–209, Online, November 2021. Ass… [find](https://scholar.google.com/scholar?q=Shauli+Ravfogel%2C+Grusha+Prasad%2C+Tal+Linzen%2C+and+Yoav+Goldberg%2E+Counterfactual+Interventions+Reveal+the+Causal+Effect+of+Relative+Clause+Representations+on+Agreement+Prediction%2E+In+Proceedings+of+the+2)
196. Tim Räz and Claus Beisbart. The Importance of Understanding Deep Learning. Erkenntnis, August 2022. ISSN 1572-8420. doi: 10.1007/s10670-022-00605-y. — [doi:10.1007/s10670-022-00605-y](https://doi.org/10.1007/s10670-022-00605-y) [find](https://scholar.google.com/scholar?q=Tim+R%C3%A4z+and+Claus+Beisbart%2E+The+Importance+of+Understanding+Deep+Learning%2E+Erkenntnis%2C+August+2022%2E+ISSN+1572%2D8420%2E+doi%3A+10%2E1007%2Fs10670%2D022%2D00605%2Dy%2E+%E2%80%94+%5Bdoi%3A10%2E1007%2Fs10670%2D022%2D00605%2Dy%5D%28https%3A%2F%2Fdoi%2Eorg%2F)
197. Anna Rogers, Olga Kovaleva, and Anna Rumshisky. [A Primer in BERTology: What We Know About How BERT Works](https://md.research.elamur.ai/free/en/papers/rogers-2020-primer-bertology-what-we-know/). Transactions of the Association for Computational Linguistics, 8:842–866, 2020. doi: 10.1162/tacl_a_00349.
198. Rudolf Rosa and David Mareček. Inducing Syntactic Trees from BERT Representations, June 2019. [find](https://scholar.google.com/scholar?q=Rudolf+Rosa+and+David+Mare%C4%8Dek%2E+Inducing+Syntactic+Trees+from+BERT+Representations%2C+June+2019%2E)
199. John Robert Ross. Constraints on variables in syntax. Technical report, Massachusetts Institute of Technology, September 1967. [find](https://scholar.google.com/scholar?q=John+Robert+Ross%2E+Constraints+on+variables+in+syntax%2E+Technical+report%2C+Massachusetts+Institute+of+Technology%2C+September+1967%2E)
200. Vinu Sankar Sadasivan, Aounon Kumar, Sriram Balasubramanian, Wenxiao Wang, and Soheil Feizi. [Can AI-Generated Text be Reliably Detected?](https://md.research.elamur.ai/free/en/papers/sadasivan-2023-ai-generated-text-reliably-detected/), June 2023.
201. G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Communications of the ACM, 18(11):613–620, November 1975. ISSN 0001-0782. doi: 10.1145/361219.361220. [find](https://scholar.google.com/scholar?q=G%2E+Salton%2C+A%2E+Wong%2C+and+C%2E+S%2E+Yang%2E+A+vector+space+model+for+automatic+indexing%2E+Communications+of+the+ACM%2C+18%2811%29%3A613%E2%80%93620%2C+November+1975%2E+ISSN+0001%2D0782%2E+doi%3A+10%2E1145%2F361219%2E361220%2E)
202. David Samuel, Andrey Kutuzov, Lilja Øvrelid, and Erik Velldal. Trained on 100 million words and still in shape: BERT meets British National Corpus. In Findings of the Association for Computational Linguistics: EACL 2023, pages 1954–1974, Dubrovnik, Croatia, May 2023. Association for Computational Li… [find](https://scholar.google.com/scholar?q=David+Samuel%2C+Andrey+Kutuzov%2C+Lilja+%C3%98vrelid%2C+and+Erik+Velldal%2E+Trained+on+100+million+words+and+still+in+shape%3A+BERT+meets+British+National+Corpus%2E+In+Findings+of+the+Association+for+Computational+Lin)
203. Carson T. Schütze. Linguistic evidence and grammatical theory. WIREs Cognitive Science, 2(2): 206–221, 2011. ISSN 1939-5086. doi: 10.1002/wcs.102. — [doi:10.1002/wcs.102](https://doi.org/10.1002/wcs.102) [find](https://scholar.google.com/scholar?q=Carson+T%2E+Sch%C3%BCtze%2E+Linguistic+evidence+and+grammatical+theory%2E+WIREs+Cognitive+Science%2C+2%282%29%3A+206%E2%80%93221%2C+2011%2E+ISSN+1939%2D5086%2E+doi%3A+10%2E1002%2Fwcs%2E102%2E+%E2%80%94+%5Bdoi%3A10%2E1002%2Fwcs%2E102%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1002%2Fwcs%2E1)
204. Cory Shain, Clara Meister, Tiago Pimentel, Ryan Cotterell, and Roger Philip Levy. Large-Scale Evidence for Logarithmic Effects of Word Predictability on Reading Time, November 2022. [find](https://scholar.google.com/scholar?q=Cory+Shain%2C+Clara+Meister%2C+Tiago+Pimentel%2C+Ryan+Cotterell%2C+and+Roger+Philip+Levy%2E+Large%2DScale+Evidence+for+Logarithmic+Effects+of+Word+Predictability+on+Reading+Time%2C+November+2022%2E)
205. C. E. Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27 (3):379–423, July 1948. ISSN 0005-8580. doi: 10.1002/j.1538-7305.1948.tb01338.x. — [doi:10.1002/j.1538-7305.1948.tb01338.x](https://doi.org/10.1002/j.1538-7305.1948.tb01338.x) [find](https://scholar.google.com/scholar?q=C%2E+E%2E+Shannon%2E+A+mathematical+theory+of+communication%2E+The+Bell+System+Technical+Journal%2C+27+%283%29%3A379%E2%80%93423%2C+July+1948%2E+ISSN+0005%2D8580%2E+doi%3A+10%2E1002%2Fj%2E1538%2D7305%2E1948%2Etb01338%2Ex%2E+%E2%80%94+%5Bdoi%3A10%2E1002%2Fj%2E1538%2D7305)
206. C. E. Shannon. Prediction and Entropy of Printed English. Bell System Technical Journal, 30(1): 50–64, January 1951. ISSN 1538-7305. doi: 10.1002/j.1538-7305.1951.tb01366.x. — [doi:10.1002/j.1538-7305.1951.tb01366.x](https://doi.org/10.1002/j.1538-7305.1951.tb01366.x) [find](https://scholar.google.com/scholar?q=C%2E+E%2E+Shannon%2E+Prediction+and+Entropy+of+Printed+English%2E+Bell+System+Technical+Journal%2C+30%281%29%3A+50%E2%80%9364%2C+January+1951%2E+ISSN+1538%2D7305%2E+doi%3A+10%2E1002%2Fj%2E1538%2D7305%2E1951%2Etb01366%2Ex%2E+%E2%80%94+%5Bdoi%3A10%2E1002%2Fj%2E1538%2D7305)
207. Nicholas Shea. Representation in Cognitive Science. OUP Oxford, October 2018. ISBN 978-0-19-881288-3. [find](https://scholar.google.com/scholar?q=Nicholas+Shea%2E+Representation+in+Cognitive+Science%2E+OUP+Oxford%2C+October+2018%2E+ISBN+978%2D0%2D19%2D881288%2D3%2E)
208. Xing Shi, Inkit Padhi, and Kevin Knight. [Does String-Based Neural MT Learn Source Syntax?](https://md.research.elamur.ai/free/en/papers/shi-2016-does-string-based-neural-mt/) In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1526–1534, Austin, Texas, November 2016. Association for Computational Linguistics. doi: 10.18653/v1/D16-1159.
209. Anders Søgaard. Understanding models understanding language. Synthese, 200(6):443, October 2022. ISSN 1573-0964. doi: 10.1007/s11229-022-03931-4. — [doi:10.1007/s11229-022-03931-4](https://doi.org/10.1007/s11229-022-03931-4) [find](https://scholar.google.com/scholar?q=Anders+S%C3%B8gaard%2E+Understanding+models+understanding+language%2E+Synthese%2C+200%286%29%3A443%2C+October+2022%2E+ISSN+1573%2D0964%2E+doi%3A+10%2E1007%2Fs11229%2D022%2D03931%2D4%2E+%E2%80%94+%5Bdoi%3A10%2E1007%2Fs11229%2D022%2D03931%2D4%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E)
210. Jon Sprouse. Acceptability judgments and grammaticality, prospects and challenges. In Syntactic Structures after 60 Years, chapter Syntactic Structures after 60 Years, pages 195–224. De Gruyter Mouton, January 2018. ISBN 978-1-5015-0692-5. [find](https://scholar.google.com/scholar?q=Jon+Sprouse%2E+Acceptability+judgments+and+grammaticality%2C+prospects+and+challenges%2E+In+Syntactic+Structures+after+60+Years%2C+chapter+Syntactic+Structures+after+60+Years%2C+pages+195%E2%80%93224%2E+De+Gruyter+Mouton)
211. Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Al… — [Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
212. Emily Sullivan. Understanding from Machine Learning Models. The British Journal for the Philosophy of Science, March 2022. doi: 10.1093/bjps/axz035. — [doi:10.1093/bjps/axz035](https://doi.org/10.1093/bjps/axz035) [find](https://scholar.google.com/scholar?q=Emily+Sullivan%2E+Understanding+from+Machine+Learning+Models%2E+The+British+Journal+for+the+Philosophy+of+Science%2C+March+2022%2E+doi%3A+10%2E1093%2Fbjps%2Faxz035%2E+%E2%80%94+%5Bdoi%3A10%2E1093%2Fbjps%2Faxz035%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1093)
213. Ian Tenney, Dipanjan Das, and Ellie Pavlick. [BERT Rediscovers the Classical NLP Pipeline](https://md.research.elamur.ai/free/en/papers/tenney-2019-bert-rediscovers-classical-nlp-pipeline/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4593–4601, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10.18653/v1/P19-1452.
214. Michael Tomasello. Constructing a Language. Harvard University Press, June 2009. ISBN 978-0-674-04439-5. [find](https://scholar.google.com/scholar?q=Michael+Tomasello%2E+Constructing+a+Language%2E+Harvard+University+Press%2C+June+2009%2E+ISBN+978%2D0%2D674%2D04439%2D5%2E)
215. Greta Tuckute, Nancy Kanwisher, and Evelina Fedorenko. Language in brains, minds, and machines. Annual Review of Neuroscience, 47(Volume 47, 2024):277–301, 2024. ISSN 1545-4126. doi: 10.1146/annurev-neuro-120623-101142. — [doi:10.1146/annurev-neuro-120623-101142](https://doi.org/10.1146/annurev-neuro-120623-101142) [find](https://scholar.google.com/scholar?q=Greta+Tuckute%2C+Nancy+Kanwisher%2C+and+Evelina+Fedorenko%2E+Language+in+brains%2C+minds%2C+and+machines%2E+Annual+Review+of+Neuroscience%2C+47%28Volume+47%2C+2024%29%3A277%E2%80%93301%2C+2024%2E+ISSN+1545%2D4126%2E+doi%3A+10%2E1146%2Fannurev%2Dn)
216. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. [Attention is All you Need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Sy…
217. Noortje J. Venhuizen, Petra Hendriks, Matthew W. Crocker, and Harm Brouwer. Distributional formal semantics. Information and Computation, 287:104763, September 2022. ISSN 0890-5401. doi: 10.1016/j.ic.2021.104763. — [doi:10.1016/j.ic.2021.104763](https://doi.org/10.1016/j.ic.2021.104763) [find](https://scholar.google.com/scholar?q=Noortje+J%2E+Venhuizen%2C+Petra+Hendriks%2C+Matthew+W%2E+Crocker%2C+and+Harm+Brouwer%2E+Distributional+formal+semantics%2E+Information+and+Computation%2C+287%3A104763%2C+September+2022%2E+ISSN+0890%2D5401%2E+doi%3A+10%2E1016%2Fj%2Eic%2E)
218. Philippe Verreault-Julien. How could models possibly provide how-possibly explanations? Studies in History and Philosophy of Science Part A, 73:22–33, February 2019. ISSN 0039-3681. doi: 10.1016/j.shpsa.2018.06.008. — [doi:10.1016/j.shpsa.2018.06.008](https://doi.org/10.1016/j.shpsa.2018.06.008) [find](https://scholar.google.com/scholar?q=Philippe+Verreault%2DJulien%2E+How+could+models+possibly+provide+how%2Dpossibly+explanations%3F+Studies+in+History+and+Philosophy+of+Science+Part+A%2C+73%3A22%E2%80%9333%2C+February+2019%2E+ISSN+0039%2D3681%2E+doi%3A+10%2E1016%2Fj%2Eshp)
219. David Vilares, Michalina Strzyz, Anders Søgaard, and Carlos Gómez-Rodríguez. Parsing as Pretraining. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05):9114–9121, April 2020. ISSN 2374-3468. doi: 10.1609/aaai.v34i05.6446. — [doi:10.1609/aaai.v34i05.6446](https://doi.org/10.1609/aaai.v34i05.6446) [find](https://scholar.google.com/scholar?q=David+Vilares%2C+Michalina+Strzyz%2C+Anders+S%C3%B8gaard%2C+and+Carlos+G%C3%B3mez%2DRodr%C3%ADguez%2E+Parsing+as+Pretraining%2E+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+34%2805%29%3A9114%E2%80%939121%2C+April+2020%2E+ISSN+2)
220. Kevin Ro Wang, Alexandre Variengien, Arthur Conmy, Buck Shlegeris, and Jacob Steinhardt. Interpretability in the Wild: A Circuit for Indirect Object Identification in GPT-2 small. In NeurIPS ML Safety Workshop, November 2022. [find](https://scholar.google.com/scholar?q=Kevin+Ro+Wang%2C+Alexandre+Variengien%2C+Arthur+Conmy%2C+Buck+Shlegeris%2C+and+Jacob+Steinhardt%2E+Interpretability+in+the+Wild%3A+A+Circuit+for+Indirect+Object+Identification+in+GPT%2D2+small%2E+In+NeurIPS+ML+Safety)
221. Wentao Wang, Wai Keen Vong, Najoung Kim, and Brenden M. Lake. Finding Structure in One Child’s Linguistic Experience. Cognitive Science, 47(6):e13305, 2023. ISSN 1551-6709. doi: 10.1111/cogs.13305. — [doi:10.1111/cogs.13305](https://doi.org/10.1111/cogs.13305) [find](https://scholar.google.com/scholar?q=Wentao+Wang%2C+Wai+Keen+Vong%2C+Najoung+Kim%2C+and+Brenden+M%2E+Lake%2E+Finding+Structure+in+One+Child%E2%80%99s+Linguistic+Experience%2E+Cognitive+Science%2C+47%286%29%3Ae13305%2C+2023%2E+ISSN+1551%2D6709%2E+doi%3A+10%2E1111%2Fcogs%2E13305%2E+%E2%80%94+)
222. Alex Warstadt and Samuel R. Bowman. Can neural networks acquire a structural bias from raw linguistic data? Proceedings of the Annual Meeting of the Cognitive Science Society, January 2020. [find](https://scholar.google.com/scholar?q=Alex+Warstadt+and+Samuel+R%2E+Bowman%2E+Can+neural+networks+acquire+a+structural+bias+from+raw+linguistic+data%3F+Proceedings+of+the+Annual+Meeting+of+the+Cognitive+Science+Society%2C+January+2020%2E)
223. Alex Warstadt and Samuel R. Bowman. [What Artificial Neural Networks Can Tell Us about Human Language Acquisition](https://md.research.elamur.ai/free/en/papers/warstadt-2022-artificial-neural-networks-tell-us/). In Algebraic Structures in Natural Language. CRC Press, 2022. ISBN 978-1-00-320538-8.
224. Alex Warstadt, Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, and Samuel R. Bowman. [BLiMP: The Benchmark of Linguistic Minimal Pairs for English](https://md.research.elamur.ai/free/en/papers/warstadt-2020-blimp-benchmark-linguistic-minimal-pairs/). Transactions of the Association for Computational Linguistics, 8:377–392, July 2020. ISSN 2307-387X. doi: 10.1162/tacl_a_00321.
225. Alex Warstadt, Leshem Choshen, Aaron Mueller, Adina Williams, Ethan Gotlieb Wilcox, and Chengxu Zhuang. Call for Papers – The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus, January 2023. [find](https://scholar.google.com/scholar?q=Alex+Warstadt%2C+Leshem+Choshen%2C+Aaron+Mueller%2C+Adina+Williams%2C+Ethan+Gotlieb+Wilcox%2C+and+Chengxu+Zhuang%2E+Call+for+Papers+%E2%80%93+The+BabyLM+Challenge%3A+Sample%2Defficient+pretraining+on+a+developmentally+plausi)
226. Alex Warstadt, Aaron Mueller, Leshem Choshen, Ethan Gotlieb Wilcox, Chengxu Zhuang, Adina Williams, Ryan Cotterell, and Tal Linzen. Insights from the first BabyLM Challenge: Training sample-efficient language models on a developmentally plausible corpus. Proceedings of the Annual Meeting of the Cogn… [find](https://scholar.google.com/scholar?q=Alex+Warstadt%2C+Aaron+Mueller%2C+Leshem+Choshen%2C+Ethan+Gotlieb+Wilcox%2C+Chengxu+Zhuang%2C+Adina+Williams%2C+Ryan+Cotterell%2C+and+Tal+Linzen%2E+Insights+from+the+first+BabyLM+Challenge%3A+Training+sample%2Defficient+)
227. Warren Weaver. Translation. In William N. Locke and Donald A. Booth, editors, Machine Translation of Languages. MIT Press, Boston, MA, May 1955. ISBN 978-0-262-12002-9. [find](https://scholar.google.com/scholar?q=Warren+Weaver%2E+Translation%2E+In+William+N%2E+Locke+and+Donald+A%2E+Booth%2C+editors%2C+Machine+Translation+of+Languages%2E+MIT+Press%2C+Boston%2C+MA%2C+May+1955%2E+ISBN+978%2D0%2D262%2D12002%2D9%2E)
228. Felix A. Wichmann and Robert Geirhos. Are Deep Neural Networks Adequate Behavioral Models of Human Visual Perception? Annual Review of Vision Science, 9(1):null, 2023. doi: 10.1146/annurev-vision-120522-031739. — [doi:10.1146/annurev-vision-120522-031739](https://doi.org/10.1146/annurev-vision-120522-031739) [find](https://scholar.google.com/scholar?q=Felix+A%2E+Wichmann+and+Robert+Geirhos%2E+Are+Deep+Neural+Networks+Adequate+Behavioral+Models+of+Human+Visual+Perception%3F+Annual+Review+of+Vision+Science%2C+9%281%29%3Anull%2C+2023%2E+doi%3A+10%2E1146%2Fannurev%2Dvision%2D1205)
229. Ethan Gotlieb Wilcox, Roger Levy, Takashi Morita, and Richard Futrell. What do RNN Language Models Learn about Filler–Gap Dependencies? In Proceedings of the 2018 [EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 211–221, Brussels, Belgium, November 2018](https://md.research.elamur.ai/free/en/papers/wilcox-2018-rnn-language-models-learn-about/). Associat…
230. Ethan Gotlieb Wilcox, Jon Gauthier, Jennifer Hu, Peng Qian, and Roger Levy. On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior, June 2020. [find](https://scholar.google.com/scholar?q=Ethan+Gotlieb+Wilcox%2C+Jon+Gauthier%2C+Jennifer+Hu%2C+Peng+Qian%2C+and+Roger+Levy%2E+On+the+Predictive+Power+of+Neural+Language+Models+for+Human+Real%2DTime+Comprehension+Behavior%2C+June+2020%2E)
231. Ethan Gotlieb Wilcox, Richard Futrell, and Roger Levy. Using Computational Models to Test Syntactic Learnability. Linguistic Inquiry, pages 1–44, April 2023. ISSN 0024-3892. doi: 10.1162/ ling_a_00491. [find](https://scholar.google.com/scholar?q=Ethan+Gotlieb+Wilcox%2C+Richard+Futrell%2C+and+Roger+Levy%2E+Using+Computational+Models+to+Test+Syntactic+Learnability%2E+Linguistic+Inquiry%2C+pages+1%E2%80%9344%2C+April+2023%2E+ISSN+0024%2D3892%2E+doi%3A+10%2E1162%2F+ling%5Fa%5F00491)
232. Ethan Gotlieb Wilcox, Michael Hu, Aaron Mueller, Tal Linzen, Alex Warstadt, Leshem Choshen, Chengxu Zhuang, Ryan Cotterell, and Adina Williams. Bigger is not always better: The importance of human-scale language modeling for psycholinguistics, July 2024. [find](https://scholar.google.com/scholar?q=Ethan+Gotlieb+Wilcox%2C+Michael+Hu%2C+Aaron+Mueller%2C+Tal+Linzen%2C+Alex+Warstadt%2C+Leshem+Choshen%2C+Chengxu+Zhuang%2C+Ryan+Cotterell%2C+and+Adina+Williams%2E+Bigger+is+not+always+better%3A+The+importance+of+human%2Dsca)
233. Terry Winograd. Procedures as a Representation for Data in a Computer Program for Understanding Natural Language. PhD thesis, Massachusetts Institute of Technology, January 1971. [find](https://scholar.google.com/scholar?q=Terry+Winograd%2E+Procedures+as+a+Representation+for+Data+in+a+Computer+Program+for+Understanding+Natural+Language%2E+PhD+thesis%2C+Massachusetts+Institute+of+Technology%2C+January+1971%2E)
234. W. A. Woods. Progress in natural language understanding: An application to lunar geology. In Proceedings of the June 4-8, 1973, National Computer Conference and Exposition, AFIPS ’73, pages 441–450, New York, NY, USA, June 1973. Association for Computing Machinery. ISBN 978-1-4503-7916-8. doi: 10.11… — [doi:10.1145/1499586.1499695](https://doi.org/10.1145/1499586.1499695) [find](https://scholar.google.com/scholar?q=W%2E+A%2E+Woods%2E+Progress+in+natural+language+understanding%3A+An+application+to+lunar+geology%2E+In+Proceedings+of+the+June+4%2D8%2C+1973%2C+National+Computer+Conference+and+Exposition%2C+AFIPS+%E2%80%9973%2C+pages+441%E2%80%93450%2C+N)
235. Zhiyong Wu, Yun Chen, Ben Kao, and Qun Liu. [Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT](https://md.research.elamur.ai/free/en/papers/wu-2020-perturbed-masking-parameter-free-probing/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4166–4176, Online, July 2020. Association for Computational Linguistics. doi: 1…
236. Takateru Yamakoshi, James L. McClelland, Adele E. Goldberg, and Robert D. Hawkins. Causal interventions expose implicit situation models for commonsense language understanding, June 2023. [find](https://scholar.google.com/scholar?q=Takateru+Yamakoshi%2C+James+L%2E+McClelland%2C+Adele+E%2E+Goldberg%2C+and+Robert+D%2E+Hawkins%2E+Causal+interventions+expose+implicit+situation+models+for+commonsense+language+understanding%2C+June+2023%2E)
237. Charles D. Yang. Universal Grammar, statistics or both? Trends in Cognitive Sciences, 8(10): 451–456, October 2004. ISSN 1364-6613, 1879-307X. doi: 10.1016/j.tics.2004.08.006. — [doi:10.1016/j.tics.2004.08.006](https://doi.org/10.1016/j.tics.2004.08.006) [find](https://scholar.google.com/scholar?q=Charles+D%2E+Yang%2E+Universal+Grammar%2C+statistics+or+both%3F+Trends+in+Cognitive+Sciences%2C+8%2810%29%3A+451%E2%80%93456%2C+October+2004%2E+ISSN+1364%2D6613%2C+1879%2D307X%2E+doi%3A+10%2E1016%2Fj%2Etics%2E2004%2E08%2E006%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fj%2Etics%2E20)
238. Shunyu Yao, Binghui Peng, Christos Papadimitriou, and Karthik Narasimhan. Self-Attention Networks Can Process Bounded Hierarchical Languages. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Pro… [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Binghui+Peng%2C+Christos+Papadimitriou%2C+and+Karthik+Narasimhan%2E+Self%2DAttention+Networks+Can+Process+Bounded+Hierarchical+Languages%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Associati)
239. Aditya Yedetore, Tal Linzen, Robert Frank, and R. Thomas McCoy. [How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech](https://md.research.elamur.ai/free/en/papers/yedetore-2023-how-poor-is-stimulus-evaluating/), June 2023.
240. Yian Zhang, Alex Warstadt, Haau-Sing Li, and Samuel R. Bowman. When Do You Need Billions of Words of Pretraining Data?, November 2020. [find](https://scholar.google.com/scholar?q=Yian+Zhang%2C+Alex+Warstadt%2C+Haau%2DSing+Li%2C+and+Samuel+R%2E+Bowman%2E+When+Do+You+Need+Billions+of+Words+of+Pretraining+Data%3F%2C+November+2020%2E)
241. Haoyu Zhao, Abhishek Panigrahi, Rong Ge, and Sanjeev Arora. Do Transformers Parse while Predicting the Masked Word?, March 2023. [find](https://scholar.google.com/scholar?q=Haoyu+Zhao%2C+Abhishek+Panigrahi%2C+Rong+Ge%2C+and+Sanjeev+Arora%2E+Do+Transformers+Parse+while+Predicting+the+Masked+Word%3F%2C+March+2023%2E)
242. Ziqian Zhong, Ziming Liu, Max Tegmark, and Jacob Andreas. The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks, June 2023. [find](https://scholar.google.com/scholar?q=Ziqian+Zhong%2C+Ziming+Liu%2C+Max+Tegmark%2C+and+Jacob+Andreas%2E+The+Clock+and+the+Pizza%3A+Two+Stories+in+Mechanistic+Explanation+of+Neural+Networks%2C+June+2023%2E)

*Updated 30 October 2026*