---
title: "Evaluating the Usage of African-American Vernacular English in"
description: "LLMs are mostly tested on Standard American English, so it is unclear whether they can faithfully produce minoritized dialects. 50 references."
authors: ["Deja Dunlap", "R. Thomas McCoy"]
year: 2026
venue: "arXiv:2602.21485"
source: "https://arxiv.org/abs/2602.21485"
doi: "10.48550/arxiv.2602.21485"
arxiv: "2602.21485"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/dunlap-2026-evaluating-usage-african-american-vernacular/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/dunlap-2026-evaluating-usage-african-american-vernacular/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/) / Evaluating the Usage of African-American Vernacular English in Large Language Models

# Evaluating the Usage of African-American Vernacular English in Large Language Models

**Authors:** Deja Dunlap and [R. Thomas McCoy](https://md.research.elamur.ai/free/en/authors/r-thomas-mccoy/) · **Year:** 2026 · **Venue:** arXiv:2602.21485 · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2602.21485) · [PDF](https://arxiv.org/pdf/2602.21485) · [DOI 10.48550/arxiv.2602.21485](https://doi.org/10.48550/arxiv.2602.21485) · [arXiv 2602.21485](https://arxiv.org/abs/2602.21485) · [OpenAlex](https://openalex.org/W7131724783)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
LLMs are mostly tested on Standard American English, so it is unclear whether they can faithfully produce minoritized dialects. This work measures how three LLMs (Llama-3-8B-Instruct-Turbo, GPT-4o-mini, Gemma-2-27B-IT) handle African American Vernacular English (AAVE), treating AAVE as a linguistic system in its own right rather than as a deviation from SAE. The human baseline comes from two sources: sociolinguistic interviews in CORAAL and a sample of TwitterAAE. The models were then prompted to imitate each genre, producing simulated interviews and batches of tweets. The authors compared how often seven AAVE grammatical features occur, and in which contexts, in human versus model text. The comparison relies on automatic analysis, not human annotators, so it scales and can be repeated. The models generally use these features too rarely or in the wrong places. Many context patterns typical of native speakers barely appear in model output. Manual reading and sentiment analysis also showed stereotyped themes in the generated interviews. The framework is designed to transfer to other dialects.

## Key points
- The human data are 272 CORAAL interviews (109,234 sentences after cleaning) and a random 110,000-tweet subset of the 1.1M-tweet TwitterAAE.
- The model data are 1,000 generated interviews per model and 750 batches of 250 tweets (about 187,500 tweets). Interview prompts drew speaker gender and city in proportion to their shares in CORAAL.
- The examined constructions cover ain't, habitual be, perfective done, null copula, double comparatives, stacked (multiple) modals and negative concord.
- Llama underused six of these features compared with humans. For example, it used habitual be at only about 14% of the human rate.
- In a manual review of 10 interviews and 250 tweets per model, the tweets were mostly unproblematic. The interviews kept returning to single-parent homes, economic hardship, "the streets" and violence.
- The authors suggest that safety-oriented post-training may push models away from nonstandard grammar, which could indirectly erase legitimate dialect patterns.

## Interesting ideas
- Instead of asking whether a model obeys a grammar rule, the paper compares how often a construction appears and in which contexts against a human reference corpus, which exposes distributional mismatches that a correctness test would miss.
- The prompts asked for the dialect without naming any target features, so the measured feature usage reflects the model's own notion of the variety rather than the prompt's wording.
- Prompt variables such as gender and city were sampled to mirror their proportions in the human corpus, which keeps the human and model collections comparable.
- The paper treats dialect grammar as a legitimate system and warns that alignment that suppresses "improper" language can erase real patterns.
- The comparison runs automatically over large corpora without human annotators, making it scalable and reproducible.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (back): Generated text could be profiled by the frequency and context of constructions and compared with human corpora of the same genre, flagging output that is grammatical but statistically unnatural.
- **I2** (learn): When LLM teacher tiers generate silver or test data, prompts should avoid naming the phenomenon being measured, so the evaluation is not contaminated by the request.
- **I3** (learn): Synthetic evaluation sets could sample genre, speaker and topic variables to match a reference corpus, giving an aligned baseline in the spirit of a negative control.
- **I4** (tokens): The tagger and lemmatizer should analyse forms like ain't, habitual be or null copula as valid structures rather than routing them to repair rules as errors.
- **I5** (tree): UD-based detectors could count dialect constructions across treebanks and generated text, for example by checking for a missing cop relation or an invariant be with habitual sense.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Yale University](https://md.research.elamur.ai/free/en/universities/yale-university/) — University, New Haven, United States · 95 works · 12,765 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 543 works

🧭 Topics (3): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,263 works · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works

## Cite

Cite as: Deja Dunlap and R. Thomas McCoy. 2026. Evaluating the Usage of African-American Vernacular English in Large Language Models. arXiv:2602.21485.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{dunlap2026evaluating,
  title = {{Evaluating the Usage of African-American Vernacular English in Large Language Models}},
  author = {Deja Dunlap and R. Thomas McCoy},
  year = {2026},
  doi = {10.48550/arxiv.2602.21485},
  eprint = {2602.21485},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2602.21485}
}
```

- [← previous Evaluating the Retrieval Component in a Retrieval-Augmented Summarization System for Patient Records in French](https://md.research.elamur.ai/free/en/papers/naguib-2026-evaluating-retrieval-component-retrieval-augmented/)
- [next → Evaluating Transformer Model Family Representations Through Automated Essay Scoring](https://md.research.elamur.ai/free/en/papers/ozten-2026-evaluating-transformer-model-family-representations/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/)

## References

50 references, 21 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Nemeroff, A.: What is AI slop? A technologist explains this new and largely unwelcome form of online content. The Conversation. (2025) [find](https://scholar.google.com/scholar?q=Nemeroff%2C+A%2E%3A+What+is+AI+slop%3F+A+technologist+explains+this+new+and+largely+unwelcome+form+of+online+content%2E+The+Conversation%2E+%282025%29)
2. Blodgett, S.L., Green, L., O’Connor, B.: [Demographic Dialectal Variation in Social Media: A Case Study of African-American English](https://md.research.elamur.ai/free/en/papers/blodgett-2016-demographic-dialectal-variation-social-media/). Proceedings of EMNLP. (2016)
3. van Ess, H.: Reporter’s Guide to Detecting AI-Generated Content. Global Investigative Journalism Network (GIJN). (2025) [find](https://scholar.google.com/scholar?q=van+Ess%2C+H%2E%3A+Reporter%E2%80%99s+Guide+to+Detecting+AI%2DGenerated+Content%2E+Global+Investigative+Journalism+Network+%28GIJN%29%2E+%282025%29)
4. Heller, M.: The Commodification of Language. Annual Review of Anthropology 39(1), 101–114 (2010). [find](https://scholar.google.com/scholar?q=Heller%2C+M%2E%3A+The+Commodification+of+Language%2E+Annual+Review+of+Anthropology+39%281%29%2C+101%E2%80%93114+%282010%29%2E)
5. Small, Z.: Black Artists Say A.I. Shows Bias, With Algorithms Erasing Their History. The New York Times. (2023) [find](https://scholar.google.com/scholar?q=Small%2C+Z%2E%3A+Black+Artists+Say+A%2EI%2E+Shows+Bias%2C+With+Algorithms+Erasing+Their+History%2E+The+New+York+Times%2E+%282023%29)
6. Towns, A.R.: The (racial) biases of communication: Rethinking media and blackness. Social Identities 21(5), 474–488 (2015). [find](https://scholar.google.com/scholar?q=Towns%2C+A%2ER%2E%3A+The+%28racial%29+biases+of+communication%3A+Rethinking+media+and+blackness%2E+Social+Identities+21%285%29%2C+474%E2%80%93488+%282015%29%2E)
7. Lin, F., Mao, S., La Malfa, E., Hofmann, V., de Wynter, A., Wang, X., Chen, S.Q., Wooldridge, M.J., Pierrehumbert, J., Wei, F.: Assessing dialect fairness and robustness of large language models in reasoning tasks. In Proceedings of the ACL. (2025). [find](https://scholar.google.com/scholar?q=Lin%2C+F%2E%2C+Mao%2C+S%2E%2C+La+Malfa%2C+E%2E%2C+Hofmann%2C+V%2E%2C+de+Wynter%2C+A%2E%2C+Wang%2C+X%2E%2C+Chen%2C+S%2EQ%2E%2C+Wooldridge%2C+M%2EJ%2E%2C+Pierrehumbert%2C+J%2E%2C+Wei%2C+F%2E%3A+Assessing+dialect+fairness+and+robustness+of+large+language+models+in+re)
8. Gupta, A., Yurtseven, E., Meng, P., Zhu, K.: [AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark](https://md.research.elamur.ai/free/en/papers/gupta-2024-aavenue-detecting-llm-biases-nlu/). In Proceedings of the Third Workshop on NLP for Positive Impact. (2024)
9. Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M.-E., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., Kompatsiaris, I., Kinder-Kurlanda, K., Wagner, C., Karimi, F., Fernandez, M., Alani, H., Berendt, B., Kruegel, T., Heinze, C., Broelemann, K., Kasneci, G., Tiropanis, T., Staab, S.: Bias in data-driven artificial intelligence systems—An introductory survey. WIREs Data Mining and Knowledge Discovery 10(3), e1356 (2020). [find](https://scholar.google.com/scholar?q=Ntoutsi%2C+E%2E%2C+Fafalios%2C+P%2E%2C+Gadiraju%2C+U%2E%2C+Iosifidis%2C+V%2E%2C+Nejdl%2C+W%2E%2C+Vidal%2C+M%2E%2DE%2E%2C+Ruggieri%2C+S%2E%2C+Turini%2C+F%2E%2C+Papadopoulos%2C+S%2E%2C+Krasanakis%2C+E%2E%2C+Kompatsiaris%2C+I%2E%2C+Kinder%2DKurlanda%2C+K%2E%2C+Wagner%2C+C%2E%2C+Karimi%2C+)
10. Hofmann, V., Kalluri, P.R., Jurafsky, D., King, S.: AI generates covertly racist decisions about people based on their dialect. Nature 633(8028), 147–154. (2024). [find](https://scholar.google.com/scholar?q=Hofmann%2C+V%2E%2C+Kalluri%2C+P%2ER%2E%2C+Jurafsky%2C+D%2E%2C+King%2C+S%2E%3A+AI+generates+covertly+racist+decisions+about+people+based+on+their+dialect%2E+Nature+633%288028%29%2C+147%E2%80%93154%2E+%282024%29%2E)
11. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I.: Language Models are Unsupervised Multitask Learners. OpenAI (2019) Evaluating Usage of AAVE in LLMs D. Dunlap, R.T. McCoy [find](https://scholar.google.com/scholar?q=Radford%2C+A%2E%2C+Wu%2C+J%2E%2C+Child%2C+R%2E%2C+Luan%2C+D%2E%2C+Amodei%2C+D%2E%2C+Sutskever%2C+I%2E%3A+Language+Models+are+Unsupervised+Multitask+Learners%2E+OpenAI+%282019%29+Evaluating+Usage+of+AAVE+in+LLMs+D%2E+Dunlap%2C+R%2ET%2E+McCoy)
12. Fleisig, E., Smith, G., Bossi, M., Rustagi, I., Yin, X., Klein, D.: [Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination](https://md.research.elamur.ai/free/en/papers/fleisig-2024-linguistic-bias-chatgpt-language-models/). In Proceedings of EMNLP. (2024).
13. Blodgett, S.L., Barocas, S., Daumé III, H., Wallach, H.: Language (Technology) is Power: A critical survey of "bias" in NLP. In ACL. (2020) — [Language (Technology) is Power: A Critical Survey of ``Bias'' in NLP](https://md.research.elamur.ai/free/en/papers/blodgett-2020-language-technology-is-power-critical/)
14. Rickford, J.R.: African American Vernacular English: Features, evolution, educational implications. Wiley-Blackwell (1999) [find](https://scholar.google.com/scholar?q=Rickford%2C+J%2ER%2E%3A+African+American+Vernacular+English%3A+Features%2C+evolution%2C+educational+implications%2E+Wiley%2DBlackwell+%281999%29)
15. Dacon, J., Liu, H., Tang, J.: [Evaluating and Mitigating Inherent Linguistic Bias of African American English through Inference](https://md.research.elamur.ai/free/en/papers/dacon-2022-evaluating-mitigating-inherent-linguistic-bias/). In Proceedings of the 29th International Conference on Computational Linguistics, pp. 1442–1454. (2022)
16. Dacon, J.: [Towards a Deep Multi-layered Dialectal Language Analysis: A Case Study of African-American English](https://md.research.elamur.ai/free/en/papers/dacon-2022-deep-multi-layered-dialectal-language/). In Proceedings of the Second Workshop on Bridging Human–Computer Interaction and Natural Language Processing, pp. 55– 63. (2022).
17. Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of NAACL, pp. 4171–4186. (2019).
18. OpenAI: [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774. (2023). [↗](https://arxiv.org/abs/2303.08774)
19. Anthropic: Introducing the next generation of Claude. (2024). [find](https://scholar.google.com/scholar?q=Anthropic%3A+Introducing+the+next+generation+of+Claude%2E+%282024%29%2E)
20. Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., Bikel, D., Blecher, L., Canton Ferrer, C., Chen, M., Cucurull, G., Esiobu, D., Fernandes, J., Fu, J., Fu, W., Fuller, B., Gao, C., Goswami, V., Goyal, N., Hartshorn, A., Hosseini, S., Hou, R., Inan, H., Kardas, M., Kerkez, V., Khabsa, M., Kloumann, I., Korenev, A., Singh Koura, P., Lachaux, M.-A., Lavril, T., Lee, J., Liskovich, D., Lu, Y., Mao, Y., Martinet, X., Mihaylov, T., Mishra, P., Molybog, I., Nie, Y., Poulton, A., Reizenstein, J., Rungta, R., Saladi, K., Schelten, A., Silva, R., Smith, E.M., Subramanian, R., Tan, X.E., Tang, B., Taylor, R., Williams, A., Kuan, J.X., Xu, P., Yan, Z., Zarov, I., Zhang, Y., Fan, A., Kambadur, M., Narang, S., Rodriguez, A., Stojnic, R., Edunov, S., Scialom, T.: [Llama 2: Open Foundation and Fine-Tuned Chat Models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-2-open-foundation-fine/). arXiv preprint arXiv:2307.09288 (2023) [↗](https://arxiv.org/abs/2307.09288)
21. Salinas, A., Haim, A., Nyarko, J.: What’s in a name? Auditing large language models for race and gender bias. arXiv preprint arXiv:2402.14875 (2024) [↗](https://arxiv.org/abs/2402.14875)
22. Zhou, R., Wan, G., Gabriel, S., Li, S., Gates, A.J., Sap, M., Hartvigsen, T.: [Disparities in LLM Reasoning Accuracy and Explanations: A Case Study on African American English](https://md.research.elamur.ai/free/en/papers/zhou-2025-disparities-llm-reasoning-accuracy-explanations/). arXiv preprint arXiv:2503.04099 (2025) [↗](https://arxiv.org/abs/2503.04099)
23. Koenecke, A., Nam, A., Lake, E., Nudell, J., Quartey, M., Mengesha, Z., Toups, C., Rickford, J.R., Jurafsky, D., Goel, S.: Racial disparities in automated speech recognition. Proceedings of the National Academy of Sciences 117(14), 7684–7689. (2020). [find](https://scholar.google.com/scholar?q=Koenecke%2C+A%2E%2C+Nam%2C+A%2E%2C+Lake%2C+E%2E%2C+Nudell%2C+J%2E%2C+Quartey%2C+M%2E%2C+Mengesha%2C+Z%2E%2C+Toups%2C+C%2E%2C+Rickford%2C+J%2ER%2E%2C+Jurafsky%2C+D%2E%2C+Goel%2C+S%2E%3A+Racial+disparities+in+automated+speech+recognition%2E+Proceedings+of+the+Nation)
24. Bolukbasi, T., Chang, K.-W., Zou, J.Y., Saligrama, V., Kalai, A.T.: [Man is to computer programmer as woman is to homemaker? Debiasing word embeddings](https://md.research.elamur.ai/free/en/papers/bolukbasi-2016-man-computer-programmer-woman-homemaker/). Advances in Neural Information Processing Systems 29. (2016).
25. Caliskan, A., Bryson, J.J., Narayanan, A.: Semantics derived automatically from language corpora contain human-like biases. Science 356(6334), 183–186. (2017). [find](https://scholar.google.com/scholar?q=Caliskan%2C+A%2E%2C+Bryson%2C+J%2EJ%2E%2C+Narayanan%2C+A%2E%3A+Semantics+derived+automatically+from+language+corpora+contain+human%2Dlike+biases%2E+Science+356%286334%29%2C+183%E2%80%93186%2E+%282017%29%2E)
26. Buolamwini, J., Gebru, T.: Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency, pp. 77–91. (2018). [find](https://scholar.google.com/scholar?q=Buolamwini%2C+J%2E%2C+Gebru%2C+T%2E%3A+Gender+shades%3A+Intersectional+accuracy+disparities+in+commercial+gender+classification%2E+In+Conference+on+Fairness%2C+Accountability+and+Transparency%2C+pp%2E+77%E2%80%9391%2E+%282018%29%2E)
27. Nadeem, M., Bethke, A., Reddy, S.: [StereoSet: Measuring stereotypical bias in pretrained language models](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/). In ACL, pp. 5356–5371. (2021).
28. Gallegos, I.O., Rossi, R.A., Barrow, J., Tanjim, M.M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., Ahmed, N.K.: [Bias and fairness in large language models: A survey](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/). Computational Linguistics 50(3), 1097–1179. (2024).
29. An, J., Huang, D., Lin, C., Tai, M.: Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation. PNAS Nexus 4(3), pgaf089. (2025). [find](https://scholar.google.com/scholar?q=An%2C+J%2E%2C+Huang%2C+D%2E%2C+Lin%2C+C%2E%2C+Tai%2C+M%2E%3A+Measuring+gender+and+racial+biases+in+large+language+models%3A+Intersectional+evidence+from+automated+resume+evaluation%2E+PNAS+Nexus+4%283%29%2C+pgaf089%2E+%282025%29%2E)
30. Felkner, V., Chang, H.-C.H., Jang, E., May, J.: WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models. In ACL. (2023). [find](https://scholar.google.com/scholar?q=Felkner%2C+V%2E%2C+Chang%2C+H%2E%2DC%2EH%2E%2C+Jang%2C+E%2E%2C+May%2C+J%2E%3A+WinoQueer%3A+A+Community%2Din%2Dthe%2DLoop+Benchmark+for+Anti%2DLGBTQ%2B+Bias+in+Large+Language+Models%2E+In+ACL%2E+%282023%29%2E)
31. Nangia, N., Vania, C., Bhalerao, R., Bowman, S.R.: [CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models](https://md.research.elamur.ai/free/en/papers/nangia-2020-crows-pairs-challenge-dataset-measuring/). In Proceedings of EMNLP, pp. 1953–1967. (2020).
32. Blodgett, S.L., O’Connor, B.: [Racial disparity in natural language processing: A case study of social media African-American English](https://md.research.elamur.ai/free/en/papers/blodgett-2017-racial-disparity-natural-language-processing/). arXiv preprint arXiv:1707.00061. (2017). [↗](https://arxiv.org/abs/1707.00061)
33. Gonen, H., Goldberg, Y.: [Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them](https://md.research.elamur.ai/free/en/papers/gonen-2019-lipstick-pig-debiasing-methods-cover/). In Proceedings of NAACL, pp. 609–614. (2019).
34. Lu, K., Mardziel, P., Wu, F., Amancharla, P., Datta, A.: [Gender bias in neural natural language processing](https://md.research.elamur.ai/free/en/papers/lu-2018-gender-bias-neural-natural-language/). In Logic, Language, and Security: Essays Dedicated to Andre Scedrov on the Occasion of his 65th Birthday, pp. 189–202. (2020)
35. Chen, Y., Raghuram, V.C., Mattern, J., Mihalcea, R., Jin, Z.: Causally testing gender bias in LLMs: A case study on occupational bias. In Findings of NAACL, pp. 4984–5004. (2025). [find](https://scholar.google.com/scholar?q=Chen%2C+Y%2E%2C+Raghuram%2C+V%2EC%2E%2C+Mattern%2C+J%2E%2C+Mihalcea%2C+R%2E%2C+Jin%2C+Z%2E%3A+Causally+testing+gender+bias+in+LLMs%3A+A+case+study+on+occupational+bias%2E+In+Findings+of+NAACL%2C+pp%2E+4984%E2%80%935004%2E+%282025%29%2E)
36. Garimella, A., Amarnath, A., Kumar, K., Yalla, A.P., Chhaya, N., Srinivasan, B.V., et al.: He is very intelligent, she is very beautiful? On mitigating social biases in language modelling and generation. In Findings of ACL, pp. 4534–4545. (2021). [find](https://scholar.google.com/scholar?q=Garimella%2C+A%2E%2C+Amarnath%2C+A%2E%2C+Kumar%2C+K%2E%2C+Yalla%2C+A%2EP%2E%2C+Chhaya%2C+N%2E%2C+Srinivasan%2C+B%2EV%2E%2C+et+al%2E%3A+He+is+very+intelligent%2C+she+is+very+beautiful%3F+On+mitigating+social+biases+in+language+modelling+and+generati)
37. Bardol, F.: ChatGPT Reads Your Tone and Responds Accordingly – Until It Does Not – Emotional Framing Induces Bias in LLM Outputs. arXiv preprint arXiv:2507.21083 (2025) [↗](https://arxiv.org/abs/2507.21083)
38. Linzen, T., Dupoux, E., Goldberg, Y.: [Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies](https://md.research.elamur.ai/free/en/papers/linzen-2016-assessing-ability-lstms-learn-syntax/). TACL 4, 521–535 (2016).
39. Gulordava, K., Bojanowski, P., Grave, E., Linzen, T., Baroni, M.: [Colorless Green Recurrent Networks Dream Hierarchically](https://md.research.elamur.ai/free/en/papers/gulordava-2018-colorless-green-recurrent-networks-dream/). In Proceedings of NAACL, pp. 1195– 1205. (2018).
40. Wilcox, E.G., Futrell, R., Levy, R.: Using computational models to test syntactic learnability. Linguistic Inquiry 55(4), 805–848. (2024). [find](https://scholar.google.com/scholar?q=Wilcox%2C+E%2EG%2E%2C+Futrell%2C+R%2E%2C+Levy%2C+R%2E%3A+Using+computational+models+to+test+syntactic+learnability%2E+Linguistic+Inquiry+55%284%29%2C+805%E2%80%93848%2E+%282024%29%2E)
41. Wilcox, E., Levy, R., Morita, T., Futrell, R.: What do RNN Language Models Learn about Filler–Gap Dependencies? In BlackboxNLP, pp. 211–221. (2018). — [What do RNN Language Models Learn about Filler-Gap Dependencies?](https://md.research.elamur.ai/free/en/papers/wilcox-2018-rnn-language-models-learn-about/)
42. Marvin, R., Linzen, T.: Targeted Syntactic Evaluation of Language Models. In EMNLP, pp. 1192–1202. (2018). [find](https://scholar.google.com/scholar?q=Marvin%2C+R%2E%2C+Linzen%2C+T%2E%3A+Targeted+Syntactic+Evaluation+of+Language+Models%2E+In+EMNLP%2C+pp%2E+1192%E2%80%931202%2E+%282018%29%2E)
43. Warstadt, A., Parrish, A., Liu, H., Mohananey, A., Peng, W., Wang, S.-F., Bowman, S.R.: [BLiMP: The benchmark of linguistic minimal pairs for English](https://md.research.elamur.ai/free/en/papers/warstadt-2020-blimp-benchmark-linguistic-minimal-pairs/). TACL 8, 377–392. (2020).
44. Sandler, M., Choung, H., Ross, A., David, P.: A linguistic comparison between human and ChatGPT-generated conversations. In International Conference on Pattern Recognition and Artificial Intelligence, pp. 366–380. (2024) [find](https://scholar.google.com/scholar?q=Sandler%2C+M%2E%2C+Choung%2C+H%2E%2C+Ross%2C+A%2E%2C+David%2C+P%2E%3A+A+linguistic+comparison+between+human+and+ChatGPT%2Dgenerated+conversations%2E+In+International+Conference+on+Pattern+Recognition+and+Artificial+Intelligence%2C)
45. Muñoz-Ortiz, A., Gómez-Rodríguez, C., Vilares, D.: Contrasting linguistic patterns in human and LLM-generated news text. Artificial Intelligence Review 57(10), 265. (2024). Evaluating Usage of AAVE in LLMs D. Dunlap, R.T. McCoy [find](https://scholar.google.com/scholar?q=Mu%C3%B1oz%2DOrtiz%2C+A%2E%2C+G%C3%B3mez%2DRodr%C3%ADguez%2C+C%2E%2C+Vilares%2C+D%2E%3A+Contrasting+linguistic+patterns+in+human+and+LLM%2Dgenerated+news+text%2E+Artificial+Intelligence+Review+57%2810%29%2C+265%2E+%282024%29%2E+Evaluating+Usage+of+AAVE+in)
46. Kendall, T., Farrington, C.: The Corpus of Regional African American Language. The Online Resources for African American Language Project. (2023). [find](https://scholar.google.com/scholar?q=Kendall%2C+T%2E%2C+Farrington%2C+C%2E%3A+The+Corpus+of+Regional+African+American+Language%2E+The+Online+Resources+for+African+American+Language+Project%2E+%282023%29%2E)
47. Gemma Team: Gemma 2: Improving open language models at a practical size. arXiv preprint arXiv:2408.00118. (2024). [↗](https://arxiv.org/abs/2408.00118)
48. Zanuttini, R., Wood, J., Zentz, J., Horn, L.: The Yale Grammatical Diversity Project: Morphosyntactic variation in North American English. Linguistics Vanguard. (2025). [find](https://scholar.google.com/scholar?q=Zanuttini%2C+R%2E%2C+Wood%2C+J%2E%2C+Zentz%2C+J%2E%2C+Horn%2C+L%2E%3A+The+Yale+Grammatical+Diversity+Project%3A+Morphosyntactic+variation+in+North+American+English%2E+Linguistics+Vanguard%2E+%282025%29%2E)
49. Green, L.J.: African American English: a Linguistic Introduction. Cambridge University Press. (2002). [find](https://scholar.google.com/scholar?q=Green%2C+L%2EJ%2E%3A+African+American+English%3A+a+Linguistic+Introduction%2E+Cambridge+University+Press%2E+%282002%29%2E)
50. Hutto, C., Gilbert, E.: VADER: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the International AAAI Conference on Web and Social Media. (2014). [find](https://scholar.google.com/scholar?q=Hutto%2C+C%2E%2C+Gilbert%2C+E%2E%3A+VADER%3A+A+parsimonious+rule%2Dbased+model+for+sentiment+analysis+of+social+media+text%2E+In+Proceedings+of+the+International+AAAI+Conference+on+Web+and+Social+Media%2E+%282014%29%2E)

*Updated 31 October 2026*