---
title: "Caged Birds and Cute Bookworms: Feminine Tropes and Implicit"
description: "The paper asks whether LLMs carry hidden gender assumptions into creative writing when a prompt never mentions gender. 30 references."
authors: ["Sachita Nishal", "Jack Bandy"]
year: 2026
venue: "Proceedings of the Workshop on Evaluating Evaluations (EvalEval)"
source: "https://aclanthology.org/2026.evaleval-1.22/"
doi: "10.18653/v1/2026.evaleval-1.22"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/nishal-2026-caged-birds-cute-bookworms-feminine/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nishal-2026-caged-birds-cute-bookworms-feminine/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/24/) / Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language Models

# Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language Models

**Authors:** Sachita Nishal and Jack Bandy · **Year:** 2026 · **Venue:** [Proceedings of the Workshop on Evaluating Evaluations (EvalEval)](https://md.research.elamur.ai/free/en/venues/evaleval/) ([EvalEval 2026](https://md.research.elamur.ai/free/en/venues/evaleval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.evaleval-1.22/) · [PDF](https://aclanthology.org/2026.evaleval-1.22.pdf) · [DOI 10.18653/v1/2026.evaleval-1.22](https://doi.org/10.18653/v1/2026.evaleval-1.22) · [OpenAlex](https://openalex.org/W7166827442)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
The paper asks whether LLMs carry hidden gender assumptions into creative writing when a prompt never mentions gender. The authors built a benchmark from the crowd-sourced TV Tropes wiki. They scored each trope's genderedness using the method of Gala et al. (2020) and kept strongly feminine-leaning tropes. They then removed tropes with gendered words in their titles. Both authors annotated the rest by hand, keeping only implicitly gendered tropes about a single character.

Each trope became 12 story prompts: three wordings crossed with four pronoun conditions (none, they, she, he). The prompts were given to four open-weight instruction-tuned models, and protagonist gender was inferred mainly from pronouns.

All models defaulted to female protagonists when no gender was given. They usually ignored requested they/them pronouns, and sometimes made a character female even when asked for he/him.

The authors argue that bias in generated stories is a matter of narrative and character construction, not just word choice. This matters as LLMs power storytelling tools.

## Key points
- **Dataset filtering:** 19,727 de-duplicated TV Tropes entries were narrowed in stages.
  - 988 tropes in the top 5th percentile of feminine genderedness
  - 522 tropes after removing gendered titles
  - 211 manually verified tropes (Cohen's Kappa = 0.65 on a 200-trope sample)
- **Prompt design:** Plot, Summary, and Sentences wordings were crossed with Ambiguous, They, She, and He conditions. This gave 2,532 stories per model.
- **Models tested:** Gemma 3 (12B), Llama 3.1 (8B), Phi-4 (14B), and Qwen 3 (14B).
- **Main findings:** The feminine default held across all three wordings, though Plot prompts produced somewhat fewer female protagonists. Phi-4 often avoided the problem by choosing neutral names such as Alex or Jamie, which the authors see as a surface-level fix.
- **Limitations:** The data is English-language and Global North–centric, only gender is studied (no intersectional identities), and the dataset is released on GitHub.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (3): [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 543 works · [🤝 Gender Studies](https://md.research.elamur.ai/free/en/shelves/social-sciences/gender-studies/) · 52 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🛡️ Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · 517 works

## Cite

Cite as: Sachita Nishal and Jack Bandy. 2026. Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language Models. Proceedings of the Workshop on Evaluating Evaluations (EvalEval).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{nishal2026caged,
  title = {{Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language Models}},
  author = {Sachita Nishal and Jack Bandy},
  booktitle = {Proceedings of the Workshop on Evaluating Evaluations (EvalEval)},
  year = {2026},
  doi = {10.18653/v1/2026.evaleval-1.22},
  url = {https://doi.org/10.18653/v1/2026.evaleval-1.22}
}
```

- [← previous CachePrune: Teaching LLMs What Not to Follow via KV-Cache Editing](https://md.research.elamur.ai/free/en/papers/wang-2026-cacheprune-teaching-llms-what-not/)
- [next → CAI@LTEDI 2026: Multilingual Gender Inclusive Language Generation using Instruction-Guided mT5 Transformer Model](https://md.research.elamur.ai/free/en/papers/nair-2026-cai-ltedi-2026-multilingual-gender/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/24/)

## References

30 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abubakar Abid, Maheen Farooqi, and James Zou. 2021. [Persistent anti-muslim bias in large language models](https://md.research.elamur.ai/free/en/papers/abid-2021-persistent-anti-muslim-bias-large/). In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, pages 298–306.
2. Nader Akoury, Shufan Wang, Josh Whiting, Stephen Hood, Nanyun Peng, and Mohit Iyyer. 2020. STO-RIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6470–6484, Online.… [find](https://scholar.google.com/scholar?q=Nader+Akoury%2C+Shufan+Wang%2C+Josh+Whiting%2C+Stephen+Hood%2C+Nanyun+Peng%2C+and+Mohit+Iyyer%2E+2020%2E+STO%2DRIUM%3A+A+Dataset+and+Evaluation+Platform+for+Machine%2Din%2Dthe%2DLoop+Story+Generation%2E+In+Proceedings+of+the+2)
3. Connor Baumler and Rachel Rudinger. 2022. [Recognition of they/them as singular personal pronouns in coreference resolution](https://md.research.elamur.ai/free/en/papers/baumler-2022-recognition-they-them-as-singular/). In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 3426–3432, Seattle, Uni…
4. Amanda Bertsch, Ashley Oh, Sanika Natu, Swetha Gangu, Alan W. Black, and Emma Strubell. 2022. Evaluating Gender Bias Transfer from Film Data. In Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 235–243, Seattle, Washington. Association for Computational L… [find](https://scholar.google.com/scholar?q=Amanda+Bertsch%2C+Ashley+Oh%2C+Sanika+Natu%2C+Swetha+Gangu%2C+Alan+W%2E+Black%2C+and+Emma+Strubell%2E+2022%2E+Evaluating+Gender+Bias+Transfer+from+Film+Data%2E+In+Proceedings+of+the+4th+Workshop+on+Gender+Bias+in+Natur)
5. Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016. [Man is to computer programmer as woman is to homemaker? debiasing word embeddings](https://md.research.elamur.ai/free/en/papers/bolukbasi-2016-man-computer-programmer-woman-homemaker/). Advances in neural information processing systems, 29.
6. Mandar S. Chaudhary and Arnav Jhala. 2022. Computational Support for Trope Analysis of Textual Narratives. In Interactive Storytelling, Lecture Notes in Computer Science, pages 529–540, Cham. Springer International Publishing. [find](https://scholar.google.com/scholar?q=Mandar+S%2E+Chaudhary+and+Arnav+Jhala%2E+2022%2E+Computational+Support+for+Trope+Analysis+of+Textual+Narratives%2E+In+Interactive+Storytelling%2C+Lecture+Notes+in+Computer+Science%2C+pages+529%E2%80%93540%2C+Cham%2E+Springer)
7. Myra Cheng, Tiziano Piccardi, and Diyi Yang. 2023. Compost: Characterizing and evaluating caricature in llm simulations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 10853–10875. [find](https://scholar.google.com/scholar?q=Myra+Cheng%2C+Tiziano+Piccardi%2C+and+Diyi+Yang%2E+2023%2E+Compost%3A+Characterizing+and+evaluating+caricature+in+llm+simulations%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+Methods+in+Natural+Language+)
8. Jean-Peïc Chou, Alexa Fay Siu, Nedim Lipka, Ryan Rossi, Franck Dernoncourt, and Maneesh Agrawala. 2023. TaleStream: Supporting Story Ideation with Trope Knowledge. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, UIST ’23, pages 1–12, New York, NY, USA. Asso… [find](https://scholar.google.com/scholar?q=Jean%2DPe%C3%AFc+Chou%2C+Alexa+Fay+Siu%2C+Nedim+Lipka%2C+Ryan+Rossi%2C+Franck+Dernoncourt%2C+and+Maneesh+Agrawala%2E+2023%2E+TaleStream%3A+Supporting+Story+Ideation+with+Trope+Knowledge%2E+In+Proceedings+of+the+36th+Annual+AC)
9. Chengyu Chuang and Yi Yang. 2022. Buy tesla, sell ford: Assessing implicit stock market preference in pre-trained language models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 100–105. [find](https://scholar.google.com/scholar?q=Chengyu+Chuang+and+Yi+Yang%2E+2022%2E+Buy+tesla%2C+sell+ford%3A+Assessing+implicit+stock+market+preference+in+pre%2Dtrained+language+models%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Comp)
10. Ruadhán Mac Cormaic. 2023. A message from the Editor. The Irish Times. [find](https://scholar.google.com/scholar?q=Ruadh%C3%A1n+Mac+Cormaic%2E+2023%2E+A+message+from+the+Editor%2E+The+Irish+Times%2E)
11. Sorelle Friedler, Ranjit Singh, Borhane Blili-Hamelin, Jacob Metcalf, and Brian J Chen. 2023. AI Red-Teaming Is Not a One-Stop Solution to AI Harms: Recommendations for Using Red-Teaming for AI Accountability. Technical report, Data and Society. [find](https://scholar.google.com/scholar?q=Sorelle+Friedler%2C+Ranjit+Singh%2C+Borhane+Blili%2DHamelin%2C+Jacob+Metcalf%2C+and+Brian+J+Chen%2E+2023%2E+AI+Red%2DTeaming+Is+Not+a+One%2DStop+Solution+to+AI+Harms%3A+Recommendations+for+Using+Red%2DTeaming+for+AI+Accoun)
12. Dhruvil Gala, Mohammad Omar Khursheed, Hannah Lerner, Brendan O’Connor, and Mohit Iyyer. 2020. Analyzing Gender Bias within Narrative Tropes. In Proceedings of the Fourth Workshop on Natural Language Processing and Computational Social Science, pages 212–217, Online. Association for Computational Li… [find](https://scholar.google.com/scholar?q=Dhruvil+Gala%2C+Mohammad+Omar+Khursheed%2C+Hannah+Lerner%2C+Brendan+O%E2%80%99Connor%2C+and+Mohit+Iyyer%2E+2020%2E+Analyzing+Gender+Bias+within+Narrative+Tropes%2E+In+Proceedings+of+the+Fourth+Workshop+on+Natural+Language+)
13. Nikhil Garg, Londa Schiebinger, Dan Jurafsky, and James Zou. 2018. Word embeddings quantify 100 years of gender and ethnic stereotypes. Proceedings of the National Academy of Sciences, 115(16):E3635– E3644. [find](https://scholar.google.com/scholar?q=Nikhil+Garg%2C+Londa+Schiebinger%2C+Dan+Jurafsky%2C+and+James+Zou%2E+2018%2E+Word+embeddings+quantify+100+years+of+gender+and+ethnic+stereotypes%2E+Proceedings+of+the+National+Academy+of+Sciences%2C+115%2816%29%3AE3635%E2%80%93+)
14. Tarleton Gillespie. 2024. Generative ai and the politics of visibility. Big Data & Society, 11(2):20539517241252131. [find](https://scholar.google.com/scholar?q=Tarleton+Gillespie%2E+2024%2E+Generative+ai+and+the+politics+of+visibility%2E+Big+Data+%26+Society%2C+11%282%29%3A20539517241252131%2E)
15. Hadas Kotek, Rikker Dockum, and David Sun. 2023. Gender bias and stereotypes in large language models. In Proceedings of The ACM Collective Intelligence Conference, pages 12–24. [find](https://scholar.google.com/scholar?q=Hadas+Kotek%2C+Rikker+Dockum%2C+and+David+Sun%2E+2023%2E+Gender+bias+and+stereotypes+in+large+language+models%2E+In+Proceedings+of+The+ACM+Collective+Intelligence+Conference%2C+pages+12%E2%80%9324%2E)
16. Eve Kraicer and Andrew Piper. 2019. Social characters: the hierarchy of gender in contemporary english-language fiction. Journal of Cultural Analytics, 3(2). [find](https://scholar.google.com/scholar?q=Eve+Kraicer+and+Andrew+Piper%2E+2019%2E+Social+characters%3A+the+hierarchy+of+gender+in+contemporary+english%2Dlanguage+fiction%2E+Journal+of+Cultural+Analytics%2C+3%282%29%2E)
17. Li Lucy and David Bamman. 2021. [Gender and Representation Bias in GPT-3 Generated Stories](https://md.research.elamur.ai/free/en/papers/lucy-2021-gender-representation-bias-gpt-3/). In Proceedings of the Third Workshop on Narrative Understanding, pages 48–55, Virtual. Association for Computational Linguistics.
18. Moin Nadeem, Anna Bethke, and Siva Reddy. 2021. [Stereoset: Measuring stereotypical bias in pretrained language models](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/). In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long…
19. Will Oremus. 2023. He wrote a book on a rare subject. Then a ChatGPT replica appeared on Amazon. Washington Post. [find](https://scholar.google.com/scholar?q=Will+Oremus%2E+2023%2E+He+wrote+a+book+on+a+rare+subject%2E+Then+a+ChatGPT+replica+appeared+on+Amazon%2E+Washington+Post%2E)
20. Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, Phu Mon Htut, and Samuel Bowman. 2022. [Bbq: A hand-built bias benchmark for question answering](https://md.research.elamur.ai/free/en/papers/parrish-2022-bbq-hand-built-bias-benchmark/). In Findings of the Association for Computational Linguistics: ACL 2022, pages 2086–2105.
21. Mia Sato. 2023. AI-generated fiction is flooding literary magazines — but not fooling anyone. [find](https://scholar.google.com/scholar?q=Mia+Sato%2E+2023%2E+AI%2Dgenerated+fiction+is+flooding+literary+magazines+%E2%80%94+but+not+fooling+anyone%2E)
22. Hanieh Shakeri, Carman Neustaedter, and Steve Di-Paola. 2021. SAGA: Collaborative Storytelling with GPT-3. In Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, CSCW ’21 Companion, pages 163–166, New York, NY, USA. Association for Computing Mach… [find](https://scholar.google.com/scholar?q=Hanieh+Shakeri%2C+Carman+Neustaedter%2C+and+Steve+Di%2DPaola%2E+2021%2E+SAGA%3A+Collaborative+Storytelling+with+GPT%2D3%2E+In+Companion+Publication+of+the+2021+Conference+on+Computer+Supported+Cooperative+Work+and+So)
23. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. 2019. [The woman worked as a babysitter: On biases in language generation](https://md.research.elamur.ai/free/en/papers/sheng-2019-woman-worked-as-babysitter-biases/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (…
24. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. 2020. [Towards controllable biases in language generation](https://md.research.elamur.ai/free/en/papers/sheng-2020-controllable-biases-language-generation/). In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3239–3254.
25. Lihao Sun, Chengzhi Mao, Valentin Hofmann, and Xuechunzi Bai. 2025. [Aligned but blind: Alignment increases implicit bias by reducing awareness of race](https://md.research.elamur.ai/free/en/papers/sun-2025-aligned-but-blind-alignment-increases/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 22167–22184, Vienna, Austr…
26. Ted Underwood, David Bamman, and Sabrina Lee. 2018. The transformation of gender in english-language fiction. Journal of Cultural Analytics, 3(2). [find](https://scholar.google.com/scholar?q=Ted+Underwood%2C+David+Bamman%2C+and+Sabrina+Lee%2E+2018%2E+The+transformation+of+gender+in+english%2Dlanguage+fiction%2E+Journal+of+Cultural+Analytics%2C+3%282%29%2E)
27. Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and Bill Dolan. 2020. [DIALOGPT : Large-scale generative pre-training for conversational response generation](https://md.research.elamur.ai/free/en/papers/zhang-2019-dialogpt-large-scale-generative-pre/). In Proceedings of the 58th Annual Meeting of the Association for Computational Ling…
28. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. [Gender bias in coreference resolution: Evaluation and debiasing methods](https://md.research.elamur.ai/free/en/papers/zhao-2018-gender-bias-coreference-resolution-evaluation/). Preprint, arxiv:1804.06876 [cs].
29. Jieyu Zhao, Yichao Zhou, Zeyu Li, Wei Wang, and Kai-Wei Chang. 2018. [Learning Gender-Neutral Word Embeddings](https://md.research.elamur.ai/free/en/papers/zhao-2018-learning-gender-neutral-word-embeddings/). In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4847–4853, Brussels, Belgium. Association for Computational Linguistics.
30. Yachao Zhao, Bo Wang, Yan Wang, Dongming Zhao, Ruifang He, and Yuexian Hou. 2025. Explicit vs. implicit: Investigating social bias in large language models through self-reflection. In Findings of the Association for Computational Linguistics: ACL 2025, pages 1–12, Vienna, Austria. Association for Co… [find](https://scholar.google.com/scholar?q=Yachao+Zhao%2C+Bo+Wang%2C+Yan+Wang%2C+Dongming+Zhao%2C+Ruifang+He%2C+and+Yuexian+Hou%2E+2025%2E+Explicit+vs%2E+implicit%3A+Investigating+social+bias+in+large+language+models+through+self%2Dreflection%2E+In+Findings+of+the+)

*Updated 1 November 2026*