---
title: "Zero Shot Phonics — paper by Manlises and Ong (2026)"
description: "This study tests whether large language models can meet all of these requirements at once without examples or fine-tuning. 26 references."
authors: ["Maria Monica Manlises", "Ethel Ong"]
year: 2026
venue: "Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)"
source: "https://aclanthology.org/2026.bea-1.61/"
doi: "10.18653/v1/2026.bea-1.61"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/manlises-2026-zero-shot-phonics-evaluating-constraint/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/manlises-2026-zero-shot-phonics-evaluating-constraint/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/48/) / Zero Shot Phonics: Evaluating Constraint-Adherent Phonics Story Generation in Large Language Models

# Zero Shot Phonics: Evaluating Constraint-Adherent Phonics Story Generation in Large Language Models

**Authors:** Maria Monica Manlises and Ethel Ong · **Year:** 2026 · **Venue:** [Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)](https://md.research.elamur.ai/free/en/venues/bea/) ([BEA 2026](https://md.research.elamur.ai/free/en/venues/bea/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.bea-1.61/) · [PDF](https://aclanthology.org/2026.bea-1.61.pdf) · [DOI 10.18653/v1/2026.bea-1.61](https://doi.org/10.18653/v1/2026.bea-1.61) · [OpenAlex](https://openalex.org/W7166830600)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Phonics stories help early readers learn to decode. They must repeat target grapheme-phoneme (GP) correspondences while staying short, simple and suitable for young children. This study tests whether large language models can meet all of these requirements at once without examples or fine-tuning. The authors built 16 prompt configurations, grouped into three prompt sets, and ran them zero-shot on six LLMs. This produced 8,688 outputs containing 39,096 short stories. Target GP pairs came from Pearson's Phonics Progression Chart. Each story was scored with a 12-metric framework covering four areas: phonological alignment, developmentally appropriate vocabulary, readability and narrative quality. The models reliably wrote easy, age-appropriate text. Their control over target sounds was only moderate, and narrative coherence varied. Both prompt wording and model choice mattered. Gains in phoneme reinforcement tended to cost story quality, and the reverse was also true. No model satisfied every constraint. The work frames phonics story generation as a demanding benchmark for controllable educational text generation. It suggests that methods beyond prompting will be needed, such as constrained decoding, structured generation or fine-tuning.

## Key points
- **Models and data:** six models available as of March 2025 were compared: Claude-3.7-Sonnet, GPT-4o, GPT-4o-Mini, Gemini-2.0 Flash, DeepSeek-V3 and Mistral-Large-2.1. All prompts, stories and evaluation code are released on Hugging Face as `monicamanlises/zero-shot-phonics`.
- **Prompt design:**
  - Stories target four sentences; outputs of three to five sentences were kept.
  - Half the prompts ask for one story and half ask for eight.
  - To test whether wording matters, the prompts vary their label for the task, using either "phonics stories" or "decodable texts".
- **Phonological scoring:** phonemes are written in ARPABET. Alignment is measured by matching GP pairs after G2P conversion, which ignores pronunciation variation.
- **Narrative scoring:** narrative quality was judged by a single rubric-guided LLM evaluator. Readability relied on formula-based measures.
- **Limitations:**
  - There was no expert review, classroom testing or comparison with human-written phonics stories.
  - Sampling was non-deterministic.
  - Only English was studied.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [De La Salle University](https://md.research.elamur.ai/free/en/universities/de-la-salle-university/) — University, Manila, Philippines · 2 works · 1 citation

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [✍️ Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/) · 202 works

## Cite

Cite as: Maria Monica Manlises and Ethel Ong. 2026. Zero Shot Phonics: Evaluating Constraint-Adherent Phonics Story Generation in Large Language Models. Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{manlises2026zero,
  title = {{Zero Shot Phonics: Evaluating Constraint-Adherent Phonics Story Generation in Large Language Models}},
  author = {Maria Monica Manlises and Ethel Ong},
  booktitle = {Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.bea-1.61},
  url = {https://doi.org/10.18653/v1/2026.bea-1.61}
}
```

- [← previous Yoysef Meyer Yavets (1832–1914), Yiddish Translator of Sacred Jewish Books](https://md.research.elamur.ai/free/en/papers/hever-chybowski-2026-yoysef-meyer-yavets-18321914-yiddish/)
- [next → Zero-Shot Context-Aware ASR for Diverse Arabic Varieties](https://md.research.elamur.ai/free/en/papers/talafha-2026-zero-shot-context-aware-asr/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/48/)

## References

26 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jawharah Alasmari, Mohammed Alzyoudi, Masheal Alshehri, Rana Alshammari, and Reyouf Aldakan. 2025. An automated predictive model for evaluating narrative cohesion in children’s stories: a computational linguistic approach considering gérard genette’s narrative structure theory. International Journal… [find](https://scholar.google.com/scholar?q=Jawharah+Alasmari%2C+Mohammed+Alzyoudi%2C+Masheal+Alshehri%2C+Rana+Alshammari%2C+and+Reyouf+Aldakan%2E+2025%2E+An+automated+predictive+model+for+evaluating+narrative+cohesion+in+children%E2%80%99s+stories%3A+a+computationa)
2. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter,… — [Language Models are Few-Shot Learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
3. Jennifer P. Cheatham and Jill H. Allor. 2012. The influence of decodability in early reading text on reading achievement: a review of the evidence. Reading and Writing, 25(9):2223–2246. [find](https://scholar.google.com/scholar?q=Jennifer+P%2E+Cheatham+and+Jill+H%2E+Allor%2E+2012%2E+The+influence+of+decodability+in+early+reading+text+on+reading+achievement%3A+a+review+of+the+evidence%2E+Reading+and+Writing%2C+25%289%29%3A2223%E2%80%932246%2E)
4. Department for Education and Skills. 2008. Letters and sounds: Principles and practice of high quality phonics. Technical report, UK Department for Education and Skills, Nottingham, UK. [find](https://scholar.google.com/scholar?q=Department+for+Education+and+Skills%2E+2008%2E+Letters+and+sounds%3A+Principles+and+practice+of+high+quality+phonics%2E+Technical+report%2C+UK+Department+for+Education+and+Skills%2C+Nottingham%2C+UK%2E)
5. Linnea C. Ehri. 2020. The science of learning to read words: A case for systematic phonics instruction. Reading Research Quarterly, 55(S1):S45–S60. [find](https://scholar.google.com/scholar?q=Linnea+C%2E+Ehri%2E+2020%2E+The+science+of+learning+to+read+words%3A+A+case+for+systematic+phonics+instruction%2E+Reading+Research+Quarterly%2C+55%28S1%29%3AS45%E2%80%93S60%2E)
6. Charlie Hargood, David Millard, and Mark Weal. 2011. Measuring narrative cohesion: A five variables approach. In Narrative and Hypertext Workshop at Hypertext 11 (06/06/11). [find](https://scholar.google.com/scholar?q=Charlie+Hargood%2C+David+Millard%2C+and+Mark+Weal%2E+2011%2E+Measuring+narrative+cohesion%3A+A+five+variables+approach%2E+In+Narrative+and+Hypertext+Workshop+at+Hypertext+11+%2806%2F06%2F11%29%2E)
7. Victor Kuperman, Hans Stadthagen-Gonzalez, and Marc Brysbaert. 2012. Age-of-acquisition ratings for 30,000 English words. Behavior Research Methods, 44(4):978–990. [find](https://scholar.google.com/scholar?q=Victor+Kuperman%2C+Hans+Stadthagen%2DGonzalez%2C+and+Marc+Brysbaert%2E+2012%2E+Age%2Dof%2Dacquisition+ratings+for+30%2C000+English+words%2E+Behavior+Research+Methods%2C+44%284%29%3A978%E2%80%93990%2E)
8. Hugo Liu and Push Singh. 2002. Makebelieve: using commonsense knowledge to generate stories. In Eighteenth National Conference on Artificial Intelligence, page 957–958, USA. American Association for Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Hugo+Liu+and+Push+Singh%2E+2002%2E+Makebelieve%3A+using+commonsense+knowledge+to+generate+stories%2E+In+Eighteenth+National+Conference+on+Artificial+Intelligence%2C+page+957%E2%80%93958%2C+USA%2E+American+Association+for+A)
9. Ronald William Marbun and Makoto Shishido. 2026. A readability-driven prompting framework for accurate grade-specific efl narrative creation. International Journal of Advanced Computer Science and Applications, 17(1). [find](https://scholar.google.com/scholar?q=Ronald+William+Marbun+and+Makoto+Shishido%2E+2026%2E+A+readability%2Ddriven+prompting+framework+for+accurate+grade%2Dspecific+efl+narrative+creation%2E+International+Journal+of+Advanced+Computer+Science+and+App)
10. James R. Meehan. 1977. Tale-spin, an interactive program that writes stories. In Proceedings of the 5th International Joint Conference on Artificial Intelligence - Volume 1, IJCAI’77, pages 91–98, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc. [find](https://scholar.google.com/scholar?q=James+R%2E+Meehan%2E+1977%2E+Tale%2Dspin%2C+an+interactive+program+that+writes+stories%2E+In+Proceedings+of+the+5th+International+Joint+Conference+on+Artificial+Intelligence+%2D+Volume+1%2C+IJCAI%E2%80%9977%2C+pages+91%E2%80%9398%2C+San)
11. Dennis Murphy Odo. 2024. The use of decodable texts in the teaching of reading in children without reading disabilities: a meta-analysis. Literacy, 58(3):267– 277. [find](https://scholar.google.com/scholar?q=Dennis+Murphy+Odo%2E+2024%2E+The+use+of+decodable+texts+in+the+teaching+of+reading+in+children+without+reading+disabilities%3A+a+meta%2Danalysis%2E+Literacy%2C+58%283%29%3A267%E2%80%93+277%2E)
12. National Reading Panel. 2000. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups. Technical Report NIH Publication No. 00-4754, National Institute of Child Health and Human De… [find](https://scholar.google.com/scholar?q=National+Reading+Panel%2E+2000%2E+Teaching+children+to+read%3A+An+evidence%2Dbased+assessment+of+the+scientific+research+literature+on+reading+and+its+implications+for+reading+instruction%3A+Reports+of+the+subg)
13. Pearson Education. n.d. Phonics progression chart. Accessed 2025. [find](https://scholar.google.com/scholar?q=Pearson+Education%2E+n%2Ed%2E+Phonics+progression+chart%2E+Accessed+2025%2E)
14. Linkai Peng, Baorian Nuchged, and Yingming Gao. 2025. Spoken language intelligence of large language models for language learning. Preprint, arXiv:2308.14536. — [arXiv:2308.14536](https://arxiv.org/abs/2308.14536) [find](https://scholar.google.com/scholar?q=Linkai+Peng%2C+Baorian+Nuchged%2C+and+Yingming+Gao%2E+2025%2E+Spoken+language+intelligence+of+large+language+models+for+language+learning%2E+Preprint%2C+arXiv%3A2308%2E14536%2E+%E2%80%94+%5BarXiv%3A2308%2E14536%5D%28https%3A%2F%2Farxiv%2Eorg%2Fab)
15. A All prompt sets incorporated the basic prompt structure in Figure 1 and had respective additional requirements listed in Figures 2, 3, and 4. System Prompt: You are a children’s story writer and children’s educator specializing in speech and language acquisition. You write decodable texts and phon… [find](https://scholar.google.com/scholar?q=A+All+prompt+sets+incorporated+the+basic+prompt+structure+in+Figure+1+and+had+respective+additional+requirements+listed+in+Figures+2%2C+3%2C+and+4%2E+System+Prompt%3A+You+are+a+children%E2%80%99s+story+writer+and+chi)
16. Ashley E. Pennell, Rebecca Lee Payne Jordan, Kindel Turner Nash, Kerry Elson, and Woodrow Tra-then. 2024. A healthy diet for beginning readers: Decodable texts as part of a comprehensive literacy program. The Reading Teacher, 77(5):673–684. [find](https://scholar.google.com/scholar?q=Ashley+E%2E+Pennell%2C+Rebecca+Lee+Payne+Jordan%2C+Kindel+Turner+Nash%2C+Kerry+Elson%2C+and+Woodrow+Tra%2Dthen%2E+2024%2E+A+healthy+diet+for+beginning+readers%3A+Decodable+texts+as+part+of+a+comprehensive+literacy+prog)
17. Melissa Roemmele, Andrew S. Gordon, and Reid Swanson. 2017. Evaluating story generation systems using automated linguistic analyses. [find](https://scholar.google.com/scholar?q=Melissa+Roemmele%2C+Andrew+S%2E+Gordon%2C+and+Reid+Swanson%2E+2017%2E+Evaluating+story+generation+systems+using+automated+linguistic+analyses%2E)
18. Story Requirements: - (Prompt-specific additional requirements) - The story must contain exactly four sentences. - Each sentence must contain fewer than eleven syllables. - The story must reinforce the target phoneme(s). [find](https://scholar.google.com/scholar?q=Story+Requirements%3A+%2D+%28Prompt%2Dspecific+additional+requirements%29+%2D+The+story+must+contain+exactly+four+sentences%2E+%2D+Each+sentence+must+contain+fewer+than+eleven+syllables%2E+%2D+The+story+must+reinforce+th)
19. Jim Rose. 2006. Independent review of the teaching of early reading. Technical report, UK Department for Education. [find](https://scholar.google.com/scholar?q=Jim+Rose%2E+2006%2E+Independent+review+of+the+teaching+of+early+reading%2E+Technical+report%2C+UK+Department+for+Education%2E)
20. Jiao Sun, Yufei Tian, Wangchunshu Zhou, Nan Xu, Qian Hu, Rahul Gupta, John Wieting, Nanyun Peng, and Xuezhe Ma. 2023. Evaluating large language models on controlled generation tasks. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3155–3168, Singapore… [find](https://scholar.google.com/scholar?q=Jiao+Sun%2C+Yufei+Tian%2C+Wangchunshu+Zhou%2C+Nan+Xu%2C+Qian+Hu%2C+Rahul+Gupta%2C+John+Wieting%2C+Nanyun+Peng%2C+and+Xuezhe+Ma%2E+2023%2E+Evaluating+large+language+models+on+controlled+generation+tasks%2E+In+Proceedings+of)
21. Ashima Suvarna, Harshita Khandelwal, and Nanyun Peng. 2024. PhonologyBench: Evaluating phonological skills of large language models. In Proceedings of the 1st Workshop on Towards Knowledgeable Language Models (KnowLLM 2024), pages 1–14, Bangkok, Thailand. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ashima+Suvarna%2C+Harshita+Khandelwal%2C+and+Nanyun+Peng%2E+2024%2E+PhonologyBench%3A+Evaluating+phonological+skills+of+large+language+models%2E+In+Proceedings+of+the+1st+Workshop+on+Towards+Knowledgeable+Languag)
22. Yufei Tian, Tenghao Huang, Miri Liu, Derek Jiang, Alexander Spangher, Muhao Chen, Jonathan May, and Nanyun Peng. 2024. [Are large language models capable of generating human-level narratives?](https://md.research.elamur.ai/free/en/papers/tian-2024-are-large-language-models-capable/) In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 17659–17681,…
23. S.R. Turner. 1992. MINSTREL, a Computer Model of Creativity and Storytelling. UCLA Computer Science Department. [find](https://scholar.google.com/scholar?q=S%2ER%2E+Turner%2E+1992%2E+MINSTREL%2C+a+Computer+Model+of+Creativity+and+Storytelling%2E+UCLA+Computer+Science+Department%2E)
24. Maria Valentini, Jennifer Weber, Jesus Salcido, Téa Wright, Eliana Colunga, and Katharina von der Wense. 2023. On the automatic generation and simplification of children‘s stories. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3588–3598, Singapore.… [find](https://scholar.google.com/scholar?q=Maria+Valentini%2C+Jennifer+Weber%2C+Jesus+Salcido%2C+T%C3%A9a+Wright%2C+Eliana+Colunga%2C+and+Katharina+von+der+Wense%2E+2023%2E+On+the+automatic+generation+and+simplification+of+children%E2%80%98s+stories%2E+In+Proceedings+of+t)
25. Zhuohan Xie, Trevor Cohn, and Jey Han Lau. 2023. The next chapter: A study of large language models in storytelling. In Proceedings of the 16th International Natural Language Generation Conference, pages 323–351, Prague, Czechia. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhuohan+Xie%2C+Trevor+Cohn%2C+and+Jey+Han+Lau%2E+2023%2E+The+next+chapter%3A+A+study+of+large+language+models+in+storytelling%2E+In+Proceedings+of+the+16th+International+Natural+Language+Generation+Conference%2C+pa)
26. Prompt Design Additional Requirements: - Each sentence must include at least 2 words containing the grapheme ’{grapheme}’. *Figure 2: Prompt Set 1: Single GP and Narrative Focus* Across all prompt sets, systematic variations, as seen in Table 2 were applied. The phrase “phonics story” was replaced w… [find](https://scholar.google.com/scholar?q=Prompt+Design+Additional+Requirements%3A+%2D+Each+sentence+must+include+at+least+2+words+containing+the+grapheme+%E2%80%99%7Bgrapheme%7D%E2%80%99%2E+%2AFigure+2%3A+Prompt+Set+1%3A+Single+GP+and+Narrative+Focus%2A+Across+all+prompt+set)

*Updated 1 November 2026*