---
title: "Exploring Chunk Based Templates for Generating a subset of"
description: "The paper addresses tactical generation: producing a grammatical English sentence in isolation that satisfies given constraints… 10 references."
authors: ["Nikhilesh Bhatnagar", "Manish Shrivastava", "Radhika Mamidi"]
year: 2018
venue: "Proceedings of ACL 2018, Student Research Workshop"
source: "https://aclanthology.org/P18-3017/"
doi: "10.18653/v1/p18-3017"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bhatnagar-2018-exploring-chunk-based-templates-generating/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bhatnagar-2018-exploring-chunk-based-templates-generating/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2018](https://md.research.elamur.ai/free/en/papers/2018/page/8/) / Exploring Chunk Based Templates for Generating a subset of English Text

# Exploring Chunk Based Templates for Generating a subset of English Text

**Authors:** Nikhilesh Bhatnagar, [Manish Shrivastava](https://md.research.elamur.ai/free/en/authors/manish-shrivastava/) and [Radhika Mamidi](https://md.research.elamur.ai/free/en/authors/radhika-mamidi/) · **Year:** 2018 · **Venue:** [Proceedings of ACL 2018, Student Research Workshop](https://md.research.elamur.ai/free/en/venues/acl-student-research-workshop/) ([ACL Student Research Workshop 2018](https://md.research.elamur.ai/free/en/venues/acl-student-research-workshop/2018/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/P18-3017/) · [PDF](https://aclanthology.org/P18-3017.pdf) · [DOI 10.18653/v1/p18-3017](https://doi.org/10.18653/v1/p18-3017) · [OpenAlex](https://openalex.org/W2886624034)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
The paper addresses tactical generation: producing a grammatical English sentence in isolation that satisfies given constraints, such as a partial bag-of-words, fixed token positions or required ordering. Rather than handcrafting templates, the authors mine them automatically from English Wikipedia. Each chunk becomes a template after abstraction. Named entities are replaced by category symbols, some POS classes are collapsed to their tags, and the remaining content words are mapped to KMeans clusters of token–POS embeddings. Stopwords and punctuation stay literal. Because every template is copied from real text, it is grammatical internally, so the open problem is only how to join templates.

Generation is treated as search. An evolutionary algorithm assembles template sequences under per-slot constraints. Its fitness function combines n-gram log-probabilities over chunk tags, chunk layouts, junctions, heads and lexical clusters. Finally, the cluster slots are filled with the requested words.

The evaluation consists only of example outputs, which are often syntactically plausible but semantically odd. The work matters as a corpus-driven, inspectable alternative to hand-written templates.

## Key points
- Templates were extracted from English Wikipedia using Stanford CoreNLP, spaCy and LM-LSTM-CRF for tagging, NER and chunking. Clustering used lexvec vectors with k = 7500 token–POS clusters.
- The fitness score is a weighted sum of five length-normalized n-gram scores (chunk, construction, junction, head, lexical) with empirically chosen weights of 75, 10, 10, 5 and 2.
- The evolutionary search works as follows:
  - population of 1000 organisms, run for 100 generations;
  - elitist selection, with the first half of the population mutated into the second half;
  - 25% of the population re-initialized each generation;
  - at least 8% of organisms must have unique blank layouts and 15% unique extended POS layouts.
- Template selection uses Zipf dampening with exponent 0.4, because otherwise NP chunks dominate (about 40% of picks).
- Generation took about 150 seconds and 2.2 GB of memory. The authors note biases toward sentences opening with "the" NPs and chains of VPs/PPs. Questions only appear when the wh-word position is constrained.

## Interesting ideas
- Build sentences by joining corpus fragments that are already well-formed internally, so the scorer only has to judge the seams between them rather than every word.
- Score a candidate with several separate n-gram models over different abstraction layers (chunk tags, chunk layouts, junction tokens, heads, lexical clusters) and combine them with explicit weights.
- Flatten a skewed Zipf distribution with a dampening exponent, so rare categories still get sampled while frequency preferences survive.
- Describe a chunk by its layout, with content words blanked or replaced by POS while function words and punctuation are kept, giving a compact construction signature.
- Cluster word embeddings per token–POS pair instead of per word form, so that each syntactic use of an ambiguous word gets its own class.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (back): Generation from the meaning graph could stitch verified phrase-level realizations taken from parsed text, and focus checking effort on boundaries between them.
- **I2** (back): Each sub-score explains which aspect of a generated sentence is weak, which fits Mova's requirement that every step be explainable.
- **I3** (learn): When sampling sentences for silver data or self-play, damping keeps rare constructions from being drowned out by common NP-heavy patterns.
- **I4** (learn): Such signatures could serve as keys for grouping parser errors and indexing self-induced repair rules by construction type.
- **I5** (tokens): POS-split clusters could provide backoff classes for rare lemmas in the tagger and morphology, without merging noun and verb behavior.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [International Institute of Information Technology, Hyderabad](https://md.research.elamur.ai/free/en/universities/international-institute-of-information-technology-hyderabad/) — University, Hyderabad, India · 42 works · 2,317 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (1): [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,379 works

## Cite

Cite as: Nikhilesh Bhatnagar, Manish Shrivastava and Radhika Mamidi. 2018. Exploring Chunk Based Templates for Generating a subset of English Text. Proceedings of ACL 2018, Student Research Workshop.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{bhatnagar2018exploring,
  title = {{Exploring Chunk Based Templates for Generating a subset of English Text}},
  author = {Nikhilesh Bhatnagar, Manish Shrivastava and Radhika Mamidi},
  booktitle = {Proceedings of ACL 2018, Student Research Workshop},
  year = {2018},
  doi = {10.18653/v1/p18-3017},
  url = {https://doi.org/10.18653/v1/p18-3017}
}
```

- [← previous Explorations in an English Poetry Corpus: A Neurocognitive Poetics Perspective](https://md.research.elamur.ai/free/en/papers/jacobs-2018-explorations-english-poetry-corpus-neurocognitive/)
- [next → Focalization in the Old Testament Narratives with Specific Examples from the Book of Ruth](https://md.research.elamur.ai/free/en/papers/nazarov-2021-focalization-old-testament-narratives-specific/)
- [↑ back to papers of 2018](https://md.research.elamur.ai/free/en/papers/2018/page/8/)

## References

10 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Nikhilesh Bhatnagar and Radhika Mamidi. 2016. Experiments in linear template combination using genetic algorithms. 22nd Himalayan Languages Symposium. [find](https://scholar.google.com/scholar?q=Nikhilesh+Bhatnagar+and+Radhika+Mamidi%2E+2016%2E+Experiments+in+linear+template+combination+using+genetic+algorithms%2E+22nd+Himalayan+Languages+Symposium%2E)
2. Dimitrios Galanis and Ion Androutsopoulos. 2007. Generating multilingual descriptions from linguistically annotated owl ontologies: the naturalowl system. In Proceedings of the Eleventh European Workshop on Natural Language Generation, pages 143–146. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Dimitrios+Galanis+and+Ion+Androutsopoulos%2E+2007%2E+Generating+multilingual+descriptions+from+linguistically+annotated+owl+ontologies%3A+the+naturalowl+system%2E+In+Proceedings+of+the+Eleventh+European+Works)
3. Matthew Honnibal and Ines Montani. 2017. spacy 2: Natural language understanding with bloom embeddings, convolutional neural networks and incremental parsing. To appear. [find](https://scholar.google.com/scholar?q=Matthew+Honnibal+and+Ines+Montani%2E+2017%2E+spacy+2%3A+Natural+language+understanding+with+bloom+embeddings%2C+convolutional+neural+networks+and+incremental+parsing%2E+To+appear%2E)
4. Ravi Kondadadi, Blake Howald, and Frank Schilder. 2013. A statistical nlg framework for aggregated planning and realization. In ACL (1), pages 1406– 1415. [find](https://scholar.google.com/scholar?q=Ravi+Kondadadi%2C+Blake+Howald%2C+and+Frank+Schilder%2E+2013%2E+A+statistical+nlg+framework+for+aggregated+planning+and+realization%2E+In+ACL+%281%29%2C+pages+1406%E2%80%93+1415%2E)
5. L. Liu, J. Shang, F. Xu, X. Ren, H. Gui, J. Peng, and J. Han. 2018. [Empower Sequence Labeling with Task-Aware Neural Language Model](https://md.research.elamur.ai/free/en/papers/liu-2017-empower-sequence-labeling-task-aware/). In AAAI.
6. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David Mc-Closky. 2014. [The Stanford CoreNLP natural language processing toolkit](https://md.research.elamur.ai/free/en/papers/manning-2014-stanford-corenlp-natural-language-processing/). In Association for Computational Linguistics (ACL) System Demonstrations, pages 55–60. [↗](https://doi.org/10.3115/v1/p14-5010)
7. Ehud Reiter and Robert Dale. 2000. Building natural language generation systems. Cambridge university press. [find](https://scholar.google.com/scholar?q=Ehud+Reiter+and+Robert+Dale%2E+2000%2E+Building+natural+language+generation+systems%2E+Cambridge+university+press%2E)
8. Alexander I Rudnicky and Alice H Oh. 2002. Dialog annotation for stochastic generation. [find](https://scholar.google.com/scholar?q=Alexander+I+Rudnicky+and+Alice+H+Oh%2E+2002%2E+Dialog+annotation+for+stochastic+generation%2E)
9. Alexandre Salle, Marco Idiart, and Aline Villavicencio. 2016. Matrix factorization using window sampling and negative sampling for improved word representations. CoRR, abs/1606.00819. [↗](https://arxiv.org/abs/1606.00819)
10. Kees Van Deemter, Emiel Krahmer, and Mariët Theune. 2005. Real versus template-based natural language generation: A false opposition? Computational Linguistics, 31(1):15–24. [find](https://scholar.google.com/scholar?q=Kees+Van+Deemter%2C+Emiel+Krahmer%2C+and+Marie%CC%88t+Theune%2E+2005%2E+Real+versus+template%2Dbased+natural+language+generation%3A+A+false+opposition%3F+Computational+Linguistics%2C+31%281%29%3A15%E2%80%9324%2E)

*Updated 2 November 2026*