---
title: "Limited Attention and Discourse Structure — Walker 1996"
description: "She proposes the cache model : a small, fast working memory backed by a larger, slower long-term… 26 references, cited by 11 papers here."
authors: ["Marilyn A. Walker"]
year: 1996
venue: "Computational Linguistics"
source: "https://aclanthology.org/J96-2005/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/walker-1996-limited-attention-discourse-structure/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/walker-1996-limited-attention-discourse-structure/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [1996](https://md.research.elamur.ai/free/en/papers/1996/) / Limited Attention and Discourse Structure

# Limited Attention and Discourse Structure

**Authors:** [Marilyn A. Walker](https://md.research.elamur.ai/free/en/authors/marilyn-walker/) · **Year:** 1996 · **Venue:** [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/) ([Computational Linguistics 1996](https://md.research.elamur.ai/free/en/venues/cl/1996/)) · **Publisher:** [The MIT Press](https://md.research.elamur.ai/free/en/publishers/the-mit-press/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/J96-2005/) · [PDF](https://aclanthology.org/J96-2005.pdf) · [OpenAlex](https://openalex.org/W1502275139)

**Citations:** 74 citations (OpenAlex, 2026-10-14) · [11](https://md.research.elamur.ai/free/en/papers/walker-1996-limited-attention-discourse-structure/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
This squib asks how the limited capacity of human attention should be modeled in computational accounts of discourse, specifically for ellipsis, pronoun resolution, and inferring discourse relations. Walker challenges the view that accessibility follows *hierarchical recency*, as operationalized by Grosz and Sidner's stack model of attentional state. Using naturally occurring dialogues from a radio financial-advice talk show, she shows two problems for the stack model. First, slightly lengthening an embedded interruption makes a later elliptical continuation hard to interpret, even though the stack model predicts no change. Second, speakers repeat already shared content (informationally redundant utterances, IRUs) right after returning to a topic that should still be salient. She proposes the **cache model**: a small, fast working memory backed by a larger, slower long-term main memory. Items are retained, retrieved, or displaced according to speakers' intentions and expectations. The model treats accessibility as gradual and effort-dependent. It accounts for IRUs and infelicitous variants while staying consistent with psychological findings on limited working memory, and it yields experimentally testable predictions.

## Key points
- The paper contrasts linear recency (backward search through text) with hierarchical recency (adjacency in the discourse tree, i.e., the Grosz & Sidner stack). It argues that attention must be partly sensitive to linear recency.
- The data are excerpts from a financial-advice radio corpus (Pollack, Hirschberg, and Webber 1982). Dialogue B, a constructed variant of Dialogue A, adds only two utterances to the interruption, yet this makes utterance 8a nearly uninterpretable.
- In the cache model, the cache stands for working memory, with a capacity of roughly 2–3 sentences or about 7 propositions (Miller; Kintsch). Its operations are retention, retrieval, and storage, and a replacement policy that favors recently used items decides what is displaced.
- All premises of an inference, and both segments in a discourse relation, must be in the cache at the same time. A pronoun's cospecifier must either already be in the cache or be retrieved into it.
- Of 21 return pops collected from the literature, 11 have antecedents competing on gender and number. Adding selectional cues leaves 4 unresolved, and IRUs appear in 6 of the 21 returns. Combining IRUs and selectional restrictions leaves only 2 problematic cases.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [AT&T](https://md.research.elamur.ai/free/en/companies/at-t/) — Company, Bedminster, United States · 40 works · 75,466 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🧠 Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/) · 165 works · [🧠 Cognitive Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/cognitive-neuroscience/) · 164 works

🧭 Topics (1): [🧵 Discourse analysis](https://md.research.elamur.ai/free/en/topics/discourse-analysis/) · 466 works

## Cite

Cite as: Marilyn A. Walker. 1996. Limited Attention and Discourse Structure. Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{walker1996limited,
  title = {{Limited Attention and Discourse Structure}},
  author = {Marilyn A. Walker},
  journal = {Computational Linguistics},
  year = {1996},
  doi = {10.5555/230386.230391},
  url = {https://doi.org/10.5555/230386.230391}
}
```

- [← previous Bilingual Dictionaries: Past, Present and Future](https://md.research.elamur.ai/free/en/papers/atkins-1996-bilingual-dictionaries/)
- [next → A Unified Theory of Irony and Its Computational Formalization](https://md.research.elamur.ai/free/en/papers/utsumi-1996-unified-theory-irony-its-computational/)
- [↑ back to papers of 1996](https://md.research.elamur.ai/free/en/papers/1996/)

## References

26 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Baddeley, Alan. 1986. Working Memory. Oxford University Press. [find](https://scholar.google.com/scholar?q=Baddeley%2C+Alan%2E+1986%2E+Working+Memory%2E+Oxford+University+Press%2E)
2. Cahn, Janet. 1991. The effect of intonation on pronoun referent resolution. Technical report, MIT Media Lab. [find](https://scholar.google.com/scholar?q=Cahn%2C+Janet%2E+1991%2E+The+effect+of+intonation+on+pronoun+referent+resolution%2E+Technical+report%2C+MIT+Media+Lab%2E)
3. Clark, Herbert H. and C. J. Sengul. 1979. In search of referents for nouns and pronouns. Memory and Cognition, 7:35-41. [find](https://scholar.google.com/scholar?q=Clark%2C+Herbert+H%2E+and+C%2E+J%2E+Sengul%2E+1979%2E+In+search+of+referents+for+nouns+and+pronouns%2E+Memory+and+Cognition%2C+7%3A35%2D41%2E)
4. Davis, James R. and Julia Hirschberg. 1988. Assigning intonational features in synthesized spoken directions. In ACL88, pages 187-193. [find](https://scholar.google.com/scholar?q=Davis%2C+James+R%2E+and+Julia+Hirschberg%2E+1988%2E+Assigning+intonational+features+in+synthesized+spoken+directions%2E+In+ACL88%2C+pages+187%2D193%2E)
5. Di Eugenio, Barbara. 1990. Centering theory and the Italian pronominal system. In COLING 90. [find](https://scholar.google.com/scholar?q=Di+Eugenio%2C+Barbara%2E+1990%2E+Centering+theory+and+the+Italian+pronominal+system%2E+In+COLING+90%2E)
6. Fletcher, Charles R., John E. Hummel, and Chad J. Marsolek. 1990. Causality and the allocation of attention during comprehension. Journal of Experimental Psychology. [find](https://scholar.google.com/scholar?q=Fletcher%2C+Charles+R%2E%2C+John+E%2E+Hummel%2C+and+Chad+J%2E+Marsolek%2E+1990%2E+Causality+and+the+allocation+of+attention+during+comprehension%2E+Journal+of+Experimental+Psychology%2E)
7. Fox, Barbara A. 1987. Discourse Structure and Anaphora: Written and Conversational English. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Fox%2C+Barbara+A%2E+1987%2E+Discourse+Structure+and+Anaphora%3A+Written+and+Conversational+English%2E+Cambridge+University+Press%2E)
8. Greene, S. B., Gail McKoon, and R. Ratcliff. 1992. Pronoun resolution and discourse models. Journal of Experimental Psychology: Learning, Memory and Cognition, pages 266-283. [find](https://scholar.google.com/scholar?q=Greene%2C+S%2E+B%2E%2C+Gail+McKoon%2C+and+R%2E+Ratcliff%2E+1992%2E+Pronoun+resolution+and+discourse+models%2E+Journal+of+Experimental+Psychology%3A+Learning%2C+Memory+and+Cognition%2C+pages+266%2D283%2E)
9. Grosz, Barbara J. 1977. The representation and use of focus in dialogue understanding. Technical Report 151, SRI International, 333 Ravenswood Ave, Menlo Park, Ca. 94025. [find](https://scholar.google.com/scholar?q=Grosz%2C+Barbara+J%2E+1977%2E+The+representation+and+use+of+focus+in+dialogue+understanding%2E+Technical+Report+151%2C+SRI+International%2C+333+Ravenswood+Ave%2C+Menlo+Park%2C+Ca%2E+94025%2E)
10. Grosz, Barbara J. and Candace L. Sidner. 1986. Attentions, intentions and the structure of discourse. Computational Linguistics, 12:175-204. [find](https://scholar.google.com/scholar?q=Grosz%2C+Barbara+J%2E+and+Candace+L%2E+Sidner%2E+1986%2E+Attentions%2C+intentions+and+the+structure+of+discourse%2E+Computational+Linguistics%2C+12%3A175%2D204%2E)
11. Hobbs, Jerry R. 1985. On the coherence and structure of discourse. Technical Report CSLI-85-37, Center for the Study of Language and Information, Ventura Hall, Stanford University, Stanford, CA 94305. [find](https://scholar.google.com/scholar?q=Hobbs%2C+Jerry+R%2E+1985%2E+On+the+coherence+and+structure+of+discourse%2E+Technical+Report+CSLI%2D85%2D37%2C+Center+for+the+Study+of+Language+and+Information%2C+Ventura+Hall%2C+Stanford+University%2C+Stanford%2C+CA+94305%2E)
12. Huang, Xiorong. 1994. Planning references choices for argumentative texts. In The 7th International Conference on Natural Language Generation. [find](https://scholar.google.com/scholar?q=Huang%2C+Xiorong%2E+1994%2E+Planning+references+choices+for+argumentative+texts%2E+In+The+7th+International+Conference+on+Natural+Language+Generation%2E)
13. Kintsch, W. 1988. The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review, 95:163-182. [find](https://scholar.google.com/scholar?q=Kintsch%2C+W%2E+1988%2E+The+role+of+knowledge+in+discourse+comprehension%3A+A+construction%2Dintegration+model%2E+Psychological+Review%2C+95%3A163%2D182%2E)
14. Malt, Barbara. 1984. The role of discourse structure in understanding anaphora. Journal of Memory and Language, 24:271-289. [find](https://scholar.google.com/scholar?q=Malt%2C+Barbara%2E+1984%2E+The+role+of+discourse+structure+in+understanding+anaphora%2E+Journal+of+Memory+and+Language%2C+24%3A271%2D289%2E)
15. Mann, W. C. and S. A. Thompson. 1987. Rhetorical structure theory: Description and construction of text structures. In Gerard Kempen, editor, Natural Language Generation. Martinus Nijhoff, pages 83-96. [find](https://scholar.google.com/scholar?q=Mann%2C+W%2E+C%2E+and+S%2E+A%2E+Thompson%2E+1987%2E+Rhetorical+structure+theory%3A+Description+and+construction+of+text+structures%2E+In+Gerard+Kempen%2C+editor%2C+Natural+Language+Generation%2E+Martinus+Nijhoff%2C+pages+83%2D96)
16. McKoon, Gail and Roger Ratcliff. 1992. Inference during reading. Psychological Review, 99(3):440-466. [find](https://scholar.google.com/scholar?q=McKoon%2C+Gail+and+Roger+Ratcliff%2E+1992%2E+Inference+during+reading%2E+Psychological+Review%2C+99%283%29%3A440%2D466%2E)
17. Miller, G. A. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, pages 81-97. [find](https://scholar.google.com/scholar?q=Miller%2C+G%2E+A%2E+1956%2E+The+magical+number+seven%2C+plus+or+minus+two%3A+Some+limits+on+our+capacity+for+processing+information%2E+Psychological+Review%2C+pages+81%2D97%2E)
18. Passonneau, Rebecca J. and Diane Litman. To appear. Empirical analysis of three dimension of spoken discourse: Segmentation, coherence and linguistic devices. In Donia Scott and Eduard Hovy, editors, Burning Issues in Discourse. [find](https://scholar.google.com/scholar?q=Passonneau%2C+Rebecca+J%2E+and+Diane+Litman%2E+To+appear%2E+Empirical+analysis+of+three+dimension+of+spoken+discourse%3A+Segmentation%2C+coherence+and+linguistic+devices%2E+In+Donia+Scott+and+Eduard+Hovy%2C+editors%2C+)
19. Pollack, Martha, Julia Hirschberg, and Bonnie Webber. 1982. User participation in the reasoning process of expert systems. In AAAI82, pages 358-361. [find](https://scholar.google.com/scholar?q=Pollack%2C+Martha%2C+Julia+Hirschberg%2C+and+Bonnie+Webber%2E+1982%2E+User+participation+in+the+reasoning+process+of+expert+systems%2E+In+AAAI82%2C+pages+358%2D361%2E)
20. Prince, Ellen F. 1981. Toward a taxonomy of given-new information. In Radical Pragmatics. Academic Press, pages 223-255. [find](https://scholar.google.com/scholar?q=Prince%2C+Ellen+F%2E+1981%2E+Toward+a+taxonomy+of+given%2Dnew+information%2E+In+Radical+Pragmatics%2E+Academic+Press%2C+pages+223%2D255%2E)
21. Ratcliff, Roger and Gail McKoon. 1988. A retrieval theory of priming in memory. Psychological Review, 95(3):385-408. [find](https://scholar.google.com/scholar?q=Ratcliff%2C+Roger+and+Gail+McKoon%2E+1988%2E+A+retrieval+theory+of+priming+in+memory%2E+Psychological+Review%2C+95%283%29%3A385%2D408%2E)
22. Reichman, Rachel. 1985. Getting Computers to Talk Like You and Me. M1T Press, Cambridge, MA. [find](https://scholar.google.com/scholar?q=Reichman%2C+Rachel%2E+1985%2E+Getting+Computers+to+Talk+Like+You+and+Me%2E+M1T+Press%2C+Cambridge%2C+MA%2E)
23. Sachs, Jacqueline D. 1967. Recognition memory for syntactic and semantic aspects of connected discourse. Ph.D. thesis, University of California Berkeley. [find](https://scholar.google.com/scholar?q=Sachs%2C+Jacqueline+D%2E+1967%2E+Recognition+memory+for+syntactic+and+semantic+aspects+of+connected+discourse%2E+Ph%2ED%2E+thesis%2C+University+of+California+Berkeley%2E)
24. Sidner, Candace L. 1979. Toward a computational theory of definite anaphora comprehension in English. Technical Report AI-TR-537, MIT. [find](https://scholar.google.com/scholar?q=Sidner%2C+Candace+L%2E+1979%2E+Toward+a+computational+theory+of+definite+anaphora+comprehension+in+English%2E+Technical+Report+AI%2DTR%2D537%2C+MIT%2E)
25. Walker, Marilyn A. 1992. Redundancy in collaborative dialogue. In Fourteenth International Conference on Computational Linguistics, pages 345-351. [find](https://scholar.google.com/scholar?q=Walker%2C+Marilyn+A%2E+1992%2E+Redundancy+in+collaborative+dialogue%2E+In+Fourteenth+International+Conference+on+Computational+Linguistics%2C+pages+345%2D351%2E)
26. Walker, Marilyn A. 1993. Informational Redundancy and Resource Bounds in Dialogue. Ph.D. thesis, University of Pennsylvania. [find](https://scholar.google.com/scholar?q=Walker%2C+Marilyn+A%2E+1993%2E+Informational+Redundancy+and+Resource+Bounds+in+Dialogue%2E+Ph%2ED%2E+thesis%2C+University+of+Pennsylvania%2E)

*Updated 30 October 2026*