---
title: "Information Structure Prediction for Visual-world Referring"
description: "Referring expression generation in visual scenes has mostly studied content selection… 60% F-score. 48 references, cited by 1 paper here."
authors: ["Micha Elsner", "Hannah Rohde", "Alasdair Clarke"]
year: 2014
venue: "Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics"
source: "https://aclanthology.org/E14-1055/"
doi: "10.3115/v1/e14-1055"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/elsner-2014-information-structure-prediction-visual-world/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/elsner-2014-information-structure-prediction-visual-world/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2014](https://md.research.elamur.ai/free/en/papers/2014/page/3/) / Information Structure Prediction for Visual-world Referring Expressions

# Information Structure Prediction for Visual-world Referring Expressions

**Authors:** [Micha Elsner](https://md.research.elamur.ai/free/en/authors/micha-elsner/), [Hannah Rohde](https://md.research.elamur.ai/free/en/authors/hannah-rohde/) and Alasdair Clarke · **Year:** 2014 · **Venue:** [Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/eacl/) ([EACL 2014](https://md.research.elamur.ai/free/en/venues/eacl/2014/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/E14-1055/) · [PDF](https://aclanthology.org/E14-1055.pdf) · [DOI 10.3115/v1/e14-1055](https://doi.org/10.3115/v1/e14-1055) · [OpenAlex](https://openalex.org/W2250185474)

**Citations:** 7 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 141,840 papers whose bibliographies we read

## Summary
Referring expression generation in visual scenes has mostly studied *content selection*, meaning which landmarks to mention. Surface ordering has usually been left to fixed templates. This paper asks what decides the order in which a speaker mentions the target ("anchor") and a helper object ("landmark") in a relational description. The authors use the Mechanical Turk corpus of "Where's Wally" descriptions from Clarke et al. (2013). They annotate each anchor–landmark pair with one of three orderings:

* PRECEDE: the landmark comes first.
* FOLLOW: the landmark comes after the anchor.
* INTER: the landmark sits between pieces of the anchor description.

Each pair also gets an ESTABLISH flag, set when the landmark is first introduced on its own. Image regions are treated separately from real objects. Logistic regression shows that large, visually prominent objects tend to be mentioned early, the way given information is in discourse. A maximum-entropy classifier beats simple baselines, with the clearest gains on non-canonical orders. The main claim is that visual prominence can put an entity into common ground without any prior mention. Template realizers therefore miss real variation in how people order these descriptions.

## Key points
- **Data:** 1672 descriptions from 152 participants, covering 11 Wally scenes with 16 designated targets per scene. Annotations mark which substrings refer to the target, to other objects, and to image regions.
- **Method:** a maxent multilabel classifier, trained with Theano, predicts an (ESTABLISH, direction) pair for each anchor–landmark link.
  - Features include area, salience, distance to the image centre and inter-object distance.
  - These values are discretized into training-set quartiles, which worked better than continuous values.
- **Evaluation setup:** three images were held out for development. Testing was leave-one-image-out over the remaining 8, with training on the other 10 images, giving 2382 test pairs.
- **Results:**
  - Overall pair accuracy rose from 43% (a "regions precede, landmarks follow" baseline) to 52%.
  - Direction accuracy rose from roughly 42–44% to 57%.
  - ESTABLISH reached a 60% F-score, about equal to a lower-bound estimate of inter-annotator agreement.
  - The ceiling from inter-subject agreement is about 74% pair accuracy.
  - All gains over baselines are significant (sign test, p \< 0.01).
- **Negative findings:**
  - Adding the Torralba et al. (2006) visual distinctiveness model did not help.
  - A parser-like structured classifier did no better than independent pair classification, possibly because the description trees are shallow.

## Interesting ideas
- Things that are perceptually or contextually obvious behave as "given" even when nothing has mentioned them, so givenness should not be tied only to earlier text.
- The authors describe a description's structure as an order between object references (precede, follow, interleaved, established first) rather than as word order, which gives a compact and interpretable target to predict.
- Continuous cues are binned into training-set quartiles before a linear model sees them, which captures nonlinear effects cheaply and keeps the features readable.
- Systems are compared against both trivial baselines and a measure of agreement between human speakers, so that 52% can be read against a ceiling of about 74%.
- The authors report honestly that a joint structured model gave no gain over independent pair decisions when the structures were shallow.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (frames): coreference and information-status tagging in prag could treat situationally prominent entities (for example a story's protagonist or a well-known name) as old information, which would help explain why they appear in subject or fronted position.
- **I2** (back): the generator could first choose an ordering strategy for each pair of entities in the world graph, then realize the text, so that every ordering decision can be explained.
- **I3** (learn): perceptron-style models in Mova could quartile-bin numeric features such as distance or length, keeping them human-inspectable while handling nonlinear effects.
- **I4** (learn): Mova's evaluations could report inter-witness or inter-annotator agreement next to negative-control baselines, so that scores have both a floor and a ceiling.
- **I5** (tree): before adding joint or global decoding to gparse-related components, check how deep the target structures really are, because local classifiers may already be enough.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Edinburgh](https://md.research.elamur.ai/free/en/universities/university-of-edinburgh/) — University, Edinburgh, United Kingdom · 255 works · 68,771 citations
- [The Ohio State University](https://md.research.elamur.ai/free/en/universities/the-ohio-state-university/) — University, Columbus, United States · 57 works · 17,793 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 798 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 463 works

## Cite

Cite as: Micha Elsner, Hannah Rohde and Alasdair Clarke. 2014. Information Structure Prediction for Visual-world Referring Expressions. Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{elsner2014information,
  title = {{Information Structure Prediction for Visual-world Referring Expressions}},
  author = {Micha Elsner, Hannah Rohde and Alasdair Clarke},
  booktitle = {Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics},
  year = {2014},
  doi = {10.3115/v1/e14-1055},
  url = {https://doi.org/10.3115/v1/e14-1055}
}
```

- [← previous Detecting Inappropriate Clarification Requests in Spoken Dialogue Systems](https://md.research.elamur.ai/free/en/papers/liu-2014-detecting-inappropriate-clarification-requests-spoken/)
- [next → “I Object!” Modeling Latent Pragmatic Effects in Courtroom Dialogues](https://md.research.elamur.ai/free/en/papers/goldwasser-2014-i-object-modeling-latent-pragmatic/)
- [↑ back to papers of 2014](https://md.research.elamur.ai/free/en/papers/2014/page/3/)

## References

48 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. D. A. Baldwin. 1995. Understanding the link between joint attention and language. In Joint attention: its origins and role in development. Lawrence Erlbaum Assoc., Hillsdale, NJ. [find](https://scholar.google.com/scholar?q=D%2E+A%2E+Baldwin%2E+1995%2E+Understanding+the+link+between+joint+attention+and+language%2E+In+Joint+attention%3A+its+origins+and+role+in+development%2E+Lawrence+Erlbaum+Assoc%2E%2C+Hillsdale%2C+NJ%2E)
2. D. Bates, M. Maechler, and B. Bolker. 2011. lme4: Linear mixed-effects models using s4 classes. Comprehensive R Archive Network: cran.r-project.org. [find](https://scholar.google.com/scholar?q=D%2E+Bates%2C+M%2E+Maechler%2C+and+B%2E+Bolker%2E+2011%2E+lme4%3A+Linear+mixed%2Deffects+models+using+s4+classes%2E+Comprehensive+R+Archive+Network%3A+cran%2Er%2Dproject%2Eorg%2E)
3. David L. Bean and Ellen Riloff. 1999. [Corpus-based identification of non-anaphoric noun phrases](https://md.research.elamur.ai/free/en/papers/bean-1999-corpus-based-identification-non-anaphoric/). In Proceedings of the 37th annual meeting of the Association for Computational Linguistics (ACL’99), pages 373–380, Morristown, NJ, USA. Association for Computational Linguistics.
4. Anja Belz and Albert Gatt. 2008. Intrinsic vs. extrinsic evaluation measures for referring expression generation. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, pages 197–200. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Anja+Belz+and+Albert+Gatt%2E+2008%2E+Intrinsic+vs%2E+extrinsic+evaluation+measures+for+referring+expression+generation%2E+In+Proceedings+of+the+46th+Annual+Meeting+of+the+Association+for+Computational+Linguis)
5. Yoshua Bengio. 2009. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1):1–127. Also published as a book. [↗](https://doi.org/10.1561/2200000006)
6. James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio. 2010. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy), June. Oral Presentation. [find](https://scholar.google.com/scholar?q=James+Bergstra%2C+Olivier+Breuleux%2C+Fre%CC%81de%CC%81ric+Bastien%2C+Pascal+Lamblin%2C+Razvan+Pascanu%2C+Guillaume+Desjardins%2C+Joseph+Turian%2C+David+Warde%2DFarley%2C+and+Yoshua+Bengio%2E+2010%2E+Theano%3A+a+CPU+and+GPU+math+expre)
7. Robbert-Jan Beun and Anita H.M. Cremers. 1998. Object reference in a shared domain of conversation. Pragmatics and Cognition, 6(1-2):121–152. [↗](https://doi.org/10.1075/pc.6.1-2.08beu)
8. Joan Bresnan, Anna Cueni, Tatiana Nikitina, and R. Harald Baayen. 2007. Predicting the dative alternation. Cognitive Foundations of Interpretation, pages 69–94. [find](https://scholar.google.com/scholar?q=Joan+Bresnan%2C+Anna+Cueni%2C+Tatiana+Nikitina%2C+and+R%2E+Harald+Baayen%2E+2007%2E+Predicting+the+dative+alternation%2E+Cognitive+Foundations+of+Interpretation%2C+pages+69%E2%80%9394%2E)
9. Ivo Brugman, Mariët Theune, Emiel Krahmer, and Jette Viethen. 2009. Realizing the costs: template-based surface realisation in the graph approach to referring expression generation. In Proceedings of the 12th European Workshop on Natural Language Generation, ENLG ’09, pages 183–184, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ivo+Brugman%2C+Marie%CC%88t+Theune%2C+Emiel+Krahmer%2C+and+Jette+Viethen%2E+2009%2E+Realizing+the+costs%3A+template%2Dbased+surface+realisation+in+the+graph+approach+to+referring+expression+generation%2E+In+Proceedings+of)
10. M. Carpenter, K. Nagell, and M. Tomasello. 1998. Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monographs of the Society for Research in Child Development, 63(4). [↗](https://doi.org/10.2307/1166214)
11. Herbert H. Clark and Deanna Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition, 22(1):1–39. [↗](https://doi.org/10.1016/0010-0277(86)90010-7)
12. Herbert H. Clark. 1996. Using language. Cambridge University Press, Cambridge. [find](https://scholar.google.com/scholar?q=Herbert+H%2E+Clark%2E+1996%2E+Using+language%2E+Cambridge+University+Press%2C+Cambridge%2E)
13. Alasdair D. F. Clarke, Micha Elsner, and Hannah Rohde. 2013. Where’s Wally: The influence of visual salience on referring expression generation. Frontiers in Psychology (Perception Science), Issue on Scene Understanding: Behavioral and computational perspectives. [↗](https://doi.org/10.3389/fpsyg.2013.00329)
14. Michael Crawley. 2007. Blackwell, Hoboken, NJ. The R Book. [find](https://scholar.google.com/scholar?q=Michael+Crawley%2E+2007%2E+Blackwell%2C+Hoboken%2C+NJ%2E+The+R+Book%2E)
15. Wiley-Robert Dale and Nicholas J. Haddock. 1991. Generating referring expressions involving relations. In EACL, pages 161–166. [find](https://scholar.google.com/scholar?q=Wiley%2DRobert+Dale+and+Nicholas+J%2E+Haddock%2E+1991%2E+Generating+referring+expressions+involving+relations%2E+In+EACL%2C+pages+161%E2%80%93166%2E)
16. Giuseppe Di Fabbrizio, Amanda J. Stent, and Srinivas Bangalore. 2008. Referring expression generation using speaker-based attribute selection and trainable realization (ATTR). In Proceedings of the 5th International Conference on Natural Language Generation (INLG), Salt Fork, OH. [find](https://scholar.google.com/scholar?q=Giuseppe+Di+Fabbrizio%2C+Amanda+J%2E+Stent%2C+and+Srinivas+Bangalore%2E+2008%2E+Referring+expression+generation+using+speaker%2Dbased+attribute+selection+and+trainable+realization+%28ATTR%29%2E+In+Proceedings+of+the+5t)
17. Manjuan Duan, Micha Elsner, and Marie-Catherine de Marneffe. 2013. Visual and linguistic predictors for the definiteness of referring expressions. In Proceedings of the 17th Workshop on the Semantics and Pragmatics of Dialogue (SemDial), Amsterdam. [find](https://scholar.google.com/scholar?q=Manjuan+Duan%2C+Micha+Elsner%2C+and+Marie%2DCatherine+de+Marneffe%2E+2013%2E+Visual+and+linguistic+predictors+for+the+definiteness+of+referring+expressions%2E+In+Proceedings+of+the+17th+Workshop+on+the+Semantics+)
18. Matt Duckham, Stephan Winter, and Michelle Robinson. 2010. Including landmarks in routing instructions. Journal of Location Based Services, 4(1):28– 52. [↗](https://doi.org/10.1080/17489721003785602)
19. Rui Fang, Changsong Liu, Lanbo She, and Joyce Y. Chai. 2013. Towards situated dialogue: Revisiting referring expression generation. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 392–402, Seattle, Washington, USA, October. Association for Computational Linguistics. [↗](https://doi.org/10.13140/rg.2.1.4022.7048)
20. Katja Filippova and Michael Strube. 2007. Generating constituent order in German clauses. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 320–327, Prague, Czech Republic, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Katja+Filippova+and+Michael+Strube%2E+2007%2E+Generating+constituent+order+in+German+clauses%2E+In+Proceedings+of+the+45th+Annual+Meeting+of+the+Association+of+Computational+Linguistics%2C+pages+320%E2%80%93327%2C+Prag)
21. William Ford and David Olson. 1975. The elaboration of the noun phrase in children’s description of objects. Journal of Experimental Child Psychology, 19:371–382. [↗](https://doi.org/10.1016/0022-0965(75)90068-5)
22. Albert Gatt and Anja Belz. 2010. Introducing shared task evaluation to NLG: The TUNA shared task evaluation challenges. In E. Krahmer and M. Theune, editors, Empirical Methods in Natural Language Generation. Springer, Berlin and Heidelberg. [find](https://scholar.google.com/scholar?q=Albert+Gatt+and+Anja+Belz%2E+2010%2E+Introducing+shared+task+evaluation+to+NLG%3A+The+TUNA+shared+task+evaluation+challenges%2E+In+E%2E+Krahmer+and+M%2E+Theune%2C+editors%2C+Empirical+Methods+in+Natural+Language+Gene)
23. Albert Gatt, Anja Belz, and Eric Kow. 2008. The TUNA-REG challenge 2008: Overview and evaluation results. In Proceedings of the 5th International Conference on Natural Language Generation (INLG), Salt Fork, OH. [find](https://scholar.google.com/scholar?q=Albert+Gatt%2C+Anja+Belz%2C+and+Eric+Kow%2E+2008%2E+The+TUNA%2DREG+challenge+2008%3A+Overview+and+evaluation+results%2E+In+Proceedings+of+the+5th+International+Conference+on+Natural+Language+Generation+%28INLG%29%2C+Salt)
24. Albert Gatt, Anja Belz, and Eric Kow. 2009. The TUNA-REG challenge 2009: Overview and evaluation results. In Proceedings of the 12th European Workshop on Natural Language Generation (ENLG), Athens. [find](https://scholar.google.com/scholar?q=Albert+Gatt%2C+Anja+Belz%2C+and+Eric+Kow%2E+2009%2E+The+TUNA%2DREG+challenge+2009%3A+Overview+and+evaluation+results%2E+In+Proceedings+of+the+12th+European+Workshop+on+Natural+Language+Generation+%28ENLG%29%2C+Athens%2E)
25. A. Gatt, E. Krahmer, R. P. G. van Gompel, and K. van Deemter. 2012. Does domain size impact speech onset time during reference production? In Proceedings of the 34th Annual Meeting of the Cognitive Science Society, pages 1584–1589, Sapporo, Japan. [find](https://scholar.google.com/scholar?q=A%2E+Gatt%2C+E%2E+Krahmer%2C+R%2E+P%2E+G%2E+van+Gompel%2C+and+K%2E+van+Deemter%2E+2012%2E+Does+domain+size+impact+speech+onset+time+during+reference+production%3F+In+Proceedings+of+the+34th+Annual+Meeting+of+the+Cognitive+Sc)
26. Dave Golland, Percy Liang, and Dan Klein. 2010. A game-theoretic approach to generating spatial descriptions. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 410–419, Cambridge, MA, October. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Dave+Golland%2C+Percy+Liang%2C+and+Dan+Klein%2E+2010%2E+A+game%2Dtheoretic+approach+to+generating+spatial+descriptions%2E+In+Proceedings+of+the+2010+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C)
27. Barbara J. Grosz, Aravind K. Joshi, and Scott Weinstein. 1995. [Centering: A framework for modeling the local coherence of discourse](https://md.research.elamur.ai/free/en/papers/grosz-1995-centering-framework-modeling-local-coherence/). Computational Linguistics, 21(2):203–225.
28. M. Handford. 1987. Where’s Wally? Walker Books, London, 3 edition. [find](https://scholar.google.com/scholar?q=M%2E+Handford%2E+1987%2E+Where%E2%80%99s+Wally%3F+Walker+Books%2C+London%2C+3+edition%2E)
29. M. Handford. 1988. Where’s Wally Now? Books, London, 4 edition. [find](https://scholar.google.com/scholar?q=M%2E+Handford%2E+1988%2E+Where%E2%80%99s+Wally+Now%3F+Books%2C+London%2C+4+edition%2E)
30. Walker L. Itti and C. Koch. 2000. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision research, 40(10-12):1489–1506. [↗](https://doi.org/10.1016/s0042-6989(99)00163-7)
31. John D. Kelleher and Geert-Jan M. Kruijff. 2006. Incremental generation of spatial referring expressions in situated dialog. In ACL. [find](https://scholar.google.com/scholar?q=John+D%2E+Kelleher+and+Geert%2DJan+M%2E+Kruijff%2E+2006%2E+Incremental+generation+of+spatial+referring+expressions+in+situated+dialog%2E+In+ACL%2E)
32. J. Kelleher, F. Costello, and J. van Genabith. 2005. Dynamically structuring, updating and interrelating representations of visual and linguistic discourse context. Artificial Intelligence, 167(12):62 – 102. Connecting Language to the World. [↗](https://doi.org/10.1016/j.artint.2005.04.008)
33. Emiel Krahmer and Kees van Deemter. 2012. [Computational generation of referring expressions: A survey](https://md.research.elamur.ai/free/en/papers/krahmer-2012-computational-generation-referring-expressions-survey/). Computational Linguistics, 38(1):173–218, March. [↗](https://doi.org/10.1162/coli_a_00088)
34. Claudia Maienborn. 2001. On the position and interpretation of locative modifiers. Natural Language Semantics, 9(2):191–240. [↗](https://doi.org/10.1023/a:1012405607146)
35. Crystal Nakatsu and Michael White. 2010. Generating with discourse combinatory categorial grammar. Linguistic Issues in Language Technology, 4(1). [↗](https://doi.org/10.33011/lilt.v4i.1221)
36. T. Pechmann. 2009. Incremental speech production and referential overspecification. Linguistics, 27(1):89–110. [find](https://scholar.google.com/scholar?q=T%2E+Pechmann%2E+2009%2E+Incremental+speech+production+and+referential+overspecification%2E+Linguistics%2C+27%281%29%3A89%E2%80%93110%2E)
37. Ellen Prince. 1981. Toward a taxonomy of given-new information. In Peter Cole, editor, Radical Pragmatics, pages 223–255. Academic Press, New York. [find](https://scholar.google.com/scholar?q=Ellen+Prince%2E+1981%2E+Toward+a+taxonomy+of+given%2Dnew+information%2E+In+Peter+Cole%2C+editor%2C+Radical+Pragmatics%2C+pages+223%E2%80%93255%2E+Academic+Press%2C+New+York%2E)
38. Ruslan Salakhutdinov and Geoffrey Hinton. 2009. Replicated softmax: an undirected topic model. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1607– 1614. [find](https://scholar.google.com/scholar?q=Ruslan+Salakhutdinov+and+Geoffrey+Hinton%2E+2009%2E+Replicated+softmax%3A+an+undirected+topic+model%2E+In+Y%2E+Bengio%2C+D%2E+Schuurmans%2C+J%2E+Lafferty%2C+C%2E+K%2E+I%2E+Williams%2C+and+A%2E+Culotta%2C+editors%2C+Advances+in+Neural+)
39. Richard Socher, Cliff C. Lin, Andrew Y. Ng, and Christopher D. Manning. 2011. Parsing natural scenes and natural language with recursive neural networks. In Proceedings of the 26th International Conference on Machine Learning (ICML). [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Cliff+C%2E+Lin%2C+Andrew+Y%2E+Ng%2C+and+Christopher+D%2E+Manning%2E+2011%2E+Parsing+natural+scenes+and+natural+language+with+recursive+neural+networks%2E+In+Proceedings+of+the+26th+International+Confe)
40. A. Toet. 2011. Computational versus psychophysical bottom-up image saliency: A comparative evaluation study. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(11):2131 –2146. [↗](https://doi.org/10.1109/tpami.2011.53)
41. A. Torralba, A. Oliva, M. Castelhano, and J. M. Henderson. 2006. Contextual guidance of attention in natural scenes: The role of global features on object search. Psychological Review, 113:766–786. [find](https://scholar.google.com/scholar?q=A%2E+Torralba%2C+A%2E+Oliva%2C+M%2E+Castelhano%2C+and+J%2E+M%2E+Henderson%2E+2006%2E+Contextual+guidance+of+attention+in+natural+scenes%3A+The+role+of+global+features+on+object+search%2E+Psychological+Review%2C+113%3A766%E2%80%93786%2E)
42. Jette Viethen and Robert Dale. 2008. The use of spatial relations in referring expressions. In Proceedings of the 5th International Conference on Natural Language Generation, Salt Fork, Ohio, USA. [find](https://scholar.google.com/scholar?q=Jette+Viethen+and+Robert+Dale%2E+2008%2E+The+use+of+spatial+relations+in+referring+expressions%2E+In+Proceedings+of+the+5th+International+Conference+on+Natural+Language+Generation%2C+Salt+Fork%2C+Ohio%2C+USA%2E)
43. Gregory Ward and Betty Birner. 1995. Definiteness and the English existential. Language, 71(4):722– 742, December. [↗](https://doi.org/10.2307/415742)
44. Gregory Ward and Betty Birner. 2001. Discourse and information structure. In Deborah Schiffrin, Deborah Tannen, and Heidi Hamilton, editors, Handbook of discourse analysis, pages 119–137. Basil Blackwell, Oxford. [find](https://scholar.google.com/scholar?q=Gregory+Ward+and+Betty+Birner%2E+2001%2E+Discourse+and+information+structure%2E+In+Deborah+Schiffrin%2C+Deborah+Tannen%2C+and+Heidi+Hamilton%2C+editors%2C+Handbook+of+discourse+analysis%2C+pages+119%E2%80%93137%2E+Basil+Blackw)
45. Bonnie L. Webber. 2004. D-ltag: extending lexicalized tag to discourse. Cognitive Science, 28(5):751– 779. [↗](https://doi.org/10.1016/j.cogsci.2004.04.002)
46. Michael White and Rajakrishnan Rajkumar. 2012. Minimal dependency length in realization ranking. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 244–255, Jeju Island, Korea, July. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Michael+White+and+Rajakrishnan+Rajkumar%2E+2012%2E+Minimal+dependency+length+in+realization+ranking%2E+In+Proceedings+of+the+2012+Joint+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+Com)
47. Jeremy M. Wolfe. 2012. Visual search. In P. Todd, T. Holls, and T. Robbins, editors, Cognitive Search: Evolution, Algorithms and the Brain, pages 159 – 175. MIT Press, Cambridge, MA, USA. [find](https://scholar.google.com/scholar?q=Jeremy+M%2E+Wolfe%2E+2012%2E+Visual+search%2E+In+P%2E+Todd%2C+T%2E+Holls%2C+and+T%2E+Robbins%2C+editors%2C+Cognitive+Search%3A+Evolution%2C+Algorithms+and+the+Brain%2C+pages+159+%E2%80%93+175%2E+MIT+Press%2C+Cambridge%2C+MA%2C+USA%2E)
48. Sina Zarrieß, Aoife Cahill, and Jonas Kuhn. 2012. To what extent does sentence-internal realisation reflect discourse context? a study on word order. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 767–776, Avignon, France, April. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sina+Zarrie%C3%9F%2C+Aoife+Cahill%2C+and+Jonas+Kuhn%2E+2012%2E+To+what+extent+does+sentence%2Dinternal+realisation+reflect+discourse+context%3F+a+study+on+word+order%2E+In+Proceedings+of+the+13th+Conference+of+the+Europ)

*Updated 24 October 2026*
