---
title: "CoordiMap — paper by Schacht (2026) — summary and ideas"
description: "Experiments where participants verbally describe static images produce speech, visual stimuli, and sometimes gaze recordings. 22 references."
authors: ["Carmen Schacht"]
year: 2026
venue: "Proceedings fo the Second International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP"
source: "https://aclanthology.org/2026.gaze4nlp-1.6/"
doi: "10.63317/3pgk5582pu3t"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/schacht-2026-coordimap-conceptual-proposition-new-framework/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/schacht-2026-coordimap-conceptual-proposition-new-framework/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/) / CoordiMap: Conceptual Proposition of a new Framework for the Annotation of Verbal Elicitation Paths on Visual Experiment Stimuli and Introduction of the Associated Annotation Tool

# CoordiMap: Conceptual Proposition of a new Framework for the Annotation of Verbal Elicitation Paths on Visual Experiment Stimuli and Introduction of the Associated Annotation Tool

**Authors:** [Carmen Schacht](https://md.research.elamur.ai/free/en/authors/carmen-schacht/) · **Year:** 2026 · **Venue:** [Proceedings fo the Second International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP](https://md.research.elamur.ai/free/en/venues/gaze4nlp/) ([fo the International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP 2026](https://md.research.elamur.ai/free/en/venues/gaze4nlp/2026/)) · **Publisher:** [ELDA](https://md.research.elamur.ai/free/en/publishers/elda/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.gaze4nlp-1.6/) · [PDF](https://aclanthology.org/2026.gaze4nlp-1.6.pdf) · [DOI 10.63317/3pgk5582pu3t](https://doi.org/10.63317/3pgk5582pu3t) · [OpenAlex](https://openalex.org/W7166528971)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Experiments where participants verbally describe static images produce speech, visual stimuli, and sometimes gaze recordings. These are hard to align consistently, even though the order and anchoring of a description may reveal how the scene was perceived. The paper proposes the verbal elicitation path as a new data type: a speaker's linguistic units are placed as coordinate points on the stimulus image and linked in the order they were produced. This mirrors how eye-tracking represents fixations and saccades. To support the concept, the author releases a first version of CoordiMap, a lightweight annotation tool that runs locally. Annotators click positions on an uploaded image and assign labels, and the tool draws the resulting path. Repeated consecutive clicks on one spot produce a larger dot, imitating longer fixation durations. The tool does not assume any theoretical framework, so users decide which units to annotate, from coreference to information structure. The work is conceptual and is shown only through an example use case. It matters because it puts language and gaze in a shared spatial format, even when different participant groups produced the two data types.

## Key points
- **Export format:** CoordiMap writes annotations to .csv files with a label plus X and Y coordinates for each point, designed to be directly comparable with eye-tracking data.
- **Implementation:** The tool is written in Python with a tkinter GUI. It can be started from a script or an .exe file and includes a README.
- **Licensing:** It will be released under CC BY 4.0 via OSF (osf.io/8ke4c).
- **Positioning against related work:** Image annotators like LabelImg and the VGG Image Annotator (VIA) focus on tasks such as bounding boxes and do not support elicitation paths. Meaning Maps (Henderson and Hayes) and the combined gaze–speech studies of Griffin and Bock (2000) motivate the approach.
- **Limitations and next steps:** There is no empirical evaluation yet. A planned pilot study will compare gaze data with elicitation paths and assess inter-annotator consistency and usability. The research is funded by DFG under SFB 1102.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Ruhr University Bochum](https://md.research.elamur.ai/free/en/universities/ruhr-university-bochum/) — University, Bochum, Germany · 25 works · 1,189 citations

📚 Shelves (6): [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 870 works · [🧠 Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/) · 165 works · [🧠 Cognitive Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/cognitive-neuroscience/) · 164 works

## Cite

Cite as: Carmen Schacht. 2026. CoordiMap: Conceptual Proposition of a new Framework for the Annotation of Verbal Elicitation Paths on Visual Experiment Stimuli and Introduction of the Associated Annotation Tool. Proceedings fo the Second International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{schacht2026coordimap,
  title = {{CoordiMap: Conceptual Proposition of a new Framework for the Annotation of Verbal Elicitation Paths on Visual Experiment Stimuli and Introduction of the Associated Annotation Tool}},
  author = {Carmen Schacht},
  booktitle = {Proceedings fo the Second International Workshop on Eye-Tracking Resources and Evaluation for Human-Aligned NLP},
  year = {2026},
  doi = {10.63317/3pgk5582pu3t},
  url = {https://doi.org/10.63317/3pgk5582pu3t}
}
```

- [← previous CoopValue: Revealing LLM Value Preferences Through Multi-Agent Cooperation](https://md.research.elamur.ai/free/en/papers/tang-2026-coopvalue-revealing-llm-value-preferences/)
- [next → Coordination of unmatched clause types and dynamic look-ahead](https://md.research.elamur.ai/free/en/papers/lasersohn-2026-coordination-unmatched-clause-types-dynamic/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/)

## References

22 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. J. D. Hunter. 2007. Matplotlib: A 2d graphics environment. Computing in Science & Engineering, 9(3):90–95. [find](https://scholar.google.com/scholar?q=J%2E+D%2E+Hunter%2E+2007%2E+Matplotlib%3A+A+2d+graphics+environment%2E+Computing+in+Science+%26+Engineering%2C+9%283%29%3A90%E2%80%9395%2E)
2. C. Blake. 2013. Eye-tracking: Grundlagen und an-wendungsfelder. In W. Möhring and D. Schlütz, editors, Handbuch standardisierte Erhebungsver-fahren in der Kommunikationswissenschaft. Wiesbaden, Springer VS. Doi:10.1007/978-3-531-18776-1_20. — [doi:10.1007/978-3-531-18776-1_20](https://doi.org/10.1007/978-3-531-18776-1_20) [find](https://scholar.google.com/scholar?q=C%2E+Blake%2E+2013%2E+Eye%2Dtracking%3A+Grundlagen+und+an%2Dwendungsfelder%2E+In+W%2E+M%C3%B6hring+and+D%2E+Schl%C3%BCtz%2C+editors%2C+Handbuch+standardisierte+Erhebungsver%2Dfahren+in+der+Kommunikationswissenschaft%2E+Wiesbaden%2C+Spring)
3. D. Kababgi, G. Grisot, F. Pennino, and B. Herrmann. 2024. Recognising non-named spatial entities in literary texts: a novel spatial entities classifier. In Proceedings of the Computational Humanities Research Conference, volume 3834 of CEUR Workshop Proceedings, pages 472–481. [find](https://scholar.google.com/scholar?q=D%2E+Kababgi%2C+G%2E+Grisot%2C+F%2E+Pennino%2C+and+B%2E+Herrmann%2E+2024%2E+Recognising+non%2Dnamed+spatial+entities+in+literary+texts%3A+a+novel+spatial+entities+classifier%2E+In+Proceedings+of+the+Computational+Humanities+)
4. A. Clark. 2015. Pillow (pil fork) documentation. [find](https://scholar.google.com/scholar?q=A%2E+Clark%2E+2015%2E+Pillow+%28pil+fork%29+documentation%2E)
5. W. Klein. 2015. Überall und nirgendwo. Subjektive und objektive Momente in der Raumreferenz (1990), pages 177–207. J.B. Metzler, Stuttgart. [find](https://scholar.google.com/scholar?q=W%2E+Klein%2E+2015%2E+%C3%9Cberall+und+nirgendwo%2E+Subjektive+und+objektive+Momente+in+der+Raumreferenz+%281990%29%2C+pages+177%E2%80%93207%2E+J%2EB%2E+Metzler%2C+Stuttgart%2E)
6. R. Delucchi Danhier. 2015. Sprachspezifische Aspekte der Informationsverteilung in Wegan-weisungen. Schneider Verlag Hohengehren, Baltmannsweiler. [find](https://scholar.google.com/scholar?q=R%2E+Delucchi+Danhier%2E+2015%2E+Sprachspezifische+Aspekte+der+Informationsverteilung+in+Wegan%2Dweisungen%2E+Schneider+Verlag+Hohengehren%2C+Baltmannsweiler%2E)
7. W. J. M. Levelt. 1989. Speaking: From Intention to Articulation. The MIT Press. [find](https://scholar.google.com/scholar?q=W%2E+J%2E+M%2E+Levelt%2E+1989%2E+Speaking%3A+From+Intention+to+Articulation%2E+The+MIT+Press%2E)
8. R. Delucchi Danhier. 2019. Linearisierungsstrate-gien und ihr einfluss auf die informationsstruktur und die syntaktische komplexität von zim-merbeschreibungen. In Tübingen:, editor, Raum-relationen im Deutschen, pages 69–89. Stauffenburg. [find](https://scholar.google.com/scholar?q=R%2E+Delucchi+Danhier%2E+2019%2E+Linearisierungsstrate%2Dgien+und+ihr+einfluss+auf+die+informationsstruktur+und+die+syntaktische+komplexit%C3%A4t+von+zim%2Dmerbeschreibungen%2E+In+T%C3%BCbingen%3A%2C+editor%2C+Raum%2Drelationen+im)
9. R. Delucchi Danhier, B. Mertins, H. Mertins, and G. Schneider. 2025. Entropy as a lens: Exploring visual behavior patterns in architects. Journal of Eye Movement Research, 18(5). [find](https://scholar.google.com/scholar?q=R%2E+Delucchi+Danhier%2C+B%2E+Mertins%2C+H%2E+Mertins%2C+and+G%2E+Schneider%2E+2025%2E+Entropy+as+a+lens%3A+Exploring+visual+behavior+patterns+in+architects%2E+Journal+of+Eye+Movement+Research%2C+18%285%29%2E)
10. Lundh. 1999. An introduction to tkinter. URL: www. pythonware. com/library/tkinter/introduction/index. htm. [find](https://scholar.google.com/scholar?q=Lundh%2E+1999%2E+An+introduction+to+tkinter%2E+URL%3A+www%2E+pythonware%2E+com%2Flibrary%2Ftkinter%2Fintroduction%2Findex%2E+htm%2E)
11. Lücking, T. Pfeiffer, and H. Rieser. 2015. Pointing and reference reconsidered. Journal of Pragmatics, 77:56–79. Doi:10.1016/j.pragma.2014.12.013. — [doi:10.1016/j.pragma.2014.12.013](https://doi.org/10.1016/j.pragma.2014.12.013) [find](https://scholar.google.com/scholar?q=L%C3%BCcking%2C+T%2E+Pfeiffer%2C+and+H%2E+Rieser%2E+2015%2E+Pointing+and+reference+reconsidered%2E+Journal+of+Pragmatics%2C+77%3A56%E2%80%9379%2E+Doi%3A10%2E1016%2Fj%2Epragma%2E2014%2E12%2E013%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fj%2Epragma%2E2014%2E12%2E013%5D%28https%3A%2F%2Fdoi%2Eorg%2F)
12. T. Pfeiffer, A. Kranstedt, and A. Lücking. 2006. Sprach-gestik experimente mit iade, dem interactive augmented data explorer. In Dritter Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR, Koblenz, pages 61–72. [find](https://scholar.google.com/scholar?q=T%2E+Pfeiffer%2C+A%2E+Kranstedt%2C+and+A%2E+L%C3%BCcking%2E+2006%2E+Sprach%2Dgestik+experimente+mit+iade%2C+dem+interactive+augmented+data+explorer%2E+In+Dritter+Workshop+Virtuelle+und+Erweiterte+Realit%C3%A4t+der+GI%2DFachgruppe+VR)
13. A. Dutta and A. Zisserman. 2019. The VIA annotation software for images, audio and video. In Proceedings of the 27th ACM International Conference on Multimedia, MM ’19, New York, NY, USA. ACM. [find](https://scholar.google.com/scholar?q=A%2E+Dutta+and+A%2E+Zisserman%2E+2019%2E+The+VIA+annotation+software+for+images%2C+audio+and+video%2E+In+Proceedings+of+the+27th+ACM+International+Conference+on+Multimedia%2C+MM+%E2%80%9919%2C+New+York%2C+NY%2C+USA%2E+ACM%2E)
14. E. Sitter, O. Momen, F. Steig, J. B. Herrmann, and S. Zarriess. 2025. Annotating spatial descriptions in literary and non-literary text. In Proceedings of the 19th Linguistic Annotation Workshop (LAW-XIX-2025), pages 308–325, Vienna, Austria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=E%2E+Sitter%2C+O%2E+Momen%2C+F%2E+Steig%2C+J%2E+B%2E+Herrmann%2C+and+S%2E+Zarriess%2E+2025%2E+Annotating+spatial+descriptions+in+literary+and+non%2Dliterary+text%2E+In+Proceedings+of+the+19th+Linguistic+Annotation+Workshop+%28LAW%2D)
15. F. Ferreira and J. M. Henderson. 1998. Linearization strategies during language production. Mem. Cognit., 26(1):88–96. [find](https://scholar.google.com/scholar?q=F%2E+Ferreira+and+J%2E+M%2E+Henderson%2E+1998%2E+Linearization+strategies+during+language+production%2E+Mem%2E+Cognit%2E%2C+26%281%29%3A88%E2%80%9396%2E)
16. Z. M. Griffin and K. Bock. 2000. What the eyes say about speaking. Psychological Science, 11(4):274–279. PMID: 11273384. [find](https://scholar.google.com/scholar?q=Z%2E+M%2E+Griffin+and+K%2E+Bock%2E+2000%2E+What+the+eyes+say+about+speaking%2E+Psychological+Science%2C+11%284%29%3A274%E2%80%93279%2E+PMID%3A+11273384%2E)
17. M. K. Tanenhaus, M. J. Spivey-Knowlton, K. M. Eberhard, and J. C. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science (New York, N. Y.), 268(5217):1632–1634. Doi:10.1126/science.7777863. — [doi:10.1126/science.7777863](https://doi.org/10.1126/science.7777863) [find](https://scholar.google.com/scholar?q=M%2E+K%2E+Tanenhaus%2C+M%2E+J%2E+Spivey%2DKnowlton%2C+K%2E+M%2E+Eberhard%2C+and+J%2E+C%2E+Sedivy%2E+1995%2E+Integration+of+visual+and+linguistic+information+in+spoken+language+comprehension%2E+Science+%28New+York%2C+N%2E+Y%2E%29%2C+268%285217%29%3A)
18. C. R. Harris, K. J. Millman, S. J. van der Walt, R. Gommers, P. Virtanen, D. Cournapeau, E. Wieser, J. Taylor, S. Berg, N. J. Smith, R.Kern, M. Picus, S. Hoyer, M. H. van Kerkwijk, M. Brett, A. Haldane, J. Fernandez del Rio, M. Wiebe, P. Peterson, P. Gerard-Marchant, K. Sheppard, T. Reddy, W. Weckes… — [Array Programming with NumPy](https://md.research.elamur.ai/free/en/papers/harris-2020-array-programming-numpy/)
19. Tzutalin. 2015. Labelimg. Free Software: MIT License. [find](https://scholar.google.com/scholar?q=Tzutalin%2E+2015%2E+Labelimg%2E+Free+Software%3A+MIT+License%2E)
20. G. Van Rossum and F. L. Drake. 2009. Python 3 Reference Manual. CreateSpace, Scotts Valley, CA. [find](https://scholar.google.com/scholar?q=G%2E+Van+Rossum+and+F%2E+L%2E+Drake%2E+2009%2E+Python+3+Reference+Manual%2E+CreateSpace%2C+Scotts+Valley%2C+CA%2E)
21. J. M. Henderson and T. R. Hayes. 2017. Meaning-based guidance of attention in scenes as revealed by meaning maps. Nature Human Behaviour, 1:743–747. Doi:10.1038/s441562-017-0208-0. — [doi:10.1038/s441562-017-0208-0](https://doi.org/10.1038/s441562-017-0208-0) [find](https://scholar.google.com/scholar?q=J%2E+M%2E+Henderson+and+T%2E+R%2E+Hayes%2E+2017%2E+Meaning%2Dbased+guidance+of+attention+in+scenes+as+revealed+by+meaning+maps%2E+Nature+Human+Behaviour%2C+1%3A743%E2%80%93747%2E+Doi%3A10%2E1038%2Fs441562%2D017%2D0208%2D0%2E+%E2%80%94+%5Bdoi%3A10%2E1038%2Fs441)
22. C. von Stutterheim and M. Carroll. 2007. Durch die grammatik fokussiert. Zeitschrift für Literaturwissenschaft und Linguistik, 145:35–60. [find](https://scholar.google.com/scholar?q=C%2E+von+Stutterheim+and+M%2E+Carroll%2E+2007%2E+Durch+die+grammatik+fokussiert%2E+Zeitschrift+f%C3%BCr+Literaturwissenschaft+und+Linguistik%2C+145%3A35%E2%80%9360%2E)

*Updated 1 November 2026*