---
title: "Topic-context Dependency on Continuous Semantic — Travi 2026"
description: "Brain-to-text decoders combine an LLM that proposes candidate continuations with a voxelwise encoder that predicts fMRI responses to each candidate."
authors: ["Fermin Travi", "Agustin Delmagro", "Diego Fernandez Slezak", "Bruno Bianchi", "Juan E. Kamienkowski"]
year: 2026
venue: "Proceedings of the 15th Workshop on Cognitive Modeling and Computational Linguistics"
source: "https://aclanthology.org/2026.cmcl-1.22/"
doi: "10.63317/233sezzfxz2m"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/travi-2026-topic-context-dependency-continuous-semantic/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/travi-2026-topic-context-dependency-continuous-semantic/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/) / Topic-context Dependency on Continuous Semantic Reconstruction of Language from fMRI Signals

# Topic-context Dependency on Continuous Semantic Reconstruction of Language from fMRI Signals

**Authors:** Fermin Travi, Agustin Delmagro, Diego Fernandez Slezak, Bruno Bianchi, Juan E. Kamienkowski · **Year:** 2026 · **Venue:** Proceedings of the 15th Workshop on Cognitive Modeling and Computational Linguistics · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.cmcl-1.22/) · [PDF](https://aclanthology.org/2026.cmcl-1.22.pdf) · [DOI 10.63317/233sezzfxz2m](https://doi.org/10.63317/233sezzfxz2m) · [OpenAlex](https://openalex.org/W7166547357)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
Brain-to-text decoders combine an LLM that proposes candidate continuations with a voxelwise encoder that predicts fMRI responses to each candidate. This work asks whether the topical makeup of the encoder's training stories skews what gets decoded. The authors used the LeBel et al. (2023) natural-listening dataset: 84 podcast stories heard by three participants. They embedded the transcripts with text-embedding-3-small and split them with K-Means into a Family cluster and a Miscellaneous cluster. They then trained GPT-2-based encoders on one topic only and reconstructed stories following the Tang et al. (2023) decoding approach. Outputs were judged in two ways: by re-clustering the decoded text, and by BERTScore against the true transcripts.

The encoders pulled reconstructions toward their own training topic. Family-trained encoders kept Family stories in the Family cluster, while Miscellaneous-trained encoders moved them out of it. Decoding beat chance only within the training topic and dropped below a random baseline across topics. The authors conclude that encoders can over-specialize semantically, which matters for brain-computer interfaces and for how decoding results are interpreted. They argue for training stimuli that are more diverse and lexically richer.

## Key points
- **Data:** the LeBel et al. (2023) fMRI corpus of 77 The Moth Radio Hour and 7 Modern Love stories. Participants S1–S3 each heard all stories, more than 16 hours of audio.
- **Clustering:** 1536-dimensional OpenAI text-embedding-3-small vectors were split by K-Means (K=2, silhouette 0.37). Eight Miscellaneous stories were dropped to give 38 stories per cluster.
- **Encoder:** GPT-2 Small with word-level tokenization, using layer 9 features and a five-word context. Leave-one-out training (37 stories per fold) produced 114 per-fold models plus 6 whole-cluster models. Compute totaled roughly 2,000 hours.
- **Topic bias:** with Family-trained encoders, 36 of 38 Family stories stayed in the Family cluster for at least one participant. With Miscellaneous-trained encoders, every reconstruction moved to the Miscellaneous cluster.
- **Fidelity:** BERTScore was computed with microsoft/deberta-xlarge-mnli. Topic-constrained encoders beat a random encoder only on in-topic stories and fell below it on out-of-topic ones.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{travi2026topic,
  title = {{Topic-context Dependency on Continuous Semantic Reconstruction of Language from fMRI Signals}},
  author = {Travi, Fermin and Delmagro, Agustin and Slezak, Diego Fernandez and Bianchi, Bruno and Kamienkowski, Juan E.},
  booktitle = {Proceedings of the 15th Workshop on Cognitive Modeling and Computational Linguistics},
  year = {2026},
  doi = {10.63317/233sezzfxz2m},
  url = {https://doi.org/10.63317/233sezzfxz2m}
}
```

- [← previous Tools for Estimating the Perceived Level of Phonetic Reduction](https://md.research.elamur.ai/free/en/papers/ward-2026-tools-estimating-perceived-level-phonetic/)
- [next → Topic-Initiator: A Proactive Chatbot with Personalized Topic RAG for Enhancing Willingness to Converse](https://md.research.elamur.ai/free/en/papers/matsuo-2026-topic-initiator-proactive-chatbot-personalized/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/)

## References

21 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Richard Antonello and Alexander Huth. 2024. Predictive Coding or Just Feature Discovery? An Alternative Account of Why Language Models Fit Brain Data. Neurobiology of Language (Cambridge, Mass.), 5(1):64–79. [find](https://scholar.google.com/scholar?q=Richard+Antonello+and+Alexander+Huth%2E+2024%2E+Predictive+Coding+or+Just+Feature+Discovery%3F+An+Alternative+Account+of+Why+Language+Models+Fit+Brain+Data%2E+Neurobiology+of+Language+%28Cambridge%2C+Mass%2E%29%2C+5%281%29)
2. Richard Antonello, Javier Turek, Vy Vo, and Alexander Huth. 2021. Low-dimensional structure in the space of language representations is reflected in brain responses. In Proceedings of the 35th International Conference on Neural Information Processing Systems, NIPS ’21, pages 8332–8344, Red Hook, NY,… [find](https://scholar.google.com/scholar?q=Richard+Antonello%2C+Javier+Turek%2C+Vy+Vo%2C+and+Alexander+Huth%2E+2021%2E+Low%2Ddimensional+structure+in+the+space+of+language+representations+is+reflected+in+brain+responses%2E+In+Proceedings+of+the+35th+Interna)
3. Richard Antonello, Aditya Vaidya, and Alexander Huth. 2023. Scaling laws for language encoding models in fMRI. Advances in Neural Information Processing Systems, 36:21895–21907. [find](https://scholar.google.com/scholar?q=Richard+Antonello%2C+Aditya+Vaidya%2C+and+Alexander+Huth%2E+2023%2E+Scaling+laws+for+language+encoding+models+in+fMRI%2E+Advances+in+Neural+Information+Processing+Systems%2C+36%3A21895%E2%80%9321907%2E)
4. Catherine Chen, Tom Dupré la Tour, Jack L. Gallant, Daniel Klein, and Fatma Deniz. 2024. The cortical representation of language timescales is shared between reading and listening. Communications Biology, 7(1):284. Publisher: Nature Publishing Group UK London. [find](https://scholar.google.com/scholar?q=Catherine+Chen%2C+Tom+Dupr%C3%A9+la+Tour%2C+Jack+L%2E+Gallant%2C+Daniel+Klein%2C+and+Fatma+Deniz%2E+2024%2E+The+cortical+representation+of+language+timescales+is+shared+between+reading+and+listening%2E+Communications+Biol)
5. Jiaqi Chen, Richard Antonello, Kaavya Chaparala, Coen Arrow, and Nima Mesgarani. 2025. Quantifying Semantic Functional Specialization in the Brain Using Encoding Models of Natural Language. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pages 77–90, Albuquerque,… [find](https://scholar.google.com/scholar?q=Jiaqi+Chen%2C+Richard+Antonello%2C+Kaavya+Chaparala%2C+Coen+Arrow%2C+and+Nima+Mesgarani%2E+2025%2E+Quantifying+Semantic+Functional+Specialization+in+the+Brain+Using+Encoding+Models+of+Natural+Language%2E+In+Proceed)
6. Srikanth R. Damera, Lillian Chang, Plamen P. Nikolov, James A. Mattei, Suneel Banerjee, Laurie S. Glezer, Patrick H. Cox, Xiong Jiang, Josef P. Rauschecker, and Maximilian Riesenhu-ber. 2023. Evidence for a Spoken Word Lexicon in the Auditory Ventral Stream. Neurobiology of Language, 4(3):420–434. [find](https://scholar.google.com/scholar?q=Srikanth+R%2E+Damera%2C+Lillian+Chang%2C+Plamen+P%2E+Nikolov%2C+James+A%2E+Mattei%2C+Suneel+Banerjee%2C+Laurie+S%2E+Glezer%2C+Patrick+H%2E+Cox%2C+Xiong+Jiang%2C+Josef+P%2E+Rauschecker%2C+and+Maximilian+Riesenhu%2Dber%2E+2023%2E+Evidence)
7. Tom Dupré la Tour, Matteo Visconti di Oleg-gio Castello, and Jack L. Gallant. 2025. The Voxelwise Encoding Model framework: A tutorial introduction to fitting encoding models to fMRI data. Imaging Neuroscience, 3:imag_a_00575. [find](https://scholar.google.com/scholar?q=Tom+Dupr%C3%A9+la+Tour%2C+Matteo+Visconti+di+Oleg%2Dgio+Castello%2C+and+Jack+L%2E+Gallant%2E+2025%2E+The+Voxelwise+Encoding+Model+framework%3A+A+tutorial+introduction+to+fitting+encoding+models+to+fMRI+data%2E+Imaging+Neu)
8. Evelina Fedorenko, Anna A. Ivanova, and Tamar I. Regev. 2024. The language network as a natural kind within the broader landscape of the human brain. Nature Reviews Neuroscience, 25(5):289– 312. [find](https://scholar.google.com/scholar?q=Evelina+Fedorenko%2C+Anna+A%2E+Ivanova%2C+and+Tamar+I%2E+Regev%2E+2024%2E+The+language+network+as+a+natural+kind+within+the+broader+landscape+of+the+human+brain%2E+Nature+Reviews+Neuroscience%2C+25%285%29%3A289%E2%80%93+312%2E)
9. Laura Gwilliams, Alec Marantz, David Poeppel, and Jean-Rémi King. 2025. Hierarchical dynamic coding coordinates speech comprehension in the human brain. Proceedings of the National Academy of Sciences, 122(42):e2422097122. [find](https://scholar.google.com/scholar?q=Laura+Gwilliams%2C+Alec+Marantz%2C+David+Poeppel%2C+and+Jean%2DR%C3%A9mi+King%2E+2025%2E+Hierarchical+dynamic+coding+coordinates+speech+comprehension+in+the+human+brain%2E+Proceedings+of+the+National+Academy+of+Sciences)
10. Amanda LeBel, Lauren Wagner, Shailee Jain, Aneesh Adhikari-Desai, Bhavin Gupta, Allyson Morgenthal, Jerry Tang, Lixiang Xu, and Alexander G. Huth. 2023. A natural language fMRI dataset for voxelwise encoding models. Scientific Data, 10(1):555. Publisher: Nature Publishing Group. [find](https://scholar.google.com/scholar?q=Amanda+LeBel%2C+Lauren+Wagner%2C+Shailee+Jain%2C+Aneesh+Adhikari%2DDesai%2C+Bhavin+Gupta%2C+Allyson+Morgenthal%2C+Jerry+Tang%2C+Lixiang+Xu%2C+and+Alexander+G%2E+Huth%2E+2023%2E+A+natural+language+fMRI+dataset+for+voxelwise+e)
11. Joaquin Quiñonero-Candela, Masashi Sugiyama, Anton Schwaighofer, Neil D. Lawrence, Michael I. Jordan, and Thomas Dietterich, editors. 2022. [find](https://scholar.google.com/scholar?q=Joaquin+Qui%C3%B1onero%2DCandela%2C+Masashi+Sugiyama%2C+Anton+Schwaighofer%2C+Neil+D%2E+Lawrence%2C+Michael+I%2E+Jordan%2C+and+Thomas+Dietterich%2C+editors%2E+2022%2E)
12. Dataset Shift in Machine Learning. Neural Information Processing series. MIT Press, Cambridge, MA, USA. [find](https://scholar.google.com/scholar?q=Dataset+Shift+in+Machine+Learning%2E+Neural+Information+Processing+series%2E+MIT+Press%2C+Cambridge%2C+MA%2C+USA%2E)
13. Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving Language Understanding by Generative Pre-Training. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Karthik+Narasimhan%2C+Tim+Salimans%2C+and+Ilya+Sutskever%2E+2018%2E+Improving+Language+Understanding+by+Generative+Pre%2DTraining%2E)
14. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+2019%2E+Language+Models+are+Unsupervised+Multitask+Learners%2E)
15. Alexander Schaefer, Ru Kong, Evan M. Gordon, Timothy O. Laumann, Xi-Nian Zuo, Avram J. Holmes, Simon B. Eickhoff, and B. T. Thomas Yeo. 2018. Local-Global Parcellation of the Human Cerebral Cortex from Intrinsic Functional Connectivity MRI. [find](https://scholar.google.com/scholar?q=Alexander+Schaefer%2C+Ru+Kong%2C+Evan+M%2E+Gordon%2C+Timothy+O%2E+Laumann%2C+Xi%2DNian+Zuo%2C+Avram+J%2E+Holmes%2C+Simon+B%2E+Eickhoff%2C+and+B%2E+T%2E+Thomas+Yeo%2E+2018%2E+Local%2DGlobal+Parcellation+of+the+Human+Cerebral+Cortex+fro)
16. Cerebral Cortex (New York, N.Y.: 1991), 28(9):3095–3114. [find](https://scholar.google.com/scholar?q=Cerebral+Cortex+%28New+York%2C+N%2EY%2E%3A+1991%29%2C+28%289%29%3A3095%E2%80%933114%2E)
17. Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander G. Huth. 2023. Semantic reconstruction of continuous language from non-invasive brain recordings. Nature Neuroscience, 26(5):858–866. Publisher: Nature Publishing Group. [find](https://scholar.google.com/scholar?q=Jerry+Tang%2C+Amanda+LeBel%2C+Shailee+Jain%2C+and+Alexander+G%2E+Huth%2E+2023%2E+Semantic+reconstruction+of+continuous+language+from+non%2Dinvasive+brain+recordings%2E+Nature+Neuroscience%2C+26%285%29%3A858%E2%80%93866%2E+Publisher%3A+N)
18. Mariya Toneva and Leila Wehbe. 2019. Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain). In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Mariya+Toneva+and+Leila+Wehbe%2E+2019%2E+Interpreting+and+improving+natural%2Dlanguage+processing+%28in+machines%29+with+natural+language%2Dprocessing+%28in+the+brain%29%2E+In+Advances+in+Neural+Information+Processing+)
19. Aditya Vaidya, Javier Turek, and Alexander Huth. 2023. Humans and language models diverge when predicting repeating text. In Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL), pages 58–69, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Aditya+Vaidya%2C+Javier+Turek%2C+and+Alexander+Huth%2E+2023%2E+Humans+and+language+models+diverge+when+predicting+repeating+text%2E+In+Proceedings+of+the+27th+Conference+on+Computational+Natural+Language+Learni)
20. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. BERTScore: Evaluating Text Generation with BERT. ArXiv:1904.09675 [cs]. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020%2E+BERTScore%3A+Evaluating+Text+Generation+with+BERT%2E+ArXiv%3A1904%2E09675+%5Bcs%5D%2E)
21. Yuchen Zhou, Emmy Liu, Graham Neubig, Michael J. Tarr, and Leila Wehbe. 2024. Divergences between Language Models and Human Brains. Advances in Neural Information Processing Systems, 37:137999–138031. [find](https://scholar.google.com/scholar?q=Yuchen+Zhou%2C+Emmy+Liu%2C+Graham+Neubig%2C+Michael+J%2E+Tarr%2C+and+Leila+Wehbe%2E+2024%2E+Divergences+between+Language+Models+and+Human+Brains%2E+Advances+in+Neural+Information+Processing+Systems%2C+37%3A137999%E2%80%93138031%2E)