---
title: "Language Reconstruction with Brain Predictive Coding from fMRI"
description: "Building on this, they propose PredFT, an end-to-end fMRI-to-text model with two parts: Main network: an fMRI encoder (a… 49 references."
authors: ["Congchi Yin", "Ziyi Ye", "Piji Li"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.949/"
doi: "10.18653/v1/2026.acl-long.949"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yin-2026-language-reconstruction-brain-predictive-coding/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yin-2026-language-reconstruction-brain-predictive-coding/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/8/) / Language Reconstruction with Brain Predictive Coding from fMRI Data

# Language Reconstruction with Brain Predictive Coding from fMRI Data

**Authors:** Congchi Yin, [Ziyi Ye](https://md.research.elamur.ai/free/en/authors/ziyi-ye/) and [Piji Li](https://md.research.elamur.ai/free/en/authors/piji-li/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.949/) · [PDF](https://aclanthology.org/2026.acl-long.949.pdf) · [DOI 10.18653/v1/2026.acl-long.949](https://doi.org/10.18653/v1/2026.acl-long.949) · [OpenAlex](https://openalex.org/W4398192142)

**Citations:** 2 citations (OpenAlex, 2026-10-14)

## Summary

This work asks whether the brain's habit of anticipating upcoming words can improve the decoding of continuous language from fMRI recordings. The authors first ran a verification study. They used ridge regression to map GPT-2 activations onto brain responses and found that adding representations of future words raises this correlation. The gain depends on how far ahead the predicted words are and how many are included, and it is strongest in prediction-related regions of interest (ROIs). Building on this, they propose PredFT, an end-to-end fMRI-to-text model with two parts:

- **Main network:** an fMRI encoder (a 3D-CNN for volumetric data or linear layers for surface data), an FIR model to correct for BOLD delay, and a Transformer encoder-decoder that generates text.
- **Side network:** encodes signals from predictive ROIs and is trained to output future words. Its representation is fed into the main decoder through attention.

On the LeBel and Narratives datasets, PredFT beats existing decoders on several language metrics. The results suggest that neuroscience theory can usefully guide brain-to-language model design.

## Key points

- The verification experiment defines a prediction score: the increase in brain score when embeddings of future words, at a given distance *d* and length *l*, are concatenated to the current word's representation. Medium lengths (around *l* = 4–6) gave the highest scores.
- PredFT is trained jointly with two cross-entropy losses, one on the original word sequence (main network) and one on the predicted future words (side network).
- Feeding the side network signals from the parietal-temporal-occipital (PTO) area produced larger decoding gains than other ROI choices, supporting this area's role in prediction.
- On LeBel's dataset (3 subjects), the authors swept *l* from 1–12 and *d* from 0–12. On Narratives, they fixed *l* = 2 and varied *d* from 0–10 because of compute cost. Decoding was evaluated with BLEU-1 and ROUGE1-F.
- Decoding quality first rises and then falls as *d* grows. Very short (*l* = 1) or very long (*l* = 11–12) predictions hurt performance. This is a stricter pattern than in the verification study, where such lengths still gave small gains.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Fudan University](https://md.research.elamur.ai/free/en/universities/fudan-university/) — University, Shanghai, China · 167 works · 20,987 citations
- [Nanjing University of Aeronautics and Astronautics](https://md.research.elamur.ai/free/en/universities/nanjing-university-of-aeronautics-and-astronautics/) — University, Nanjing, China · 4 works · 2 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🧠 Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/) · 165 works · [🧠 Cognitive Neuroscience](https://md.research.elamur.ai/free/en/shelves/neuroscience/cognitive-neuroscience/) · 164 works

## Cite

Cite as: Congchi Yin, Ziyi Ye and Piji Li. 2026. Language Reconstruction with Brain Predictive Coding from fMRI Data. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yin2026language,
  title = {{Language Reconstruction with Brain Predictive Coding from fMRI Data}},
  author = {Congchi Yin, Ziyi Ye and Piji Li},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.949},
  url = {https://doi.org/10.18653/v1/2026.acl-long.949}
}
```

- [← previous Language of Thought Shapes Output Diversity in Large Language Models](https://md.research.elamur.ai/free/en/papers/xu-2026-language-thought-shapes-output-diversity/)
- [next → Latent Agents: A Post-Training Procedure for Internalized Multi-Agent Debate](https://md.research.elamur.ai/free/en/papers/yi-2026-latent-agents-post-training-procedure/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/8/)

## References

49 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Hervé Abdi and Lynne J Williams. 2010. Principal component analysis. Wiley interdisciplinary reviews: computational statistics. [find](https://scholar.google.com/scholar?q=Herv%C3%A9+Abdi+and+Lynne+J+Williams%2E+2010%2E+Principal+component+analysis%2E+Wiley+interdisciplinary+reviews%3A+computational+statistics%2E)
2. Nicolas Affolter, Beni Egressy, Damian Pascual, and Roger Wattenhofer. 2020. Brain2word: decoding brain activity for language generation. arXiv preprint arXiv:2009.04765. — [arXiv:2009.04765](https://arxiv.org/abs/2009.04765) [find](https://scholar.google.com/scholar?q=Nicolas+Affolter%2C+Beni+Egressy%2C+Damian+Pascual%2C+and+Roger+Wattenhofer%2E+2020%2E+Brain2word%3A+decoding+brain+activity+for+language+generation%2E+arXiv+preprint+arXiv%3A2009%2E04765%2E+%E2%80%94+%5BarXiv%3A2009%2E04765%5D%28https%3A%2F%2F)
3. Richard Antonello and Alexander Huth. 2024. Predictive coding or just feature discovery? an alternative account of why language models fit brain data. Neurobiology of Language, 5(1):64–79. [find](https://scholar.google.com/scholar?q=Richard+Antonello+and+Alexander+Huth%2E+2024%2E+Predictive+coding+or+just+feature+discovery%3F+an+alternative+account+of+why+language+models+fit+brain+data%2E+Neurobiology+of+Language%2C+5%281%29%3A64%E2%80%9379%2E)
4. Shohini Bhattasali, Murielle Fabre, Wen-Ming Luh, Hazem Al Saied, Mathieu Constant, Christophe Pallier, Jonathan R Brennan, R Nathan Spreng, and John Hale. 2019. Localising memory retrieval and syntactic composition: an fmri study of naturalistic language comprehension. Language, Cognition and Neuro… [find](https://scholar.google.com/scholar?q=Shohini+Bhattasali%2C+Murielle+Fabre%2C+Wen%2DMing+Luh%2C+Hazem+Al+Saied%2C+Mathieu+Constant%2C+Christophe+Pallier%2C+Jonathan+R+Brennan%2C+R+Nathan+Spreng%2C+and+John+Hale%2E+2019%2E+Localising+memory+retrieval+and+syntac)
5. Charlotte Caucheteux, Alexandre Gramfort, and Jean-Rémi King. 2022. Deep language algorithms predict semantic comprehension from brain activity. Scientific Reports, 12(1):16327. [find](https://scholar.google.com/scholar?q=Charlotte+Caucheteux%2C+Alexandre+Gramfort%2C+and+Jean%2DR%C3%A9mi+King%2E+2022%2E+Deep+language+algorithms+predict+semantic+comprehension+from+brain+activity%2E+Scientific+Reports%2C+12%281%29%3A16327%2E)
6. Charlotte Caucheteux, Alexandre Gramfort, and Jean-Rémi King. 2023. Evidence of a predictive coding hierarchy in the human brain listening to speech. Nature Human Behaviour, 7(3):430–441. [find](https://scholar.google.com/scholar?q=Charlotte+Caucheteux%2C+Alexandre+Gramfort%2C+and+Jean%2DR%C3%A9mi+King%2E+2023%2E+Evidence+of+a+predictive+coding+hierarchy+in+the+human+brain+listening+to+speech%2E+Nature+Human+Behaviour%2C+7%283%29%3A430%E2%80%93441%2E)
7. Christophe Destrieux, Bruce Fischl, Anders Dale, and Eric Halgren. 2010. Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature. Neuroimage, 53(1):1–15. [find](https://scholar.google.com/scholar?q=Christophe+Destrieux%2C+Bruce+Fischl%2C+Anders+Dale%2C+and+Eric+Halgren%2E+2010%2E+Automatic+parcellation+of+human+cortical+gyri+and+sulci+using+standard+anatomical+nomenclature%2E+Neuroimage%2C+53%281%29%3A1%E2%80%9315%2E)
8. Peter W Donhauser and Sylvain Baillet. 2020. Two distinct neural timescales for predictive speech processing. Neuron, 105(2):385–393. [find](https://scholar.google.com/scholar?q=Peter+W+Donhauser+and+Sylvain+Baillet%2E+2020%2E+Two+distinct+neural+timescales+for+predictive+speech+processing%2E+Neuron%2C+105%282%29%3A385%E2%80%93393%2E)
9. Karl Friston. 2008. Hierarchical models in the brain. PLoS Computational Biology, 4(11):e1000211. [find](https://scholar.google.com/scholar?q=Karl+Friston%2E+2008%2E+Hierarchical+models+in+the+brain%2E+PLoS+Computational+Biology%2C+4%2811%29%3Ae1000211%2E)
10. Karl Friston and Stefan Kiebel. 2009. Predictive coding under the free-energy principle. Philosophical transactions of the Royal Society B: Biological sciences, 364(1521):1211–1221. [find](https://scholar.google.com/scholar?q=Karl+Friston+and+Stefan+Kiebel%2E+2009%2E+Predictive+coding+under+the+free%2Denergy+principle%2E+Philosophical+transactions+of+the+Royal+Society+B%3A+Biological+sciences%2C+364%281521%29%3A1211%E2%80%931221%2E)
11. Marta I Garrido, James M Kilner, Klaas E Stephan, and Karl J Friston. 2009. The mismatch negativity: a review of underlying mechanisms. Clinical Neurophysiology, 120(3):453–463. [find](https://scholar.google.com/scholar?q=Marta+I+Garrido%2C+James+M+Kilner%2C+Klaas+E+Stephan%2C+and+Karl+J+Friston%2E+2009%2E+The+mismatch+negativity%3A+a+review+of+underlying+mechanisms%2E+Clinical+Neurophysiology%2C+120%283%29%3A453%E2%80%93463%2E)
12. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. [Deep residual learning for image recognition](https://md.research.elamur.ai/free/en/papers/he-2015-deep-residual-learning-image-recognition/). In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
13. Micha Heilbron, Kristijan Armeni, Jan-Mathijs Schoffelen, Peter Hagoort, and Floris P De Lange. 2022. A hierarchy of linguistic predictions during natural language comprehension. Proceedings of the National Academy of Sciences, 119(32):e2201968119. [find](https://scholar.google.com/scholar?q=Micha+Heilbron%2C+Kristijan+Armeni%2C+Jan%2DMathijs+Schoffelen%2C+Peter+Hagoort%2C+and+Floris+P+De+Lange%2E+2022%2E+A+hierarchy+of+linguistic+predictions+during+natural+language+comprehension%2E+Proceedings+of+the+Na)
14. Alexander G Huth, Wendy A De Heer, Thomas L Griffiths, Frédéric E Theunissen, and Jack L Gallant. 2016. Natural speech reveals the semantic maps that tile human cerebral cortex. Nature, 532(7600):453– 458. [find](https://scholar.google.com/scholar?q=Alexander+G+Huth%2C+Wendy+A+De+Heer%2C+Thomas+L+Griffiths%2C+Fr%C3%A9d%C3%A9ric+E+Theunissen%2C+and+Jack+L+Gallant%2E+2016%2E+Natural+speech+reveals+the+semantic+maps+that+tile+human+cerebral+cortex%2E+Nature%2C+532%287600%29%3A453%E2%80%93)
15. Amanda LeBel, Lauren Wagner, Shailee Jain, Aneesh Adhikari-Desai, Bhavin Gupta, Allyson Morgenthal, Jerry Tang, Lixiang Xu, and Alexander G Huth. 2023. A natural language fmri dataset for voxelwise encoding models. Scientific Data, 10(1):555. [find](https://scholar.google.com/scholar?q=Amanda+LeBel%2C+Lauren+Wagner%2C+Shailee+Jain%2C+Aneesh+Adhikari%2DDesai%2C+Bhavin+Gupta%2C+Allyson+Morgenthal%2C+Jerry+Tang%2C+Lixiang+Xu%2C+and+Alexander+G+Huth%2E+2023%2E+A+natural+language+fmri+dataset+for+voxelwise+en)
16. Yann LeCun and Yoshua Bengio. Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks. [find](https://scholar.google.com/scholar?q=Yann+LeCun+and+Yoshua+Bengio%2E+Convolutional+networks+for+images%2C+speech%2C+and+time+series%2E+The+Handbook+of+Brain+Theory+and+Neural+Networks%2E)
17. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. [Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/). In Proceedings of the 58th Annual Meeting of the…
18. Chien Heng Liao, Keith J Worsley, J-B Poline, John AD Aston, Gary H Duncan, and Alan C Evans. 2002. Estimating the delay of the fmri response. Neuroimage, 16(3):593–606. [find](https://scholar.google.com/scholar?q=Chien+Heng+Liao%2C+Keith+J+Worsley%2C+J%2DB+Poline%2C+John+AD+Aston%2C+Gary+H+Duncan%2C+and+Alan+C+Evans%2E+2002%2E+Estimating+the+delay+of+the+fmri+response%2E+Neuroimage%2C+16%283%29%3A593%E2%80%93606%2E)
19. Chin-Yew Lin. 2004. [Rouge: A package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In Proceedings of the Workshop on Text Summarization Branches Out.
20. James L McClelland and David E Rumelhart. 1981. An interactive activation model of context effects in letter perception: I. an account of basic findings. Psychological Review, 88(5):375. [find](https://scholar.google.com/scholar?q=James+L+McClelland+and+David+E+Rumelhart%2E+1981%2E+An+interactive+activation+model+of+context+effects+in+letter+perception%3A+I%2E+an+account+of+basic+findings%2E+Psychological+Review%2C+88%285%29%3A375%2E)
21. Beren Millidge, Anil Seth, and Christopher L Buckley. 2021. Predictive coding: a theoretical and experimental review. arXiv preprint arXiv:2107.12979. — [arXiv:2107.12979](https://arxiv.org/abs/2107.12979) [find](https://scholar.google.com/scholar?q=Beren+Millidge%2C+Anil+Seth%2C+and+Christopher+L+Buckley%2E+2021%2E+Predictive+coding%3A+a+theoretical+and+experimental+review%2E+arXiv+preprint+arXiv%3A2107%2E12979%2E+%E2%80%94+%5BarXiv%3A2107%2E12979%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2107%2E1)
22. David Mumford. 1991. On the computational architecture of the neocortex: I. the role of the thalamo-cortical loop. Biological Cybernetics, 65(2):135– 145. [find](https://scholar.google.com/scholar?q=David+Mumford%2E+1991%2E+On+the+computational+architecture+of+the+neocortex%3A+I%2E+the+role+of+the+thalamo%2Dcortical+loop%2E+Biological+Cybernetics%2C+65%282%29%3A135%E2%80%93+145%2E)
23. Samuel A Nastase, Yun-Fei Liu, Hanna Hillman, Asieh Zadbood, Liat Hasenfratz, Neggin Keshavarzian, Janice Chen, Christopher J Honey, Yaara Yeshurun, Mor Regev, et al. 2021. The "narratives" fmri dataset for evaluating models of naturalistic language comprehension. Scientific Data, 8(1):250. [find](https://scholar.google.com/scholar?q=Samuel+A+Nastase%2C+Yun%2DFei+Liu%2C+Hanna+Hillman%2C+Asieh+Zadbood%2C+Liat+Hasenfratz%2C+Neggin+Keshavarzian%2C+Janice+Chen%2C+Christopher+J+Honey%2C+Yaara+Yeshurun%2C+Mor+Regev%2C+et+al%2E+2021%2E+The+%22narratives%22+fmri+datas)
24. Kayoko Okada, William Matchin, and Gregory Hickok. 2018. Neural evidence for predictive coding in auditory cortex during speech production. Psychonomic Bulletin & Review, 25:423–430. [find](https://scholar.google.com/scholar?q=Kayoko+Okada%2C+William+Matchin%2C+and+Gregory+Hickok%2E+2018%2E+Neural+evidence+for+predictive+coding+in+auditory+cortex+during+speech+production%2E+Psychonomic+Bulletin+%26+Review%2C+25%3A423%E2%80%93430%2E)
25. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics.
26. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in python. the Journal of machine Learning research. [find](https://scholar.google.com/scholar?q=Fabian+Pedregosa%2C+Ga%C3%ABl+Varoquaux%2C+Alexandre+Gramfort%2C+Vincent+Michel%2C+Bertrand+Thirion%2C+Olivier+Grisel%2C+Mathieu+Blondel%2C+Peter+Prettenhofer%2C+Ron+Weiss%2C+Vincent+Dubourg%2C+et+al%2E+2011%2E+Scikit%2Dlearn%3A+Mach)
27. Francisco Pereira, Bin Lou, Brianna Pritchett, Samuel Ritter, Samuel J Gershman, Nancy Kanwisher, Matthew Botvinick, and Evelina Fedorenko. 2018. Toward a universal decoder of linguistic meaning from brain activation. Nature Communications, 9(1):963. [find](https://scholar.google.com/scholar?q=Francisco+Pereira%2C+Bin+Lou%2C+Brianna+Pritchett%2C+Samuel+Ritter%2C+Samuel+J+Gershman%2C+Nancy+Kanwisher%2C+Matthew+Botvinick%2C+and+Evelina+Fedorenko%2E+2018%2E+Toward+a+universal+decoder+of+linguistic+meaning+from+)
28. Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018. Improving language understanding by generative pre-training. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Karthik+Narasimhan%2C+Tim+Salimans%2C+Ilya+Sutskever%2C+et+al%2E+2018%2E+Improving+language+understanding+by+generative+pre%2Dtraining%2E)
29. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI Blog. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+Ilya+Sutskever%2C+et+al%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+Blog%2E)
30. Rajesh PN Rao and Dana H Ballard. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1):79–87. [find](https://scholar.google.com/scholar?q=Rajesh+PN+Rao+and+Dana+H+Ballard%2E+1999%2E+Predictive+coding+in+the+visual+cortex%3A+a+functional+interpretation+of+some+extra%2Dclassical+receptive%2Dfield+effects%2E+Nature+Neuroscience%2C+2%281%29%3A79%E2%80%9387%2E)
31. Paul Scotti, Atmadeep Banerjee, Jimmie Goode, Stepan Shabalin, Alex Nguyen, Aidan Dempster, Nathalie Verlinde, Elad Yundler, David Weisberg, Kenneth Norman, et al. 2024. Reconstructing the mind’s eye: fmri-to-image with contrastive learning and diffusion priors. In Advances in Neural Information Pro… [find](https://scholar.google.com/scholar?q=Paul+Scotti%2C+Atmadeep+Banerjee%2C+Jimmie+Goode%2C+Stepan+Shabalin%2C+Alex+Nguyen%2C+Aidan+Dempster%2C+Nathalie+Verlinde%2C+Elad+Yundler%2C+David+Weisberg%2C+Kenneth+Norman%2C+et+al%2E+2024%2E+Reconstructing+the+mind%E2%80%99s+eye%3A)
32. Jingyuan Sun, Shaonan Wang, Jiajun Zhang, and Chengqing Zong. 2019. Towards sentence-level brain decoding with distributed representations. In Proceedings of the AAAI Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Jingyuan+Sun%2C+Shaonan+Wang%2C+Jiajun+Zhang%2C+and+Chengqing+Zong%2E+2019%2E+Towards+sentence%2Dlevel+brain+decoding+with+distributed+representations%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intellig)
33. Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. [Sequence to sequence learning with neural networks](https://md.research.elamur.ai/free/en/papers/sutskever-2014-sequence-sequence-learning-neural-networks/). In Advances in Neural Information Processing Systems.
34. Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander G Huth. 2023. Semantic reconstruction of continuous language from non-invasive brain recordings. Nature Neuroscience, 26(5):858–866. [find](https://scholar.google.com/scholar?q=Jerry+Tang%2C+Amanda+LeBel%2C+Shailee+Jain%2C+and+Alexander+G+Huth%2E+2023%2E+Semantic+reconstruction+of+continuous+language+from+non%2Dinvasive+brain+recordings%2E+Nature+Neuroscience%2C+26%285%29%3A858%E2%80%93866%2E)
35. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023. [Llama 2: Open foundation and fine-tuned chat models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-2-open-foundation-fine/). arXiv preprint arXiv:2307.09288.
36. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. [Attention is all you need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In Advances in Neural Information Processing Systems.
37. Catherine Wacongne, Etienne Labyt, Virginie Van Wassenhove, Tristan Bekinschtein, Lionel Naccache, and Stanislas Dehaene. 2011. Evidence for a hierarchy of predictions and prediction errors in human cortex. Proceedings of the National Academy of Sciences, 108(51):20754–20759. [find](https://scholar.google.com/scholar?q=Catherine+Wacongne%2C+Etienne+Labyt%2C+Virginie+Van+Wassenhove%2C+Tristan+Bekinschtein%2C+Lionel+Naccache%2C+and+Stanislas+Dehaene%2E+2011%2E+Evidence+for+a+hierarchy+of+predictions+and+prediction+errors+in+human+c)
38. Shaonan Wang, Jiajun Zhang, Haiyan Wang, Nan Lin, and Chengqing Zong. 2020. Fine-grained neural decoding with distributed word representations. Information Sciences, 507:256–272. [find](https://scholar.google.com/scholar?q=Shaonan+Wang%2C+Jiajun+Zhang%2C+Haiyan+Wang%2C+Nan+Lin%2C+and+Chengqing+Zong%2E+2020%2E+Fine%2Dgrained+neural+decoding+with+distributed+word+representations%2E+Information+Sciences%2C+507%3A256%E2%80%93272%2E)
39. Shizun Wang, Songhua Liu, Zhenxiong Tan, and Xinchao Wang. 2024. Mindbridge: A cross-subject brain decoding framework. arXiv preprint arXiv:2404.07850. — [arXiv:2404.07850](https://arxiv.org/abs/2404.07850) [find](https://scholar.google.com/scholar?q=Shizun+Wang%2C+Songhua+Liu%2C+Zhenxiong+Tan%2C+and+Xinchao+Wang%2E+2024%2E+Mindbridge%3A+A+cross%2Dsubject+brain+decoding+framework%2E+arXiv+preprint+arXiv%3A2404%2E07850%2E+%E2%80%94+%5BarXiv%3A2404%2E07850%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2404%2E)
40. Roel M Willems, Stefan L Frank, Annabel D Nijhof, Peter Hagoort, and Antal Van den Bosch. 2016. Prediction during natural language comprehension. Cerebral Cortex, 26(6):2506–2516. [find](https://scholar.google.com/scholar?q=Roel+M+Willems%2C+Stefan+L+Frank%2C+Annabel+D+Nijhof%2C+Peter+Hagoort%2C+and+Antal+Van+den+Bosch%2E+2016%2E+Prediction+during+natural+language+comprehension%2E+Cerebral+Cortex%2C+26%286%29%3A2506%E2%80%932516%2E)
41. Yuxin Wu and Kaiming He. 2018. Group normalization. In Proceedings of the European Conference on Computer Vision. [find](https://scholar.google.com/scholar?q=Yuxin+Wu+and+Kaiming+He%2E+2018%2E+Group+normalization%2E+In+Proceedings+of+the+European+Conference+on+Computer+Vision%2E)
42. Nuwa Xi, Sendong Zhao, Haochun Wang, Chi Liu, Bing Qin, and Ting Liu. 2023. [Unicorn: Unified cognitive signal reconstruction bridging cognitive signals and human language](https://md.research.elamur.ai/free/en/papers/xi-2023-unicorn-unified-cognitive-signal-reconstruction/). In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics.
43. Runze Xia, Congchi Yin, and Piji Li. 2024. Decoding the echoes of vision from fmri: Memory disentangling for past semantic information. In Proceedings of the 2024 conference on empirical methods in natural language processing, pages 2040–2052. [find](https://scholar.google.com/scholar?q=Runze+Xia%2C+Congchi+Yin%2C+and+Piji+Li%2E+2024%2E+Decoding+the+echoes+of+vision+from+fmri%3A+Memory+disentangling+for+past+semantic+information%2E+In+Proceedings+of+the+2024+conference+on+empirical+methods+in+na)
44. Ziyi Ye, Qingyao Ai, Yiqun Liu, Min Zhang, Christina Lioma, and Tuukka Ruotsalo. 2023. Language generation from human brain activities. arXiv preprint arXiv:2311.09889. — [arXiv:2311.09889](https://arxiv.org/abs/2311.09889) [find](https://scholar.google.com/scholar?q=Ziyi+Ye%2C+Qingyao+Ai%2C+Yiqun+Liu%2C+Min+Zhang%2C+Christina+Lioma%2C+and+Tuukka+Ruotsalo%2E+2023%2E+Language+generation+from+human+brain+activities%2E+arXiv+preprint+arXiv%3A2311%2E09889%2E+%E2%80%94+%5BarXiv%3A2311%2E09889%5D%28https%3A%2F%2Far)
45. Congchi Yin, Qian Yu, Zhiwei Fang, Jie He, Changping Peng, Zhangang Lin, Jingping Shao, and Piji Li. 2023. Data contamination issues in brain-to-text decoding. arXiv preprint arXiv:2312.10987. — [arXiv:2312.10987](https://arxiv.org/abs/2312.10987) [find](https://scholar.google.com/scholar?q=Congchi+Yin%2C+Qian+Yu%2C+Zhiwei+Fang%2C+Jie+He%2C+Changping+Peng%2C+Zhangang+Lin%2C+Jingping+Shao%2C+and+Piji+Li%2E+2023%2E+Data+contamination+issues+in+brain%2Dto%2Dtext+decoding%2E+arXiv+preprint+arXiv%3A2312%2E10987%2E+%E2%80%94+%5BarXi)
46. Congchi Yin, Yongpeng Zhang, Xuyun Wen, and Piji Li. 2025. Improve language model and brain alignment via associative memory. In Findings of the Association for Computational Linguistics: ACL 2025, pages 986–999. [find](https://scholar.google.com/scholar?q=Congchi+Yin%2C+Yongpeng+Zhang%2C+Xuyun+Wen%2C+and+Piji+Li%2E+2025%2E+Improve+language+model+and+brain+alignment+via+associative+memory%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2025%2C+pa)
47. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019. Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q+Weinberger%2C+and+Yoav+Artzi%2E+2019%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+arXiv+preprint+arXiv%3A1904%2E09675%2E)
48. Xinpei Zhao, Jingyuan Sun, Shaonan Wang, Jing Ye, Xiaohan Zhang, and Chengqing Zong. 2024. MapGuide: A simple yet effective method to reconstruct continuous language from brain activities. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Xinpei+Zhao%2C+Jingyuan+Sun%2C+Shaonan+Wang%2C+Jing+Ye%2C+Xiaohan+Zhang%2C+and+Chengqing+Zong%2E+2024%2E+MapGuide%3A+A+simple+yet+effective+method+to+reconstruct+continuous+language+from+brain+activities%2E+In+Proceedi)
49. Shuxian Zou, Shaonan Wang, Jiajun Zhang, and Chengqing Zong. 2021. Towards brain-to-text generation: Neural decoding with pre-trained encoder-decoder models. In Proceedings of the NeurIPS Workshop on AI for Science. [find](https://scholar.google.com/scholar?q=Shuxian+Zou%2C+Shaonan+Wang%2C+Jiajun+Zhang%2C+and+Chengqing+Zong%2E+2021%2E+Towards+brain%2Dto%2Dtext+generation%3A+Neural+decoding+with+pre%2Dtrained+encoder%2Ddecoder+models%2E+In+Proceedings+of+the+NeurIPS+Workshop+on+)

*Updated 1 November 2026*