---
title: "Tonal Salience in Cognitive Decline: In-Context MCI Detection"
description: "The authors propose a \"tonal salience\" hypothesis: in Mandarin, pitch distinguishes word meaning on every syllable and… 21 references."
authors: ["Christopher Song", "Abdullah P. Rashed Ahmed"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)"
source: "https://aclanthology.org/2026.acl-srw.81/"
doi: "10.18653/v1/2026.acl-srw.81"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/song-2026-tonal-salience-cognitive-decline-context/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/song-2026-tonal-salience-cognitive-decline-context/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/46/) / Tonal Salience in Cognitive Decline: In-Context MCI Detection with Multimodal LLMs

# Tonal Salience in Cognitive Decline: In-Context MCI Detection with Multimodal LLMs

**Authors:** Christopher Song and Abdullah P. Rashed Ahmed · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-srw.81/) · [PDF](https://aclanthology.org/2026.acl-srw.81.pdf) · [DOI 10.18653/v1/2026.acl-srw.81](https://doi.org/10.18653/v1/2026.acl-srw.81) · [OpenAlex](https://openalex.org/W7166871528)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Studies on the bilingual TAUKADIAL benchmark keep finding that speech-based detection of mild cognitive impairment (MCI) works better for Chinese than for English, but nobody had explained why. The authors propose a "tonal salience" hypothesis: in Mandarin, pitch distinguishes word meaning on every syllable and demands fine motor-cognitive control, so cognitive decline should leave clearer acoustic traces than in non-tonal English. They tested this with Gemini 2.5 Pro, prompted without any fine-tuning, on TAUKADIAL-24 under three setups: zero-shot on raw audio, zero-shot on transcripts, and in-context learning (ICL) with audio examples. They then reran the audio setups after flattening F0 with PSOLA, which removes tone but keeps other acoustic cues. Pitch flattening hurt Chinese results clearly, while English results stayed flat or slightly improved. This points to lexical tone as the source of the cross-lingual gap. The authors argue that screening tools should take language typology into account: raw audio suits tonal languages, while text may be enough, and cheaper, for non-tonal ones.

## Key points
- **Data:** TAUKADIAL-24 (Interspeech 2024 challenge, hosted by DementiaBank) contains picture-description recordings.
  - 507 samples in total.
  - English: 246 samples (93 NC / 153 MCI).
  - Chinese: 261 samples (129 NC / 132 MCI).
- **Effect of pitch flattening on Chinese (UAR):** −4.78 in zero-shot and −5.92 in ICL.
- **Effect of pitch flattening on English (UAR):** +0.11 in zero-shot and +2.98 in ICL.
- **ICL vs. zero-shot:** ICL with randomly chosen exemplars outperformed zero-shot prompting, including earlier zero-shot AudioLLM work with Qwen2-Audio. The model was run at default temperature 1, and gemini-3.0-pro was also tried on the ICL audio setup.
- **Stated limitations:**
  - The pitch-flattening effect was shown on only one main model.
  - TAUKADIAL is the only multilingual MCI speech corpus available.
  - The task is framed as binary classification only.
  - The model's decisions are a black box.
  - Future work should test other languages such as Cantonese, Vietnamese, Thai and Japanese.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Brown University](https://md.research.elamur.ai/free/en/universities/brown-university/) — University, Providence, United States · 76 works · 25,952 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🩺 Medicine](https://md.research.elamur.ai/free/en/shelves/medicine/) · 241 works · [🩺 Physiology](https://md.research.elamur.ai/free/en/shelves/medicine/physiology/) · 29 works · [🩺 Psychiatry and Mental health](https://md.research.elamur.ai/free/en/shelves/medicine/psychiatry-and-mental-health/) · 9 works

🧭 Topics (1): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works

## Cite

Cite as: Christopher Song and Abdullah P. Rashed Ahmed. 2026. Tonal Salience in Cognitive Decline: In-Context MCI Detection with Multimodal LLMs. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{song2026tonal,
  title = {{Tonal Salience in Cognitive Decline: In-Context MCI Detection with Multimodal LLMs}},
  author = {Christopher Song and Abdullah P. Rashed Ahmed},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-srw.81},
  url = {https://doi.org/10.18653/v1/2026.acl-srw.81}
}
```

- [← previous ToMELP: A Theory-of-Mind Benchmark for Route-Controlled Persuasion under the Elaboration Likelihood Model](https://md.research.elamur.ai/free/en/papers/wang-2026-tomelp-theory-mind-benchmark-route/)
- [next → ToneSwiper: Facilitating Manual ToDI-annotation of Dutch Prosody](https://md.research.elamur.ai/free/en/papers/westera-2026-toneswiper-facilitating-manual-todi-annotation/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/46/)

## References

21 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. [2] Alzheimer’s Association. 2023. 2023 Alzheimer’s disease facts and figures. Alzheimer’s & Dementia, 19(4). [find](https://scholar.google.com/scholar?q=%5B2%5D+Alzheimer%E2%80%99s+Association%2E+2023%2E+2023+Alzheimer%E2%80%99s+disease+facts+and+figures%2E+Alzheimer%E2%80%99s+%26+Dementia%2C+19%284%29%2E)
2. [4] Tom B. Brown, Benjamin Mann, Nick Ryder, and 1 others. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). In NeurIPS.
3. [14] Alyssa M. Lanzi, Anna K. Saylor, Davida Fromm, Hui Liu, Brian MacWhinney, and Matthew Cohen. 2023. DementiaBank: Theoretical rationale, protocol, and illustrative analyses. American Journal of Speech-Language Pathology. [find](https://scholar.google.com/scholar?q=%5B14%5D+Alyssa+M%2E+Lanzi%2C+Anna+K%2E+Saylor%2C+Davida+Fromm%2C+Hui+Liu%2C+Brian+MacWhinney%2C+and+Matthew+Cohen%2E+2023%2E+DementiaBank%3A+Theoretical+rationale%2C+protocol%2C+and+illustrative+analyses%2E+American+Journal+of+Sp)
4. [15] Siyu Liang and Gina-Anne Levow. 2025. Tone in perspective: A computational typological analysis of tone function in ASR. In Proceedings of the 7th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, pages 82–92, Vienna, Austria. Association for Computational Linguist… [find](https://scholar.google.com/scholar?q=%5B15%5D+Siyu+Liang+and+Gina%2DAnne+Levow%2E+2025%2E+Tone+in+perspective%3A+A+computational+typological+analysis+of+tone+function+in+ASR%2E+In+Proceedings+of+the+7th+Workshop+on+Research+in+Computational+Linguistic)
5. [16] Junfeng Lu, Yuanning Li, Zehao Zhao, Yan Liu, Yanming Zhu, Ying Mao, Jinsong Wu, and Edward F Chang. 2023. Neural control of lexical tone production in human laryngeal motor cortex. Nature Communications, 14(1):6150. [find](https://scholar.google.com/scholar?q=%5B16%5D+Junfeng+Lu%2C+Yuanning+Li%2C+Zehao+Zhao%2C+Yan+Liu%2C+Yanming+Zhu%2C+Ying+Mao%2C+Jinsong+Wu%2C+and+Edward+F+Chang%2E+2023%2E+Neural+control+of+lexical+tone+production+in+human+laryngeal+motor+cortex%2E+Nature+Commun)
6. [28] H. Valbret, E. Moulines, and J. P. Tubach. 1992. Voice transformation using PSOLA technique. Speech Communication, 11(2):175–187. [find](https://scholar.google.com/scholar?q=%5B28%5D+H%2E+Valbret%2C+E%2E+Moulines%2C+and+J%2E+P%2E+Tubach%2E+1992%2E+Voice+transformation+using+PSOLA+technique%2E+Speech+Communication%2C+11%282%29%3A175%E2%80%93187%2E)
7. [17] S. Luz, S. De La Fuente Garcia, F. Haider, and 1 others. 2024. Connected speech-based cognitive assessment in Chinese and English. In Interspeech. [find](https://scholar.google.com/scholar?q=%5B17%5D+S%2E+Luz%2C+S%2E+De+La+Fuente+Garcia%2C+F%2E+Haider%2C+and+1+others%2E+2024%2E+Connected+speech%2Dbased+cognitive+assessment+in+Chinese+and+English%2E+In+Interspeech%2E)
8. [29] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. [Attention is all you need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). Advances in neural information processing systems, 30.
9. [18] M. Martinc and S. Pollak. 2020. Tackling the ADReSS challenge: a multimodal approach to the automated recognition of Alzheimer’s dementia. In Interspeech. [find](https://scholar.google.com/scholar?q=%5B18%5D+M%2E+Martinc+and+S%2E+Pollak%2E+2020%2E+Tackling+the+ADReSS+challenge%3A+a+multimodal+approach+to+the+automated+recognition+of+Alzheimer%E2%80%99s+dementia%2E+In+Interspeech%2E)
10. [30] W3Techs. 2026. Usage statistics of content languages for websites. [https://w3techs.com/](https://w3techs.com/) technologies/overview/content_language. Accessed: 8 May 2026. [↗](https://w3techs.com/)
11. [19] Francisco Martínez-Sánchez, Juan José García Meilán, Julia García-Sevilla, Juan Carro, and José M Arana. 2012. Temporal parameters of spontaneous speech in Alzheimer’s disease. International Journal of Speech-Language Pathology, 14(5):428–436. [find](https://scholar.google.com/scholar?q=%5B19%5D+Francisco+Mart%C3%ADnez%2DS%C3%A1nchez%2C+Juan+Jos%C3%A9+Garc%C3%ADa+Meil%C3%A1n%2C+Julia+Garc%C3%ADa%2DSevilla%2C+Juan+Carro%2C+and+Jos%C3%A9+M+Arana%2E+2012%2E+Temporal+parameters+of+spontaneous+speech+in+Alzheimer%E2%80%99s+disease%2E+International+Jour)
12. [31] An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, and 43 others. 2024. Qwen2 technical report. Preprint, arXi… [find](https://scholar.google.com/scholar?q=%5B31%5D+An+Yang%2C+Baosong+Yang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chang+Zhou%2C+Chengpeng+Li%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Guanting+Dong%2C+Haoran+Wei%2C+Huan+Lin%2C+Jialong+Tang%2C+Jialin+Wang%2C+Jian+Yang%2C)
13. [20] Milap A. Nowrangi, Paul B. Rosenberg, and Jeannie-Marie S. Leoutsakos. 2016. Subtle changes in daily functioning predict conversion from normal to mild cognitive impairment or dementia. International Psychogeriatrics, 28(12):2009–2018. [find](https://scholar.google.com/scholar?q=%5B20%5D+Milap+A%2E+Nowrangi%2C+Paul+B%2E+Rosenberg%2C+and+Jeannie%2DMarie+S%2E+Leoutsakos%2E+2016%2E+Subtle+changes+in+daily+functioning+predict+conversion+from+normal+to+mild+cognitive+impairment+or+dementia%2E+Internati)
14. [32] J. Yuan, Y. Bian, X. Cai, and 1 others. 2020. Disfluencies and fine-tuning pre-trained language models for detection of Alzheimer’s disease. In Interspeech. [find](https://scholar.google.com/scholar?q=%5B32%5D+J%2E+Yuan%2C+Y%2E+Bian%2C+X%2E+Cai%2C+and+1+others%2E+2020%2E+Disfluencies+and+fine%2Dtuning+pre%2Dtrained+language+models+for+detection+of+Alzheimer%E2%80%99s+disease%2E+In+Interspeech%2E)
15. [21] Kristin Qi, Jiali Cheng, Youxiang Zhu, Hadi Amiri, and Xiaohui Liang. 2025. Unveil multi-picture descriptions for multilingual mild cognitive impairment detection via contrastive learning. arXiv preprint arXiv:2505.17067. — [arXiv:2505.17067](https://arxiv.org/abs/2505.17067) [find](https://scholar.google.com/scholar?q=%5B21%5D+Kristin+Qi%2C+Jiali+Cheng%2C+Youxiang+Zhu%2C+Hadi+Amiri%2C+and+Xiaohui+Liang%2E+2025%2E+Unveil+multi%2Dpicture+descriptions+for+multilingual+mild+cognitive+impairment+detection+via+contrastive+learning%2E+arXiv+)
16. [22] Alec Radford, Jong Wook Kim, Tao Xu, and 1 others. 2023. [Robust speech recognition via large-scale weak supervision](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/). In ICML.
17. [23] Paul R Rosenbaum and Donald B Rubin. 1983. The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1):41–55. [find](https://scholar.google.com/scholar?q=%5B23%5D+Paul+R+Rosenbaum+and+Donald+B+Rubin%2E+1983%2E+The+central+role+of+the+propensity+score+in+observational+studies+for+causal+effects%2E+Biometrika%2C+70%281%29%3A41%E2%80%9355%2E)
18. [24] Mostafa Shahin, Beena Ahmed, and Julien Epps. 2025. Zero-shot cognitive impairment detection from speech using AudioLLM. In Interspeech. [find](https://scholar.google.com/scholar?q=%5B24%5D+Mostafa+Shahin%2C+Beena+Ahmed%2C+and+Julien+Epps%2E+2025%2E+Zero%2Dshot+cognitive+impairment+detection+from+speech+using+AudioLLM%2E+In+Interspeech%2E)
19. [25] Ravi Shankar, Anjali Bundele, and Amartya Mukhopadhyay. 2025. A systematic review of natural language processing techniques for early detection of cognitive impairment. Mayo Clinic Proceedings: Digital Health, 3(2):100205. [find](https://scholar.google.com/scholar?q=%5B25%5D+Ravi+Shankar%2C+Anjali+Bundele%2C+and+Amartya+Mukhopadhyay%2E+2025%2E+A+systematic+review+of+natural+language+processing+techniques+for+early+detection+of+cognitive+impairment%2E+Mayo+Clinic+Proceedings%3A+D)
20. [26] Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, Pouya Tafti, Léonard Hussenot, Pier Giuseppe Sessa, Aakanksha Chowdhery, Adam Roberts, Aditya Barua, Alex Botev, Alex Castro-Ros, Ambro… [find](https://scholar.google.com/scholar?q=%5B26%5D+Gemma+Team%2C+Thomas+Mesnard%2C+Cassidy+Hardin%2C+Robert+Dadashi%2C+Surya+Bhupatiraju%2C+Shreya+Pathak%2C+Laurent+Sifre%2C+Morgane+Rivi%C3%A8re%2C+Mihir+Sanjay+Kale%2C+Juliette+Love%2C+Pouya+Tafti%2C+L%C3%A9onard+Hussenot%2C+Pier)
21. [27] Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, and 1 others. 2024. Gemma 2: Improving open language models at a practical size. arXiv preprint arXiv:2408.00118. [find](https://scholar.google.com/scholar?q=%5B27%5D+Gemma+Team%2C+Morgane+Riviere%2C+Shreya+Pathak%2C+Pier+Giuseppe+Sessa%2C+Cassidy+Hardin%2C+Surya+Bhupatiraju%2C+L%C3%A9onard+Hussenot%2C+Thomas+Mesnard%2C+Bobak+Shahriari%2C+Alexandre+Ram%C3%A9%2C+and+1+others%2E+2024%2E+Gemma+2%3A)

*Updated 1 November 2026*