---
title: "CMTD — paper by Nguyen et al. (2026) — summary and ideas"
description: "The authors argue that current systems read emotion too superficially and miss the psychological factors behind it. 83 references."
authors: ["Minh-Tien Nguyen", "Huu-Loi Le", "Manh-Cuong Phan", "Hajime Hotta"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.41/"
doi: "10.18653/v1/2026.findings-acl.41"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/nguyen-2026-cmtd-cognitive-modeling-traits-distortions/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nguyen-2026-cmtd-cognitive-modeling-traits-distortions/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/) / CMTD: Cognitive Modeling with Traits and Distortions for Multimodal Emotion Recognition in Conversations

# CMTD: Cognitive Modeling with Traits and Distortions for Multimodal Emotion Recognition in Conversations

**Authors:** [Minh-Tien Nguyen](https://md.research.elamur.ai/free/en/authors/minh-tien-nguyen/), Huu-Loi Le, Manh-Cuong Phan and Hajime Hotta · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.41/) · [PDF](https://aclanthology.org/2026.findings-acl.41.pdf) · [DOI 10.18653/v1/2026.findings-acl.41](https://doi.org/10.18653/v1/2026.findings-acl.41) · [OpenAlex](https://openalex.org/W7166799942)

**Citations:** 2 citations (OpenAlex, 2026-10-14)

## Summary
CMTD tackles multimodal emotion recognition in conversations (MERC). The authors argue that current systems read emotion too superficially and miss the psychological factors behind it. Their framework is a zero-shot, prompt-based multi-agent pipeline. It pairs long-lasting personality traits (Big Five), used as a proxy for static emotional tendencies, with short-term cognitive distortions, which reflect dynamic emotional states. These psychological signals are combined with facial and vocal cues.

The pipeline has five agents:
- a trait agent;
- a distortion agent, which extends Diagnosis-of-Thought (DoT) by splitting it into several sub-agents instead of one long prompt;
- a visual agent that reads a single representative frame;
- a speech agent that verbalizes acoustic properties;
- a fusion agent that issues the final label.

Experiments on MELD and IEMOCAP indicate that this cognitive and multimodal combination improves MERC. Traits appear to counteract the negativity bias that distortion detection alone tends to introduce. The main drawbacks are higher latency and cost than the baselines. The work shows how ideas from cognitive behavioral therapy can make LLM-based emotion reasoning more robust.

## Key points
- **Distortion agent:** built on DoT, it runs four stages: subjectivity assessment, contrastive reasoning, schema analysis, and distortion detection. It produces labels such as Mind Reading, Should Statements, and Magnification.
- **Speech agent:** describes four acoustic features (frequency, energy, speaking rate, voice quality).
- **Visual agent:** uses a middle-frame strategy, which saves cost but loses temporal facial dynamics.
- **Evaluation:** zero-shot, with no parameter tuning, on MELD and IEMOCAP, using gpt-5-mini and gpt-4.1 as backbones. An ablation study is included.
- **Efficiency:** the reported cost/time table ranges up to about 25× runtime (≈4167 s, ≈1.64 USD) relative to the cheapest gpt-4.1 setting. The extracted text does not make clear which row is the full CMTD.
- **Limitations and availability:**
  - Both datasets are acted (TV sitcoms and scripted dialogues).
  - Agent collaboration is a simple single-judge fusion.
  - Code is released at github.com/Shaun-le/CMTD.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Hung Yen University of Technology and Education](https://md.research.elamur.ai/free/en/universities/hung-yen-university-of-technology-and-education/) — University, Hưng Yên, Vietnam · 2 works · 2 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 870 works

🧭 Topics (3): [😊 Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · 972 works · [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works · [🧒 Psycholinguistics & language acquisition](https://md.research.elamur.ai/free/en/topics/psycholinguistics/) · 102 works

## Cite

Cite as: Minh-Tien Nguyen, Huu-Loi Le, Manh-Cuong Phan and Hajime Hotta. 2026. CMTD: Cognitive Modeling with Traits and Distortions for Multimodal Emotion Recognition in Conversations. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{nguyen2026cmtd,
  title = {{CMTD: Cognitive Modeling with Traits and Distortions for Multimodal Emotion Recognition in Conversations}},
  author = {Minh-Tien Nguyen, Huu-Loi Le, Manh-Cuong Phan and Hajime Hotta},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.41},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.41}
}
```

- [← previous Closing the Modality Reasoning Gap for Speech Large Language Models](https://md.research.elamur.ai/free/en/papers/wang-2026-closing-modality-reasoning-gap-speech/)
- [next → COMMUNITYNOTES: A Dataset for Exploring the Helpfulness of Fact-Checking Explanations](https://md.research.elamur.ai/free/en/papers/xing-2026-communitynotes-dataset-exploring-helpfulness-fact/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/)

## References

83 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Wei Ai, Yuntao Shou, Tao Meng, and Keqin Li. 2024. Der-gcn: Dialog and event relation-aware graph convolutional neural network for multimodal dialog emotion recognition. IEEE Transactions on Neural Networks and Learning Systems, 36(3):4908–4921. [find](https://scholar.google.com/scholar?q=Wei+Ai%2C+Yuntao+Shou%2C+Tao+Meng%2C+and+Keqin+Li%2E+2024%2E+Der%2Dgcn%3A+Dialog+and+event+relation%2Daware+graph+convolutional+neural+network+for+multimodal+dialog+emotion+recognition%2E+IEEE+Transactions+on+Neural+Ne)
2. Wei Ai, Fuchen Zhang, Yuntao Shou, Tao Meng, Haowen Chen, and Keqin Li. 2025. Revisiting multimodal emotion recognition in conversation from the perspective of graph spectrum. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 11418–11426. [find](https://scholar.google.com/scholar?q=Wei+Ai%2C+Fuchen+Zhang%2C+Yuntao+Shou%2C+Tao+Meng%2C+Haowen+Chen%2C+and+Keqin+Li%2E+2025%2E+Revisiting+multimodal+emotion+recognition+in+conversation+from+the+perspective+of+graph+spectrum%2E+In+Proceedings+of+the+AA)
3. Mehmet Baris Akccay and Kayhan Oguz. 2020. Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers. Speech Communication, 116:56– 76. [find](https://scholar.google.com/scholar?q=Mehmet+Baris+Akccay+and+Kayhan+Oguz%2E+2020%2E+Speech+emotion+recognition%3A+Emotional+models%2C+databases%2C+features%2C+preprocessing+methods%2C+supporting+modalities%2C+and+classifiers%2E+Speech+Communication%2C+116%3A5)
4. Muhammad Wasiq Alani, Jae-Hwan Kim, Hyoung-Gook Kim, and Jae-Yeol Woo. 2023. Hybrid multi-attention network for audio–visual emotion recognition through multimodal feature fusion. Applied Sciences, 13(7):4169. [find](https://scholar.google.com/scholar?q=Muhammad+Wasiq+Alani%2C+Jae%2DHwan+Kim%2C+Hyoung%2DGook+Kim%2C+and+Jae%2DYeol+Woo%2E+2023%2E+Hybrid+multi%2Dattention+network+for+audio%E2%80%93visual+emotion+recognition+through+multimodal+feature+fusion%2E+Applied+Sciences%2C+13)
5. Rawan AlMakinah, Andrea Norcini-Pala, Lindsey Disney, and M Abdullah Canbaz. 2024. Enhancing mental health support through human-ai collaboration: Toward secure and empathetic ai-enabled chatbots. arXiv preprint arXiv:2410.02783. — [arXiv:2410.02783](https://arxiv.org/abs/2410.02783) [find](https://scholar.google.com/scholar?q=Rawan+AlMakinah%2C+Andrea+Norcini%2DPala%2C+Lindsey+Disney%2C+and+M+Abdullah+Canbaz%2E+2024%2E+Enhancing+mental+health+support+through+human%2Dai+collaboration%3A+Toward+secure+and+empathetic+ai%2Denabled+chatbots%2E+arX)
6. Urszula Barańczuk. 2019. The five factor model of personality and emotion regulation: A meta-analysis. Personality and Individual Differences, 139:217–227. [find](https://scholar.google.com/scholar?q=Urszula+Baran%CC%81czuk%2E+2019%2E+The+five+factor+model+of+personality+and+emotion+regulation%3A+A+meta%2Danalysis%2E+Personality+and+Individual+Differences%2C+139%3A217%E2%80%93227%2E)
7. Judith S Beck. 2020. Cognitive behavior therapy: Basics and beyond. Guilford Publications. [find](https://scholar.google.com/scholar?q=Judith+S+Beck%2E+2020%2E+Cognitive+behavior+therapy%3A+Basics+and+beyond%2E+Guilford+Publications%2E)
8. Kishor Bhangale and Mohanaprasad Kothandaraman. 2023. Speech emotion recognition based on multiple acoustic features and deep convolutional neural network. Electronics, 12(4):839. [find](https://scholar.google.com/scholar?q=Kishor+Bhangale+and+Mohanaprasad+Kothandaraman%2E+2023%2E+Speech+emotion+recognition+based+on+multiple+acoustic+features+and+deep+convolutional+neural+network%2E+Electronics%2C+12%284%29%3A839%2E)
9. Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jeannette N Chang, Sungbok Lee, and Shrikanth S Narayanan. 2008. Iemocap: Interactive emotional dyadic motion capture database. Language resources and evaluation, 42:335–359. [find](https://scholar.google.com/scholar?q=Carlos+Busso%2C+Murtaza+Bulut%2C+Chi%2DChun+Lee%2C+Abe+Kazemzadeh%2C+Emily+Mower%2C+Samuel+Kim%2C+Jeannette+N+Chang%2C+Sungbok+Lee%2C+and+Shrikanth+S+Narayanan%2E+2008%2E+Iemocap%3A+Interactive+emotional+dyadic+motion+captur)
10. Zhiyu Chen, Yujie Lu, and William Wang. 2023. Empowering psychotherapy with large language models: Cognitive distortion detection through diagnosis of thought prompting. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 4295–4304. [find](https://scholar.google.com/scholar?q=Zhiyu+Chen%2C+Yujie+Lu%2C+and+William+Wang%2E+2023%2E+Empowering+psychotherapy+with+large+language+models%3A+Cognitive+distortion+detection+through+diagnosis+of+thought+prompting%2E+In+Findings+of+the+Association)
11. Zebang Cheng, Zhi-Qi Cheng, Jun-Yan He, Kai Wang, Yuxiang Lin, Zheng Lian, Xiaojiang Peng, and Alexander Hauptmann. 2024. Emotion-llama: Multimodal emotion recognition and reasoning with instruction tuning. Advances in Neural Information Processing Systems, 37:110805–110853. [find](https://scholar.google.com/scholar?q=Zebang+Cheng%2C+Zhi%2DQi+Cheng%2C+Jun%2DYan+He%2C+Kai+Wang%2C+Yuxiang+Lin%2C+Zheng+Lian%2C+Xiaojiang+Peng%2C+and+Alexander+Hauptmann%2E+2024%2E+Emotion%2Dllama%3A+Multimodal+emotion+recognition+and+reasoning+with+instruction+t)
12. Jaher Hassan Chowdhury, Sheela Ramanna, and Ketan Kotecha. 2025. Speech emotion recognition with lightweight deep neural ensemble model using hand-crafted features. Scientific Reports, 15:11824. [find](https://scholar.google.com/scholar?q=Jaher+Hassan+Chowdhury%2C+Sheela+Ramanna%2C+and+Ketan+Kotecha%2E+2025%2E+Speech+emotion+recognition+with+lightweight+deep+neural+ensemble+model+using+hand%2Dcrafted+features%2E+Scientific+Reports%2C+15%3A11824%2E)
13. Vishal Chudasama, Purbayan Kar, Ashish Gudmalwar, Nirmesh Shah, Pankaj Wasnik, and Naoyuki Onoe. 2022. M2fnet: Multi-modal fusion network for emotion recognition in conversation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4652–4661. [find](https://scholar.google.com/scholar?q=Vishal+Chudasama%2C+Purbayan+Kar%2C+Ashish+Gudmalwar%2C+Nirmesh+Shah%2C+Pankaj+Wasnik%2C+and+Naoyuki+Onoe%2E+2022%2E+M2fnet%3A+Multi%2Dmodal+fusion+network+for+emotion+recognition+in+conversation%2E+In+Proceedings+of+the)
14. Joshua E Curtiss, Daniella S Levine, Ilana Ander, and Amanda W Baker. 2021. Cognitive-behavioral treatments for anxiety and stress-related disorders. Focus, 19(2):184–189. [find](https://scholar.google.com/scholar?q=Joshua+E+Curtiss%2C+Daniella+S+Levine%2C+Ilana+Ander%2C+and+Amanda+W+Baker%2E+2021%2E+Cognitive%2Dbehavioral+treatments+for+anxiety+and+stress%2Drelated+disorders%2E+Focus%2C+19%282%29%3A184%E2%80%93189%2E)
15. Soumya Dutta and Sriram Ganapathy. 2025. Llm supervised pre-training for multimodal emotion recognition in conversations. In ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1–5. IEEE. [find](https://scholar.google.com/scholar?q=Soumya+Dutta+and+Sriram+Ganapathy%2E+2025%2E+Llm+supervised+pre%2Dtraining+for+multimodal+emotion+recognition+in+conversations%2E+In+ICASSP+2025%2D2025+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Sig)
16. Paul Ekman and Wallace V. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. [find](https://scholar.google.com/scholar?q=Paul+Ekman+and+Wallace+V%2E+Friesen%2E+1978%2E+Facial+Action+Coding+System%3A+A+Technique+for+the+Measurement+of+Facial+Movement%2E)
17. Consulting Psychologists Press, Palo Alto, CA. 2016. Zara the supergirl: An empathetic personality recognition system. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pages 87–91. [find](https://scholar.google.com/scholar?q=Consulting+Psychologists+Press%2C+Palo+Alto%2C+CA%2E+2016%2E+Zara+the+supergirl%3A+An+empathetic+personality+recognition+system%2E+In+Proceedings+of+the+2016+Conference+of+the+North+American+Chapter+of+the+Associ)
18. Thomas Goetz, Eva S Becker, Madeleine Bieg, Melanie M Keller, Anne C Frenzel, and Nathan C Hall. 2015. The glass half empty: How emotional exhaustion affects the state-trait discrepancy in self-reports of teaching emotions. PloS one, 10(9):e0137441. [find](https://scholar.google.com/scholar?q=Thomas+Goetz%2C+Eva+S+Becker%2C+Madeleine+Bieg%2C+Melanie+M+Keller%2C+Anne+C+Frenzel%2C+and+Nathan+C+Hall%2E+2015%2E+The+glass+half+empty%3A+How+emotional+exhaustion+affects+the+state%2Dtrait+discrepancy+in+self%2Dreport)
19. Lewis R Goldberg. 1992. The development of markers for the big-five factor structure. Psychological assessment, 4(1):26. [find](https://scholar.google.com/scholar?q=Lewis+R+Goldberg%2E+1992%2E+The+development+of+markers+for+the+big%2Dfive+factor+structure%2E+Psychological+assessment%2C+4%281%29%3A26%2E)
20. Russell Harris. 2006. Embracing your demons: An overview of acceptance and commitment therapy. Psychotherapy in Australia, 12(4):70–6. [find](https://scholar.google.com/scholar?q=Russell+Harris%2E+2006%2E+Embracing+your+demons%3A+An+overview+of+acceptance+and+commitment+therapy%2E+Psychotherapy+in+Australia%2C+12%284%29%3A70%E2%80%936%2E)
21. Steven C Hayes, Kirk D Strosahl, and Kelly G Wilson. 2011. Acceptance and commitment therapy: The process and practice of mindful change. Guilford press. [find](https://scholar.google.com/scholar?q=Steven+C+Hayes%2C+Kirk+D+Strosahl%2C+and+Kelly+G+Wilson%2E+2011%2E+Acceptance+and+commitment+therapy%3A+The+process+and+practice+of+mindful+change%2E+Guilford+press%2E)
22. Mahshid Hosseini and Cornelia Caragea. 2021. It takes two to empathize: One to seek and one to provide. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 13018–13026. [find](https://scholar.google.com/scholar?q=Mahshid+Hosseini+and+Cornelia+Caragea%2E+2021%2E+It+takes+two+to+empathize%3A+One+to+seek+and+one+to+provide%2E+In+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2C+volume+35%2C+pages+13018%E2%80%9313026%2E)
23. Hajime Hotta, Huu-Loi Le, Manh-Cuong Phan, and Minh-Tien Nguyen. 2025. Metamo: Empowering large language models with psychological distortion detection for cognition-aware coaching. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, page… [find](https://scholar.google.com/scholar?q=Hajime+Hotta%2C+Huu%2DLoi+Le%2C+Manh%2DCuong+Phan%2C+and+Minh%2DTien+Nguyen%2E+2025%2E+Metamo%3A+Empowering+large+language+models+with+psychological+distortion+detection+for+cognition%2Daware+coaching%2E+In+Proceedings+of+)
24. Junwei Feng and Xueyan Fan. 2025. Cross-modal context fusion and adaptive graph convolutional network for multimodal conversational emotion recognition. arXiv preprint arXiv:2501.15063. — [arXiv:2501.15063](https://arxiv.org/abs/2501.15063) [find](https://scholar.google.com/scholar?q=Junwei+Feng+and+Xueyan+Fan%2E+2025%2E+Cross%2Dmodal+context+fusion+and+adaptive+graph+convolutional+network+for+multimodal+conversational+emotion+recognition%2E+arXiv+preprint+arXiv%3A2501%2E15063%2E+%E2%80%94+%5BarXiv%3A2501%2E)
25. Jian Huang, Yuanyuan Pu, Dongming Zhou, Jinde Cao, Jinjing Gu, Zhengpeng Zhao, and Dan Xu. 2024a. Dynamic hypergraph convolutional network for multimodal sentiment analysis. Neurocomputing, 565:126992. [find](https://scholar.google.com/scholar?q=Jian+Huang%2C+Yuanyuan+Pu%2C+Dongming+Zhou%2C+Jinde+Cao%2C+Jinjing+Gu%2C+Zhengpeng+Zhao%2C+and+Dan+Xu%2E+2024a%2E+Dynamic+hypergraph+convolutional+network+for+multimodal+sentiment+analysis%2E+Neurocomputing%2C+565%3A126992)
26. Julian D Ford, Damion J Grasso, Joan Levine, and Howard Tennen. 2018. Emotion regulation enhancement of cognitive behavior therapy for college student problem drinkers: A pilot randomized controlled trial. Journal of Child & Adolescent Substance Abuse, 27(1):47–58. [find](https://scholar.google.com/scholar?q=Julian+D+Ford%2C+Damion+J+Grasso%2C+Joan+Levine%2C+and+Howard+Tennen%2E+2018%2E+Emotion+regulation+enhancement+of+cognitive+behavior+therapy+for+college+student+problem+drinkers%3A+A+pilot+randomized+controlled+t)
27. Zilong Huang, Man-Wai Mak, and Kong Aik Lee. 2024b. Mm-nodeformer: Node transformer multimodal fusion for emotion recognition in conversation. In Proceedings of the Annual Conference of the International Speech Communication Association, IN-TERSPEECH, pages 4069–4073. [find](https://scholar.google.com/scholar?q=Zilong+Huang%2C+Man%2DWai+Mak%2C+and+Kong+Aik+Lee%2E+2024b%2E+Mm%2Dnodeformer%3A+Node+transformer+multimodal+fusion+for+emotion+recognition+in+conversation%2E+In+Proceedings+of+the+Annual+Conference+of+the+Internatio)
28. Yumeng Fu, Junjie Wu, Zhongjie Wang, Meishan Zhang, Lili Shan, Yulin Wu, and Bingquan Liu. 2025a. Laerc-s: Improving llm-based emotion recognition in conversation with speaker characteristics. In Proceedings of the 31st International Conference on Computational Linguistics, pages 6748–6761. [find](https://scholar.google.com/scholar?q=Yumeng+Fu%2C+Junjie+Wu%2C+Zhongjie+Wang%2C+Meishan+Zhang%2C+Lili+Shan%2C+Yulin+Wu%2C+and+Bingquan+Liu%2E+2025a%2E+Laerc%2Ds%3A+Improving+llm%2Dbased+emotion+recognition+in+conversation+with+speaker+characteristics%2E+In+Proc)
29. K. N. Javaras, M.J. Zonnevylle-Bender, J. Park, T. Uher, G. Turecki, J. Ferreira, C. M. Bulik, E. Koffel, M. Burmeister, and G. Turecki. 2012. Conscientiousness predicts greater recovery from negative emotion. Personality and Individual Differences, 52(5):587– 592. [find](https://scholar.google.com/scholar?q=K%2E+N%2E+Javaras%2C+M%2EJ%2E+Zonnevylle%2DBender%2C+J%2E+Park%2C+T%2E+Uher%2C+G%2E+Turecki%2C+J%2E+Ferreira%2C+C%2E+M%2E+Bulik%2C+E%2E+Koffel%2C+M%2E+Burmeister%2C+and+G%2E+Turecki%2E+2012%2E+Conscientiousness+predicts+greater+recovery+from+negative)
30. Yumeng Fu, Junjie Wu, Zhongjie Wang, Meishan Zhang, Yulin Wu, and Bingquan Liu. 2025b. Bemerc: Behavior-aware mllm-based framework for multimodal emotion recognition in conversation. arXiv preprint arXiv:2503.23990. — [arXiv:2503.23990](https://arxiv.org/abs/2503.23990) [find](https://scholar.google.com/scholar?q=Yumeng+Fu%2C+Junjie+Wu%2C+Zhongjie+Wang%2C+Meishan+Zhang%2C+Yulin+Wu%2C+and+Bingquan+Liu%2E+2025b%2E+Bemerc%3A+Behavior%2Daware+mllm%2Dbased+framework+for+multimodal+emotion+recognition+in+conversation%2E+arXiv+preprint+ar)
31. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+Lucile+Saulnier%2C+L%C3%A9lio+Renard+Lav)
32. Pascale Fung, Anik Dey, Farhad Bin Siddique, Ruixi Lin, Yang Yang, Yan Wan, and Ho Yin Ricky Chan. [find](https://scholar.google.com/scholar?q=Pascale+Fung%2C+Anik+Dey%2C+Farhad+Bin+Siddique%2C+Ruixi+Lin%2C+Yang+Yang%2C+Yan+Wan%2C+and+Ho+Yin+Ricky+Chan%2E)
33. Juraj Kacur et al. 2021. On the speech properties and feature extraction methods in speech emotion recognition. Sensors, 21(5):1888. [find](https://scholar.google.com/scholar?q=Juraj+Kacur+et+al%2E+2021%2E+On+the+speech+properties+and+feature+extraction+methods+in+speech+emotion+recognition%2E+Sensors%2C+21%285%29%3A1888%2E)
34. Benjamin B. Lahey. 2009a. Public health significance of neuroticism. American Psychologist, 64(4):241–256. [find](https://scholar.google.com/scholar?q=Benjamin+B%2E+Lahey%2E+2009a%2E+Public+health+significance+of+neuroticism%2E+American+Psychologist%2C+64%284%29%3A241%E2%80%93256%2E)
35. Benjamin B. Lahey. 2009b. Public health significance of neuroticism. American Psychologist, 64(4):241– 256. [find](https://scholar.google.com/scholar?q=Benjamin+B%2E+Lahey%2E+2009b%2E+Public+health+significance+of+neuroticism%2E+American+Psychologist%2C+64%284%29%3A241%E2%80%93+256%2E)
36. Tin Lai, Yukun Shi, Zicong Du, Jiajie Wu, Ken Fu, Yichao Dou, and Ziqi Wang. 2023. Psy-llm: Scaling up global mental health psychological services with ai-based large language models. arXiv preprint arXiv:2307.11991. — [arXiv:2307.11991](https://arxiv.org/abs/2307.11991) [find](https://scholar.google.com/scholar?q=Tin+Lai%2C+Yukun+Shi%2C+Zicong+Du%2C+Jiajie+Wu%2C+Ken+Fu%2C+Yichao+Dou%2C+and+Ziqi+Wang%2E+2023%2E+Psy%2Dllm%3A+Scaling+up+global+mental+health+psychological+services+with+ai%2Dbased+large+language+models%2E+arXiv+preprint+a)
37. Joosung Lee and Wooin Lee. 2022. Compm: Context modeling with speaker’s pre-trained memory tracking for emotion recognition in conversation. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 5669–5… [find](https://scholar.google.com/scholar?q=Joosung+Lee+and+Wooin+Lee%2E+2022%2E+Compm%3A+Context+modeling+with+speaker%E2%80%99s+pre%2Dtrained+memory+tracking+for+emotion+recognition+in+conversation%2E+In+Proceedings+of+the+2022+Conference+of+the+North+American)
38. Shanglin Lei, Guanting Dong, Xiaoping Wang, Keheng Wang, and Sirui Wang. 2023. Instructerc: Reforming emotion recognition in conversation with a retrieval multi-task llms framework. arXiv preprint arXiv:2309.11911. — [arXiv:2309.11911](https://arxiv.org/abs/2309.11911) [find](https://scholar.google.com/scholar?q=Shanglin+Lei%2C+Guanting+Dong%2C+Xiaoping+Wang%2C+Keheng+Wang%2C+and+Sirui+Wang%2E+2023%2E+Instructerc%3A+Reforming+emotion+recognition+in+conversation+with+a+retrieval+multi%2Dtask+llms+framework%2E+arXiv+preprint+arX)
39. Qintong Li, Hongshen Chen, Zhaochun Ren, Pengjie Ren, Zhaopeng Tu, and Zhumin Chen. 2020. Empdg: Multi-resolution interactive empathetic dialogue generation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 4454–4466. [find](https://scholar.google.com/scholar?q=Qintong+Li%2C+Hongshen+Chen%2C+Zhaochun+Ren%2C+Pengjie+Ren%2C+Zhaopeng+Tu%2C+and+Zhumin+Chen%2E+2020%2E+Empdg%3A+Multi%2Dresolution+interactive+empathetic+dialogue+generation%2E+In+Proceedings+of+the+28th+International+C)
40. Qintong Li, Piji Li, Zhaochun Ren, Pengjie Ren, and Zhumin Chen. 2022. Knowledge bridging for empathetic dialogue generation. In Proceedings of the AAAI conference on artificial intelligence, volume 36, pages 10993–11001. [find](https://scholar.google.com/scholar?q=Qintong+Li%2C+Piji+Li%2C+Zhaochun+Ren%2C+Pengjie+Ren%2C+and+Zhumin+Chen%2E+2022%2E+Knowledge+bridging+for+empathetic+dialogue+generation%2E+In+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2C+volume+3)
41. Zheng Li, Sujian Li, Dawei Zhu, Qilong Ma, and Weimin Xiong. 2025. Eerpd: Leveraging emotion and emotion regulation for improving personality detection. In Proceedings of the 31st International Conference on Computational Linguistics, pages 7721– 7734. [find](https://scholar.google.com/scholar?q=Zheng+Li%2C+Sujian+Li%2C+Dawei+Zhu%2C+Qilong+Ma%2C+and+Weimin+Xiong%2E+2025%2E+Eerpd%3A+Leveraging+emotion+and+emotion+regulation+for+improving+personality+detection%2E+In+Proceedings+of+the+31st+International+Confer)
42. Sehee Lim, Yejin Kim, Chi-Hyun Choi, Jy-yong Sohn, and Byung-Hoon Kim. 2024. Erd: A framework for improving llm reasoning for cognitive distortion classification. arXiv preprint arXiv:2403.14255. [find](https://scholar.google.com/scholar?q=Sehee+Lim%2C+Yejin+Kim%2C+Chi%2DHyun+Choi%2C+Jy%2Dyong+Sohn%2C+and+Byung%2DHoon+Kim%2E+2024%2E+Erd%3A+A+framework+for+improving+llm+reasoning+for+cognitive+distortion+classification%2E+arXiv+preprint+arXiv%3A2403%2E14255%2E)
43. Zhaojiang Lin, Andrea Madotto, Jamin Shin, Peng Xu, and Pascale Fung. 2019a. [Moel: Mixture of empathetic listeners](https://md.research.elamur.ai/free/en/papers/lin-2019-moel-mixture-empathetic-listeners/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), page…
44. Zhaojiang Lin, Peng Xu, Genta Indra Winata, Farhad Bin Siddique, Zihan Liu, Jamin Shin, and Pascale Fung. 2019b. Caire: An empathetic neural chatbot. arXiv preprint arXiv:1907.12108. — [arXiv:1907.12108](https://arxiv.org/abs/1907.12108) [find](https://scholar.google.com/scholar?q=Zhaojiang+Lin%2C+Peng+Xu%2C+Genta+Indra+Winata%2C+Farhad+Bin+Siddique%2C+Zihan+Liu%2C+Jamin+Shin%2C+and+Pascale+Fung%2E+2019b%2E+Caire%3A+An+empathetic+neural+chatbot%2E+arXiv+preprint+arXiv%3A1907%2E12108%2E+%E2%80%94+%5BarXiv%3A1907%2E121)
45. Zhiwei Liu, Kailai Yang, Qianqian Xie, Tianlin Zhang, and Sophia Ananiadou. 2024. Emollms: A series of emotional large language models and annotation tools for comprehensive affective analysis. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 5487– 5496. [find](https://scholar.google.com/scholar?q=Zhiwei+Liu%2C+Kailai+Yang%2C+Qianqian+Xie%2C+Tianlin+Zhang%2C+and+Sophia+Ananiadou%2E+2024%2E+Emollms%3A+A+series+of+emotional+large+language+models+and+annotation+tools+for+comprehensive+affective+analysis%2E+In+Pro)
46. Hui Ma, Jian Wang, Hongfei Lin, Bo Zhang, Yijia Zhang, and Bo Xu. 2023. A transformer-based model with self-distillation for multimodal emotion recognition in conversations. IEEE Transactions on Multimedia, 26:776–788. [find](https://scholar.google.com/scholar?q=Hui+Ma%2C+Jian+Wang%2C+Hongfei+Lin%2C+Bo+Zhang%2C+Yijia+Zhang%2C+and+Bo+Xu%2E+2023%2E+A+transformer%2Dbased+model+with+self%2Ddistillation+for+multimodal+emotion+recognition+in+conversations%2E+IEEE+Transactions+on+Multi)
47. Yukun Ma, Khanh Linh Nguyen, Frank Z Xing, and Erik Cambria. 2020. A survey on empathetic dialogue systems. Information Fusion, 64:50–70. [find](https://scholar.google.com/scholar?q=Yukun+Ma%2C+Khanh+Linh+Nguyen%2C+Frank+Z+Xing%2C+and+Erik+Cambria%2E+2020%2E+A+survey+on+empathetic+dialogue+systems%2E+Information+Fusion%2C+64%3A50%E2%80%9370%2E)
48. Anh-Tuan Mai, Hai-Dang Kieu, Duc-Trong Le, et al. 2023. Conversation understanding using relational temporal graph neural networks with auxiliary cross-modality interaction. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 15154–15167. [find](https://scholar.google.com/scholar?q=Anh%2DTuan+Mai%2C+Hai%2DDang+Kieu%2C+Duc%2DTrong+Le%2C+et+al%2E+2023%2E+Conversation+understanding+using+relational+temporal+graph+neural+networks+with+auxiliary+cross%2Dmodality+interaction%2E+In+Proceedings+of+the+2023)
49. Navonil Majumder, Soujanya Poria, Devamanyu Hazarika, Rada Mihalcea, Alexander Gelbukh, and Erik Cambria. 2019. Dialoguernn: An attentive rnn for emotion detection in conversations. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pages 6818–6825. [find](https://scholar.google.com/scholar?q=Navonil+Majumder%2C+Soujanya+Poria%2C+Devamanyu+Hazarika%2C+Rada+Mihalcea%2C+Alexander+Gelbukh%2C+and+Erik+Cambria%2E+2019%2E+Dialoguernn%3A+An+attentive+rnn+for+emotion+detection+in+conversations%2E+In+Proceedings+of+)
50. Robert McCrae and Paul Costa. 1997. Conceptions and Correlates of Openness to Experience, pages 825–847. [find](https://scholar.google.com/scholar?q=Robert+McCrae+and+Paul+Costa%2E+1997%2E+Conceptions+and+Correlates+of+Openness+to+Experience%2C+pages+825%E2%80%93847%2E)
51. Mikhail Mozikov, Nikita Severin, Maria Glushanina, Mikhail Baklashkin, Andrey Savchenko, and Ilya Makarov. 2024. Insideout: Unifying emotional llms to foster empathy. In ECAI 2024, pages 4499–4502. IOS Press. [find](https://scholar.google.com/scholar?q=Mikhail+Mozikov%2C+Nikita+Severin%2C+Maria+Glushanina%2C+Mikhail+Baklashkin%2C+Andrey+Savchenko%2C+and+Ilya+Makarov%2E+2024%2E+Insideout%3A+Unifying+emotional+llms+to+foster+empathy%2E+In+ECAI+2024%2C+pages+4499%E2%80%934502%2E+IO)
52. Shrikanth S. Narayanan et al. 2009. Analysis of pausing behavior in spontaneous speech using real-time mri. Journal of the Acoustical Society of America. [find](https://scholar.google.com/scholar?q=Shrikanth+S%2E+Narayanan+et+al%2E+2009%2E+Analysis+of+pausing+behavior+in+spontaneous+speech+using+real%2Dtime+mri%2E+Journal+of+the+Acoustical+Society+of+America%2E)
53. Soujanya Poria, Erik Cambria, Devamanyu Hazarika, Navonil Majumder, Amir Zadeh, and Louis-Philippe Morency. 2017. [Context-dependent sentiment analysis in user-generated videos](https://md.research.elamur.ai/free/en/papers/poria-2017-context-dependent-sentiment-analysis-user/). In Proceedings of the 55th annual meeting of the association for computational linguistics (volume 1: Long papers), pages 8…
54. Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik, Erik Cambria, and Rada Mihalcea. 2019. [Meld: A multimodal multi-party dataset for emotion recognition in conversations](https://md.research.elamur.ai/free/en/papers/poria-2018-meld-multimodal-multi-party-dataset/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 527–536.
55. Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng… [find](https://scholar.google.com/scholar?q=Qwen%2C+%3A%2C+An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+)
56. Geng Tu, Tian Xie, Bin Liang, Hongpeng Wang, and Ruifeng Xu. 2024. Adaptive graph learning for multimodal conversational emotion detection. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19089–19097. [find](https://scholar.google.com/scholar?q=Geng+Tu%2C+Tian+Xie%2C+Bin+Liang%2C+Hongpeng+Wang%2C+and+Ruifeng+Xu%2E+2024%2E+Adaptive+graph+learning+for+multimodal+conversational+emotion+detection%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intellig)
57. Erika L Rosenberg. 1998. Levels of analysis and the organization of affect. Review of general psychology, 2(3):247–270. [find](https://scholar.google.com/scholar?q=Erika+L+Rosenberg%2E+1998%2E+Levels+of+analysis+and+the+organization+of+affect%2E+Review+of+general+psychology%2C+2%283%29%3A247%E2%80%93270%2E)
58. Ruiyi Wang, Stephanie Milani, Jamie Chiu, Jiayin Zhi, Shaun Eack, Travis Labrum, Samuel Murphy, Nev Jones, Kate Hardy, Hong Shen, et al. 2024a. Patient-: Using large language models to simulate patients for training mental health professionals. In Proceedings of the 2024 Conference on Empirical Meth… [find](https://scholar.google.com/scholar?q=Ruiyi+Wang%2C+Stephanie+Milani%2C+Jamie+Chiu%2C+Jiayin+Zhi%2C+Shaun+Eack%2C+Travis+Labrum%2C+Samuel+Murphy%2C+Nev+Jones%2C+Kate+Hardy%2C+Hong+Shen%2C+et+al%2E+2024a%2E+Patient%2D%3A+Using+large+language+models+to+simulate+patien)
59. Cuong Tran Van, Thanh VT Tran, Van Nguyen, and Truong Son Hy. 2025. Effective context modeling framework for emotion recognition in conversations. In ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1–5. IEEE. [find](https://scholar.google.com/scholar?q=Cuong+Tran+Van%2C+Thanh+VT+Tran%2C+Van+Nguyen%2C+and+Truong+Son+Hy%2E+2025%2E+Effective+context+modeling+framework+for+emotion+recognition+in+conversations%2E+In+ICASSP+2025%2D2025+IEEE+International+Conference+on+)
60. Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE transactions on neural networks, 20(1):61–80. [find](https://scholar.google.com/scholar?q=Franco+Scarselli%2C+Marco+Gori%2C+Ah+Chung+Tsoi%2C+Markus+Hagenbuchner%2C+and+Gabriele+Monfardini%2E+2008%2E+The+graph+neural+network+model%2E+IEEE+transactions+on+neural+networks%2C+20%281%29%3A61%E2%80%9380%2E)
61. Björn Schuller et al. 2018. Speech emotion recognition: Two decades in a nutshell, benchmarks, and ongoing trends. Communications of the ACM. [find](https://scholar.google.com/scholar?q=Bj%C3%B6rn+Schuller+et+al%2E+2018%2E+Speech+emotion+recognition%3A+Two+decades+in+a+nutshell%2C+benchmarks%2C+and+ongoing+trends%2E+Communications+of+the+ACM%2E)
62. Jocelyn Shen, Daniella DiPaola, Safinah Ali, Maarten Sap, Hae Won Park, Cynthia Breazeal, et al. 2024a. Empathy toward artificial intelligence versus human experiences and the role of transparency in mental health and social support chatbot design: Comparative study. JMIR Mental Health, 11(1):e62679… [find](https://scholar.google.com/scholar?q=Jocelyn+Shen%2C+Daniella+DiPaola%2C+Safinah+Ali%2C+Maarten+Sap%2C+Hae+Won+Park%2C+Cynthia+Breazeal%2C+et+al%2E+2024a%2E+Empathy+toward+artificial+intelligence+versus+human+experiences+and+the+role+of+transparency+in+)
63. Jocelyn Shen, Joel Mire, Hae Won Park, Cynthia Breazeal, and Maarten Sap. 2024b. Heart-felt narratives: Tracing empathy and narrative style in personal stories with llms. arXiv preprint arXiv:2405.17633. [find](https://scholar.google.com/scholar?q=Jocelyn+Shen%2C+Joel+Mire%2C+Hae+Won+Park%2C+Cynthia+Breazeal%2C+and+Maarten+Sap%2E+2024b%2E+Heart%2Dfelt+narratives%3A+Tracing+empathy+and+narrative+style+in+personal+stories+with+llms%2E+arXiv+preprint+arXiv%3A2405%2E176)
64. Jocelyn Shen, Maarten Sap, Pedro Colon-Hernandez, Hae Park, and Cynthia Breazeal. 2023. Modeling empathic similarity in personal narratives. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 6237–6252. [find](https://scholar.google.com/scholar?q=Jocelyn+Shen%2C+Maarten+Sap%2C+Pedro+Colon%2DHernandez%2C+Hae+Park%2C+and+Cynthia+Breazeal%2E+2023%2E+Modeling+empathic+similarity+in+personal+narratives%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+Methods+)
65. Zhiyu Shen, Yunhe Pang, Yanghui Rao, and Jianxing Yu. 2025. Coe: A clue of emotion framework for emotion recognition in conversations. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 23548–23563. [find](https://scholar.google.com/scholar?q=Zhiyu+Shen%2C+Yunhe+Pang%2C+Yanghui+Rao%2C+and+Jianxing+Yu%2E+2025%2E+Coe%3A+A+clue+of+emotion+framework+for+emotion+recognition+in+conversations%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+for+)
66. Yuntao Shou, Tao Meng, Wei Ai, and Keqin Li. 2025. Dynamic graph neural ode network for multi-modal emotion recognition in conversation. In Proceedings of the 31st International Conference on Computational Linguistics, pages 256–268. [find](https://scholar.google.com/scholar?q=Yuntao+Shou%2C+Tao+Meng%2C+Wei+Ai%2C+and+Keqin+Li%2E+2025%2E+Dynamic+graph+neural+ode+network+for+multi%2Dmodal+emotion+recognition+in+conversation%2E+In+Proceedings+of+the+31st+International+Conference+on+Computat)
67. Yufeng Wang, Chao Chen, Zhou Yang, Shuhui Wang, and Xiangwen Liao. 2024b. Ctsm: Combining trait and state emotions for empathetic response model. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 4214–4… [find](https://scholar.google.com/scholar?q=Yufeng+Wang%2C+Chao+Chen%2C+Zhou+Yang%2C+Shuhui+Wang%2C+and+Xiangwen+Liao%2E+2024b%2E+Ctsm%3A+Combining+trait+and+state+emotions+for+empathetic+response+model%2E+In+Proceedings+of+the+2024+Joint+International+Confere)
68. Joshua Wilt and {William R} Revelle. 2016. Extraversion. Oxford Univeristy Press. [find](https://scholar.google.com/scholar?q=Joshua+Wilt+and+%7BWilliam+R%7D+Revelle%2E+2016%2E+Extraversion%2E+Oxford+Univeristy+Press%2E)
69. Jesse H Wright, Gregory K Brown, Michael E Thase, and Monica Ramirez Basco. 2017. Learning cognitive-behavior therapy: An illustrated guide. American Psychiatric Pub. [find](https://scholar.google.com/scholar?q=Jesse+H+Wright%2C+Gregory+K+Brown%2C+Michael+E+Thase%2C+and+Monica+Ramirez+Basco%2E+2017%2E+Learning+cognitive%2Dbehavior+therapy%3A+An+illustrated+guide%2E+American+Psychiatric+Pub%2E)
70. Chengyan Wu, Yiqiang Cai, Yang Liu, Pengxu Zhu, Yun Xue, Ziwei Gong, Julia Hirschberg, and Bolei Ma. 2025a. Multimodal emotion recognition in conversations: A survey of methods, trends, challenges and prospects. arXiv preprint arXiv:2505.20511. [find](https://scholar.google.com/scholar?q=Chengyan+Wu%2C+Yiqiang+Cai%2C+Yang+Liu%2C+Pengxu+Zhu%2C+Yun+Xue%2C+Ziwei+Gong%2C+Julia+Hirschberg%2C+and+Bolei+Ma%2E+2025a%2E+Multimodal+emotion+recognition+in+conversations%3A+A+survey+of+methods%2C+trends%2C+challenges+and)
71. Jiaqiang Wu, Xuandong Huang, Zhouan Zhu, and Shangfei Wang. 2025b. From traits to empathy: Personality-aware multimodal empathetic response generation. In Proceedings of the 31st International Conference on Computational Linguistics, pages 8925–8938. [find](https://scholar.google.com/scholar?q=Jiaqiang+Wu%2C+Xuandong+Huang%2C+Zhouan+Zhu%2C+and+Shangfei+Wang%2E+2025b%2E+From+traits+to+empathy%3A+Personality%2Daware+multimodal+empathetic+response+generation%2E+In+Proceedings+of+the+31st+International+Confere)
72. Jieying Xue, Minh-Phuong Nguyen, Blake Matheny, and Le-Minh Nguyen. 2024. Bioserc: Integrating biography speakers supported by llms for erc tasks. In International Conference on Artificial Neural Networks, pages 277–292. Springer. [find](https://scholar.google.com/scholar?q=Jieying+Xue%2C+Minh%2DPhuong+Nguyen%2C+Blake+Matheny%2C+and+Le%2DMinh+Nguyen%2E+2024%2E+Bioserc%3A+Integrating+biography+speakers+supported+by+llms+for+erc+tasks%2E+In+International+Conference+on+Artificial+Neural+Netw)
73. Sagarika Shreevastava and Peter Foltz. 2021. Detecting cognitive distortions from patient-therapist interactions. In Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access, pages 151–158. [find](https://scholar.google.com/scholar?q=Sagarika+Shreevastava+and+Peter+Foltz%2E+2021%2E+Detecting+cognitive+distortions+from+patient%2Dtherapist+interactions%2E+In+Proceedings+of+the+Seventh+Workshop+on+Computational+Linguistics+and+Clinical+Psych)
74. Yang Yang, Xunde Dong, and Yupeng Qiang. 2025. Mse-adapter: A lightweight plugin endowing llms with the capability to perform multimodal sentiment analysis and emotion recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 25642–25650. [find](https://scholar.google.com/scholar?q=Yang+Yang%2C+Xunde+Dong%2C+and+Yupeng+Qiang%2E+2025%2E+Mse%2Dadapter%3A+A+lightweight+plugin+endowing+llms+with+the+capability+to+perform+multimodal+sentiment+analysis+and+emotion+recognition%2E+In+Proceedings+of+t)
75. Hiroki Tanioka, Tetsushi Ueta, and Masahiko Sano. 2024. Toward a dialogue system using a large language model to recognize user emotions with a camera. arXiv preprint arXiv:2408.07982. — [arXiv:2408.07982](https://arxiv.org/abs/2408.07982) [find](https://scholar.google.com/scholar?q=Hiroki+Tanioka%2C+Tetsushi+Ueta%2C+and+Masahiko+Sano%2E+2024%2E+Toward+a+dialogue+system+using+a+large+language+model+to+recognize+user+emotions+with+a+camera%2E+arXiv+preprint+arXiv%3A2408%2E07982%2E+%E2%80%94+%5BarXiv%3A2408%2E0)
76. Zijun Yang, Zhen Li, Shi Zhou, Lifeng Zhang, and Seiichi Serikawa. 2024. Speech emotion recognition based on multi-feature speed rate and lstm. Neurocomputing, 601:128177. [find](https://scholar.google.com/scholar?q=Zijun+Yang%2C+Zhen+Li%2C+Shi+Zhou%2C+Lifeng+Zhang%2C+and+Seiichi+Serikawa%2E+2024%2E+Speech+emotion+recognition+based+on+multi%2Dfeature+speed+rate+and+lstm%2E+Neurocomputing%2C+601%3A128177%2E)
77. Jamil Zaki. 2019. The war for kindness: Building empathy in a fractured world. Crown. [find](https://scholar.google.com/scholar?q=Jamil+Zaki%2E+2019%2E+The+war+for+kindness%3A+Building+empathy+in+a+fractured+world%2E+Crown%2E)
78. Xiaoheng Zhang and Yang Li. 2023. A cross-modality context fusion and semantic refinement network for emotion recognition in conversation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13099–13110. [find](https://scholar.google.com/scholar?q=Xiaoheng+Zhang+and+Yang+Li%2E+2023%2E+A+cross%2Dmodality+context+fusion+and+semantic+refinement+network+for+emotion+recognition+in+conversation%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+)
79. A.3 Table 6 shows the prompts using in all MERC methods in Table 2. The DoT method is a version of Visual+DoT by removing the visual part. [find](https://scholar.google.com/scholar?q=A%2E3+Table+6+shows+the+prompts+using+in+all+MERC+methods+in+Table+2%2E+The+DoT+method+is+a+version+of+Visual%2BDoT+by+removing+the+visual+part%2E)
80. Yazhou Zhang, Mengyao Wang, Prayag Tiwari, Qiuchi Li, Benyou Wang, and Jing Qin. 2023. Dialoguellm: Context and emotion knowledge-tuned llama models for emotion recognition in conversations. arXiv preprint arXiv:2310.11374. [find](https://scholar.google.com/scholar?q=Yazhou+Zhang%2C+Mengyao+Wang%2C+Prayag+Tiwari%2C+Qiuchi+Li%2C+Benyou+Wang%2C+and+Jing+Qin%2E+2023%2E+Dialoguellm%3A+Context+and+emotion+knowledge%2Dtuned+llama+models+for+emotion+recognition+in+conversations%2E+arXiv+pre)
81. Juan Zheng, Susanne Lajoie, and Shan Li. 2023. Emotions in self-regulated learning: A critical literature review and meta-analysis. Frontiers in Psychology, 14:1137010. [find](https://scholar.google.com/scholar?q=Juan+Zheng%2C+Susanne+Lajoie%2C+and+Shan+Li%2E+2023%2E+Emotions+in+self%2Dregulated+learning%3A+A+critical+literature+review+and+meta%2Danalysis%2E+Frontiers+in+Psychology%2C+14%3A1137010%2E)
82. Jianfeng Zhu, Ruoming Jin, and Karin G Coifman. 2025. Investigating large language models in inferring personality traits from user conversations. arXiv preprint arXiv:2501.07532. — [arXiv:2501.07532](https://arxiv.org/abs/2501.07532) [find](https://scholar.google.com/scholar?q=Jianfeng+Zhu%2C+Ruoming+Jin%2C+and+Karin+G+Coifman%2E+2025%2E+Investigating+large+language+models+in+inferring+personality+traits+from+user+conversations%2E+arXiv+preprint+arXiv%3A2501%2E07532%2E+%E2%80%94+%5BarXiv%3A2501%2E07532%5D)
83. Xiaofei Zhu, Jiawei Cheng, Zhou Yang, Zhuo Chen, Qingyang Wang, and Jianfeng Yao. 2024. Cmath: Cross-modality augmented transformer with hierarchical variational distillation for multimodal emotion recognition in conversation. arXiv preprint arXiv:2411.10060. — [arXiv:2411.10060](https://arxiv.org/abs/2411.10060) [find](https://scholar.google.com/scholar?q=Xiaofei+Zhu%2C+Jiawei+Cheng%2C+Zhou+Yang%2C+Zhuo+Chen%2C+Qingyang+Wang%2C+and+Jianfeng+Yao%2E+2024%2E+Cmath%3A+Cross%2Dmodality+augmented+transformer+with+hierarchical+variational+distillation+for+multimodal+emotion+re)

*Updated 31 October 2026*