---
title: "PsychEval — paper by Pan et al. (2026) — summary and ideas"
description: "The authors also propose an evaluation framework that scores both how realistic the simulated client is and how competent… 53 references."
authors: ["Qianjun Pan", "Junyi Wang", "Jie Zhou", "Yutao Yang", "Junsong Li", "Kaiyin Xu", "Yougen Zhou", "Yihan Li", "JingYuan Zhao", "Qin Chen", "Ningning Zhou", "Kai Chen", "Liang He"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.1115/"
doi: "10.18653/v1/2026.findings-acl.1115"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/pan-2026-psycheval-multi-session-multi-therapy/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/pan-2026-psycheval-multi-session-multi-therapy/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/16/) / PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor

# PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor

**Authors:** [Qianjun Pan](https://md.research.elamur.ai/free/en/authors/qianjun-pan/), Junyi Wang, [Jie Zhou](https://md.research.elamur.ai/free/en/authors/jie-zhou/), Yutao Yang, Junsong Li, Kaiyin Xu, [Yougen Zhou](https://md.research.elamur.ai/free/en/authors/yougen-zhou/), Yihan Li, JingYuan Zhao, [Qin Chen](https://md.research.elamur.ai/free/en/authors/qin-chen/), Ningning Zhou, [Kai Chen](https://md.research.elamur.ai/free/en/authors/kai-chen/) and [Liang He](https://md.research.elamur.ai/free/en/authors/liang-he/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.1115/) · [PDF](https://aclanthology.org/2026.findings-acl.1115.pdf) · [DOI 10.18653/v1/2026.findings-acl.1115](https://doi.org/10.18653/v1/2026.findings-acl.1115) · [OpenAlex](https://openalex.org/W7166840864)

**Citations:** 1 citations (OpenAlex, 2026-10-14)

## Summary
Most benchmarks for AI mental-health assistants test isolated, single-turn exchanges. Real counseling, by contrast, unfolds over many sessions, depends on remembering the client's history, and often mixes therapeutic schools. PsychEval addresses this gap with a Chinese-language benchmark built by using LLMs (e.g., GPT-5) to turn published clinical case reports into multi-session dialogues. Every case follows a shared three-stage workflow: case conceptualization, core intervention, and consolidation/prevention. The dialogues are annotated with a hierarchical skill taxonomy that links high-level strategies to fine-grained counselor actions. The authors also propose an evaluation framework that scores both how realistic the simulated client is and how competent the counselor is, using metrics common to all therapies as well as therapy-specific ones. Against prior corpora, PsychEval scores highest on alliance and therapy-adherence measures and shows a plausible improvement trajectory for clients across sessions. Expert raters agree closely with the LLM judge. The resource can serve as a test bed and as a reinforcement learning environment for training long-horizon AI counselors.

## Key points
- **Source and structure:** built from 369 case reports in psychology journals, with 6–10 sessions per case (7.6 on average). It covers five therapies (Psychodynamic, Behavioral, CBT, Humanistic-Existential, Postmodernist) plus Integrative, across six psychological topics.
- **Annotations and profiles:** more than 677 meta-skills and 4577 atomic skills, plus over 2,000 client profiles. Evaluation uses 18 metrics at the Client-Level and Counselor-Level.
- **Comparison with prior corpora:** PsychEval reaches WAI 7.26, HTAIS 6.40, CTRS 9.19 and PSC 7.27, outperforming PsyDTCorpus, CPsyCoun, PsyDial and SimPsyDial.
- **Client trajectory:** from one session to the next, BDI-II falls by 0.45 and IPO by 0.09, while CCT rises by 0.14 and SFBT by 0.16. Psy-Insight shows the opposite trends.
- **Human validation and limitations:** two experts rated 231 sessions. Their mutual weighted kappa averaged 0.83, and agreement with GPT-5 averaged 0.80–0.83. The benchmark is text-only, underrepresents high-risk cases, and is tied to the Chinese cultural context.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Shanghai Artificial Intelligence Laboratory](https://md.research.elamur.ai/free/en/labs/shanghai-artificial-intelligence-laboratory/) — Research institute, Shanghai, China · 117 works · 11,281 citations
- [East China Normal University](https://md.research.elamur.ai/free/en/universities/east-china-normal-university/) — University, Shanghai, China · 50 works · 2,174 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 870 works · [💭 Applied Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/applied-psychology/) · 21 works

🧭 Topics (1): [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works

## Cite

Cite as: Qianjun Pan, Junyi Wang, Jie Zhou, Yutao Yang, Junsong Li, Kaiyin Xu, Yougen Zhou, Yihan Li, JingYuan Zhao, Qin Chen, Ningning Zhou, Kai Chen and Liang He. 2026. PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{pan2026psycheval,
  title = {{PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor}},
  author = {Qianjun Pan, Junyi Wang, Jie Zhou, Yutao Yang, Junsong Li, Kaiyin Xu, Yougen Zhou, Yihan Li, JingYuan Zhao, Qin Chen, Ningning Zhou, Kai Chen and Liang He},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1115},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.1115}
}
```

- [← previous ProxyPrompt: Securing System Prompts against Prompt Extraction Attacks](https://md.research.elamur.ai/free/en/papers/zhuang-2026-proxyprompt-securing-system-prompts-against/)
- [next → PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback](https://md.research.elamur.ai/free/en/papers/xia-2026-psyscore-psychometrically-aware-framework-trait/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/16/)

## References

53 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Anonymous. 2025. From empathy to action: Benchmarking LLMs in mental health with mentalbench-10 and a novel cognitive-affective evaluation approach. In Submitted to ACL Rolling Review - May 2025. Under review. [find](https://scholar.google.com/scholar?q=Anonymous%2E+2025%2E+From+empathy+to+action%3A+Benchmarking+LLMs+in+mental+health+with+mentalbench%2D10+and+a+novel+cognitive%2Daffective+evaluation+approach%2E+In+Submitted+to+ACL+Rolling+Review+%2D+May+2025%2E+Unde)
2. Douglas Behan. 2022. Do clients train therapists to become eclectic and use the common factors? a qualitative study listening to experienced psychotherapists. BMC psychology, 10(1):183. [find](https://scholar.google.com/scholar?q=Douglas+Behan%2E+2022%2E+Do+clients+train+therapists+to+become+eclectic+and+use+the+common+factors%3F+a+qualitative+study+listening+to+experienced+psychotherapists%2E+BMC+psychology%2C+10%281%29%3A183%2E)
3. Vera Békés, Daniel S Spina, Katie Aafjes-van Doorn, Bernard S Gorman, Karl Stukenberg, and Sherwood Waldron. 2025. Development of a new observer-rated measure to assess the real relationship in psychotherapy sessions. Psychotherapy Research, 35(5):807– 817. [find](https://scholar.google.com/scholar?q=Vera+B%C3%A9k%C3%A9s%2C+Daniel+S+Spina%2C+Katie+Aafjes%2Dvan+Doorn%2C+Bernard+S+Gorman%2C+Karl+Stukenberg%2C+and+Sherwood+Waldron%2E+2025%2E+Development+of+a+new+observer%2Drated+measure+to+assess+the+real+relationship+in+psycho)
4. Sorio Boit and Rajvardhan Patil. 2025. A prompt engineering framework for large language model– based mental health chatbots: Conceptual framework. JMIR Mental Health, 12(1):e75078. [find](https://scholar.google.com/scholar?q=Sorio+Boit+and+Rajvardhan+Patil%2E+2025%2E+A+prompt+engineering+framework+for+large+language+model%E2%80%93+based+mental+health+chatbots%3A+Conceptual+framework%2E+JMIR+Mental+Health%2C+12%281%29%3Ae75078%2E)
5. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, and 1 others. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). Advances in neural information processing systems, 33:1877–1901. model: A multifaceted… — [arXiv:2308.15192](https://arxiv.org/abs/2308.15192)
6. Qiming Guo, Jinwen Tang, Wenbo Sun, Haoteng Tang, Yi Shang, and Wenlu Wang. 2024. Soullmate: An adaptive llm-driven system for advanced mental health support and assessment, based on a systematic application survey. arXiv preprint arXiv:2410.11859. — [arXiv:2410.11859](https://arxiv.org/abs/2410.11859) [find](https://scholar.google.com/scholar?q=Qiming+Guo%2C+Jinwen+Tang%2C+Wenbo+Sun%2C+Haoteng+Tang%2C+Yi+Shang%2C+and+Wenlu+Wang%2E+2024%2E+Soullmate%3A+An+adaptive+llm%2Ddriven+system+for+advanced+mental+health+support+and+assessment%2C+based+on+a+systematic+appl)
7. Guangzeng Han, Weisi Liu, Xiaolei Huang, and Brian Borsari. 2024. Chain-of-interaction: Enhancing large language models for psychiatric behavior understanding by dyadic contexts. In 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI), pages 392–401. IEEE. [find](https://scholar.google.com/scholar?q=Guangzeng+Han%2C+Weisi+Liu%2C+Xiaolei+Huang%2C+and+Brian+Borsari%2E+2024%2E+Chain%2Dof%2Dinteraction%3A+Enhancing+large+language+models+for+psychiatric+behavior+understanding+by+dyadic+contexts%2E+In+2024+IEEE+12th+Int)
8. Ayaan Haque, Viraaj Reddi, and Tyler Giallanza. 2021. Deep learning for suicide and depression identification with unsupervised label correction. In International Conference on Artificial Neural Networks, pages 436–447. Springer. [find](https://scholar.google.com/scholar?q=Ayaan+Haque%2C+Viraaj+Reddi%2C+and+Tyler+Giallanza%2E+2021%2E+Deep+learning+for+suicide+and+depression+identification+with+unsupervised+label+correction%2E+In+International+Conference+on+Artificial+Neural+Netwo)
9. Stefan G Hofmann, Anu Asnaani, Imke JJ Vonk, Alice T Sawyer, and Angela Fang. 2012. The efficacy of cognitive behavioral therapy: A review of meta-analyses. Cognitive therapy and research, 36(5):427–440. [find](https://scholar.google.com/scholar?q=Stefan+G+Hofmann%2C+Anu+Asnaani%2C+Imke+JJ+Vonk%2C+Alice+T+Sawyer%2C+and+Angela+Fang%2E+2012%2E+The+efficacy+of+cognitive+behavioral+therapy%3A+A+review+of+meta%2Danalyses%2E+Cognitive+therapy+and+research%2C+36%285%29%3A427%E2%80%934)
10. He Hu, Yucheng Zhou, Juzheng Si, Qianning Wang, Hengheng Zhang, Fuji Ren, Fei Ma, Laizhong Cui, and Qi Tian. 2025. Beyond empathy: Integrating diagnostic and therapeutic reasoning with large language models for mental health counseling. arXiv preprint arXiv:2505.15715. — [arXiv:2505.15715](https://arxiv.org/abs/2505.15715) [find](https://scholar.google.com/scholar?q=He+Hu%2C+Yucheng+Zhou%2C+Juzheng+Si%2C+Qianning+Wang%2C+Hengheng+Zhang%2C+Fuji+Ren%2C+Fei+Ma%2C+Laizhong+Cui%2C+and+Qi+Tian%2E+2025%2E+Beyond+empathy%3A+Integrating+diagnostic+and+therapeutic+reasoning+with+large+language+)
11. Keqi Chen, Zekai Sun, Yuhua Wen, Huijun Lian, Yingming Gao, and Ya Li. 2025. Psy-insight: Explainable multi-turn bilingual dataset for mental health counseling. arXiv preprint arXiv:2503.03607. — [arXiv:2503.03607](https://arxiv.org/abs/2503.03607) [find](https://scholar.google.com/scholar?q=Keqi+Chen%2C+Zekai+Sun%2C+Yuhua+Wen%2C+Huijun+Lian%2C+Yingming+Gao%2C+and+Ya+Li%2E+2025%2E+Psy%2Dinsight%3A+Explainable+multi%2Dturn+bilingual+dataset+for+mental+health+counseling%2E+arXiv+preprint+arXiv%3A2503%2E03607%2E+%E2%80%94+%5BarX)
12. Yining Hua, Hongbin Na, Zehan Li, Fenglin Liu, Xiao Fang, David Clifton, and John Torous. 2025. A scoping review of large language models for generative tasks in mental health care. npj Digital Medicine, 8(1):230. [find](https://scholar.google.com/scholar?q=Yining+Hua%2C+Hongbin+Na%2C+Zehan+Li%2C+Fenglin+Liu%2C+Xiao+Fang%2C+David+Clifton%2C+and+John+Torous%2E+2025%2E+A+scoping+review+of+large+language+models+for+generative+tasks+in+mental+health+care%2E+npj+Digital+Medici)
13. Yirong Chen, Xiaofen Xing, Jingkai Lin, Huimin Zheng, Zhenyu Wang, Qi Liu, and Xiangmin Xu. 2023. Soulchat: Improving llms’ empathy, listening, and comfort abilities through fine-tuning with multi-turn empathy conversations. In Findings of the Association for Computational Linguistics: EMNLP 2023, p… [find](https://scholar.google.com/scholar?q=Yirong+Chen%2C+Xiaofen+Xing%2C+Jingkai+Lin%2C+Huimin+Zheng%2C+Zhenyu+Wang%2C+Qi+Liu%2C+and+Xiangmin+Xu%2E+2023%2E+Soulchat%3A+Improving+llms%E2%80%99+empathy%2C+listening%2C+and+comfort+abilities+through+fine%2Dtuning+with+multi%2Dtur)
14. Jen-tse Huang, Wenxuan Wang, Eric John Li, Man Ho Lam, Shujie Ren, Youliang Yuan, Wenxiang Jiao, Zhaopeng Tu, and Michael R. Lyu. 2024. On the humanity of conversational ai: Evaluating the psychological portrayal of llms. In Proceedings of the Twelfth International Conference on Learning Representat… [find](https://scholar.google.com/scholar?q=Jen%2Dtse+Huang%2C+Wenxuan+Wang%2C+Eric+John+Li%2C+Man+Ho+Lam%2C+Shujie+Ren%2C+Youliang+Yuan%2C+Wenxiang+Jiao%2C+Zhaopeng+Tu%2C+and+Michael+R%2E+Lyu%2E+2024%2E+On+the+humanity+of+conversational+ai%3A+Evaluating+the+psychologic)
15. Eugene W Farber. 2010. Humanistic–existential psychotherapy competencies and the supervisory process. Psychotherapy: Theory, Research, Practice, Training, 47(1):28. [find](https://scholar.google.com/scholar?q=Eugene+W+Farber%2E+2010%2E+Humanistic%E2%80%93existential+psychotherapy+competencies+and+the+supervisory+process%2E+Psychotherapy%3A+Theory%2C+Research%2C+Practice%2C+Training%2C+47%281%29%3A28%2E)
16. Daniel B Fishman. 2013. The pragmatic case study method for creating rigorous and systematic, practitioner-friendly research. Pragmatic Case Studies in Psychotherapy, 9(4):403–425. [find](https://scholar.google.com/scholar?q=Daniel+B+Fishman%2E+2013%2E+The+pragmatic+case+study+method+for+creating+rigorous+and+systematic%2C+practitioner%2Dfriendly+research%2E+Pragmatic+Case+Studies+in+Psychotherapy%2C+9%284%29%3A403%E2%80%93425%2E)
17. Carmel Flaskas. 2003. Family therapy beyond postmodernism: Practice challenges theory. Routledge. [find](https://scholar.google.com/scholar?q=Carmel+Flaskas%2E+2003%2E+Family+therapy+beyond+postmodernism%3A+Practice+challenges+theory%2E+Routledge%2E)
18. Guanghui Fu, Qing Zhao, Jianqiang Li, Dan Luo, Changwei Song, Wei Zhai, Shuo Liu, Fan Wang, Yan Wang, Lijuan Cheng, and 1 others. 2023. Enhancing psychological counseling with large language Zainab Iftikhar, Amy Xiao, Sean Ransom, Jeff Huang, and Harini Suresh. 2025. How llm counselors violate ethic… [find](https://scholar.google.com/scholar?q=Guanghui+Fu%2C+Qing+Zhao%2C+Jianqiang+Li%2C+Dan+Luo%2C+Changwei+Song%2C+Wei+Zhai%2C+Shuo+Liu%2C+Fan+Wang%2C+Yan+Wang%2C+Lijuan+Cheng%2C+and+1+others%2E+2023%2E+Enhancing+psychological+counseling+with+large+language+Zainab+If)
19. Tin Lai, Yukun Shi, Zicong Du, Jiajie Wu, Ken Fu, Yichao Dou, and Ziqi Wang. 2023. Psy-llm: Scaling up global mental health psychological services with ai-based large language models. arXiv preprint arXiv:2307.11991. — [arXiv:2307.11991](https://arxiv.org/abs/2307.11991) [find](https://scholar.google.com/scholar?q=Tin+Lai%2C+Yukun+Shi%2C+Zicong+Du%2C+Jiajie+Wu%2C+Ken+Fu%2C+Yichao+Dou%2C+and+Ziqi+Wang%2E+2023%2E+Psy%2Dllm%3A+Scaling+up+global+mental+health+psychological+services+with+ai%2Dbased+large+language+models%2E+arXiv+preprint+a)
20. Max Lamparth, Declan Grabb, Amy Franks, Scott Gershan, Kaitlyn N Kunstman, Aaron Lulla, Monika Drummond Roots, Manu Sharma, Aryan Shrivastava, Nina Vasan, and 1 others. 2025. Moving beyond medical exam questions: A clinician-annotated dataset of real-world tasks and ambiguity in mental healthcare. a… — [arXiv:2502.16051](https://arxiv.org/abs/2502.16051) [find](https://scholar.google.com/scholar?q=Max+Lamparth%2C+Declan+Grabb%2C+Amy+Franks%2C+Scott+Gershan%2C+Kaitlyn+N+Kunstman%2C+Aaron+Lulla%2C+Monika+Drummond+Roots%2C+Manu+Sharma%2C+Aryan+Shrivastava%2C+Nina+Vasan%2C+and+1+others%2E+2025%2E+Moving+beyond+medical+exa)
21. Suyeon Lee, Sunghwan Mac Kim, Minju Kim, Dongjin Kang, Dongil Yang, Harim Kim, Minseok Kang, Dayi Jung, Min Hee Kim, Seungbeen Lee, and 1 others. 2024. Cactus: Towards psychological counseling conversations using cognitive behavioral theory. In Findings of the Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Suyeon+Lee%2C+Sunghwan+Mac+Kim%2C+Minju+Kim%2C+Dongjin+Kang%2C+Dongil+Yang%2C+Harim+Kim%2C+Minseok+Kang%2C+Dayi+Jung%2C+Min+Hee+Kim%2C+Seungbeen+Lee%2C+and+1+others%2E+2024%2E+Cactus%3A+Towards+psychological+counseling+convers)
22. Wenyu Li, Yinuo Zhu, Xin Lin, Ming Li, Ziyue Jiang, and Ziqian Zeng. 2024. Zero-shot explainable mental health analysis on social media by incorporating mental scales. In Companion Proceedings of the ACM Web Conference 2024, pages 959–962. [find](https://scholar.google.com/scholar?q=Wenyu+Li%2C+Yinuo+Zhu%2C+Xin+Lin%2C+Ming+Li%2C+Ziyue+Jiang%2C+and+Ziqian+Zeng%2E+2024%2E+Zero%2Dshot+explainable+mental+health+analysis+on+social+media+by+incorporating+mental+scales%2E+In+Companion+Proceedings+of+the+)
23. Xiaobao Li, Hong Gu, Xudong Zhao, Fazhan Chen, and Liang Liu. 2022. Development of a measure quantifying helpful psychotherapy interventions: The helpful therapeutic attitudes and interventions scale. Frontiers in Psychiatry, 13:1023346. [find](https://scholar.google.com/scholar?q=Xiaobao+Li%2C+Hong+Gu%2C+Xudong+Zhao%2C+Fazhan+Chen%2C+and+Liang+Liu%2E+2022%2E+Development+of+a+measure+quantifying+helpful+psychotherapy+interventions%3A+The+helpful+therapeutic+attitudes+and+interventions+scale%2E)
24. Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, and 1 others. 2024. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437. [find](https://scholar.google.com/scholar?q=Aixin+Liu%2C+Bei+Feng%2C+Bing+Xue%2C+Bingxuan+Wang%2C+Bochao+Wu%2C+Chengda+Lu%2C+Chenggang+Zhao%2C+Chengqi+Deng%2C+Chenyu+Zhang%2C+Chong+Ruan%2C+and+1+others%2E+2024%2E+Deepseek%2Dv3+technical+report%2E+arXiv+preprint+arXiv%3A2412)
25. June M Liu, Donghao Li, He Cao, Tianhe Ren, Zeyi Liao, and Jiamin Wu. 2023a. Chatcounselor: A large language models for mental health support. arXiv preprint arXiv:2309.15461. — [arXiv:2309.15461](https://arxiv.org/abs/2309.15461) [find](https://scholar.google.com/scholar?q=June+M+Liu%2C+Donghao+Li%2C+He+Cao%2C+Tianhe+Ren%2C+Zeyi+Liao%2C+and+Jiamin+Wu%2E+2023a%2E+Chatcounselor%3A+A+large+language+models+for+mental+health+support%2E+arXiv+preprint+arXiv%3A2309%2E15461%2E+%E2%80%94+%5BarXiv%3A2309%2E15461%5D%28htt)
26. Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, and Minlie Huang. 2021. [Towards emotional support dialog systems](https://md.research.elamur.ai/free/en/papers/liu-2021-emotional-support-dialog-systems/). In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Lan…
27. Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023b. [G-eval: Nlg evaluation using gpt-4 with better human alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-g-eval-nlg-evaluation-gpt/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2511–2522.
28. Hongbin Na, Yining Hua, Zimu Wang, Tao Shen, Beibei Yu, Lilin Wang, Wei Wang, John Torous, and Ling Chen. 2025. A survey of large language models in psychotherapy: Current landscape and future directions. arXiv preprint arXiv:2502.11095. [find](https://scholar.google.com/scholar?q=Hongbin+Na%2C+Yining+Hua%2C+Zimu+Wang%2C+Tao+Shen%2C+Beibei+Yu%2C+Lilin+Wang%2C+Wei+Wang%2C+John+Torous%2C+and+Ling+Chen%2E+2025%2E+A+survey+of+large+language+models+in+psychotherapy%3A+Current+landscape+and+future+directi)
29. Viet Cuong Nguyen, Mohammad Taher, Dongwan Hong, Vinicius Konkolics Possobom, Vibha Thirunel-layi Gopalakrishnan, Ekta Raj, Zihang Li, Heather J Soled, Michael L Birnbaum, Srijan Kumar, and 1 others. 2025. Do large language models align with core mental health counseling competencies? In Findings of… [find](https://scholar.google.com/scholar?q=Viet+Cuong+Nguyen%2C+Mohammad+Taher%2C+Dongwan+Hong%2C+Vinicius+Konkolics+Possobom%2C+Vibha+Thirunel%2Dlayi+Gopalakrishnan%2C+Ekta+Raj%2C+Zihang+Li%2C+Heather+J+Soled%2C+Michael+L+Birnbaum%2C+Srijan+Kumar%2C+and+1+others%2E+)
30. Donald R Peterson. 1991. Connection and disconnection of research and practice in the education of professional psychologists. American Psychologist, 46(4):422. [find](https://scholar.google.com/scholar?q=Donald+R+Peterson%2E+1991%2E+Connection+and+disconnection+of+research+and+practice+in+the+education+of+professional+psychologists%2E+American+Psychologist%2C+46%284%29%3A422%2E)
31. Huachuan Qiu, Hongliang He, Shuai Zhang, Anqi Li, and Zhenzhong Lan. 2024. [Smile: Single-turn to multi-turn inclusive language expansion via chatgpt for mental health support](https://md.research.elamur.ai/free/en/papers/qiu-2024-smile-single-turn-multi-turn/). In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 615–636.
32. Huachuan Qiu and Zhenzhong Lan. 2024. [Interactive agents: Simulating counselor-client psychological counseling via role-playing llm-to-llm interactions](https://md.research.elamur.ai/free/en/papers/qiu-2026-interactive-agents-simulating-counselor-client/). arXiv preprint arXiv:2408.15787.
33. Huachuan Qiu and Zhenzhong Lan. 2025. Psydial: A large-scale long-term conversational dataset for mental health support. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 21624– 21655. [find](https://scholar.google.com/scholar?q=Huachuan+Qiu+and+Zhenzhong+Lan%2E+2025%2E+Psydial%3A+A+large%2Dscale+long%2Dterm+conversational+dataset+for+mental+health+support%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+for+Computational+)
34. Barbara Olasov Rothbaum, Elizabeth A Meadows, Patricia Resick, and David W Foy. 2000. Cognitive-behavioral therapy. [find](https://scholar.google.com/scholar?q=Barbara+Olasov+Rothbaum%2C+Elizabeth+A+Meadows%2C+Patricia+Resick%2C+and+David+W+Foy%2E+2000%2E+Cognitive%2Dbehavioral+therapy%2E)
35. Günter Schiepek and David Pincus. 2023. Complexity science: A framework for psychotherapy integration. Counselling and Psychotherapy Research, 23(4):941– 955. [find](https://scholar.google.com/scholar?q=G%C3%BCnter+Schiepek+and+David+Pincus%2E+2023%2E+Complexity+science%3A+A+framework+for+psychotherapy+integration%2E+Counselling+and+Psychotherapy+Research%2C+23%284%29%3A941%E2%80%93+955%2E)
36. Sahar Khan Sherwani, Zarak Khan, Jim Samuel, Rajiv Kashyap, and Kushal Gunavantkumar Patel. 2025. Eshro: An innovative evaluation framework for ai-driven mental health chatbots. Available at SSRN 5254332. [find](https://scholar.google.com/scholar?q=Sahar+Khan+Sherwani%2C+Zarak+Khan%2C+Jim+Samuel%2C+Rajiv+Kashyap%2C+and+Kushal+Gunavantkumar+Patel%2E+2025%2E+Eshro%3A+An+innovative+evaluation+framework+for+ai%2Ddriven+mental+health+chatbots%2E+Available+at+SSRN+5254)
37. Richard F Summers, Jacques P Barber, and Sigal Zilcha-Mano. 2024. Psychodynamic therapy. Guilford Publications. [find](https://scholar.google.com/scholar?q=Richard+F+Summers%2C+Jacques+P+Barber%2C+and+Sigal+Zilcha%2DMano%2E+2024%2E+Psychodynamic+therapy%2E+Guilford+Publications%2E)
38. Hao Sun, Zhenru Lin, Chujie Zheng, Siyang Liu, and Minlie Huang. 2021. Psyqa: A chinese dataset for generating long counseling text for mental health support. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1489–1503. [find](https://scholar.google.com/scholar?q=Hao+Sun%2C+Zhenru+Lin%2C+Chujie+Zheng%2C+Siyang+Liu%2C+and+Minlie+Huang%2E+2021%2E+Psyqa%3A+A+chinese+dataset+for+generating+long+counseling+text+for+mental+health+support%2E+In+Findings+of+the+Association+for+Comput)
39. Thomas Yu Chow Tam, Sonish Sivarajkumar, Sumit Kapoor, Alisa V Stolyar, Katelyn Polanska, Kar-leigh R McCarthy, Hunter Osterhoudt, Xizhi Wu, Shyam Visweswaran, Sunyang Fu, and 1 others. 2024. A framework for human evaluation of large language models in healthcare derived from literature review. NPJ… [find](https://scholar.google.com/scholar?q=Thomas+Yu+Chow+Tam%2C+Sonish+Sivarajkumar%2C+Sumit+Kapoor%2C+Alisa+V+Stolyar%2C+Katelyn+Polanska%2C+Kar%2Dleigh+R+McCarthy%2C+Hunter+Osterhoudt%2C+Xizhi+Wu%2C+Shyam+Visweswaran%2C+Sunyang+Fu%2C+and+1+others%2E+2024%2E+A+framew)
40. Elsbeth Turcan and Kathleen McKeown. 2019. Dreaddit: A reddit dataset for stress analysis in social media. In Proceedings of the Tenth International Workshop on Health Text Mining and Information Analysis (LOUHI 2019), pages 97–107. [find](https://scholar.google.com/scholar?q=Elsbeth+Turcan+and+Kathleen+McKeown%2E+2019%2E+Dreaddit%3A+A+reddit+dataset+for+stress+analysis+in+social+media%2E+In+Proceedings+of+the+Tenth+International+Workshop+on+Health+Text+Mining+and+Information+Anal)
41. Junzhe Wang, Bichen Wang, Xing Fu, Yixin Sun, Yanyan Zhao, and Bing Qin. 2025. [Psychological counseling cannot be achieved overnight: Automated psychological counseling through multi-session conversations](https://md.research.elamur.ai/free/en/papers/wang-2026-psychological-counseling-cannot-be-achieved/). arXiv preprint arXiv:2506.06626.
42. Ruiyi Wang, Stephanie Milani, Jamie C Chiu, Jiayin Zhi, Shaun M Eack, Travis Labrum, Samuel M Murphy, Nev Jones, Kate Hardy, Hong Shen, and 1 others. 2024. Patient-{\\Psi}: Using large language models to simulate patients for training mental health professionals. arXiv preprint arXiv:2405.19660. [find](https://scholar.google.com/scholar?q=Ruiyi+Wang%2C+Stephanie+Milani%2C+Jamie+C+Chiu%2C+Jiayin+Zhi%2C+Shaun+M+Eack%2C+Travis+Labrum%2C+Samuel+M+Murphy%2C+Nev+Jones%2C+Kate+Hardy%2C+Hong+Shen%2C+and+1+others%2E+2024%2E+Patient%2D%7B%5C%5CPsi%7D%3A+Using+large+language+models)
43. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824– 24837.
44. G Terence Wilson. 2005. Behavior therapy. [find](https://scholar.google.com/scholar?q=G+Terence+Wilson%2E+2005%2E+Behavior+therapy%2E)
45. Joseph Wolpe. 1990. The practice of behavior therapy. Pergamon press. [find](https://scholar.google.com/scholar?q=Joseph+Wolpe%2E+1990%2E+The+practice+of+behavior+therapy%2E+Pergamon+press%2E)
46. Mengxi Xiao, Qianqian Xie, Ziyan Kuang, Zhicheng Liu, Kailai Yang, Min Peng, Weiguang Han, and Jimin Huang. 2024. Healme: Harnessing cognitive reframing in large language models for psychotherapy. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: L… [find](https://scholar.google.com/scholar?q=Mengxi+Xiao%2C+Qianqian+Xie%2C+Ziyan+Kuang%2C+Zhicheng+Liu%2C+Kailai+Yang%2C+Min+Peng%2C+Weiguang+Han%2C+and+Jimin+Huang%2E+2024%2E+Healme%3A+Harnessing+cognitive+reframing+in+large+language+models+for+psychotherapy%2E+In+)
47. Haojie Xie, Yirong Chen, Xiaofen Xing, Jingkai Lin, and Xiangmin Xu. 2025. [Psydt: Using llms to construct the digital twin of psychological counselor with personalized counseling style for psychological counseling](https://md.research.elamur.ai/free/en/papers/xie-2025-psydt-llms-construct-digital-twin/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Lingui…
48. Dong Xue* Xin Yan. 2023. Mindchat: Psychological large language model. [https://github.com/](https://github.com/) X-D-Lab/MindChat. [↗](https://github.com/)
49. Cristina Zarbo, Giorgio A. Tasca, Francesco Cattafi, and Angelo Compare. 2016. Integrative psychotherapy works. Frontiers in Psychology, Volume 6 - 2015. [find](https://scholar.google.com/scholar?q=Cristina+Zarbo%2C+Giorgio+A%2E+Tasca%2C+Francesco+Cattafi%2C+and+Angelo+Compare%2E+2016%2E+Integrative+psychotherapy+works%2E+Frontiers+in+Psychology%2C+Volume+6+%2D+2015%2E)
50. Min Zeng. 2025. Pychobench: Evaluating the psychology intelligence of large language models. arXiv e-prints, pages arXiv–2510. [find](https://scholar.google.com/scholar?q=Min+Zeng%2E+2025%2E+Pychobench%3A+Evaluating+the+psychology+intelligence+of+large+language+models%2E+arXiv+e%2Dprints%2C+pages+arXiv%E2%80%932510%2E)
51. Chenhao Zhang, Renhao Li, Minghuan Tan, Min Yang, Jingwei Zhu, Di Yang, Jiahao Zhao, Guancheng Ye, Chengming Li, and Xiping Hu. 2024a. Cpsycoun: A report-based multi-turn dialogue reconstruction and evaluation framework for chinese psychological counseling. arXiv preprint arXiv:2405.16433. [find](https://scholar.google.com/scholar?q=Chenhao+Zhang%2C+Renhao+Li%2C+Minghuan+Tan%2C+Min+Yang%2C+Jingwei+Zhu%2C+Di+Yang%2C+Jiahao+Zhao%2C+Guancheng+Ye%2C+Chengming+Li%2C+and+Xiping+Hu%2E+2024a%2E+Cpsycoun%3A+A+report%2Dbased+multi%2Dturn+dialogue+reconstruction+and+e)
52. Mian Zhang, Xianjun Yang, Xinlu Zhang, Travis Labrum, Jamie C Chiu, Shaun M Eack, Fei Fang, William Yang Wang, and Zhiyu Chen. 2025. [Cbt-bench: Evaluating large language models on assisting cognitive behavior therapy](https://md.research.elamur.ai/free/en/papers/zhang-2025-cbt-bench-evaluating-large-language/). In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of th…
53. Zhexin Zhang, Leqi Lei, Lindong Wu, Rui Sun, Yongkang Huang, Chong Long, Xiao Liu, Xuanyu Lei, Jie Tang, and Minlie Huang. 2024b. [Safetybench: Evaluating the safety of large language models](https://md.research.elamur.ai/free/en/papers/zhang-2023-safetybench-evaluating-safety-large/). In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Pa…

*Updated 31 October 2026*