--- title: "Resource-Efficient LLMs for Depression Symptoms Screening:" description: "The paper examines whether small and mid-sized open LLMs can recognise individual DSM-5 depression symptoms in short… 5 references." authors: ["Muhammad Rizwan", "Jure Demšar"] year: 2026 venue: "Proceedings of the Sixth Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric/developmental impairments in cooperation with the MENTAL.ai consortium" source: "https://aclanthology.org/2026.rapid-1.7/" doi: "10.63317/5fkbms3rp4bo" licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)" licence_url: "https://creativecommons.org/licenses/by-nc/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/rizwan-2026-resource-efficient-llms-depression-symptoms/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rizwan-2026-resource-efficient-llms-depression-symptoms/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/47/) / Resource-Efficient LLMs for Depression Symptoms Screening: Performance and Limitations in Zero Shot Setting # Resource-Efficient LLMs for Depression Symptoms Screening: Performance and Limitations in Zero Shot Setting **Authors:** Muhammad Rizwan and Jure Demšar · **Year:** 2026 · **Venue:** [Proceedings of the Sixth Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric/developmental impairments in cooperation with the MENTAL.ai consortium](https://md.research.elamur.ai/free/en/venues/rapid/) ([Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric/developmental impairments in cooperation with the MENTAL.ai consortium 2026](https://md.research.elamur.ai/free/en/venues/rapid/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.rapid-1.7/) · [PDF](https://aclanthology.org/2026.rapid-1.7.pdf) · [DOI 10.63317/5fkbms3rp4bo](https://doi.org/10.63317/5fkbms3rp4bo) · [OpenAlex](https://openalex.org/W7166588748) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary The paper examines whether small and mid-sized open LLMs can recognise individual DSM-5 depression symptoms in short texts without training or examples. The authors used the ReDSM5 dataset of Reddit sentences, labelled by a licensed clinical psychologist for nine DSM-5 symptoms. They removed multi-label sentences and kept symptom-free sentences as a control class. They then prompted eight instruction-tuned models from the Llama 3.2, Mistral and Qwen 2.5 families to act as a clinician and output a single category. Decoding was deterministic. Qwen 2.5-7B performed best. Its 14B sibling did not improve on it, so larger size alone did not yield better symptom recognition. Error analysis showed that the model handles explicit signals such as suicidal ideation well. It often misreads depressed mood, missing irritability and social isolation, or mistaking ordinary sadness for a symptom. The work suggests modest open models could assist initial screening at low compute cost. However, without fine-tuning they risk missing clinically important symptoms and cannot replace professional assessment. ## Key points - **Data:** ReDSM5 (Bao et al., 2025) was filtered to 1,610 single-label sentences in 10 classes: nine symptoms plus "None". Dropping multi-label items removed 129 sentences. The largest classes were None (374) and depressed mood (326), and the smallest was psychomotor (32). - **Models and setup:** - Models tested: Qwen 2.5 (1.5B, 3B, 7B, 14B), Llama 3.2 (1B, 3B) and Mistral (7B, 12B). - Inference: zero-shot prompting, temperature 0 and max_tokens 15. - Non-conforming outputs were discarded as invalid. - **Best result:** Qwen 2.5-7B reached Cohen's κ = 0.603 and Macro F1 = 0.648. Llama-3.2-1B-Instruct was close to chance (κ = 0.060, Macro F1 = 0.089). - **Typical errors:** - Depressed mood and None were frequently confused in both directions. - The model leaned on words like "sad" or "cry". - Neutral-sounding mentions of sleep hours were labelled as no symptom. - **Reproducibility:** The code is published on GitHub as rizwan2phd/zeroshot-depression-symptoms-screening-llms. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [University of Ljubljana](https://md.research.elamur.ai/free/en/universities/university-of-ljubljana/) — University, Ljubljana, Slovenia · 13 works · 38,693 citations 📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Social Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) · 330 works · [🏥 Health Professions](https://md.research.elamur.ai/free/en/shelves/health-professions/) · 75 works · [🏥 Health Information Management](https://md.research.elamur.ai/free/en/shelves/health-professions/health-information-management/) · 56 works 🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works ## Cite Cite as: Muhammad Rizwan and Jure Demšar. 2026. Resource-Efficient LLMs for Depression Symptoms Screening: Performance and Limitations in Zero Shot Setting. Proceedings of the Sixth Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric/developmental impairments in cooperation with the MENTAL.ai consortium. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{rizwan2026resource, title = {{Resource-Efficient LLMs for Depression Symptoms Screening: Performance and Limitations in Zero Shot Setting}}, author = {Muhammad Rizwan and Jure Demšar}, booktitle = {Proceedings of the Sixth Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric/developmental impairments in cooperation with the MENTAL.ai consortium}, year = {2026}, doi = {10.63317/5fkbms3rp4bo}, url = {https://doi.org/10.63317/5fkbms3rp4bo} } ``` - [← previous Resonating with RoPE: Spectral Quantization for High-Fidelity Key Cache Compression](https://md.research.elamur.ai/free/en/papers/wang-2026-resonating-rope-spectral-quantization-high/) - [next → RespiraMFM: A Multimodal Foundation Model with Contrastive Audio-Language Alignment for Respiratory Disease Identification](https://md.research.elamur.ai/free/en/papers/siam-2026-respiramfm-multimodal-foundation-model-contrastive/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/47/) ## References 5 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Information Retrieval Lab, University of A Coruña. 2025. ReDSM5: A Reddit Dataset for DSM-5 Depression Detection. Information Retrieval Lab (IRLab), Universidade da Coruña. Hugging Face Datasets, Mental Health and Clinical NLP Resources, 1.0. PID [https://huggingface.co/datasets/irlab-udc/redsm5](https://huggingface.co/datasets/irlab-udc/redsm5). Red… [↗](https://huggingface.co/datasets/irlab-udc/redsm5) 2. Gwenolé Loas, Guillaume Lefebvre, Marianne Rot-saert, and Yvon Englert. 2018. Relationships between anhedonia, suicidal ideation and suicide attempts in a large sample of physicians. PloS one, 13(3):e0193619. [find](https://scholar.google.com/scholar?q=Gwenol%C3%A9+Loas%2C+Guillaume+Lefebvre%2C+Marianne+Rot%2Dsaert%2C+and+Yvon+Englert%2E+2018%2E+Relationships+between+anhedonia%2C+suicidal+ideation+and+suicide+attempts+in+a+large+sample+of+physicians%2E+PloS+one%2C+13%283%29%3Ae) 3. Lydia Manikonda and Munmun De Choudhury. 2017. Modeling and understanding visual attributes of mental health disclosures in social media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 170–181. [find](https://scholar.google.com/scholar?q=Lydia+Manikonda+and+Munmun+De+Choudhury%2E+2017%2E+Modeling+and+understanding+visual+attributes+of+mental+health+disclosures+in+social+media%2E+In+Proceedings+of+the+2017+CHI+Conference+on+Human+Factors+in+) 4. Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia medica, 22(3):276– 282. [find](https://scholar.google.com/scholar?q=Mary+L+McHugh%2E+2012%2E+Interrater+reliability%3A+the+kappa+statistic%2E+Biochemia+medica%2C+22%283%29%3A276%E2%80%93+282%2E) 5. Mahmud Omar, Shelly Soffer, Alexander W Charney, Isotta Landi, Girish N Nadkarni, and Eyal [find](https://scholar.google.com/scholar?q=Mahmud+Omar%2C+Shelly+Soffer%2C+Alexander+W+Charney%2C+Isotta+Landi%2C+Girish+N+Nadkarni%2C+and+Eyal) *Updated 1 November 2026*