---
title: "How Much Would a Clinician Edit This Draft? Evaluating LLM"
description: "Clinicians are increasingly asked to review LLM-generated drafts of replies to patient portal messages. 72 references."
authors: ["Parker Seegmiller", "Joseph Gatto", "Sarah E. Greer", "Ganza Belise Isingizwe", "Rohan Ray", "Timothy E. Burdick", "Sarah Masud Preum"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1505/"
doi: "10.18653/v1/2026.acl-long.1505"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/seegmiller-2026-how-much-would-clinician-edit/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/seegmiller-2026-how-much-would-clinician-edit/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/32/) / How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting

# How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting

**Authors:** [Parker Seegmiller](https://md.research.elamur.ai/free/en/authors/parker-seegmiller/), [Joseph Gatto](https://md.research.elamur.ai/free/en/authors/joseph-gatto/), Sarah E. Greer, Ganza Belise Isingizwe, Rohan Ray, Timothy E. Burdick and [Sarah Masud Preum](https://md.research.elamur.ai/free/en/authors/sarah-masud-preum/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1505/) · [PDF](https://aclanthology.org/2026.acl-long.1505.pdf) · [DOI 10.18653/v1/2026.acl-long.1505](https://doi.org/10.18653/v1/2026.acl-long.1505) · [OpenAlex](https://openalex.org/W7166863471)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Clinicians are increasingly asked to review LLM-generated drafts of replies to patient portal messages. The authors ask whether such drafts actually reduce their workload or just shift effort into editing. With 13 primary care physicians and nurses, they built a taxonomy of what good clinician replies contain: 8 themes broken into 67 frames. They then created EditJudge, a reference-based LLM-as-judge framework. It estimates how much a clinician would have to delete from or add to a draft, scored as Edit-F1 at two levels: specific content and broader themes. Data come from a US academic hospital's portal. Drafts are conditioned on both the patient message and an EHR summary. The authors tested three local and three commercial LLMs with several adaptation strategies, including thematic prompting, RAG, SFT and DPO. Adapting models around the themes improved drafting by about 33% over 0-shot baselines. Models were weakest at asking patients follow-up questions, and clinician preferences differed widely. The authors conclude that useful drafting will likely require tailoring models to individual clinicians.

## Key points
- **Source data:** 610k portal messages (2020–2024) yielded 146k patient–clinician conversations from 10,105 adult patients. About 144k conversations were used for training and the rest for evaluation.
- **Three evaluation sets:**
  - IPPM: 300 samples, 4 clinicians, theme-guided responses.
  - SyPPM: 100 semi-synthetic samples, publicly released on Hugging Face as `PortalPal-AI/Patient-Message-Response-Drafting`.
  - SoCPPM: 300 real responses sent in practice by 196 clinicians.
- **Taxonomy:** The taxonomy groups reply content into 8 themes: Logistics, Care Coordination and Contingency Planning, alongside Medical Planning, Medical Assessment, Medication Questions, Symptom Questions and Empathy.
- **EditJudge:** Its content-level and theme-level Edit-F1 scores work like precision (what must be removed from a draft) and recall (what must be added). The best models would cut clinician edits by only about 25–26%.
- **Privacy:** Commercial LLMs were run only on the de-identified SyPPM data. All real patient data stayed on a secure server.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Dartmouth College](https://md.research.elamur.ai/free/en/universities/dartmouth-college/) — University, Hanover, United States · 37 works · 42,625 citations

Also on the byline: [Dartmouth Health](https://ror.org/01pa9ed26).

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🩺 Medicine](https://md.research.elamur.ai/free/en/shelves/medicine/) · 241 works · [🩺 Health Informatics](https://md.research.elamur.ai/free/en/shelves/medicine/health-informatics/) · 184 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works

## Cite

Cite as: Parker Seegmiller, Joseph Gatto, Sarah E. Greer, Ganza Belise Isingizwe, Rohan Ray, Timothy E. Burdick and Sarah Masud Preum. 2026. How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{seegmiller2026how,
  title = {{How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting}},
  author = {Parker Seegmiller, Joseph Gatto, Sarah E. Greer, Ganza Belise Isingizwe, Rohan Ray, Timothy E. Burdick and Sarah Masud Preum},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1505},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1505}
}
```

- [← previous How Much Does Persuasion Strategy Matter? LLM-Annotated Evidence from Charitable Donation Dialogues](https://md.research.elamur.ai/free/en/papers/petrova-2026-how-much-does-persuasion-strategy/)
- [next → How to Improve LLMs' Performance on Specific Languages: A Perspective on LLM-Derived Language Similarity](https://md.research.elamur.ai/free/en/papers/shi-2026-how-improve-llms-performance-specific/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/32/)

## References

72 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Sandhini Agarwal, Lama Ahmad, Jason Ai, Sam Altman, Andy Applebaum, Edwin Arbus, Rahul K Arora, Yu Bai, Bowen Baker, Haiming Bao, and 1 others. 2025. [gpt-oss-120b & gpt-oss-20b model card](https://md.research.elamur.ai/free/en/papers/agarwal-2025-gpt-oss-120b-gpt-oss/). arXiv preprint arXiv:2508.10925.
2. AI@Meta. 2024. Llama 3 model card. [find](https://scholar.google.com/scholar?q=AI%40Meta%2E+2024%2E+Llama+3+model+card%2E)
3. Anthropic. 2025. Claude 4.5 sonnet. [find](https://scholar.google.com/scholar?q=Anthropic%2E+2025%2E+Claude+4%2E5+sonnet%2E)
4. Rahul K Arora, Jason Wei, Rebecca Soskin Hicks, Preston Bowman, Joaquin Quiñonero-Candela, Foivos Tsimpourlas, Michael Sharman, Meghan Shah, Andrea Vallone, Alex Beutel, and 1 others. 2025. [Healthbench: Evaluating large language models towards improved human health](https://md.research.elamur.ai/free/en/papers/arora-2025-healthbench-evaluating-large-language-models/). arXiv preprint arXiv:2505.08775.
5. Tita Alissa Bach, Aleksandar Babic, Narae Park, Tor Sporsem, Rasmus Ulfsnes, Henrik Smith-Meyer, and Torkel Skeie. 2024. Using llm-generated draft replies to support human experts in responding to stakeholder inquiries in maritime industry: A real-world case study of industrial ai. arXiv preprint ar… — [arXiv:2412.12732](https://arxiv.org/abs/2412.12732) [find](https://scholar.google.com/scholar?q=Tita+Alissa+Bach%2C+Aleksandar+Babic%2C+Narae+Park%2C+Tor+Sporsem%2C+Rasmus+Ulfsnes%2C+Henrik+Smith%2DMeyer%2C+and+Torkel+Skeie%2E+2024%2E+Using+llm%2Dgenerated+draft+replies+to+support+human+experts+in+responding+to+sta)
6. Elizabeth Baltaro, Wendy Henderson, and Karen M Goldstein. 2022. Patient electronic messaging: 12 tips to save time. Family Practice Management, 29(6):5–9. [find](https://scholar.google.com/scholar?q=Elizabeth+Baltaro%2C+Wendy+Henderson%2C+and+Karen+M+Goldstein%2E+2022%2E+Patient+electronic+messaging%3A+12+tips+to+save+time%2E+Family+Practice+Management%2C+29%286%29%3A5%E2%80%939%2E)
7. Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, Andre Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Sur… — [LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks](https://md.research.elamur.ai/free/en/papers/bavaresco-2024-llms-instead-human-judges-large/)
8. Sally L Baxter, Christopher A Longhurst, Marlene Millen, Amy M Sitapati, and Ming Tai-Seale. 2024. Generative artificial intelligence responses to patient messages in the electronic health record: early lessons learned. JAMIA open, 7(2):ooae028. [find](https://scholar.google.com/scholar?q=Sally+L+Baxter%2C+Christopher+A+Longhurst%2C+Marlene+Millen%2C+Amy+M+Sitapati%2C+and+Ming+Tai%2DSeale%2E+2024%2E+Generative+artificial+intelligence+responses+to+patient+messages+in+the+electronic+health+record%3A+ear)
9. Suhana Bedi, Hejie Cui, Miguel Fuentes, Alyssa Unell, Michael Wornow, Juan M. Banda, Nikesh Kotecha, Timothy Keyes, Yifan Mai, Mert Oez, Hao Qiu, Shrey Jain, Leonardo Schettini, Mehr Kashyap, Jason Alan Fries, Akshay Swaminathan, Philip Chung, Fateme Nateghi, Asad Aali, and 62 others. 2025. Medhelm:… [find](https://scholar.google.com/scholar?q=Suhana+Bedi%2C+Hejie+Cui%2C+Miguel+Fuentes%2C+Alyssa+Unell%2C+Michael+Wornow%2C+Juan+M%2E+Banda%2C+Nikesh+Kotecha%2C+Timothy+Keyes%2C+Yifan+Mai%2C+Mert+Oez%2C+Hao+Qiu%2C+Shrey+Jain%2C+Leonardo+Schettini%2C+Mehr+Kashyap%2C+Jason+Al)
10. Joshua M. Biro, Jessica L. Handley, J. Malcolm Mc-Curry, Adam Visconti, Jeffrey M Weinfeld, J. Gregory Trafton, and Raj M. Ratwani. 2025. Opportunities and risks of artificial intelligence in patient portal messaging in primary care. NPJ Digital Medicine, 8. 32629 10 [find](https://scholar.google.com/scholar?q=Joshua+M%2E+Biro%2C+Jessica+L%2E+Handley%2C+J%2E+Malcolm+Mc%2DCurry%2C+Adam+Visconti%2C+Jeffrey+M+Weinfeld%2C+J%2E+Gregory+Trafton%2C+and+Raj+M%2E+Ratwani%2E+2025%2E+Opportunities+and+risks+of+artificial+intelligence+in+patient+)
11. Charlotte MHHT Bootsma-Robroeks, Jessica D Workum, Stephanie CE Schuit, Anne Hoekman, Tarannom Mehri, Job N Doornberg, Tom P van der Laan, and Rosanne C Schoonbeek. 2025. Ai-generated draft replies to patient messages: exploring effects of implementation. Frontiers in Digital Health, 7:1588143. [find](https://scholar.google.com/scholar?q=Charlotte+MHHT+Bootsma%2DRobroeks%2C+Jessica+D+Workum%2C+Stephanie+CE+Schuit%2C+Anne+Hoekman%2C+Tarannom+Mehri%2C+Job+N+Doornberg%2C+Tom+P+van+der+Laan%2C+and+Rosanne+C+Schoonbeek%2E+2025%2E+Ai%2Dgenerated+draft+replies+to)
12. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77–101. [find](https://scholar.google.com/scholar?q=Virginia+Braun+and+Victoria+Clarke%2E+2006%2E+Using+thematic+analysis+in+psychology%2E+Qualitative+research+in+psychology%2C+3%282%29%3A77%E2%80%93101%2E)
13. Jeffrey Budd. 2023. Burnout related to electronic health record use in primary care. Journal of Primary Care & Community Health, 14. [find](https://scholar.google.com/scholar?q=Jeffrey+Budd%2E+2023%2E+Burnout+related+to+electronic+health+record+use+in+primary+care%2E+Journal+of+Primary+Care+%26+Community+Health%2C+14%2E)
14. Nitay Calderon, Roi Reichart, and Rotem Dror. 2025. [The alternative annotator test for llm-as-a-judge: How to statistically justify replacing human annotators with llms](https://md.research.elamur.ai/free/en/papers/calderon-2025-alternative-annotator-test-llm-as/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 16051– 1…
15. Guiming Hardy Chen, Shunian Chen, Ziche Liu, Feng Jiang, and Benyou Wang. 2024a. [Humans or llms as the judge? a study on judgement biases](https://md.research.elamur.ai/free/en/papers/chen-2024-humans-llms-judge-study-judgement/). arXiv preprint arXiv:2402.10669.
16. Shan Chen, Marco Guevara, Shalini Moningi, Frank Hoebers, Hesham Elhalawani, Benjamin H Kann, Fallon E Chipidza, Jonathan Leeman, Hugo JWL Aerts, Timothy Miller, and 1 others. 2024b. The effect of using a large language model to respond to patient messages. The Lancet Digital Health, 6(6):e379– e381… [find](https://scholar.google.com/scholar?q=Shan+Chen%2C+Marco+Guevara%2C+Shalini+Moningi%2C+Frank+Hoebers%2C+Hesham+Elhalawani%2C+Benjamin+H+Kann%2C+Fallon+E+Chipidza%2C+Jonathan+Leeman%2C+Hugo+JWL+Aerts%2C+Timothy+Miller%2C+and+1+others%2E+2024b%2E+The+effect+of+usi)
17. Wenyuan Chen, Fateme Nateghi Haredasht, Kameron C Black, Francois Grolleau, Emily Alsentzer, Jonathan H Chen, and Stephen P Ma. 2025. Retrieval-augmented guardrails for ai-drafted patient-portal messages: Error taxonomy construction and large-scale evaluation. arXiv preprint arXiv:2509.22565. — [arXiv:2509.22565](https://arxiv.org/abs/2509.22565) [find](https://scholar.google.com/scholar?q=Wenyuan+Chen%2C+Fateme+Nateghi+Haredasht%2C+Kameron+C+Black%2C+Francois+Grolleau%2C+Emily+Alsentzer%2C+Jonathan+H+Chen%2C+and+Stephen+P+Ma%2E+2025%2E+Retrieval%2Daugmented+guardrails+for+ai%2Ddrafted+patient%2Dportal+messa)
18. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, Luke Marris, Sam Petulla, Colin Gaffney, Asaf Aharoni, Nathan Lintz, Tiago Cardal Pais, Henrik Jacobsson, Idan Szpektor, Nan-Jiang Jiang, and 3416 [other…](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/)
19. Eden English, Janelle Laughlin, Jeffrey Sippel, Matthew DeCamp, and Chen-Tan Lin. 2024a. Utility of artificial intelligence–generative draft replies to patient messages. JAMA Network Open, 7(10):e2438573– e2438573. [find](https://scholar.google.com/scholar?q=Eden+English%2C+Janelle+Laughlin%2C+Jeffrey+Sippel%2C+Matthew+DeCamp%2C+and+Chen%2DTan+Lin%2E+2024a%2E+Utility+of+artificial+intelligence%E2%80%93generative+draft+replies+to+patient+messages%2E+JAMA+Network+Open%2C+7%2810%29%3Ae2438)
20. Eden F. English, Janelle Laughlin, Jeffrey Sippel, Matthew DeCamp, and Chen-Tan Lin. 2024b. Utility of artificial intelligence–generative draft replies to patient messages. JAMA Network Open, 7. [find](https://scholar.google.com/scholar?q=Eden+F%2E+English%2C+Janelle+Laughlin%2C+Jeffrey+Sippel%2C+Matthew+DeCamp%2C+and+Chen%2DTan+Lin%2E+2024b%2E+Utility+of+artificial+intelligence%E2%80%93generative+draft+replies+to+patient+messages%2E+JAMA+Network+Open%2C+7%2E)
21. Jordan Eschler, Leslie S Liu, Lisa M Vizer, Jennifer B McClure, Paula Lozano, Wanda Pratt, and James D Ralston. 2015. Designing asynchronous communication tools for optimization of patient-clinician coordination. In AMIA Annual Symposium Proceedings, volume 2015, page 543. [find](https://scholar.google.com/scholar?q=Jordan+Eschler%2C+Leslie+S+Liu%2C+Lisa+M+Vizer%2C+Jennifer+B+McClure%2C+Paula+Lozano%2C+Wanda+Pratt%2C+and+James+D+Ralston%2E+2015%2E+Designing+asynchronous+communication+tools+for+optimization+of+patient%2Dclinician+c)
22. Patricia Garcia, Stephen P. Ma, Shreya J. Shah, Margaret Smith, Yejin Jeong, Anna Devon-Sand, Ming Tai-Seale, Kevin Takazawa, Danyelle Clutter, Kyle Vogt, Carlene Lugtu, Matthew Rojo, Steven Lin, Tait Shanafelt, Michael A. Pfeffer, and Christopher Sharp. 2024. Artificial intelligence–generated draft… [find](https://scholar.google.com/scholar?q=Patricia+Garcia%2C+Stephen+P%2E+Ma%2C+Shreya+J%2E+Shah%2C+Margaret+Smith%2C+Yejin+Jeong%2C+Anna+Devon%2DSand%2C+Ming+Tai%2DSeale%2C+Kevin+Takazawa%2C+Danyelle+Clutter%2C+Kyle+Vogt%2C+Carlene+Lugtu%2C+Matthew+Rojo%2C+Steven+Lin%2C+Tait)
23. Joseph Gatto, Parker Seegmiller, Timothy Burdick, Philip Resnik, Roshnik Rahat, Sarah DeLozier, and Sarah M Preum. 2026. Medical triage as pairwise ranking: A benchmark for urgency in patient portal messages. arXiv preprint arXiv:2601.13178. — [arXiv:2601.13178](https://arxiv.org/abs/2601.13178) [find](https://scholar.google.com/scholar?q=Joseph+Gatto%2C+Parker+Seegmiller%2C+Timothy+Burdick%2C+Philip+Resnik%2C+Roshnik+Rahat%2C+Sarah+DeLozier%2C+and+Sarah+M+Preum%2E+2026%2E+Medical+triage+as+pairwise+ranking%3A+A+benchmark+for+urgency+in+patient+portal+m)
24. Joseph Gatto, Parker Seegmiller, Timothy E. Burdick, Inas S. Khayal, Sarah DeLozier, and Sarah M. Preum. 2025. Follow-up question generation for enhanced patient-provider conversations. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)… [find](https://scholar.google.com/scholar?q=Joseph+Gatto%2C+Parker+Seegmiller%2C+Timothy+E%2E+Burdick%2C+Inas+S%2E+Khayal%2C+Sarah+DeLozier%2C+and+Sarah+M%2E+Preum%2E+2025%2E+Follow%2Dup+question+generation+for+enhanced+patient%2Dprovider+conversations%2E+In+Proceedings)
25. Joseph Gatto, Parker Seegmiller, Timothy E. Burdick, and Sarah M. Preum. 2024. In-context learning for preserving patient privacy: A framework for synthesizing realistic patient portal messages. In Machine Learning for Health (ML4H) Findings. [find](https://scholar.google.com/scholar?q=Joseph+Gatto%2C+Parker+Seegmiller%2C+Timothy+E%2E+Burdick%2C+and+Sarah+M%2E+Preum%2E+2024%2E+In%2Dcontext+learning+for+preserving+patient+privacy%3A+A+framework+for+synthesizing+realistic+patient+portal+messages%2E+In+Ma)
26. Joseph Gatto, Parker Seegmiller, Garrett Johnston, and Sarah Masud Preum. 2022. Identifying the perceived severity of patient-generated telemedical queries regarding covid: Developing and evaluating a transfer learning–based solution. JMIR Medical Informatics, 10(9):e37770. [find](https://scholar.google.com/scholar?q=Joseph+Gatto%2C+Parker+Seegmiller%2C+Garrett+Johnston%2C+and+Sarah+Masud+Preum%2E+2022%2E+Identifying+the+perceived+severity+of+patient%2Dgenerated+telemedical+queries+regarding+covid%3A+Developing+and+evaluating+a)
27. Emma Croxford, Yanjun Gao, Elliot First, Nicholas Pellegrino, Miranda Schnier, John Caskey, Madeline Oguss, Graham Wills, Guanhua Chen, Dmitriy Dligach, and 1 others. 2025. Automating evaluation of ai text generation in healthcare with a large language model (llm)-as-a-judge. medRxiv, pages 2025–04. [find](https://scholar.google.com/scholar?q=Emma+Croxford%2C+Yanjun+Gao%2C+Elliot+First%2C+Nicholas+Pellegrino%2C+Miranda+Schnier%2C+John+Caskey%2C+Madeline+Oguss%2C+Graham+Wills%2C+Guanhua+Chen%2C+Dmitriy+Dligach%2C+and+1+others%2E+2025%2E+Automating+evaluation+of+ai)
28. Ariana Genovese, Sahar Borna, Cesar Abraham Gomez-Cabello, Syed Ali Haider, Srinivasagam Prabha, Maissa Trabilsy, Cui Tao, Keith T Aziz, Peter M. Murray, and AJ Forte. 2025. Artificial intelligence for patient support: Assessing retrieval-augmented generation for answering postoperative rhinoplasty… [find](https://scholar.google.com/scholar?q=Ariana+Genovese%2C+Sahar+Borna%2C+Cesar+Abraham+Gomez%2DCabello%2C+Syed+Ali+Haider%2C+Srinivasagam+Prabha%2C+Maissa+Trabilsy%2C+Cui+Tao%2C+Keith+T+Aziz%2C+Peter+M%2E+Murray%2C+and+AJ+Forte%2E+2025%2E+Artificial+intelligence+fo)
29. Cathal Doyle, Laura Lennox, and Derek Bell. 2013. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ open, 3(1):e001570. [find](https://scholar.google.com/scholar?q=Cathal+Doyle%2C+Laura+Lennox%2C+and+Derek+Bell%2E+2013%2E+A+systematic+review+of+evidence+on+the+links+between+patient+experience+and+clinical+safety+and+effectiveness%2E+BMJ+open%2C+3%281%29%3Ae001570%2E)
30. Ashwin Kumar Gururajan, Enrique Lopez-Cuena, Jordi Bayarri-Planas, Adrian Tormos, Daniel Hinjos, Pablo Bernabeu-Perez, Anna Arias-Duart, Pablo Agustin Martin-Torres, Lucia Urcelay-Ganzabal, Marta 32630 11 [find](https://scholar.google.com/scholar?q=Ashwin+Kumar+Gururajan%2C+Enrique+Lopez%2DCuena%2C+Jordi+Bayarri%2DPlanas%2C+Adrian+Tormos%2C+Daniel+Hinjos%2C+Pablo+Bernabeu%2DPerez%2C+Anna+Arias%2DDuart%2C+Pablo+Agustin+Martin%2DTorres%2C+Lucia+Urcelay%2DGanzabal%2C+Marta+3263)
31. Gonzalez-Mallo, Sergio Alvarez-Napagao, Eduard Ayguadé-Parra, and Ulises Cortés Dario Garcia-Gasulla. 2024. Aloe: A family of fine-tuned open healthcare llms. Preprint, arXiv:2405.01886. — [arXiv:2405.01886](https://arxiv.org/abs/2405.01886) [find](https://scholar.google.com/scholar?q=Gonzalez%2DMallo%2C+Sergio+Alvarez%2DNapagao%2C+Eduard+Ayguad%C3%A9%2DParra%2C+and+Ulises+Cort%C3%A9s+Dario+Garcia%2DGasulla%2E+2024%2E+Aloe%3A+A+family+of+fine%2Dtuned+open+healthcare+llms%2E+Preprint%2C+arXiv%3A2405%2E01886%2E+%E2%80%94+%5BarXiv%3A2405)
32. Paul KJ Han, Tania D Strout, Caitlin Gutheil, Carl Germann, Brian King, Eirik Ofstad, Pål Gulbrand-sen, and Robert Trowbridge. 2021. How physicians manage medical uncertainty: a qualitative study and conceptual taxonomy. Medical decision making, 41(3):275–291. [find](https://scholar.google.com/scholar?q=Paul+KJ+Han%2C+Tania+D+Strout%2C+Caitlin+Gutheil%2C+Carl+Germann%2C+Brian+King%2C+Eirik+Ofstad%2C+P%C3%A5l+Gulbrand%2Dsen%2C+and+Robert+Trowbridge%2E+2021%2E+How+physicians+manage+medical+uncertainty%3A+a+qualitative+study+and+)
33. Paul A Harris, Robert Taylor, Robert Thielke, Jonathon Payne, Nathaniel Gonzalez, and Jose G Conde. 2009. Research electronic data capture (redcap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2):37… [find](https://scholar.google.com/scholar?q=Paul+A+Harris%2C+Robert+Taylor%2C+Robert+Thielke%2C+Jonathon+Payne%2C+Nathaniel+Gonzalez%2C+and+Jose+G+Conde%2E+2009%2E+Research+electronic+data+capture+%28redcap%29%E2%80%94a+metadata%2Ddriven+methodology+and+workflow+process+f)
34. Di Hu, Yawen Guo, Yiliang Zhou, Lidia Flores, and Kai Zheng. 2025. A systematic review of early evidence on generative ai for drafting responses to patient messages. npj Health Systems, 2(1):27. [find](https://scholar.google.com/scholar?q=Di+Hu%2C+Yawen+Guo%2C+Yiliang+Zhou%2C+Lidia+Flores%2C+and+Kai+Zheng%2E+2025%2E+A+systematic+review+of+early+evidence+on+generative+ai+for+drafting+responses+to+patient+messages%2E+npj+Health+Systems%2C+2%281%29%3A27%2E)
35. Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, and 1 others. 2022. [Lora: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). ICLR, 1(2):3.
36. Jiaming Ji, Mickel Liu, Josef Dai, Xuehai Pan, Chi Zhang, Ce Bian, Boyuan Chen, Ruiyang Sun, Yizhou Wang, and Yaodong Yang. 2023. [Beavertails: Towards improved safety alignment of llm via a human-preference dataset](https://md.research.elamur.ai/free/en/papers/ji-2023-beavertails-towards-improved-safety-alignment/). Advances in Neural Information Processing Systems, 36:24678–24704.
37. Thinking Machines John Schulman. 2025. Lora without regret. [find](https://scholar.google.com/scholar?q=Thinking+Machines+John+Schulman%2E+2025%2E+Lora+without+regret%2E)
38. Marina Jovic and Salaheddine Mnasri. 2024. Evaluating ai-generated emails: A comparative efficiency analysis. World Journal of English Language, 14(2). [find](https://scholar.google.com/scholar?q=Marina+Jovic+and+Salaheddine+Mnasri%2E+2024%2E+Evaluating+ai%2Dgenerated+emails%3A+A+comparative+efficiency+analysis%2E+World+Journal+of+English+Language%2C+14%282%29%2E)
39. Minal S Kale and Deborah Korenstein. 2018. Overdiagnosis in primary care: framing the problem and finding solutions. Bmj, 362. [find](https://scholar.google.com/scholar?q=Minal+S+Kale+and+Deborah+Korenstein%2E+2018%2E+Overdiagnosis+in+primary+care%3A+framing+the+problem+and+finding+solutions%2E+Bmj%2C+362%2E)
40. Jiyeong Kim, Michael L Chen, Shawheen J Rezaei, April S Liang, Susan M Seav, Sonia Onyeka, Julie J Lee, Shivam C Vedak, David Mui, Rayhan A Lal, and 1 others. 2024. Perspectives on artificial intelligence– generated responses to patient messages. JAMA Network Open, 7(10):e2438535–e2438535. [find](https://scholar.google.com/scholar?q=Jiyeong+Kim%2C+Michael+L+Chen%2C+Shawheen+J+Rezaei%2C+April+S+Liang%2C+Susan+M+Seav%2C+Sonia+Onyeka%2C+Julie+J+Lee%2C+Shivam+C+Vedak%2C+David+Mui%2C+Rayhan+A+Lal%2C+and+1+others%2E+2024%2E+Perspectives+on+artificial+intellig)
41. Jack Krolik, Herprit Mahal, Feroz Ahmad, Gaurav Trivedi, and Bahador Saket. 2024. Towards leveraging large language models for automated medical q&a evaluation. arXiv preprint arXiv:2409.01941. — [arXiv:2409.01941](https://arxiv.org/abs/2409.01941) [find](https://scholar.google.com/scholar?q=Jack+Krolik%2C+Herprit+Mahal%2C+Feroz+Ahmad%2C+Gaurav+Trivedi%2C+and+Bahador+Saket%2E+2024%2E+Towards+leveraging+large+language+models+for+automated+medical+q%26a+evaluation%2E+arXiv+preprint+arXiv%3A2409%2E01941%2E+%E2%80%94+%5BarX)
42. Elina Laukka, Moona Huhtakangas, Tarja Heponiemi, Sari Kujala, Anu-Marja Kaihlanen, Kia Gluschkoff, and Outi Kanste. 2020. Health care professionals’ experiences of patient-professional communication over patient portals: systematic review of qualitative studies. Journal of Medical Internet Research… [find](https://scholar.google.com/scholar?q=Elina+Laukka%2C+Moona+Huhtakangas%2C+Tarja+Heponiemi%2C+Sari+Kujala%2C+Anu%2DMarja+Kaihlanen%2C+Kia+Gluschkoff%2C+and+Outi+Kanste%2E+2020%2E+Health+care+professionals%E2%80%99+experiences+of+patient%2Dprofessional+communication+)
43. Dawei Li, Bohan Jiang, Liangjie Huang, Alimohammad Beigi, Chengshuai Zhao, Zhen Tan, Amrita Bhattacharjee, Yuxuan Jiang, Canyu Chen, Tianhao Wu, and 1 others. 2025. From generation to judgment: Opportunities and challenges of llm-as-a-judge. In Proceedings of the 2025 Conference on Empirical Methods… [find](https://scholar.google.com/scholar?q=Dawei+Li%2C+Bohan+Jiang%2C+Liangjie+Huang%2C+Alimohammad+Beigi%2C+Chengshuai+Zhao%2C+Zhen+Tan%2C+Amrita+Bhattacharjee%2C+Yuxuan+Jiang%2C+Canyu+Chen%2C+Tianhao+Wu%2C+and+1+others%2E+2025%2E+From+generation+to+judgment%3A+Opport)
44. Haitao Li, Qian Dong, Junjie Chen, Huixue Su, Yujia Zhou, Qingyao Ai, Ziyi Ye, and Yiqun Liu. 2024. [Llms-as-judges: a comprehensive survey on llm-based evaluation methods](https://md.research.elamur.ai/free/en/papers/li-2024-llms-judges-comprehensive-survey-llm/). arXiv preprint arXiv:2412.05579.
45. Shuyue Stella Li, Jimin Mun, Faeze Brahman, Pedram Hosseini, Bryceton G Thomas, Jessica M Sin, Bing Ren, Jonathan S Ilgen, Yulia Tsvetkov, and Maarten Sap. Alfa: Aligning llms to ask good questions a case study in clinical reasoning. In Second Conference on Language Modeling. [find](https://scholar.google.com/scholar?q=Shuyue+Stella+Li%2C+Jimin+Mun%2C+Faeze+Brahman%2C+Pedram+Hosseini%2C+Bryceton+G+Thomas%2C+Jessica+M+Sin%2C+Bing+Ren%2C+Jonathan+S+Ilgen%2C+Yulia+Tsvetkov%2C+and+Maarten+Sap%2E+Alfa%3A+Aligning+llms+to+ask+good+questions+a+)
46. Yen-Ting Lin and Yun-Nung Chen. 2023. [Llm-eval: Unified multi-dimensional automatic evaluation for open-domain conversations with large language models](https://md.research.elamur.ai/free/en/papers/lin-2023-llm-eval-unified-multi-dimensional/). In Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023), pages 47–58.
47. Siru Liu, Allison B McCoy, Aileen P Wright, Babatunde Carew, Julian Z Genkins, Sean S Huang, Josh F Peterson, Bryan Steitz, and Adam Wright. 2024. Leveraging large language models for generating responses to patient messages—a subjective analysis. Journal of the American Medical Informatics Associat… [find](https://scholar.google.com/scholar?q=Siru+Liu%2C+Allison+B+McCoy%2C+Aileen+P+Wright%2C+Babatunde+Carew%2C+Julian+Z+Genkins%2C+Sean+S+Huang%2C+Josh+F+Peterson%2C+Bryan+Steitz%2C+and+Adam+Wright%2E+2024%2E+Leveraging+large+language+models+for+generating+respo)
48. Ivan Lorencin, Nikola Tankovic, and Darko Etinger. 2025. Optimizing healthcare efficiency with local large language models. [find](https://scholar.google.com/scholar?q=Ivan+Lorencin%2C+Nikola+Tankovic%2C+and+Darko+Etinger%2E+2025%2E+Optimizing+healthcare+efficiency+with+local+large+language+models%2E)
49. Intelligent Human Systems Integration (IHSI 2025): Integrating People and Intelligent Systems, 160(160). [find](https://scholar.google.com/scholar?q=Intelligent+Human+Systems+Integration+%28IHSI+2025%29%3A+Integrating+People+and+Intelligent+Systems%2C+160%28160%29%2E)
50. Kathryn A. Martinez, Rebecca Schulte, Michael B. Rothberg, Maria C Tang, and Elizabeth R. Pfoh. 2023. Patient portal message volume and time spent on the ehr: an observational study of primary care clinicians. Journal of General Internal Medicine, 39:566 – 572. [find](https://scholar.google.com/scholar?q=Kathryn+A%2E+Martinez%2C+Rebecca+Schulte%2C+Michael+B%2E+Rothberg%2C+Maria+C+Tang%2C+and+Elizabeth+R%2E+Pfoh%2E+2023%2E+Patient+portal+message+volume+and+time+spent+on+the+ehr%3A+an+observational+study+of+primary+care+cl)
51. Frederick North, Kristine E Luhman, Eric A Mallmann, Toby J Mallmann, Sidna M. Tulledge-Scheitel, Emily J North, and Jennifer L. Pecina. 2019. A retrospective analysis of provider-to-patient secure messages: How much are they increasing, who is doing the work, and is the work happening after hours?… [find](https://scholar.google.com/scholar?q=Frederick+North%2C+Kristine+E+Luhman%2C+Eric+A+Mallmann%2C+Toby+J+Mallmann%2C+Sidna+M%2E+Tulledge%2DScheitel%2C+Emily+J+North%2C+and+Jennifer+L%2E+Pecina%2E+2019%2E+A+retrospective+analysis+of+provider%2Dto%2Dpatient+secure+me)
52. Sarah Masud Preum, Sirajum Munir, Meiyi Ma, Mohammad Samin Yasar, David J Stone, Ronald Williams, Homa Alemzadeh, and John A Stankovic. 2021. A review of cognitive assistants for healthcare: Trends, prospects, and future directions. ACM Computing Surveys (CSUR), 53(6):1–37. 32631 12 [find](https://scholar.google.com/scholar?q=Sarah+Masud+Preum%2C+Sirajum+Munir%2C+Meiyi+Ma%2C+Mohammad+Samin+Yasar%2C+David+J+Stone%2C+Ronald+Williams%2C+Homa+Alemzadeh%2C+and+John+A+Stankovic%2E+2021%2E+A+review+of+cognitive+assistants+for+healthcare%3A+Trends%2C+p)
53. Shuying Qiao, Paul Denny, and Nasser Giacaman. 2025. Oversight in action: experiences with instructor-moderated llm responses in an online discussion forum. In Proceedings of the 27th Australasian Computing Education Conference, pages 95–104. [find](https://scholar.google.com/scholar?q=Shuying+Qiao%2C+Paul+Denny%2C+and+Nasser+Giacaman%2E+2025%2E+Oversight+in+action%3A+experiences+with+instructor%2Dmoderated+llm+responses+in+an+online+discussion+forum%2E+In+Proceedings+of+the+27th+Australasian+Com)
54. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2023. [Direct preference optimization: Your language model is secretly a reward model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/). Advances in neural information processing systems, 36:53728–53741.
55. Nils Reimers and Iryna Gurevych. 2019. [Sentence-bert: Sentence embeddings using siamese bert-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992.
56. Matthew Sakumoto and Aditi U. Joshi. 2023. Digital empathy 2.0: Connecting with patients using the written word. Telehealth and Medicine Today, 8(5). [find](https://scholar.google.com/scholar?q=Matthew+Sakumoto+and+Aditi+U%2E+Joshi%2E+2023%2E+Digital+empathy+2%2E0%3A+Connecting+with+patients+using+the+written+word%2E+Telehealth+and+Medicine+Today%2C+8%285%29%2E)
57. Malik Sallam, Nesreen A Salim, Muna Barakat, and Ala’a B Al-Tammemi. 2023. Chatgpt applications in medical, dental, pharmacy, and public health education: A descriptive study highlighting the advantages and limitations. Narra j, 3(1):e103. [find](https://scholar.google.com/scholar?q=Malik+Sallam%2C+Nesreen+A+Salim%2C+Muna+Barakat%2C+and+Ala%E2%80%99a+B+Al%2DTammemi%2E+2023%2E+Chatgpt+applications+in+medical%2C+dental%2C+pharmacy%2C+and+public+health+education%3A+A+descriptive+study+highlighting+the+advantag)
58. Ian A Scott, Anton Van Der Vegt, Paul Lane, Steven McPhail, and Farah Magrabi. 2024. Achieving large-scale clinician adoption of ai-enabled decision support. BMJ Health & Care Informatics, 31(1):e100971. [find](https://scholar.google.com/scholar?q=Ian+A+Scott%2C+Anton+Van+Der+Vegt%2C+Paul+Lane%2C+Steven+McPhail%2C+and+Farah+Magrabi%2E+2024%2E+Achieving+large%2Dscale+clinician+adoption+of+ai%2Denabled+decision+support%2E+BMJ+Health+%26+Care+Informatics%2C+31%281%29%3Ae1009)
59. Rahul Sharma, Pragnya Ramjee, Kaushik Murali, and Mohit Jain. Editing with ai: How doctors refine llm-generated answers to patient queries. In The Second Workshop on GenAI for Health: Potential, Trust, and Policy Compliance. William R Small, Batia Wiesenfeld, Beatrix Brandfield-Harvey, Zoe Jonassen,… [find](https://scholar.google.com/scholar?q=Rahul+Sharma%2C+Pragnya+Ramjee%2C+Kaushik+Murali%2C+and+Mohit+Jain%2E+Editing+with+ai%3A+How+doctors+refine+llm%2Dgenerated+answers+to+patient+queries%2E+In+The+Second+Workshop+on+GenAI+for+Health%3A+Potential%2C+Trust)
60. John A Stankovic, Meiyi Ma, Sarah Masud Preum, and Homa Alemzadeh. 2021. Challenges and directions for ambient intelligence: A cyber physical systems perspective. In 2021 IEEE Third International Conference on Cognitive Machine Intelligence (CogMI), pages 232–241. IEEE. [find](https://scholar.google.com/scholar?q=John+A+Stankovic%2C+Meiyi+Ma%2C+Sarah+Masud+Preum%2C+and+Homa+Alemzadeh%2E+2021%2E+Challenges+and+directions+for+ambient+intelligence%3A+A+cyber+physical+systems+perspective%2E+In+2021+IEEE+Third+International+Conf)
61. Moira Stewart. 1995. Effective physician-patient communication and health outcomes: a review. CMAJ : Canadian Medical Association journal = journal de l’Association medicale canadienne, 152 9:1423–33. [find](https://scholar.google.com/scholar?q=Moira+Stewart%2E+1995%2E+Effective+physician%2Dpatient+communication+and+health+outcomes%3A+a+review%2E+CMAJ+%3A+Canadian+Medical+Association+journal+%3D+journal+de+l%E2%80%99Association+medicale+canadienne%2C+152+9%3A1423%E2%80%9333%2E)
62. P TaftiAhmad and 1 others. 2021. Probing patient messages enhanced by natural language processing: a top-down message corpus analysis. Health Data Science. [find](https://scholar.google.com/scholar?q=P+TaftiAhmad+and+1+others%2E+2021%2E+Probing+patient+messages+enhanced+by+natural+language+processing%3A+a+top%2Ddown+message+corpus+analysis%2E+Health+Data+Science%2E)
63. Ming Tai-Seale, Sally L Baxter, Florin Vaida, Amanda Walker, Amy Sitapati, Chad Osborne, Joseph Diaz, Nimit Desai, Sophie Webb, Gregory Polston, Teresa Helsten, Erin Gross, Jessica Thackaberry, Ammar Mandvi, Dustin Lillie, Steve Li, Geneen T Gin, Suraj A Achar, Heather Hofflich, and 3 others. 2024.… [find](https://scholar.google.com/scholar?q=Ming+Tai%2DSeale%2C+Sally+L+Baxter%2C+Florin+Vaida%2C+Amanda+Walker%2C+Amy+Sitapati%2C+Chad+Osborne%2C+Joseph+Diaz%2C+Nimit+Desai%2C+Sophie+Webb%2C+Gregory+Polston%2C+Teresa+Helsten%2C+Erin+Gross%2C+Jessica+Thackaberry%2C+Ammar+)
64. Qwen Team. 2024. Qwen2.5: A party of foundation models. [find](https://scholar.google.com/scholar?q=Qwen+Team%2E+2024%2E+Qwen2%2E5%3A+A+party+of+foundation+models%2E)
65. Qwen Team. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). Preprint, arXiv:2505.09388.
66. Louise Underdahl, Mary Ditri, and Lunthita M Duthely. 2024. Physician burnout: Evidence-based roadmaps to prioritizing and supporting personal wellbeing. Journal of Healthcare Leadership, 16:15 – 27. [find](https://scholar.google.com/scholar?q=Louise+Underdahl%2C+Mary+Ditri%2C+and+Lunthita+M+Duthely%2E+2024%2E+Physician+burnout%3A+Evidence%2Dbased+roadmaps+to+prioritizing+and+supporting+personal+wellbeing%2E+Journal+of+Healthcare+Leadership%2C+16%3A15+%E2%80%93+27%2E)
67. Minghao Wu and Alham Fikri Aji. 2025. [Style over substance: Evaluation biases for large language models](https://md.research.elamur.ai/free/en/papers/wu-2025-style-over-substance-evaluation-biases/). In Proceedings of the 31st International Conference on Computational Linguistics.
68. Qi Yan, Zheng Jiang, Zachary Harbin, Preston H Tolbert, and Mark G Davies. 2021. Exploring the relationship between electronic health records and provider burnout: a systematic review. Journal of the American Medical Informatics Association, 28(5):1009– 1021. [find](https://scholar.google.com/scholar?q=Qi+Yan%2C+Zheng+Jiang%2C+Zachary+Harbin%2C+Preston+H+Tolbert%2C+and+Mark+G+Davies%2E+2021%2E+Exploring+the+relationship+between+electronic+health+records+and+provider+burnout%3A+a+systematic+review%2E+Journal+of+the+)
69. Justin Zhao, Timothy Wang, Wael Abid, Geoffrey Angus, Arnav Garg, Jeffery Kinnison, Alex Sherstinsky, Piero Molino, Travis Addair, and Devvret Rishi. 2024. Lora land: 310 fine-tuned llms that rival gpt-4, a technical report. arXiv preprint arXiv:2405.00732. [find](https://scholar.google.com/scholar?q=Justin+Zhao%2C+Timothy+Wang%2C+Wael+Abid%2C+Geoffrey+Angus%2C+Arnav+Garg%2C+Jeffery+Kinnison%2C+Alex+Sherstinsky%2C+Piero+Molino%2C+Travis+Addair%2C+and+Devvret+Rishi%2E+2024%2E+Lora+land%3A+310+fine%2Dtuned+llms+that+rival+gp)
70. M. Zhao, I. Y. Oh, A. Gupta, S. Cohen-Cutler, K. M. Harmoney, A. M. Lai, and B. A. Sisk. 2025. Automating evaluation of llm-generated responses to patient questions about rare diseases. In medRxiv. [find](https://scholar.google.com/scholar?q=M%2E+Zhao%2C+I%2E+Y%2E+Oh%2C+A%2E+Gupta%2C+S%2E+Cohen%2DCutler%2C+K%2E+M%2E+Harmoney%2C+A%2E+M%2E+Lai%2C+and+B%2E+A%2E+Sisk%2E+2025%2E+Automating+evaluation+of+llm%2Dgenerated+responses+to+patient+questions+about+rare+diseases%2E+In+medRxiv%2E)
71. Juexiao Zhou, Xiaonan He, Liyuan Sun, Jiannan Xu, Xiuying Chen, Yuetan Chu, Longxi Zhou, Xingyu Liao, Bin Zhang, and Xin Gao. 2023. Skingpt-4: an interactive dermatology diagnostic system with visual large language model. arXiv preprint arXiv:2304.10691. — [arXiv:2304.10691](https://arxiv.org/abs/2304.10691) [find](https://scholar.google.com/scholar?q=Juexiao+Zhou%2C+Xiaonan+He%2C+Liyuan+Sun%2C+Jiannan+Xu%2C+Xiuying+Chen%2C+Yuetan+Chu%2C+Longxi+Zhou%2C+Xingyu+Liao%2C+Bin+Zhang%2C+and+Xin+Gao%2E+2023%2E+Skingpt%2D4%3A+an+interactive+dermatology+diagnostic+system+with+visual+)
72. Si Sun, Xiaomu Zhou, Joshua C Denny, Trent S Rosenbloom, and Hua Xu. 2013. Messaging to your doctors: understanding patient-provider communications via a portal system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1739–1748. 32632 13 [find](https://scholar.google.com/scholar?q=Si+Sun%2C+Xiaomu+Zhou%2C+Joshua+C+Denny%2C+Trent+S+Rosenbloom%2C+and+Hua+Xu%2E+2013%2E+Messaging+to+your+doctors%3A+understanding+patient%2Dprovider+communications+via+a+portal+system%2E+In+Proceedings+of+the+SIGCHI+Co)

*Updated 1 November 2026*