--- title: "FU-HU-P5 at #SMM4H-HeaRD 2026 — paper by Wong (2026)" description: "This system paper addresses Task 4 of the #SMM4H-HeaRD 2026 shared task: automatically turning a… 0.39 ROUGE-L. 5 references." authors: ["Jessica Ying En Wong"] year: 2026 venue: "Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks" source: "https://aclanthology.org/2026.smm4h-1.38/" doi: "10.18653/v1/2026.smm4h-1.38" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/wong-2026-fu-hu-p5-smm4h-heard/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wong-2026-fu-hu-p5-smm4h-heard/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/34/) / FU-HU-P5 at #SMM4H-HeaRD 2026: MedSynth Dialogue-to-Note Generation # FU-HU-P5 at #SMM4H-HeaRD 2026: MedSynth Dialogue-to-Note Generation **Authors:** Jessica Ying En Wong · **Year:** 2026 · **Venue:** [Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks](https://md.research.elamur.ai/free/en/venues/smm4h/) ([Social Media Mining for Health Research and Applications Workshop and Shared Tasks 2026](https://md.research.elamur.ai/free/en/venues/smm4h/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.smm4h-1.38/) · [PDF](https://aclanthology.org/2026.smm4h-1.38.pdf) · [DOI 10.18653/v1/2026.smm4h-1.38](https://doi.org/10.18653/v1/2026.smm4h-1.38) · [OpenAlex](https://openalex.org/W7166806208) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary This system paper addresses Task 4 of the #SMM4H-HeaRD 2026 shared task: automatically turning a doctor–patient conversation into a clinical note in SOAP (Subjective, Objective, Assessment, Plan) format. The aim is to reduce the documentation workload on clinicians. The team used the synthetic MedSynth corpus of paired diarized dialogues and SOAP notes. After light cleaning, they fine-tuned the compact Qwen3.5-2B model using QLoRA together with Unsloth and SFTTrainer. Only about half a percent of the weights were updated, and training ran on a single consumer-grade T4 GPU. The abstract also mentions semi-supervised learning, but the method section describes only instruction-based supervised fine-tuning. On the test set, the model reached an average score of 0.44 across BLEU, ROUGE and METEOR, close to its validation average of 0.46. This suggests reasonable generalization for its size. The authors also report that some reference notes contain hallucinated details absent from the dialogues, which is a data-quality concern for MedSynth. The work is relevant as a low-resource baseline for clinical note generation. ## Key points - **Data:** MedSynth splits are 8528 train, 1506 eval and 368 test samples. Filtering removed missing, short (\<50 characters) and duplicate entries, which dropped a single training sample. - **Model setup:** Qwen3.5-2B (max sequence length 2048) was fine-tuned with QLoRA (rank 16, alpha 32, all attention and MLP projections). About 10.9M of 2.22B parameters (0.49%) were trained. Training used lr 2e-4, adamw_8bit, effective batch size 32 and 2 epochs. - **Compute:** Training took roughly 20 hours on one NVIDIA Tesla T4 (fp16). The authors observed frequent loss spikes and recommend gradient clipping and lower learning rates. - **Test scores:** | Metric | Test | Validation | |---|---|---| | BLEU | 0.33 | 0.35 | | ROUGE-1 | 0.60 | 0.61 | | ROUGE-2 | 0.35 | 0.39 | | ROUGE-L | 0.42 | 0.42 | | METEOR | 0.51 | 0.54 | | Average | 0.44 | 0.46 | - **Limitations and authorship:** Overly long prompts degraded output coherence, and scaling to Qwen3.5-4B or 9B is planned. The PDF lists Vardhani, Lee and Wong as authors, not Wong alone. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works 🧭 Topics (1): [🗨️ Dialogue systems](https://md.research.elamur.ai/free/en/topics/dialogue-systems/) · 654 works ## Cite Cite as: Jessica Ying En Wong. 2026. FU-HU-P5 at #SMM4H-HeaRD 2026: MedSynth Dialogue-to-Note Generation. Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{wong2026fu, title = {{FU-HU-P5 at \#SMM4H-HeaRD 2026: MedSynth Dialogue-to-Note Generation}}, author = {Jessica Ying En Wong}, booktitle = {Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks}, year = {2026}, doi = {10.18653/v1/2026.smm4h-1.38}, url = {https://doi.org/10.18653/v1/2026.smm4h-1.38} } ``` - [← previous FTibSuite: A Comprehensive Resource Suite for Tibetan Vision–Language Modeling](https://md.research.elamur.ai/free/en/papers/xu-2026-ftibsuite-comprehensive-resource-suite-tibetan/) - [next → FuseSearch: Learning Adaptive Parallel Execution for Efficient Code Localization](https://md.research.elamur.ai/free/en/papers/xu-2026-fusesearch-learning-adaptive-parallel-execution/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/34/) ## References 5 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. To verify the generalizability of our model, we conducted an evaluation on unseen test dataset. The results demonstrated that the model maintained consistent performance across all primary metrics. [find](https://scholar.google.com/scholar?q=To+verify+the+generalizability+of+our+model%2C+we+conducted+an+evaluation+on+unseen+test+dataset%2E+The+results+demonstrated+that+the+model+maintained+consistent+performance+across+all+primary+metrics%2E) 2. Anjanava Biswas and Wrick Talukdar. 2024. Intelligent clinical documentation: Harnessing generative ai for patient-centric clinical note generation. arXiv preprint arXiv:2405.18346. — [arXiv:2405.18346](https://arxiv.org/abs/2405.18346) [find](https://scholar.google.com/scholar?q=Anjanava+Biswas+and+Wrick+Talukdar%2E+2024%2E+Intelligent+clinical+documentation%3A+Harnessing+generative+ai+for+patient%2Dcentric+clinical+note+generation%2E+arXiv+preprint+arXiv%3A2405%2E18346%2E+%E2%80%94+%5BarXiv%3A2405%2E1834) 3. Limitations and Future Work While the current experiments yielded promising results, several technical limitations were identified during the training process that provide clear directions for future improvements. [find](https://scholar.google.com/scholar?q=Limitations+and+Future+Work+While+the+current+experiments+yielded+promising+results%2C+several+technical+limitations+were+identified+during+the+training+process+that+provide+clear+directions+for+future+) 4. Kundan Krishna, Sopan Khosla, Jeffrey P Bigham, and Zachary C Lipton. 2021. Generating soap notes from doctor-patient conversations using modular summarization techniques. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conf… [find](https://scholar.google.com/scholar?q=Kundan+Krishna%2C+Sopan+Khosla%2C+Jeffrey+P+Bigham%2C+and+Zachary+C+Lipton%2E+2021%2E+Generating+soap+notes+from+doctor%2Dpatient+conversations+using+modular+summarization+techniques%2E+In+Proceedings+of+the+59th+A) 5. Qwen Team. 2026. Qwen3.5: Towards native multimodal agents. 239 3 [find](https://scholar.google.com/scholar?q=Qwen+Team%2E+2026%2E+Qwen3%2E5%3A+Towards+native+multimodal+agents%2E+239+3) *Updated 2 November 2026*