--- title: "NoviceTrio in #SMM4H-HeaRD 2026: Hybrid Clinical Transformer" description: "The paper describes the NoviceTrio team's submissions to #SMM4H-HeaRD 2026 Task 2, which involves finding insomnia in… 5 references." authors: ["Abir Naskar", "Mike Conway"] year: 2026 venue: "Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks" source: "https://aclanthology.org/2026.smm4h-1.51/" doi: "10.18653/v1/2026.smm4h-1.51" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/naskar-2026-novicetrio-smm4h-heard-2026-hybrid/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/naskar-2026-novicetrio-smm4h-heard-2026-hybrid/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/43/) / NoviceTrio in #SMM4H-HeaRD 2026: Hybrid Clinical Transformer Ensembles for Insomnia Detection and Evidence Extraction from Clinical Notes # NoviceTrio in #SMM4H-HeaRD 2026: Hybrid Clinical Transformer Ensembles for Insomnia Detection and Evidence Extraction from Clinical Notes **Authors:** [Abir Naskar](https://md.research.elamur.ai/free/en/authors/abir-naskar/) and [Mike Conway](https://md.research.elamur.ai/free/en/authors/mike-conway/) · **Year:** 2026 · **Venue:** [Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks](https://md.research.elamur.ai/free/en/venues/smm4h/) ([Social Media Mining for Health Research and Applications Workshop and Shared Tasks 2026](https://md.research.elamur.ai/free/en/venues/smm4h/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.smm4h-1.51/) · [PDF](https://aclanthology.org/2026.smm4h-1.51.pdf) · [DOI 10.18653/v1/2026.smm4h-1.51](https://doi.org/10.18653/v1/2026.smm4h-1.51) · [OpenAlex](https://openalex.org/W7166830179) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary The paper describes the NoviceTrio team's submissions to #SMM4H-HeaRD 2026 Task 2, which involves finding insomnia in MIMIC-III discharge notes. The data comprises 156 training and 23 validation notes. Subtask 1 is note-level yes/no classification. Subtask 2 predicts four criteria (Definition 1, Definition 2, Rule B, Rule C) and extracts character-offset evidence for each. System 1 combines two independently fine-tuned models, Qwen3-4B-Instruct and Bio_ClinicalBERT, using a weighted average. Long notes are split into overlapping 512-token windows, and the note score is the maximum over its chunks, a design that deliberately favours recall. System 2 is a single Bio_ClinicalBERT encoder with two heads: one classifies the note, the other assigns BIO tags to tokens to mark evidence spans. Before encoding, sentences are filtered by embedding similarity to an insomnia prototype. Three seed-varied copies vote on the final spans. System 1 has very high recall but low precision. System 2 beats the shared-task mean and median on every Subtask 2 metric. Both systems show workable approaches for screening long clinical texts, and the code is public on GitHub. ## Key points - **Subtask 1 (System 1):** - Recall is 0.9474, well above the mean of 0.6935 and the median of 0.6842. - F1 is 0.6923, slightly above the mean (0.6805) but below the median (0.7037). - Precision is only 0.5455. - **Subtask 2 (System 2) vs. mean/median:** - Label F1: 0.6444 vs. 0.5888/0.6000 - Exact-match span F1: 0.4472 vs. 0.3129/0.3586 - Partial-match span F1: 0.5093 vs. 0.4584/0.4524 - **System 1 ensemble details:** - The ensemble weight α is chosen from 0.3–0.7 on the validation set. - The minority class is handled with inverse-frequency loss weights. - Both models are retrained on train+validation data before final test prediction. - **System 2 pipeline:** - Sentences are split with en_core_sci_sm and embedded with all-MiniLM-L6-v2. - When a note exceeds 90 sentences, the 30 most relevant ones are kept, each with ±1 neighbouring sentence. - Tagging uses 9 BIO classes, and chunks are 500 tokens with a 100-token overlap. - A span survives only if at least 2 of the 3 seed models predict it. - **Stated limitations:** - Only one train/validation split was used, with no cross-validation. - The sentence-filtering heuristics are fixed by hand. - No ablation study was run for System 1. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [The University of Melbourne](https://md.research.elamur.ai/free/en/universities/the-university-of-melbourne/) — University, Melbourne, Australia · 102 works · 22,618 citations 📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Social Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) · 330 works ## Cite Cite as: Abir Naskar and Mike Conway. 2026. NoviceTrio in #SMM4H-HeaRD 2026: Hybrid Clinical Transformer Ensembles for Insomnia Detection and Evidence Extraction from Clinical Notes. Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{naskar2026novicetrio, title = {{NoviceTrio in \#SMM4H-HeaRD 2026: Hybrid Clinical Transformer Ensembles for Insomnia Detection and Evidence Extraction from Clinical Notes}}, author = {Abir Naskar and Mike Conway}, booktitle = {Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks}, year = {2026}, doi = {10.18653/v1/2026.smm4h-1.51}, url = {https://doi.org/10.18653/v1/2026.smm4h-1.51} } ``` - [← previous Noun-noun coordination in English and functional structure in the nominal domain](https://md.research.elamur.ai/free/en/papers/mcinnerney-2026-noun-noun-coordination-english-functional/) - [next → Now You Hear Me: Audio Narrative Attacks Against Large Audio–Language Models](https://md.research.elamur.ai/free/en/papers/yu-2026-now-you-hear-me-audio/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/43/) ## References 5 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… 2. Guillermo Lopez-Garcia, Jose Miguel Acitores Cortina, Jacob Berkowitz, Joey Chan, Ganesh Chandrasekar, Sumon Kanti Dey, Ivan Flores Amaro, Fernando Gallego, Lauren Gryboski, Ari Z Klein, Martin Krallinger, Salvador Lima-López, Tomohiro Nishiyama, Lisa Raithel, Ahmad Rezaie Mianroodi, Roland Roller,… [find](https://scholar.google.com/scholar?q=Guillermo+Lopez%2DGarcia%2C+Jose+Miguel+Acitores+Cortina%2C+Jacob+Berkowitz%2C+Joey+Chan%2C+Ganesh+Chandrasekar%2C+Sumon+Kanti+Dey%2C+Ivan+Flores+Amaro%2C+Fernando+Gallego%2C+Lauren+Gryboski%2C+Ari+Z+Klein%2C+Martin+Kralli) 3. Lance Ramshaw and Mitch Marcus. 1995. [Text chunking using transformation-based learning](https://md.research.elamur.ai/free/en/papers/ramshaw-1995-text-chunking-transformation-based-learning/). In Third Workshop on Very Large Corpora. 4. Nils Reimers and Iryna Gurevych. 2019. [Sentence-bert: Sentence embeddings using siamese bert-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. 5. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388. *Updated 1 November 2026*