--- title: "DNT at #SMM4H–HeaRD 2026 — paper by Tien and Văn (2026)" description: "The authors, a team from the University of Information Technology (VNU-HCM), took part in two #SMM4H-HeaRD 2026 shared… 4 references." authors: ["Doan Nhat Tien", "Thìn \\DJặng Văn"] year: 2026 venue: "Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks" source: "https://aclanthology.org/2026.smm4h-1.7/" doi: "10.18653/v1/2026.smm4h-1.7" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/tien-2026-dnt-smm4h-heard-2026-leveraging/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/tien-2026-dnt-smm4h-heard-2026-leveraging/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/27/) / DNT at #SMM4H–HeaRD 2026: Leveraging BERT-based Encoders and LLMs for Medical Information Extraction # DNT at #SMM4H–HeaRD 2026: Leveraging BERT-based Encoders and LLMs for Medical Information Extraction **Authors:** Doan Nhat Tien and [Thìn \\DJặng Văn](https://md.research.elamur.ai/free/en/authors/thin-djang-van/) · **Year:** 2026 · **Venue:** [Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks](https://md.research.elamur.ai/free/en/venues/smm4h/) ([Social Media Mining for Health Research and Applications Workshop and Shared Tasks 2026](https://md.research.elamur.ai/free/en/venues/smm4h/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.smm4h-1.7/) · [PDF](https://aclanthology.org/2026.smm4h-1.7.pdf) · [DOI 10.18653/v1/2026.smm4h-1.7](https://doi.org/10.18653/v1/2026.smm4h-1.7) · [OpenAlex](https://openalex.org/W7166890064) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary The authors, a team from the University of Information Technology (VNU-HCM), took part in two #SMM4H-HeaRD 2026 shared tasks. Task 1 is binary detection of Adverse Drug Event (ADE) mentions in social media posts in six languages, with Farsi added only at test time to probe zero-shot transfer. For this task they fine-tuned InfoXLM and XLM-RoBERTa, trained Qwen3.5-9B-Base with LoRA instruction tuning, and combined the three through voting ensembles. Training data came from the task data plus translated CADEC, with the positive class upsampled. Task 7 is a token-level NER problem: finding ClinicalImpacts and SocialImpacts spans in first-person opioid narratives. Here they compared a generative Qwen tagger with DeBERTa-Large trained either on BIO tags or on a reduced three-label scheme. Qwen performed best overall and on seen languages. The soft-voting ensemble, however, transferred better to Farsi. In Task 7 the encoders clearly beat the LLM, and the simplified labels gave a small edge. The study shows that architectural diversity helps with unseen scripts and that a smaller label space can suffice when entity boundaries are rarely ambiguous. ## Key points - **Task 1, development set:** the soft-voting ensemble reached 0.8584 macro F1, compared with 0.8543 for Qwen alone. - **Task 1, test set:** Qwen scored 0.6623 overall and 0.7853 on known languages, but only 0.4865 on Farsi. The ensemble reached 0.5304 on Farsi, above the team median of 0.3797. - **Task 7, test set:** DeBERTa-Large with labels O/ClinicalImpacts/SocialImpacts achieved 0.500 strict F1 and 0.583 relaxed F1. BIO tagging achieved 0.484 strict and 0.564 relaxed. - **Task 7, LLM baseline:** the Qwen3.5-9B + LoRA tagger, which output index:token:label triples, reached only 0.2604 strict and 0.2961 relaxed F1 on the development set. This reflects its unreliable structured generation. - **Setup:** training ran on a single NVIDIA RTX Pro 6000 Blackwell GPU (96GB) with the Transformers framework, and the code is released at github.com/TienDoan274/SMM4H. - **Limitations:** apart from 3x upsampling, no data augmentation was used. The simplified labeling scheme cannot separate adjacent spans of the same type. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Vietnam National University Ho Chi Minh City](https://md.research.elamur.ai/free/en/universities/vietnam-national-university-ho-chi-minh-city/) — University, Ho Chi Minh City, Vietnam · 21 works · 14 citations 📚 Shelves (8): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🧬 Biochemistry, Genetics and Molecular Biology](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/) · 234 works · [🧬 Molecular Biology](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/molecular-biology/) · 231 works · [💊 Pharmacology, Toxicology and Pharmaceutics](https://md.research.elamur.ai/free/en/shelves/pharmacology-toxicology-and-pharmaceutics/) · 7 works · [💊 Toxicology](https://md.research.elamur.ai/free/en/shelves/pharmacology-toxicology-and-pharmaceutics/toxicology/) · 6 works 🧭 Topics (1): [🔎 Information extraction](https://md.research.elamur.ai/free/en/topics/information-extraction/) · 167 works ## Cite Cite as: Doan Nhat Tien and Thìn \\DJặng Văn. 2026. DNT at #SMM4H–HeaRD 2026: Leveraging BERT-based Encoders and LLMs for Medical Information Extraction. Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{tien2026dnt, title = {{DNT at \#SMM4H–HeaRD 2026: Leveraging BERT-based Encoders and LLMs for Medical Information Extraction}}, author = {Doan Nhat Tien and Thìn DJặng Văn}, booktitle = {Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks}, year = {2026}, doi = {10.18653/v1/2026.smm4h-1.7}, url = {https://doi.org/10.18653/v1/2026.smm4h-1.7} } ``` - [← previous DM Doppelgangers: Implicit Connectives as eRST Signals](https://md.research.elamur.ai/free/en/papers/ai-2026-dm-doppelgangers-implicit-connectives-as/) - [next → Do Emotions Influence Moral Judgment in Large Language Models?](https://md.research.elamur.ai/free/en/papers/saim-2026-do-emotions-influence-moral-judgment/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/27/) ## References 4 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, and 30 others. 2023. [Qwen technical report](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/). arXiv preprint arXiv:2309.16609. 2. Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, and Ming Zhou. 2021. [Infoxlm: An information-theoretic framework for cross-lingual language model pre-training](https://md.research.elamur.ai/free/en/papers/chi-2020-infoxlm-information-theoretic-framework-cross/). In Proceedings of the 2021 Conference of the North American Chapter of the Assoc… 3. Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Unsupervised cross-lingual representation learning at scale. In Proceedings of the 58th Annual Meeting of the Association fo… [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Kartikay+Khandelwal%2C+Naman+Goyal%2C+Vishrav+Chaudhary%2C+Guillaume+Wenzek%2C+Francisco+Guzm%C3%A1n%2C+Edouard+Grave%2C+Myle+Ott%2C+Luke+Zettlemoyer%2C+and+Veselin+Stoyanov%2E+2020%2E+Unsupervised+cross%2Dlingu) 4. Sumon Kanti Dey, Jeanne M. Powell, Azra Ismail, Jean-marie Perrone, and Abeed Sarker. 2025. Inference gap in domain expertise and machine intelligence in [find](https://scholar.google.com/scholar?q=Sumon+Kanti+Dey%2C+Jeanne+M%2E+Powell%2C+Azra+Ismail%2C+Jean%2Dmarie+Perrone%2C+and+Abeed+Sarker%2E+2025%2E+Inference+gap+in+domain+expertise+and+machine+intelligence+in) *Updated 1 November 2026*