--- title: "Egyhealth at General Arabic Health QA (MedArabiQ): An" description: "This shared-task paper (AraHealthQA 2025, Track 2 on general medical QA) targets Arabic medical… 3 references, cited by 1 paper here." authors: ["Hossam Amer", "Rawan Tarek Taha", "Gannat Elsayed", "Ensaf Hussein Mohamed"] year: 2025 venue: "Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks" source: "https://aclanthology.org/2025.arabicnlp-sharedtasks.31/" doi: "10.18653/v1/2025.arabicnlp-sharedtasks.31" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/amer-2025-egyhealth-general-arabic-health-qa/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/amer-2025-egyhealth-general-arabic-health-qa/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/14/) / Egyhealth at General Arabic Health QA (MedArabiQ): An Enhanced RAG Framework with Large-Scale Arabic Q&A Medical Data # Egyhealth at General Arabic Health QA (MedArabiQ): An Enhanced RAG Framework with Large-Scale Arabic Q&A Medical Data **Authors:** Hossam Amer, Rawan Tarek Taha, Gannat Elsayed and [Ensaf Hussein Mohamed](https://md.research.elamur.ai/free/en/authors/ensaf-hussein-mohamed/) · **Year:** 2025 · **Venue:** [Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks](https://md.research.elamur.ai/free/en/venues/arabicnlp/) ([ArabicNLP 2025](https://md.research.elamur.ai/free/en/venues/arabicnlp/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2025.arabicnlp-sharedtasks.31/) · [PDF](https://aclanthology.org/2025.arabicnlp-sharedtasks.31.pdf) · [DOI 10.18653/v1/2025.arabicnlp-sharedtasks.31](https://doi.org/10.18653/v1/2025.arabicnlp-sharedtasks.31) · [OpenAlex](https://openalex.org/W4416037664) **Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/amer-2025-egyhealth-general-arabic-health-qa/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary This shared-task paper (AraHealthQA 2025, Track 2 on general medical QA) targets Arabic medical question answering. Two obstacles make the task hard: good Arabic data is scarce, and the language has heavy morphology, dialect variety and inconsistent spelling. The team merged two web-scraped Arabic health Q&A collections, AHD and MAQA, into a pool of roughly one million question–answer pairs. They cleaned the pool, normalized the orthography and aligned the two category schemes. The pool then serves as the knowledge store for a retrieval-augmented generation system. The pipeline has several stages: - a Gemma model repairs typos in the incoming question; - a fine-tuned AraBERT model predicts the likely medical specialties; - retrieval runs only inside the top predicted specialties; - a hybrid dense/lexical score reranks the hits; - llama-3.3-70b-versatile writes the final answer. Against a naïve RAG baseline, BERTScore rose from about 0.83 to 0.86. The gains in the retrieval metrics were small but consistent. The work shows that a large, noisy, scraped corpus can still serve as practical grounding for a low-resource medical chatbot if it is cleaned and searched in a structured way. ## Key points - **Data:** - AHD contributes 808,472 Q&A pairs in 45 categories. - MAQA contributes 273,174 pairs in 20 categories. - The 45 AHD categories were remapped onto MAQA's 20. - The task's development set, MedArabiQ, has 400 samples. - **Preprocessing:** - Removed scraped junk such as links, "read more" phrases and image filenames. - Dropped entries written fully in a non-Arabic language. - Merged Alef variants into bare Alef, replaced final Yaa with its dotless form, and deleted Tatweel. - **Specialty classifier and embeddings:** - The AraBERT specialty classifier reaches accuracy 0.7407 and F1 0.7379 over 20 classes. - Search is limited to the top 5 predicted classes, which roughly halves the search space. - Embeddings come from bert-base-arabic-camelbert-mix. - **Retrieval:** - The system fetches 10 candidates and reranks them to 5 with a score of 0.7·cosine + 0.3·BM25. - On a 440-question test set, the full pipeline scores MRR 0.245 and Recall@5 0.259. - Basic retrieval scores MRR 0.188 and Recall@5 0.227. - Removing the classifier changes the scores only marginally (MRR 0.235). - **Generation:** - Answers come from llama-3.3-70b-versatile at temperature 0.2. - On 100 mixed-format test questions, BERTScore is 0.8287 for naïve RAG and 0.8620 for the advanced RAG. ## Interesting ideas - Because patient questions often span several specialties, the system filters on the top five predicted classes rather than trusting only the single best class, which keeps recall while still pruning. - Reranking mixes dense cosine similarity with BM25 under fixed, inspectable weights, so both lexical overlap and semantic closeness count and the contribution of each is easy to read. - The retrieval test set is built by having an LLM rephrase questions already in the index, balanced at 22 per category, so the probe checks robustness to wording rather than exact matching. - The ablation shows the classifier adds little accuracy but halves the search space, so the authors judge the component on efficiency as well as quality. - Two corpora with different taxonomies (45 vs 20 categories) were merged by mapping each fine label to its nearest coarse one before indexing. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (world): When resolving a word against compiled knowledge (WordNet senses, verb classes), Mova could keep the top few candidate domains as an explainable shortlist rather than committing to one label too early. - **I2** (answer): Fable and school-test readers could rank candidate supporting sentences by a transparent mix of lexical overlap and frame/graph similarity, logging each component as part of the explanation. - **I3** (learn): LLM-paraphrased variants of known items could test whether parses and frames stay stable under rewording, with unchanged originals and unrelated questions as controls. - **I4** (learn): Evaluation reports could record cost (search space, steps, time) beside accuracy for each module, so cheap pruning stages are not discarded just because their quality gain is small. - **I5** (world): A similar explicit crosswalk table could align FrameNet, VerbNet and Wikidata class inventories into one ontology layer, keeping the mapping auditable. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Nile University](https://md.research.elamur.ai/free/en/universities/nile-university/) — University, Giza, Egypt · 14 works · 158 citations 📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works · [🩺 Medicine](https://md.research.elamur.ai/free/en/shelves/medicine/) · 241 works · [🩺 Health Informatics](https://md.research.elamur.ai/free/en/shelves/medicine/health-informatics/) · 184 works 🧭 Topics (2): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 441 works ## Cite Cite as: Hossam Amer, Rawan Tarek Taha, Gannat Elsayed and Ensaf Hussein Mohamed. 2025. Egyhealth at General Arabic Health QA (MedArabiQ): An Enhanced RAG Framework with Large-Scale Arabic Q&A Medical Data. Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{amer2025egyhealth, title = {{Egyhealth at General Arabic Health QA (MedArabiQ): An Enhanced RAG Framework with Large-Scale Arabic Q\&A Medical Data}}, author = {Hossam Amer, Rawan Tarek Taha, Gannat Elsayed and Ensaf Hussein Mohamed}, booktitle = {Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks}, year = {2025}, doi = {10.18653/v1/2025.arabicnlp-sharedtasks.31}, url = {https://doi.org/10.18653/v1/2025.arabicnlp-sharedtasks.31} } ``` - [← previous DialG2P: Dialectal Grapheme-to-Phoneme. Arabic as a Case Study](https://md.research.elamur.ai/free/en/papers/hawasly-2025-dialg2p-dialectal-grapheme-phoneme-arabic/) - [next → Emergent morpho-phonological representations in self-supervised speech models](https://md.research.elamur.ai/free/en/papers/gauthier-2025-emergent-morpho-phonological-representations-self/) - [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/14/) ## References 3 references, 1 of them with a card of ours. ↗ leads to the work. 1. Mohammed Abdelhay, Ammar Mohammed, and Hesham Hefny. 2023. Deep learning for arabic healthcare: Medicalbot. Social Network Analysis and Mining, 13:71. [↗](https://doi.org/10.1007/s13278-023-01077-w) 2. All experiments were conducted using the following software versions: Abdelhay and Mohammed. Maqa: Medical arabic q&a dataset. https://dataverse.harvard.edu/dataset.xhtml? persistentId=doi:10.7910/DVN/Y2JBEZ. Accessed 2025. [↗](https://doi.org/10.7910/dvn/y2jbez) 3. Mouath Abu Daoud, Chaimae Abouzahir, Leen Kharouf, Walid Al-Eisawi, Nizar Habash, and Farah E Shamout. 2025. [Medarabiq: Benchmarking large language models on arabic medical tasks](https://md.research.elamur.ai/free/en/papers/daoud-2025-medarabiq-benchmarking-large-language-models/). arXiv e-prints, pages arXiv–2505. *Updated 1 November 2026*