---
title: "REGLAT at AbjadMed — paper by Fetouh et al. (2026)"
description: "This paper describes the REGLAT team's entry to the AbjadMed shared task: assigning one of 82 medical categories to Arabic… 12 references."
authors: ["Ahmed M. Fetouh", "Mohammed Rahmath", "Omer Dawood", "Mariam Labib", "Nsrin Ashraf", "Hamada Nayel"]
year: 2026
venue: "Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script"
source: "https://aclanthology.org/2026.abjadnlp-1.46/"
doi: "10.18653/v1/2026.abjadnlp-1.46"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/fetouh-2026-reglat-abjadmed-handling-imbalanced-arabic/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/fetouh-2026-reglat-abjadmed-handling-imbalanced-arabic/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/47/) / REGLAT at AbjadMed: Handling Imbalanced Arabic Medical Text Classification via Hierarchical KNN-MLP Architecture

# REGLAT at AbjadMed: Handling Imbalanced Arabic Medical Text Classification via Hierarchical KNN-MLP Architecture

**Authors:** [Ahmed M. Fetouh](https://md.research.elamur.ai/free/en/authors/ahmed-m-fetouh/), Mohammed Rahmath, [Omer Dawood](https://md.research.elamur.ai/free/en/authors/omer-dawood/), [Mariam Labib](https://md.research.elamur.ai/free/en/authors/mariam-labib/), [Nsrin Ashraf](https://md.research.elamur.ai/free/en/authors/nsrin-ashraf/) and [Hamada Nayel](https://md.research.elamur.ai/free/en/authors/hamada-nayel/) · **Year:** 2026 · **Venue:** [Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script](https://md.research.elamur.ai/free/en/venues/abjadnlp/) ([Workshop on NLP for Languages Using Arabic Script 2026](https://md.research.elamur.ai/free/en/venues/abjadnlp/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.abjadnlp-1.46/) · [PDF](https://aclanthology.org/2026.abjadnlp-1.46.pdf) · [DOI 10.18653/v1/2026.abjadnlp-1.46](https://doi.org/10.18653/v1/2026.abjadnlp-1.46) · [OpenAlex](https://openalex.org/W7140140151)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
This paper describes the REGLAT team's entry to the AbjadMed shared task: assigning one of 82 medical categories to Arabic healthcare question–answer texts, where some categories have many examples and others very few. The authors clean and normalize the Arabic text. They rebalance the training data by capping frequent classes and adding examples for scarce ones from an external Arabic healthcare corpus. They then fine-tune ArabicBERT on this balanced set and use it only as an embedding encoder. Classification is two-stage. A cosine KNN makes a first guess. If that guess is a rare label, a separate MLP trained only on rare-class examples re-decides. On the blind test set the system reaches macro F1 0.46, ahead of the fine-tuned ArabicBERT, RAC, AraBERT and CAMeLBERT runs the authors also tried. The work shows that a light, reproducible pipeline built on domain-adapted embeddings can beat end-to-end fine-tuning when many classes are rare.

## Key points
- The AbjadMed data has 27,951 labelled training texts and 18,633 blind test texts across 82 categories. The task is single-label and multi-class, and the official metric is macro-averaged F1.
- The Anchor-Cap balancing strategy keeps the original data as the anchor and caps each class at 600 samples. Only underrepresented classes are topped up, using a Kaggle Arabic healthcare dataset.
- ArabicBERT was fine-tuned for 8 epochs on the balanced data, and its normalized embeddings feed a scikit-learn KNN (k=25, distance weighting, cosine metric).
- A class counts as rare if it has fewer than 50 training instances. Rare predictions are passed to an MLP with layers 1024–512–256–128, StandardScaler, Adam, adaptive learning rate and early stopping, trained only on rare-class data.
- Macro F1 scores were:
  - KNN+MLP (proposed): 0.46
  - ArabicBERT: 0.38
  - RAC: 0.3785
  - AraBERT: 0.35
  - CAMeLBERT: 0.3047

## Interesting ideas
- A cheap general classifier makes the first call, and a specialist trained only on rare labels re-judges any prediction that lands in a rare class, so scarce categories are not swamped by frequent ones.
- The Anchor-Cap scheme caps frequent classes at a fixed ceiling and adds outside data only for underfilled classes, rather than oversampling everything.
- The authors fine-tune an encoder on the target domain but classify by nearest neighbours in its embedding space, so each decision is backed by concrete similar training examples.
- Choosing macro F1 as the headline metric makes failures on low-frequency classes visible instead of hiding them behind accuracy on common classes.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (frames): VerbNet class or semantic-role assignment could use a general picker, with a dedicated checker invoked only when the chosen frame is a rare one, logging both decisions for explanation.
- **I2** (learn): when assembling silver treebank data, cap common constructions and deprels and pull extra agreed sentences only for rare relations or constructions.
- **I3** (world): mapping mentions to ontology types or senses could cite the nearest annotated examples as evidence, which fits the requirement that every step be explainable.
- **I4** (answer): score readers per question type and average equally, so rare test types such as multi-step word problems are not masked by easy frequent ones.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Prince Sattam Bin Abdulaziz University](https://md.research.elamur.ai/free/en/universities/prince-sattam-bin-abdulaziz-university/) — University, Al Kharj, Saudi Arabia · 17 works · 489 citations
- [Benha University](https://md.research.elamur.ai/free/en/universities/benha-university/) — University, Banhā, Egypt · 14 works · 89 citations
- [ElSewedy University of Technology](https://md.research.elamur.ai/free/en/universities/elsewedy-university-of-technology/) — University, Cairo, Egypt · 5 works · 5 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 3,066 works

## Cite

Cite as: Ahmed M. Fetouh, Mohammed Rahmath, Omer Dawood, Mariam Labib, Nsrin Ashraf and Hamada Nayel. 2026. REGLAT at AbjadMed: Handling Imbalanced Arabic Medical Text Classification via Hierarchical KNN-MLP Architecture. Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{fetouh2026reglat,
  title = {{REGLAT at AbjadMed: Handling Imbalanced Arabic Medical Text Classification via Hierarchical KNN-MLP Architecture}},
  author = {Ahmed M. Fetouh, Mohammed Rahmath, Omer Dawood, Mariam Labib, Nsrin Ashraf and Hamada Nayel},
  booktitle = {Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script},
  year = {2026},
  doi = {10.18653/v1/2026.abjadnlp-1.46},
  url = {https://doi.org/10.18653/v1/2026.abjadnlp-1.46}
}
```

- [← previous REGLAT at AbjadGenEval: Multi-Model Ensemble Approach for Arabic AI-Generated Text Detection](https://md.research.elamur.ai/free/en/papers/labib-2026-reglat-abjadgeneval-multi-model-ensemble/)
- [next → RegNLI: Detecting Online Product Misbranding through Legal and Linguistic Alignment](https://md.research.elamur.ai/free/en/papers/saha-2026-regnli-detecting-online-product-misbranding/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/47/)

## References

12 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Bushra Al-Smadi, Bassam Hammo, Hossam Faris, and Pedro A. Castillo. 2025. Enhancing the classification of imbalanced arabic medical questions using deepsmote. AI, 6(4). questions using pre-trained models and deep learning. Computers in Biology and Medicine, 170:107921. [↗](https://doi.org/10.3390/ai6040077)
2. Rana Ehab, Ahmed El-Sawy, Mohammed Aldawsari, and Hamada Nayel. 2026. DEAST: A dataset for english-arabic scientific translation and vice versa. Data in Brief, 64:112381. [find](https://scholar.google.com/scholar?q=Rana+Ehab%2C+Ahmed+El%2DSawy%2C+Mohammed+Aldawsari%2C+and+Hamada+Nayel%2E+2026%2E+DEAST%3A+A+dataset+for+english%2Darabic+scientific+translation+and+vice+versa%2E+Data+in+Brief%2C+64%3A112381%2E)
3. Hozayfa El Rifai, Leen Al Qadi, and Ashraf Elnagar. 2022. Arabic text classification: the need for multi-labeling systems. Neural Computing and Applications, 34(2):1135–1159. [↗](https://doi.org/10.1007/s00521-021-06390-z)
4. Pranav Gupta, Niranjan Kumar M, Balaji Nagarajan, Imed Zitouni, and Mo El-Haj. 2026. [Abjadmed: Arabic medical text classification at abjadnlp 2026](https://md.research.elamur.ai/free/en/papers/gupta-2026-abjadmed-arabic-medical-text-classification/). In Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script (AbjadNLP 2026), co-located with the 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2026), Rabat, Morocco.
5. Jaafar Hammoud, Aleksandra Vatian, Natalia Dobrenko, Nikolai Vedernikov, Anatoly Shalyto, and Natalia Gusarova. 2021. [New arabic medical dataset for diseases classification](https://md.research.elamur.ai/free/en/papers/hammoud-2021-new-arabic-medical-dataset-diseases/). In Intelligent Data Engineering and Automated Learning – IDEAL 2021, pages 196–203, Cham. Springer International Publishing.
6. Hadi Mohammadi, Ehsan Nazerfard, and Mostafa Haghir Chehreghani. 2025. Anchor-based oversampling for imbalanced tabular data via contrastive and adversarial learning. [↗](https://doi.org/10.48550/arxiv.2503.18569)
7. Hamada Nayel, Nourhan Marzouk, and Ahmed Elsawy. 2023. Named entity recognition for arabic medical texts using deep learning models. In 2023 Intelligent Methods, Systems, and Applications (IMSA), pages 281–285. [find](https://scholar.google.com/scholar?q=Hamada+Nayel%2C+Nourhan+Marzouk%2C+and+Ahmed+Elsawy%2E+2023%2E+Named+entity+recognition+for+arabic+medical+texts+using+deep+learning+models%2E+In+2023+Intelligent+Methods%2C+Systems%2C+and+Applications+%28IMSA%29%2C+page)
8. Ali Safaya, Moutasem Abdullatif, and Deniz Yuret. 2020. [KUISAIL at SemEval-2020 task 12: BERT-CNN for offensive speech identification in social media](https://md.research.elamur.ai/free/en/papers/safaya-2020-kuisail-semeval-2020-task-12/). In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 2054– 2059, Barcelona (online). International Committee for Computational Linguistics.
9. Fatih Soygazi and Damla Oğuz. 2025. Medical text classification using semisupervised learning and bert-based models. Mühendislik Bilimleri ve Araştırmaları Dergisi, 7(1):60–69. [↗](https://doi.org/10.46387/bjesr.1597329)
10. Yu Wang, Yuan Wang, Zhenwan Peng, Feifan Zhang, Luyao Zhou, and Fei Yang. 2023. Medical text classification based on the discriminative pre-training model and prompt-tuning. DIGITAL HEALTH, 9:20552076231193213. [↗](https://doi.org/10.1177/20552076231193213)
11. Yujia Yuan and Guan Xi. 2025. Msa k-bert: A method for medical text intent classification. Applied Sciences, 15(12). [↗](https://doi.org/10.3390/app15126834)
12. Bushra Salem Al-Smadi. 2024. Deberta-bilstm: A multi-label classification model of arabic medical [find](https://scholar.google.com/scholar?q=Bushra+Salem+Al%2DSmadi%2E+2024%2E+Deberta%2Dbilstm%3A+A+multi%2Dlabel+classification+model+of+arabic+medical)

*Updated 1 November 2026*