--- title: "Candidate-Aware Retrieval and Reranking for Multiple-Choice" description: "Instead of retrieving on the question alone, the authors build one query per answer option by joining the question with that option. 1 reference." authors: ["Yassine Bouziane", "Youness Moukafih", "Mounir Ghogho"] year: 2026 venue: "Findings of the Association for Computational Linguistics: ACL 2026" source: "https://aclanthology.org/2026.findings-acl.435/" doi: "10.18653/v1/2026.findings-acl.435" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/bouziane-2026-candidate-aware-retrieval-reranking-multiple/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bouziane-2026-candidate-aware-retrieval-reranking-multiple/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/24/) / Candidate-Aware Retrieval and Reranking for Multiple-Choice Question Answering: Arabic as a Case Study # Candidate-Aware Retrieval and Reranking for Multiple-Choice Question Answering: Arabic as a Case Study **Authors:** Yassine Bouziane, Youness Moukafih and [Mounir Ghogho](https://md.research.elamur.ai/free/en/authors/mounir-ghogho/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.435/) · [PDF](https://aclanthology.org/2026.findings-acl.435.pdf) · [DOI 10.18653/v1/2026.findings-acl.435](https://doi.org/10.18653/v1/2026.findings-acl.435) · [OpenAlex](https://openalex.org/W7166811274) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary The paper targets multiple-choice QA in Arabic, where LLMs score well below their English level and plain RAG often adds noise or passages that are on-topic but do not settle the question. Instead of retrieving on the question alone, the authors build one query per answer option by joining the question with that option. They retrieve top-k passages for each query from a Milvus/Zilliz Cloud index. A lightweight reranker, trained with a combined regression and triplet loss, then picks the most supportive passage for each option. The chosen passages are concatenated into an extended ArabicMMLU prompt. The work adds two resources. HumCorpus is a retrieval base built from Arabic textbooks and general-knowledge texts. RankMCQ, derived from PalmX 2025 Islamic Culture data, holds passages labelled positive, partially positive and negative. Evaluation covers ArabicMMLU humanities questions at high-school and university level, using small models (Llama-3.2, Qwen3, Mistral). The method beats both a standard RAG setup and a baseline reranker on average, and Qwen3-4B comes close to much larger systems. This shows that evidence selection aware of each answer option can stand in for model scale. ## Key points - **Corpus construction.** HumCorpus has these chunk counts: - Islamic Studies: 257,084 - History: 49,833 - Law: 16,806 - Philosophy: 8,463 Chunks are at most 1,000 tokens with a 200-token overlap. They are embedded with an Arabic Sentence-BERT model (768 dimensions) and searched by cosine similarity. - **Reranker supervision.** RankMCQ gives each question three kinds of passage: - one that resolves it, - one that is relevant but insufficient, - one that is false or misleading. The data came from a two-stage pipeline that uses LLM generation. - **Average zero-shot accuracy (Qwen3-4B):** 57.5 for this method, 56.4 for the baseline reranker, 55.2 for standard RAG and 53.7 with no retrieval. - **Mistral-7B:** accuracy rises from 31.3 to 47.3. In Philosophy it jumps from 20.5 to 61.5. - **Comparison with larger models.** Qwen3-4B with this method reaches 74.3 in Philosophy against 74.4 for GPT-4. The authors note that the reference baselines also include easier education levels. - **Ablation.** Adding the triplet/contrastive term gives lower and faster-falling validation loss than regression alone. ## Interesting ideas - Build one retrieval query per answer option (question plus that option) and keep the best evidence for each option, so every option is tested against its own support or refutation. - Use three graded evidence labels (resolving, relevant-but-insufficient, misleading) rather than a binary relevant/irrelevant split, which targets the common "on-topic but not decisive" failure. - Combine a regression score with a triplet margin loss, so the model gets calibrated relevance values and also a clear separation between close classes. - Report the cases where added context hurts a model, alongside average gains, as a measure of how robust the method is. - Offload vector storage and search to a managed service so the reranker can run on the same modest local hardware. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (answer): School-test readers could look up evidence separately for each option in the world of the text or the knowledge graph, then compare the per-option justifications instead of scoring the question alone. - **I2** (learn): Evaluation sets and negative controls could include near-miss distractor passages, to check that a reader really needs the decisive fact and is not just matching the topic. - **I3** (learn): This objective could suit any learned scorer that must rank near-identical candidates, such as choosing among competing parses or frame readings proposed by several witnesses. - **I4** (answer): The QA harness could log every question where adding retrieved knowledge flips a correct answer to a wrong one, showing where compiled knowledge interferes. - **I5** (world): Large lookup structures for the knowledge layer (Wikidata or WordNet indices) could sit behind a separate service, leaving local GPU time for parsing with gparse. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Université Mohammed VI Polytechnique](https://md.research.elamur.ai/free/en/universities/universite-mohammed-vi-polytechnique/) — University, Marrakesh, Morocco · 18 works · 171 citations Also on the byline: [International University of Rabat](https://ror.org/01t9czq80). 📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works 🧭 Topics (3): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 441 works · [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 473 works ## Cite Cite as: Yassine Bouziane, Youness Moukafih and Mounir Ghogho. 2026. Candidate-Aware Retrieval and Reranking for Multiple-Choice Question Answering: Arabic as a Case Study. Findings of the Association for Computational Linguistics: ACL 2026. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{bouziane2026candidate, title = {{Candidate-Aware Retrieval and Reranking for Multiple-Choice Question Answering: Arabic as a Case Study}}, author = {Yassine Bouziane, Youness Moukafih and Mounir Ghogho}, booktitle = {Findings of the Association for Computational Linguistics: ACL 2026}, year = {2026}, doi = {10.18653/v1/2026.findings-acl.435}, url = {https://doi.org/10.18653/v1/2026.findings-acl.435} } ``` - [← previous CANDICE: Agentic Causal Disentanglement with Class Conditional Knowledge Integration for Long Tailed Domain Generalization](https://md.research.elamur.ai/free/en/papers/urooj-2026-candice-agentic-causal-disentanglement-class/) - [next → CANDLE: CTC-based Arabic Noisy-character Deduplication using a Lightweight Encoder](https://md.research.elamur.ai/free/en/papers/alasmary-2026-candle-ctc-based-arabic-noisy/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/24/) ## References 1 references, 1 of them with a card of ours. ↗ leads to the work. 1. Abdelrahman Abdallah, Mahmoud Kasem, Mahmoud Abdalla, Mohamed Mahmoud, Mohamed Elkasaby, Yasser Elbendary, and Adam Jatowt. 2024. [Arabicaqa: A comprehensive dataset for arabic question answering](https://md.research.elamur.ai/free/en/papers/abdallah-2024-arabicaqa-comprehensive-dataset-arabic-question/). In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2049–2059. *Figure 5: Training loss for each epoch.* *Updated 1 November 2026*