---
title: "Evaluation & benchmarks — papers, page 6 — Elamur Research"
description: "Evaluation & benchmarks: 684 papers of the Elamur Research library · page 6 of 8 · 426–525, the most cited first."
canonical: "https://research.elamur.ai/free/en/topics/evaluation-benchmarks/page/6/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/topics/evaluation-benchmarks/page/6/)

[home](https://md.research.elamur.ai/free/en/) / [topics](https://md.research.elamur.ai/free/en/topics/) / [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) / page 6

# 📏 Evaluation & benchmarks

684 papers · page 6 of 8 · 426–525 · the most cited first · [all topics](https://md.research.elamur.ai/free/en/topics/)

How systems are measured: benchmarks, metrics, human judgements and what the numbers mean.

## Papers (684)

[← prev](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/5/) [1](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) … [5](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/5/) **6** [7](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/7/) [8](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/8/) [next →](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/7/)

426. [**Evaluating statistical language models as pragmatic reasoners arXiv:2305.01020**Benjamin Lipkin, Lionel Wong, Gabriel Grand, et al.*2023 · 18 citations*](https://md.research.elamur.ai/free/en/papers/lipkin-2023-evaluating-statistical-language-models-pragmatic/)
427. **[The Iron(ic) Melting Pot: Reviewing Human Evaluation in Humour, Irony and Sarcasm Generation](https://md.research.elamur.ai/free/en/papers/loakman-2023-iron-ic-melting-pot-reviewing/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Tyler Loakman, Aaron Maladry, Chenghua Lin*2023 · 18 citations*
428. **[GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation](https://md.research.elamur.ai/free/en/papers/xu-2022-guofeng-benchmark-zero-pronoun-recovery/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Mingzhou Xu, Longyue Wang, Derek F. Wong, et al.*2022 · 18 citations*
429. **[AR-ASAG An ARabic Dataset for Automatic Short Answer Grading Evaluation](https://md.research.elamur.ai/free/en/papers/ouahrani-2020-ar-asag-arabic-dataset-automatic/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Leila Ouahrani, Djamal Bennouar*2020 · 18 citations*
430. [**An Evaluation of Parser Robustness for Ungrammatical Sentences**Homa B. Hashemi, Rebecca Hwa*2016 · 18 citations*](https://md.research.elamur.ai/free/en/papers/hashemi-2016-evaluation-parser-robustness-ungrammatical-sentences/)
431. **[Multi-metric optimization for coreference: The UniTN / IITP / Essex submission to the 2011 CONLL Shared Task](https://md.research.elamur.ai/free/en/papers/uryupina-2011-multi-metric-optimization-coreference-unitn/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Olga Uryupina, Sriparna Saha, Asif Ekbal, et al.*2011 · 18 citations*
432. [**Parser Evaluation and the BNC: Evaluating 4 constituency parsers with 3 metrics**Jennifer Foster, Josef van Genabith*2008 · 18 citations*](https://md.research.elamur.ai/free/en/papers/foster-2008-parser-evaluation-bnc-evaluating-4/)
433. **[Ciron: a New Benchmark Dataset for Chinese Irony Detection](https://md.research.elamur.ai/free/en/papers/xiang-2020-ciron-new-benchmark-dataset-chinese/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Rong Xiang, Xuefeng Gao, Yunfei Long, et al.*2020 · 17 citations*
434. **[The SADID Evaluation Datasets for Low-Resource Spoken Language Machine Translation of Arabic Dialects](https://md.research.elamur.ai/free/en/papers/abid-2020-sadid-evaluation-datasets-low-resource/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Wael Abid*2020 · 17 citations*
435. **[Comparative Evaluation of Argument Extraction Algorithms in Discourse Relation Parsing](https://md.research.elamur.ai/free/en/papers/stepanov-2013-comparative-evaluation-argument-extraction-algorithms/) [International Workshop/Conference on Parsing Technologies](https://md.research.elamur.ai/free/en/venues/international-workshop-conference-on-parsing-technologies/)**Evgeny Stepanov, Giuseppe Riccardi*2013 · 17 citations*
436. **[Bridging Cultures in the Kitchen: A Framework and Benchmark for Cross-Cultural Recipe Retrieval](https://md.research.elamur.ai/free/en/papers/hu-2024-bridging-cultures-kitchen-framework-benchmark/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tianyi Hu, Maria Maistro, Daniel Hershcovich*2024 · 16 citations*
437. [**Opinion Piece: Can we Fix the Scope for Coreference? Problems and Solutions for Benchmarks beyond OntoNotes**Amir Zeldes*2022 · 16 citations*](https://md.research.elamur.ai/free/en/papers/zeldes-2022-opinion-piece-can-we-fix/)
438. **[Linguistically Aware Coreference Evaluation Metrics](https://md.research.elamur.ai/free/en/papers/chen-2013-linguistically-aware-coreference-evaluation-metrics/) [International Joint Conference on Natural Language Processing (IJCNLP)](https://md.research.elamur.ai/free/en/venues/ijcnlp/)**Chen Chen, Vincent Ng*2013 · 16 citations*
439. [**AraSTEM: A Native Arabic Multiple Choice Question Benchmark for Evaluating LLMs Knowledge In STEM Subjects arXiv:2501.00559**Ahmad Mustapha; Hadi Al-Khansa; Hadi Al-Mubasher; Aya Mourad; Ranam Hamoud; Hasan El-Husseini; Marwah Al-Sakkaf;, Mariette Awad*2024 · 15 citations*](https://md.research.elamur.ai/free/en/papers/mustapha-2024-arastem-native-arabic-multiple-choice/)
440. [**Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics**Stefano Perrella, Lorenzo Proietti, Pere-Lluís Huguet Cabot, et al.*2024 · 15 citations*](https://md.research.elamur.ai/free/en/papers/perrella-2024-beyond-correlation-interpretable-evaluation-machine/)
441. **[Evaluating Large Language Models for Health-related Queries with Presuppositions](https://md.research.elamur.ai/free/en/papers/kaur-2024-evaluating-large-language-models-health/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Navreet Kaur, Monojit Choudhury, Danish Pruthi*2024 · 15 citations*
442. **[TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs](https://md.research.elamur.ai/free/en/papers/basar-2025-turblimp-turkish-benchmark-linguistic-minimal/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ezgi Başar, Francesca Padovani, Jaap Jumelet, et al.*2025 · 14 citations*
443. [**Evaluating Text Generation from Discourse Representation Structures**Chunliu Wang, Rik van Noord, Arianna Bisazza, et al.*2021 · 14 citations*](https://md.research.elamur.ai/free/en/papers/wang-2021-evaluating-text-generation-discourse-representation/)
444. **[SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?](https://md.research.elamur.ai/free/en/papers/li-2025-ssa-comet-do-llms-outperform/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Senyu Li, Jiayi Wang, Felermino D. M. A. Ali, et al.*2025 · 13 citations*
445. **[Towards a Unified Benchmark for Arabic Pronunciation Assessment: Quranic Recitation as Case Study](https://md.research.elamur.ai/free/en/papers/kheir-2025-towards-unified-benchmark-arabic-pronunciation/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Yassine El Kheir, Omnia Ibrahim, Amit Meghanani, et al.*2025 · 13 citations*
446. **[Open Universal Arabic ASR Leaderboard](https://md.research.elamur.ai/free/en/papers/wang-2024-open-universal-arabic-asr-leaderboard/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Yingzhi Wang, Anas Alhmoud, Muhammad Alqurishi*2024 · 13 citations*
447. [**HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark**Amir DN Cohen, Hilla Merhav, Yoav Goldberg, et al.*2023 · 13 citations*](https://md.research.elamur.ai/free/en/papers/cohen-2023-heq-large-diverse-hebrew-reading/)
448. **[Evaluation of named entity coreference](https://md.research.elamur.ai/free/en/papers/agarwal-2019-evaluation-named-entity-coreference/) [Workshop on Computational Models of Reference, Anaphora and Coreference (CRAC)](https://md.research.elamur.ai/free/en/venues/crac/)**Oshin Agarwal, Sanjay Subramanian, Ani Nenkova, et al.*2019 · 13 citations*
449. [**Diacritic Annotation in the Arabic Treebank and its Impact on Parser Evaluation**Mohamed Maamouri, Seth Kulick, Ann Bies*2008 · 13 citations*](https://md.research.elamur.ai/free/en/papers/maamouri-2008-diacritic-annotation-arabic-treebank-its/)
450. [**Towards Heterogeneous Automatic MT Error Analysis**Jesús Giménez, Lluís Màrquez*2008 · 13 citations*](https://md.research.elamur.ai/free/en/papers/gimenez-2008-heterogeneous-automatic-mt-error-analysis/)
451. [**Incorporate Semantic Structures into Machine Translation Evaluation via UCCA**Jin Xu, Yinuo Guo, Junfeng Hu*2020 · 12 citations*](https://md.research.elamur.ai/free/en/papers/xu-2020-incorporate-semantic-structures-into-machine/)
452. [**Evaluating Historical Text Normalization Systems: How Well Do They Generalize?**Alexander Robertson, Sharon Goldwater*2018 · 12 citations*](https://md.research.elamur.ai/free/en/papers/robertson-2018-evaluating-historical-text-normalization-systems/)
453. **[FrameNet Translation Using Bilingual Dictionaries with Evaluation on the English-French Pair](https://md.research.elamur.ai/free/en/papers/mouton-2010-framenet-translation-bilingual-dictionaries-evaluation/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Claire Mouton, Gaël de Chalendar, Benoit Richert*2010 · 12 citations*
454. **[MORQA: Benchmarking Evaluation Metrics for Medical Open-Ended Question Answering](https://md.research.elamur.ai/free/en/papers/yim-2026-morqa-benchmarking-evaluation-metrics-medical/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Wen-wai Yim, Asma Ben Abacha, Zixuan Yu, et al.*2026 · 11 citations*
455. **[DiBiMT: A Gold Evaluation Benchmark for Studying Lexical Ambiguity in Machine Translation](https://md.research.elamur.ai/free/en/papers/martelli-2025-dibimt-gold-evaluation-benchmark-studying/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Federico Martelli, Stefano Perrella, Niccolò Campolungo, et al.*2025 · 11 citations*
456. **[Pragmatic Competence Evaluation of Large Language Models for the Korean Language](https://md.research.elamur.ai/free/en/papers/park-2024-pragmatic-competence-evaluation-large-language/) [Pacific Asia Conference on Language, Information and Computation (PACLIC)](https://md.research.elamur.ai/free/en/venues/paclic/)**Dojun Park, Jiwoo Lee, Hyeyun Jeong, et al.*2024 · 11 citations*
457. **[Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings](https://md.research.elamur.ai/free/en/papers/schuff-2021-does-external-knowledge-help-explainable/) [BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/blackboxnlp/)**Hendrik Schuff, Hsiu-Yu Yang, Heike Adel, et al.*2021 · 11 citations*
458. [**Critical Reflections on Evaluation Practices in Coreference Resolution Proceedings of the 2013 NAACL HLT Student Research Workshop**Gordana Ilić Holen*2013 · 11 citations*](https://md.research.elamur.ai/free/en/papers/holen-2013-critical-reflections-evaluation-practices-coreference/)
459. [**Findings of the Fourth Shared Task on Multilingual Coreference Resolution: Can LLMs Dethrone Traditional Approaches?**Michal Novák, Miloslav Konopik, Anna Nedoluzhko, et al.*2025 · 10 citations*](https://md.research.elamur.ai/free/en/papers/novak-2025-findings-fourth-shared-task-multilingual/)
460. [**Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective**Ian Porada, Alexandra Olteanu, Kaheer Suleman, et al.*2024 · 10 citations*](https://md.research.elamur.ai/free/en/papers/porada-2024-challenges-evaluating-generalization-coreference-resolution/)
461. **[Targeted Syntactic Evaluation on the Chomsky Hierarchy](https://md.research.elamur.ai/free/en/papers/someya-2024-targeted-syntactic-evaluation-chomsky-hierarchy/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Taiga Someya, Ryo Yoshida, Yohei Oseki*2024 · 10 citations*
462. [**The Perceptimatic English Benchmark for Speech Perception Models arXiv:2005.03418**Juliette Millet, Ewan Dunbar*2020 · 10 citations*](https://md.research.elamur.ai/free/en/papers/millet-2020-perceptimatic-english-benchmark-speech-perception/)
463. [**MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs arXiv:2603.07539**Abdessalam Bouchekif; Shahd Gaben; Samer Rashwani; Somaya Eltanbouly; Mutaz Al-Khatib; Heba Sbahi; Mohammed Ghaly;, Emad Mohamed*2026 · 9 citations*](https://md.research.elamur.ai/free/en/papers/bouchekif-2026-mawarith-dataset-benchmark-legal-inheritance/)
464. **[TriFine: A Large-Scale Dataset of Vision-Audio-Subtitle for Tri-Modal Machine Translation and Benchmark with Fine-Grained Annotated Tags](https://md.research.elamur.ai/free/en/papers/guan-2025-trifine-large-scale-dataset-vision/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Boyu Guan, Yining Zhang, Yang Zhao, et al.*2025 · 9 citations*
465. [**The eBible Corpus: Data and Model Benchmarks for Bible Translation for Low-Resource Languages**Vesa Akerman, David Baines, Damien Daspit, et al.*2023 · 9 citations*](https://md.research.elamur.ai/free/en/papers/akerman-2023-ebible-corpus-data-model-benchmarks/)
466. [**Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding arXiv:2205.10687**Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.*2022 · 9 citations*](https://md.research.elamur.ai/free/en/papers/ghaddar-2022-revisiting-pre-trained-language-models-their/)
467. [**Referenceless Parsing-Based Evaluation of AMR-to-English Generation**Emma Manning, Nathan Schneider*2021 · 9 citations*](https://md.research.elamur.ai/free/en/papers/manning-2021-referenceless-parsing-based-evaluation-amr/)
468. [**DTED: Evaluation of Machine Translation Structure Using Dependency Parsing and Tree Edit Distance**Martin McCaffery, Mark-Jan Nederhof*2016 · 9 citations*](https://md.research.elamur.ai/free/en/papers/mccaffery-2016-dted-evaluation-machine-translation-structure/)
469. **[A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understanding](https://md.research.elamur.ai/free/en/papers/selamet-2026-parallel-cross-lingual-benchmark-multimodal/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Dilara Torunoğlu-Selamet, Doğukan Arslan, Rodrigo Wilkens, et al.*2026 · 8 citations*
470. **[Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions](https://md.research.elamur.ai/free/en/papers/atif-2025-sacred-synthetic-evaluating-llm-reliability/) [Proceedings of the AAAI/ACM Conference on AI Ethics and Society](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-acm-conference-on-ai-ethics-and-society/)**Farah Atif, Nursultan Askarbekuly, Kareem Darwish, et al.*2025 · 8 citations*
471. **[Assessing the Role of Context in Chat Translation Evaluation: Is Context Helpful and Under What Conditions?](https://md.research.elamur.ai/free/en/papers/agrawal-2024-assessing-role-context-chat-translation/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Sweta Agrawal, Amin Farajian, Patrick Fernandes, et al.*2024 · 8 citations*
472. [**Data-driven Parsing Evaluation for Child-Parent Interactions**Zoey Liu, Emily Prud'hommeaux*2023 · 8 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-data-driven-parsing-evaluation-child/)
473. [**Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions**Vivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, et al.*2022 · 8 citations*](https://md.research.elamur.ai/free/en/papers/macketanz-2022-linguistically-motivated-evaluation-2022-state/)
474. **[An Evaluation Dataset for Identifying Communicative Functions of Sentences in English Scholarly Papers](https://md.research.elamur.ai/free/en/papers/iwatsuki-2020-evaluation-dataset-identifying-communicative-functions/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Kenichi Iwatsuki, Florian Boudin, Akiko Aizawa*2020 · 8 citations*
475. [**Evaluating Word Embeddings on Low-Resource Languages**Nathan Stringham, Mike Izbicki*2020 · 8 citations*](https://md.research.elamur.ai/free/en/papers/stringham-2020-evaluating-word-embeddings-low-resource/)
476. [**The Types and Distributions of Errors in a Wide Coverage Surface Realizer Evaluation**Charles Callaway*2005 · 8 citations*](https://md.research.elamur.ai/free/en/papers/callaway-2005-types-distributions-errors-wide-coverage/)
477. [**A Comprehensive Evaluation of Large Language Models on Mental Illnesses in Arabic Context arXiv:2501.06859**Noureldin Zahran, Aya E. Fouda, Radwa J. Hanafy, et al.*2025 · 7 citations*](https://md.research.elamur.ai/free/en/papers/zahran-2025-comprehensive-evaluation-large-language-models/)
478. [**Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entities**Michal Novák, Miloslav Konopík, Anna Nedoluzhko, et al.*2026 · 6 citations*](https://md.research.elamur.ai/free/en/papers/novak-2026-findings-fifth-shared-task-multilingual/)
479. **[MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languages](https://md.research.elamur.ai/free/en/papers/smart-2026-multiwikiqa-reading-comprehension-benchmark-300/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Dan Saattrup Smart*2026 · 6 citations*
480. **[The LSCD Benchmark: a Testbed for Diachronic Word Meaning Tasks](https://md.research.elamur.ai/free/en/papers/schlechtweg-2026-lscd-benchmark-testbed-diachronic-word/) [Joint Conference on Lexical and Computational Semantics (*SEM)](https://md.research.elamur.ai/free/en/venues/starsem/)**Dominik Schlechtweg, Sachin Yadav, Jonas Kuhn, et al.*2026 · 6 citations*
481. **[A Pragmatics-Centered Evaluation Framework for Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/sileo-2022-pragmatics-centered-evaluation-framework-natural/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Damien Sileo, Philippe Muller, Tim Van de Cruys, et al.*2022 · 6 citations*
482. [**Dependency Parsing Evaluation for Low-resource Spontaneous Speech**Zoey Liu, Emily Prud'hommeaux*2021 · 6 citations*](https://md.research.elamur.ai/free/en/papers/liu-2021-dependency-parsing-evaluation-low-resource/)
483. [**Evaluating Amharic Machine Translation arXiv:2003.14386**Asmelash Teka Hadgu, Adam Beaudoin, Abel Aregawi*2020 · 6 citations*](https://md.research.elamur.ai/free/en/papers/hadgu-2020-evaluating-amharic-machine-translation/)
484. [**Development and Evaluation of a Personalized Computer-aided Question Generation for English Learners to Improve Proficiency and Correct Mistakes arXiv:1808.09732**Yi-Ting Huang, Meng Chang Chen, Yeali S. Sun*2018 · 6 citations*](https://md.research.elamur.ai/free/en/papers/huang-2018-development-evaluation-personalized-computer-aided/)
485. [**Evaluation of Finite State Morphological Analyzers Based on Paradigm Extraction from Wiktionary**Ling Liu, Mans Hulden*2017 · 6 citations*](https://md.research.elamur.ai/free/en/papers/liu-2017-fst-paradigm-extraction-wiktionary/)
486. **[In-Context Evaluation of Unsupervised Dialogue Act Models for Tutorial Dialogue](https://md.research.elamur.ai/free/en/papers/can-2013-context-evaluation-unsupervised-dialogue-act/) [SIGDIAL Conference](https://md.research.elamur.ai/free/en/venues/sigdial-conference/)**Aysu Ezen-Can, Kristy Boyer*2013 · 6 citations*
487. **[Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation](https://md.research.elamur.ai/free/en/papers/tian-2026-beyond-literal-mapping-benchmarking-improving/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yanzhi Tian, Cunxiang Wang, Zeming Liu, et al.*2026 · 5 citations*
488. [**MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark arXiv:2602.01714**Mouath Abu-Daoud, Leen Kharouf, Omar El Hajj, et al.*2026 · 5 citations*](https://md.research.elamur.ai/free/en/papers/abu-daoud-2026-medarabench-large-scale-arabic-medical/)
489. **[Gender Bias Evaluation in Machine Translation for Amharic, Tigrigna, and Afaan Oromoo](https://md.research.elamur.ai/free/en/papers/sewunetie-2024-gender-bias-evaluation-machine-translation/) [Workshop on Gender-Inclusive Translation Technologies](https://md.research.elamur.ai/free/en/venues/gitt/)**Walelign Sewunetie, Atnafu Tonja, Tadesse Belay, et al.*2024 · 5 citations*
490. [**Overview of the Arabic Sentiment Analysis 2021 Competition at KAUST arXiv:2109.14456**Hind Alamro, Manal Alshehri, Basma Alharbi, et al.*2021 · 5 citations*](https://md.research.elamur.ai/free/en/papers/alamro-2021-overview-arabic-sentiment-analysis-2021/)
491. **[Toward Qualitative Evaluation of Embeddings for Arabic Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/barhoumi-2020-qualitative-evaluation-embeddings-arabic-sentiment/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Amira Barhoumi, Nathalie Camelin, Chafik Aloulou, et al.*2020 · 5 citations*
492. [**Predicting CEFRL levels in learner English on the basis of metrics and full texts arXiv:1806.11099**Taylor Arnold, Nicolas Ballier, Thomas Gaillat, et al.*2018 · 5 citations*](https://md.research.elamur.ai/free/en/papers/arnold-2018-predicting-cefrl-levels-learner-english/)
493. **[Evaluation Strategies for Computational Construction Grammars](https://md.research.elamur.ai/free/en/papers/marques-2016-evaluation-strategies-computational-construction-grammars/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Tânia Marques, Katrien Beuls*2016 · 5 citations*
494. [**First Results in a Study Evaluating Pre-annotation and Correction Propagation for Machine-Assisted Syriac Morphological Analysis**Paul Felt, Eric Ringger, Kevin Seppi, et al.*2012 · 5 citations*](https://md.research.elamur.ai/free/en/papers/felt-2012-first-results-study-evaluating-pre/)
495. [**Evaluation Metrics for Knowledge-Based Machine Translation**Teruko Mitamura, Jaime G. Carbonell*1994 · 5 citations*](https://md.research.elamur.ai/free/en/papers/mitamura-1994-evaluation-metrics-knowledge-based-machine/)
496. **[Extending ASR Evaluation Resources for Modern Greek Dialects](https://md.research.elamur.ai/free/en/papers/tsoukala-2026-extending-asr-evaluation-resources-modern/) [Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial)](https://md.research.elamur.ai/free/en/venues/vardial/)**Chara Tsoukala, Stavros Bompolas, Antigoni Margariti, et al.*2026 · 4 citations*
497. **[Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results](https://md.research.elamur.ai/free/en/papers/peter-2026-mind-gap-or-not-how/) [Workshop on Generation, Evaluation and Metrics (GEM)](https://md.research.elamur.ai/free/en/venues/gem/)**Jan-Thorsten Peter, David Vilar, Tobias Domhan, et al.*2026 · 4 citations*
498. **[Multi-Session Client-Centered Treatment Outcome Evaluation in Psychotherapy](https://md.research.elamur.ai/free/en/papers/na-2026-multi-session-client-centered-treatment/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Hongbin Na, Tao Shen, Shumao Yu, et al.*2026 · 4 citations*
499. **[Are BabyLMs Deaf to Gricean Maxims? A Pragmatic Evaluation of Sample-efficient Language Models](https://md.research.elamur.ai/free/en/papers/askari-2025-are-babylms-deaf-gricean-maxims/) [BabyLM Workshop](https://md.research.elamur.ai/free/en/venues/babylm/)**Raha Askari, Sina Zarrieß, Özge Alacam, et al.*2025 · 4 citations*
500. **[Advancing Arabic Sentiment Analysis: ArSen Benchmark and the Improved Fuzzy Deep Hybrid Network](https://md.research.elamur.ai/free/en/papers/fang-2024-advancing-arabic-sentiment-analysis-arsen/) [Conference on Computational Natural Language Learning (CoNLL)](https://md.research.elamur.ai/free/en/venues/conll/)**Yang Fang, Cheng Xu, Shuhao Guan, et al.*2024 · 4 citations*
501. [**How BERT Speaks Shakespearean English? Evaluating Historical Bias in Contextual Language Models**Miriam Cuscito, Alfio Ferrara, Martin Ruskov*2024 · 4 citations*](https://md.research.elamur.ai/free/en/papers/cuscito-2024-bert-speaks-shakespearean-english-evaluating/)
502. [**A Benchmark Arabic Dataset for Commonsense Explanation arXiv:2012.10251**Saja AL-Tawalbeh, Mohammad AL-Smadi*2020 · 4 citations*](https://md.research.elamur.ai/free/en/papers/al-tawalbeh-2020-benchmark-arabic-dataset-commonsense-explanation/)
503. [**Evaluating Inter-Annotator Agreement on Historical Spelling Normalization**Marcel Bollmann, Stefanie Dipper, Florian Petran*2016 · 4 citations*](https://md.research.elamur.ai/free/en/papers/bollmann-2016-evaluating-inter-annotator-agreement-historical/)
504. **[Towards a Semantic Annotation of English Television News - Building and Evaluating a Constraint Grammar FrameNet](https://md.research.elamur.ai/free/en/papers/bick-2012-semantic-annotation-english-television-news/) [Pacific Asia Conference on Language, Information and Computation (PACLIC)](https://md.research.elamur.ai/free/en/venues/paclic/)**Eckhard Bick*2012 · 4 citations*
505. **[How Specialized are Specialized Corpora? Behavioral Evaluation of Corpus Representativeness for Maltese.](https://md.research.elamur.ai/free/en/papers/francom-2010-how-specialized-are-specialized-corpora/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Jerid Francom, Amy LaCross, Adam Ussishkin*2010 · 4 citations*
506. **[Creation and Evaluation of Extensible Language Resources for Maltese](https://md.research.elamur.ai/free/en/papers/dalli-2002-creation-evaluation-extensible-language-resources/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Angelo Dalli*2002 · 4 citations*
507. **[ARB: A Comprehensive Arabic Multimodal Reasoning Benchmark](https://md.research.elamur.ai/free/en/papers/ghaboura-2026-arb-comprehensive-arabic-multimodal-reasoning/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Sara Ghaboura, Shubham Patle, Ketan More, et al.*2026 · 3 citations*
508. **[Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect Variants](https://md.research.elamur.ai/free/en/papers/bhatti-2026-beyond-mcq-open-ended-arabic/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Hunzalah Hassan Bhatti, Firoj Alam*2026 · 3 citations*
509. [**Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM Benchmarks**Go Inoue, Bashar Alhafni, Nizar Habash, et al.*2026 · 3 citations*](https://md.research.elamur.ai/free/en/papers/inoue-2026-do-diacritics-matter-evaluating-impact/)
510. **[Evaluating Multimodal Large Language Models on Vertically Written Japanese Text](https://md.research.elamur.ai/free/en/papers/sasagawa-2026-evaluating-multimodal-large-language-models/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Keito Sasagawa, Shuhei Kurita, Daisuke Kawahara*2026 · 3 citations*
511. [**HalluScore: Large Language Model Hallucination Question Answering Benchmark arXiv:2605.17007**Aisha Alansari, Hamzah Luqman*2026 · 3 citations*](https://md.research.elamur.ai/free/en/papers/alansari-2026-halluscore-large-language-model-hallucination/)
512. [**Nahw: A Comprehensive Benchmark of Arabic Grammar Understanding, Error Detection, Correction, and Explanation**Hamdy Mubarak, Majd Hawasly, Abubakr Mohamed*2026 · 3 citations*](https://md.research.elamur.ai/free/en/papers/mubarak-2026-nahw-comprehensive-benchmark-arabic-grammar/)
513. **[A Multi-Task Benchmark for Abusive Language Detection in Low-Resource Settings](https://md.research.elamur.ai/free/en/papers/gaim-2025-multi-task-benchmark-abusive-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Fitsum Gaim, Hoyun Song, Huije Lee, et al.*2025 · 3 citations*
514. **[BLiMP-IT: Harnessing Automatic Minimal Pair Generation for Italian Language Model Evaluation](https://md.research.elamur.ai/free/en/papers/barbini-2025-blimp-it-harnessing-automatic-minimal/) [Italian Conference on Computational Linguistics](https://md.research.elamur.ai/free/en/venues/clicit/)**Matilde Barbini, Maria Letizia Piccini Bianchessi, Veronica Bressan, et al.*2025 · 3 citations*
515. [**Targeted Syntactic Evaluation for Grammatical Error Correction**Aomi Koyama, Masato Mita, Su-Youn Yoon, et al.*2025 · 3 citations*](https://md.research.elamur.ai/free/en/papers/koyama-2025-targeted-syntactic-evaluation-grammatical-error/)
516. [**Cyber Risks of Machine Translation Critical Errors : Arabic Mental Health Tweets as a Case Study arXiv:2405.11668**Hadeel Saadany, Ashraf Tantawy, Constantin Orasan*2024 · 3 citations*](https://md.research.elamur.ai/free/en/papers/saadany-2024-cyber-risks-machine-translation-critical/)
517. [**Evaluating large language models for the tasks of PoS tagging within the Universal Dependency framework**Mateus Machado, Evandro Ruiz*2024 · 3 citations*](https://md.research.elamur.ai/free/en/papers/machado-2024-evaluating-large-language-models-tasks/)
518. [**PCR4ALL: A Comprehensive Evaluation Benchmark for Pronoun Coreference Resolution in English**Xinran Zhao, Hongming Zhang, Yangqiu Song*2022 · 3 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2022-pcr4all-comprehensive-evaluation-benchmark-pronoun/)
519. **[BPoMP: The Benchmark of Poetic Minimal Pairs – Limericks, Rhyme, and Narrative Coherence](https://md.research.elamur.ai/free/en/papers/abdibayev-2021-bpomp-benchmark-poetic-minimal-pairs/) [Recent Advances in Natural Language Processing (RANLP)](https://md.research.elamur.ai/free/en/venues/ranlp/)**Almas Abdibayev, Allen Riddell, Daniel Rockmore*2021 · 3 citations*
520. **[SiPOS: A Benchmark Dataset for Sindhi Part-of-Speech Tagging](https://md.research.elamur.ai/free/en/papers/ali-2021-sipos-benchmark-dataset-sindhi-part/) [Recent Advances in Natural Language Processing (RANLP)](https://md.research.elamur.ai/free/en/venues/ranlp/)**Wazir Ali, Zenglin Xu, Jay Kumar*2021 · 3 citations*
521. [**English Out-of-Vocabulary Lexical Evaluation Task arXiv:1804.04242**Han Wang, Ye Wang, Xinxiang Zhang, et al.*2018 · 3 citations*](https://md.research.elamur.ai/free/en/papers/wang-2018-english-out-vocabulary-lexical-evaluation/)
522. **[Applying the Cognitive Machine Translation Evaluation Approach to Arabic](https://md.research.elamur.ai/free/en/papers/temnikova-2016-applying-cognitive-machine-translation-evaluation/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Irina Temnikova, Wajdi Zaghouani, Stephan Vogel, et al.*2016 · 3 citations*
523. [**Concept Based vs. Pseudo Relevance Feedback Performance Evaluation for Information Retrieval System arXiv:1403.4362 · International Journal of Computational Linguistics Research, ISSN: 0976-416X, Volume 4, Issue 4, December, 2013, Pages 149-158**Mohammed El Amine Abderrahim*2013 · 3 citations*](https://md.research.elamur.ai/free/en/papers/abderrahim-2014-concept-based-vs-pseudo-relevance/)
524. **[Automatic Extraction and Evaluation of Arabic LFG Resources](https://md.research.elamur.ai/free/en/papers/attia-2012-automatic-extraction-evaluation-arabic-lfg/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Mohammed Attia, Khaled Shaalan, Lamia Tounsi, et al.*2012 · 3 citations*
525. **[A Critical Study of Automatic Evaluation in Sign Language Translation](https://md.research.elamur.ai/free/en/papers/yazdani-2026-critical-study-automatic-evaluation-sign/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Shakib Yazdani, Yasser HAMIDULLAH, Cristina España-Bonet, et al.*2026 · 2 citations*

[← prev](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/5/) [1](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) … [5](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/5/) **6** [7](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/7/) [8](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/8/) [next →](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/page/7/)