---
title: "IF-RewardBench — paper by Wen et al. (2026)"
description: "The authors introduce IF-RewardBench to address these gaps. 0.95 agreement. 69 references, cited by 1 paper here."
authors: ["Bosi Wen", "Yilin Niu", "Cunxiang Wang", "Xiaoying Ling", "Ying Zhang", "Pei Ke", "Hongning Wang", "Minlie Huang"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1092/"
doi: "10.18653/v1/2026.acl-long.1092"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wen-2026-if-rewardbench-benchmarking-judge-models/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wen-2026-if-rewardbench-benchmarking-judge-models/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/13/) / IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation

# IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation

**Authors:** [Bosi Wen](https://md.research.elamur.ai/free/en/authors/bosi-wen/), [Yilin Niu](https://md.research.elamur.ai/free/en/authors/yilin-niu/), [Cunxiang Wang](https://md.research.elamur.ai/free/en/authors/cunxiang-wang/), [Xiaoying Ling](https://md.research.elamur.ai/free/en/authors/xiaoying-ling/), [Ying Zhang](https://md.research.elamur.ai/free/en/authors/ying-zhang/), [Pei Ke](https://md.research.elamur.ai/free/en/authors/pei-ke/), [Hongning Wang](https://md.research.elamur.ai/free/en/authors/hongning-wang/) and [Minlie Huang](https://md.research.elamur.ai/free/en/authors/minlie-huang/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1092/) · [PDF](https://aclanthology.org/2026.acl-long.1092.pdf) · [DOI 10.18653/v1/2026.acl-long.1092](https://doi.org/10.18653/v1/2026.acl-long.1092) · [OpenAlex](https://openalex.org/W7166852156)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
Judge models (LLM-as-a-Judge and reward models) are widely used to check whether LLM outputs obey instructions and to supply reward signals for alignment. Existing meta-evaluation benchmarks for this task have three weaknesses: they cover mostly single-turn prompts with code-checkable constraints, they reduce judging to pairwise or Best-of-N winner selection, and their labels often lack human verification.

The authors introduce IF-RewardBench to address these gaps. It covers single-turn, multi-turn and system-prompt instructions, each paired with a constraint checklist. Several responses per instruction are labelled by human experts for each constraint. Pareto dominance over these labels produces a preference graph, which supports two kinds of evaluation:
- pointwise checking of individual constraints;
- listwise ranking of all responses, which resembles how rewards are actually used in optimization.

Across 22 judges, every model falls well short of human-level ranking. Scores on the benchmark also predict downstream Best-of-N selection quality better than prior benchmarks do. This makes it a more trustworthy tool for choosing judges in instruction-following alignment.

## Key points
- **Dataset scale:** 842 instructions and 6,011 responses produced by 16 LLMs. Sources include Chinese and English instruction-following benchmarks and real user data.
- **Annotation quality:** cross-validation showed 0.95 agreement between annotators, with a Cohen's Kappa of 0.87.
- **Ranking performance (Kendall correlation):**
  - Gemini-3-Pro, the best model, reaches 0.609, against 0.755 for humans.
  - GLM-4.6 and DeepSeek-V3.2 score around 0.4 or lower.
  - No dedicated reward model exceeds 0.2.
- **Factors that make judging harder:**
  - Missing constraint violations is the main bottleneck.
  - System prompts and conversation history increase difficulty.
  - Subjective constraints (Situation, Style) are harder to verify than objective ones.
  - Performance drops as constraints become more numerous or more complex, and as response quality rises.
- **Inference-time effects:** turning off thinking mode lowers results on all tasks. Gains from self-consistency voting level off beyond K=7.
- **Downstream validation:** the authors ran Best-of-8 sampling on 300 new instructions with 15 judges. IF-RewardBench showed the strongest Somers' D correlation with Best-of-8 results, while LLMBar and RewardBench-2 are close to saturation.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Tsinghua University](https://md.research.elamur.ai/free/en/universities/tsinghua-university/) — University, Beijing, China · 333 works · 87,019 citations
- [Zhipu AI](https://md.research.elamur.ai/free/en/companies/zhipu-ai/) — Company, Beijing, China · 22 works · 2,364 citations
- [University of Electronic Science and Technology of China](https://md.research.elamur.ai/free/en/universities/university-of-electronic-science-and-technology-of-china/) — University, Chengdu, China · 31 works · 2,012 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

## Cite

Cite as: Bosi Wen, Yilin Niu, Cunxiang Wang, Xiaoying Ling, Ying Zhang, Pei Ke, Hongning Wang and Minlie Huang. 2026. IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wen2026if,
  title = {{IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation}},
  author = {Bosi Wen, Yilin Niu, Cunxiang Wang, Xiaoying Ling, Ying Zhang, Pei Ke, Hongning Wang and Minlie Huang},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1092},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1092}
}
```

- [← previous IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation](https://md.research.elamur.ai/free/en/papers/wen-2026-if-critic-fine-grained-llm/)
- [next → IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation](https://md.research.elamur.ai/free/en/papers/tang-2026-igenbench-benchmarking-reliability-text-infographic/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/13/)

## References

69 references, 32 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Sandhini Agarwal, Lama Ahmad, Jason Ai, Sam Altman, Andy Applebaum, Edwin Arbus, Rahul K Arora, Yu Bai, Bowen Baker, Haiming Bao, and 1 others. 2025. [gpt-oss-120b & gpt-oss-20b model card](https://md.research.elamur.ai/free/en/papers/agarwal-2025-gpt-oss-120b-gpt-oss/). arXiv preprint arXiv:2508.10925.
2. Anthropic. 2025. Claude sonnet 4.5. [find](https://scholar.google.com/scholar?q=Anthropic%2E+2025%2E+Claude+sonnet+4%2E5%2E)
3. Bradley Brown, Jordan Juravsky, Ryan Ehrlich, Ronald Clark, Quoc V Le, Christopher Ré, and Azalia Mirhoseini. 2024. [Large language monkeys: Scaling inference compute with repeated sampling](https://md.research.elamur.ai/free/en/papers/brown-2024-large-language-monkeys-scaling-inference/). arXiv preprint arXiv:2407.21787.
4. ByteDance. 2025. Seed1.6 tech introduction. [find](https://scholar.google.com/scholar?q=ByteDance%2E+2025%2E+Seed1%2E6+tech+introduction%2E)
5. Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, and 1 others. 2024. [Internlm2 technical report](https://md.research.elamur.ai/free/en/papers/cai-2024-internlm2-technical-report/). arXiv preprint arXiv:2403.17297.
6. Xiusi Chen, Gaotang Li, Ziqi Wang, Bowen Jin, Cheng Qian, Yu Wang, Hongru Wang, Yu Zhang, Denghui Zhang, Tong Zhang, and 1 others. 2025. [Rm-r1: Reward modeling as reasoning](https://md.research.elamur.ai/free/en/papers/chen-2025-rm-r1-reward-modeling-reasoning/). arXiv preprint arXiv:2505.02387.
7. Jiale Cheng, Xiao Liu, Cunxiang Wang, Xiaotao Gu, Yida Lu, Dan Zhang, Yuxiao Dong, Jie Tang, Hongning Wang, and Minlie Huang. 2025. SPar: Self-play with tree-search refinement to improve instruction-following in large language models. In The Thirteenth International Conference on Learning Representa… [find](https://scholar.google.com/scholar?q=Jiale+Cheng%2C+Xiao+Liu%2C+Cunxiang+Wang%2C+Xiaotao+Gu%2C+Yida+Lu%2C+Dan+Zhang%2C+Yuxiao+Dong%2C+Jie+Tang%2C+Hongning+Wang%2C+and+Minlie+Huang%2E+2025%2E+SPar%3A+Self%2Dplay+with+tree%2Dsearch+refinement+to+improve+instruction%2Df)
8. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1):37–46. [find](https://scholar.google.com/scholar?q=Jacob+Cohen%2E+1960%2E+A+coefficient+of+agreement+for+nominal+scales%2E+Educational+and+psychological+measurement%2C+20%281%29%3A37%E2%80%9346%2E)
9. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, and 1 others. 2025. [Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/). arX…
10. Kaustubh Deshpande, Ved Sirdeshmukh, Johannes Baptist Mols, Lifeng Jin, Ed-Yeremai Hernandez-Cardona, Dean Lee, Jeremy Kritz, Willow E. Primack, Summer Yue, and Chen Xing. 2025. Multi-Challenge: A realistic multi-turn conversation evaluation benchmark challenging to frontier LLMs. In Findings of the… [find](https://scholar.google.com/scholar?q=Kaustubh+Deshpande%2C+Ved+Sirdeshmukh%2C+Johannes+Baptist+Mols%2C+Lifeng+Jin%2C+Ed%2DYeremai+Hernandez%2DCardona%2C+Dean+Lee%2C+Jeremy+Kritz%2C+Willow+E%2E+Primack%2C+Summer+Yue%2C+and+Chen+Xing%2E+2025%2E+Multi%2DChallenge%3A+A+rea)
11. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, and 1 others. 2024. [The llama 3 herd of models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). arXiv e-prints, pages arXiv–2407.
12. Arpad E. Elo. 1978. The Rating of Chessplayers, Past and Present. Arco Pub., New York. [find](https://scholar.google.com/scholar?q=Arpad+E%2E+Elo%2E+1978%2E+The+Rating+of+Chessplayers%2C+Past+and+Present%2E+Arco+Pub%2E%2C+New+York%2E)
13. Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, and 1 others. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, volume 96, pages 226–231. [find](https://scholar.google.com/scholar?q=Martin+Ester%2C+Hans%2DPeter+Kriegel%2C+J%C3%B6rg+Sander%2C+Xiaowei+Xu%2C+and+1+others%2E+1996%2E+A+density%2Dbased+algorithm+for+discovering+clusters+in+large+spatial+databases+with+noise%2E+In+kdd%2C+volume+96%2C+pages+226%E2%80%9323)
14. Evan Frick, Tianle Li, Connor Chen, Wei-Lin Chiang, Anastasios Nikolas Angelopoulos, Jiantao Jiao, Banghua Zhu, Joseph E. Gonzalez, and Ion Stoica. 2025. How to evaluate reward models for RLHF. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Evan+Frick%2C+Tianle+Li%2C+Connor+Chen%2C+Wei%2DLin+Chiang%2C+Anastasios+Nikolas+Angelopoulos%2C+Jiantao+Jiao%2C+Banghua+Zhu%2C+Joseph+E%2E+Gonzalez%2C+and+Ion+Stoica%2E+2025%2E+How+to+evaluate+reward+models+for+RLHF%2E+In+The)
15. Team GLM, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Dan Zhang, Diego Rojas, Guanyu Feng, Hanlin Zhao, and 1 others. 2024. [Chatglm: A family of large language models from glm-130b to glm-4 all tools](https://md.research.elamur.ai/free/en/papers/glm-2024-chatglm-family-large-language-models/). arXiv preprint arXiv:2406.12793.
16. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, and 1 others. 2025a. Deepseekr1 incentivizes reasoning in llms through reinforcement learning. Nature, 645(8081):633–638. [find](https://scholar.google.com/scholar?q=Daya+Guo%2C+Dejian+Yang%2C+Haowei+Zhang%2C+Junxiao+Song%2C+Peiyi+Wang%2C+Qihao+Zhu%2C+Runxin+Xu%2C+Ruoyu+Zhang%2C+Shirong+Ma%2C+Xiao+Bi%2C+and+1+others%2E+2025a%2E+Deepseekr1+incentivizes+reasoning+in+llms+through+reinforcem)
17. Jiaxin Guo, Zewen Chi, Li Dong, Qingxiu Dong, Xun Wu, Shaohan Huang, and Furu Wei. 2025b. Reward reasoning model. arXiv preprint arXiv:2505.14674. — [arXiv:2505.14674](https://arxiv.org/abs/2505.14674) [find](https://scholar.google.com/scholar?q=Jiaxin+Guo%2C+Zewen+Chi%2C+Li+Dong%2C+Qingxiu+Dong%2C+Xun+Wu%2C+Shaohan+Huang%2C+and+Furu+Wei%2E+2025b%2E+Reward+reasoning+model%2E+arXiv+preprint+arXiv%3A2505%2E14674%2E+%E2%80%94+%5BarXiv%3A2505%2E14674%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2505%2E14674)
18. Yun He, Di Jin, Chaoqi Wang, Chloe Bi, Karishma Mandyam, Hejia Zhang, Chen Zhu, Ning Li, Tengyu Xu, Hongjiang Lv, and 1 others. 2024. Multi-if: Benchmarking llms on multi-turn and multilingual instructions following. arXiv preprint arXiv:2410.15553. — [arXiv:2410.15553](https://arxiv.org/abs/2410.15553) [find](https://scholar.google.com/scholar?q=Yun+He%2C+Di+Jin%2C+Chaoqi+Wang%2C+Chloe+Bi%2C+Karishma+Mandyam%2C+Hejia+Zhang%2C+Chen+Zhu%2C+Ning+Li%2C+Tengyu+Xu%2C+Hongjiang+Lv%2C+and+1+others%2E+2024%2E+Multi%2Dif%3A+Benchmarking+llms+on+multi%2Dturn+and+multilingual+instruc)
19. Yun He, Wenzhe Li, Hejia Zhang, Songlin Li, Karishma Mandyam, Sopan Khosla, Yuanhao Xiong, Nanshu Wang, Selina Peng, Beibin Li, and 1 others. 2025. Rubric-based benchmarking and reinforcement learning for advancing llm instruction following. arXiv preprint arXiv:2511.10507. — [arXiv:2511.10507](https://arxiv.org/abs/2511.10507) [find](https://scholar.google.com/scholar?q=Yun+He%2C+Wenzhe+Li%2C+Hejia+Zhang%2C+Songlin+Li%2C+Karishma+Mandyam%2C+Sopan+Khosla%2C+Yuanhao+Xiong%2C+Nanshu+Wang%2C+Selina+Peng%2C+Beibin+Li%2C+and+1+others%2E+2025%2E+Rubric%2Dbased+benchmarking+and+reinforcement+learning)
20. Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, and 1 others. 2024. [Minicpm: Unveiling the potential of small language models with scalable training strategies](https://md.research.elamur.ai/free/en/papers/hu-2024-minicpm-unveiling-potential-small-language/). arXiv preprint arXiv:2404.06395.
21. Xiaowei Huang, Wenjie Ruan, Wei Huang, Gaojie Jin, Yi Dong, Changshun Wu, Saddek Bensalem, Ronghui Mu, Yi Qi, Xingyu Zhao, and 1 others. 2024. A survey of safety and trustworthiness of large language models through the lens of verification and validation. Artificial Intelligence Review, 57(7):175. [find](https://scholar.google.com/scholar?q=Xiaowei+Huang%2C+Wenjie+Ruan%2C+Wei+Huang%2C+Gaojie+Jin%2C+Yi+Dong%2C+Changshun+Wu%2C+Saddek+Bensalem%2C+Ronghui+Mu%2C+Yi+Qi%2C+Xingyu+Zhao%2C+and+1+others%2E+2024%2E+A+survey+of+safety+and+trustworthiness+of+large+language+)
22. Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li, Fei Mi, Lifeng Shang, Xin Jiang, Qun Liu, and Wei Wang. 2024. Follow-Bench: A multi-level fine-grained constraints following benchmark for large language models. In Proceedings of the 62nd Annual Meeting of the Association for Comput… [find](https://scholar.google.com/scholar?q=Yuxin+Jiang%2C+Yufei+Wang%2C+Xingshan+Zeng%2C+Wanjun+Zhong%2C+Liangyou+Li%2C+Fei+Mi%2C+Lifeng+Shang%2C+Xin+Jiang%2C+Qun+Liu%2C+and+Wei+Wang%2E+2024%2E+Follow%2DBench%3A+A+multi%2Dlevel+fine%2Dgrained+constraints+following+benchmar)
23. Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, and Ion Stoica. 2023. [Efficient memory management for large language model serving with pagedattention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/). In Proceedings of the 29th Symposium on Operating Systems Principles, pages 611–626. pro…
24. Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, and 1 others. 2024. [Tulu 3: Pushing frontiers in open language model post-training](https://md.research.elamur.ai/free/en/papers/lambert-2024-tulu-3-pushing-frontiers-open/). arXiv preprint arXiv:2411.15124.
25. Junru Lu, Jiazheng Li, Guodong Shen, Lin Gui, Siyu An, Yulan He, Di Yin, and Xing Sun. 2025. RoleMRC: A fine-grained composite benchmark for role-playing and instruction-following. In Findings of the Association for Computational Linguistics: ACL 2025, pages 21008–21030, Vienna, Austria. Association… [find](https://scholar.google.com/scholar?q=Junru+Lu%2C+Jiazheng+Li%2C+Guodong+Shen%2C+Lin+Gui%2C+Siyu+An%2C+Yulan+He%2C+Di+Yin%2C+and+Xing+Sun%2E+2025%2E+RoleMRC%3A+A+fine%2Dgrained+composite+benchmark+for+role%2Dplaying+and+instruction%2Dfollowing%2E+In+Findings+of+the+)
26. Nathan Lambert, Valentina Pyatkin, Jacob Morrison, LJ Miranda, Bill Yuchen Lin, Khyathi Chandu, Nouha Dziri, Sachin Kumar, Tom Zick, Yejin Choi, Noah A. Smith, and Hannaneh Hajishirzi. 2025. RewardBench: Evaluating reward models for language modeling. In Findings of the Association for Computational… [find](https://scholar.google.com/scholar?q=Nathan+Lambert%2C+Valentina+Pyatkin%2C+Jacob+Morrison%2C+LJ+Miranda%2C+Bill+Yuchen+Lin%2C+Khyathi+Chandu%2C+Nouha+Dziri%2C+Sachin+Kumar%2C+Tom+Zick%2C+Yejin+Choi%2C+Noah+A%2E+Smith%2C+and+Hannaneh+Hajishirzi%2E+2025%2E+RewardBen)
27. Jinnan Li, Jinzhe Li, Yue Wang, Yi Chang, and Yuan Wu. 2025a. StructFlowBench: A structured flow benchmark for multi-turn instruction following. In Findings of the Association for Computational Linguistics: ACL 2025, pages 9322–9341, Vienna, Austria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jinnan+Li%2C+Jinzhe+Li%2C+Yue+Wang%2C+Yi+Chang%2C+and+Yuan+Wu%2E+2025a%2E+StructFlowBench%3A+A+structured+flow+benchmark+for+multi%2Dturn+instruction+following%2E+In+Findings+of+the+Association+for+Computational+Lingui)
28. Shiyu Li, Yang Tang, Shizhe Chen, and Xi Chen. 2024. Conan-embedding: General text embedding with more and better negative samples. arXiv preprint arXiv:2408.15710. [find](https://scholar.google.com/scholar?q=Shiyu+Li%2C+Yang+Tang%2C+Shizhe+Chen%2C+and+Xi+Chen%2E+2024%2E+Conan%2Dembedding%3A+General+text+embedding+with+more+and+better+negative+samples%2E+arXiv+preprint+arXiv%3A2408%2E15710%2E)
29. Zhenyu Li, Kehai Chen, Yunfei Long, Xuefeng Bai, Yaoyin Zhang, Xuchen Wei, Juntao Li, and Min Zhang. 2025b. Xifbench: Evaluating large language models on multilingual instruction following. arXiv preprint arXiv:2503.07539. — [arXiv:2503.07539](https://arxiv.org/abs/2503.07539) [find](https://scholar.google.com/scholar?q=Zhenyu+Li%2C+Kehai+Chen%2C+Yunfei+Long%2C+Xuefeng+Bai%2C+Yaoyin+Zhang%2C+Xuchen+Wei%2C+Juntao+Li%2C+and+Min+Zhang%2E+2025b%2E+Xifbench%3A+Evaluating+large+language+models+on+multilingual+instruction+following%2E+arXiv+prep)
30. Aixin Liu, Aoxue Mei, Bangcai Lin, Bing Xue, Bingxuan Wang, Bingzheng Xu, Bochao Wu, Bowei Zhang, Chaofan Lin, Chen Dong, and 1 others. 2025a. [Deepseek-v3.2: Pushing the frontier of open large language models](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-v3-2-pushing/). arXiv preprint arXiv:2512.02556.
31. Chris Yuhao Liu, Liang Zeng, Yuzhen Xiao, Jujie He, Jiacai Liu, Chaojie Wang, Rui Yan, Wei Shen, Fuxiang Zhang, Jiacheng Xu, and 1 others. 2025b. [Skywork-reward-v2: Scaling preference data curation via human-ai synergy](https://md.research.elamur.ai/free/en/papers/liu-2025-skywork-reward-v2-scaling/). arXiv preprint arXiv:2507.01352.
32. Wenhao Liu, Zhengkang Guo, Mingchen Xie, Jingwen Xu, Zisu Huang, Muzhao Tian, Jianhan Xu, Muling Wu, Xiaohua Wang, Changze Lv, and 1 others. 2025c. Recast: Strengthening llms’ complex instruction following with constraint-verifiable data. arXiv preprint arXiv:2505.19030. — [arXiv:2505.19030](https://arxiv.org/abs/2505.19030) [find](https://scholar.google.com/scholar?q=Wenhao+Liu%2C+Zhengkang+Guo%2C+Mingchen+Xie%2C+Jingwen+Xu%2C+Zisu+Huang%2C+Muzhao+Tian%2C+Jianhan+Xu%2C+Muling+Wu%2C+Xiaohua+Wang%2C+Changze+Lv%2C+and+1+others%2E+2025c%2E+Recast%3A+Strengthening+llms%E2%80%99+complex+instruction+foll)
33. Yang Liu, Yuanshun Yao, Jean-Francois Ton, Xiaoying Zhang, Ruocheng Guo, Hao Cheng, Yegor Klochkov, Muhammad Faaiz Taufiq, and Hang Li. 2023. [Trustworthy llms: a survey and guideline for evaluating large language models’ alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-trustworthy-llms-survey-guideline-evaluating/). arXiv preprint arXiv:2308.05374.
34. Renze Lou, Kai Zhang, and Wenpeng Yin. 2024. Large language model instruction following: A survey of Xing Han Lù, Amirhossein Kazemnejad, Nicholas Meade, Arkil Patel, Dongchan Shin, Alejandra Zambrano, Karolina Stanczak, Peter Shaw, Christopher Pal, and Siva Reddy. 2025. Agentrewardbench: Evaluating… [find](https://scholar.google.com/scholar?q=Renze+Lou%2C+Kai+Zhang%2C+and+Wenpeng+Yin%2E+2024%2E+Large+language+model+instruction+following%3A+A+survey+of+Xing+Han+L%C3%B9%2C+Amirhossein+Kazemnejad%2C+Nicholas+Meade%2C+Arkil+Patel%2C+Dongchan+Shin%2C+Alejandra+Zambrano)
35. Saumya Malik, Valentina Pyatkin, Sander Land, Jacob Morrison, Noah A Smith, Hannaneh Hajishirzi, and Nathan Lambert. 2025. Rewardbench 2: Advancing reward model evaluation. arXiv preprint arXiv:2506.01937. — [arXiv:2506.01937](https://arxiv.org/abs/2506.01937) [find](https://scholar.google.com/scholar?q=Saumya+Malik%2C+Valentina+Pyatkin%2C+Sander+Land%2C+Jacob+Morrison%2C+Noah+A+Smith%2C+Hannaneh+Hajishirzi%2C+and+Nathan+Lambert%2E+2025%2E+Rewardbench+2%3A+Advancing+reward+model+evaluation%2E+arXiv+preprint+arXiv%3A2506%2E0)
36. Tianyi Men, Zhuoran Jin, Pengfei Cao, Yubo Chen, Kang Liu, and Jun Zhao. 2025. Agent-RewardBench: Towards a unified benchmark for reward modeling across perception, planning, and safety in real-world multimodal agents. In Proceedings of the 63rd Annual Meeting of the Association for Computational Li… [find](https://scholar.google.com/scholar?q=Tianyi+Men%2C+Zhuoran+Jin%2C+Pengfei+Cao%2C+Yubo+Chen%2C+Kang+Liu%2C+and+Jun+Zhao%2E+2025%2E+Agent%2DRewardBench%3A+Towards+a+unified+benchmark+for+reward+modeling+across+perception%2C+planning%2C+and+safety+in+real%2Dworld+)
37. OpenAI. 2025. Introducing gpt-5. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025%2E+Introducing+gpt%2D5%2E)
38. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, and 1 others. 2022. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). Advances in neural information processing systems, 35:27730–27744.
39. Hao Peng, Yunjia Qi, Xiaozhi Wang, Bin Xu, Lei Hou, and Juanzi Li. 2025a. [VerIF: Verification engineering for reinforcement learning in instruction following](https://md.research.elamur.ai/free/en/papers/peng-2025-verif-verification-engineering-reinforcement-learning/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 30312–30327, Suzhou, China. Association for…
40. Hao Peng, Yunjia Qi, Xiaozhi Wang, Zijun Yao, Bin Xu, Lei Hou, and Juanzi Li. 2025b. [Agentic reward modeling: Integrating human preferences with verifiable correctness signals for reliable reward systems](https://md.research.elamur.ai/free/en/papers/peng-2025-agentic-reward-modeling-integrating-human/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Vol…
41. José Pombal, Dongkeun Yoon, Patrick Fernandes, Ian Wu, Seungone Kim, Ricardo Rei, Graham Neubig, and André FT Martins. 2025. M-prometheus: A suite of open multilingual llm judges. arXiv preprint arXiv:2504.04953. [find](https://scholar.google.com/scholar?q=Jos%C3%A9+Pombal%2C+Dongkeun+Yoon%2C+Patrick+Fernandes%2C+Ian+Wu%2C+Seungone+Kim%2C+Ricardo+Rei%2C+Graham+Neubig%2C+and+Andr%C3%A9+FT+Martins%2E+2025%2E+M%2Dprometheus%3A+A+suite+of+open+multilingual+llm+judges%2E+arXiv+preprint+arXiv)
42. Valentina Pyatkin, Saumya Malik, Victoria Graf, Hamish Ivison, Shengyi Huang, Pradeep Dasigi, Nathan Lambert, and Hannaneh Hajishirzi. 2025. [Generalizing verifiable instruction following](https://md.research.elamur.ai/free/en/papers/pyatkin-2025-generalizing-verifiable-instruction-following/). arXiv preprint arXiv:2507.02833.
43. Yunjia Qi, Hao Peng, Xiaozhi Wang, Amy Xin, Youfeng Liu, Bin Xu, Lei Hou, and Juanzi Li. 2025. Agentif: Benchmarking instruction following of large language models in agentic scenarios. arXiv preprint arXiv:2505.16944. — [arXiv:2505.16944](https://arxiv.org/abs/2505.16944) [find](https://scholar.google.com/scholar?q=Yunjia+Qi%2C+Hao+Peng%2C+Xiaozhi+Wang%2C+Amy+Xin%2C+Youfeng+Liu%2C+Bin+Xu%2C+Lei+Hou%2C+and+Juanzi+Li%2E+2025%2E+Agentif%3A+Benchmarking+instruction+following+of+large+language+models+in+agentic+scenarios%2E+arXiv+preprint)
44. Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Yuan Tang, Alejandro Cuadron, Chenguang Wang, Raluca Popa, and Ion Stoica. 2025. Judgebench: A benchmark for evaluating LLM-based judges. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Sijun+Tan%2C+Siyuan+Zhuang%2C+Kyle+Montgomery%2C+William+Yuan+Tang%2C+Alejandro+Cuadron%2C+Chenguang+Wang%2C+Raluca+Popa%2C+and+Ion+Stoica%2E+2025%2E+Judgebench%3A+A+benchmark+for+evaluating+LLM%2Dbased+judges%2E+In+The+Thir)
45. Kimi Team, Yifan Bai, Yiping Bao, Guanduo Chen, Jiahao Chen, Ningxin Chen, Ruijue Chen, Yanru Chen, Yuankun Chen, Yutian Chen, and 1 others. 2025. [Kimi k2: Open agentic intelligence](https://md.research.elamur.ai/free/en/papers/kimi-team-2025-kimi-k2-open-agentic/). arXiv preprint arXiv:2507.20534.
46. Yanzhao Qin, Tao Zhang, Tao Zhang, Yanjun Shen, Wenjing Luo, sunhaoze, Yan Zhang, Yujing Qiao, weipeng chen, Zenan Zhou, Wentao Zhang, and Bin CUI. 2025a. Sysbench: Can LLMs follow system message? In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yanzhao+Qin%2C+Tao+Zhang%2C+Tao+Zhang%2C+Yanjun+Shen%2C+Wenjing+Luo%2C+sunhaoze%2C+Yan+Zhang%2C+Yujing+Qiao%2C+weipeng+chen%2C+Zenan+Zhou%2C+Wentao+Zhang%2C+and+Bin+CUI%2E+2025a%2E+Sysbench%3A+Can+LLMs+follow+system+message%3F+In+)
47. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). In The Eleventh International Conference on Learning Representations.
48. Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, and Dong Yu. 2024. [InFoBench: Evaluating instruction following ability in large language models](https://md.research.elamur.ai/free/en/papers/qin-2024-infobench-evaluating-instruction-following-ability/). In Findings of the Association for Computational Linguistics: ACL 2024, pages 13025– 1304…
49. Bosi Wen, Pei Ke, Xiaotao Gu, Lindong Wu, Hao Huang, Jinfeng Zhou, Wenchuang Li, Binxin Hu, Wendy Gao, Jiaxing Xu, and 1 others. 2024. Benchmarking complex instruction-following with multiple constraints composition. Advances in Neural Information Processing Systems, 37:137610–137645. [find](https://scholar.google.com/scholar?q=Bosi+Wen%2C+Pei+Ke%2C+Xiaotao+Gu%2C+Lindong+Wu%2C+Hao+Huang%2C+Jinfeng+Zhou%2C+Wenchuang+Li%2C+Binxin+Hu%2C+Wendy+Gao%2C+Jiaxing+Xu%2C+and+1+others%2E+2024%2E+Benchmarking+complex+instruction%2Dfollowing+with+multiple+constrai)
50. Yulei Qin, Gang Li, Zongyi Li, Zihan Xu, Yuchen Shi, Zhekai Lin, Xiao Cui, Ke Li, and Xing Sun. 2025b. Incentivizing reasoning for advanced instruction-following of large language models. arXiv preprint arXiv:2506.01413. — [arXiv:2506.01413](https://arxiv.org/abs/2506.01413) [find](https://scholar.google.com/scholar?q=Yulei+Qin%2C+Gang+Li%2C+Zongyi+Li%2C+Zihan+Xu%2C+Yuchen+Shi%2C+Zhekai+Lin%2C+Xiao+Cui%2C+Ke+Li%2C+and+Xing+Sun%2E+2025b%2E+Incentivizing+reasoning+for+advanced+instruction%2Dfollowing+of+large+language+models%2E+arXiv+prepri)
51. Qingyu Ren, Jie Zeng, Qianyu He, Jiaqing Liang, Yanghua Xiao, Weikang Zhou, Zeye Sun, and Fei Yu. 2025. Step-by-step mastery: Enhancing soft constraint following ability of large language models. In Findings of the Association for Computational Linguistics: ACL 2025, pages 19581–19596, Vienna, Austr… [find](https://scholar.google.com/scholar?q=Qingyu+Ren%2C+Jie+Zeng%2C+Qianyu+He%2C+Jiaqing+Liang%2C+Yanghua+Xiao%2C+Weikang+Zhou%2C+Zeye+Sun%2C+and+Fei+Yu%2E+2025%2E+Step%2Dby%2Dstep+mastery%3A+Enhancing+soft+constraint+following+ability+of+large+language+models%2E+In+F)
52. Jon Saad-Falcon, Rajan Vivek, William Berrios, Nandita Shankar Naik, Matija Franklin, Bertie Vidgen, Amanpreet Singh, Douwe Kiela, and Shikib Mehri. 2024. Lmunit: Fine-grained evaluation with natural language unit tests. arXiv preprint arXiv:2412.13091. [find](https://scholar.google.com/scholar?q=Jon+Saad%2DFalcon%2C+Rajan+Vivek%2C+William+Berrios%2C+Nandita+Shankar+Naik%2C+Matija+Franklin%2C+Bertie+Vidgen%2C+Amanpreet+Singh%2C+Douwe+Kiela%2C+and+Shikib+Mehri%2E+2024%2E+Lmunit%3A+Fine%2Dgrained+evaluation+with+natural+)
53. Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, YK Li, Yang Wu, and 1 others. 2024. [Deepseekmath: Pushing the limits of mathematical reasoning in open language models](https://md.research.elamur.ai/free/en/papers/shao-2024-deepseekmath-pushing-limits-mathematical-reasoning/). arXiv preprint arXiv:2402.03300.
54. Mingyang Song, Zhaochen Su, Xiaoye Qu, Jiawei Zhou, and Yu Cheng. 2025. PRMBench: A fine-grained and challenging benchmark for process-level reward models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 25299–25346, Vienna, A… [find](https://scholar.google.com/scholar?q=Mingyang+Song%2C+Zhaochen+Su%2C+Xiaoye+Qu%2C+Jiawei+Zhou%2C+and+Yu+Cheng%2E+2025%2E+PRMBench%3A+A+fine%2Dgrained+and+challenging+benchmark+for+process%2Dlevel+reward+models%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of)
55. Bosi Wen, Yilin Niu, Cunxiang Wang, Pei Ke, Xiaoying Ling, Ying Zhang, Aohan Zeng, Hongning Wang, and Minlie Huang. 2025. [If-critic: Towards a fine-grained llm critic for instruction-following evaluation](https://md.research.elamur.ai/free/en/papers/wen-2026-if-critic-fine-grained-llm/). arXiv preprint arXiv:2511.01014.
56. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
57. An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, and 1 others. 2024a. Qwen2.5 technical report. arXiv preprint arXiv:2412.15115. [find](https://scholar.google.com/scholar?q=An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+and+1+others%2E+2024a%2E+Qwen2%2E5+technical+report%2E+arXiv+preprint+arXiv%3A2412%2E15115)
58. An Yang, Beichen Zhang, Binyuan Hui, Bofei Gao, Bowen Yu, Chengpeng Li, Dayiheng Liu, Jianhong Tu, Jingren Zhou, Junyang Lin, and 1 others. 2024b. Qwen2. 5-math technical report: Toward mathematical expert model via self-improvement. arXiv preprint arXiv:2409.12122. — [Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement](https://md.research.elamur.ai/free/en/papers/yang-2024-qwen2-5-math-technical-report/)
59. Aohan Zeng, Xin Lv, Qinkai Zheng, Zhenyu Hou, Bin Chen, Chengxing Xie, Cunxiang Wang, Da Yin, Hao Zeng, Jiajie Zhang, and 1 others. 2025. [Glm-4.5: Agentic, reasoning, and coding (arc) foundation models](https://md.research.elamur.ai/free/en/papers/team-2025-4-glm-4-5-agentic/). arXiv preprint arXiv:2508.06471.
60. Zhiyuan Zeng, Jiatong Yu, Tianyu Gao, Yu Meng, Tanya Goyal, and Danqi Chen. 2024. Evaluating large language models at evaluating instruction following. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Zhiyuan+Zeng%2C+Jiatong+Yu%2C+Tianyu+Gao%2C+Yu+Meng%2C+Tanya+Goyal%2C+and+Danqi+Chen%2E+2024%2E+Evaluating+large+language+models+at+evaluating+instruction+following%2E+In+The+Twelfth+International+Conference+on+Learn)
61. Qinyan Zhang, Xinping Lei, Ruijie Miao, Yu Fu, Haojie Fan, Le Chang, Jiafan Hou, Dingling Zhang, Zhongfei Hou, Ziqiang Yang, and 1 others. 2025a. Inverse ifeval: Can llms unlearn stubborn training conventions to follow real instructions? arXiv preprint arXiv:2509.04292. — [arXiv:2509.04292](https://arxiv.org/abs/2509.04292) [find](https://scholar.google.com/scholar?q=Qinyan+Zhang%2C+Xinping+Lei%2C+Ruijie+Miao%2C+Yu+Fu%2C+Haojie+Fan%2C+Le+Chang%2C+Jiafan+Hou%2C+Dingling+Zhang%2C+Zhongfei+Hou%2C+Ziqiang+Yang%2C+and+1+others%2E+2025a%2E+Inverse+ifeval%3A+Can+llms+unlearn+stubborn+training+con)
62. Tao Zhang, ChengLIn Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, and Zenan Zhou. 2025b. [CFBench: A comprehensive constraints-following benchmark for LLMs](https://md.research.elamur.ai/free/en/papers/zhang-2025-cfbench-comprehensive-constraints-following-benchmark/). In Proceedings of the 63rd Annual Meeting of the Assoc…
63. Xinghua Zhang, Haiyang Yu, Cheng Fu, Fei Huang, and Yongbin Li. 2025c. [IOPO: Empowering LLMs with complex instruction following via input-output preference optimization](https://md.research.elamur.ai/free/en/papers/zhang-2025-iopo-empowering-llms-complex-instruction/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 22185– 2…
64. Zhihan Zhang, Shiyang Li, Zixuan Zhang, Xin Liu, Haoming Jiang, Xianfeng Tang, Yifan Gao, Zheng Li, Haodong Wang, Zhaoxuan Tan, Yichuan Li, Qingyu Yin, Bing Yin, and Meng Jiang. 2025d. IHEval: Evaluating language models on following the instruction hierarchy. In Proceedings of the 2025 Conference of… [find](https://scholar.google.com/scholar?q=Zhihan+Zhang%2C+Shiyang+Li%2C+Zixuan+Zhang%2C+Xin+Liu%2C+Haoming+Jiang%2C+Xianfeng+Tang%2C+Yifan+Gao%2C+Zheng+Li%2C+Haodong+Wang%2C+Zhaoxuan+Tan%2C+Yichuan+Li%2C+Qingyu+Yin%2C+Bing+Yin%2C+and+Meng+Jiang%2E+2025d%2E+IHEval%3A+Evaluat)
65. Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, and 1 others. 2023. [A survey of large language models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/). arXiv preprint arXiv:2303.18223, 1(2).
66. Yunke Zhao, Peng Ding, Jun Kuang, Yibin Shen, Zhe Tang, Yilin Jin, ZongYu Wang, Xiaoyu Li, Xuezhi Cao, Xunliang Cai, and 1 others. 2025. [Meeseeks: A feedback-driven, iterative self-correction benchmark evaluating llms’ instruction following capability](https://md.research.elamur.ai/free/en/papers/wang-2026-meeseeks-feedback-driven-iterative-self/). arXiv preprint arXiv:2504.21625.
67. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, and 1 others. 2023. [Judging llm-as-a-judge with mt-bench and chatbot arena](https://md.research.elamur.ai/free/en/papers/zheng-2023-judging-llm-judge-mt-bench/). Advances in neural information processing systems, 36:46595–46623.
68. Enyu Zhou, Guodong Zheng, Binghai Wang, Zhiheng Xi, Shihan Dou, Rong Bao, Wei Shen, Limao Xiong, Jessica Fan, Yurong Mou, Rui Zheng, Tao Gui, Qi Zhang, and Xuanjing Huang. 2025. [RMB: Comprehensively benchmarking reward models in LLM alignment](https://md.research.elamur.ai/free/en/papers/zhou-2024-rmb-comprehensively-benchmarking-reward-models/). In The Thirteenth International Conference on Learning R…
69. Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. 2023. [Instruction-following evaluation for large language models](https://md.research.elamur.ai/free/en/papers/zhou-2023-instruction-following-evaluation-large-language/). arXiv preprint arXiv:2311.07911.

*Updated 31 October 2026*