--- title: "Who cites From r to Q*: Your Language — 71 citing papers" description: "71 papers of the Elamur Research library cite «From r to Q*: Your Language Model is Secretly a Q-Function», found in their bibliographies…" canonical: "https://research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/cited-by/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/cited-by/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [From r to Q*: Your Language Model is Secretly a…](https://md.research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/) / cited by # Who cites «From r to Q*: Your Language Model is Secretly a Q-Function» 71 papers of our library cite it (of the 149,439 whose bibliographies we read) · 15 with a page here, the most cited first · [← back to «From r to Q*: Your Language Model is Secretly a Q-Function»](https://md.research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/) 1. **[Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts](https://md.research.elamur.ai/free/en/papers/wang-2024-interpretable-preferences-multi-objective-reward/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Haoxiang Wang, Wei Xiong, Tengyang Xie, et al.*2024 · 153 citations* 2. **[Iterative Reasoning Preference Optimization](https://md.research.elamur.ai/free/en/papers/pang-2024-iterative-reasoning-preference-optimization/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Richard Yuanzhe Pang, Weizhe Yuan, Kyunghyun Cho, et al.*2024 · 153 citations* 3. [**Process Reinforcement through Implicit Rewards arXiv:2502.01456**Ganqu Cui, Lifan Yuan, Zefan Wang, et al.*2025 · 151 citations*](https://md.research.elamur.ai/free/en/papers/cui-2025-process-reinforcement-through-implicit-rewards/) 4. [**Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs arXiv:2410.18451**Chris Yuhao Liu, Liang Zeng, Jiacai Liu, et al.*2024 · 112 citations*](https://md.research.elamur.ai/free/en/papers/liu-2024-skywork-reward-bag-tricks/) 5. [**Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive arXiv:2402.13228**Arka Pal, Deep Karkhanis, Samuel Dooley, et al.*2024 · 82 citations*](https://md.research.elamur.ai/free/en/papers/pal-2024-smaug-fixing-failure-modes-preference/) 6. [**Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents arXiv:2408.07199**Pranav Putta, Edmund Mills, Naman Garg, et al.*2024 · 68 citations*](https://md.research.elamur.ai/free/en/papers/putta-2024-agent-q-advanced-reasoning-learning/) 7. [**Free Process Rewards without Process Labels arXiv:2412.01981**Lifan Yuan, Wendi Li, Huayu Chen, et al.*2024 · 58 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2024-free-process-rewards-process-labels/) 8. **[Improve Vision Language Model Chain-of-thought Reasoning](https://md.research.elamur.ai/free/en/papers/zhang-2025-improve-vision-language-model-chain/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ruohong Zhang, Bowen Zhang, Yanghao Li, et al.*2025 · 42 citations* 9. **[Binary Classifier Optimization for Large Language Model Alignment](https://md.research.elamur.ai/free/en/papers/jung-2025-binary-classifier-optimization-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Seungjae Jung, Gunsoo Han, Daniel Wontae Nam, et al.*2025 · 26 citations* 10. [**Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical Reasoning arXiv:2407.00782**Zimu Lu, Aojun Zhou, Ke Wang, et al.*2024 · 23 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-step-controlled-dpo-leveraging-stepwise/) 11. **[Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/bae-2026-online-difficulty-filtering-reasoning-oriented/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Sanghwan Bae, Jiwoo Hong, Min Young Lee, et al.*2026 · 22 citations* 12. **[Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models](https://md.research.elamur.ai/free/en/papers/zhou-2024-weak-strong-search-align-large/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Zhanhui Zhou, Zhixuan Liu, Jie Liu, et al.*2024 · 17 citations* 13. **[Selective Preference Optimization via Token-Level Reward Function Estimation](https://md.research.elamur.ai/free/en/papers/yang-2025-selective-preference-optimization-token-level/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Kailai Yang, Zhiwei Liu, Qianqian Xie, et al.*2025 · 8 citations* 14. **[MuSC: Improving Complex Instruction Following with Multi-granularity Self-Contrastive Training](https://md.research.elamur.ai/free/en/papers/huang-2025-musc-improving-complex-instruction-following/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Hui Huang, Jiaheng Liu, Yancheng He, et al.*2025 · 4 citations* 15. **[Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models](https://md.research.elamur.ai/free/en/papers/wang-2026-learning-while-staying-curious-entropy/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Hao Wang, Hao Gu, Hongming Piao, et al.*2026 · 3 citations* 56 more papers of our library cite it; they have no page here yet. - [← back to](https://md.research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/) — From r to Q*: Your Language Model is Secretly a Q-Function