---
title: "Self-Preference Bias in LLM-as-a-Judge — Wataoka 2024"
description: "LLM judges are widely used to score dialogue systems, but they may favour their own answers, which… 17 references, cited by 67 papers here."
authors: ["Koki Wataoka", "Tsubasa Takahashi", "Ryokan Ri"]
year: 2024
venue: "arXiv:2410.21819"
source: "https://arxiv.org/abs/2410.21819"
doi: "10.48550/arxiv.2410.21819"
arxiv: "2410.21819"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wataoka-2024-self-preference-bias-llm-judge/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wataoka-2024-self-preference-bias-llm-judge/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/4/) / Self-Preference Bias in LLM-as-a-Judge

# Self-Preference Bias in LLM-as-a-Judge

**Authors:** Koki Wataoka, Tsubasa Takahashi and Ryokan Ri · **Year:** 2024 · **Venue:** arXiv:2410.21819 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2410.21819) · [PDF](https://arxiv.org/pdf/2410.21819) · [DOI 10.48550/arxiv.2410.21819](https://doi.org/10.48550/arxiv.2410.21819) · [arXiv 2410.21819](https://arxiv.org/abs/2410.21819) · [OpenAlex](https://openalex.org/W4404341075)

**Citations:** 5 citations (OpenAlex, 2026-10-14) · [67](https://md.research.elamur.ai/free/en/papers/wataoka-2024-self-preference-bias-llm-judge/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
LLM judges are widely used to score dialogue systems, but they may favour their own answers, which risks amplifying one model's style or policies. Earlier attempts to measure this relied on absolute scoring or reference-based metrics in narrow tasks such as summarization and translation, and they lacked a solid human baseline. The authors treat the judge as a classifier and borrow the Equal Opportunity notion from algorithmic fairness. Bias is the gap in how often the judge picks a human-preferred response, depending on whether that response is its own. Using pairwise human verdicts from the Chatbot Arena dataset, they test eight LLMs and swap answer order to cancel position bias. GPT-4 shows by far the strongest self-preference. To explain this, they relate judgments to the perplexity of the answers. LLM judges reward low-perplexity text much more than humans do, whether or not they wrote it. Self-preference therefore looks like a side effect of preferring familiar text. This matters for anyone who relies on a single model as an evaluator.

## Key points
- **Proposed metric:** Bias = P(Y′=1 | S=1, Y=1) − P(Y′=1 | S=0, Y=1).
  - A value of 0 means no bias, values near 1 mean strong self-preference, and negative values mean the judge undervalues itself.
- **Data and method:** Chatbot Arena supplies 33,000 dialogues, each with a human query, two responses from different LLMs and a human verdict.
  - The judge's score comes from its normalized probabilities for the tokens "A" and "B".
  - Scores are averaged over both answer orderings.
- **Judges tested:** GPT-4, GPT-3.5-turbo, Vicuna-13b, Vicuna-7b, Koala-13b, oasst-pythia-12b, dolly-v2-12b and stablelm-tuned-alpha-7b.
  - A Demographic Parity variant of the metric gives GPT-4 0.749, Vicuna-13b 0.382 and GPT-3.5-turbo 0.191.
  - dolly-v2-12b (−0.069) and stablelm-tuned-alpha-7b (−0.032) come out slightly negative.
- **Perplexity findings:** Every evaluator has lower average log-perplexity on its own responses.
  - Once perplexity is controlled for, own and foreign texts win at similar rates; dolly-v2-12b and stablelm-tuned-alpha-7b are the exceptions.
  - Llama-2 and later models, including Llama 3.1, also over-reward low-perplexity text compared with humans.
- **Suggested mitigation:** Ensembles of judges could down-weight a model on samples where its perplexity is low.
  - The new metric can be used to check whether such fixes actually work.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 744 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 221 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 1,344 works

## Cite

Cite as: Koki Wataoka, Tsubasa Takahashi and Ryokan Ri. 2024. Self-Preference Bias in LLM-as-a-Judge. arXiv:2410.21819.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{wataoka2024self,
  title = {{Self-Preference Bias in LLM-as-a-Judge}},
  author = {Koki Wataoka, Tsubasa Takahashi and Ryokan Ri},
  year = {2024},
  doi = {10.48550/arxiv.2410.21819},
  eprint = {2410.21819},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2410.21819}
}
```

- [← previous Gecko: Versatile Text Embeddings Distilled from Large Language Models](https://md.research.elamur.ai/free/en/papers/lee-2024-gecko-versatile-text-embeddings-distilled/)
- [next → Self-Taught Evaluators](https://md.research.elamur.ai/free/en/papers/wang-2024-self-taught-evaluators/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/4/)

## References

17 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. Judging llm-as-a-judge with mt-bench and chatbot arena. In Proceedings of the 37th International Conference on Neural In… [find](https://scholar.google.com/scholar?q=Lianmin+Zheng%2C+Wei%2DLin+Chiang%2C+Ying+Sheng%2C+Siyuan+Zhuang%2C+Zhanghao+Wu%2C+Yonghao+Zhuang%2C+Zi+Lin%2C+Zhuohan+Li%2C+Dacheng+Li%2C+Eric+P%2E+Xing%2C+Hao+Zhang%2C+Joseph+E%2E+Gonzalez%2C+and+Ion+Stoica%2E+Judging+llm%2Das%2Da%2Djud)
2. Julian’s, Malta, March 2024. [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/papers/wang-2024-do-not-answer-evaluating-safeguards/). URL https://aclanthology.org/2024.findings-eacl.61. Timo Schick, Sahana Udupa, and Hinrich Schütze. Self-diagnosis and self-debiasing: A proposal for reducing corpus-based bias in NLP. Transactions of the Association for Computa… [↗](https://aclanthology.org/2024.findings-eacl.61)
3. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. Self-refine: Iterative refinement with self-… [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+Shashank+Gupta%2C+Bodhisattwa+Prasad+Majumder%2C+Katherine+Her)
4. Xinyun Chen, Maxwell Lin, Nathanael Schärli, and Denny Zhou. Teaching large language models to self-debug. In The Twelfth International Conference on Learning Representations, 2024. URL [https://openreview.net/forum?](https://openreview.net/forum?) id=KuPixIqPiq. [↗](https://openreview.net/forum?)
5. Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David Cox, Yiming Yang, and Chuang Gan. [Principle-driven self-alignment of language models from scratch with minimal human supervision](https://md.research.elamur.ai/free/en/papers/sun-2023-principle-driven-self-alignment-language/). In Thirty-seventh Conference on Neural Information Processing Systems, 2023. URL https://openr…
6. Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho, Xian Li, Sainbayar Sukhbaatar, Jing Xu, and Jason E Weston. Self-rewarding language models. In Forty-first International Conference on Machine Learning, 2024. URL [https://openreview.net/forum?id=0NphYCmgua](https://openreview.net/forum?id=0NphYCmgua). [↗](https://openreview.net/forum?id=0NphYCmgua)
7. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F Christiano, Jan Leike, and Ryan Lowe. Training… — [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/)
8. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. [Direct preference optimization: Your language model is secretly a reward model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/). In Thirty-seventh Conference on Neural Information Processing Systems, 2023. URL [https://openreview.net/forum?id=HPuS…](https://openreview.net/forum?id=HPuS…) [↗](https://openreview.net/forum?id=HPuS…)
9. Zongjie Li, Chaozheng Wang, Pingchuan Ma, Daoyuan Wu, Tianxiang Li, Shuai Wang, Cuiyun Gao, and Yang Liu. Split and merge: Aligning position biases in large language model based evaluators, 2024. URL [https://openreview.net/forum?id=1hLFLNu4uy](https://openreview.net/forum?id=1hLFLNu4uy). [↗](https://openreview.net/forum?id=1hLFLNu4uy)
10. Keita Saito, Akifumi Wachi, Koki Wataoka, and Youhei Akimoto. Verbosity bias in preference labeling by large language models. In NeurIPS 2023 Workshop on Instruction Tuning and Instruction Following, 2023. URL [https://openreview.net/forum?id=magEgFpK1y](https://openreview.net/forum?id=magEgFpK1y). [↗](https://openreview.net/forum?id=magEgFpK1y)
11. Toon Calders, Faisal Kamiran, and Mykola Pechenizkiy. Building classifiers with independency constraints. In 2009 IEEE International Conference on Data Mining Workshops, pages 13–18, 2009. doi:10.1109/ICDMW.2009.83. — [doi:10.1109/icdmw.2009.83](https://doi.org/10.1109/icdmw.2009.83) [find](https://scholar.google.com/scholar?q=Toon+Calders%2C+Faisal+Kamiran%2C+and+Mykola+Pechenizkiy%2E+Building+classifiers+with+independency+constraints%2E+In+2009+IEEE+International+Conference+on+Data+Mining+Workshops%2C+pages+13%E2%80%9318%2C+2009%2E+doi%3A10%2E1109)
12. Moritz Hardt, Eric Price, and Nathan Srebro. [Equality of opportunity in supervised learning](https://md.research.elamur.ai/free/en/papers/hardt-2016-equality-opportunity-supervised-learning/). In Proceedings of the 30th International Conference on Neural Information Processing Systems, NIPS’16, page 3323–3331, Red Hook, NY, USA, 2016. Curran Associates Inc. ISBN 9781510838819.
13. Achiam Josh, Adler Steven, Agarwal Sandhini, Ahmad Lama, Akkaya Ilge, Leoni Aleman Florencia, Almeida Diogo, Altenschmidt Janko, Altman Sam, and et al. Shyamal, Anadkat. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/), 2024. URL https://arxiv.org/abs/2303.08774. [↗](https://arxiv.org/abs/2303.08774)
14. Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality, March 2023. URL [https://lmsys.org/blog/2023-03-30-vicuna/…](https://lmsys.org/blog/2023-03-30-vicuna/…) [↗](https://lmsys.org/blog/2023-03-30-vicuna/…)
15. Stella Biderman, Hailey Schoelkopf, Quentin Gregory Anthony, Herbie Bradley, Kyle O’Brien, Eric Hallahan, Mohammad Aflah Khan, Shivanshu Purohit, USVSN Sai Prashanth, Edward Raff, et al. Pythia: A suite for analyzing large language models across training and scaling. In International Conference on M… [find](https://scholar.google.com/scholar?q=Stella+Biderman%2C+Hailey+Schoelkopf%2C+Quentin+Gregory+Anthony%2C+Herbie+Bradley%2C+Kyle+O%E2%80%99Brien%2C+Eric+Hallahan%2C+Mohammad+Aflah+Khan%2C+Shivanshu+Purohit%2C+USVSN+Sai+Prashanth%2C+Edward+Raff%2C+et+al%2E+Pythia%3A+A+sui)
16. Mike Conover, Matt Hayes, Ankit Mathur, Jianwei Xie, Jun Wan, Sam Shah, Ali Ghodsi, Patrick Wendell, Matei Zaharia, and Reynold Xin. Free dolly: Introducing the world’s first truly open instruction-tuned llm, 2023. URL [https://www.databricks.com/blog/2023/04/12/](https://www.databricks.com/blog/2023/04/12/) dolly-first-open-commercially-viable-… [↗](https://www.databricks.com/blog/2023/04/12/)
17. Xinyang Geng, Arnav Gudibande, Hao Liu, Eric Wallace, Pieter Abbeel, Sergey Levine, and Dawn Song. Koala: A dialogue model for academic research. Blog post, April 2023. URL [https://bair.berkeley.edu/blog/2023/](https://bair.berkeley.edu/blog/2023/) 04/03/koala/. et al. Jonathan Tow. Stablelm alpha v2 models, 2023. URL https://huggingface… [↗](https://bair.berkeley.edu/blog/2023/)

*Updated 24 October 2026*