---
title: "Democratic or Authoritarian? Probing a New Dimension of"
description: "The authors build a three-part probing framework. 38 references, cited by 2 papers here. Among them: 1."
authors: ["David Guzman Piedrahita", "Irene Strauss", "Rada Mihalcea", "Zhijing Jin"]
year: 2026
venue: "Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.eacl-long.27/"
doi: "10.18653/v1/2026.eacl-long.27"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/piedrahita-2026-democratic-or-authoritarian-probing-new/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/piedrahita-2026-democratic-or-authoritarian-probing-new/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/) / Democratic or Authoritarian? Probing a New Dimension of Political Biases in Large Language Models

# Democratic or Authoritarian? Probing a New Dimension of Political Biases in Large Language Models

**Authors:** David Guzman Piedrahita, Irene Strauss, [Rada Mihalcea](https://md.research.elamur.ai/free/en/authors/rada-mihalcea/) and [Zhijing Jin](https://md.research.elamur.ai/free/en/authors/zhijing-jin/) · **Year:** 2026 · **Venue:** [Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/eacl/) ([EACL 2026](https://md.research.elamur.ai/free/en/venues/eacl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.eacl-long.27/) · [PDF](https://aclanthology.org/2026.eacl-long.27.pdf) · [DOI 10.18653/v1/2026.eacl-long.27](https://doi.org/10.18653/v1/2026.eacl-long.27) · [OpenAlex](https://openalex.org/W7140124564)

**Citations:** 1 citations (OpenAlex, 2026-10-14) · [2](https://md.research.elamur.ai/free/en/papers/piedrahita-2026-democratic-or-authoritarian-probing-new/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Most studies of political bias in LLMs focus on demographics or on the left–right axis, which assumes a democratic setting. This paper asks a different question: do models lean toward democratic or authoritarian systems of governance? The authors build a three-part probing framework. First, an adapted F-scale questionnaire measures abstract authoritarian attitudes. Second, FavScore, a new metric built from public-opinion survey items, rates how favorably models judge current world leaders. Third, role-model prompts check whether political preferences appear in contexts that are not explicitly political. Eight prominent LLMs were tested in English and in Mandarin. In English, the models mostly reject authoritarian values and rate authoritarian leaders poorly. In Mandarin, that democratic tilt weakens, and approval of authoritarian leaders rises significantly. In both languages, models often name authoritarian figures when asked for role models of a given nationality. The work matters because it shows that geopolitical value bias depends on language and can surface in everyday, apolitical use. It also gives auditors a reusable tool for this kind of evaluation.

## Key points
- **Value-centric probe:** 30 F-scale items (Adorno et al., 1950) from nine categories, such as authoritarian aggression and conventionalism. Models answer on the original 6-point Likert scale, and English–Mandarin differences are tested with a sign test.
- **FavScore:** 39 questions adapted from Pew, ANES and Eurobarometer, organized into five categories covering overall approval, approval of the leader's policies, emotional affect, perceived traits, and expectations about the future. Scores range from –1 to +1 for each leader in power as of April 2025, and regime types come from the V-Dem dataset.
- **Language effect:** Mandarin prompts yield noticeably higher favorability toward authoritarian leaders than English prompts.
- **Role-model probing:** Authoritarian figures are frequently suggested as role models. Adding a prosocial definition of "role model" reduces this tendency but does not remove it, while synonyms give similar or higher rates.
- **Resources and limitations:** Code is released on GitHub (irenestrauss/Democratic-Authoritarian-Bias-LLMs). The study covers only two languages and uses LLM-judge annotation with human validation.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Toronto](https://md.research.elamur.ai/free/en/universities/university-of-toronto/) — University, Toronto, Canada · 96 works · 142,007 citations
- [University of Michigan](https://md.research.elamur.ai/free/en/universities/university-of-michigan/) — University, Ann Arbor, United States · 70 works · 13,693 citations
- [University of Zurich](https://md.research.elamur.ai/free/en/universities/university-of-zurich/) — University, Zurich, Switzerland · 78 works · 12,260 citations
- [ETH Zurich](https://md.research.elamur.ai/free/en/universities/eth-zurich/) — University, Zurich, Switzerland · 72 works · 5,176 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 543 works

🧭 Topics (3): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🛡️ Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · 517 works · [🔬 Interpretability](https://md.research.elamur.ai/free/en/topics/interpretability/) · 130 works

## Cite

Cite as: David Guzman Piedrahita, Irene Strauss, Rada Mihalcea and Zhijing Jin. 2026. Democratic or Authoritarian? Probing a New Dimension of Political Biases in Large Language Models. Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{piedrahita2026democratic,
  title = {{Democratic or Authoritarian? Probing a New Dimension of Political Biases in Large Language Models}},
  author = {David Guzman Piedrahita, Irene Strauss, Rada Mihalcea and Zhijing Jin},
  booktitle = {Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.eacl-long.27},
  url = {https://doi.org/10.18653/v1/2026.eacl-long.27}
}
```

- [← previous DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2026-deepseek-v4-1-flash/)
- [next → Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering](https://md.research.elamur.ai/free/en/papers/zhao-2026-denoising-concept-vectors-sparse-autoencoders/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/)

## References

38 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. T. W. Adorno, Else Frenkel-Brunswik, Daniel J. Levinson, and R. Nevitt Sanford. 1950. The Authoritarian Personality. Harper & Brothers, New York. [find](https://scholar.google.com/scholar?q=T%2E+W%2E+Adorno%2C+Else+Frenkel%2DBrunswik%2C+Daniel+J%2E+Levinson%2C+and+R%2E+Nevitt+Sanford%2E+1950%2E+The+Authoritarian+Personality%2E+Harper+%26+Brothers%2C+New+York%2E)
2. Yunus Akdal. 2025. The political compass test and the death of politics. Columbia Political Review. [find](https://scholar.google.com/scholar?q=Yunus+Akdal%2E+2025%2E+The+political+compass+test+and+the+death+of+politics%2E+Columbia+Political+Review%2E)
3. Bob Altemeyer. 1981. Right-Wing Authoritarianism. University of Manitoba Press. [find](https://scholar.google.com/scholar?q=Bob+Altemeyer%2E+1981%2E+Right%2DWing+Authoritarianism%2E+University+of+Manitoba+Press%2E)
4. ANES. 2021. Anes 2020 time series study full release. [dataset and documentation]. July 19, 2021 version. [find](https://scholar.google.com/scholar?q=ANES%2E+2021%2E+Anes+2020+time+series+study+full+release%2E+%5Bdataset+and+documentation%5D%2E+July+19%2C+2021+version%2E)
5. Mikel Artetxe, Sebastian Ruder, and Dani Yogatama. 2020. [On the cross-lingual transferability of monolingual representations](https://md.research.elamur.ai/free/en/papers/artetxe-2020-cross-lingual-transferability-monolingual-representations/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4623–4637, Online. Association for Computational Linguistics.
6. Yejin Bang, Delong Chen, Nayeon Lee, and Pascale Fung. 2024. [Measuring political bias in large language models: What is said and how it is said](https://md.research.elamur.ai/free/en/papers/bang-2024-measuring-political-bias-large-language/). In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 11142–11159, Bangkok, Thailand. A…
7. Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Margaret Mitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, pages 610–623, New York, NY, USA. Association… [find](https://scholar.google.com/scholar?q=Emily+M%2E+Bender%2C+Timnit+Gebru%2C+Angelina+McMillan%2DMajor%2C+and+Margaret+Mitchell%2E+2021%2E+On+the+dangers+of+stochastic+parrots%3A+Can+language+models+be+too+big%3F+In+Proceedings+of+the+2021+ACM+Conference+on+)
8. Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. [Language (technology) is power: A critical survey of “bias” in NLP](https://md.research.elamur.ai/free/en/papers/blodgett-2020-language-technology-is-power-critical/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454– 5476, Online. Association for Computational Linguistics.
9. Wayne Brittenden. 2001. The political compass test. [find](https://scholar.google.com/scholar?q=Wayne+Brittenden%2E+2001%2E+The+political+compass+test%2E)
10. Guiming Hardy Chen, Shunian Chen, Ziche Liu, Feng Jiang, and Benyou Wang. 2024. [Humans or LLMs as the judge? a study on judgement bias](https://md.research.elamur.ai/free/en/papers/chen-2024-humans-or-llms-as-judge/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 8301–8327, Miami, Florida, USA. Association for Computational Lingu…
11. Richard Christie and Marie Jahoda. 1954. Studies in the Scope and Method of The Authoritarian Personality. Free Press. [find](https://scholar.google.com/scholar?q=Richard+Christie+and+Marie+Jahoda%2E+1954%2E+Studies+in+the+Scope+and+Method+of+The+Authoritarian+Personality%2E+Free+Press%2E)
12. Alan C. Elms and Stanley Milgram. 1966. Personality characteristics associated with obedience and defiance toward authoritative command. Journal of Experimental Research in Personality. [find](https://scholar.google.com/scholar?q=Alan+C%2E+Elms+and+Stanley+Milgram%2E+1966%2E+Personality+characteristics+associated+with+obedience+and+defiance+toward+authoritative+command%2E+Journal+of+Experimental+Research+in+Personality%2E)
13. Ruibo Liu, Chenyan Jia, Jason Wei, Guangxuan Xu, and Soroush Vosoughi. 2022. Quantifying and alleviating political bias in language models. Artificial Intelligence, 304:103654. [find](https://scholar.google.com/scholar?q=Ruibo+Liu%2C+Chenyan+Jia%2C+Jason+Wei%2C+Guangxuan+Xu%2C+and+Soroush+Vosoughi%2E+2022%2E+Quantifying+and+alleviating+political+bias+in+language+models%2E+Artificial+Intelligence%2C+304%3A103654%2E)
14. Eurobarometer. 2024. Standard eurobarometer std102: Standard eurobarometer 102 – autumn 2024 (v1.00). [find](https://scholar.google.com/scholar?q=Eurobarometer%2E+2024%2E+Standard+eurobarometer+std102%3A+Standard+eurobarometer+102+%E2%80%93+autumn+2024+%28v1%2E00%29%2E)
15. Ervin Locklear and Micheal Stratil. 1982. Authoritarianism: Validation of the balanced f scale through observer ratings. Technical report, Pembroke State University. [find](https://scholar.google.com/scholar?q=Ervin+Locklear+and+Micheal+Stratil%2E+1982%2E+Authoritarianism%3A+Validation+of+the+balanced+f+scale+through+observer+ratings%2E+Technical+report%2C+Pembroke+State+University%2E)
16. David Exler, Mark Schutera, Markus Reischl, and Luca Rettenberger. 2025. [Large means left: Political bias in large language models increases with their number of parameters](https://md.research.elamur.ai/free/en/papers/exler-2025-large-means-left-political-bias/).
17. Shangbin Feng, Chan Young Park, Yuhan Liu, and Yulia Tsvetkov. 2023. [From pretraining data to language models to downstream tasks: Tracking the trails of political biases leading to unfair NLP models](https://md.research.elamur.ai/free/en/papers/feng-2023-pretraining-data-language-models-downstream/). In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume…
18. Suyash Fulay, William Brannon, Shrestha Mohanty, Cassandra Overney, Elinor Poole-Dayan, Deb Roy, and Jad Kabbara. 2024. On the relationship between truth and political bias in language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 9004– 9018… [find](https://scholar.google.com/scholar?q=Suyash+Fulay%2C+William+Brannon%2C+Shrestha+Mohanty%2C+Cassandra+Overney%2C+Elinor+Poole%2DDayan%2C+Deb+Roy%2C+and+Jad+Kabbara%2E+2024%2E+On+the+relationship+between+truth+and+political+bias+in+language+models%2E+In+Proc)
19. Anna Lührmann and Staffan I. Lindberg. 2019. A third wave of autocratization is here: What is new about it? Democratization, 26(7):1095–1113. [find](https://scholar.google.com/scholar?q=Anna+L%C3%BChrmann+and+Staffan+I%2E+Lindberg%2E+2019%2E+A+third+wave+of+autocratization+is+here%3A+What+is+new+about+it%3F+Democratization%2C+26%287%29%3A1095%E2%80%931113%2E)
20. Anna Lührmann, Marcus Tannenberg, and Staffan I. Lindberg. 2018. Regimes of the world (row): Opening new avenues for the comparative study of political regimes. Politics and Governance, 6(1):60–77. [find](https://scholar.google.com/scholar?q=Anna+L%C3%BChrmann%2C+Marcus+Tannenberg%2C+and+Staffan+I%2E+Lindberg%2E+2018%2E+Regimes+of+the+world+%28row%29%3A+Opening+new+avenues+for+the+comparative+study+of+political+regimes%2E+Politics+and+Governance%2C+6%281%29%3A60%E2%80%9377%2E)
21. Fabio Motoki, Valdemar Pinho Neto, and Victor Rodrigues. 2024. More human than human: Measuring chatgpt political bias. Public Choice, 198(1):3–23. [find](https://scholar.google.com/scholar?q=Fabio+Motoki%2C+Valdemar+Pinho+Neto%2C+and+Victor+Rodrigues%2E+2024%2E+More+human+than+human%3A+Measuring+chatgpt+political+bias%2E+Public+Choice%2C+198%281%29%3A3%E2%80%9323%2E)
22. Anna Neumann, Elisabeth Kirsten, Muhammad Bilal Zafar, and Jatinder Singh. 2025. Position is power: System prompts as a mechanism of bias in large language models (llms). In Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’25, page 573–598, New York, NY, U… [find](https://scholar.google.com/scholar?q=Anna+Neumann%2C+Elisabeth+Kirsten%2C+Muhammad+Bilal+Zafar%2C+and+Jatinder+Singh%2E+2025%2E+Position+is+power%3A+System+prompts+as+a+mechanism+of+bias+in+large+language+models+%28llms%29%2E+In+Proceedings+of+the+2025+AC)
23. Isabel O. Gallegos, Ryan A. Rossi, Joe Barrow, Md Mehrab Tanjim, Sungchul Kim, Franck Dernoncourt, Tong Yu, Ruiyi Zhang, and Nesreen K. Ahmed. 2024. [Bias and fairness in large language models: A survey](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/). Computational Linguistics, 50(3):1097– 1179.
24. Thomas B. Pepinsky. 2025. State, society, and the politics of democratic backsliding. SSRN Electronic Journal. Available at SSRN. [find](https://scholar.google.com/scholar?q=Thomas+B%2E+Pepinsky%2E+2025%2E+State%2C+society%2C+and+the+politics+of+democratic+backsliding%2E+SSRN+Electronic+Journal%2E+Available+at+SSRN%2E)
25. Stephan Haggard and Robert Kaufman. 2021. Backsliding: Democratic Regress in the Contemporary World. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Stephan+Haggard+and+Robert+Kaufman%2E+2021%2E+Backsliding%3A+Democratic+Regress+in+the+Contemporary+World%2E+Cambridge+University+Press%2E)
26. Saghar Hosseini, Hamid Palangi, and Ahmed Hassan Awadallah. 2023. [An empirical study of metrics to measure representational harms in pre-trained language models](https://md.research.elamur.ai/free/en/papers/hosseini-2023-empirical-study-metrics-measure-representational/). In Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023), pages 121–134, Toronto, Canada. Association…
27. Minseok Jung, Aurora Zhang, Junho Lee, and Paul Pu Liang. 2024. Quantitative insights into language model usage and trust in academia: An empirical study. [find](https://scholar.google.com/scholar?q=Minseok+Jung%2C+Aurora+Zhang%2C+Junho+Lee%2C+and+Paul+Pu+Liang%2E+2024%2E+Quantitative+insights+into+language+model+usage+and+trust+in+academia%3A+An+empirical+study%2E)
28. Pew. 2010. Obama’s ratings little affected by recent turmoil. [find](https://scholar.google.com/scholar?q=Pew%2E+2010%2E+Obama%E2%80%99s+ratings+little+affected+by+recent+turmoil%2E)
29. Yujin Potter, Shiyang Lai, Junsol Kim, James Evans, and Dawn Song. 2024. Hidden persuaders: LLMs’ political leaning and their influence on voters. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 4244– 4275, Miami, Florida, USA. Association for Computa… [find](https://scholar.google.com/scholar?q=Yujin+Potter%2C+Shiyang+Lai%2C+Junsol+Kim%2C+James+Evans%2C+and+Dawn+Song%2E+2024%2E+Hidden+persuaders%3A+LLMs%E2%80%99+political+leaning+and+their+influence+on+voters%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+Me)
30. Lee Rainie. 2025. Close encounters of the ai kind: The increasingly human-like way people are engaging with language models. [find](https://scholar.google.com/scholar?q=Lee+Rainie%2E+2025%2E+Close+encounters+of+the+ai+kind%3A+The+increasingly+human%2Dlike+way+people+are+engaging+with+language+models%2E)
31. Luca Rettenberger, Markus Reischl, and Mark Schutera. 2025. Assessing political bias in large language models. Journal of Computational Social Science, 8(2):1– 17. [find](https://scholar.google.com/scholar?q=Luca+Rettenberger%2C+Markus+Reischl%2C+and+Mark+Schutera%2E+2025%2E+Assessing+political+bias+in+large+language+models%2E+Journal+of+Computational+Social+Science%2C+8%282%29%3A1%E2%80%93+17%2E)
32. Haitao Li, Qian Dong, Junjie Chen, Huixue Su, Yujia Zhou, Qingyao Ai, Ziyi Ye, and Yiqun Liu. 2024. [Llms-as-judges: A comprehensive survey on llm-based evaluation methods](https://md.research.elamur.ai/free/en/papers/li-2024-llms-judges-comprehensive-survey-llm/).
33. Weixin Liang, Yaohui Zhang, Mihai Codreanu, Jiayu Wang, Hancheng Cao, and James Zou. 2025. The widespread adoption of large language model-assisted writing across society. [find](https://scholar.google.com/scholar?q=Weixin+Liang%2C+Yaohui+Zhang%2C+Mihai+Codreanu%2C+Jiayu+Wang%2C+Hancheng+Cao%2C+and+James+Zou%2E+2025%2E+The+widespread+adoption+of+large+language+model%2Dassisted+writing+across+society%2E)
34. David Rozado. 2024. The political preferences of llms. PLOS ONE, 19(7):e0306621. [find](https://scholar.google.com/scholar?q=David+Rozado%2E+2024%2E+The+political+preferences+of+llms%2E+PLOS+ONE%2C+19%287%29%3Ae0306621%2E)
35. Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. [Whose opinions do language models reflect?](https://md.research.elamur.ai/free/en/papers/santurkar-2023-whose-opinions-language-models-reflect/) In Proceedings of the 40th International Conference on Machine Learning, ICML 2023, pages 29971–30004, Honolulu, HI, USA. PMLR.
36. Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin A. Rothkopf, and Kristian Kersting. 2022. Large pre-trained language models contain human-like biases of what is right and wrong to do. Nature Machine Intelligence, 4(3):258–268. [find](https://scholar.google.com/scholar?q=Patrick+Schramowski%2C+Cigdem+Turan%2C+Nico+Andersen%2C+Constantin+A%2E+Rothkopf%2C+and+Kristian+Kersting%2E+2022%2E+Large+pre%2Dtrained+language+models+contain+human%2Dlike+biases+of+what+is+right+and+wrong+to+do%2E+Nat)
37. Koki Wataoka, Tsubasa Takahashi, and Ryokan Ri. 2024. [Self-preference bias in llm-as-a-judge](https://md.research.elamur.ai/free/en/papers/wataoka-2024-self-preference-bias-llm-judge/).
38. Jiayi Ye, Yanbo Wang, Yue Huang, Dongping Chen, Qihui Zhang, Nuno Moniz, Tian Gao, Werner Geyer, Chao Huang, Pin-Yu Chen, Nitesh V. Chawla, and Xiangliang Zhang. 2025. [Justice or prejudice? quantifying biases in LLM-as-a-judge](https://md.research.elamur.ai/free/en/papers/ye-2024-justice-prejudice-quantifying-biases-llm/). In The Thirteenth International Conference on Learning Representations.

*Updated 31 October 2026*