---
title: "Interpretability of LLM Classifiers via the Rational Inattention"
description: "Their approach builds on Sims's rational inattention (RI) theory and the discrete-choice solution of Matějka and McKay. 13 references."
authors: ["Yuan Zhao", "Ali Abdi"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)"
source: "https://aclanthology.org/2026.acl-srw.23/"
doi: "10.18653/v1/2026.acl-srw.23"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhao-2026-interpretability-llm-classifiers-rational-inattention/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhao-2026-interpretability-llm-classifiers-rational-inattention/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/37/) / Interpretability of LLM Classifiers via the Rational Inattention Theory with Application to Hate Speech Detection

# Interpretability of LLM Classifiers via the Rational Inattention Theory with Application to Hate Speech Detection

**Authors:** Yuan Zhao and Ali Abdi · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-srw.23/) · [PDF](https://aclanthology.org/2026.acl-srw.23.pdf) · [DOI 10.18653/v1/2026.acl-srw.23](https://doi.org/10.18653/v1/2026.acl-srw.23) · [OpenAlex](https://openalex.org/W7166871052)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
LLMs are widely used as high-volume classifiers, such as hate speech moderators. Explaining their choices through generated rationales like chain-of-thought adds heavy per-item inference cost. Zhao and Abdi instead treat a black-box LLM as a rationally inattentive decision maker and infer interpretable parameters only from its input–output behaviour. Their approach builds on Sims's rational inattention (RI) theory and the discrete-choice solution of Matějka and McKay. The extended RI model adds a noise stage: character-level distortion masks hateful content with a "hiding rate" q, and the model then balances expected reward against a unit information cost λ. Using hate speech texts from Kennedy et al. (2020), the authors build eleven noise environments with random in-word edits and query four commercial LLMs zero-shot. The fitted model closely tracks observed accuracy across noise levels. λ separates the models and stays nearly fixed when the distortion mix changes, while the noise parameters absorb that change. This lets practitioners tell whether an accuracy drop comes from the input environment or from the model's own strategy, without generating extra tokens.

## Key points
- **Models and data:** GPT-5.2, GPT-3.5, Gemini-2.5 and Gemini-2.0 were tested as binary classifiers ("Hate Speech" vs. "Not Hate Speech"). The short social-media texts (YouTube, X, Reddit) come from the Kennedy et al. (2020) datasets.
- **Noise procedure:** Each word is chosen for distortion with probability p′, from 0 to 1 in steps of 0.1, giving 11 environments. Each chosen word receives one swap, replace, delete or insert operation.
- **Model structure:** The model has two states and two actions, with a latent noisy state V. Accuracy depends on q and the ratio r/λ, and the reward r is fixed at 1 so λ can be estimated.
- **Generalization test:** With N = 1000 and three noise mixes (replace-dominant, swap-dominant, equal-probability), λ stayed stable within each model:
  - GPT-5.2: ≈0.345–0.399 (lowest cost)
  - GPT-3.5: ≈0.416–0.461
  - Gemini-2.5: ≈0.518–0.556
  - Gemini-2.0: ≈0.589–0.596 (highest cost)
  
  In contrast, the noise parameters shifted substantially: α ranged 0.295–0.594 and β ranged 2.318–3.06.
- **Limitations:** Batching items caused cross-item label contamination, which the authors mitigated by grouping same-label items. The framework is restricted to binary decisions, and it assumes an equal reward across providers.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [New Jersey Institute of Technology](https://md.research.elamur.ai/free/en/universities/new-jersey-institute-of-technology/) — University, Newark, United States · 16 works · 1,333 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,954 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 626 works

🧭 Topics (3): [😊 Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · 1,035 works · [🛡️ Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · 587 works · [🔬 Interpretability](https://md.research.elamur.ai/free/en/topics/interpretability/) · 149 works

## Cite

Cite as: Yuan Zhao and Ali Abdi. 2026. Interpretability of LLM Classifiers via the Rational Inattention Theory with Application to Hate Speech Detection. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhao2026interpretability,
  title = {{Interpretability of LLM Classifiers via the Rational Inattention Theory with Application to Hate Speech Detection}},
  author = {Yuan Zhao and Ali Abdi},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-srw.23},
  url = {https://doi.org/10.18653/v1/2026.acl-srw.23}
}
```

- [← previous Internalizing Multi-Agent Reasoning for Accurate and Efficient LLM-based Recommendation](https://md.research.elamur.ai/free/en/papers/wu-2026-internalizing-multi-agent-reasoning-accurate/)
- [next → Interpretable ICD Code Classification with Faithful Sentence Extraction](https://md.research.elamur.ai/free/en/papers/wang-2026-interpretable-icd-code-classification-faithful/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/37/)

## References

13 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Yevgeni Belinkov and Yonatan Bisk. 2018. Synthetic and natural noise both break neural machine translation. In Proceedings of the 6th International Conference on Learning Representations, pages 1–13, Vancouver, Canada. [find](https://scholar.google.com/scholar?q=Yevgeni+Belinkov+and+Yonatan+Bisk%2E+2018%2E+Synthetic+and+natural+noise+both+break+neural+machine+translation%2E+In+Proceedings+of+the+6th+International+Conference+on+Learning+Representations%2C+pages+1%E2%80%9313%2C+)
2. Filip Matějka and Alisdair McKay. 2015. Rational inattention to discrete choices: A new foundation for the multinomial logit model. American Economic Review, 105:272–298. [find](https://scholar.google.com/scholar?q=Filip+Mate%CC%8Cjka+and+Alisdair+McKay%2E+2015%2E+Rational+inattention+to+discrete+choices%3A+A+new+foundation+for+the+multinomial+logit+model%2E+American+Economic+Review%2C+105%3A272%E2%80%93298%2E)
3. Koushik Pattanayak, Vikram Krishnamurthy, and Ankur Jain. 2024. Interpretable deep image classification using rationally inattentive utility maximization. IEEE Journal of Selected Topics in Signal Processing, 18:254–270. [find](https://scholar.google.com/scholar?q=Koushik+Pattanayak%2C+Vikram+Krishnamurthy%2C+and+Ankur+Jain%2E+2024%2E+Interpretable+deep+image+classification+using+rationally+inattentive+utility+maximization%2E+IEEE+Journal+of+Selected+Topics+in+Signal+Pro)
4. Christopher A. Sims. 2003. Implications of rational inattention. Journal of Monetary Economics, 50:665– 690. [find](https://scholar.google.com/scholar?q=Christopher+A%2E+Sims%2E+2003%2E+Implications+of+rational+inattention%2E+Journal+of+Monetary+Economics%2C+50%3A665%E2%80%93+690%2E)
5. Bolin Wen, K. P. Subbalakshmi, and Feng Yang. 2022. Revisiting attention weights as explanations from an information theoretic perspective. arXiv preprint arXiv:2211.07714. — [arXiv:2211.07714](https://arxiv.org/abs/2211.07714) [find](https://scholar.google.com/scholar?q=Bolin+Wen%2C+K%2E+P%2E+Subbalakshmi%2C+and+Feng+Yang%2E+2022%2E+Revisiting+attention+weights+as+explanations+from+an+information+theoretic+perspective%2E+arXiv+preprint+arXiv%3A2211%2E07714%2E+%E2%80%94+%5BarXiv%3A2211%2E07714%5D%28https%3A)
6. Yujia Yang, Jihyung Kim, Yubin Kim, Nayeon Ho, James Thorne, and Se-Young Yun. 2023. HARE: Explainable hate speech detection with step-by-step reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 5490– 5505, Singapore. [find](https://scholar.google.com/scholar?q=Yujia+Yang%2C+Jihyung+Kim%2C+Yubin+Kim%2C+Nayeon+Ho%2C+James+Thorne%2C+and+Se%2DYoung+Yun%2E+2023%2E+HARE%3A+Explainable+hate+speech+detection+with+step%2Dby%2Dstep+reasoning%2E+In+Findings+of+the+Association+for+Computation)
7. Andrew Caplin and Mark Dean. 2015. Revealed preference, rational inattention, and costly information acquisition. American Economic Review, 105:2183– 2203. [find](https://scholar.google.com/scholar?q=Andrew+Caplin+and+Mark+Dean%2E+2015%2E+Revealed+preference%2C+rational+inattention%2C+and+costly+information+acquisition%2E+American+Economic+Review%2C+105%3A2183%E2%80%93+2203%2E)
8. Andrew Caplin and Daniel Martin. 2015. A testable theory of imperfect perception. The Economic Journal, 125:184–202. [find](https://scholar.google.com/scholar?q=Andrew+Caplin+and+Daniel+Martin%2E+2015%2E+A+testable+theory+of+imperfect+perception%2E+The+Economic+Journal%2C+125%3A184%E2%80%93202%2E)
9. Mark Dean and Nathaniel Neligh. 2023. Experimental tests of rational inattention. Journal of Political Economy, 131:3415–3461. [find](https://scholar.google.com/scholar?q=Mark+Dean+and+Nathaniel+Neligh%2E+2023%2E+Experimental+tests+of+rational+inattention%2E+Journal+of+Political+Economy%2C+131%3A3415%E2%80%933461%2E)
10. Ankur Jain and Vikram Krishnamurthy. 2025. Interacting large language model agents: Bayesian social learning based interpretable models. IEEE Access, 13:25465–25504. [find](https://scholar.google.com/scholar?q=Ankur+Jain+and+Vikram+Krishnamurthy%2E+2025%2E+Interacting+large+language+model+agents%3A+Bayesian+social+learning+based+interpretable+models%2E+IEEE+Access%2C+13%3A25465%E2%80%9325504%2E)
11. Di Jin, Zhijing Jin, Joey Tianyi Zhou, and Peter Szolovits. 2020. [Is BERT really robust? A strong baseline for natural language attack on text classification and entailment](https://md.research.elamur.ai/free/en/papers/jin-2019-bert-really-robust-strong-baseline/). In Proceedings of the AAAI Conference on Artificial Intelligence, pages 8018– 8025, New York, NY.
12. Christopher J. Kennedy, Geoffrey Bacon, Alexander Sahn, and Clara von Vacano. 2020. Constructing interval variables via faceted Rasch measurement and multitask deep learning: A hate speech application. arXiv preprint arXiv:2009.10277. — [arXiv:2009.10277](https://arxiv.org/abs/2009.10277) [find](https://scholar.google.com/scholar?q=Christopher+J%2E+Kennedy%2C+Geoffrey+Bacon%2C+Alexander+Sahn%2C+and+Clara+von+Vacano%2E+2020%2E+Constructing+interval+variables+via+faceted+Rasch+measurement+and+multitask+deep+learning%3A+A+hate+speech+application)
13. Jinfeng Li, Shouling Ji, Tianyu Du, Bo Li, and Ting Wang. 2018. [Textbugger: Generating adversarial text against real-world applications](https://md.research.elamur.ai/free/en/papers/li-2018-textbugger-generating-adversarial-text-against/). arXiv preprint arXiv:1812.05271.

*Updated 2 November 2026*