---
title: "Beyond Logical Forms — paper by Papadopulos et al. (2026)"
description: "The authors propose a weakly supervised, inference-only framework. 73.5% accuracy on LOGIC. 26 references."
authors: ["Eleni Papadopulos", "Firoj Alam", "Giovanni Da San Martino"]
year: 2026
venue: "Proceedings of the 13th Workshop on Argument Mining and Reasoning"
source: "https://aclanthology.org/2026.argmining-1.2/"
doi: "10.18653/v1/2026.argmining-1.2"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/papadopulos-2026-beyond-logical-forms-llm-extracted/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/papadopulos-2026-beyond-logical-forms-llm-extracted/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/23/) / Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification

# Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification

**Authors:** [Eleni Papadopulos](https://md.research.elamur.ai/free/en/authors/eleni-papadopulos/), [Firoj Alam](https://md.research.elamur.ai/free/en/authors/firoj-alam/) and [Giovanni Da San Martino](https://md.research.elamur.ai/free/en/authors/giovanni-da-san-martino/) · **Year:** 2026 · **Venue:** [Proceedings of the 13th Workshop on Argument Mining and Reasoning](https://md.research.elamur.ai/free/en/venues/argmining/) ([Workshop on Argument Mining 2026](https://md.research.elamur.ai/free/en/venues/argmining/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.argmining-1.2/) · [PDF](https://aclanthology.org/2026.argmining-1.2.pdf) · [DOI 10.18653/v1/2026.argmining-1.2](https://doi.org/10.18653/v1/2026.argmining-1.2) · [OpenAlex](https://openalex.org/W7166400106)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Automatic fallacy classification is hard because fallacies, especially informal ones, take many surface forms. Earlier structure-based methods, such as the Electra model of Jin et al. (2022), map each fallacy to a single abstract logical form, which misses this variety. The authors propose a weakly supervised, inference-only framework. They use the labelled training portion of the LOGIC dataset in two steps. First, llama-3.3-70B-Instruct explains why each example is fallacious. Second, o4-mini derives "structural patterns" per class from the examples and their explanations. These patterns combine formal logical skeletons with recurring lexical and rhetorical cues. The patterns, together with LLM-written class definitions, are added to classification prompts in zero- and one-shot settings, with no fine-tuning. Prompts that include the patterns beat zero-shot baselines and earlier unsupervised approaches on LOGIC. The patterns also transfer to the REDDIT and ELECDEBATE datasets without being re-extracted. The study shows that data-driven patterns can serve as reusable, generalizable logical representations for low-cost fallacy detection.

## Key points
- **Source data:** Patterns were extracted only from LOGIC, which has 2,449 short educational examples across 13 fallacy classes, split 1807/299/299. Several LOGIC classes merge distinct sub-fallacies; for example, Hasty Generalization also covers Slippery Slope.
- **Pipeline:** llama-3.3-70B-Instruct generates the explanations, and o4-mini extracts the patterns. During extraction, function words are kept and content words are replaced with placeholders.
- **Main results:** Pattern-based prompting reaches 73.5% accuracy on LOGIC, rising to 74.2% with one-shot examples. Reasoning models perform best in every configuration.
- **Cross-dataset tests:** The patterns were evaluated on REDDIT (Sahai et al., 2021; subreddit comments) and ELECDEBATE 60TO16 (Goffredo et al., 2023; U.S. presidential debates from 1960 to 2016).
- **Resources:** The prompts are available at github.com/elenipapadopulos/fallacy-patterns.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Padua](https://md.research.elamur.ai/free/en/universities/university-of-padua/) — University, Padua, Italy · 18 works · 4,260 citations
- [Politecnico di Torino](https://md.research.elamur.ai/free/en/universities/politecnico-di-torino/) — University, Turin, Italy · 11 works · 18 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [🤝 Sociology and Political Science](https://md.research.elamur.ai/free/en/shelves/social-sciences/sociology-and-political-science/) · 577 works · [🤔 Philosophy](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/philosophy/) · 284 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧾 Semantic parsing & meaning representation](https://md.research.elamur.ai/free/en/topics/semantic-parsing/) · 185 works

## Cite

Cite as: Eleni Papadopulos, Firoj Alam and Giovanni Da San Martino. 2026. Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification. Proceedings of the 13th Workshop on Argument Mining and Reasoning.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{papadopulos2026beyond,
  title = {{Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification}},
  author = {Eleni Papadopulos, Firoj Alam and Giovanni {Da San Martino}},
  booktitle = {Proceedings of the 13th Workshop on Argument Mining and Reasoning},
  year = {2026},
  doi = {10.18653/v1/2026.argmining-1.2},
  url = {https://doi.org/10.18653/v1/2026.argmining-1.2}
}
```

- [← previous Beyond Genre Categories: How Narrative Pattern Coherence and Spanning Distance Shape Film Success](https://md.research.elamur.ai/free/en/papers/wang-2026-beyond-genre-categories-how-narrative/)
- [next → Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling](https://md.research.elamur.ai/free/en/papers/rodkin-2026-beyond-memorization-extending-reasoning-depth/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/23/)

## References

26 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Tariq Alhindi, Smaranda Muresan, and Preslav Nakov. 2024. Large language models are few-shot training example generators: A case study in fallacy recognition. [find](https://scholar.google.com/scholar?q=Tariq+Alhindi%2C+Smaranda+Muresan%2C+and+Preslav+Nakov%2E+2024%2E+Large+language+models+are+few%2Dshot+training+example+generators%3A+A+case+study+in+fallacy+recognition%2E)
2. Ivan Habernal, Henning Wachsmuth, Iryna Gurevych, and Benno Stein. 2018. [Before name-calling: Dynamics and triggers of ad hominem fallacies in web argumentation](https://md.research.elamur.ai/free/en/papers/habernal-2018-before-name-calling-dynamics-triggers/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techn…
3. Paul Reisert, Naoya Inoue, Tatsuki Kuribayashi, and Kentaro Inui. 2018. Feasible annotation scheme for capturing policy argument reasoning using argument templates. In Proceedings of the 5th Workshop on Argument Mining, pages 79–89, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Paul+Reisert%2C+Naoya+Inoue%2C+Tatsuki+Kuribayashi%2C+and+Kentaro+Inui%2E+2018%2E+Feasible+annotation+scheme+for+capturing+policy+argument+reasoning+using+argument+templates%2E+In+Proceedings+of+the+5th+Workshop+)
4. Irfan Robbani, Paul Reisert, Surawat Pothong, Naoya Inoue, Camélia Guerraoui, Wenzhi Wang, Shoichi Naito, Jungmin Choi, and Kentaro Inui. 2024. Flee the flaw: Annotating the underlying logic of fallacious arguments through templates and slot-filling. In Proceedings of the 2024 Conference on Empirica… [find](https://scholar.google.com/scholar?q=Irfan+Robbani%2C+Paul+Reisert%2C+Surawat+Pothong%2C+Naoya+Inoue%2C+Cam%C3%A9lia+Guerraoui%2C+Wenzhi+Wang%2C+Shoichi+Naito%2C+Jungmin+Choi%2C+and+Kentaro+Inui%2E+2024%2E+Flee+the+flaw%3A+Annotating+the+underlying+logic+of+fallac)
5. C.L. Hamblin. 1970. Fallacies. University paperbacks. Methuen. [find](https://scholar.google.com/scholar?q=C%2EL%2E+Hamblin%2E+1970%2E+Fallacies%2E+University+paperbacks%2E+Methuen%2E)
6. William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation learning on graphs: Methods and applications. [find](https://scholar.google.com/scholar?q=William+L%2E+Hamilton%2C+Rex+Ying%2C+and+Jure+Leskovec%2E+2017%2E+Representation+learning+on+graphs%3A+Methods+and+applications%2E)
7. Ruixin Hong, Hongming Zhang, Xinyu Pang, Dong Yu, and Changshui Zhang. 2024. A closer look at the self-verification abilities of large language models in logical reasoning. [find](https://scholar.google.com/scholar?q=Ruixin+Hong%2C+Hongming+Zhang%2C+Xinyu+Pang%2C+Dong+Yu%2C+and+Changshui+Zhang%2E+2024%2E+A+closer+look+at+the+self%2Dverification+abilities+of+large+language+models+in+logical+reasoning%2E)
8. Ramon Ruiz-Dolz and John Lawrence. 2023. Detecting argumentative fallacies in the wild: Problems and limitations of large language models. In Proceedings of the 10th Workshop on Argument Mining, pages 1–10, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ramon+Ruiz%2DDolz+and+John+Lawrence%2E+2023%2E+Detecting+argumentative+fallacies+in+the+wild%3A+Problems+and+limitations+of+large+language+models%2E+In+Proceedings+of+the+10th+Workshop+on+Argument+Mining%2C+pages)
9. Jiwon Jeong, Hyeju Jang, and Hogun Park. 2025. Large language models are better logical fallacy reasoners with counterargument, explanation, and goal-aware prompt formulation. [find](https://scholar.google.com/scholar?q=Jiwon+Jeong%2C+Hyeju+Jang%2C+and+Hogun+Park%2E+2025%2E+Large+language+models+are+better+logical+fallacy+reasoners+with+counterargument%2C+explanation%2C+and+goal%2Daware+prompt+formulation%2E)
10. Ramon Ruiz-Dolz and John Lawrence. 2025. An explainable framework for misinformation identification via critical question answering. Preprint, arXiv:2503.14626. — [arXiv:2503.14626](https://arxiv.org/abs/2503.14626) [find](https://scholar.google.com/scholar?q=Ramon+Ruiz%2DDolz+and+John+Lawrence%2E+2025%2E+An+explainable+framework+for+misinformation+identification+via+critical+question+answering%2E+Preprint%2C+arXiv%3A2503%2E14626%2E+%E2%80%94+%5BarXiv%3A2503%2E14626%5D%28https%3A%2F%2Farxiv%2Eorg%2F)
11. Zhijing Jin, Abhinav Lalwani, Tejas Vaidhya, Xiaoyu Shen, Yiwen Ding, Zhiheng Lyu, Mrinmaya Sachan, Rada Mihalcea, and Bernhard Schölkopf. 2022. [Logical fallacy detection](https://md.research.elamur.ai/free/en/papers/jin-2022-logical-fallacy-detection/). In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 7180–7198, Abu Dhabi, United Arab Emirates. Asso…
12. Devendra Sachan, Yuhao Zhang, Peng Qi, and William L. Hamilton. 2021. Do syntax trees help pre-trained transformers extract information? [find](https://scholar.google.com/scholar?q=Devendra+Sachan%2C+Yuhao+Zhang%2C+Peng+Qi%2C+and+William+L%2E+Hamilton%2E+2021%2E+Do+syntax+trees+help+pre%2Dtrained+transformers+extract+information%3F)
13. Saumya Sahai, Oana Balalau, and Roxana Horincar. 2021. Breaking down the invisible wall of informal fallacies in online discussions. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (… [find](https://scholar.google.com/scholar?q=Saumya+Sahai%2C+Oana+Balalau%2C+and+Roxana+Horincar%2E+2021%2E+Breaking+down+the+invisible+wall+of+informal+fallacies+in+online+discussions%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+for+Co)
14. Ralph Henry Johnson and J. Anthony Blair. 1977. Logical Self-Defense. Toronto, Canada. [find](https://scholar.google.com/scholar?q=Ralph+Henry+Johnson+and+J%2E+Anthony+Blair%2E+1977%2E+Logical+Self%2DDefense%2E+Toronto%2C+Canada%2E)
15. Yuanyuan Lei and Ruihong Huang. 2024. Boosting logical fallacy reasoning in LLMs via logical structure tree. [find](https://scholar.google.com/scholar?q=Yuanyuan+Lei+and+Ruihong+Huang%2E+2024%2E+Boosting+logical+fallacy+reasoning+in+LLMs+via+logical+structure+tree%2E)
16. Yanda Li, Dixuan Wang, Jiaqing Liang, Guochao Jiang, Qianyu He, Yanghua Xiao, and Deqing Yang. 2024. Reason from fallacy: Enhancing large language models’ logical reasoning through logical fallacy understanding. [find](https://scholar.google.com/scholar?q=Yanda+Li%2C+Dixuan+Wang%2C+Jiaqing+Liang%2C+Guochao+Jiang%2C+Qianyu+He%2C+Yanghua+Xiao%2C+and+Deqing+Yang%2E+2024%2E+Reason+from+fallacy%3A+Enhancing+large+language+models%E2%80%99+logical+reasoning+through+logical+fallacy+und)
17. Zhivar Sourati, Filip Ilievski, Hông-Ân Sandlin, and Alain Mermoud. 2023a. Case-based reasoning with language models for classification of logical fallacies. [find](https://scholar.google.com/scholar?q=Zhivar+Sourati%2C+Filip+Ilievski%2C+H%C3%B4ng%2D%C3%82n+Sandlin%2C+and+Alain+Mermoud%2E+2023a%2E+Case%2Dbased+reasoning+with+language+models+for+classification+of+logical+fallacies%2E)
18. Gionnieve Lim and Simon T. Perrault. 2024. Evaluation of an llm in identifying logical fallacies: A call for rigor when adopting llms in hci research. [find](https://scholar.google.com/scholar?q=Gionnieve+Lim+and+Simon+T%2E+Perrault%2E+2024%2E+Evaluation+of+an+llm+in+identifying+logical+fallacies%3A+A+call+for+rigor+when+adopting+llms+in+hci+research%2E)
19. Zhivar Sourati, Vishnu Priya Prasanna Venkatesh, Darshan Deshpande, Himanshu Rawlani, Filip Ilievski, Hông-Ân Sandlin, and Alain Mermoud. 2023b. Robust and explainable identification of logical fallacies in natural language arguments. [find](https://scholar.google.com/scholar?q=Zhivar+Sourati%2C+Vishnu+Priya+Prasanna+Venkatesh%2C+Darshan+Deshpande%2C+Himanshu+Rawlani%2C+Filip+Ilievski%2C+H%C3%B4ng%2D%C3%82n+Sandlin%2C+and+Alain+Mermoud%2E+2023b%2E+Robust+and+explainable+identification+of+logical+fallac)
20. OpenAI. 2023. [GPT-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774.
21. OpenAI. 2025. Openai o3 and o4-mini system card. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025%2E+Openai+o3+and+o4%2Dmini+system+card%2E)
22. Fengjun Pan, Xiaobao Wu, Zongrui Li, and Anh Tuan Luu. 2024. Are LLMs good zero-shot fallacy classifiers? [find](https://scholar.google.com/scholar?q=Fengjun+Pan%2C+Xiaobao+Wu%2C+Zongrui+Li%2C+and+Anh+Tuan+Luu%2E+2024%2E+Are+LLMs+good+zero%2Dshot+fallacy+classifiers%3F)
23. Thomas Storer. 1949. Carl g. hempel and paul oppenheim. studies in the logic of explanation. philosophy of science, vol. 15 (1948), pp. 135–175. Journal of Symbolic Logic, 14(2):133–133. [find](https://scholar.google.com/scholar?q=Thomas+Storer%2E+1949%2E+Carl+g%2E+hempel+and+paul+oppenheim%2E+studies+in+the+logic+of+explanation%2E+philosophy+of+science%2C+vol%2E+15+%281948%29%2C+pp%2E+135%E2%80%93175%2E+Journal+of+Symbolic+Logic%2C+14%282%29%3A133%E2%80%93133%2E)
24. Nils Reimers and Iryna Gurevych. 2019. [Sentence-bert: Sentence embeddings using siamese bert-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics.
25. Nicole Teo, Donghao Huang, Erik Cambria, and Zhaoxia Wang. 2025. Large language models for logical fallacy detection. In Trends and Applications in Knowledge Discovery and Data Mining, pages 387–398, Singapore. Springer Nature Singapore. [find](https://scholar.google.com/scholar?q=Nicole+Teo%2C+Donghao+Huang%2C+Erik+Cambria%2C+and+Zhaoxia+Wang%2E+2025%2E+Large+language+models+for+logical+fallacy+detection%2E+In+Trends+and+Applications+in+Knowledge+Discovery+and+Data+Mining%2C+pages+387%E2%80%93398%2C+)
26. Prashanth Vijayaraghavan and Soroush Vosoughi. 2022. TWEETSPIN: Fine-grained propaganda detection in social media using multi-view representations. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages… [find](https://scholar.google.com/scholar?q=Prashanth+Vijayaraghavan+and+Soroush+Vosoughi%2E+2022%2E+TWEETSPIN%3A+Fine%2Dgrained+propaganda+detection+in+social+media+using+multi%2Dview+representations%2E+In+Proceedings+of+the+2022+Conference+of+the+North+A)

*Updated 1 November 2026*