---
title: "TrustTable — paper by Zhao et al. (2026) — summary and ideas"
description: "The authors also release TrustTable-Bench, a diagnostic set of deliberately faithful and flawed reasoning… 93.5% agreement. 32 references."
authors: ["Guangzhen Zhao", "Dechang Kong", "Tongyu Wu", "Zhenjiang Dong"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1612/"
doi: "10.18653/v1/2026.acl-long.1612"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhao-2026-trusttable-neuro-symbolic-auditing-framework/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhao-2026-trusttable-neuro-symbolic-auditing-framework/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/54/) / TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA

# TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA

**Authors:** Guangzhen Zhao, Dechang Kong, Tongyu Wu and Zhenjiang Dong · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1612/) · [PDF](https://aclanthology.org/2026.acl-long.1612.pdf) · [DOI 10.18653/v1/2026.acl-long.1612](https://doi.org/10.18653/v1/2026.acl-long.1612) · [OpenAlex](https://openalex.org/W7166872245)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary

LLM-based table question answering systems sometimes reach the right answer through faulty reasoning, such as misread columns or wrong arithmetic that happens to land on the gold value. The authors estimate this affects about 5% of correct predictions. Benchmarks that score only the final answer miss this problem. TrustTable addresses it by auditing the reasoning itself rather than relying on another LLM as judge. It treats a Chain-of-Thought as an implicit symbolic program and checks it in two independent ways. A Pandas-based FactChecker runs generated code on the table to confirm that the cited values exist. A Z3-based LogicAuditor tests whether the reasoning steps are logically satisfiable. Rejected chains go back to the generator with precise error diagnostics, forming a refinement loop that needs no human labels. The authors also release TrustTable-Bench, a diagnostic set of deliberately faithful and flawed reasoning chains. On WikiTableQuestions, TrustTable matches strong self-consistency baselines while using fewer API calls. Its verdicts also agree with human experts more closely than purely neural verifiers do. This matters for high-stakes domains such as finance and medicine.

## Key points

- **TrustTable-Bench:** seeds come from WTQ, PubHealthTab and SciAutomic, and GPT-5 generates the reasoning chains. Each chain falls into one of four types: Faithful, Spurious (correct answer from wrong logic), Fallacious, or Inconsistent. Human checks found 96.5% of items valid, with Fleiss' κ = 0.88.
- **Efficiency on WTQ:** accuracy rises from 80.1% (Greedy CoT) to 83.4% at an average of 5.80 calls per query. Self-Consistency needs k=10 (10 calls) to reach 83.2%, so TrustTable uses about 42% fewer calls.
- **Agreement with experts:** on 200 reasoning chains judged by three experts, TrustTable scores Cohen's κ = 0.86 and 93.5% agreement. The comparison verifiers score lower:
  - VeriCoT: κ = 0.79
  - LLM Self-Check (DeepSeek-V3): κ = 0.74
- **Value of structured feedback:** with symbolic error messages, 48.4% of rejected chains are successfully corrected, compared with 34.1% for blind resampling.
- **Limitations:** the framework handles only deterministic logic, not "soft" reasoning such as the qualitative claims in SCITAB. It works on flattened 2D DataFrames, so tables with hierarchical or merged headers can cause problems.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Nanjing University of Posts and Telecommunications](https://md.research.elamur.ai/free/en/universities/nanjing-university-of-posts-and-telecommunications/) — University, Nanjing, China · 4 works · 22 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (2): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,685 works · [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 487 works

## Cite

Cite as: Guangzhen Zhao, Dechang Kong, Tongyu Wu and Zhenjiang Dong. 2026. TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhao2026trusttable,
  title = {{TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA}},
  author = {Guangzhen Zhao, Dechang Kong, Tongyu Wu and Zhenjiang Dong},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1612},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1612}
}
```

- [← previous TRUST: Towards Robust Social Bot Detection via Uncertainty-Guided Pseudo-Labeling and Graph Structure Purification](https://md.research.elamur.ai/free/en/papers/xu-2026-trust-robust-social-bot-detection/)
- [next → Trustworthy and Explainable Causal Representation Learning in Transformers](https://md.research.elamur.ai/free/en/papers/liu-2026-trustworthy-explainable-causal-representation-learning/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/54/)

## References

32 references, 18 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Nikhil Abhyankar, Vivek Gupta, Dan Roth, and Chandan K Reddy. 2025. H-star: Llm-driven hybrid sql-text adaptive reasoning on tables. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2025)… [find](https://scholar.google.com/scholar?q=Nikhil+Abhyankar%2C+Vivek+Gupta%2C+Dan+Roth%2C+and+Chandan+K+Reddy%2E+2025%2E+H%2Dstar%3A+Llm%2Ddriven+hybrid+sql%2Dtext+adaptive+reasoning+on+tables%2E+In+Proceedings+of+the+2025+Conference+of+the+Nations+of+the+America)
2. Mubashara Akhtar, Oana Cocarascu, and Elena Simperl. 2022. Pubhealthtab: A public health table-based dataset for evidence-based fact checking. In Findings of the Association for Computational Linguistics: NAACL 2022 (Findings of NAACL 2022), pages 1–16, Seattle, United States. [find](https://scholar.google.com/scholar?q=Mubashara+Akhtar%2C+Oana+Cocarascu%2C+and+Elena+Simperl%2E+2022%2E+Pubhealthtab%3A+A+public+health+table%2Dbased+dataset+for+evidence%2Dbased+fact+checking%2E+In+Findings+of+the+Association+for+Computational+Linguist)
3. Wenhu Chen. 2023. [Large language models are few (1)-shot table reasoners](https://md.research.elamur.ai/free/en/papers/chen-2023-large-language-models-are-few/). In Findings of the association for computational linguistics: EACL 2023 (Findings of EACL 2023), pages 1120–1130, Dubrovnik, Croatia.
4. Wenhu Chen, Xueguang Ma, Xinyi Wang, and William W. Cohen. 2023. Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks. Transactions on Machine Learning Research. [find](https://scholar.google.com/scholar?q=Wenhu+Chen%2C+Xueguang+Ma%2C+Xinyi+Wang%2C+and+William+W%2E+Cohen%2E+2023%2E+Program+of+thoughts+prompting%3A+Disentangling+computation+from+reasoning+for+numerical+reasoning+tasks%2E+Transactions+on+Machine+Learning)
5. Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, and William Yang Wang. 2021. [FinQA: A dataset of numerical reasoning over financial data](https://md.research.elamur.ai/free/en/papers/chen-2021-finqa-dataset-numerical-reasoning-over/). In Proceedings of the 2021 Conference on Empirical Methods in Natural…
6. Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, and Tao Yu. 2023. [Binding language models in symbolic languages](https://md.research.elamur.ai/free/en/papers/cheng-2022-binding-language-models-symbolic-languages/). In The Eleventh International Conference on Learning Representations (ICLR 2023…
7. Thomas M. Cover and Joy A. Thomas. 2006. Elements of Information Theory, 2nd edition. John Wiley & Sons, Hoboken, NJ. [find](https://scholar.google.com/scholar?q=Thomas+M%2E+Cover+and+Joy+A%2E+Thomas%2E+2006%2E+Elements+of+Information+Theory%2C+2nd+edition%2E+John+Wiley+%26+Sons%2C+Hoboken%2C+NJ%2E)
8. Leonardo de Moura and Nikolaj Bjørner. 2008. Z3: An efficient SMT solver. In Proceedings of the 14th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2008), pages 337–340, Budapest, Hungary. [find](https://scholar.google.com/scholar?q=Leonardo+de+Moura+and+Nikolaj+Bj%C3%B8rner%2E+2008%2E+Z3%3A+An+efficient+SMT+solver%2E+In+Proceedings+of+the+14th+International+Conference+on+Tools+and+Algorithms+for+the+Construction+and+Analysis+of+Systems+%28TACA)
9. Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaid Harchaoui, and Yejin Choi. 2023. [Faith and fate: limits of transformers on composition…](https://md.research.elamur.ai/free/en/papers/dziri-2023-faith-fate-limits-transformers-compositionality/)
10. Yu Feng, Nathaniel Weir, Kaj Bostrom, Sam Bayless, Darion Cassel, Sapana Chaudhary, Benjamin Kiesl-Reiter, and Huzefa Rangwala. 2025. Vericot: Neuro-symbolic chain-of-thought validation via logical consistency checks. arXiv preprint arXiv:2511.04662. — [arXiv:2511.04662](https://arxiv.org/abs/2511.04662) [find](https://scholar.google.com/scholar?q=Yu+Feng%2C+Nathaniel+Weir%2C+Kaj+Bostrom%2C+Sam+Bayless%2C+Darion+Cassel%2C+Sapana+Chaudhary%2C+Benjamin+Kiesl%2DReiter%2C+and+Huzefa+Rangwala%2E+2025%2E+Vericot%3A+Neuro%2Dsymbolic+chain%2Dof%2Dthought+validation+via+logical+co)
11. Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5):378–382. [find](https://scholar.google.com/scholar?q=Joseph+L%2E+Fleiss%2E+1971%2E+Measuring+nominal+scale+agreement+among+many+raters%2E+Psychological+Bulletin%2C+76%285%29%3A378%E2%80%93382%2E)
12. Heng Gong, Yawei Sun, Xiaocheng Feng, Bing Qin, Wei Bi, Xiaojiang Liu, and Ting Liu. 2020. TableGPT: Few-shot table-to-text generation with table structure reconstruction and content matching. In Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), pages 1978–… [find](https://scholar.google.com/scholar?q=Heng+Gong%2C+Yawei+Sun%2C+Xiaocheng+Feng%2C+Bing+Qin%2C+Wei+Bi%2C+Xiaojiang+Liu%2C+and+Ting+Liu%2E+2020%2E+TableGPT%3A+Few%2Dshot+table%2Dto%2Dtext+generation+with+table+structure+reconstruction+and+content+matching%2E+In+Proc)
13. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). In Proceedings of the 36th International Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, USA.
14. Zhenjie Sun, Naihao Deng, Haofei Yu, and Jiaxuan You. 2025. Tables as thought: Exploring structured thoughts in LLM reasoning. In Proceedings of the 4th Table Representation Learning Workshop, pages 19–33, Vienna, Austria. [find](https://scholar.google.com/scholar?q=Zhenjie+Sun%2C+Naihao+Deng%2C+Haofei+Yu%2C+and+Jiaxuan+You%2E+2025%2E+Tables+as+thought%3A+Exploring+structured+thoughts+in+LLM+reasoning%2E+In+Proceedings+of+the+4th+Table+Representation+Learning+Workshop%2C+pages+1)
15. Tamera Lanham, Anna Chen, Ansh Radhakrishnan, Benoit Steiner, Carson Denison, Danny Hernandez, Dustin Li, Esin Durmus, Evan Hubinger, Jackson Kernion, Kamilė Lukošiūtė, Karina Nguyen, Newton Cheng, Nicholas Joseph, Nicholas Schiefer, Oliver Rausch, Robin Larson, Sam McCandlish, Sandipan Kundu, an… — [Measuring Faithfulness in Chain-of-Thought Reasoning](https://md.research.elamur.ai/free/en/papers/lanham-2023-measuring-faithfulness-chain-thought-reasoning/)
16. Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024. [Let’s verify step by step](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/). In The Twelfth International Conference on Learning Representations (ICLR 2024), Vienna, Austria.
17. Qian Liu, Bei Chen, Jiaqi Guo, Morteza Ziyadi, Zeqi Lin, Weizhu Chen, and Jian-Guang Lou. 2022. [TAPEX: Table pre-training via learning a neural SQL executor](https://md.research.elamur.ai/free/en/papers/liu-2021-tapex-table-pre-training-learning/). In International Conference on Learning Representations (ICLR 2022), Virtual.
18. Tianyang Liu, Fei Wang, and Muhao Chen. 2024. Rethinking tabular data understanding with large language models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2024), pages 450–482, Mexico City,… [find](https://scholar.google.com/scholar?q=Tianyang+Liu%2C+Fei+Wang%2C+and+Muhao+Chen%2E+2024%2E+Rethinking+tabular+data+understanding+with+large+language+models%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+Chapter+of+the+Association+f)
19. Miles Turpin, Julian Michael, Ethan Perez, and Samuel R. Bowman. 2023. [Language models don’t always say what they think: Unfaithful explanations in chain-of-thought prompting](https://md.research.elamur.ai/free/en/papers/turpin-2023-language-models-don-t-always/). In Proceedings of the 37th International Conference on Neural Information Processing Systems (NeurIPS 2023), pages 74952–749…
20. Jonathan Uesato, Nate Kushman, Ramana Kumar, Francis Song, Noah Siegel, Lisa Wang, Antonia Creswell, Geoffrey Irving, and Irina Higgins. 2022. [Solving math word problems with process-and outcome-based feedback](https://md.research.elamur.ai/free/en/papers/uesato-2022-solving-math-word-problems-process/). arXiv preprint arXiv:2211.14275.
21. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. [Attention is All You Need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In Advances in Neural Information Processing Systems (NIPS 2017), pages 5998–6008, Long Beach, CA, USA.
22. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). In The Eleventh International Conference on Learning Representations (ICLR 2023), Kigali, Rwanda.
23. William Merrill and Ashish Sabharwal. 2024. The expressive power of transformers with chain of thought. In The Twelfth International Conference on Learning Representations (ICLR 2024), Vienna, Austria. [find](https://scholar.google.com/scholar?q=William+Merrill+and+Ashish+Sabharwal%2E+2024%2E+The+expressive+power+of+transformers+with+chain+of+thought%2E+In+The+Twelfth+International+Conference+on+Learning+Representations+%28ICLR+2024%29%2C+Vienna%2C+Austria)
24. Zilong Wang, Hao Zhang, Chun-Liang Li, Julian Martin Eisenschlos, Vincent Perot, Zifeng Wang, Lesly Miculicich, Yasuhisa Fujii, Jingbo Shang, Chen-Yu Lee, and Tomas Pfister. 2024. [Chain-of-table: Evolving tables in the reasoning chain for table understanding](https://md.research.elamur.ai/free/en/papers/wang-2024-chain-table-evolving-tables-reasoning/). In The Twelfth International Conference…
25. Md Mahadi Hasan Nahid and Davood Rafiei. 2024. Tab-SQLify: Enhancing reasoning capabilities of LLMs through table decomposition. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2024), pages 5725–… [find](https://scholar.google.com/scholar?q=Md+Mahadi+Hasan+Nahid+and+Davood+Rafiei%2E+2024%2E+Tab%2DSQLify%3A+Enhancing+reasoning+capabilities+of+LLMs+through+table+decomposition%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+Chapter+of+)
26. Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus. 2022a. [Emergent abilities of large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/). Transactions on M…
27. Panupong Pasupat and Percy Liang. 2015. [Compositional semantic parsing on semi-structured tables](https://md.research.elamur.ai/free/en/papers/pasupat-2015-compositional-semantic-parsing-semi-structured/). In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (ACL 2015), pages 1470–1480, Beijing,…
28. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc V. Le, and Denny Zhou. 2022b. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In Proceedings of the 36th International Conference on Neural Information Processing Systems (NeurIPS 2022)…
29. Xin Quan, Marco Valentino, Louise Dennis, and Andre Freitas. 2024. Enhancing ethical explanations of large language models through iterative symbolic refinement. In Proceedings of the 18th Conference Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng… [find](https://scholar.google.com/scholar?q=Xin+Quan%2C+Marco+Valentino%2C+Louise+Dennis%2C+and+Andre+Freitas%2E+2024%2E+Enhancing+ethical+explanations+of+large+language+models+through+iterative+symbolic+refinement%2E+In+Proceedings+of+the+18th+Conference+)
30. Tianshu Zhang, Xiang Yue, Yifei Li, and Huan Sun. 2024. [Tablellama: Towards open large generalist models for tables](https://md.research.elamur.ai/free/en/papers/zhang-2023-tablellama-towards-open-large-generalist/). In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2024), pages 6024– 6044.
31. Yuji Zhang, Qingyun Wang, Cheng Qian, Jiateng Liu, Chenkai Sun, Denghui Zhang, Tarek Abdelzaher, Chengxiang Zhai, Preslav Nakov, and Heng Ji. 2025. Atomic reasoning for scientific table claim verification. arXiv preprint arXiv:2506.06972. — [arXiv:2506.06972](https://arxiv.org/abs/2506.06972) [find](https://scholar.google.com/scholar?q=Yuji+Zhang%2C+Qingyun+Wang%2C+Cheng+Qian%2C+Jiateng+Liu%2C+Chenkai+Sun%2C+Denghui+Zhang%2C+Tarek+Abdelzaher%2C+Chengxiang+Zhai%2C+Preslav+Nakov%2C+and+Heng+Ji%2E+2025%2E+Atomic+reasoning+for+scientific+table+claim+verifica)
32. Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, and 3 others. 2023. [A survey of large language models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/). Prepri…

*Updated 2 November 2026*