---
title: "arXiv2Table — paper by Wang et al. (2026) — summary and ideas"
description: "The authors build arXiv2Table, a benchmark derived from ArxivDIGESTables. 49 references, cited by 1 paper here."
authors: ["Weiqi Wang", "Jiefu Ou", "Yangqiu Song", "Benjamin Van Durme", "Daniel Khashabi"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.346/"
doi: "10.18653/v1/2026.acl-long.346"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2026-arxiv2table-realistic-benchmarking-evaluation-llm/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2026-arxiv2table-realistic-benchmarking-evaluation-llm/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/) / arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation

# arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation

**Authors:** [Weiqi Wang](https://md.research.elamur.ai/free/en/authors/weiqi-wang/), [Jiefu Ou](https://md.research.elamur.ai/free/en/authors/jiefu-ou/), [Yangqiu Song](https://md.research.elamur.ai/free/en/authors/yangqiu-song/), [Benjamin Van Durme](https://md.research.elamur.ai/free/en/authors/benjamin-van-durme/) and [Daniel Khashabi](https://md.research.elamur.ai/free/en/authors/daniel-khashabi/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.346/) · [PDF](https://aclanthology.org/2026.acl-long.346.pdf) · [DOI 10.18653/v1/2026.acl-long.346](https://doi.org/10.18653/v1/2026.acl-long.346) · [OpenAlex](https://openalex.org/W4414626360)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper argues that current evaluations of LLM-generated literature-review tables are too idealized. They assume every supplied paper belongs in the table, and they use the gold table's caption as the target, which is either too vague or reveals the expected columns. The authors build arXiv2Table, a benchmark derived from ArxivDIGESTables. Captions are rewritten into self-contained user requests that describe the goal of the comparison without exposing gold column names or cell values. The candidate pool also contains semantically similar but out-of-scope distractor papers, which human annotators checked. Evaluation needs no annotation: an LLM generates QA pairs from the gold table and then answers them using the system's table. Scores cover schema coverage, single-cell fidelity and pairwise-cell consistency, and paper selection is scored with a bidirectional QA procedure. The authors also propose a generation method that processes papers in batches and refines both the paper filter and the schema over several rounds. Across five LLMs, this method beats strong baselines, but absolute scores stay modest, so the task remains difficult.

## Key points
- arXiv2Table contains 1,957 tables that reference 7,158 computer-science papers. It was built from ArxivDIGESTables by removing incomplete tables and tables whose cited papers lack full text.
- The task has three stages: candidate retrieval (T1, recall-oriented), paper selection (T2, precision-oriented, filtering out distractors) and table induction (T3, at least 2 columns, one row per selected paper).
- Paper selection is checked in both directions (gold→system and system→gold) and reported as recall, precision and F1. Human audits and cross-evaluator checks support the evaluation protocol.
- In the ablation, the iterative batch method reaches its best macro-F1 of 53.1 with batch size 4 and 4 iterations. Gains level off around 4–5 rounds, and pairwise-cell F1 improves the most.
- Limitations: GPT-4o is used both to curate the benchmark and to evaluate, which raises risks of contamination and bias. Distractor verification was done by 19 graduate-level annotators.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Johns Hopkins University](https://md.research.elamur.ai/free/en/universities/johns-hopkins-university/) — University, Baltimore, United States · 240 works · 96,487 citations
- [Hong Kong University of Science and Technology](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/) — University, Hong Kong, China · 142 works · 25,136 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

## Cite

Cite as: Weiqi Wang, Jiefu Ou, Yangqiu Song, Benjamin Van Durme and Daniel Khashabi. 2026. arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wang2026arxiv2table,
  title = {{arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation}},
  author = {Weiqi Wang, Jiefu Ou, Yangqiu Song, Benjamin {Van Durme} and Daniel Khashabi},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.346},
  url = {https://doi.org/10.18653/v1/2026.acl-long.346}
}
```

- [← previous ART: Attention Replacement Technique to Improve Factuality in LLMs](https://md.research.elamur.ai/free/en/papers/luo-2026-art-attention-replacement-technique-improve/)
- [next → ASTraNet at SemEval-2026 Task 13: Not All Code Looks the Same: Multi-View Structural and Semantic Detection of Machine-Generated Code](https://md.research.elamur.ai/free/en/papers/naswan-2026-astranet-semeval-2026-task-13/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/)

## References

49 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ojas Ahuja, Jiacheng Xu, Akshay Gupta, Kevin Horecka, and Greg Durrett. 2022. ASPECTNEWS: aspect-oriented summarization of news documents. In Proceedings of the 60th Annual Meeting of the [https://platform.openai.com/](https://platform.openai.com/) [↗](https://platform.openai.com/)
2. Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, pages 6494–6506. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29%2C+ACL+2022%2C+Dublin%2C+Ireland%2C+May+22%2D27%2C+2022%2C+pages+6494%E2%80%936506%2E+Association+for+Computational+Linguistics%2E)
3. Yuxuan Liu, Yuyang Zhou, Y. X. Zhu, Yanhong Xu, Yanping Huang, Yaohui Li, Yi Zheng, Yuchen Zhu, Yunxian Ma, Ying Tang, Yukun Zha, Yuting Yan, Z. Z. Ren, Zehui Ren, Zhangli Sha, Zhe Fu, Zhean Xu, Zhenda Xie, Zhengyan Zhang, Zhewen Hao, Zhicheng Ma, Zhigang Yan, Zhiyu Wu, Zihui Gu, Zijia Zhu, Zijun Li… — [DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/)
4. John Dagdelen, Alexander Dunn, Sanghoon Lee, Nicholas Walker, Andrew S Rosen, Gerbrand Ceder, Kristin A Persson, and Anubhav Jain. 2024. [Structured information extraction from scientific text with large language models](https://md.research.elamur.ai/free/en/papers/dagdelen-2024-structured-information-extraction-scientific-text/). Nature Communications, 15(1):1418.
5. Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, and Matt Gardner. 2021. [A dataset of information-seeking questions and answers anchored in research papers](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/). In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lan…
6. DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda Lu, Chengg… [find](https://scholar.google.com/scholar?q=DeepSeek%2DAI%2C+Daya+Guo%2C+Dejian+Yang%2C+Haowei+Zhang%2C+Junxiao+Song%2C+Ruoyu+Zhang%2C+Runxin+Xu%2C+Qihao+Zhu%2C+Shirong+Ma%2C+Peiyi+Wang%2C+Xiao+Bi%2C+Xiaokang+Zhang%2C+Xingkai+Yu%2C+Yu+Wu%2C+Z%2E+F%2E+Wu%2C+Zhibin+Gou%2C+Zhihong+Sha)
7. Chunyuan Deng, Yilun Zhao, Xiangru Tang, Mark Gerstein, and Arman Cohan. 2024a. [Investigating data contamination in modern benchmarks for large language models](https://md.research.elamur.ai/free/en/papers/deng-2024-investigating-data-contamination-modern-benchmarks/). In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno…
8. Zheye Deng, Chunkit Chan, Weiqi Wang, Yuxi Sun, Wei Fan, Tianshi Zheng, Yauwai Yim, and Yangqiu Song. 2024b. Text-tuple-table: Towards information integration in text-to-table generation via global tuple extraction. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Proce… [find](https://scholar.google.com/scholar?q=Zheye+Deng%2C+Chunkit+Chan%2C+Weiqi+Wang%2C+Yuxi+Sun%2C+Wei+Fan%2C+Tianshi+Zheng%2C+Yauwai+Yim%2C+and+Yangqiu+Song%2E+2024b%2E+Text%2Dtuple%2Dtable%3A+Towards+information+integration+in+text%2Dto%2Dtable+generation+via+global+tu)
9. Jay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl, and Lucy Lu Wang. 2021. Ms\\ˆ2: Multi-document summarization of medical studies. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 Nov… [find](https://scholar.google.com/scholar?q=Jay+DeYoung%2C+Iz+Beltagy%2C+Madeleine+van+Zuylen%2C+Bailey+Kuehl%2C+and+Lucy+Lu+Wang%2E+2021%2E+Ms%5C%5C%CB%862%3A+Multi%2Ddocument+summarization+of+medical+studies%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods)
10. Yihong Dong, Xue Jiang, Huanyu Liu, Zhi Jin, Bin Gu, Mengfei Yang, and Ge Li. 2024. Generalization or memorization: Data contamination and trustworthy evaluation for large language models. In Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting,… [find](https://scholar.google.com/scholar?q=Yihong+Dong%2C+Xue+Jiang%2C+Huanyu+Liu%2C+Zhi+Jin%2C+Bin+Gu%2C+Mengfei+Yang%2C+and+Ge+Li%2E+2024%2E+Generalization+or+memorization%3A+Data+contamination+and+trustworthy+evaluation+for+large+language+models%2E+In+Findings)
11. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurélien Rodriguez,… — [The Llama 3 Herd of Models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/)
12. Joseph L Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5):378. 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), Tokyo, Japan, August 11, 2017, volume 1888 of CEUR Workshop Proceedings, pages 69–… [find](https://scholar.google.com/scholar?q=Joseph+L+Fleiss%2E+1971%2E+Measuring+nominal+scale+agreement+among+many+raters%2E+Psychological+bulletin%2C+76%285%29%3A378%2E+40th+International+ACM+SIGIR+Conference+on+Research+and+Development+in+Information+Retrie)
13. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. [Natur…](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
14. Yoonjoo Lee, Kyungjae Lee, Sunghyun Park, Dasol Hwang, Jaehyeon Kim, Hong-In Lee, and Moontae Lee. 2023. QASA: advanced question answering on scientific articles. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine… [find](https://scholar.google.com/scholar?q=Yoonjoo+Lee%2C+Kyungjae+Lee%2C+Sunghyun+Park%2C+Dasol+Hwang%2C+Jaehyeon+Kim%2C+Hong%2DIn+Lee%2C+and+Moontae+Lee%2E+2023%2E+QASA%3A+advanced+question+answering+on+scientific+articles%2E+In+International+Conference+on+Machin)
15. Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, and Zhoujun Li. 2020. Tablebank: Table benchmark for image-based table detection and recognition. In Proceedings of The 12th Language Resources and Evaluation Conference, LREC 2020, Marseille, France, May 11-16, 2020, pages 1918– 1925. Europea… [find](https://scholar.google.com/scholar?q=Minghao+Li%2C+Lei+Cui%2C+Shaohan+Huang%2C+Furu+Wei%2C+Ming+Zhou%2C+and+Zhoujun+Li%2E+2020%2E+Tablebank%3A+Table+benchmark+for+image%2Dbased+table+detection+and+recognition%2E+In+Proceedings+of+The+12th+Language+Resources)
16. Tong Li, Zhihao Wang, Liangying Shao, Xuling Zheng, Xiaoli Wang, and Jinsong Su. 2023. A sequence-to-sequence&set model for text-to-table generation. In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023, pages 5358–5370. Association for Computation… [find](https://scholar.google.com/scholar?q=Tong+Li%2C+Zhihao+Wang%2C+Liangying+Shao%2C+Xuling+Zheng%2C+Xiaoli+Wang%2C+and+Jinsong+Su%2E+2023%2E+A+sequence%2Dto%2Dsequence%26set+model+for+text%2Dto%2Dtable+generation%2E+In+Findings+of+the+Association+for+Computational+L)
17. Shayne Longpre, Robert Mahari, Naana Obeng-Marnu, William Brannon, Tobin South, Katy Ilonka Gero, Alex Pentland, and Jad Kabbara. 2024. Position: Data authenticity, consent, & provenance for AI are all broken: what will it take to fix them? In Forty-first International Conference on Machine Learning… [find](https://scholar.google.com/scholar?q=Shayne+Longpre%2C+Robert+Mahari%2C+Naana+Obeng%2DMarnu%2C+William+Brannon%2C+Tobin+South%2C+Katy+Ilonka+Gero%2C+Alex+Pentland%2C+and+Jad+Kabbara%2E+2024%2E+Position%3A+Data+authenticity%2C+consent%2C+%26+provenance+for+AI+are+al)
18. Muhan Gao, Jash Shah, Weiqi Wang, and Daniel Khashabi. 2025. Science hierarchography: Hierarchical organization of science literature. CoRR, abs/2504.13834. — [arXiv:2504.13834](https://arxiv.org/abs/2504.13834) [find](https://scholar.google.com/scholar?q=Muhan+Gao%2C+Jash+Shah%2C+Weiqi+Wang%2C+and+Daniel+Khashabi%2E+2025%2E+Science+hierarchography%3A+Hierarchical+organization+of+science+literature%2E+CoRR%2C+abs%2F2504%2E13834%2E+%E2%80%94+%5BarXiv%3A2504%2E13834%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F)
19. Xinyuan Lu, Liangming Pan, Qian Liu, Preslav Nakov, and Min-Yen Kan. 2023. SCITAB: A challenging benchmark for compositional reasoning and claim verification on scientific tables. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, Decemb… [find](https://scholar.google.com/scholar?q=Xinyuan+Lu%2C+Liangming+Pan%2C+Qian+Liu%2C+Preslav+Nakov%2C+and+Min%2DYen+Kan%2E+2023%2E+SCITAB%3A+A+challenging+benchmark+for+compositional+reasoning+and+claim+verification+on+scientific+tables%2E+In+Proceedings+of+th)
20. Hayato Hashimoto, Kazutoshi Shinoda, Hikaru Yokono, and Akiko Aizawa. 2017. Automatic generation of review matrices as multi-document summarization of scientific papers. In Proceedings of the 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digita… [find](https://scholar.google.com/scholar?q=Hayato+Hashimoto%2C+Kazutoshi+Shinoda%2C+Hikaru+Yokono%2C+and+Akiko+Aizawa%2E+2017%2E+Automatic+generation+of+review+matrices+as+multi%2Ddocument+summarization+of+scientific+papers%2E+In+Proceedings+of+the+2nd+Join)
21. Mistral-AI. 2024. Large enough. Mistral AI Blog. [find](https://scholar.google.com/scholar?q=Mistral%2DAI%2E+2024%2E+Large+enough%2E+Mistral+AI+Blog%2E)
22. Nafise Sadat Moosavi, Andreas Rücklé, Dan Roth, and Iryna Gurevych. 2021. Scigen: a dataset for reasoning-aware text generation from scientific tables. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021,… [find](https://scholar.google.com/scholar?q=Nafise+Sadat+Moosavi%2C+Andreas+R%C3%BCckl%C3%A9%2C+Dan+Roth%2C+and+Iryna+Gurevych%2E+2021%2E+Scigen%3A+a+dataset+for+reasoning%2Daware+text+generation+from+scientific+tables%2E+In+Proceedings+of+the+Neural+Information+Process)
23. Benjamin Newman, Yoonjoo Lee, Aakanksha Naik, Pao Siangliulue, Raymond Fok, Juho Kim, Daniel S. Weld, Joseph Chee Chang, and Kyle Lo. 2024. Arxivdigestables: Synthesizing scientific literature into tables using language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural La… [find](https://scholar.google.com/scholar?q=Benjamin+Newman%2C+Yoonjoo+Lee%2C+Aakanksha+Naik%2C+Pao+Siangliulue%2C+Raymond+Fok%2C+Juho+Kim%2C+Daniel+S%2E+Weld%2C+Joseph+Chee+Chang%2C+and+Kyle+Lo%2E+2024%2E+Arxivdigestables%3A+Synthesizing+scientific+literature+into+ta)
24. OpenAI. 2024a. Gpt-4o mini: advancing cost-efficient intelligence. OpenAI. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024a%2E+Gpt%2D4o+mini%3A+advancing+cost%2Defficient+intelligence%2E+OpenAI%2E)
25. OpenAI. 2024b. Hello gpt-4o. OpenAI. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024b%2E+Hello+gpt%2D4o%2E+OpenAI%2E)
26. OpenAI. 2025a. Introducing deep research. OpenAI Blog. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025a%2E+Introducing+deep+research%2E+OpenAI+Blog%2E)
27. OpenAI. 2025b. Introducing openai o3 and o4-mini. OpenAI. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025b%2E+Introducing+openai+o3+and+o4%2Dmini%2E+OpenAI%2E)
28. OpenAI. 2025c. Openai o3-mini. OpenAI Blog. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025c%2E+Openai+o3%2Dmini%2E+OpenAI+Blog%2E)
29. Jiefu Ou, William Gantt Walden, Kate Sanders, Zhengping Jiang, Kaiser Sun, Jeffrey Cheng, William Jurayj, Miriam Wanner, Shaobo Liang, Candice Morgan, Seunghoon Han, Weiqi Wang, Chandler May, Hannah Recknor, Daniel Khashabi, and Benjamin Van Durme. 2025. CLAIMCHECK: how grounded are LLM critiques of… [find](https://scholar.google.com/scholar?q=Jiefu+Ou%2C+William+Gantt+Walden%2C+Kate+Sanders%2C+Zhengping+Jiang%2C+Kaiser+Sun%2C+Jeffrey+Cheng%2C+William+Jurayj%2C+Miriam+Wanner%2C+Shaobo+Liang%2C+Candice+Morgan%2C+Seunghoon+Han%2C+Weiqi+Wang%2C+Chandler+May%2C+Hannah+R)
30. Vishakh Padmakumar, Joseph Chee Chang, Kyle Lo, Doug Downey, and Aakanksha Naik. 2025. Setting the table with intent: Intent-aware schema generation and editing for literature review tables. To appear. [find](https://scholar.google.com/scholar?q=Vishakh+Padmakumar%2C+Joseph+Chee+Chang%2C+Kyle+Lo%2C+Doug+Downey%2C+and+Aakanksha+Naik%2E+2025%2E+Setting+the+table+with+intent%3A+Intent%2Daware+schema+generation+and+editing+for+literature+review+tables%2E+To+appear)
31. Daniel M. Russell, Mark Stefik, Peter Pirolli, and Stuart K. Card. 1993. The cost structure of sensemaking. In Human-Computer Interaction, INTERACT ’93, IFIP TC13 International Conference on Human-Computer Interaction, 24-29 April 1993, Amsterdam, The Netherlands, jointly organised with ACM Conferen… [find](https://scholar.google.com/scholar?q=Daniel+M%2E+Russell%2C+Mark+Stefik%2C+Peter+Pirolli%2C+and+Stuart+K%2E+Card%2E+1993%2E+The+cost+structure+of+sensemaking%2E+In+Human%2DComputer+Interaction%2C+INTERACT+%E2%80%9993%2C+IFIP+TC13+International+Conference+on+Human%2DCom)
32. Liangtai Sun, Yang Han, Zihan Zhao, Da Ma, Zhennan Shen, Baocai Chen, Lu Chen, and Kai Yu. 2024. Scieval: A multi-level large language model evaluation benchmark for scientific research. In Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative App… [find](https://scholar.google.com/scholar?q=Liangtai+Sun%2C+Yang+Han%2C+Zihan+Zhao%2C+Da+Ma%2C+Zhennan+Shen%2C+Baocai+Chen%2C+Lu+Chen%2C+and+Kai+Yu%2E+2024%2E+Scieval%3A+A+multi%2Dlevel+large+language+model+evaluation+benchmark+for+scientific+research%2E+In+Thirty%2DEig)
33. Anirudh Sundar, Christopher Richardson, and Larry Heck. 2024. gtbls: Generating tables from text by conditional question answering. CoRR, abs/2403.14457. — [arXiv:2403.14457](https://arxiv.org/abs/2403.14457) [find](https://scholar.google.com/scholar?q=Anirudh+Sundar%2C+Christopher+Richardson%2C+and+Larry+Heck%2E+2024%2E+gtbls%3A+Generating+tables+from+text+by+conditional+question+answering%2E+CoRR%2C+abs%2F2403%2E14457%2E+%E2%80%94+%5BarXiv%3A2403%2E14457%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F240)
34. Xiangru Tang, Yiming Zong, Jason Phang, Yilun Zhao, Wangchunshu Zhou, Arman Cohan, and Mark Gerstein. 2023. Struc-bench: Are large language models really good at generating complex structured data? CoRR, abs/2309.08963. — [arXiv:2309.08963](https://arxiv.org/abs/2309.08963) [find](https://scholar.google.com/scholar?q=Xiangru+Tang%2C+Yiming+Zong%2C+Jason+Phang%2C+Yilun+Zhao%2C+Wangchunshu+Zhou%2C+Arman+Cohan%2C+and+Mark+Gerstein%2E+2023%2E+Struc%2Dbench%3A+Are+large+language+models+really+good+at+generating+complex+structured+data%3F+Co)
35. Qwen Team. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). CoRR, abs/2505.09388.
36. Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, and Yangqiu Song. 2025a. Ecomscriptbench: A multi-task benchmark for e-commerce script planning via step-wise… [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Limeng+Cui%2C+Xin+Liu%2C+Sreyashi+Nag%2C+Wenju+Xu%2C+Chen+Luo%2C+Sheikh+Muhammad+Sarwar%2C+Yang+Li%2C+Hansu+Gu%2C+Hui+Liu%2C+Changlong+Yu%2C+Jiaxin+Bai%2C+Yifan+Gao%2C+Haiyang+Zhang%2C+Qi+He%2C+Shuiwang+Ji%2C+and+Yangq)
37. Pritika Ramu, Aparna Garimella, and Sambaran Bandyopadhyay. 2024. Is this a bad table? A closer look at the evaluation of table generation from text. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024, pages 222… [find](https://scholar.google.com/scholar?q=Pritika+Ramu%2C+Aparna+Garimella%2C+and+Sambaran+Bandyopadhyay%2E+2024%2E+Is+this+a+bad+table%3F+A+closer+look+at+the+evaluation+of+table+generation+from+text%2E+In+Proceedings+of+the+2024+Conference+on+Empirical)
38. Weiqi Wang, Tianqing Fang, Wenxuan Ding, Baixuan Xu, Xin Liu, Yangqiu Song, and Antoine Bosselut. 2023a. CAR: conceptualization-augmented reasoner for zero-shot commonsense question answering. In Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, F… [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Tianqing+Fang%2C+Wenxuan+Ding%2C+Baixuan+Xu%2C+Xin+Liu%2C+Yangqiu+Song%2C+and+Antoine+Bosselut%2E+2023a%2E+CAR%3A+conceptualization%2Daugmented+reasoner+for+zero%2Dshot+commonsense+question+answering%2E+In+Find)
39. Nils Reimers and Iryna Gurevych. 2019. [Sentence-bert: Sentence embeddings using siamese bert-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, Ch…
40. Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi, Wenxuan Ding, Baixuan Xu, Zhaowei Wang, Jiaxin Bai, Xin Liu, Cheng Jiayang, Chunkit Chan, and Yangqiu Song. 2024a. CANDLE: iterative conceptualization and instantiation distillation from large language models for commonsense reasoning. In Proceedi… [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Tianqing+Fang%2C+Chunyang+Li%2C+Haochen+Shi%2C+Wenxuan+Ding%2C+Baixuan+Xu%2C+Zhaowei+Wang%2C+Jiaxin+Bai%2C+Xin+Liu%2C+Cheng+Jiayang%2C+Chunkit+Chan%2C+and+Yangqiu+Song%2E+2024a%2E+CANDLE%3A+iterative+conceptualizat)
41. Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, and Yangqiu Song. 2025b. On the role of entity and event level conceptualization in generalizable reasoning: A survey of tasks, methods, applications, and future directions. In Find… [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Tianqing+Fang%2C+Haochen+Shi%2C+Baixuan+Xu%2C+Wenxuan+Ding%2C+Liyu+Zhang%2C+Wei+Fan%2C+Jiaxin+Bai%2C+Haoran+Li%2C+Xin+Liu%2C+and+Yangqiu+Song%2E+2025b%2E+On+the+role+of+entity+and+event+level+conceptualization+)
42. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, pages 2518–2533. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29%2C+ACL+2022%2C+Dublin%2C+Ireland%2C+May+22%2D27%2C+2022%2C+pages+2518%E2%80%932533%2E+Association+for+Computatio)
43. Shuo Zhang and Krisztian Balog. 2018. On-the-fly table generation. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018, pages 595–604. ACM. [find](https://scholar.google.com/scholar?q=Shuo+Zhang+and+Krisztian+Balog%2E+2018%2E+On%2Dthe%2Dfly+table+generation%2E+In+The+41st+International+ACM+SIGIR+Conference+on+Research+%26+Development+in+Information+Retrieval%2C+SIGIR+2018%2C+Ann+Arbor%2C+MI%2C+USA%2C+Ju)
44. Weiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo, Yangqiu Song, and Lei Chen. 2023b. CAT: A contextualized conceptualization and instantiation framework for commonsense reasoning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers… [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Tianqing+Fang%2C+Baixuan+Xu%2C+Chun+Yi+Louis+Bo%2C+Yangqiu+Song%2C+and+Lei+Chen%2E+2023b%2E+CAT%3A+A+contextualized+conceptualization+and+instantiation+framework+for+commonsense+reasoning%2E+In+Proceeding)
45. Weiqi Wang, Xin Liu, Binxuan Huang, Hejie Cui, Rongzhi Zhang, Changlong Yu, Shuowei Jin, Jingfeng Yang, Qingyu Yin, Zhengyang Wang, Zheng Li, Yifan Gao, Priyanka Nigam, Bing Yin, Lihong Li, and Yangqiu Song. 2026. Heapa: Difficulty-aware heap sampling and on-policy query augmentation for LLM reinfor… — [arXiv:2601.22448](https://arxiv.org/abs/2601.22448) [find](https://scholar.google.com/scholar?q=Weiqi+Wang%2C+Xin+Liu%2C+Binxuan+Huang%2C+Hejie+Cui%2C+Rongzhi+Zhang%2C+Changlong+Yu%2C+Shuowei+Jin%2C+Jingfeng+Yang%2C+Qingyu+Yin%2C+Zhengyang+Wang%2C+Zheng+Li%2C+Yifan+Gao%2C+Priyanka+Nigam%2C+Bing+Yin%2C+Lihong+Li%2C+and+Yangqi)
46. Weiqi Wang and Yangqiu Song. 2025. MARS: benchmarking the metaphysical reasoning abilities of language models with a multi-task evaluation dataset. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2025, Vienna, Austria, July 27 -… [find](https://scholar.google.com/scholar?q=Weiqi+Wang+and+Yangqiu+Song%2E+2025%2E+MARS%3A+benchmarking+the+metaphysical+reasoning+abilities+of+language+models+with+a+multi%2Dtask+evaluation+dataset%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Ass)
47. Xingbo Wang, Samantha L. Huey, Rui Sheng, Saurabh Mehta, and Fei Wang. 2024b. Scidasynth: Interactive structured knowledge extraction and synthesis from scientific literature with large language model. CoRR, abs/2404.13765. — [arXiv:2404.13765](https://arxiv.org/abs/2404.13765) [find](https://scholar.google.com/scholar?q=Xingbo+Wang%2C+Samantha+L%2E+Huey%2C+Rui+Sheng%2C+Saurabh+Mehta%2C+and+Fei+Wang%2E+2024b%2E+Scidasynth%3A+Interactive+structured+knowledge+extraction+and+synthesis+from+scientific+literature+with+large+language+model)
48. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lho… — [Transformers: State-of-the-Art Natural Language Processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
49. Xueqing Wu, Jiacheng Zhang, and Hang Li. 2022. Text-to-table: A new way of information extraction. In [find](https://scholar.google.com/scholar?q=Xueqing+Wu%2C+Jiacheng+Zhang%2C+and+Hang+Li%2E+2022%2E+Text%2Dto%2Dtable%3A+A+new+way+of+information+extraction%2E+In)

*Updated 31 October 2026*