---
title: "Usefulness of LLMs as an Author Checklist Assistant for"
description: "This study tests whether an LLM can help with that narrow, low-stakes task. 29 references, cited by 6 papers here."
authors: ["Alexander Goldberg", "Ihsan Ullah", "Thanh Gia Hieu Khuong", "Benedictus Kent Rachmat", "Zhen Xu", "Isabelle Guyon", "Nihar B. Shah"]
year: 2024
venue: "arXiv:2411.03417"
source: "https://arxiv.org/abs/2411.03417"
doi: "10.48550/arxiv.2411.03417"
arxiv: "2411.03417"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/goldberg-2024-usefulness-llms-author-checklist-assistant/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/goldberg-2024-usefulness-llms-author-checklist-assistant/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/9/) / Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment

# Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment

**Authors:** Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong, [Benedictus Kent Rachmat](https://md.research.elamur.ai/free/en/authors/benedictus-kent-rachmat/), [Zhen Xu](https://md.research.elamur.ai/free/en/authors/zhen-xu/), Isabelle Guyon and Nihar B. Shah · **Year:** 2024 · **Venue:** arXiv:2411.03417 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2411.03417) · [PDF](https://arxiv.org/pdf/2411.03417) · [DOI 10.48550/arxiv.2411.03417](https://doi.org/10.48550/arxiv.2411.03417) · [arXiv 2411.03417](https://arxiv.org/abs/2411.03417) · [OpenAlex](https://openalex.org/W4404395372)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · 6 in our library, of the 149,439 papers whose bibliographies we read

## Summary
Large conferences ask authors to fill in compliance checklists, but making sure those answers are accurate is hard to do at scale. This study tests whether an LLM can help with that narrow, low-stakes task. At NeurIPS 2024 the team offered an optional "Checklist Assistant." Authors uploaded a manuscript along with their answers and justifications for the 15-item NeurIPS Paper Checklist, which covers claims, limitations, reproducibility, compute, ethics, licenses, IRB and similar topics. The LLM then returned a critique for each question. Only the authors saw this output; reviewers and chairs never had access to it. The evaluation combined surveys before and after use, an analysis of the generated feedback, a comparison of papers uploaded twice, and an adversarial manipulation test. Most participants considered the tool helpful and planned revisions, although their opinion after use was lower than their expectations beforehand. Complaints focused on incorrect or overly demanding feedback. Rewritten justifications could also push the assistant toward leniency. The work provides real-world evidence that LLMs can support guideline compliance, and it shows that human oversight is still required.

## Key points
- Participation: 539 pre-usage survey responses, 234 papers submitted to the assistant, and 78 post-usage survey responses.
- Over 70% of post-use respondents rated the assistant useful, and about 70% intended to change their paper or checklist answers.
- The most frequent complaints were inaccuracy (20 of 52 respondents) and excessive strictness (14 of 52).
- The LLM typically gave 4–6 distinct points per checklist question. 35 respondents named concrete changes they would make. In the 40 papers checked twice (80 submissions), justifications grew noticeably longer on the second upload.
- AI-assisted rewriting of justifications, with no real changes to the paper, made the assistant noticeably more lenient. Code, prompts and test papers are on GitHub (ihsaan-ullah/neurips-checklist-assistant).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 539 works · 179,533 citations
- [University of Chicago](https://md.research.elamur.ai/free/en/universities/university-of-chicago/) — University, Chicago, United States · 45 works · 50,617 citations
- [Université Paris-Saclay](https://md.research.elamur.ai/free/en/universities/universite-paris-saclay/) — University, Gif-sur-Yvette, France · 45 works · 6,127 citations
- [Laboratoire Interdisciplinaire des Sciences du Numérique](https://md.research.elamur.ai/free/en/labs/laboratoire-interdisciplinaire-des-sciences-du-numerique/) — Research institute, Gif-sur-Yvette, France · 14 works · 507 citations

Also on the byline: [ChaLearn](https://ror.org/055fhtb27) · [TAU: IA : vers des problèmes mieux posés](https://ror.org/031y5kf09).

📚 Shelves (4): [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🎯 Decision Sciences](https://md.research.elamur.ai/free/en/shelves/decision-sciences/) · 209 works · [🎯 Information Systems and Management](https://md.research.elamur.ai/free/en/shelves/decision-sciences/information-systems-and-management/) · 41 works · [🎭 History and Philosophy of Science](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/history-and-philosophy-of-science/) · 53 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works

## Cite

Cite as: Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong, Benedictus Kent Rachmat, Zhen Xu, Isabelle Guyon and Nihar B. Shah. 2024. Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment. arXiv:2411.03417.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{goldberg2024usefulness,
  title = {{Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment}},
  author = {Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong, Benedictus Kent Rachmat, Zhen Xu, Isabelle Guyon and Nihar B. Shah},
  year = {2024},
  doi = {10.48550/arxiv.2411.03417},
  eprint = {2411.03417},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2411.03417}
}
```

- [← previous Unearthing Large Scale Domain-Specific Knowledge from Public Corpora](https://md.research.elamur.ai/free/en/papers/fei-2024-unearthing-large-scale-domain-specific/)
- [next → Arabic Automatic Story Generation with Large Language Models](https://md.research.elamur.ai/free/en/papers/shangiti-2024-arabic-automatic-story-generation-large/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/9/)

## References

29 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey, and Daniel S Weld. [Specter: Document-level representation learning using citation-informed transformers](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2270–2282, 2020.
2. L. Charlin and R. S. Zemel. The Toronto Paper Matching System: An automated paper-reviewer assignment system. In ICML Workshop on Peer Reviewing and Publishing Models, 2013. [find](https://scholar.google.com/scholar?q=L%2E+Charlin+and+R%2E+S%2E+Zemel%2E+The+Toronto+Paper+Matching+System%3A+An+automated+paper%2Dreviewer+assignment+system%2E+In+ICML+Workshop+on+Peer+Reviewing+and+Publishing+Models%2C+2013%2E)
3. Mike D’Arcy, Tom Hope, Larry Birnbaum, and Doug Downey. MARG: multi-agent review generation for scientific papers. arXiv preprint arXiv:2401.04259, 2024. [find](https://scholar.google.com/scholar?q=Mike+D%E2%80%99Arcy%2C+Tom+Hope%2C+Larry+Birnbaum%2C+and+Doug+Downey%2E+MARG%3A+multi%2Dagent+review+generation+for+scientific+papers%2E+arXiv+preprint+arXiv%3A2401%2E04259%2C+2024%2E)
4. Mike D’Arcy, Alexis Ross, Erin Bransom, Bailey Kuehl, Jonathan Bragg, Tom Hope, and Doug Downey. [Aries: A corpus of scientific paper edits made in response to peer reviews](https://md.research.elamur.ai/free/en/papers/arcy-2024-aries-corpus-scientific-paper-edits/). ArXiv, abs/2306.12587, 2023.
5. Thorsten Eisenhofer, Erwin Quiring, Jonas Möller, Doreen Riepel, Thorsten Holz, and Konrad Rieck. No more reviewer\# 2: Subverting automatic {Paper-Reviewer} assignment using adversarial learning. In 32nd USENIX Security Symposium (USENIX Security 23), pages 5109–5126, 2023. [find](https://scholar.google.com/scholar?q=Thorsten+Eisenhofer%2C+Erwin+Quiring%2C+Jonas+Mo%CC%88ller%2C+Doreen+Riepel%2C+Thorsten+Holz%2C+and+Konrad+Rieck%2E+No+more+reviewer%5C%23+2%3A+Subverting+automatic+%7BPaper%2DReviewer%7D+assignment+using+adversarial+learning%2E+In)
6. Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho, Alice Oh, Alekh Agarwal, Danielle Belgrave, and Nihar B Shah. Peer reviews of peer reviews: A randomized controlled trial and other experiments. arXiv preprint arXiv:2311.09497, 2023. [find](https://scholar.google.com/scholar?q=Alexander+Goldberg%2C+Ivan+Stelmakh%2C+Kyunghyun+Cho%2C+Alice+Oh%2C+Alekh+Agarwal%2C+Danielle+Belgrave%2C+and+Nihar+B+Shah%2E+Peer+reviews+of+peer+reviews%3A+A+randomized+controlled+trial+and+other+experiments%2E+arXiv)
7. Jhih-Yi (Janet) Hsieh, Aditi Raghunathan, and Nihar Shah. Vulnerability of text-matching in ML/AI conference reviewer assignments to collusion rings. arXiv, 2024. [find](https://scholar.google.com/scholar?q=Jhih%2DYi+%28Janet%29+Hsieh%2C+Aditi+Raghunathan%2C+and+Nihar+Shah%2E+Vulnerability+of+text%2Dmatching+in+ML%2FAI+conference+reviewer+assignments+to+collusion+rings%2E+arXiv%2C+2024%2E)
8. Steven Jecmen, Hanrui Zhang, Ryan Liu, Nihar B. Shah, Vincent Conitzer, and Fei Fang. Mitigating manipulation in peer review via randomized reviewer assignments. In NeurIPS, 2020. [find](https://scholar.google.com/scholar?q=Steven+Jecmen%2C+Hanrui+Zhang%2C+Ryan+Liu%2C+Nihar+B%2E+Shah%2C+Vincent+Conitzer%2C+and+Fei+Fang%2E+Mitigating+manipulation+in+peer+review+via+randomized+reviewer+assignments%2E+In+NeurIPS%2C+2020%2E)
9. Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, Jingyan Wan… [find](https://scholar.google.com/scholar?q=Ilia+Kuznetsov%2C+Osama+Mohammed+Afzal%2C+Koen+Dercksen%2C+Nils+Dycke%2C+Alexander+Goldberg%2C+Tom+Hope%2C+Dirk+Hovy%2C+Jonathan+K%2E+Kummerfeld%2C+Anne+Lauscher%2C+Kevin+Leyton%2DBrown%2C+Sheng+Lu%2C+Mausam%2C+Margot+Mieskes%2C+A)
10. Michael L Littman. Collusion rings threaten the integrity of computer science research. Communications of the ACM, 64(6):43–44, 2021. [find](https://scholar.google.com/scholar?q=Michael+L+Littman%2E+Collusion+rings+threaten+the+integrity+of+computer+science+research%2E+Communications+of+the+ACM%2C+64%286%29%3A43%E2%80%9344%2C+2021%2E)
11. Weixin Liang, Zachary Izzo, Yaohui Zhang, Haley Lepp, Hancheng Cao, Xuandong Zhao, Lingjiao Chen, Haotian Ye, Sheng Liu, Zhi Huang, Daniel A. McFarland, and James Y. Zou. Monitoring ai-modified content at scale: A case study on the impact of ChatGPT on AI conference peer reviews, 2024. [find](https://scholar.google.com/scholar?q=Weixin+Liang%2C+Zachary+Izzo%2C+Yaohui+Zhang%2C+Haley+Lepp%2C+Hancheng+Cao%2C+Xuandong+Zhao%2C+Lingjiao+Chen%2C+Haotian+Ye%2C+Sheng+Liu%2C+Zhi+Huang%2C+Daniel+A%2E+McFarland%2C+and+James+Y%2E+Zou%2E+Monitoring+ai%2Dmodified+conten)
12. Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, and David Ha. [The AI scientist: Towards fully automated open-ended scientific discovery](https://md.research.elamur.ai/free/en/papers/lu-2024-ai-scientist-fully-automated/), 2024.
13. Giuseppe Russo Latona, Manoel Horta Ribeiro, Tim R. Davidson, Veniamin Veselovsky, and Robert West. The AI review lottery: Widespread AI-assisted peer reviews boost paper scores and acceptance rates, 2024. [find](https://scholar.google.com/scholar?q=Giuseppe+Russo+Latona%2C+Manoel+Horta+Ribeiro%2C+Tim+R%2E+Davidson%2C+Veniamin+Veselovsky%2C+and+Robert+West%2E+The+AI+review+lottery%3A+Widespread+AI%2Dassisted+peer+reviews+boost+paper+scores+and+acceptance+rates%2C+)
14. Ryan Liu and Nihar B. Shah. ReviewerGPT? an exploratory study on using large language models for paper reviewing, 2023. [find](https://scholar.google.com/scholar?q=Ryan+Liu+and+Nihar+B%2E+Shah%2E+ReviewerGPT%3F+an+exploratory+study+on+using+large+language+models+for+paper+reviewing%2C+2023%2E)
15. Weixin Liang, Yuhui Zhang, Hancheng Cao, Binglu Wang, Daisy Ding, Xinyu Yang, Kailas Vodrahalli, Siyu He, Daniel Smith, Yian Yin, et al. Can large language models provide useful feedback on research papers? a large-scale empirical analysis. arXiv preprint arXiv:2310.01783, 2023. [find](https://scholar.google.com/scholar?q=Weixin+Liang%2C+Yuhui+Zhang%2C+Hancheng+Cao%2C+Binglu+Wang%2C+Daisy+Ding%2C+Xinyu+Yang%2C+Kailas+Vodrahalli%2C+Siyu+He%2C+Daniel+Smith%2C+Yian+Yin%2C+et+al%2E+Can+large+language+models+provide+useful+feedback+on+research+p)
16. Weixin Liang, Yaohui Zhang, Zhengxuan Wu, Haley Lepp, Wenlong Ji, Xuandong Zhao, Hancheng Cao, Sheng Liu, Siyu He, Zhi Huang, et al. Mapping the increasing use of LLMs in scientific papers. arXiv preprint arXiv:2404.01268, 2024. [find](https://scholar.google.com/scholar?q=Weixin+Liang%2C+Yaohui+Zhang%2C+Zhengxuan+Wu%2C+Haley+Lepp%2C+Wenlong+Ji%2C+Xuandong+Zhao%2C+Hancheng+Cao%2C+Sheng+Liu%2C+Siyu+He%2C+Zhi+Huang%2C+et+al%2E+Mapping+the+increasing+use+of+LLMs+in+scientific+papers%2E+arXiv+prep)
17. David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and t PRISMA Group*. Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. Annals of internal medicine, 151(4):264–269, 2009. [find](https://scholar.google.com/scholar?q=David+Moher%2C+Alessandro+Liberati%2C+Jennifer+Tetzlaff%2C+Douglas+G+Altman%2C+and+t+PRISMA+Group%2A%2E+Preferred+reporting+items+for+systematic+reviews+and+meta%2Danalyses%3A+the+prisma+statement%2E+Annals+of+internal)
18. David Moher, Kenneth F Schulz, and Douglas G Altman. The consort statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. The lancet, 357(9263):1191–1194, 2001. [find](https://scholar.google.com/scholar?q=David+Moher%2C+Kenneth+F+Schulz%2C+and+Douglas+G+Altman%2E+The+consort+statement%3A+revised+recommendations+for+improving+the+quality+of+reports+of+parallel%2Dgroup+randomised+trials%2E+The+lancet%2C+357%289263%29%3A1191)
19. Ian Markwood, Dakun Shen, Yao Liu, and Zhuo Lu. PDF mirage: Content masking attack against Information-Based online services. In 26th USENIX Security Symposium (USENIX Security 17), pages 833–847, Vancouver, BC, August 2017. USENIX Association. [find](https://scholar.google.com/scholar?q=Ian+Markwood%2C+Dakun+Shen%2C+Yao+Liu%2C+and+Zhuo+Lu%2E+PDF+mirage%3A+Content+masking+attack+against+Information%2DBased+online+services%2E+In+26th+USENIX+Security+Symposium+%28USENIX+Security+17%29%2C+pages+833%E2%80%93847%2C+Van)
20. Justin Payan and Yair Zick. I will have order! optimizing orders for fair reviewer assignment. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, pages 1711–1713, 2022. [find](https://scholar.google.com/scholar?q=Justin+Payan+and+Yair+Zick%2E+I+will+have+order%21+optimizing+orders+for+fair+reviewer+assignment%2E+In+Proceedings+of+the+21st+International+Conference+on+Autonomous+Agents+and+Multiagent+Systems%2C+pages+17)
21. Charvi Rastogi, Xiangchen Song, Zhijing Jin, Ivan Stelmakh, Hal Daumé III, Kun Zhang, and Nihar B Shah. A randomized controlled trial on anonymizing reviewers to each other in peer review discussions. arXiv preprint arXiv:2403.01015, 2024. — [arXiv:2403.01015](https://arxiv.org/abs/2403.01015) [find](https://scholar.google.com/scholar?q=Charvi+Rastogi%2C+Xiangchen+Song%2C+Zhijing+Jin%2C+Ivan+Stelmakh%2C+Hal+Daume%CC%81+III%2C+Kun+Zhang%2C+and+Nihar+B+Shah%2E+A+randomized+controlled+trial+on+anonymizing+reviewers+to+each+other+in+peer+review+discussions)
22. Nihar B Shah. An overview of challenges, experiments, and computational solutions in peer review. [https://www.cs.cmu.edu/~nihars/preprints/SurveyPeerReview.pdf](https://www.cs.cmu.edu/~nihars/preprints/SurveyPeerReview.pdf) (Abridged version published in the Communications of the ACM), June 2022. [↗](https://www.cs.cmu.edu/~nihars/preprints/SurveyPeerReview.pdf)
23. Ivan Stelmakh, Nihar Shah, and Aarti Singh. PeerReview4All: Fair and accurate reviewer assignment in peer review. Journal of Machine Learning Research, 2021. [find](https://scholar.google.com/scholar?q=Ivan+Stelmakh%2C+Nihar+Shah%2C+and+Aarti+Singh%2E+PeerReview4All%3A+Fair+and+accurate+reviewer+assignment+in+peer+review%2E+Journal+of+Machine+Learning+Research%2C+2021%2E)
24. Dat Tran and Chetan Jaiswal. PDFPhantom: Exploiting pdf attacks against academic conferences’ paper submission process with counterattack. In 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), pages 0736–0743, 2019. [find](https://scholar.google.com/scholar?q=Dat+Tran+and+Chetan+Jaiswal%2E+PDFPhantom%3A+Exploiting+pdf+attacks+against+academic+conferences%E2%80%99+paper+submission+process+with+counterattack%2E+In+2019+IEEE+10th+Annual+Ubiquitous+Computing%2C+Electronics+%26+)
25. Keith Tyser, Jason Lee, Avi Shporer, Madeleine Udell, Dov Te’eni, and Iddo Drori. Openreviewer: Mitigating challenges in LLM reviewing. submitted to ICLR 2024 on OpenReview.net, 2024. [find](https://scholar.google.com/scholar?q=Keith+Tyser%2C+Jason+Lee%2C+Avi+Shporer%2C+Madeleine+Udell%2C+Dov+Te%E2%80%99eni%2C+and+Iddo+Drori%2E+Openreviewer%3A+Mitigating+challenges+in+LLM+reviewing%2E+submitted+to+ICLR+2024+on+OpenReview%2Enet%2C+2024%2E)
26. Jan P Vandenbroucke, Erik von Elm, Douglas G Altman, Peter C Gøtzsche, Cynthia D Mulrow, Stuart J Pocock, Charles Poole, James J Schlesselman, Matthias Egger, and Strobe Initiative. Strengthening the reporting of observational studies in epidemiology (strobe): explanation and elaboration. Annals of… [find](https://scholar.google.com/scholar?q=Jan+P+Vandenbroucke%2C+Erik+von+Elm%2C+Douglas+G+Altman%2C+Peter+C+G%C3%B8tzsche%2C+Cynthia+D+Mulrow%2C+Stuart+J+Pocock%2C+Charles+Poole%2C+James+J+Schlesselman%2C+Matthias+Egger%2C+and+Strobe+Initiative%2E+Strengthening+the+)
27. James G Wrightson, Paul Blazey, D Moher, KM Khan, and CL Ardern. Gpt for rcts? using ai to determine adherence to reporting guidelines. medRxiv, pages 2023–12, 2023. [find](https://scholar.google.com/scholar?q=James+G+Wrightson%2C+Paul+Blazey%2C+D+Moher%2C+KM+Khan%2C+and+CL+Ardern%2E+Gpt+for+rcts%3F+using+ai+to+determine+adherence+to+reporting+guidelines%2E+medRxiv%2C+pages+2023%E2%80%9312%2C+2023%2E)
28. John Wieting, Kevin Gimpel, Graham Neubig, and Taylor Berg-Kirkpatrick. Simple and effective paraphrastic similarity from parallel translations. In ACL, pages 4602–4608, Florence, Italy, July 2019. [find](https://scholar.google.com/scholar?q=John+Wieting%2C+Kevin+Gimpel%2C+Graham+Neubig%2C+and+Taylor+Berg%2DKirkpatrick%2E+Simple+and+effective+paraphrastic+similarity+from+parallel+translations%2E+In+ACL%2C+pages+4602%E2%80%934608%2C+Florence%2C+Italy%2C+July+2019%2E)
29. Zhen Xu, Sergio Escalera, Adrien Pavão, Magali Richard, Wei-Wei Tu, Quanming Yao, Huan Zhao, and Isabelle Guyon. Codabench: Flexible, easy-to-use, and reproducible meta-benchmark platform. Patterns, 3(7):100543, 2022. [find](https://scholar.google.com/scholar?q=Zhen+Xu%2C+Sergio+Escalera%2C+Adrien+Pava%CC%83o%2C+Magali+Richard%2C+Wei%2DWei+Tu%2C+Quanming+Yao%2C+Huan+Zhao%2C+and+Isabelle+Guyon%2E+Codabench%3A+Flexible%2C+easy%2Dto%2Duse%2C+and+reproducible+meta%2Dbenchmark+platform%2E+Patterns%2C+)

*Updated 1 November 2026*