---
title: "NeurIPS 2024 — all papers: 34 in our library, the most cited first"
description: "34 works of NeurIPS 2024 in our library, the most cited first. Among them: MMLU-Pro: A More Robust and Challenging Multi-Task Language…"
canonical: "https://research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/works/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [NeurIPS](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) / [2024](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/) / works

# NeurIPS 2024: all papers in our library

34 works · the most cited first · [← NeurIPS 2024](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/)

1. **[MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark](https://md.research.elamur.ai/free/en/papers/wang-2024-mmlu-pro-more-robust-challenging/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yubo Wang, Xueguang Ma, Ge Zhang, et al.*2024 · 731 citations*
2. **[SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering](https://md.research.elamur.ai/free/en/papers/yang-2024-swe-agent-agent-computer-interfaces/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**John Yang, Carlos E. Jimenez, Alexander Wettig, et al.*2024 · 507 citations*
3. **[The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale](https://md.research.elamur.ai/free/en/papers/penedo-2024-fineweb-datasets-decanting-web-finest/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.*2024 · 404 citations*
4. **[SnapKV: LLM Knows What You are Looking for Before Generation](https://md.research.elamur.ai/free/en/papers/li-2024-snapkv-llm-knows-looking-before/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yuhong Li, Yingbing Huang, Bowen Yang, et al.*2024 · 350 citations*
5. **[KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization](https://md.research.elamur.ai/free/en/papers/hooper-2024-kvquant-towards-10-million-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.*2024 · 293 citations*
6. **[JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models](https://md.research.elamur.ai/free/en/papers/chao-2024-jailbreakbench-open-robustness-benchmark-jailbreaking/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.*2024 · 273 citations*
7. **[HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models](https://md.research.elamur.ai/free/en/papers/gutierrez-2024-hipporag-neurobiologically-inspired-long-term/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Bernal Jimenez Gutierrez, Yiheng Shu, Yu Gu, et al.*2024 · 264 citations*
8. **[Are We on the Right Way for Evaluating Large Vision-Language Models?](https://md.research.elamur.ai/free/en/papers/chen-2024-right-way-evaluating-large-vision/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Lin Chen, Jinsong Li, Xiaoyi Dong, et al.*2024 · 263 citations*
9. **[QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs](https://md.research.elamur.ai/free/en/papers/ashkboos-2024-quarot-outlier-free-4-bit/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.*2024 · 252 citations*
10. **[RedPajama: an Open Dataset for Training Large Language Models](https://md.research.elamur.ai/free/en/papers/weber-2024-redpajama-open-dataset-training-large/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Maurice Weber, Daniel Fu, Quentin Anthony, et al.*2024 · 247 citations*
11. **[G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering](https://md.research.elamur.ai/free/en/papers/he-2024-g-retriever-retrieval-augmented-generation/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Xiaoxin He, Yijun Tian, Yifei Sun, et al.*2024 · 234 citations*
12. **[OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments](https://md.research.elamur.ai/free/en/papers/xie-2024-osworld-benchmarking-multimodal-agents-open/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Tianbao Xie, Danyang Zhang, Jixuan Chen, et al.*2024 · 228 citations*
13. **[Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset](https://md.research.elamur.ai/free/en/papers/wang-2024-measuring-multimodal-mathematical-reasoning-math/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Ke Wang, Junting Pan, Weikang Shi, et al.*2024 · 198 citations*
14. **[MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.*2024 · 197 citations*
15. **[ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search](https://md.research.elamur.ai/free/en/papers/zhang-2024-rest-mcts-llm-self-training/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Dan Zhang, Sining Zhoubian, Ziniu Hu, et al.*2024 · 197 citations*
16. **[What matters when building vision-language models?](https://md.research.elamur.ai/free/en/papers/lauren-ccon-2024-matters-building-vision-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.*2024 · 195 citations*
17. **[Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs](https://md.research.elamur.ai/free/en/papers/tong-2024-cambrian-1-fully-open-vision/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shengbang Tong, Ellis Brown, Penghao Wu, et al.*2024 · 173 citations*
18. **[Long-form factuality in large language models](https://md.research.elamur.ai/free/en/papers/wei-2024-long-form-factuality-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jerry Wei, Chengrun Yang, Xinying Song, et al.*2024 · 162 citations*
19. **[CultureLLM: Incorporating Cultural Differences into Large Language Models](https://md.research.elamur.ai/free/en/papers/li-2024-culturellm-incorporating-cultural-differences-large/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Cheng Li, Mengzhou Chen, Jindong Wang, et al.*2024 · 160 citations*
20. **[DataComp-LM: In search of the next generation of training sets for language models](https://md.research.elamur.ai/free/en/papers/li-2024-datacomp-lm-search-next-generation/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.*2024 · 156 citations*
21. **[WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs](https://md.research.elamur.ai/free/en/papers/han-2024-wildguard-open-one-stop-moderation/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Seungju Han, Kavel Rao, Allyson Ettinger, et al.*2024 · 155 citations*
22. **[BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages](https://md.research.elamur.ai/free/en/papers/myung-2024-blend-benchmark-llms-everyday-knowledge/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Junho Myung, Nayeon Lee, Yi Zhou, et al.*2024 · 147 citations*
23. **[Iterative Reasoning Preference Optimization](https://md.research.elamur.ai/free/en/papers/pang-2024-iterative-reasoning-preference-optimization/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Richard Yuanzhe Pang, Weizhe Yuan, Kyunghyun Cho, et al.*2024 · 144 citations*
24. **[Many-Shot In-Context Learning](https://md.research.elamur.ai/free/en/papers/agarwal-2024-many-shot-context-learning/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Rishabh Agarwal, Avi Singh, Lei M. Zhang, et al.*2024 · 134 citations*
25. **[Simple and Effective Masked Diffusion Language Models](https://md.research.elamur.ai/free/en/papers/sahoo-2024-simple-effective-masked-diffusion-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.*2024 · 134 citations*
26. **[InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory](https://md.research.elamur.ai/free/en/papers/xiao-2024-infllm-training-free-long-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chaojun Xiao, Pengle Zhang, Xu Han, et al.*2024 · 125 citations*
27. **[AlphaMath Almost Zero: Process Supervision without Process](https://md.research.elamur.ai/free/en/papers/chen-2024-alphamath-almost-zero-process-supervision/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Guoxin Chen, Minpeng Liao, Chengxi Li, et al.*2024 · 119 citations*
28. **[How do Large Language Models Handle Multilingualism?](https://md.research.elamur.ai/free/en/papers/zhao-2024-large-language-models-handle-multilingualism/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yiran Zhao, Wenxuan Zhang, Guizhen Chen, et al.*2024 · 98 citations*
29. **[MAmmoTH2: Scaling Instructions from the Web](https://md.research.elamur.ai/free/en/papers/yue-2024-mammoth2-scaling-instructions-web/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Xiang Yue, Tuney Zheng, Ge Zhang, et al.*2024 · 94 citations*
30. **[WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models](https://md.research.elamur.ai/free/en/papers/jiang-2024-wildteaming-scale-wild-jailbreaks-adversarially/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Liwei Jiang, Kavel Rao, Seungju Han, et al.*2024 · 89 citations*
31. **[MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning](https://md.research.elamur.ai/free/en/papers/li-2024-mediq-question-asking-llms-benchmark/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shuyue Stella Li, Vidhisha Balachandran, Shangbin Feng, et al.*2024 · 70 citations*
32. **[Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations](https://md.research.elamur.ai/free/en/papers/hagele-2024-scaling-laws-compute-optimal-training/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Alexander Hägele, Elie Bakouch, Atli Kosson, et al.*2024 · 26 citations*
33. **[Alignment at Pre-training! Towards Native Alignment for Arabic LLMs](https://md.research.elamur.ai/free/en/papers/liang-2024-alignment-pre-training-towards-native/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Juhao Liang, Zhenyang Cai, Jianqing Zhu, et al.*2024 · 14 citations*
34. **[Resolving Discrepancies in Compute-Optimal Scaling of Language Models](https://md.research.elamur.ai/free/en/papers/porian-2024-resolving-discrepancies-compute-optimal-scaling/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Tomer Porian, Mitchell Wortsman, Jenia Jitsev, et al.*2024 · 14 citations*
- [← back to](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/) — NeurIPS 2024