---
title: "Who cites FlashAttention-2: Faster — 1,097 citing papers"
description: "1,097 papers of the Elamur Research library cite «FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [FlashAttention-2: Faster Attention with Better…](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/) / cited by

# Who cites «FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning»

1,097 papers of our library cite it (of the 149,439 whose bibliographies we read) · 188 with a page here, the most cited first · page 1 of 2 · 1–100 · [← back to «FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning»](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/)

**1** [2](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/page/2/)

1. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
2. [**Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution arXiv:2409.12191**Peng Wang, Shuai Bai, Sinan Tan, et al.*2024 · 860 citations*](https://md.research.elamur.ai/free/en/papers/wang-2024-qwen2-vl-enhancing-vision/)
3. [**Baichuan 2: Open Large-scale Language Models arXiv:2309.10305**Aiyuan Yang, Bin Xiao, Bingning Wang, et al.*2023 · 517 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-baichuan-2-open-large-scale/)
4. [**The Falcon Series of Open Language Models arXiv:2311.16867**Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.*2023 · 443 citations*](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/)
5. **[BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains](https://md.research.elamur.ai/free/en/papers/labrak-2024-biomistral-collection-open-source-pretrained/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yanis Labrak, Adrien Bazoge, Emmanuel Morin, et al.*2024 · 409 citations*
6. [**Yi: Open Foundation Models by 01.AI arXiv:2403.04652**Alex Young, Bei Chen, Chao Li, et al.*2024 · 408 citations*](https://md.research.elamur.ai/free/en/papers/ai-2024-yi-open-foundation-models-01/)
7. **[FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision](https://md.research.elamur.ai/free/en/papers/shah-2024-flashattention-3-fast-accurate-attention/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.*2024 · 400 citations*
8. [**RULER: What's the Real Context Size of Your Long-Context Language Models? arXiv:2404.06654**Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.*2024 · 400 citations*](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/)
9. [**Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve OSDI 2024**Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.*2024 · 369 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2024-taming-throughput-latency-tradeoff-llm/)
10. [**Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference arXiv:2412.13663**Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.*2024 · 358 citations*](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/)
11. **[SnapKV: LLM Knows What You are Looking for Before Generation](https://md.research.elamur.ai/free/en/papers/li-2024-snapkv-llm-knows-looking-before/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yuhong Li, Yingbing Huang, Bowen Yang, et al.*2024 · 355 citations*
12. [**TinyLlama: An Open-Source Small Language Model arXiv:2401.02385**Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.*2024 · 352 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-tinyllama-open-source-small-language/)
13. [**Textbooks Are All You Need II: phi-1.5 technical report arXiv:2309.05463**Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, et al.*2023 · 336 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-textbooks-all-need-ii-phi/)
14. [**MEDITRON-70B: Scaling Medical Pretraining for Large Language Models arXiv:2311.16079**Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.*2023 · 315 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-meditron-70b-scaling-medical-pretraining/)
15. [**InternLM2 Technical Report arXiv:2403.17297**Zheng Cai, Maosong Cao, Haojiong Chen, et al.*2024 · 301 citations*](https://md.research.elamur.ai/free/en/papers/cai-2024-internlm2-technical-report/)
16. **[xLSTM: Extended Long Short-Term Memory](https://md.research.elamur.ai/free/en/papers/beck-2024-xlstm-extended-long-short-term/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.*2024 · 296 citations*
17. [**Llemma: An Open Language Model For Mathematics arXiv:2310.10631**Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.*2023 · 286 citations*](https://md.research.elamur.ai/free/en/papers/azerbayev-2023-llemma-open-language-model-mathematics/)
18. **[An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models](https://md.research.elamur.ai/free/en/papers/chen-2024-image-worth-1-2-tokens/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Liang Chen, Haozhe Zhao, Tianyu Liu, et al.*2024 · 279 citations*
19. [**LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models arXiv:2309.12307**Yukang Chen, Shengju Qian, Haotian Tang, et al.*2023 · 268 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-longlora-efficient-fine-tuning-long/)
20. **[Fine-Tuning LLaMA for Multi-Stage Text Retrieval](https://md.research.elamur.ai/free/en/papers/ma-2023-fine-tuning-llama-multi-stage/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Xueguang Ma, Liang Wang, Nan Yang, et al.*2023 · 257 citations*
21. [**Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture arXiv:2306.16092**Jiaxi Cui; Munan Ning; Zongjian Li; Bohua Chen; Yang Yan; Hao Li; Bin Ling; Yonghong Tian;, Li Yuan*2023 · 248 citations*](https://md.research.elamur.ai/free/en/papers/cui-2023-chatlaw-multi-agent-legal-assistant/)
22. **[mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval](https://md.research.elamur.ai/free/en/papers/zhang-2024-mgte-generalized-long-context-text/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xin Zhang, Yanzhao Zhang, Dingkun Long, et al.*2024 · 237 citations*
23. [**ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving arXiv:2309.17452**Zhibin Gou, Zhihong Shao, Yeyun Gong, et al.*2023 · 225 citations*](https://md.research.elamur.ai/free/en/papers/gou-2023-tora-tool-integrated-reasoning-agent/)
24. **[Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models](https://md.research.elamur.ai/free/en/papers/deitke-2024-molmo-pixmo-open-weights-open/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Matt Deitke, Christopher Clark, Sangho Lee, et al.*2024 · 216 citations*
25. [**LIMO: Less is More for Reasoning arXiv:2502.03387**Yixin Ye, Zhen Huang, Yang Xiao, et al.*2025 · 209 citations*](https://md.research.elamur.ai/free/en/papers/ye-2025-limo-less-more-reasoning/)
26. **[MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.*2024 · 202 citations*
27. [**CodeS: Towards Building Open-source Language Models for Text-to-SQL arXiv:2402.16347**Haoyang Li, Jing Zhang, Hanbing Liu, et al.*2024 · 190 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-codes-towards-building-open-source/)
28. [**InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency arXiv:2508.18265**Weiyun Wang, Zhangwei Gao, Lixin Gu, et al.*2025 · 179 citations*](https://md.research.elamur.ai/free/en/papers/wang-2025-internvl3-5-advancing-open/)
29. [**KernelBench: Can LLMs Write Efficient GPU Kernels? arXiv:2502.10517**Anne Ouyang, Simon Guo, Simran Arora, et al.*2025 · 178 citations*](https://md.research.elamur.ai/free/en/papers/ouyang-2025-kernelbench-llms-write-efficient-gpu/)
30. [**What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning arXiv:2312.15685**Wei Liu, Weihao Zeng, Keqing He, et al.*2023 · 178 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-makes-good-data-alignment-comprehensive/)
31. [**FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving MLSys 2025**Zihao Ye, Lequn Chen, Ruihang Lai, et al.*2025 · 177 citations*](https://md.research.elamur.ai/free/en/papers/ye-2025-flashinfer-efficient-customizable-attention-engine/)
32. [**Generative Representational Instruction Tuning arXiv:2402.09906**Niklas Muennighoff, Hongjin Su, Liang Wang, et al.*2024 · 172 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2024-generative-representational-instruction-tuning/)
33. [**DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models arXiv:2309.14509**Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.*2023 · 162 citations*](https://md.research.elamur.ai/free/en/papers/jacobs-2023-deepspeed-ulysses-system-optimizations-enabling/)
34. **[A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness](https://md.research.elamur.ai/free/en/papers/wang-2024-comprehensive-survey-small-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Fali Wang, Zhiwei Zhang, Xianren Zhang, et al.*2024 · 159 citations*
35. [**MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs arXiv:2402.15627**Ziheng Jiang, Haibin Lin, Yinmin Zhong, et al.*2024 · 157 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2024-megascale-scaling-large-language-model/)
36. [**The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning arXiv:2312.01552**Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, et al.*2023 · 150 citations*](https://md.research.elamur.ai/free/en/papers/lin-2023-unlocking-spell-base-llms-rethinking/)
37. **[Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding](https://md.research.elamur.ai/free/en/papers/zhang-2024-draft-verify-lossless-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Jun Zhang, Jue Wang, Huan Li, et al.*2024 · 148 citations*
38. **[Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding](https://md.research.elamur.ai/free/en/papers/xia-2024-unlocking-efficiency-large-language-model/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Heming Xia, Zhe Yang, Qingxiu Dong, et al.*2024 · 146 citations*
39. [**SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills arXiv 2023**Amey Agrawal, Ashish Panwar, Jayashree Mohan, et al.*2023 · 144 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/)
40. [**LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens arXiv:2402.13753**Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, et al.*2024 · 142 citations*](https://md.research.elamur.ai/free/en/papers/ding-2024-longrope-extending-llm-context/)
41. **[LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism](https://md.research.elamur.ai/free/en/papers/wu-2024-loongserve-efficiently-serving-long-context/) [ACM SIGOPS Symposium on Operating Systems Principles (SOSP)](https://md.research.elamur.ai/free/en/venues/acm-sigops-symposium-on-operating-systems-principles-sosp/)**Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.*2024 · 131 citations*
42. [**Olmo 3 arXiv:2512.13961**Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.*2025 · 130 citations*](https://md.research.elamur.ai/free/en/papers/ettinger-2025-olmo-3/)
43. [**Retrieval meets Long Context Large Language Models arXiv:2310.03025**Peng Xu, Wei Ping, Xianchao Wu, et al.*2023 · 130 citations*](https://md.research.elamur.ai/free/en/papers/xu-2023-retrieval-meets-long-context-large/)
44. **[InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory](https://md.research.elamur.ai/free/en/papers/xiao-2024-infllm-training-free-long-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chaojun Xiao, Pengle Zhang, Xu Han, et al.*2024 · 126 citations*
45. [**Generative Judge for Evaluating Alignment arXiv:2310.05470**Junlong Li, Shichao Sun, Weizhe Yuan, et al.*2023 · 125 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-generative-judge-evaluating-alignment/)
46. **[AlphaMath Almost Zero: Process Supervision without Process](https://md.research.elamur.ai/free/en/papers/chen-2024-alphamath-almost-zero-process-supervision/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Guoxin Chen, Minpeng Liao, Chengxi Li, et al.*2024 · 120 citations*
47. [**Demystifying Long Chain-of-Thought Reasoning in LLMs arXiv:2502.03373**Edward Yeo, Yuxuan Tong, Morry Niu, et al.*2025 · 119 citations*](https://md.research.elamur.ai/free/en/papers/yeo-2025-demystifying-long-chain-thought-reasoning/)
48. [**Llumnix: Dynamic Scheduling for Large Language Model Serving OSDI 2024**Biao Sun, Ziming Huang, Hanyu Zhao, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/sun-2024-llumnix-dynamic-scheduling-large-language/)
49. [**SaulLM-7B: A pioneering Large Language Model for Law arXiv:2403.03883**Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/colombo-2024-saullm-7b-pioneering-large-language/)
50. [**QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks arXiv:2402.04396**Albert Tseng, Jerry Chee, Qingyao Sun, et al.*2024 · 117 citations*](https://md.research.elamur.ai/free/en/papers/tseng-2024-quip-even-better-llm-quantization/)
51. [**Break the Sequential Dependency of LLM Inference Using Lookahead Decoding arXiv:2402.02057**Yichao Fu, Peter Bailis, Ion Stoica, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/fu-2024-break-sequential-dependency-llm-inference/)
52. [**Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities arXiv:2404.17790**Kazuki Fujii, Taishi Nakamura, Mengsay Loem, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/fujii-2024-continual-pre-training-cross-lingual/)
53. [**DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads arXiv:2410.10819**Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2024-duoattention-efficient-long-context-llm/)
54. [**A Survey on Efficient Inference for Large Language Models arXiv:2404.14294**Zixuan Zhou, Xuefei Ning, Ke Hong, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2024-survey-efficient-inference-large-language/)
55. [**ALLaM: Large Language Models for Arabic and English arXiv:2407.15390**M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/bari-2024-allam-large-language-models-arabic/)
56. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/)
57. [**Data Engineering for Scaling Language Models to 128K Context arXiv:2402.10171**Yao Fu, Rameswar Panda, Xinyao Niu, et al.*2024 · 109 citations*](https://md.research.elamur.ai/free/en/papers/fu-2024-data-engineering-scaling-language-models/)
58. [**Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security arXiv:2401.05459**Yuanchun Li, Hao Wen, Weijun Wang, et al.*2024 · 100 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-personal-llm-agents-insights-survey/)
59. [**LongAlign: A Recipe for Long Context Alignment of Large Language Models arXiv:2401.18058**Yushi Bai, Xin Lv, Jiajie Zhang, et al.*2024 · 98 citations*](https://md.research.elamur.ai/free/en/papers/bai-2024-longalign-recipe-long-context/)
60. [**ColPali: Efficient Document Retrieval with Vision Language Models arXiv:2407.01449**Manuel Faysse, Hugues Sibille, Tony Wu, et al.*2024 · 96 citations*](https://md.research.elamur.ai/free/en/papers/faysse-2024-colpali-efficient-document-retrieval-vision/)
61. [**LLM Inference Unveiled: Survey and Roofline Model Insights arXiv 2024**Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.*2024 · 91 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2024-llm-inference-unveiled-survey-roofline/)
62. **[PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference](https://md.research.elamur.ai/free/en/papers/yang-2024-pyramidinfer-pyramid-kv-cache-compression/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Dongjie Yang, Xiaodong Han, Yan Gao, et al.*2024 · 91 citations*
63. [**Skywork: A More Open Bilingual Foundation Model arXiv:2310.19341**Tianwen Wei, Liang Zhao, Lichang Zhang, et al.*2023 · 91 citations*](https://md.research.elamur.ai/free/en/papers/wei-2023-skywork-more-open-bilingual/)
64. [**InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning arXiv:2402.06332**Huaiyuan Ying, Shuo Zhang, Linyang Li, et al.*2024 · 90 citations*](https://md.research.elamur.ai/free/en/papers/ying-2024-internlm-math-open-math-large/)
65. **[How to Train Long-Context Language Models (Effectively)](https://md.research.elamur.ai/free/en/papers/gao-2025-how-train-long-context-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tianyu Gao, Alexander Wettig, Howard Yen, et al.*2025 · 89 citations*
66. [**Liger Kernel: Efficient Triton Kernels for LLM Training arXiv:2410.10989**Pin-Lun Hsu, Yun Dai, Vignesh Kothapalli, et al.*2024 · 87 citations*](https://md.research.elamur.ai/free/en/papers/hsu-2024-liger-kernel-efficient-triton-kernels/)
67. [**REST: Retrieval-Based Speculative Decoding arXiv:2311.08252**Zhenyu He; Zexuan Zhong; Tianle Cai; Jason D. Lee;, Di He*2023 · 87 citations*](https://md.research.elamur.ai/free/en/papers/he-2023-rest-retrieval-based-speculative-decoding/)
68. [**S-LoRA: Serving Thousands of Concurrent LoRA Adapters MLSys 2024**Ying Sheng, Shiyi Cao, Dacheng Li, et al.*2023 · 80 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2023-s-lora-serving-thousands-concurrent/)
69. [**DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference arXiv 2024 (Microsoft DeepSpeed)**Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.*2024 · 78 citations*](https://md.research.elamur.ai/free/en/papers/holmes-2024-deepspeed-fastgen-high-throughput-text/)
70. **[OVM, Outcome-supervised Value Models for Planning in Mathematical Reasoning](https://md.research.elamur.ai/free/en/papers/yu-2023-ovm-outcome-supervised-value-models/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Fei Yu, Anningzhe Gao, Benyou Wang*2023 · 78 citations*
71. [**BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval arXiv:2407.12883**Hongjin Su, Howard Yen, Mengzhou Xia, et al.*2024 · 77 citations*](https://md.research.elamur.ai/free/en/papers/su-2024-bright-realistic-challenging-benchmark-reasoning/)
72. **[Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures](https://md.research.elamur.ai/free/en/papers/zhao-2025-insights-deepseek-v3-scaling/) [Proceedings - International Symposium on Computer Architecture/Proceedings](https://md.research.elamur.ai/free/en/venues/proceedings-international-symposium-on-computer-architecture-proceedings/)**Chenggang Zhao, Chengqi Deng, Chong Ruan, et al.*2025 · 74 citations*
73. **[MANTIS: Interleaved Multi-Image Instruction Tuning](https://md.research.elamur.ai/free/en/papers/jiang-2024-mantis-interleaved-multi-image-instruction/) [Transactions on Machine Learning Research](https://md.research.elamur.ai/free/en/venues/transactions-on-machine-learning-research/)**Dongfu Jiang, Xuan He, Huaye Zeng, et al.*2024 · 74 citations*
74. **[SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration](https://md.research.elamur.ai/free/en/papers/zhang-2024-sageattention-accurate-8-bit-attention/) [International Conference on Learning Representations (ICLR)](https://md.research.elamur.ai/free/en/venues/international-conference-on-learning-representations-iclr/)**Jintao Zhang, Jia Wei, Haofeng Huang, et al.*2024 · 74 citations*
75. [**Long Context Transfer from Language to Vision arXiv:2406.16852**Peiyuan Zhang, Kaichen Zhang, Bo Li, et al.*2024 · 73 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-long-context-transfer-language-vision/)
76. [**Seed-TTS: A Family of High-Quality Versatile Speech Generation Models arXiv:2406.02430**Philip Anastassiou, Jiawei Chen, Jitong Chen, et al.*2024 · 71 citations*](https://md.research.elamur.ai/free/en/papers/anastassiou-2024-seed-tts-family-high/)
77. [**Kevin: Multi-Turn RL for Generating CUDA Kernels arXiv 2025**Carlo Baronio, Pietro Marsella, Ben Pan, et al.*2025 · 69 citations*](https://md.research.elamur.ai/free/en/papers/baronio-2025-kevin-multi-turn-rl-generating/)
78. [**MagicPIG: LSH Sampling for Efficient LLM Generation arXiv:2410.16179**Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.*2024 · 68 citations*](https://md.research.elamur.ai/free/en/papers/chen-2024-magicpig-lsh-sampling-efficient-llm/)
79. [**A Comprehensive Survey on Long Context Language Modeling arXiv:2503.17407**Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.*2025 · 64 citations*](https://md.research.elamur.ai/free/en/papers/liu-2025-comprehensive-survey-long-context-language/)
80. **[MARIO: MAth Reasoning with code Interpreter Output - A Reproducible Pipeline](https://md.research.elamur.ai/free/en/papers/liao-2024-mario-math-reasoning-code-interpreter/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Minpeng Liao, Chengxi Li, Wei Luo, et al.*2024 · 64 citations*
81. [**Tree Search for Language Model Agents arXiv:2407.01476**Jing Yu Koh, Stephen McAleer, Daniel Fried, et al.*2024 · 61 citations*](https://md.research.elamur.ai/free/en/papers/koh-2024-tree-search-language-model-agents/)
82. **[Unifying Multimodal Retrieval via Document Screenshot Embedding](https://md.research.elamur.ai/free/en/papers/ma-2024-unifying-multimodal-retrieval-document-screenshot/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xueguang Ma, Sheng-Chieh Lin, Minghan Li, et al.*2024 · 61 citations*
83. [**XAttention: Block Sparse Attention with Antidiagonal Scoring arXiv:2503.16428**Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.*2025 · 59 citations*](https://md.research.elamur.ai/free/en/papers/xu-2025-xattention-block-sparse-attention-antidiagonal/)
84. [**Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling arXiv:2406.07522**Liliang Ren, Yang Liu, Yadong Lu, et al.*2024 · 59 citations*](https://md.research.elamur.ai/free/en/papers/ren-2024-samba-simple-hybrid-state-space/)
85. [**Flex Attention: A Programming Model for Generating Optimized Attention Kernels arXiv:2412.05496**Juechu Dong, Boyuan Feng, Driss Guessous, et al.*2024 · 55 citations*](https://md.research.elamur.ai/free/en/papers/dong-2024-flex-attention-programming-model-generating/)
86. [**Zoology: Measuring and Improving Recall in Efficient Language Models arXiv:2312.04927**Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re*2023 · 55 citations*](https://md.research.elamur.ai/free/en/papers/arora-2023-zoology-measuring-improving-recall-efficient/)
87. [**Scaling Laws of RoPE-based Extrapolation arXiv:2310.05209**Xiaoran Liu, Hang Yan, Shuo Zhang, et al.*2023 · 54 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-scaling-laws-rope-based/)
88. [**PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training arXiv:2309.10400**Dawei Zhu, Nan Yang, Liang Wang, et al.*2023 · 52 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2023-pose-efficient-context-window/)
89. **[Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketching](https://md.research.elamur.ai/free/en/papers/aytes-2025-sketch-thought-efficient-llm-reasoning/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Simon A. Aytes, Jinheon Baek, Sung Ju Hwang*2025 · 51 citations*
90. [**From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models arXiv:2406.16838**Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.*2024 · 51 citations*](https://md.research.elamur.ai/free/en/papers/welleck-2024-decoding-meta-generation-inference-time/)
91. [**MiniMax-01: Scaling Foundation Models with Lightning Attention arXiv:2501.08313**MiniMax, Aonian Li, Bangwei Gong, et al.*2025 · 50 citations*](https://md.research.elamur.ai/free/en/papers/minimax-2025-minimax-01-scaling-foundation/)
92. [**WebLINX: Real-World Website Navigation with Multi-Turn Dialogue arXiv:2402.05930**Xing Han Lu, Zden\vek Kasner, Siva Reddy*2024 · 50 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-weblinx-real-world-website-navigation/)
93. [**Long Context Compression with Activation Beacon arXiv:2401.03462**Peitian Zhang, Zheng Liu, Shitao Xiao, et al.*2024 · 47 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-long-context-compression-activation-beacon/)
94. [**Stable LM 2 1.6B Technical Report arXiv:2402.17834**Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.*2024 · 46 citations*](https://md.research.elamur.ai/free/en/papers/bellagente-2024-stable-lm-2-1-6b/)
95. **[Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More](https://md.research.elamur.ai/free/en/papers/wen-2025-stop-looking-important-tokens-multimodal/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zichen Wen, Yifeng Gao, Shaobo Wang, et al.*2025 · 44 citations*
96. **[APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay](https://md.research.elamur.ai/free/en/papers/prabhakar-2025-apigen-mt-agentic-pipeline-multi/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Akshara Prabhakar, Zuxin Liu, Ming Zhu, et al.*2025 · 36 citations*
97. **[WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/wei-2025-webagent-r1-training-web-agents/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhepei Wei, Wenlin Yao, Yao Liu, et al.*2025 · 36 citations*
98. [**EuroBERT: Scaling Multilingual Encoders for European Languages arXiv:2503.05500**Nicolas Boizard, Hippolyte Gisserot-Boukhlef, Duarte M. Alves, et al.*2025 · 34 citations*](https://md.research.elamur.ai/free/en/papers/boizard-2025-eurobert-scaling-multilingual-encoders-european/)
99. [**TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer arXiv:2307.14995**Zhen Qin, Dong Li, Weigao Sun, et al.*2023 · 33 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-transnormerllm-faster-better-large/)
100. **[TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text](https://md.research.elamur.ai/free/en/papers/lu-2025-turborag-accelerating-retrieval-augmented-generation/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Songshuo Lu, Hua Wang, Yutian Rong, et al.*2025 · 32 citations*

**1** [2](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/papers/dao-2023-flashattention-2-faster-attention-better/) — FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning