---
title: "Who cites Albert Gu — 783 papers of our library"
description: "783 papers of the Elamur Research library cite the works of Albert Gu, found in their bibliographies · page 1 of 2 · 1–100; the most cited first."
canonical: "https://research.elamur.ai/free/en/authors/albert-gu/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/albert-gu/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Albert Gu](https://md.research.elamur.ai/free/en/authors/albert-gu/) / cited by

# Who cites Albert Gu

1,191 citations of their works from 783 papers of our library (of the 149,439 whose bibliographies we read) · 117 with a page here, the most cited first · page 1 of 2 · 1–100 · [← Albert Gu](https://md.research.elamur.ai/free/en/authors/albert-gu/)

**1** [2](https://md.research.elamur.ai/free/en/authors/albert-gu/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/authors/albert-gu/cited-by/page/2/)

1. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
2. **[Lost in the Middle: How Language Models Use Long Contexts](https://md.research.elamur.ai/free/en/papers/liu-2023-lost-middle-language-models-use/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Nelson F. Liu, Kevin Lin, John Hewitt, et al.*2023 · 2,584 citations*
3. [**Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530**Gemini Team, Petko Georgiev, Ving Ian Lei, et al.*2024 · 1,589 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2024-gemini-1-5-unlocking-multimodal/)
4. **[Efficient Transformers: A Survey](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Yi Tay, Mostafa Dehghani, Dara Bahri, et al.*2020 · 1,539 citations*
5. [**LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding arXiv:2308.14508**Yushi Bai, Xin Lv, Jiajie Zhang, et al.*2023 · 514 citations*](https://md.research.elamur.ai/free/en/papers/bai-2023-longbench-bilingual-multitask-benchmark/)
6. [**Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model arXiv:2401.09417**Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.*2024 · 500 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2024-vision-mamba-efficient-visual-representation/)
7. **[FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision](https://md.research.elamur.ai/free/en/papers/shah-2024-flashattention-3-fast-accurate-attention/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.*2024 · 400 citations*
8. [**RULER: What's the Real Context Size of Your Long-Context Language Models? arXiv:2404.06654**Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.*2024 · 400 citations*](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/)
9. **[xLSTM: Extended Long Short-Term Memory](https://md.research.elamur.ai/free/en/papers/beck-2024-xlstm-extended-long-short-term/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.*2024 · 296 citations*
10. [**A Review of Large Language Models and Autonomous Agents in Chemistry arXiv:2407.01603**Mayk Caldas Ramos, Christopher J. Collison, Andrew D. White*2024 · 288 citations*](https://md.research.elamur.ai/free/en/papers/ramos-2024-review-large-language-models-autonomous/)
11. [**Retentive Network: A Successor to Transformer for Large Language Models arXiv:2307.08621**Yutao Sun, Li Dong, Shaohan Huang, et al.*2023 · 265 citations*](https://md.research.elamur.ai/free/en/papers/sun-2023-retentive-network-successor-transformer-large/)
12. [**Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey arXiv:2403.14608**Zeyu Han, Chao Gao, Jinyang Liu, et al.*2024 · 240 citations*](https://md.research.elamur.ai/free/en/papers/han-2024-parameter-efficient-fine-tuning-large/)
13. [**EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty arXiv:2401.15077**Yuhui Li, Fangyun Wei, Chao Zhang, et al.*2024 · 208 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-eagle-speculative-sampling-requires-rethinking/)
14. **[MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.*2024 · 202 citations*
15. **[DataComp-LM: In search of the next generation of training sets for language models](https://md.research.elamur.ai/free/en/papers/li-2024-datacomp-lm-search-next-generation/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.*2024 · 191 citations*
16. [**ShortGPT: Layers in Large Language Models are More Redundant Than You Expect arXiv:2403.03853**Xin Men, Mingyu Xu, Qingyu Zhang, et al.*2024 · 169 citations*](https://md.research.elamur.ai/free/en/papers/men-2024-shortgpt-layers-large-language-models/)
17. [**Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving FAST 2025**Ruoyu Qin, Zheming Li, Weiran He, et al.*2024 · 161 citations*](https://md.research.elamur.ai/free/en/papers/qin-2024-mooncake-kvcache-centric-disaggregated-architecture/)
18. **[A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness](https://md.research.elamur.ai/free/en/papers/wang-2024-comprehensive-survey-small-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Fali Wang, Zhiwei Zhang, Xianren Zhang, et al.*2024 · 159 citations*
19. [**Jamba: A Hybrid Transformer-Mamba Language Model arXiv:2403.19887**Opher Lieber, Barak Lenz, Hofit Bata, et al.*2024 · 159 citations*](https://md.research.elamur.ai/free/en/papers/lieber-2024-jamba-hybrid-transformer-mamba-language/)
20. [**Atom: Low-bit Quantization for Efficient and Accurate LLM Serving MLSys 2024**Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.*2023 · 156 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-atom-low-bit-quantization-efficient/)
21. **[Simple and Effective Masked Diffusion Language Models](https://md.research.elamur.ai/free/en/papers/sahoo-2024-simple-effective-masked-diffusion-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.*2024 · 152 citations*
22. **[Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion](https://md.research.elamur.ai/free/en/papers/huang-2025-self-forcing-bridging-train-test/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Xun Huang, Zhengqi Li, Guande He, et al.*2025 · 146 citations*
23. **[Efficient Methods for Natural Language Processing: A Survey](https://md.research.elamur.ai/free/en/papers/treviso-2023-efficient-methods-natural-language-processing/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.*2023 · 145 citations*
24. [**Long-context LLMs Struggle with Long In-context Learning arXiv:2404.02060**Tianle Li, Ge Zhang, Quy Duc Do, et al.*2024 · 138 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-long-context-llms-struggle-long/)
25. **[InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory](https://md.research.elamur.ai/free/en/papers/xiao-2024-infllm-training-free-long-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chaojun Xiao, Pengle Zhang, Xu Han, et al.*2024 · 126 citations*
26. [**LongNet: Scaling Transformers to 1,000,000,000 Tokens arXiv:2307.02486**Jiayu Ding, Shuming Ma, Li Dong, et al.*2023 · 123 citations*](https://md.research.elamur.ai/free/en/papers/ding-2023-longnet-scaling-transformers-1-000/)
27. [**SaulLM-7B: A pioneering Large Language Model for Law arXiv:2403.03883**Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/colombo-2024-saullm-7b-pioneering-large-language/)
28. [**Resurrecting Recurrent Neural Networks for Long Sequences arXiv:2303.06349**Antonio Orvieto, Samuel L Smith, Albert Gu, et al.*2023 · 118 citations*](https://md.research.elamur.ai/free/en/papers/orvieto-2023-resurrecting-recurrent-neural-networks-long/)
29. [**DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads arXiv:2410.10819**Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2024-duoattention-efficient-long-context-llm/)
30. [**A Survey on Efficient Inference for Large Language Models arXiv:2404.14294**Zixuan Zhou, Xuefei Ning, Ke Hong, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2024-survey-efficient-inference-large-language/)
31. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/)
32. **[Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems](https://md.research.elamur.ai/free/en/papers/miao-2023-towards-efficient-generative-large-language/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.*2023 · 110 citations*
33. [**Data Engineering for Scaling Language Models to 128K Context arXiv:2402.10171**Yao Fu, Rameswar Panda, Xinyao Niu, et al.*2024 · 109 citations*](https://md.research.elamur.ai/free/en/papers/fu-2024-data-engineering-scaling-language-models/)
34. **[Make Your LLM Fully Utilize the Context](https://md.research.elamur.ai/free/en/papers/an-2024-make-llm-fully-utilize-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shengnan An, Zexiong Ma, Zeqi Lin, et al.*2024 · 97 citations*
35. [**Retrieval Head Mechanistically Explains Long-Context Factuality arXiv:2404.15574**Wenhao Wu, Yizhong Wang, Guangxuan Xiao, et al.*2024 · 94 citations*](https://md.research.elamur.ai/free/en/papers/wu-2024-retrieval-head-mechanistically-explains-long/)
36. **[Efficient Long-Text Understanding with Short-Text Models](https://md.research.elamur.ai/free/en/papers/ivgi-2023-efficient-long-text-understanding-short/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Maor Ivgi, Uri Shaham, Jonathan Berant*2023 · 94 citations*
37. **[How to Train Long-Context Language Models (Effectively)](https://md.research.elamur.ai/free/en/papers/gao-2025-how-train-long-context-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Tianyu Gao, Alexander Wettig, Howard Yen, et al.*2025 · 89 citations*
38. **[BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack](https://md.research.elamur.ai/free/en/papers/kuratov-2024-babilong-testing-limits-llms-long/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yuri Kuratov, Aydar Bulatov, Petr Anokhin, et al.*2024 · 88 citations*
39. [**Small Language Models: Survey, Measurements, and Insights arXiv:2409.15790**Zhenyan Lu, Xiang Li, Dongqi Cai, et al.*2024 · 88 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-small-language-models-survey-measurements/)
40. [**Benchmark Data Contamination of Large Language Models: A Survey arXiv:2406.04244**Cheng Xu, Shuhao Guan, Derek Greene, et al.*2024 · 85 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-benchmark-data-contamination-large/)
41. **[MoBA: Mixture of Block Attention for Long-Context LLMs](https://md.research.elamur.ai/free/en/papers/lu-2025-moba-mixture-block-attention/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.*2025 · 80 citations*
42. [**A Primer on the Inner Workings of Transformer-based Language Models arXiv:2405.00208**Javier Ferrando, Gabriele Sarti, Arianna Bisazza, et al.*2024 · 72 citations*](https://md.research.elamur.ai/free/en/papers/ferrando-2024-primer-inner-workings-transformer-based/)
43. **[(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts](https://md.research.elamur.ai/free/en/papers/wu-2025-perhaps-beyond-human-translation-harnessing/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Minghao Wu, Jiahao Xu, Yulin Yuan, et al.*2025 · 71 citations*
44. **[Recent Advances in Speech Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/cui-2025-recent-advances-speech-language-models/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, et al.*2025 · 69 citations*
45. [**An Empirical Study of Mamba-based Language Models arXiv:2406.07887**Roger Waleffe, Wonmin Byeon, Duncan Riach, et al.*2024 · 67 citations*](https://md.research.elamur.ai/free/en/papers/waleffe-2024-empirical-study-mamba-based-language/)
46. [**MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention arXiv:2506.13585**MiniMax, Aili Chen, Aonian Li, et al.*2025 · 66 citations*](https://md.research.elamur.ai/free/en/papers/minimax-2025-minimax-m1-scaling-test/)
47. [**A Comprehensive Survey on Long Context Language Modeling arXiv:2503.17407**Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.*2025 · 64 citations*](https://md.research.elamur.ai/free/en/papers/liu-2025-comprehensive-survey-long-context-language/)
48. [**Layer by Layer: Uncovering Hidden Representations in Language Models arXiv:2502.02013**Oscar Skean, Md Rifat Arefin, Dan Zhao, et al.*2025 · 64 citations*](https://md.research.elamur.ai/free/en/papers/skean-2025-layer-layer-uncovering-hidden-representations/)
49. [**Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models arXiv:2402.02244**Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.*2024 · 60 citations*](https://md.research.elamur.ai/free/en/papers/wang-2024-limits-survey-techniques-extend-context/)
50. **[BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language Models](https://md.research.elamur.ai/free/en/papers/dong-2024-bamboo-comprehensive-benchmark-evaluating-long/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Zican Dong, Tianyi Tang, Junyi Li, et al.*2024 · 59 citations*
51. [**Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling arXiv:2406.07522**Liliang Ren, Yang Liu, Yadong Lu, et al.*2024 · 59 citations*](https://md.research.elamur.ai/free/en/papers/ren-2024-samba-simple-hybrid-state-space/)
52. [**Simple linear attention language models balance the recall-throughput tradeoff arXiv:2402.18668**Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.*2024 · 59 citations*](https://md.research.elamur.ai/free/en/papers/arora-2024-simple-linear-attention-language-models/)
53. [**A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond arXiv:2503.21614**Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.*2025 · 55 citations*](https://md.research.elamur.ai/free/en/papers/qu-2025-survey-efficient-reasoning-large-reasoning/)
54. [**Zoology: Measuring and Improving Recall in Efficient Language Models arXiv:2312.04927**Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re*2023 · 55 citations*](https://md.research.elamur.ai/free/en/papers/arora-2023-zoology-measuring-improving-recall-efficient/)
55. [**Kimi Linear: An Expressive, Efficient Attention Architecture arXiv:2510.26692**Kimi Team, Yu Zhang, Zongyu Lin, et al.*2025 · 51 citations*](https://md.research.elamur.ai/free/en/papers/kimi-team-2025-kimi-linear-expressive-efficient/)
56. [**From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models arXiv:2406.16838**Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.*2024 · 51 citations*](https://md.research.elamur.ai/free/en/papers/welleck-2024-decoding-meta-generation-inference-time/)
57. [**MiniMax-01: Scaling Foundation Models with Lightning Attention arXiv:2501.08313**MiniMax, Aonian Li, Bangwei Gong, et al.*2025 · 50 citations*](https://md.research.elamur.ai/free/en/papers/minimax-2025-minimax-01-scaling-foundation/)
58. [**Hymba: A Hybrid-head Architecture for Small Language Models arXiv:2411.13676**Xin Dong, Yonggan Fu, Shizhe Diao, et al.*2024 · 50 citations*](https://md.research.elamur.ai/free/en/papers/dong-2024-hymba-hybrid-head-architecture-small/)
59. [**Language models scale reliably with over-training and on downstream tasks arXiv:2403.08540**Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.*2024 · 46 citations*](https://md.research.elamur.ai/free/en/papers/gadre-2024-language-models-scale-reliably-over/)
60. **[Long-Context Language Modeling with Parallel Context Encoding](https://md.research.elamur.ai/free/en/papers/yen-2024-long-context-language-modeling-parallel/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Howard Yen, Tianyu Gao, Danqi Chen*2024 · 44 citations*
61. [**NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model arXiv:2508.14444**NVIDIA: Aarti Basant, Abhijit Khairnar, Abhijit Paithankar, et al.*2025 · 39 citations*](https://md.research.elamur.ai/free/en/papers/basant-2025-nvidia-nemotron-nano-2-accurate/)
62. [**Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models arXiv:2504.03624**NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.*2025 · 38 citations*](https://md.research.elamur.ai/free/en/papers/blakeman-2025-nemotron-h-family-accurate-efficient/)
63. [**Efficient Reasoning Models: A Survey arXiv:2504.10903**Sicheng Feng, Gongfan Fang, Xinyin Ma, et al.*2025 · 37 citations*](https://md.research.elamur.ai/free/en/papers/feng-2025-efficient-reasoning-models-survey/)
64. [**MambaByte: Token-free Selective State Space Model arXiv:2401.13660**Junxiong Wang, Tushaar Gangavarapu, Jing Nathan Yan, et al.*2024 · 35 citations*](https://md.research.elamur.ai/free/en/papers/wang-2024-mambabyte-token-free-selective-state/)
65. [**TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer arXiv:2307.14995**Zhen Qin, Dong Li, Weigao Sun, et al.*2023 · 33 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-transnormerllm-faster-better-large/)
66. **[The Hidden Attention of Mamba Models](https://md.research.elamur.ai/free/en/papers/ali-2025-hidden-attention-mamba-models/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ameen Ali Ali, Itamar Zimerman, Lior Wolf*2025 · 32 citations*
67. [**A Survey of Small Language Models arXiv:2410.20011**Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.*2024 · 31 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2024-survey-small-language-models/)
68. **[Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations](https://md.research.elamur.ai/free/en/papers/hagele-2024-scaling-laws-compute-optimal-training/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Alexander Hägele, Elie Bakouch, Atli Kosson, et al.*2024 · 31 citations*
69. [**Jamba-1.5: Hybrid Transformer-Mamba Models at Scale arXiv:2408.12570**Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.*2024 · 30 citations*](https://md.research.elamur.ai/free/en/papers/lenz-2024-jamba-1-5-hybrid-transformer/)
70. **[Towards the Law of Capacity Gap in Distilling Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2025-law-capacity-gap-distilling-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Chen Zhang, Qiuchi Li, Dawei Song, et al.*2025 · 27 citations*
71. [**Baichuan-M1: Pushing the Medical Capability of Large Language Models arXiv:2502.12671**Bingning Wang, Haizhou Zhao, Huozhi Zhou, et al.*2025 · 24 citations*](https://md.research.elamur.ai/free/en/papers/wang-2025-baichuan-m1-pushing-medical/)
72. [**RWKV-7 "Goose" with Expressive Dynamic State Evolution arXiv:2503.14456**Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.*2025 · 23 citations*](https://md.research.elamur.ai/free/en/papers/peng-2025-rwkv-7-goose-expressive-dynamic/)
73. **[LongReward: Improving Long-context Large Language Models with AI Feedback](https://md.research.elamur.ai/free/en/papers/zhang-2025-longreward-improving-long-context-large/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Jiajie Zhang, Zhongni Hou, Xin Lv, et al.*2025 · 21 citations*
74. [**Block-State Transformers arXiv:2306.09539**Mahan Fathi, Jonathan Pilault, Orhan Firat, et al.*2023 · 20 citations*](https://md.research.elamur.ai/free/en/papers/fathi-2023-block-state-transformers/)
75. [**Locating and Editing Factual Associations in Mamba arXiv:2404.03646**Arnab Sen Sharma, David Atkinson, David Bau*2024 · 18 citations*](https://md.research.elamur.ai/free/en/papers/sharma-2024-locating-editing-factual-associations-mamba/)
76. [**Linearizing Large Language Models arXiv:2405.06640**Jean Mercat, Igor Vasiljevic, Sedrick Keh, et al.*2024 · 16 citations*](https://md.research.elamur.ai/free/en/papers/mercat-2024-linearizing-large-language-models/)
77. [**A Survey on Latent Reasoning arXiv:2507.06203**Rui-Jie Zhu, Tianhao Peng, Tianhao Cheng, et al.*2025 · 15 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2025-survey-latent-reasoning/)
78. [**Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance arXiv:2507.22448**Jingwei Zuo, Maksim Velikanov, Ilyas Chahed, et al.*2025 · 15 citations*](https://md.research.elamur.ai/free/en/papers/zuo-2025-falcon-h1-family-hybrid-head/)
79. **[Semantic-Aware Logical Reasoning via a Semiotic Framework](https://md.research.elamur.ai/free/en/papers/zhang-2026-semantic-aware-logical-reasoning-semiotic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yunyao Zhang, Xinglang Zhang, Junxi Sheng, et al.*2026 · 13 citations*
80. [**When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoning arXiv:2504.01005**Nishad Singhi, Hritik Bansal, Arian Hosseini, et al.*2025 · 12 citations*](https://md.research.elamur.ai/free/en/papers/singhi-2025-solve-verify-compute-optimal-problem/)
81. [**Base of RoPE Bounds Context Length arXiv:2405.14591**Xin Men, Mingyu Xu, Bingning Wang, et al.*2024 · 12 citations*](https://md.research.elamur.ai/free/en/papers/men-2024-base-rope-bounds-context/)
82. [**Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretraining arXiv:2412.15285**Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.*2024 · 12 citations*](https://md.research.elamur.ai/free/en/papers/feng-2024-maximize-data-s-potential-enhancing/)
83. [**MiniPLM: Knowledge Distillation for Pre-Training Language Models arXiv:2410.17215**Yuxian Gu, Hao Zhou, Fandong Meng, et al.*2024 · 12 citations*](https://md.research.elamur.ai/free/en/papers/gu-2024-miniplm-knowledge-distillation-pre-training/)
84. [**Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thought arXiv:2505.15431**Tencent Hunyuan Team, Ao Liu, Botong Zhou, et al.*2025 · 10 citations*](https://md.research.elamur.ai/free/en/papers/team-2025-hunyuan-hunyuan-turbos-advancing-large/)
85. [**Associative Recurrent Memory Transformer arXiv:2407.04841**Ivan Rodkin, Yuri Kuratov, Aydar Bulatov, et al.*2024 · 8 citations*](https://md.research.elamur.ai/free/en/papers/rodkin-2024-associative-recurrent-memory-transformer/)
86. [**Just read twice: closing the recall gap for recurrent language models arXiv:2407.05483**Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re*2024 · 8 citations*](https://md.research.elamur.ai/free/en/papers/arora-2024-just-read-twice-closing-recall/)
87. **[The Quest for the Right Mediator: Surveying Mechanistic Interpretability for NLP Through the Lens of Causal Mediation Analysis](https://md.research.elamur.ai/free/en/papers/mueller-2026-quest-right-mediator-surveying-mechanistic/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Aaron Mueller, Jannik Brinkmann, Millicent Li, et al.*2026 · 7 citations*
88. [**MoM: Linear Sequence Modeling with Mixture-of-Memories arXiv:2502.13685**Jusen Du, Weigao Sun, Disen Lan, et al.*2025 · 7 citations*](https://md.research.elamur.ai/free/en/papers/du-2025-mom-linear-sequence-modeling-mixture/)
89. **[Detecting Training Data of Large Language Models via Expectation Maximization](https://md.research.elamur.ai/free/en/papers/kim-2026-detecting-training-data-large-language/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Gyuwan Kim, Yang Li, Evangelia Spiliopoulou, et al.*2026 · 5 citations*
90. **[Barriers to Discrete Reasoning with Transformers: A Survey Across Depth, Exactness, and Bandwidth](https://md.research.elamur.ai/free/en/papers/yuan-2026-barriers-discrete-reasoning-transformers-survey/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Michelle Yuan, Weiyi Sun, Amir H. Rezaeian, et al.*2026 · 3 citations*
91. **[MISSION at KSAA-CAD 2024: AraT5 with Arabic Reverse Dictionary](https://md.research.elamur.ai/free/en/papers/alharbi-2024-mission-ksaa-cad-2024-arat5/) [Arabic Natural Language Processing Conference (ArabicNLP)](https://md.research.elamur.ai/free/en/venues/arabicnlp/)**Thamer Alharbi*2024 · 3 citations*
92. **[Lizard: An Efficient Linearization Framework for Large Language Models](https://md.research.elamur.ai/free/en/papers/nguyen-2026-lizard-efficient-linearization-framework-large/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, et al.*2026 · 2 citations*
93. **[LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model](https://md.research.elamur.ai/free/en/papers/shao-2026-lopt-lossless-parallel-tokenization-acceleration/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Wei Shao, Zheng Lingchao, Pengyu Wang, et al.*2026 · 2 citations*
94. [**MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling arXiv:2602.11761**MiniCPM Team, Wenhao An, Yingfa Chen, et al.*2026 · 2 citations*](https://md.research.elamur.ai/free/en/papers/minicpm-team-2026-minicpm-sala-hybridizing-sparse/)
95. [**MiniMax Sparse Attention arXiv:2606.13392**Xunhao Lai, Weiqi Xu, Yufeng Yang, et al.*2026 · 2 citations*](https://md.research.elamur.ai/free/en/papers/lai-2026-minimax-sparse-attention/)
96. **[DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning](https://md.research.elamur.ai/free/en/papers/zarch-2026-delta-dynamic-layer-aware-token/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Hossein Entezari Zarch, Lei Gao, Chaoyi Jiang, et al.*2026 · 1 citation*
97. **[StateX: Enhancing RNN Recall via Post-training State Expansion](https://md.research.elamur.ai/free/en/papers/shen-2026-statex-enhancing-rnn-recall-post/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Xingyu Shen, Yingfa Chen, Zhen Leng Thai, et al.*2026 · 1 citation*
98. **[VARH-AI at SemEval-2026 Task 10: Exploiting Architectural Diversity with Transformer-SSM Ensembles and Confidence-Based Iterative Refinement for Conspiracy Detection](https://md.research.elamur.ai/free/en/papers/solanki-2026-varh-ai-semeval-2026-task/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Hritav Solanki, Shubham Sharma, Manish Prasad, et al.*2026 · 1 citation*
99. **[A Survey of Retentive Network](https://md.research.elamur.ai/free/en/papers/yang-2026-survey-retentive-network/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Haiqi Yang, Zhiyuan Li, Yi Chang, et al.*2026*
100. [**AraSSM: A bidirectional state-space encoder for Arabic masked language modeling arXiv:2608.08256**Ahmed Amine Aliane, Hassina Aliane, Nasredine Semmar*2026*](https://md.research.elamur.ai/free/en/papers/aliane-2026-arassm-bidirectional-state-space-encoder/)

**1** [2](https://md.research.elamur.ai/free/en/authors/albert-gu/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/authors/albert-gu/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/authors/albert-gu/) — Albert Gu