---
title: "Massive Activations in Large Language Models — Sun 2024"
description: "The authors call these \"massive activations.\" They examine many model families, including LLaMA2… 58 references, cited by 81 papers here."
authors: ["Mingjie Sun", "Xinlei Chen", "J. Zico Kolter", "Zhuang Liu"]
year: 2024
venue: "arXiv:2402.17762"
source: "https://arxiv.org/abs/2402.17762"
doi: "10.48550/arxiv.2402.17762"
arxiv: "2402.17762"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sun-2024-massive-activations-large-language-models/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sun-2024-massive-activations-large-language-models/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/5/) / Massive Activations in Large Language Models

# Massive Activations in Large Language Models

**Authors:** [Mingjie Sun](https://md.research.elamur.ai/free/en/authors/mingjie-sun/), [Xinlei Chen](https://md.research.elamur.ai/free/en/authors/xinlei-chen/), [J. Zico Kolter](https://md.research.elamur.ai/free/en/authors/j-zico-kolter/) and [Zhuang Liu](https://md.research.elamur.ai/free/en/authors/zhuang-liu/) · **Year:** 2024 · **Venue:** arXiv:2402.17762 · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2402.17762) · [PDF](https://arxiv.org/pdf/2402.17762) · [DOI 10.48550/arxiv.2402.17762](https://doi.org/10.48550/arxiv.2402.17762) · [arXiv 2402.17762](https://arxiv.org/abs/2402.17762) · [OpenAlex](https://openalex.org/W4392271820)

**Citations:** 7 citations (OpenAlex, 2026-10-14) · [81](https://md.research.elamur.ai/free/en/papers/sun-2024-massive-activations-large-language-models/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper looks at the internal hidden states of LLMs and reports a strange phenomenon. A tiny handful of scalar activations, often fewer than ten among tens of millions, reach magnitudes thousands to tens of thousands of times above the typical value. The authors call these "massive activations." They examine many model families, including LLaMA2, Mixtral-8x7B, Phi-2, MPT and GPT-2, using 100 RedPajama sequences of 4,096 tokens each. For each model they locate the spikes by layer, feature dimension and token position. Intervention experiments show the values are almost constant across inputs and behave like built-in bias terms. Removing them breaks the model, while replacing them with their average leaves it intact. The spikes also pull attention toward their tokens, which explains "attention sinks." Adding explicit key/value bias terms to self-attention removes the need for these spikes. Similar effects appear in Vision Transformers, which gives a new reading of register tokens. The work matters for LLM quantization and compression, and for interpretability.

## Key points
- A working definition: an activation counts as massive if its magnitude exceeds 100 and is roughly 1,000× the median of its hidden state. In LLaMA2-70B such values can surpass 15,000.
- In LLaMA2-7B the spikes sit in feature dimensions 1415 and 2533, on the first token and the first "." or "\n". They appear abruptly at layer 2 and stay nearly constant until about layer 30. LLaMA2-13B uses dims 2100 and 4743 on the starting token only. Mixtral-8x7B uses dims 2070 and 3398.
- In LLaMA2-7B, zeroing just four massive activations causes performance to collapse. Setting them to their mean values causes no harm.
- Training a small GPT-2 with explicit attention key/value biases eliminates massive activations. Scaling this up is left as future work.
- In DINOv2-reg ViTs, fixing register features to their means preserves ImageNet accuracy (ViT-G: 87.0 vs 87.0). This suggests registers act as learned biases.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 598 works · 191,226 citations
- [Robert Bosch (United States)](https://md.research.elamur.ai/free/en/companies/robert-bosch/) — Company, Farmington Hills, United States · 6 works · 4,912 citations
- [Robert Bosch (Taiwan)](https://md.research.elamur.ai/free/en/companies/robert-bosch-taiwan/) — Company, Taipei, Taiwan · 3 works · 3,286 citations
- [Robert Bosch (India)](https://md.research.elamur.ai/free/en/companies/robert-bosch-india/) — Company, Bengaluru, India · 3 works · 3,286 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works

## Cite

Cite as: Mingjie Sun, Xinlei Chen, J. Zico Kolter and Zhuang Liu. 2024. Massive Activations in Large Language Models. arXiv:2402.17762.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{sun2024massive,
  title = {{Massive Activations in Large Language Models}},
  author = {Mingjie Sun, Xinlei Chen, J. Zico Kolter and Zhuang Liu},
  year = {2024},
  doi = {10.48550/arxiv.2402.17762},
  eprint = {2402.17762},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2402.17762}
}
```

- [← previous LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks](https://md.research.elamur.ai/free/en/papers/kambhampati-2024-llms-t-plan-but-help/)
- [next → Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models](https://md.research.elamur.ai/free/en/papers/lu-2024-not-all-experts-are-equal/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/5/)

## References

58 references, 30 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Gou, Phil Blunsom, Ahmet Üstün, and Sara Hooker. Intriguing properties of quantization at scale. In NeurIPS, 2023. [find](https://scholar.google.com/scholar?q=Arash+Ahmadian%2C+Saurabh+Dash%2C+Hongyu+Chen%2C+Bharat+Venkitesh%2C+Stephen+Gou%2C+Phil+Blunsom%2C+Ahmet+%C3%9Cst%C3%BCn%2C+and+Sara+Hooker%2E+Intriguing+properties+of+quantization+at+scale%2E+In+NeurIPS%2C+2023%2E)
2. Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, and et al. [The falcon series of open language models](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/). arXiv preprint arXiv:2311.16867, 2023.
3. Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. arXiv:1607.[06450, 2016](https://md.research.elamur.ai/free/en/papers/ba-2016-layer-normalization/).
4. Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, and Yejin Choi. [Piqa: Reasoning about physical commonsense in natural language](https://md.research.elamur.ai/free/en/papers/bisk-2019-piqa-reasoning-about-physical-commonsense/). arXiv preprint arXiv:1911.11641, 2019.
5. Yelysei Bondarenko, Markus Nagel, and Tijmen Blankevoort. Understanding and overcoming the challenges of efficient transformer quantization. arXiv:2109.12948, 2021. [find](https://scholar.google.com/scholar?q=Yelysei+Bondarenko%2C+Markus+Nagel%2C+and+Tijmen+Blankevoort%2E+Understanding+and+overcoming+the+challenges+of+efficient+transformer+quantization%2E+arXiv%3A2109%2E12948%2C+2021%2E)
6. Yelysei Bondarenko, Markus Nagel, and Tijmen Blankevoort. Quantizable transformers: Removing outliers by helping attention heads do nothing. arXiv preprint arXiv:2306.12929, 2023. — [arXiv:2306.12929](https://arxiv.org/abs/2306.12929) [find](https://scholar.google.com/scholar?q=Yelysei+Bondarenko%2C+Markus+Nagel%2C+and+Tijmen+Blankevoort%2E+Quantizable+transformers%3A+Removing+outliers+by+helping+attention+heads+do+nothing%2E+arXiv+preprint+arXiv%3A2306%2E12929%2C+2023%2E+%E2%80%94+%5BarXiv%3A2306%2E12929%5D)
7. Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). arXiv preprint arXiv:2005.14165, 2020.
8. Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco Tulio Ribeiro, and Yi Zhang. [Sparks of artificial general intelligence: Early experiments with gpt-4](https://md.research.elamur.ai/free/en/papers/bubeck-2023-sparks-artificial-general-intelligence-early/). arXiv preprint ar…
9. Layer normalization. arXiv preprint Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, and Kristina Toutanova. [BoolQ: Exploring the surprising difficulty of natural yes/no questions](https://md.research.elamur.ai/free/en/papers/clark-2019-boolq-exploring-surprising-difficulty-natural/). arXiv preprint arXiv:1905.10044, 2019a.
10. Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D. Manning. What does bert look at? an analysis of bert’s attention. arXiv preprint arXiv:1906.04341, 2019b. [find](https://scholar.google.com/scholar?q=Kevin+Clark%2C+Urvashi+Khandelwal%2C+Omer+Levy%2C+and+Christopher+D%2E+Manning%2E+What+does+bert+look+at%3F+an+analysis+of+bert%E2%80%99s+attention%2E+arXiv+preprint+arXiv%3A1906%2E04341%2C+2019b%2E)
11. Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. [Think you have solved question answering? try arc, the ai2 reasoning challenge](https://md.research.elamur.ai/free/en/papers/clark-2018-think-have-solved-question-answering/). arXiv preprint arXiv:1803.05457, 2018.
12. Timothée Darcet, Maxime Oquab, Julien Mairal, and Piotr Bojanowski. Vision transformers need registers. arXiv:2309.16588, 2023. — [arXiv:2309.16588](https://arxiv.org/abs/2309.16588) [find](https://scholar.google.com/scholar?q=Timoth%C3%A9e+Darcet%2C+Maxime+Oquab%2C+Julien+Mairal%2C+and+Piotr+Bojanowski%2E+Vision+transformers+need+registers%2E+arXiv%3A2309%2E16588%2C+2023%2E+%E2%80%94+%5BarXiv%3A2309%2E16588%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2309%2E16588%29)
13. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. ImageNet: A large-scale hierarchical image database. In CVPR, 2009. [find](https://scholar.google.com/scholar?q=Jia+Deng%2C+Wei+Dong%2C+Richard+Socher%2C+Li%2DJia+Li%2C+Kai+Li%2C+and+Li+Fei%2DFei%2E+ImageNet%3A+A+large%2Dscale+hierarchical+image+database%2E+In+CVPR%2C+2009%2E)
14. Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. LLM.int8(): 8-bit matrix multiplication for transformers at scale. In NeurIPS, 2022. [find](https://scholar.google.com/scholar?q=Tim+Dettmers%2C+Mike+Lewis%2C+Younes+Belkada%2C+and+Luke+Zettlemoyer%2E+LLM%2Eint8%28%29%3A+8%2Dbit+matrix+multiplication+for+transformers+at+scale%2E+In+NeurIPS%2C+2022%2E)
15. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanove. [Bert: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). arXiv preprint arXiv:1810.04805, 2018.
16. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. [An image is worth 16x16 words: Transformers for image recognition at scale](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/). In ICLR, 2021.
17. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, et al. [The llama 3 herd of models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). arXiv preprint arXiv:2407.21783, 2024.
18. Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy. The pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv:2101.00027, 2021. [find](https://scholar.google.com/scholar?q=Leo+Gao%2C+Stella+Biderman%2C+Sid+Black%2C+Laurence+Golding%2C+Travis+Hoppe%2C+Charles+Foster%2C+Jason+Phang%2C+Horace+He%2C+Anish+Thite%2C+Noa+Nabeshima%2C+Shawn+Presser%2C+and+Connor+Leahy%2E+The+pile%3A+An+800gb+dataset+of+)
19. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. [Deep residual learning for image recognition](https://md.research.elamur.ai/free/en/papers/he-2015-deep-residual-learning-image-recognition/). In CVPR, 2016.
20. Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick. [Masked autoencoders are scalable vision learners](https://md.research.elamur.ai/free/en/papers/he-2021-masked-autoencoders-scalable-vision-learners/). arXiv:2111.06377, 2021.
21. Stefan Heimersheim and Alex Turner. Residual stream norms grow exponentially over the forward pass, 2023. URL [https://www.alignmentforum.org/posts/8mizBCm3dyc432nK8/residual-stream-norms-grow-exponentially-over-the-forward](https://www.alignmentforum.org/posts/8mizBCm3dyc432nK8/residual-stream-norms-grow-exponentially-over-the-forward). [↗](https://www.alignmentforum.org/posts/8mizBCm3dyc432nK8/residual-stream-norms-grow-exponentially-over-the-forward)
22. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. [Measuring massive multitask language understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/). In ICLR, 2021.
23. Jerry Yao-Chieh Hu, Pei-Hsuan Chang, Robin Luo, Hong-Yu Chen, Weijian Li, Wei-Po Wang, and Han Liu. Outlier-efficient hopfield layers for large transformer-based models. arXiv preprint arXiv:2404.03828, 2024. — [arXiv:2404.03828](https://arxiv.org/abs/2404.03828) [find](https://scholar.google.com/scholar?q=Jerry+Yao%2DChieh+Hu%2C+Pei%2DHsuan+Chang%2C+Robin+Luo%2C+Hong%2DYu+Chen%2C+Weijian+Li%2C+Wei%2DPo+Wang%2C+and+Han+Liu%2E+Outlier%2Defficient+hopfield+layers+for+large+transformer%2Dbased+models%2E+arXiv+preprint+arXiv%3A2404%2E0382)
24. Mojan Javaheripi, Sébastien Bubeck, and et al. Phi-2: The surprising power of small language models, 2023. URL [https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/](https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/). [↗](https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/)
25. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, et al. Mistral 7b. arXiv preprint arXiv:2310.06825, 2023. [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+et+al%2E+Mistral+7b%2E+arXiv+preprint+arXiv%3A2310%2E06825%2C+2023%2E)
26. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, et al. Mixtral of experts. arXiv preprint arXiv:2401.04088, 2024. [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+et+al%2E+Mixtral+of+experts%2E+arXiv+preprint+arXiv%3A2401%2E04088%2C+2024%2E)
27. Andrej Karpathy. Nanogpt, 2023. URL [https://github.com/karpathy/nanoGPT](https://github.com/karpathy/nanoGPT). [↗](https://github.com/karpathy/nanoGPT)
28. Daniel Martin Katz, Michael James Bommarito, Shang Gao, and Pablo Arredondo. Gpt-4 passes the bar exam. SSRN, 2023. [find](https://scholar.google.com/scholar?q=Daniel+Martin+Katz%2C+Michael+James+Bommarito%2C+Shang+Gao%2C+and+Pablo+Arredondo%2E+Gpt%2D4+passes+the+bar+exam%2E+SSRN%2C+2023%2E)
29. Olga Kovaleva, Alexey Romanov, Anna Rogers, and Anna Rumshisky. [Revealing the dark secrets of bert](https://md.research.elamur.ai/free/en/papers/kovaleva-2019-revealing-dark-secrets-bert/). arXiv preprint arXiv:1908.08593, 2019.
30. Olga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, and Anna Rumshisky. [Bert busters: Outlier dimensions that disrupt transformers](https://md.research.elamur.ai/free/en/papers/kovaleva-2021-bert-busters-outlier-dimensions-that/). In ACL Findings, 2021.
31. Ji Lin, Jiaming Tang, Haotian Tang, Shang Yang, Xingyu Dang, Chuang Gan, and Song Han. Awq: Activation-aware weight quantization for llm compression and acceleration. arXiv preprint arXiv:2306.00978, 2023. [find](https://scholar.google.com/scholar?q=Ji+Lin%2C+Jiaming+Tang%2C+Haotian+Tang%2C+Shang+Yang%2C+Xingyu+Dang%2C+Chuang+Gan%2C+and+Song+Han%2E+Awq%3A+Activation%2Daware+weight+quantization+for+llm+compression+and+acceleration%2E+arXiv+preprint+arXiv%3A2306%2E00978%2C+)
32. Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. [Pointer sentinel mixture models](https://md.research.elamur.ai/free/en/papers/merity-2016-pointer-sentinel-mixture-models/). arXiv preprint arXiv:1609.07843, 2016.
33. Evan Miller. Attention is off by one, 2023. URL [https://www.evanmiller.org/attention-is-off-by-one](https://www.evanmiller.org/attention-is-off-by-one). html. [↗](https://www.evanmiller.org/attention-is-off-by-one)
34. MosaicML. Introducing mpt-7b: A new standard for open-source, commercially usable llms, 2023. URL www.mosaicml.com/blog/mpt-7b. [find](https://scholar.google.com/scholar?q=MosaicML%2E+Introducing+mpt%2D7b%3A+A+new+standard+for+open%2Dsource%2C+commercially+usable+llms%2C+2023%2E+URL+www%2Emosaicml%2Ecom%2Fblog%2Fmpt%2D7b%2E)
35. Mahdi Namazifar, Devamanyu Hazarika, and Dilek Hakkani-Tur. Role of bias terms in dot-product attention. arXiv preprint arXiv:2302.08626, 2023. — [arXiv:2302.08626](https://arxiv.org/abs/2302.08626) [find](https://scholar.google.com/scholar?q=Mahdi+Namazifar%2C+Devamanyu+Hazarika%2C+and+Dilek+Hakkani%2DTur%2E+Role+of+bias+terms+in+dot%2Dproduct+attention%2E+arXiv+preprint+arXiv%3A2302%2E08626%2C+2023%2E+%E2%80%94+%5BarXiv%3A2302%2E08626%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2302%2E08626%29)
36. Catherine Olsson, Nelson Elhage, Neel Nanda, Nicholas Joseph, Nova DasSarma, Tom Henighan, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Scott Johnston, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amode… — [In-context Learning and Induction Heads](https://md.research.elamur.ai/free/en/papers/olsson-2022-context-learning-induction-heads/)
37. OpenAI. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774, 2023.
38. Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, and Marc Szafraniec. [Dinov2: Learning robust visual features without supervision](https://md.research.elamur.ai/free/en/papers/oquab-2023-dinov2-learning-robust-visual-features/). arXiv:2304.07193, 2024.
39. Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, and et al. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). arXiv preprint arXiv:2203.02155, 2022.
40. Ofir Press, Noah A. Smith, and Mike Lewis. Train short, test long: Attention with linear biases enables input length extrapolation. arXiv preprint arXiv:2108.12409, 2021. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Noah+A%2E+Smith%2C+and+Mike+Lewis%2E+Train+short%2C+test+long%3A+Attention+with+linear+biases+enables+input+length+extrapolation%2E+arXiv+preprint+arXiv%3A2108%2E12409%2C+2021%2E)
41. Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. Technical Report, 2019. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeff+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+Language+models+are+unsupervised+multitask+learners%2E+Technical+Report%2C+2019%2E)
42. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, et al. [Learning transferable visual models from natural language supervision](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/). arXiv preprint arXiv:2103.00020, 2021.
43. Jack W Rae, Anna Potapenko, Siddhant M Jayakumar, Chloe Hillier, and Timothy P Lillicrap. [Compressive transformers for long-range sequence modelling](https://md.research.elamur.ai/free/en/papers/rae-2019-compressive-transformers-long-range-sequence/). arXiv preprint, 2019. URL https://arxiv.org/abs/1911.05507. [↗](https://arxiv.org/abs/1911.05507)
44. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. [Exploring the limits of transfer learning with a unified text-to-text transformer](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/). Journal of Machine Learning Research, 2020.
45. Brian S. Robinson, Nathan Drenkow, Colin Conwell, and Michael F. Bonner. A sparse null code emerges in deep neural networks. In NeurIPS UniReps Workshop, 2023. [find](https://scholar.google.com/scholar?q=Brian+S%2E+Robinson%2C+Nathan+Drenkow%2C+Colin+Conwell%2C+and+Michael+F%2E+Bonner%2E+A+sparse+null+code+emerges+in+deep+neural+networks%2E+In+NeurIPS+UniReps+Workshop%2C+2023%2E)
46. Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. Winogrande: An adversarial winograd schema challenge at scale. arXiv preprint arXiv:1907.10641, 2019. [find](https://scholar.google.com/scholar?q=Keisuke+Sakaguchi%2C+Ronan+Le+Bras%2C+Chandra+Bhagavatula%2C+and+Yejin+Choi%2E+Winogrande%3A+An+adversarial+winograd+schema+challenge+at+scale%2E+arXiv+preprint+arXiv%3A1907%2E10641%2C+2019%2E)
47. Jianlin Su, Yu Lu, Shengfeng Pan, Ahmed Murtadha, Bo Wen, and Yunfeng Liu. [Roformer: Enhanced transformer with rotary position embedding](https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/). arXiv preprint arXiv:2104.09864, 2021.
48. William Timkey and Marten van Schijndel. [All bark and no bite: Rogue dimensions in transformer language models obscure representational quality](https://md.research.elamur.ai/free/en/papers/timkey-2021-all-bark-no-bite-rogue/). arXiv:2109.04404, 2021.
49. Together Computer. [Redpajama: an open dataset for training large language models](https://md.research.elamur.ai/free/en/papers/weber-2024-redpajama-open-dataset-training-large/), October 2023. URL [https://github.com/togethercomputer/RedPajama-Data](https://github.com/togethercomputer/RedPajama-Data). [↗](https://github.com/togethercomputer/RedPajama-Data)
50. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, et al. [Llama 2: Open foundation and fine-tuned chat models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-2-open-foundation-fine/). arXiv preprint arXiv:2307.09288, 2023.
51. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In Advances in Neural Information Processing Systems, 2022.
52. Mitchell Wortsman, Peter J. Liu, Lechao Xiao, Katie Everett, and et al. Small-scale proxies for large-scale transformer training instabilities. arXiv preprint arXiv:2309.14322, 2023. [find](https://scholar.google.com/scholar?q=Mitchell+Wortsman%2C+Peter+J%2E+Liu%2C+Lechao+Xiao%2C+Katie+Everett%2C+and+et+al%2E+Small%2Dscale+proxies+for+large%2Dscale+transformer+training+instabilities%2E+arXiv+preprint+arXiv%3A2309%2E14322%2C+2023%2E)
53. Guangxuan Xiao, Ji Lin, Mickael Seznec, Hao Wu, Julien Demouth, and Song Han. Smoothquant: Accurate and efficient post-training quantization for large language models. In ICML, 2023a. [find](https://scholar.google.com/scholar?q=Guangxuan+Xiao%2C+Ji+Lin%2C+Mickael+Seznec%2C+Hao+Wu%2C+Julien+Demouth%2C+and+Song+Han%2E+Smoothquant%3A+Accurate+and+efficient+post%2Dtraining+quantization+for+large+language+models%2E+In+ICML%2C+2023a%2E)
54. Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. Efficient streaming language models with attention sinks. arXiv:2309.17453, 2023b. [find](https://scholar.google.com/scholar?q=Guangxuan+Xiao%2C+Yuandong+Tian%2C+Beidi+Chen%2C+Song+Han%2C+and+Mike+Lewis%2E+Efficient+streaming+language+models+with+attention+sinks%2E+arXiv%3A2309%2E17453%2C+2023b%2E)
55. Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, and Xinyun Chen. [Large language models as optimizers](https://md.research.elamur.ai/free/en/papers/yang-2023-large-language-models-optimizers/). arXiv preprint arXiv:2309.03409, 2023.
56. Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, and et al. [Glm-130b: An open bilingual pre-trained model](https://md.research.elamur.ai/free/en/papers/zeng-2022-glm-130b-open-bilingual-pre/). arXiv preprint arXiv:2210.02414, 2022.
57. Biao Zhang and Rico Sennrich. Root mean square layer normalization. In NeurIPS, 2019. [find](https://scholar.google.com/scholar?q=Biao+Zhang+and+Rico+Sennrich%2E+Root+mean+square+layer+normalization%2E+In+NeurIPS%2C+2019%2E)
58. Jun Zhao, Zhihao Zhang, Yide Ma, Qi Zhang, Tao Gui, Luhui Gao, and Xuanjing Huang. Unveiling a core linguistic region in large language models. arXiv:2310.14928, 2023. — [arXiv:2310.14928](https://arxiv.org/abs/2310.14928) [find](https://scholar.google.com/scholar?q=Jun+Zhao%2C+Zhihao+Zhang%2C+Yide+Ma%2C+Qi+Zhang%2C+Tao+Gui%2C+Luhui+Gao%2C+and+Xuanjing+Huang%2E+Unveiling+a+core+linguistic+region+in+large+language+models%2E+arXiv%3A2310%2E14928%2C+2023%2E+%E2%80%94+%5BarXiv%3A2310%2E14928%5D%28https%3A%2F%2Farx)

*Updated 2 November 2026*