--- title: "Who cites What Language Model — 40 citing papers" description: "40 papers of the Elamur Research library cite «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot…" canonical: "https://research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/cited-by/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/cited-by/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [What Language Model Architecture and Pretraining…](https://md.research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/) / cited by # Who cites «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?» 40 papers of our library cite it (of the 149,439 whose bibliographies we read) · 18 with a page here, the most cited first · [← back to «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?»](https://md.research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/) 1. [**Emergent Abilities of Large Language Models arXiv:2206.07682**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,269 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/) 2. [**Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198**Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.*2022 · 2,246 citations*](https://md.research.elamur.ai/free/en/papers/alayrac-2022-flamingo-visual-language-model-few/) 3. [**Crosslingual Generalization through Multitask Finetuning arXiv:2211.01786**Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.*2022 · 703 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2022-crosslingual-generalization-through-multitask-finetuning/) 4. [**The Flan Collection: Designing Data and Methods for Effective Instruction Tuning arXiv:2301.13688**Shayne Longpre, Le Hou, Tu Vu, et al.*2023 · 607 citations*](https://md.research.elamur.ai/free/en/papers/longpre-2023-flan-collection-designing-data-methods/) 5. [**The Falcon Series of Open Language Models arXiv:2311.16867**Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.*2023 · 443 citations*](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/) 6. [**Large Language Models Struggle to Learn Long-Tail Knowledge arXiv:2211.08411**Nikhil Kandpal, Haikang Deng, Adam Roberts, et al.*2022 · 366 citations*](https://md.research.elamur.ai/free/en/papers/kandpal-2022-large-language-models-struggle-learn/) 7. [**UL2: Unifying Language Learning Paradigms arXiv:2205.05131**Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.*2022 · 347 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-ul2-unifying-language-learning-paradigms/) 8. [**Generative Representational Instruction Tuning arXiv:2402.09906**Niklas Muennighoff, Hongjin Su, Liang Wang, et al.*2024 · 172 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2024-generative-representational-instruction-tuning/) 9. [**Efficient Training of Language Models to Fill in the Middle arXiv:2207.14255**Mohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.*2022 · 144 citations*](https://md.research.elamur.ai/free/en/papers/bavarian-2022-efficient-training-language-models-fill/) 10. [**Scaling Up Models and Data with t5x and seqio arXiv:2203.17189**Adam Roberts, Hyung Won Chung, Anselm Levskaya, et al.*2022 · 130 citations*](https://md.research.elamur.ai/free/en/papers/roberts-2022-scaling-up-models-data-texttt/) 11. [**A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity arXiv:2305.13169**Shayne Longpre, Gregory Yauney, Emily Reif, et al.*2023 · 104 citations*](https://md.research.elamur.ai/free/en/papers/longpre-2023-pretrainer-s-guide-training-data/) 12. [**FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets arXiv:2307.10928**Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.*2023 · 100 citations*](https://md.research.elamur.ai/free/en/papers/ye-2023-flask-fine-grained-language-model/) 13. [**Benchmark Data Contamination of Large Language Models: A Survey arXiv:2406.04244**Cheng Xu, Shuhao Guan, Derek Greene, et al.*2024 · 85 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-benchmark-data-contamination-large/) 14. [**AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model arXiv:2208.01448**Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.*2022 · 84 citations*](https://md.research.elamur.ai/free/en/papers/soltan-2022-alexatm-20b-few-shot-learning/) 15. [**What Language Model to Train if You Have One Million GPU Hours? arXiv:2210.15424**Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.*2022 · 73 citations*](https://md.research.elamur.ai/free/en/papers/scao-2022-language-model-train-if-have/) 16. [**Transcending Scaling Laws with 0.1% Extra Compute arXiv:2210.11399**Yi Tay, Jason Wei, Hyung Won Chung, et al.*2022 · 42 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-transcending-scaling-laws-0-1/) 17. **[TADA : Task Agnostic Dialect Adapters for English](https://md.research.elamur.ai/free/en/papers/held-2023-tada-task-agnostic-dialect-adapters/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**William Held, Caleb Ziems, Diyi Yang*2023 · 17 citations* 18. [**Just read twice: closing the recall gap for recurrent language models arXiv:2407.05483**Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re*2024 · 8 citations*](https://md.research.elamur.ai/free/en/papers/arora-2024-just-read-twice-closing-recall/) 22 more papers of our library cite it; they have no page here yet. - [← back to](https://md.research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/) — What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?