---
title: "Language models & pretraining — papers, page 6"
description: "Language models & pretraining: 1,079 papers of the Elamur Research library · page 6 of 12 · 426–525, the most cited first."
canonical: "https://research.elamur.ai/free/en/topics/language-models/page/6/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/topics/language-models/page/6/)

[home](https://md.research.elamur.ai/free/en/) / [topics](https://md.research.elamur.ai/free/en/topics/) / [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) / page 6

# 🧠 Language models & pretraining

1,079 papers · page 6 of 12 · 426–525 · the most cited first · [all topics](https://md.research.elamur.ai/free/en/topics/)

Models that learn a language from raw text, and how they are pretrained, tuned and prompted.

[← prev](https://md.research.elamur.ai/free/en/topics/language-models/page/5/) [1](https://md.research.elamur.ai/free/en/topics/language-models/) … [5](https://md.research.elamur.ai/free/en/topics/language-models/page/5/) **6** [7](https://md.research.elamur.ai/free/en/topics/language-models/page/7/) … [12](https://md.research.elamur.ai/free/en/topics/language-models/page/12/) [next →](https://md.research.elamur.ai/free/en/topics/language-models/page/7/)

426. [**Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models**Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.*2020 · 216 citations*](https://md.research.elamur.ai/free/en/papers/lin-2020-birds-have-four-legs-numersense/)
427. [**Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning**Beliz Gunel, Jingfei Du, Alexis Conneau, et al.*2020 · 216 citations*](https://md.research.elamur.ai/free/en/papers/gunel-2020-supervised-contrastive-learning-pre-trained/)
428. [**Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models**Robert Logan IV, Ivana Balazevic, Eric Wallace, et al.*2022 · 215 citations*](https://md.research.elamur.ai/free/en/papers/iv-2022-cutting-down-prompts-parameters-simple/)
429. [**Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations**Jaehun Jung, Lianhui Qin, Sean Welleck, et al.*2022 · 213 citations*](https://md.research.elamur.ai/free/en/papers/jung-2022-maieutic-prompting-logically-consistent-reasoning/)
430. [**N-gram Counts and Language Models from the Common Crawl**Christian Buck, Kenneth Heafield, Bas van Ooyen*2014 · 213 citations*](https://md.research.elamur.ai/free/en/papers/buck-2014-n-gram-counts-language-models/)
431. [**Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models**Mosh Levy, Alon Jacoby, Yoav Goldberg*2024 · 212 citations*](https://md.research.elamur.ai/free/en/papers/levy-2024-same-task-more-tokens-impact/)
432. [**Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4**Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, et al.*2023 · 212 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-evaluating-logical-reasoning-ability-chatgpt/)
433. [**Fine-Grained Human Feedback Gives Better Rewards for Language Model Training**Zeqiu Wu, Yushi Hu, Weijia Shi, et al.*2023 · 212 citations*](https://md.research.elamur.ai/free/en/papers/wu-2023-fine-grained-human-feedback-gives/)
434. [**Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?**Byung-Doh Oh, William Schuler*2023 · 211 citations*](https://md.research.elamur.ai/free/en/papers/oh-2023-why-does-surprisal-larger-transformer/)
435. [**An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models**Nicholas Meade, Elinor Poole-Dayan, Siva Reddy*2022 · 211 citations*](https://md.research.elamur.ai/free/en/papers/meade-2022-empirical-survey-effectiveness-debiasing-techniques/)
436. [**Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP**Omar Khattab, Keshav Santhanam, Xiang Lisa Li, et al.*2022 · 211 citations*](https://md.research.elamur.ai/free/en/papers/khattab-2022-demonstrate-search-predict-composing-retrieval/)
437. [**Teaching language models to support answers with verified quotes**Jacob Menick, Maja Trebacz, Vladimir Mikulik, et al.*2022 · 211 citations*](https://md.research.elamur.ai/free/en/papers/menick-2022-teaching-language-models-support-answers/)
438. [**Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!**Yubo Ma, Yixin Cao, Yong Hong, et al.*2023 · 210 citations*](https://md.research.elamur.ai/free/en/papers/ma-2023-large-language-model-is-not/)
439. [**LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders**Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, et al.*2024 · 209 citations*](https://md.research.elamur.ai/free/en/papers/behnamghader-2024-llm2vec-large-language-models-secretly/)
440. [**Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch**Le Yu, Bowen Yu, Haiyang Yu, et al.*2023 · 209 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-language-models-super-mario-absorbing/)
441. [**OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models**Anas Awadalla, Irena Gao, Josh Gardner, et al.*2023 · 209 citations*](https://md.research.elamur.ai/free/en/papers/awadalla-2023-openflamingo-open-source-framework-training/)
442. [**Reinforced Self-Training (ReST) for Language Modeling**Caglar Gulcehre, Tom Le Paine, Srivatsan Srinivasan, et al.*2023 · 209 citations*](https://md.research.elamur.ai/free/en/papers/gulcehre-2023-reinforced-self-training-rest-language/)
443. [**PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change**Karthik Valmeekam, Matthew Marquez, Alberto Olmo, et al.*2022 · 209 citations*](https://md.research.elamur.ai/free/en/papers/valmeekam-2022-planbench-extensible-benchmark-evaluating-large/)
444. [**Compressing Context to Enhance Inference Efficiency of Large Language Models**Yucheng Li, Bo Dong, Frank Guerin, et al.*2023 · 208 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-compressing-context-enhance-inference-efficiency/)
445. [**Sources of Hallucination by Large Language Models on Inference Tasks**Nick McKenna, Tianyi Li, Liang Cheng, et al.*2023 · 208 citations*](https://md.research.elamur.ai/free/en/papers/mckenna-2023-sources-hallucination-large-language-models/)
446. [**Active Example Selection for In-Context Learning**Yiming Zhang, Shi Feng, Chenhao Tan*2022 · 207 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-active-example-selection-context-learning/)
447. [**Enabling Language Models to Fill in the Blanks**Chris Donahue, Mina Lee, Percy Liang*2020 · 207 citations*](https://md.research.elamur.ai/free/en/papers/donahue-2020-enabling-language-models-fill-blanks/)
448. [**LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Models**Yen-Ting Lin, Yun-Nung Chen*2023 · 206 citations*](https://md.research.elamur.ai/free/en/papers/lin-2023-llm-eval-unified-multi-dimensional/)
449. [**Generating Training Data with Language Models: Towards Zero-Shot Language Understanding**Yu Meng, Jiaxin Huang, Yu Zhang, et al.*2022 · 206 citations*](https://md.research.elamur.ai/free/en/papers/meng-2022-generating-training-data-language-models/)
450. [**Prompting GPT-3 To Be Reliable**Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.*2022 · 206 citations*](https://md.research.elamur.ai/free/en/papers/si-2022-prompting-gpt-3-reliable/)
451. [**Challenges in Detoxifying Language Models**Johannes Welbl, Amelia Glaese, Jonathan Uesato, et al.*2021 · 206 citations*](https://md.research.elamur.ai/free/en/papers/welbl-2021-challenges-detoxifying-language-models/)
452. [**RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models**Cheng Niu, Yuanhao Wu, Juno Zhu, et al.*2024 · 204 citations*](https://md.research.elamur.ai/free/en/papers/niu-2024-ragtruth-hallucination-corpus-developing-trustworthy/)
453. [**LLM+P: Empowering Large Language Models with Optimal Planning Proficiency**Bo Liu, Yuqian Jiang, Xiaohan Zhang, et al.*2023 · 204 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-llm-p-empowering-large-language/)
454. [**Internet-augmented language models through few-shot prompting for open-domain question answering**Angeliki Lazaridou, Elena Gribovskaya, Wojciech Stokowiec, et al.*2022 · 204 citations*](https://md.research.elamur.ai/free/en/papers/lazaridou-2022-internet-augmented-language-models-through/)
455. [**PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization**Wen Xiao, Iz Beltagy, Giuseppe Carenini, et al.*2022 · 204 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2022-primera-pyramid-based-masked-sentence/)
456. [**On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation**Ruidan He, Linlin Liu, Hai Ye, et al.*2021 · 204 citations*](https://md.research.elamur.ai/free/en/papers/he-2021-effectiveness-adapter-based-tuning-pretrained/)
457. [**Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning**Shivalika Singh, Freddie Vargus, Daniel D'souza, et al.*2024 · 202 citations*](https://md.research.elamur.ai/free/en/papers/singh-2024-aya-dataset-open-access-collection/)
458. [**How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs**Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.*2024 · 202 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2024-how-johnny-can-persuade-llms/)
459. [**SALMONN: Towards Generic Hearing Abilities for Large Language Models**Changli Tang, Wenyi Yu, Guangzhi Sun, et al.*2023 · 202 citations*](https://md.research.elamur.ai/free/en/papers/tang-2023-salmonn-towards-generic-hearing-abilities/)
460. [**TinyStories: How Small Can Language Models Be and Still Speak Coherent English?**Ronen Eldan, Yuanzhi Li*2023 · 202 citations*](https://md.research.elamur.ai/free/en/papers/eldan-2023-tinystories-small-language-models-still/)
461. [**Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data**Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, et al.*2018 · 202 citations*](https://md.research.elamur.ai/free/en/papers/pratapa-2018-language-modeling-code-mixing-role/)
462. [**DeepSeek-VL: Towards Real-World Vision-Language Understanding**Haoyu Lu, Wen Liu, Bo Zhang, et al.*2024 · 201 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-deepseek-vl-real-world/)
463. [**Aligning Large Language Models with Human: A Survey**Yufei Wang, Wanjun Zhong, Liangyou Li, et al.*2023 · 199 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-aligning-large-language-models-human/)
464. [**Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias**Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-large-language-model-attributed-training/)
465. [**Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs**Suyu Ge, Yunan Zhang, Liyuan Liu, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/ge-2023-model-tells-discard-adaptive-kv/)
466. [**MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention**Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.*2024 · 197 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/)
467. [**Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference**Jiaming Tang, Yilong Zhao, Kan Zhu, et al.*2024 · 197 citations*](https://md.research.elamur.ai/free/en/papers/tang-2024-quest-query-aware-sparsity-efficient/)
468. [**ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search**Dan Zhang, Sining Zhoubian, Ziniu Hu, et al.*2024 · 197 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-rest-mcts-llm-self-training/)
469. [**Prompt Injection attack against LLM-integrated Applications**Yi Liu; Gelei Deng; Yuekang Li; Kailong Wang; Zihao Wang; Xiaofeng Wang; Tianwei Zhang; Yepang Liu; Haoyu Wang; Yan Zheng; Leo Yu Zhang;, Yang Liu*2023 · 197 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-prompt-injection-attack-against-llm/)
470. [**Scalable Extraction of Training Data from (Production) Language Models**Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.*2023 · 197 citations*](https://md.research.elamur.ai/free/en/papers/nasr-2023-scalable-extraction-training-data-production/)
471. [**Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?**Yang Yue, Zhiqi Chen, Rui Lu, et al.*2025 · 196 citations*](https://md.research.elamur.ai/free/en/papers/yue-2025-reinforcement-learning-really-incentivize-reasoning/)
472. [**The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning**Xi Ye, Greg Durrett*2022 · 196 citations*](https://md.research.elamur.ai/free/en/papers/ye-2022-unreliability-explanations-few-shot-prompting/)
473. [**COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining**Yu Meng, Chenyan Xiong, Payal Bajaj, et al.*2021 · 196 citations*](https://md.research.elamur.ai/free/en/papers/meng-2021-coco-lm-correcting-contrasting-text/)
474. [**Structured Pruning of Large Language Models**Ziheng Wang, Jeremy Wohlwend, Tao Lei*2020 · 196 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-structured-pruning-large-language-models/)
475. [**What matters when building vision-language models?**Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.*2024 · 195 citations*](https://md.research.elamur.ai/free/en/papers/lauren-ccon-2024-matters-building-vision-language-models/)
476. [**Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning**Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.*2022 · 195 citations*](https://md.research.elamur.ai/free/en/papers/alabi-2022-adapting-pre-trained-language-models/)
477. [**InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction**Xiao Wang, Weikang Zhou, Can Zu, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-instructuie-multi-task-instruction-tuning/)
478. [**Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback**Viet Lai, Chien Nguyen, Nghia Ngo, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/lai-2023-okapi-instruction-tuned-large-language/)
479. [**RRHF: Rank Responses to Align Language Models with Human Feedback without tears**Zheng Yuan, Hongyi Yuan, Chuanqi Tan, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-rrhf-rank-responses-align-language/)
480. [**Shikra: Unleashing Multimodal LLM's Referential Dialogue Magic**Keqin Chen, Zhao Zhang, Weili Zeng, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-shikra-unleashing-multimodal-llm-s/)
481. [**Time-Aware Language Models as Temporal Knowledge Bases**Bhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.*2022 · 194 citations*](https://md.research.elamur.ai/free/en/papers/dhingra-2022-time-aware-language-models-as/)
482. [**The emergence of number and syntax units in LSTM language models**Yair Lakretz, German Kruszewski, Theo Desbordes, et al.*2019 · 194 citations*](https://md.research.elamur.ai/free/en/papers/lakretz-2019-emergence-number-syntax-units-lstm/)
483. [**Making Retrieval-Augmented Language Models Robust to Irrelevant Context**Ori Yoran, Tomer Wolfson, Ori Ram, et al.*2023 · 193 citations*](https://md.research.elamur.ai/free/en/papers/yoran-2023-making-retrieval-augmented-language-models/)
484. [**OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models**Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.*2023 · 193 citations*](https://md.research.elamur.ai/free/en/papers/shao-2023-omniquant-omnidirectionally-calibrated-quantization-large/)
485. [**LLM in a flash: Efficient Large Language Model Inference with Limited Memory**Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.*2024 · 192 citations*](https://md.research.elamur.ai/free/en/papers/alizadeh-2024-llm-flash-efficient-large-language/)
486. [**MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning**Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.*2023 · 192 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-minigpt-v2-large-language-model/)
487. [**Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts**Yue Guo, Yi Yang, Ahmed Abbasi*2022 · 191 citations*](https://md.research.elamur.ai/free/en/papers/guo-2022-auto-debias-debiasing-masked-language/)
488. [**HONEST: Measuring Hurtful Sentence Completion in Language Models**Debora Nozza, Federico Bianchi, Dirk Hovy*2021 · 190 citations*](https://md.research.elamur.ai/free/en/papers/nozza-2021-honest-measuring-hurtful-sentence-completion/)
489. [**PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization**Yidong Wang, Zhuohao Yu, Zhengran Zeng, et al.*2023 · 189 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-pandalm-automatic-evaluation-benchmark-llm/)
490. [**When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models**Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.*2021 · 189 citations*](https://md.research.elamur.ai/free/en/papers/muller-2021-when-being-unseen-mbert-is/)
491. [**Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation**Daniel Loureiro, Alípio Jorge*2019 · 189 citations*](https://md.research.elamur.ai/free/en/papers/loureiro-2019-language-modelling-makes-sense-propagating/)
492. [**Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs**Xingyu Chen, Jiahao Xu, Tian Liang, et al.*2024 · 188 citations*](https://md.research.elamur.ai/free/en/papers/chen-2024-think-that-much-2-3/)
493. [**LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods**Haitao Li, Qian Dong, Junjie Chen, et al.*2024 · 188 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-llms-judges-comprehensive-survey-llm/)
494. [**Refusal in Language Models Is Mediated by a Single Direction**Andy Arditi, Oscar Obeso, Aaquib Syed, et al.*2024 · 188 citations*](https://md.research.elamur.ai/free/en/papers/arditi-2024-refusal-language-models-mediated-single/)
495. [**SGPT: GPT Sentence Embeddings for Semantic Search**Niklas Muennighoff*2022 · 187 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2022-sgpt-gpt-sentence-embeddings-semantic/)
496. [**Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models**Matt Deitke, Christopher Clark, Sangho Lee, et al.*2024 · 184 citations*](https://md.research.elamur.ai/free/en/papers/deitke-2024-molmo-pixmo-open-weights-open/)
497. [**Multilingual Jailbreak Challenges in Large Language Models**Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, et al.*2023 · 183 citations*](https://md.research.elamur.ai/free/en/papers/deng-2023-multilingual-jailbreak-challenges-large-language/)
498. [**Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models**Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.*2022 · 183 citations*](https://md.research.elamur.ai/free/en/papers/tirumala-2022-memorization-overfitting-analyzing-training-dynamics/)
499. [**Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers**Chenglei Si, Diyi Yang, Tatsunori Hashimoto*2024 · 182 citations*](https://md.research.elamur.ai/free/en/papers/si-2024-llms-generate-novel-research/)
500. [**Large Language Models are few(1)-shot Table Reasoners**Wenhu Chen*2023 · 182 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-large-language-models-are-few/)
501. [**Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models**Yunfei Chu, Jin Xu, Xiaohuan Zhou, et al.*2023 · 182 citations*](https://md.research.elamur.ai/free/en/papers/chu-2023-qwen-audio-advancing-universal/)
502. [**Pre-training via Paraphrasing**Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.*2020 · 181 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-pre-training-paraphrasing/)
503. [**GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models**Archiki Prasad, Peter Hase, Xiang Zhou, et al.*2023 · 180 citations*](https://md.research.elamur.ai/free/en/papers/prasad-2023-grips-gradient-free-edit-based/)
504. [**Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning**Fuxiao Liu, Kevin Lin, Linjie Li, et al.*2023 · 180 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-mitigating-hallucination-large-multi-modal/)
505. [**Knowledge Conflicts for LLMs: A Survey**Rongwu Xu, Zehan Qi, Zhijiang Guo, et al.*2024 · 179 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-knowledge-conflicts-llms-survey/)
506. [**Adapting Language Models to Compress Contexts**Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.*2023 · 179 citations*](https://md.research.elamur.ai/free/en/papers/chevalier-2023-adapting-language-models-compress-contexts/)
507. [**CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages**Thuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.*2023 · 179 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2023-culturax-cleaned-enormous-multilingual-dataset/)
508. [**The False Promise of Imitating Proprietary LLMs**Arnav Gudibande, Eric Wallace, Charlie Snell, et al.*2023 · 178 citations*](https://md.research.elamur.ai/free/en/papers/gudibande-2023-false-promise-imitating-proprietary-llms/)
509. [**Investigating Cultural Alignment of Large Language Models**Badr AlKhamissi, Muhammad ElNokrashy, Mai Alkhamissi, et al.*2024 · 177 citations*](https://md.research.elamur.ai/free/en/papers/alkhamissi-2024-investigating-cultural-alignment-large-language/)
510. [**Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization**Yu-Min Tseng, Yu-Chao Huang, Teng-Yun Hsiao, et al.*2024 · 177 citations*](https://md.research.elamur.ai/free/en/papers/tseng-2024-two-tales-persona-llms-survey/)
511. [**Effective Long-Context Scaling of Foundation Models**Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.*2023 · 177 citations*](https://md.research.elamur.ai/free/en/papers/xiong-2023-effective-long-context-scaling-foundation/)
512. [**Evaluating Large Language Models: A Comprehensive Survey**Zishan Guo, Renren Jin, Chuang Liu, et al.*2023 · 177 citations*](https://md.research.elamur.ai/free/en/papers/guo-2023-evaluating-large-language-models-comprehensive/)
513. [**ToolQA: A Dataset for LLM Question Answering with External Tools**Yuchen Zhuang, Yue Yu, Kuan Wang, et al.*2023 · 177 citations*](https://md.research.elamur.ai/free/en/papers/zhuang-2023-toolqa-dataset-llm-question-answering/)
514. [**Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information**Zehui Lin, Xiao Pan, Mingxuan Wang, et al.*2020 · 177 citations*](https://md.research.elamur.ai/free/en/papers/lin-2020-pre-training-multilingual-neural-machine/)
515. [**Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models**Nora Kassner, Philipp Dufter, Hinrich Schütze*2021 · 175 citations*](https://md.research.elamur.ai/free/en/papers/kassner-2021-multilingual-lama-investigating-knowledge-multilingual/)
516. [**Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models**Qiguang Chen, Libo Qin, Jinhao Liu, et al.*2025 · 174 citations*](https://md.research.elamur.ai/free/en/papers/chen-2025-towards-reasoning-era-survey-long/)
517. [**Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages**Sumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.*2023 · 174 citations*](https://md.research.elamur.ai/free/en/papers/doddapaneni-2023-leaving-no-indic-language-behind/)
518. [**What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning**Wei Liu, Weihao Zeng, Keqing He, et al.*2023 · 174 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-makes-good-data-alignment-comprehensive/)
519. [**UNKs Everywhere: Adapting Multilingual Language Models to New Scripts**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*2021 · 174 citations*](https://md.research.elamur.ai/free/en/papers/pfeiffer-2021-unks-everywhere-adapting-multilingual-language/)
520. [**Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs**Shengbang Tong, Ellis Brown, Penghao Wu, et al.*2024 · 173 citations*](https://md.research.elamur.ai/free/en/papers/tong-2024-cambrian-1-fully-open-vision/)
521. [**Language Models are Few-shot Multilingual Learners**Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, et al.*2021 · 173 citations*](https://md.research.elamur.ai/free/en/papers/winata-2021-language-models-are-few-shot/)
522. [**ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases**Qiaoyu Tang, Ziliang Deng, Hongyu Lin, et al.*2023 · 172 citations*](https://md.research.elamur.ai/free/en/papers/tang-2023-toolalpaca-generalized-tool-learning-language/)
523. [**Lifting the Curse of Multilinguality by Pre-training Modular Transformers**Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, et al.*2022 · 172 citations*](https://md.research.elamur.ai/free/en/papers/pfeiffer-2022-lifting-curse-multilinguality-pre-training/)
524. [**SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language Model**Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.*2025 · 171 citations*](https://md.research.elamur.ai/free/en/papers/allal-2025-smollm2-smol-goes-big-data/)
525. [**MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues**Ge Bai, Jie Liu, Xingyuan Bu, et al.*2024 · 171 citations*](https://md.research.elamur.ai/free/en/papers/bai-2024-mt-bench-101-fine-grained/)

[← prev](https://md.research.elamur.ai/free/en/topics/language-models/page/5/) [1](https://md.research.elamur.ai/free/en/topics/language-models/) … [5](https://md.research.elamur.ai/free/en/topics/language-models/page/5/) **6** [7](https://md.research.elamur.ai/free/en/topics/language-models/page/7/) … [12](https://md.research.elamur.ai/free/en/topics/language-models/page/12/) [next →](https://md.research.elamur.ai/free/en/topics/language-models/page/7/)