--- title: "Vaishaal Shankar · Anthropic — author profile and papers" description: "Vaishaal Shankar, Anthropic: 2 papers on Elamur Research (2024), h-index 20 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/vaishaal-shankar/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/vaishaal-shankar/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Vaishaal Shankar # Vaishaal Shankar Vaishaal Shankar has 2 papers in our library, in 2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Alex Fang](https://md.research.elamur.ai/free/en/authors/alex-fang/), [Chun-Liang Li](https://md.research.elamur.ai/free/en/authors/chun-liang-li/), [Georgios Smyrnis](https://md.research.elamur.ai/free/en/authors/georgios-smyrnis/). 2 papers in our library · 2024 [OpenAlex](https://openalex.org/A5112327867) · [**h-index 20**](https://openalex.org/authors/A5112327867) · [55 works](https://openalex.org/works?filter=author.id:A5112327867) · [2,542 citations](https://openalex.org/works?filter=author.id:A5112327867&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/vaishaal-shankar/#papers) · [🔗 Cited 618 times in our library](https://md.research.elamur.ai/free/en/authors/vaishaal-shankar/cited-by/) · [6 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #8739](https://md.research.elamur.ai/free/en/paper-stars/page/88/#star-8739) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Vaishaal+Shankar) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Vaishaal+Shankar) · [dblp](https://dblp.org/search?q=Vaishaal+Shankar) · [ACL Anthology](https://aclanthology.org/search/?q=Vaishaal+Shankar) ## Affiliations [🏢**Anthropic** San Francisco · United States 2025 · 1 paper*current*](https://md.research.elamur.ai/free/en/companies/anthropic/) · [🎓**University of California, Berkeley** Berkeley · United States 2015–2021 · 15 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) · [🏢**Apple** Cupertino · United States 2022–2024 · 8 papers](https://md.research.elamur.ai/free/en/companies/apple/) · [🏢**Amazon** Seattle · United States 2021–2024 · 2 papers](https://md.research.elamur.ai/free/en/companies/amazon/) · [🎓**University of Washington** Seattle · United States 2022–2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-washington/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2024** 2 papers](https://md.research.elamur.ai/free/en/authors/vaishaal-shankar/year/2024/) ## Papers The most cited first (OpenAlex and our library). 1. **[Language models scale reliably with over-training and on downstream tasks](https://md.research.elamur.ai/free/en/papers/gadre-2024-language-models-scale-reliably-over/)** *(2024 · 46 citations)* Scaling laws let teams forecast large language model behaviour from cheap small runs. Most published laws, however, assume Chinchilla-style compute-optimal training and predict only next-token loss. In practice, smaller models are often over-trained on far more tokens to cut inference cost, and they are compared on… 2. **[Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum](https://md.research.elamur.ai/free/en/papers/pouransari-2024-dataset-decomposition-faster-llm-training/)** *(2024 · 16 citations)* Standard LLM pretraining uses concat-and-chunk: documents are shuffled, joined, and cut into fixed-length sequences. ## All works 8 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Cloud Programming Simplified: A Berkeley View on Serverless Computing ↗](https://doi.org/10.4230/oasics.microservices.2020-2022.5) arXiv (Cornell University) · no summary yet**Jonas, Eric et al.*2019 · 422 citations* 2. **[Measuring Robustness to Natural Distribution Shifts in Image Classification ↗](https://openalex.org/W3104911444) neural information processing systems · no summary yet**Rohan Taori et al.*2020 · 209 citations* 3. **[Predicting with Confidence on Unseen Distributions ↗](https://doi.org/10.1109/iccv48922.2021.00117) IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yet**Devin Guillory et al.*2021 · 85 citations* 4. **[numpywren: serverless linear algebra ↗](https://arxiv.org/abs/1810.09679) arXiv (Cornell University) · no summary yet**Vaishaal Shankar et al.*2018 · 69 citations* 5. **[Data Filtering Networks ↗](https://arxiv.org/abs/2309.17425) arXiv:2309.17425 · no summary yet**Alex Fang et al.*2023 · 60 citations* 6. **[Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization ↗](https://arxiv.org/abs/2107.04649) arXiv (Cornell University) · no summary yet**John J. Miller et al.*2021 · 59 citations* 7. [**Language models scale reliably with over-training and on downstream tasks arXiv:2403.08540**Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.*2024 · 46 citations*](https://md.research.elamur.ai/free/en/papers/gadre-2024-language-models-scale-reliably-over/) 8. **[Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum](https://md.research.elamur.ai/free/en/papers/pouransari-2024-dataset-decomposition-faster-llm-training/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.*2024 · 16 citations* ## Co-authors here 12 of 13 co-authors with a page, the most papers together first. - [Alex Fang](https://md.research.elamur.ai/free/en/authors/alex-fang/) - [Chun-Liang Li](https://md.research.elamur.ai/free/en/authors/chun-liang-li/) - [Georgios Smyrnis](https://md.research.elamur.ai/free/en/authors/georgios-smyrnis/) - [Jean Mercat](https://md.research.elamur.ai/free/en/authors/jean-mercat/) - [Jeffrey Li](https://md.research.elamur.ai/free/en/authors/jeffrey-li/) - [Marianna Nezhurina](https://md.research.elamur.ai/free/en/authors/marianna-nezhurina/) - [Mitchell Wortsman](https://md.research.elamur.ai/free/en/authors/mitchell-wortsman/) - [Oncel Tuzel](https://md.research.elamur.ai/free/en/authors/oncel-tuzel/) - [Rui Xin](https://md.research.elamur.ai/free/en/authors/rui-xin/) - [Rulin Shao](https://md.research.elamur.ai/free/en/authors/rulin-shao/) - [Samir Yitzhak Gadre](https://md.research.elamur.ai/free/en/authors/samir-yitzhak-gadre/) - [Sedrick Keh](https://md.research.elamur.ai/free/en/authors/sedrick-keh/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) ×3: [NeurIPS 2024](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/) - IEEE/CVF International Conference on Computer Vision (ICCV) - neural information processing systems ## Cited by Papers of our library cite their works 618 times (of the 149,439 papers whose bibliographies we read); [125 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/vaishaal-shankar/cited-by/). Updated 2 November 2026