--- title: "Fartash Faghri — author profile and papers — Elamur Research" description: "Fartash Faghri: 2 papers on Elamur Research (2024–2026), h-index 12 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/fartash-faghri/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/fartash-faghri/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Fartash Faghri # Fartash Faghri Fartash Faghri has 2 papers in our library, in 2024–2026, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Efficient models & compression](https://md.research.elamur.ai/free/en/topics/efficient-models/); often with [Mehrdad Farajtabar](https://md.research.elamur.ai/free/en/authors/mehrdad-farajtabar/), [Minsik Cho](https://md.research.elamur.ai/free/en/authors/minsik-cho/), [Fatih Ilhan](https://md.research.elamur.ai/free/en/authors/fatih-ilhan/). 2 papers in our library · 2024–2026 [OpenAlex](https://openalex.org/A5036601505) · [ORCID](https://orcid.org/0000-0001-5975-5158) · [**h-index 12**](https://openalex.org/authors/A5036601505) · [51 works](https://openalex.org/works?filter=author.id:A5036601505) · [1,661 citations](https://openalex.org/works?filter=author.id:A5036601505&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/fartash-faghri/#papers) · [🔗 Cited 190 times in our library](https://md.research.elamur.ai/free/en/authors/fartash-faghri/cited-by/) · [5 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #11509](https://md.research.elamur.ai/free/en/paper-stars/page/116/#star-11509) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Fartash+Faghri) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Fartash+Faghri) · [dblp](https://dblp.org/search?q=Fartash+Faghri) · [ACL Anthology](https://aclanthology.org/search/?q=Fartash+Faghri) ## Affiliations [🏢**Apple** Cupertino · United States 2022–2025 · 11 papers](https://md.research.elamur.ai/free/en/companies/apple/) · [🎓**University of Toronto** Toronto · Canada 2013–2022 · 6 papersEducation 2013–2014 · MSc, Computer ScienceEducation since 2017 · PhD, Computer Science](https://md.research.elamur.ai/free/en/universities/university-of-toronto/) · [🎓**Sharif University of Technology** Tehran · Iran 2008–2012 · 1 paperEducation 2008–2012 · BSc, Computer Engineering](https://md.research.elamur.ai/free/en/universities/sharif-university-of-technology/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 2 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Efficient models & compression · 1 work](https://md.research.elamur.ai/free/en/topics/efficient-models/) ## Works by year ### 2020s [**2026** 1 paper](https://md.research.elamur.ai/free/en/authors/fartash-faghri/year/2026/) · [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/fartash-faghri/year/2024/) ## Papers The most cited first (OpenAlex and our library). 1. **[Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization](https://md.research.elamur.ai/free/en/papers/samragh-2024-scaling-smart-accelerating-large-language/)** *(2024 · 8 citations)* Training large language models from random weights is slow and costly, while small models are cheap but less accurate. 2. **[Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why](https://md.research.elamur.ai/free/en/papers/armandpour-2026-unmasking-policy-distillation-where-helps/)** *(2026 · 7 citations)* On-policy distillation gives a student model dense, per-token supervision, either from a larger external teacher or from the student itself conditioned on privileged context such as a correct solution. ## All works 7 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[A Study of Gradient Variance in Deep Learning ↗](https://arxiv.org/abs/2007.04532) arXiv (Cornell University) · no summary yet**Fartash Faghri et al.*2020 · 12 citations* 2. [**Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization arXiv:2409.12903**Mohammad Samragh, Iman Mirzadeh, Keivan Alizadeh Vahid, et al.*2024 · 8 citations*](https://md.research.elamur.ai/free/en/papers/samragh-2024-scaling-smart-accelerating-large-language/) 3. [**Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why arXiv:2605.10889**Mohammadreza Armandpour, Fatih Ilhan, David Harrison, et al.*2026 · 7 citations*](https://md.research.elamur.ai/free/en/papers/armandpour-2026-unmasking-policy-distillation-where-helps/) 4. **[Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pre-training ↗](https://aclanthology.org/2026.findings-eacl.307/) Findings of the Association for Computational Linguistics: EACL 2026 · no summary yet**Jeffrey Li et al.*2026* 5. **[Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pretraining ↗](https://arxiv.org/abs/2602.19548) arXiv (Cornell University) · no summary yet**Jeffrey Li et al.*2026* 6. **[FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representations ↗](https://arxiv.org/abs/2504.08368) arXiv (Cornell University) · no summary yet**Cheng-Yu Hsieh et al.*2025* 7. **[A Non-asymptotic comparison of SVRG and SGD: tradeoffs between compute and speed ↗](https://openalex.org/W2997794460) no summary yet**Qingru Zhang et al.*2019* ## Co-authors here 6 co-authors with a page, the most papers together first. - [Mehrdad Farajtabar](https://md.research.elamur.ai/free/en/authors/mehrdad-farajtabar/) ×2 - [Minsik Cho](https://md.research.elamur.ai/free/en/authors/minsik-cho/) ×2 - [Fatih Ilhan](https://md.research.elamur.ai/free/en/authors/fatih-ilhan/) - [Iman Mirzadeh](https://md.research.elamur.ai/free/en/authors/iman-mirzadeh/) - [Moin Nabi](https://md.research.elamur.ai/free/en/authors/moin-nabi/) - [Yizhe Zhang](https://md.research.elamur.ai/free/en/authors/yizhe-zhang/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) - Findings of the Association for Computational Linguistics: EACL 2026 ## Cited by Papers of our library cite their works 190 times (of the 149,439 papers whose bibliographies we read); [58 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/fartash-faghri/cited-by/). Updated 3 November 2026