--- title: "Jinfeng Rao — author profile and papers" description: "Jinfeng Rao, Pinterest: 3 papers on Elamur Research (2020–2023), h-index 17 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/jinfeng-rao/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/jinfeng-rao/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Jinfeng Rao # Jinfeng Rao Jinfeng Rao has 3 papers in our library, in 2020–2023, most of them on [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/), [Efficient models & compression](https://md.research.elamur.ai/free/en/topics/efficient-models/); often with [Donald Metzler](https://md.research.elamur.ai/free/en/authors/donald-metzler/), [Yi Tay](https://md.research.elamur.ai/free/en/authors/yi-tay/), [Hyung Won Chung](https://md.research.elamur.ai/free/en/authors/hyung-won-chung/). 3 papers in our library · 2020–2023 [OpenAlex](https://openalex.org/A5075728689) · [**h-index 17**](https://openalex.org/authors/A5075728689) · [44 works](https://openalex.org/works?filter=author.id:A5075728689) · [1,070 citations](https://openalex.org/works?filter=author.id:A5075728689&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 3 works in our library](https://md.research.elamur.ai/free/en/authors/jinfeng-rao/#papers) · [🔗 460 citations in our library](https://md.research.elamur.ai/free/en/authors/jinfeng-rao/cited-by/) · [4 more in our library without a page yet](#also) · [⭐ Paper Star rank #2918](https://md.research.elamur.ai/free/en/paper-stars/page/30/#star-2918) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Jinfeng+Rao) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Jinfeng+Rao) · [dblp](https://dblp.org/search?q=Jinfeng+Rao) · [ACL Anthology](https://aclanthology.org/search/?q=Jinfeng+Rao) ## Affiliations [🏢**Pinterest** San Francisco 2024–2026 · 2 papers*current*](https://ror.org/04m6zg706) · [🎓**University of Maryland, College Park** College Park · United States 2014–2020 · 14 papers](https://md.research.elamur.ai/free/en/universities/university-of-maryland-college-park/) · [🏢**Google** Mountain View · United States 2022–2023 · 7 papers](https://md.research.elamur.ai/free/en/companies/google/) · [🏢**Meta** Menlo Park · United States 2019 · 3 papers](https://md.research.elamur.ai/free/en/companies/meta/) · [🎓**Nanyang Technological University** Singapore · Singapore 2019 · 2 papers](https://md.research.elamur.ai/free/en/universities/nanyang-technological-university/) · [🎓**The Ohio State University** Columbus · United States 2019 · 2 papers](https://md.research.elamur.ai/free/en/universities/the-ohio-state-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed. ## Topics [Evaluation & benchmarks (1)](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Efficient models & compression (1)](https://md.research.elamur.ai/free/en/topics/efficient-models/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/papers/tay-2022-transcending-scaling-laws-0-1/) · [**2020** 1 paper](https://md.research.elamur.ai/free/en/papers/tay-2020-long-range-arena-benchmark-efficient/) ## Papers The most cited first (OpenAlex and our library). 1. **[Long Range Arena: A Benchmark for Efficient Transformers](https://md.research.elamur.ai/free/en/papers/tay-2020-long-range-arena-benchmark-efficient/)** *(2020 · 396 citations)* Many "efficient" Transformer variants (xformers) have been proposed to get around the quadratic cost of self-attention. 2. **[Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/)** *(2023 · 79 citations)* Most work on scaling laws studies only the standard Transformer. New architectures are also often judged at a single model size, such as "base", on the assumption that their gains carry over to other scales. This paper tests that assumption. The authors ask whether the inductive bias built into an architecture… 3. **[Transcending Scaling Laws with 0.1% Extra Compute](https://md.research.elamur.ai/free/en/papers/tay-2022-transcending-scaling-laws-0-1/)** *(2022 · 40 citations)* Making large language models better usually means scaling them up, which costs a great deal of compute. The authors ask whether an already trained causal model can be improved cheaply instead. Their method, UL2R (UL2Restore), takes existing PaLM checkpoints and trains them for a small number of extra steps using the… ## Also in our library 4 more works of theirs are in our library without a page here yet; they will appear as we publish them. ## Co-authors here 12 of 21 co-authors with a page, the most papers together first. - [Donald Metzler](https://md.research.elamur.ai/free/en/authors/donald-metzler/) ×3 - [Yi Tay](https://md.research.elamur.ai/free/en/authors/yi-tay/) ×3 - [Hyung Won Chung](https://md.research.elamur.ai/free/en/authors/hyung-won-chung/) ×2 - [Mostafa Dehghani](https://md.research.elamur.ai/free/en/authors/mostafa-dehghani/) ×2 - [Samira Abnar](https://md.research.elamur.ai/free/en/authors/samira-abnar/) ×2 - [Aakanksha Chowdhery](https://md.research.elamur.ai/free/en/authors/aakanksha-chowdhery/) - [Dani Yogatama](https://md.research.elamur.ai/free/en/authors/dani-yogatama/) - [Dara Bahri](https://md.research.elamur.ai/free/en/authors/dara-bahri/) - [David R. So](https://md.research.elamur.ai/free/en/authors/david-r-so/) - [Denny Zhou](https://md.research.elamur.ai/free/en/authors/denny-zhou/) - [Huaixiu Steven Zheng](https://md.research.elamur.ai/free/en/authors/huaixiu-steven-zheng/) - [Jason Wei](https://md.research.elamur.ai/free/en/authors/jason-wei/) ## Cited by Papers of our library cite their works 460 times (of the 140,884 papers whose bibliographies we read); [45 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/jinfeng-rao/cited-by/).