---
title: "Mostafa Dehghani — papers of 2022 — Elamur Research"
description: "Mostafa Dehghani — papers of 2022: 3 papers on Elamur Research, the most cited first — what each work is about in our own words."
canonical: "https://research.elamur.ai/free/en/authors/mostafa-dehghani/year/2022/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/mostafa-dehghani/year/2022/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Mostafa Dehghani](https://md.research.elamur.ai/free/en/authors/mostafa-dehghani/) / 2022

# Mostafa Dehghani — papers of 2022 — Elamur Research

3 papers · [all years of Mostafa Dehghani](https://md.research.elamur.ai/free/en/authors/mostafa-dehghani/#years)

- [UL2: Unifying Language Learning Paradigms arXiv:2205.05131](https://md.research.elamur.ai/free/en/papers/tay-2022-ul2-unifying-language-learning-paradigms/) — Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al. · 2022 · 347 citations

**[Transformer Memory as a Differentiable Search Index](https://md.research.elamur.ai/free/en/papers/tay-2022-transformer-memory-differentiable-search-index/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.*2022 · 223 citations*

- [Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints arXiv:2212.05055](https://md.research.elamur.ai/free/en/papers/komatsuzaki-2022-sparse-upcycling-training-mixture-experts/) — Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, et al. · 2022 · 98 citations