---
title: "Donald Metzler — all works — Elamur Research"
description: "All 34 works of Donald Metzler in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/donald-metzler/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/donald-metzler/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Donald Metzler](https://md.research.elamur.ai/free/en/authors/donald-metzler/) / all works

# Donald Metzler — all works

34 works · [← Donald Metzler](https://md.research.elamur.ai/free/en/authors/donald-metzler/)

1. [**Emergent Abilities of Large Language Models arXiv:2206.07682**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,269 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
2. **[Efficient Transformers: A Survey](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Yi Tay, Mostafa Dehghani, Dara Bahri, et al.*2020 · 1,539 citations*
3. [**Long Range Arena: A Benchmark for Efficient Transformers arXiv:2011.04006**Yi Tay, Mostafa Dehghani, Samira Abnar, et al.*2020 · 414 citations*](https://md.research.elamur.ai/free/en/papers/tay-2020-long-range-arena-benchmark-efficient/)
4. **[Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting](https://md.research.elamur.ai/free/en/papers/qin-2024-large-language-models-are-effective/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhen Qin, Rolf Jagerman, Kai Hui, et al.*2024 · 300 citations*
5. **[Synthesizer: Rethinking Self-Attention in Transformer Models ↗](https://arxiv.org/abs/2005.00743) arXiv (Cornell University) · no summary yet**Yi Tay et al.*2020 · 245 citations*
6. **[A New Generation of Perspective API: Efficient Multilingual Character-level Transformers](https://md.research.elamur.ai/free/en/papers/lees-2022-new-generation-perspective-api/) [ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)](https://md.research.elamur.ai/free/en/venues/acm-sigkdd-conference-on-knowledge-discovery-and-data-mining-kdd/)**Alyssa Lees, Vinh Q. Tran, Yi Tay, et al.*2022 · 238 citations*
7. **[Sparse Sinkhorn Attention ↗](https://arxiv.org/abs/2002.11296) arXiv (Cornell University) · no summary yet**Yi Tay et al.*2020 · 200 citations*
8. **[Confident Adaptive Language Modeling ↗](https://doi.org/10.52202/068431-1269) neural information processing systems · no summary yet**Tal Schuster et al.*2022 · 197 citations*
9. [**Charformer: Fast Character Transformers via Gradient-based Subword Tokenization arXiv:2106.12672**Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.*2021 · 186 citations*](https://md.research.elamur.ai/free/en/papers/tay-2021-charformer-fast-character-transformers-gradient/)
10. **[Improving search relevance for implicitly temporal queries ↗](https://doi.org/10.1145/1571941.1572085) International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yet**Donald Metzler et al.*2009 · 140 citations*
11. **[Rethinking search ↗](https://doi.org/10.1145/3476415.3476428) ACM SIGIR Forum · no summary yet**Donald Metzler et al.*2021 · 119 citations*
12. **[Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers ↗](https://arxiv.org/abs/2109.10686) arXiv (Cornell University) · no summary yet**Yi Tay et al.*2021 · 104 citations*
13. **[Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?](https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yi Tay, Mostafa Dehghani, Samira Abnar, et al.*2023 · 86 citations*
14. **[Building enriched document representations using aggregated anchor text ↗](https://doi.org/10.1145/1571941.1571981) International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yet**Donald Metzler et al.*2009 · 67 citations*
15. **[HyperPrompt: Prompt-based Task-Conditioning of Transformers ↗](https://arxiv.org/abs/2203.00759) arXiv (Cornell University) · no summary yet**Yun He et al.*2022 · 62 citations*
16. **[Are Pretrained Convolutions Better than Pretrained Transformers? ↗](https://aclanthology.org/2021.acl-long.335/) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yet**Yi Tay et al.*2021 · 61 citations*
17. **[The Benchmark Lottery ↗](https://arxiv.org/abs/2107.07002) arXiv:2107.07002 · no summary yet**Mostafa Dehghani et al.*2021 · 50 citations*
18. **[StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ↗](https://aclanthology.org/2021.acl-long.559/) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yet**Yikang Shen et al.*2021 · 48 citations*
19. **[Synthesizer: Rethinking Self-Attention for Transformer Models ↗](https://openalex.org/W3166398787) International Conference on Machine Learning · no summary yet**Yi Tay et al.*2021 · 44 citations*
20. [**Transcending Scaling Laws with 0.1% Extra Compute arXiv:2210.11399**Yi Tay, Jason Wei, Hyung Won Chung, et al.*2022 · 42 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-transcending-scaling-laws-0-1/)
21. **[Are Pre-trained Convolutions Better than Pre-trained Transformers? ↗](https://arxiv.org/abs/2105.03322) arXiv (Cornell University) · no summary yet**Yi Tay et al.*2021 · 42 citations*
22. **[DSI++: Updating Transformer Memory with New Documents ↗](https://aclanthology.org/2023.emnlp-main.510/) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yet**Sanket Vaibhav Mehta et al.*2023 · 35 citations*
23. **[Reverse Engineering Configurations of Neural Text Generation Models ↗](https://aclanthology.org/2020.acl-main.25/) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yet**Yi Tay et al.*2020 · 28 citations*
24. **[How Reliable are Model Diagnostics? ↗](https://aclanthology.org/2021.findings-acl.155/) Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yet**Vamsi Aribandi, Yi Tay, Donald Metzler*2021 · 27 citations*
25. **[HyperGrid Transformers: Towards A Single Model for Multiple Tasks ↗](https://openalex.org/W3123161422) International Conference on Learning Representations · no summary yet**Yi Tay et al.*2021 · 25 citations*
26. **[Choppy: Cut Transformer for Ranked List Truncation ↗](https://doi.org/10.1145/3397271.3401188) International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yet**Dara Bahri et al.*2020 · 24 citations*
27. **[An Empirical Evaluation of Data-Driven Paraphrase Generation Techniques ↗](https://aclanthology.org/P11-2096/) Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Donald Metzler, Eduard Hovy, Chunliang Zhang*2011 · 23 citations*
28. **[ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ↗](https://aclanthology.org/2022.findings-acl.295/) Findings of the Association for Computational Linguistics: ACL 2022 · no summary yet**Kai Hui et al.*2022 · 12 citations*
29. **[SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption ↗](https://arxiv.org/abs/2106.15147) arXiv (Cornell University) · no summary yet**Dara Bahri et al.*2021 · 12 citations*
30. **[Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study ↗](https://doi.org/10.1145/3437963.3441809) ACM International Conference on Web Search and Data Mining (WSDM) · no summary yet**Dara Bahri et al.*2021 · 10 citations*
31. **[HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections ↗](https://arxiv.org/abs/2007.05891) arXiv (Cornell University) · no summary yet**Yi Tay et al.*2020 · 9 citations*
32. **[Surprise: Result List Truncation via Extreme Value Theory ↗](https://doi.org/10.1145/3539618.3592066) International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yet**Dara Bahri et al.*2020 · 3 citations*
33. **[Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification ↗](https://aclanthology.org/2022.emnlp-industry.53/) Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track · no summary yet**Jai Gupta et al.*2022*
34. **[Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection ↗](https://arxiv.org/abs/2102.05131) arXiv (Cornell University) · no summary yet**Dara Bahri et al.*2021*