---
title: "Lukasz Kaiser — all works — Elamur Research"
description: "All 85 works of Lukasz Kaiser in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/lukasz-kaiser/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/lukasz-kaiser/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Lukasz Kaiser](https://md.research.elamur.ai/free/en/authors/lukasz-kaiser/) / all works

# Lukasz Kaiser — all works

85 works · [← Lukasz Kaiser](https://md.research.elamur.ai/free/en/authors/lukasz-kaiser/)

1. [**Attention Is All You Need arXiv:1706.03762**Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.*2017 · 17,458 citations*](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)
2. **[Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation ↗](https://arxiv.org/abs/1609.08144) arXiv:1609.08144 · no summary yet**Yonghui Wu et al.*2016 · 6,904 citations*
3. [**Training Verifiers to Solve Math Word Problems arXiv:2110.14168**Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.*2021 · 3,796 citations*](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/)
4. [**Reformer: The Efficient Transformer arXiv:2001.04451**Nikita Kitaev, Łukasz Kaiser, Anselm Levskaya*2020 · 829 citations*](https://md.research.elamur.ai/free/en/papers/kitaev-2020-reformer-efficient-transformer/)
5. **[Grammar as a Foreign Language ↗](https://arxiv.org/abs/1412.7449) arXiv:1412.7449 · no summary yet**Oriol Vinyals et al.*2014 · 687 citations*
6. **[Universal Transformers ↗](https://arxiv.org/abs/1807.03819) arXiv:1807.03819 · no summary yet**Mostafa Dehghani et al.*2018 · 637 citations*
7. [**Regularizing Neural Networks by Penalizing Confident Output Distributions arXiv:1701.06548**Gabriel Pereyra, George Tucker, Jan Chorowski, et al.*2017 · 496 citations*](https://md.research.elamur.ai/free/en/papers/pereyra-2017-regularizing-neural-networks-penalizing-confident/)
8. [**Rethinking Attention with Performers arXiv:2009.14794**Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, et al.*2020 · 491 citations*](https://md.research.elamur.ai/free/en/papers/choromanski-2020-rethinking-attention-performers/)
9. **[Model-Based Reinforcement Learning for Atari ↗](https://arxiv.org/abs/1903.00374) arXiv (Cornell University) · no summary yet**Łukasz Kaiser et al.*2019 · 429 citations*
10. **[Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals ↗](https://doi.org/10.1038/s41467-020-18073-9) Nature Communications 11:4381 · no summary yet**Martin Popel et al.*2020 · 374 citations*
11. **[Image Transformer ↗](https://arxiv.org/abs/1802.05751) arXiv (Cornell University) · no summary yet**Niki Parmar et al.*2018 · 342 citations*
12. **[Sentence Compression by Deletion with LSTMs](https://md.research.elamur.ai/free/en/papers/filippova-2015-sentence-compression-deletion-lstms/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Katja Filippova, Enrique Alfonseca, Carlos A. Colmenares, et al.*2015 · 338 citations*
13. [**Generating Wikipedia by Summarizing Long Sequences arXiv:1801.10198**Peter J. Liu, Mohammad Saleh, Etienne Pot, et al.*2018 · 334 citations*](https://md.research.elamur.ai/free/en/papers/liu-2018-generating-wikipedia-summarizing-long-sequences/)
14. [**Multi-task Sequence to Sequence Learning arXiv:1511.06114**Minh-Thang Luong, Quoc V. Le, Ilya Sutskever, et al.*2015 · 321 citations*](https://md.research.elamur.ai/free/en/papers/luong-2015-multi-task-sequence-sequence-learning/)
15. **[Neural GPUs Learn Algorithms ↗](https://arxiv.org/abs/1511.08228) arXiv:1511.08228 · no summary yet**Łukasz Kaiser, Ilya Sutskever*2015 · 305 citations*
16. **[One Model To Learn Them All ↗](https://arxiv.org/abs/1706.05137) arXiv (Cornell University) · no summary yet**Łukasz Kaiser et al.*2017 · 277 citations*
17. **[Adding Gradient Noise Improves Learning for Very Deep Networks ↗](https://arxiv.org/abs/1511.06807) arXiv (Cornell University) · no summary yet**Arvind Neelakantan et al.*2015 · 274 citations*
18. **[Depthwise Separable Convolutions for Neural Machine Translation ↗](https://arxiv.org/abs/1706.03059) arXiv (Cornell University) · no summary yet**Łukasz Kaiser, Aidan N. Gomez, Chollet, Francois*2017 · 260 citations*
19. **[Learning to Remember Rare Events ↗](https://arxiv.org/abs/1703.03129) arXiv:1703.03129 · no summary yet**Łukasz Kaiser et al.*2017 · 258 citations*
20. **[Fast Decoding in Sequence Models using Discrete Latent Variables ↗](https://arxiv.org/abs/1803.03382) arXiv (Cornell University) · no summary yet**Łukasz Kaiser et al.*2018 · 213 citations*
21. **[Tensor2Tensor for Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/vaswani-2018-tensor2tensor-neural-machine-translation/) [Conference of the Association for Machine Translation in the Americas (AMTA)](https://md.research.elamur.ai/free/en/venues/amta/)**Ashish Vaswani, Samy Bengio, Eugene Brevdo, et al.*2018 · 191 citations*
22. **[Sample Efficient Text Summarization Using a Single Pre-Trained Transformer ↗](https://arxiv.org/abs/1905.08836) arXiv (Cornell University) · no summary yet**Urvashi Khandelwal et al.*2019 · 81 citations*
23. **[Competitive Programming with Large Reasoning Models ↗](https://arxiv.org/abs/2502.06807) arXiv:2502.06807 · no summary yet**OpenAI: Ahmed El-Kishky et al.*2025 · 68 citations*
24. **[Hierarchical Transformers Are More Efficient Language Models ↗](https://aclanthology.org/2022.findings-naacl.117/) Findings of the Association for Computational Linguistics: NAACL 2022 · no summary yet**Piotr Nawrot et al.*2022 · 60 citations*
25. **[Discrete Autoencoders for Sequence Models ↗](https://arxiv.org/abs/1801.09797) arXiv (Cornell University) · no summary yet**Łukasz Kaiser, Samy Bengio*2018 · 40 citations*
26. **[Can Active Memory Replace Attention? ↗](https://arxiv.org/abs/1610.08613) arXiv (Cornell University) · no summary yet**Łukasz Kaiser, Samy Bengio*2016 · 31 citations*
27. **[Model Checking Games for the Quantitative μ-Calculus ↗](https://doi.org/10.1007/s00224-009-9201-y) Theory of Computing Systems · no summary yet**Diana Fischer, Erich Grädel, Łukasz Kaiser*2009 · 31 citations*
28. **[Sparse is Enough in Scaling Transformers ↗](https://arxiv.org/abs/2111.12763) arXiv (Cornell University) · no summary yet**Sebastian Jaszczur et al.*2021 · 30 citations*
29. **[Unsupervised Cipher Cracking Using Discrete GANs ↗](https://arxiv.org/abs/1801.04883) arXiv (Cornell University) · no summary yet**Aidan N. Gomez et al.*2018 · 30 citations*
30. **[Learning games from videos guided by descriptive complexity ↗](https://openalex.org/W2295670218) National Conference on Artificial Intelligence · no summary yet**Łukasz Kaiser*2012 · 30 citations*
31. **[Degrees of Lookahead in Regular Infinite Games ↗](https://doi.org/10.2168/lmcs-8(3:24)2012) Logical Methods in Computer Science · no summary yet**Michael Holtmann, Łukasz Kaiser, Wolfgang Thomas*2012 · 27 citations*
32. **[Information Tracking in Games on Graphs ↗](https://doi.org/10.1007/s10849-009-9115-8) Journal of Logic Language and Information · no summary yet**Dietmar Berwanger, Łukasz Kaiser*2010 · 27 citations*
33. **[Experiments with Reduction Finding ↗](https://doi.org/10.1007/978-3-642-39071-5_15) Lecture notes in computer science · no summary yet**Charles Jordan, Łukasz Kaiser*2013 · 22 citations*
34. **[Degrees of Lookahead in Regular Infinite Games ↗](https://doi.org/10.1007/978-3-642-12032-9_18) Lecture notes in computer science · no summary yet**Michael Holtmann, Łukasz Kaiser, Wolfgang Thomas*2010 · 21 citations*
35. **[Parallel Scheduled Sampling ↗](https://arxiv.org/abs/1906.04331) arXiv (Cornell University) · no summary yet**Duckworth, Daniel et al.*2019 · 20 citations*
36. **[New Algorithm for Weak Monadic Second-Order Logic on Inductive Structures ↗](https://doi.org/10.1007/978-3-642-15205-4_29) Lecture notes in computer science · no summary yet**Tobias Ganzow, Łukasz Kaiser*2010 · 16 citations*
37. **[Expressing Cardinality Quantifiers in Monadic Second-Order Logic over Trees ↗](https://doi.org/10.3233/fi-2010-260) Fundamenta Informaticae · no summary yet**Vince Bárány, Łukasz Kaiser, Alexander Rabinovich*2010 · 15 citations*
38. **[Characterising Choiceless Polynomial Time with First-Order Interpretations ↗](https://doi.org/10.1109/lics.2015.68) Proceedings - Symposium on Logic in Computer Science · no summary yet**Erich Grädel et al.*2015 · 12 citations*
39. **[First-Order Logic with Counting for General Game Playing ↗](https://doi.org/10.1609/aaai.v25i1.7949) Proceedings of the AAAI Conference on Artificial Intelligence · no summary yet**Łukasz Kaiser, Łukasz Stafiniak*2011 · 12 citations*
40. **[A Perfect-Information Construction for Coordination in Games ↗](https://doi.org/10.4230/lipics.fsttcs.2011.387) DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · no summary yet**Dietmar Berwanger, Łukasz Kaiser, Bernd Puchala*2011 · 11 citations*
41. **[Graph Searching Games and Width Measures for Directed Graphs ↗](https://doi.org/10.4230/lipics.stacs.2015.34) DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · no summary yet**Saeed Akhoondian Amiri et al.*2015 · 10 citations*
42. **[Solving Counter Parity Games ↗](https://doi.org/10.1007/978-3-642-32589-2_17) Lecture notes in computer science · no summary yet**Dietmar Berwanger, Łukasz Kaiser, Simon Robert Leßenich*2012 · 9 citations*
43. **[Synthesis for Structure Rewriting Systems ↗](https://doi.org/10.1007/978-3-642-03816-7_36) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2009 · 9 citations*
44. **[MPIDepQBF: Towards Parallel QBF Solving without Knowledge Sharing ↗](https://doi.org/10.1007/978-3-319-09284-3_32) Lecture notes in computer science · no summary yet**Charles Jordan et al.*2014 · 8 citations*
45. **[Model Checking Games for the Quantitative mu-Calculus ↗](https://arxiv.org/abs/0802.2871) arXiv (Cornell University) · no summary yet**Fischer, Diana, Erich Grädel, Łukasz Kaiser*2008 · 8 citations*
46. **[Cardinality Quantifiers in MLO over Trees ↗](https://doi.org/10.1007/978-3-642-04027-6_11) Lecture notes in computer science · no summary yet**Vince Bárány, Łukasz Kaiser, Alexander Rabinovich*2009 · 7 citations*
47. **[A Unified Approach to Boundedness Properties in MSO ↗](https://doi.org/10.18154/rwth-conv-211031) DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · no summary yet**Łukasz Kaiser et al.*2015 · 5 citations*
48. **[Expressing cardinality quantifiers in monadic second-order logic over chains ↗](https://doi.org/10.2178/jsl/1305810766) Journal of Symbolic Logic · no summary yet**Vince Bárány, Łukasz Kaiser, Alexander Rabinovich*2011 · 5 citations*
49. **[Directed Graphs of Entanglement Two ↗](https://doi.org/10.1007/978-3-642-03409-1_16) Lecture notes in computer science · no summary yet**Erich Grädel, Łukasz Kaiser, Roman Rabinovich*2009 · 5 citations*
50. **[Game Quantification on Automatic Structures and Hierarchical Model Checking Games ↗](https://doi.org/10.1007/11874683_27) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2006 · 5 citations*
51. **[Learning Games from Videos Guided by Descriptive Complexity ↗](https://doi.org/10.1609/aaai.v26i1.8312) Proceedings of the AAAI Conference on Artificial Intelligence · no summary yet**Łukasz Kaiser*5 citations*
52. **[Model Checking the Quantitative mu-Calculus on Linear Hybrid Systems ↗](https://doi.org/10.2168/lmcs-8(3:21)2012) Logical Methods in Computer Science · no summary yet**Diana Fischer, Łukasz Kaiser*2012 · 4 citations*
53. **[Model Checking the Quantitative μ-Calculus on Linear Hybrid Systems ↗](https://doi.org/10.1007/978-3-642-22012-8_32) Lecture notes in computer science · no summary yet**Diana Fischer, Łukasz Kaiser*2011 · 4 citations*
54. **[Cardinality and counting quantifiers on omega-automatic structures ↗](https://doi.org/10.4230/lipics.stacs.2008.1360) arXiv (Cornell University) · no summary yet**Łukasz Kaiser, Sasha Rubin, Vince Bárány*2008 · 4 citations*
55. **[Confluence of Right Ground Term Rewriting Systems Is Decidable ↗](https://doi.org/10.1007/978-3-540-31982-5_30) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2005 · 4 citations*
56. **[Q-Value Weighted Regression: Reinforcement Learning with Limited Data ↗](https://doi.org/10.1109/ijcnn55064.2022.9892633) 2022 International Joint Conference on Neural Networks (IJCNN) · no summary yet**Piotr Kozakowski et al.*2022 · 3 citations*
57. **[Directed Width Measures and Monotonicity of Directed Graph Searching ↗](https://arxiv.org/abs/1408.4745) arXiv (Cornell University) · no summary yet**Łukasz Kaiser et al.*2014 · 3 citations*
58. **[The Field of Reals is not omega-Automatic ↗](https://doi.org/10.4230/lipics.stacs.2012.577) DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · no summary yet**Faried Abu Zaid, Erich Grädel, Łukasz Kaiser*2012 · 3 citations*
59. **[Logic and Games on Automatic Structures: Playing with Quantifiers and Decompositions ↗](https://openalex.org/W78042926) no summary yet**Łukasz Kaiser*2011 · 3 citations*
60. **[Forecasting Deep Learning Dynamics with Applications to Hyperparameter Tuning ↗](https://openalex.org/W3005697398) no summary yet**Piotr Kozakowski, Łukasz Kaiser, Afroz Mohiuddin*2019 · 2 citations*
61. **[Area Attention ↗](https://arxiv.org/abs/1810.10126) arXiv (Cornell University) · no summary yet**Yang Li et al.*2018 · 2 citations*
62. **[Model-Theoretic Properties of ω-Automatic Structures ↗](https://doi.org/10.1007/s00224-013-9508-6) Theory of Computing Systems · no summary yet**Faried Abu Zaid et al.*2013 · 2 citations*
63. **[Imperfect Recall and Counter Games ↗](https://openalex.org/W2580276323) no summary yet**Dietmar Berwanger, Simon Robert Leßenich, Łukasz Kaiser*2011 · 2 citations*
64. **[Logic and Games on Automatic Structures ↗](https://doi.org/10.1007/978-3-642-22807-0) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 2 citations*
65. **[CUBBITT Translation Models (en-cs) (v1.0) ↗](http://hdl.handle.net/11234/1-3733) Lindat/Clarin Repository (Lindat Clarin) · no summary yet**Popel, Martin et al.*2021 · 1 citation*
66. **[A Counting Logic for Structure Transition Systems ↗](https://doi.org/10.4230/lipics.csl.2012.366) DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · no summary yet**Łukasz Kaiser, Simon Robert Leßenich*2012 · 1 citation*
67. **[Cardinality Quantifiers in MSO on Linear Orders ↗](https://doi.org/10.1007/978-3-642-22807-0_6) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
68. **[Cardinality Quantifiers in MSO on Trees ↗](https://doi.org/10.1007/978-3-642-22807-0_7) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
69. **[Counting Quantifiers on Automatic Structures ↗](https://doi.org/10.1007/978-3-642-22807-0_5) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
70. **[Game Quantifiers on Automatic Presentations ↗](https://doi.org/10.1007/978-3-642-22807-0_2) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
71. **[Games for Model Checking on Automatic Structures ↗](https://doi.org/10.1007/978-3-642-22807-0_3) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
72. **[Memory Structures for Infinitary Games ↗](https://doi.org/10.1007/978-3-642-22807-0_4) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011 · 1 citation*
73. **[Playing General Structure Rewriting Games ↗](https://doi.org/10.2991/agi.2010.23) no summary yet**Łukasz Kaiser, Łukasz Stafiniak*2010 · 1 citation*
74. **[Program Search as a Path to Artificial General Intelligence ↗](https://doi.org/10.1007/978-3-540-68677-4_9) Cognitive technologies · no summary yet**Łukasz Kaiser*2007 · 1 citation*
75. **[tsGT: Stochastic Time Series Modeling With Transformer ↗](https://arxiv.org/abs/2403.05713) arXiv (Cornell University) · no summary yet**Łukasz Kuciński et al.*2024*
76. **[CUBBITT Translation Models (en-pl) (v1.0) ↗](http://hdl.handle.net/11234/1-3742) Lindat/Clarin Repository (Lindat Clarin) · no summary yet**Popel, Martin et al.*2021*
77. **[CUBBITT Translation Models (en-fr) (v1.0) ↗](http://hdl.handle.net/11234/1-3743) Lindat/Clarin Repository (Lindat Clarin) · no summary yet**Martin Popel et al.*2021*
78. **[Large Scale Multi-Domain Multi-Task Learning with MultiModel ↗](https://openalex.org/W2785866442) no summary yet**Łukasz Kaiser et al.*2018*
79. **[L.: Experiments with reduction finding ↗](https://openalex.org/W7095598086) no summary yet**Charles Harold Jordan, Łukasz Kaiser*2013*
80. **[Learning Programs as Logical Queries Type 1 Paper ↗](https://openalex.org/W7097879472) no summary yet**Charles Harold Jordan, Łukasz Kaiser*2013*
81. **[The Field of Reals is not ω-Automatic ↗](https://doi.org/10.18154/rwth-conv-211654) RWTH Publications (RWTH Aachen) · no summary yet**Faried Abu Zaid, Erich Grädel, Łukasz Kaiser*2012*
82. **[Logics, Structures and Presentations ↗](https://doi.org/10.1007/978-3-642-22807-0_1) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011*
83. **[Outlook ↗](https://doi.org/10.1007/978-3-642-22807-0_8) Lecture notes in computer science · no summary yet**Łukasz Kaiser*2011*
84. **[www.stacs-conf.org MODEL CHECKING GAMES FOR THE QUANTITATIVE µ-CALCULUS ↗](https://openalex.org/W7098638430) no summary yet**Diana Fischer, Erich Gr Ädel, Łukasz Kaiser*2008*
85. **[Logic and games on automatic structures ↗](https://publications.rwth-aachen.de/search?p=id:%22RWTH-CONV-112921%22) RWTH Publications (RWTH Aachen) · no summary yet**Łukasz Kaiser, Erich Grädel*2008*