--- title: "Peter Izsak — author profile and papers — Elamur Research" description: "Peter Izsak, Intel: 2 papers on Elamur Research (2022–2024), h-index 7 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/peter-izsak/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/peter-izsak/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Peter Izsak # Peter Izsak Peter Izsak has 2 papers in our library, in 2022–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Adi Haviv](https://md.research.elamur.ai/free/en/authors/adi-haviv/), [Danqi Chen](https://md.research.elamur.ai/free/en/authors/danqi-chen/), [Howard Yen](https://md.research.elamur.ai/free/en/authors/howard-yen/). 2 papers in our library · 2022–2024 [OpenAlex](https://openalex.org/A5081126295) · [**h-index 7**](https://openalex.org/authors/A5081126295) · [22 works](https://openalex.org/works?filter=author.id:A5081126295) · [647 citations](https://openalex.org/works?filter=author.id:A5081126295&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/peter-izsak/#papers) · [🔗 Cited 163 times in our library](https://md.research.elamur.ai/free/en/authors/peter-izsak/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #7188](https://md.research.elamur.ai/free/en/paper-stars/page/72/#star-7188) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Peter+Izsak) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Peter+Izsak) · [dblp](https://dblp.org/search?q=Peter+Izsak) · [ACL Anthology](https://aclanthology.org/search/?q=Peter+Izsak) ## Affiliations [🏢**Intel** Santa Clara · United States 2018–2024 · 8 papers*current*](https://md.research.elamur.ai/free/en/companies/intel/) · [🎓**Princeton University** Princeton · United States 2024 · 1 paper*current*](https://md.research.elamur.ai/free/en/universities/princeton-university/) · [🏢**Intel** Kiryat Gat · Israel 2018–2023 · 7 papers](https://md.research.elamur.ai/free/en/companies/intel-israel/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 4 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/peter-izsak/year/2024/) · [**2022** 1 paper](https://md.research.elamur.ai/free/en/authors/peter-izsak/year/2022/) ## Papers The most cited first (OpenAlex and our library). 1. **[Transformer Language Models without Positional Encodings Still Learn Positional Information](https://md.research.elamur.ai/free/en/papers/haviv-2022-transformer-language-models-positional-encodings/)** *(2022 · 111 citations)* Self-attention in transformers ignores token order, so language models usually receive explicit position information through embeddings or attention biases. 2. **[HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly](https://md.research.elamur.ai/free/en/papers/yen-2024-helmet-evaluate-long-context-language/)** *(2024 · 55 citations)* Developers of long-context language models (LCLMs) tend to report synthetic needle-in-a-haystack (NIAH) scores or a hand-picked set of datasets. ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[How to Train BERT with an Academic Budget ↗](https://aclanthology.org/2021.emnlp-main.831/) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yet**Peter Izsak, Moshe Berchansky, Omer Levy*2021 · 130 citations* 2. [**Transformer Language Models without Positional Encodings Still Learn Positional Information arXiv:2203.16634**Adi Haviv, Ori Ram, Ofir Press, et al.*2022 · 111 citations*](https://md.research.elamur.ai/free/en/papers/haviv-2022-transformer-language-models-positional-encodings/) 3. [**HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly arXiv:2410.02694**Howard Yen, Tianyu Gao, Minmin Hou, et al.*2024 · 55 citations*](https://md.research.elamur.ai/free/en/papers/yen-2024-helmet-evaluate-long-context-language/) ## Co-authors here 7 co-authors with a page, the most papers together first. - [Adi Haviv](https://md.research.elamur.ai/free/en/authors/adi-haviv/) - [Danqi Chen](https://md.research.elamur.ai/free/en/authors/danqi-chen/) - [Howard Yen](https://md.research.elamur.ai/free/en/authors/howard-yen/) - [Ofir Press](https://md.research.elamur.ai/free/en/authors/ofir-press/) - [Omer Levy](https://md.research.elamur.ai/free/en/authors/omer-levy/) - [Ori Ram](https://md.research.elamur.ai/free/en/authors/ori-ram/) - [Tianyu Gao](https://md.research.elamur.ai/free/en/authors/tianyu-gao/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing ## Cited by Papers of our library cite their works 163 times (of the 149,439 papers whose bibliographies we read); [36 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/peter-izsak/cited-by/). Updated 3 November 2026