--- title: "Ilia Kulikov — author profile and papers" description: "Ilia Kulikov, Physikalisch-Technische Bundesanstalt: 2 papers on Elamur Research (2019–2020), h-index 11 — affiliations, topics, co-authors and who cites…" canonical: "https://research.elamur.ai/free/en/authors/ilia-kulikov/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/ilia-kulikov/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Ilia Kulikov # Ilia Kulikov Ilia Kulikov works on neural text generation and [dialogue systems](https://md.research.elamur.ai/free/en/topics/dialogue-systems/), with a focus on how the training objective of a language model shapes the text it produces. Their papers here ask why models trained purely by maximum likelihood drift toward bland, repetitive and sometimes self-contradictory output. They answer by changing the loss function itself rather than adjusting the search or sampling procedure used at decoding time. The work sits within [text generation](https://md.research.elamur.ai/free/en/topics/text-generation/) and pairs a new objective with careful diagnosis of specific failure modes. The most cited of these papers, [Neural Text Generation with Unlikelihood Training](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/) (2019), contends that much of the degeneration seen in generated text comes from the likelihood objective. Decoding tricks such as top-k or nucleus sampling leave the model's probabilities untouched. The paper introduces unlikelihood training, which keeps the ordinary term rewarding correct tokens but adds a penalty that pushes down the probability of selected negative candidates, for instance tokens that have already appeared. The follow-up, [Don't Say That!](https://md.research.elamur.ai/free/en/papers/li-2020-don-t-say-that-making/) (2020), carries the idea into conversation. It turns the loss into a general framework in which the choice of negative candidates and their weights is tuned to particular problems in dialogue agents: copying too heavily from the context, repeating phrases within a reply, leaning on frequent words, and contradicting earlier turns. Kulikov's papers list affiliations with [New York University](https://md.research.elamur.ai/free/en/universities/new-york-university/) and [Meta](https://md.research.elamur.ai/free/en/companies/meta/), and also with [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/). Co-authors on the work here include [Sean Welleck](https://md.research.elamur.ai/free/en/authors/sean-welleck/), [Kyunghyun Cho](https://md.research.elamur.ai/free/en/authors/kyunghyun-cho/), [Jason Weston](https://md.research.elamur.ai/free/en/authors/jason-weston/) and Stephen Roller, along with Emily Dinan and Y-Lan Boureau on the dialogue study. Ilia Kulikov has 2 papers in our library, in 2019–2020, most of them on [Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/), [Dialogue systems](https://md.research.elamur.ai/free/en/topics/dialogue-systems/); often with [Jason Weston](https://md.research.elamur.ai/free/en/authors/jason-weston/), [Kyunghyun Cho](https://md.research.elamur.ai/free/en/authors/kyunghyun-cho/), [Sean Welleck](https://md.research.elamur.ai/free/en/authors/sean-welleck/). 2 papers in our library · 2019–2020 current affiliation [Physikalisch-Technische Bundesanstalt](https://ror.org/05r3f7h03) · Braunschweig Germany; [Federal Institute For Materials Research and Testing](https://ror.org/03x516a66) · Berlin Germany [OpenAlex](https://openalex.org/A5103110668) · [ORCID](https://orcid.org/0000-0001-5989-9733) · [**h-index 11**](https://openalex.org/authors/A5103110668) · [55 works](https://openalex.org/works?filter=author.id:A5103110668) · [812 citations](https://openalex.org/works?filter=author.id:A5103110668&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [2 works in our library](https://md.research.elamur.ai/free/en/authors/ilia-kulikov/#papers) · [853 citations in our library](https://md.research.elamur.ai/free/en/authors/ilia-kulikov/cited-by/) · 5 more works in our library · [⭐ Paper Star rank #2449](https://md.research.elamur.ai/free/en/paper-stars/page/25/#star-2449) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Ilia+Kulikov) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Ilia+Kulikov) · [dblp](https://dblp.org/search?q=Ilia+Kulikov) · [ACL Anthology](https://aclanthology.org/search/?q=Ilia+Kulikov) ## Affiliations [🔬**Federal Institute For Materials Research and Testing** Berlin · Germany 2026 · 1 paper*current*](https://ror.org/03x516a66) · [🏛️**Physikalisch-Technische Bundesanstalt** Braunschweig · Germany 2026 · 1 paper*current*](https://ror.org/05r3f7h03) · [🏢**Meta** Menlo Park · United States 2022–2025 · 9 papers](https://md.research.elamur.ai/free/en/companies/meta/) · [🎓**New York University** New York · United States 2019–2025 · 9 papers](https://md.research.elamur.ai/free/en/universities/new-york-university/) · [🎓**Carnegie Mellon University** Pittsburgh · United States 2022–2024 · 3 papers](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) · [🎓**University of California, Berkeley** Berkeley · United States 2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) · [🎓**RWTH Aachen University** Aachen · Germany 2017 · 2 papers](https://md.research.elamur.ai/free/en/universities/rwth-aachen-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed. ## Topics [Text generation 1](https://md.research.elamur.ai/free/en/topics/text-generation/) · [Dialogue systems 1](https://md.research.elamur.ai/free/en/topics/dialogue-systems/) ## Works by year ### 2020s [**2020** 1 paper](https://md.research.elamur.ai/free/en/papers/li-2020-don-t-say-that-making/) ### 2010s [**2019** 1 paper](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/) ## Papers The most cited first (OpenAlex and our library). 1. **[Neural Text Generation with Unlikelihood Training](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/)** *(2019 · 498 citations)* Language models trained with standard maximum likelihood tend to produce dull text that repeats itself. They overuse frequent words and loop on the same phrases, especially with greedy or beam search. Earlier fixes such as top-k sampling, nucleus sampling and n-gram beam blocking only change how text is decoded. The… 2. **[Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training](https://md.research.elamur.ai/free/en/papers/li-2020-don-t-say-that-making/)** *(2020 · 214 citations)* Generative dialogue models trained only with maximum likelihood show several weaknesses. They copy too much from the context, repeat n-grams inside a single reply, overuse frequent tokens, and can contradict what was said earlier. The authors extend the unlikelihood loss of Welleck et al. (2019a) into a general… ## Also in our library 5 more works of theirs are in our library without a page here yet; they will appear as we publish them. ## Co-authors here 6 co-authors with a page, the most papers together first. - [Jason Weston](https://md.research.elamur.ai/free/en/authors/jason-weston/) ×2 - [Kyunghyun Cho](https://md.research.elamur.ai/free/en/authors/kyunghyun-cho/) ×2 - [Sean Welleck](https://md.research.elamur.ai/free/en/authors/sean-welleck/) ×2 - [Stephen Roller](https://md.research.elamur.ai/free/en/authors/stephen-roller/) ×2 - [Emily Dinan](https://md.research.elamur.ai/free/en/authors/emily-dinan/) - [Y-Lan Boureau](https://md.research.elamur.ai/free/en/authors/y-lan-boureau/) ## Cited by Papers of our library cite their works 853 times (of the 140,884 papers whose bibliographies we read); [74 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/ilia-kulikov/cited-by/).