---
title: "Contrastive Decoding — Li 2022"
description: "Open-ended text generation with large language models faces a tradeoff."
authors: ["Xiang Lisa Li", "Ari Holtzman", "Daniel Fried", "Percy Liang", "Jason Eisner", "Tatsunori Hashimoto", "Luke Zettlemoyer", "Mike Lewis"]
year: 2022
venue: "arXiv:2210.15097"
source: "https://arxiv.org/abs/2210.15097"
doi: "10.48550/arxiv.2210.15097"
arxiv: "2210.15097"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/li-2022-contrastive-decoding-open-ended-text/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/li-2022-contrastive-decoding-open-ended-text/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2022](https://md.research.elamur.ai/free/en/papers/2022/) / Contrastive Decoding: Open-ended Text Generation as Optimization

# Contrastive Decoding: Open-ended Text Generation as Optimization

**Authors:** [Xiang Lisa Li](https://md.research.elamur.ai/free/en/authors/xiang-lisa-li/), [Ari Holtzman](https://md.research.elamur.ai/free/en/authors/ari-holtzman/), [Daniel Fried](https://md.research.elamur.ai/free/en/authors/daniel-fried/), [Percy Liang](https://md.research.elamur.ai/free/en/authors/percy-liang/), [Jason Eisner](https://md.research.elamur.ai/free/en/authors/jason-eisner/), [Tatsunori Hashimoto](https://md.research.elamur.ai/free/en/authors/tatsunori-hashimoto/), [Luke Zettlemoyer](https://md.research.elamur.ai/free/en/authors/luke-zettlemoyer/), [Mike Lewis](https://md.research.elamur.ai/free/en/authors/mike-lewis/) · **Year:** 2022 · **Venue:** arXiv:2210.15097 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2210.15097) · [PDF](https://arxiv.org/pdf/2210.15097) · [DOI 10.48550/arxiv.2210.15097](https://doi.org/10.48550/arxiv.2210.15097) · [arXiv 2210.15097](https://arxiv.org/abs/2210.15097) · [OpenAlex](https://openalex.org/W4307535256)

**Citations:** 8 citations (openalex-snapshot · 2026-10-14) · [238](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Open-ended text generation with large language models faces a tradeoff. Picking the most probable continuation tends to yield short, looping text, while sampling often wanders off topic or loses coherence. The authors introduce contrastive decoding (CD), a training-free, search-based method that pairs two frozen models from the same family: a large "expert" (e.g., OPT-13B, GPT2-XL) and a tiny "amateur" (e.g., OPT-125M, GPT2-small). Small models make the typical generation mistakes, such as repetition and drift, even more often than large ones. CD therefore uses beam search to favor tokens where the expert's log-probability most exceeds the amateur's. An adaptive plausibility constraint limits candidates to tokens the expert itself rates reasonably likely, which blocks rare junk tokens from winning the score. In tests on Wikipedia, news and story continuations, CD beat nucleus, top-k, typical decoding and SimCTG on coherence and matched or improved fluency, by both automatic metrics and human judges. The practical appeal is better generations at almost no extra cost, with no fine-tuning required.

## Key points
- The token score is the difference of log-probabilities, log p_EXP − log p_AMA. Only tokens whose expert probability reaches at least α = 0.1 times the top token's probability are allowed (the V_head constraint).
- The amateur works best when it is the smallest model of the expert's family, and a larger size gap helps. n-gram amateurs are too weak to be useful. Amateur temperature τ in roughly 0.5–1.5 is robust; the paper uses τ = 0.5 for GPT-2 and τ = 1.0 for OPT.
- In the ablations, dropping V_head causes MAUVE to fall from 0.92 to 0.01, a severe loss of fluency. Sampling from the softmaxed CD score instead of searching gives MAUVE 0.85 versus 0.92.
- The amateur is conditioned only on the last prompt token. Giving it the full prompt slightly lowered coherence and fluency.
- Limitation: CD did not help task-oriented generation. For summarization, a small BART amateur scored lower ROUGE than plain beam search. Code: github.com/XiangLi1999/ContrastiveDecoding.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Other](https://md.research.elamur.ai/free/en/shelves/other/)

## Cited by

Cited by

238 papers of our library cite it (of the 140673 whose bibliographies we read); 10 of them have a page here, 228 not yet.

- [DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models](https://md.research.elamur.ai/free/en/papers/chuang-2023-dola-decoding-contrasting-layers-improves/)
- [A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/)
- [Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP](https://md.research.elamur.ai/free/en/papers/khattab-2022-demonstrate-search-predict-composing-retrieval/)
- [Dynamic Model Switching to Mitigate Outdated Knowledge in Large Language Models](https://md.research.elamur.ai/free/en/papers/pinninti-2026-dynamic-model-switching-mitigate-outdated/)
- [Trusting Your Evidence: Hallucinate Less with Context-aware Decoding](https://md.research.elamur.ai/free/en/papers/shi-2024-trusting-your-evidence-hallucinate-less/)
- [SCOTT: Self-Consistent Chain-of-Thought Distillation](https://md.research.elamur.ai/free/en/papers/wang-2023-scott-self-consistent-chain-thought/)
- [Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-factuality-large-language-models/)
- [Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding](https://md.research.elamur.ai/free/en/papers/xia-2024-unlocking-efficiency-large-language-model/)
- [Knowledge Conflicts for LLMs: A Survey](https://md.research.elamur.ai/free/en/papers/xu-2024-knowledge-conflicts-llms-survey/)
- [A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{li2022contrastive,
  title = {{Contrastive Decoding: Open-ended Text Generation as Optimization}},
  author = {Li, Xiang Lisa and Holtzman, Ari and Fried, Daniel and Liang, Percy and Eisner, Jason and Hashimoto, Tatsunori and Zettlemoyer, Luke and Lewis, Mike},
  year = {2022},
  doi = {10.48550/arxiv.2210.15097},
  eprint = {2210.15097},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2210.15097}
}
```

- [← previous Context Matters: A Pragmatic Study of PLMs' Negation Understanding](https://md.research.elamur.ai/free/en/papers/gubelmann-2022-context-matters-pragmatic-study-plms/)
- [next → Contrastive Representation Learning for Cross-Document Coreference Resolution of Events and Entities](https://md.research.elamur.ai/free/en/papers/hsu-2022-contrastive-representation-learning-cross-document/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/en/papers/2022/)

## References

29 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Chen An, Jiangtao Feng, Kai Lv, Lingpeng Kong, Xipeng Qiu, and Xuanjing Huang. 2022. Cont: Contrastive neural text generation. ArXiv, abs/2205.14690. — [arXiv:2205.14690](https://arxiv.org/abs/2205.14690) [find](https://scholar.google.com/scholar?q=Chen+An%2C+Jiangtao+Feng%2C+Kai+Lv%2C+Lingpeng+Kong%2C+Xipeng+Qiu%2C+and+Xuanjing+Huang%2E+2022%2E+Cont%3A+Contrastive+neural+text+generation%2E+ArXiv%2C+abs%2F2205%2E14690%2E+%E2%80%94+%5BarXiv%3A2205%2E14690%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2205%2E14)
2. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chri… [find](https://scholar.google.com/scholar?q=Tom+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+D+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+Sandhini+Agarwal%2C+Ariel+Herbert%2DVoss%2C+Gretchen)
3. Alexandra DeLucia, Aaron Mueller, Xiang Lisa Li, and João Sedoc. 2020. Decoding methods for neural narrative generation. CoRR, abs/2010.07375. [find](https://scholar.google.com/scholar?q=Alexandra+DeLucia%2C+Aaron+Mueller%2C+Xiang+Lisa+Li%2C+and+Jo%C3%A3o+Sedoc%2E+2020%2E+Decoding+methods+for+neural+narrative+generation%2E+CoRR%2C+abs%2F2010%2E07375%2E)
4. Bryan Eikema and Wilker Aziz. 2020. Is map decoding all you need? the inadequacy of the mode in neural machine translation. In COLING, pages 4506–4520. [find](https://scholar.google.com/scholar?q=Bryan+Eikema+and+Wilker+Aziz%2E+2020%2E+Is+map+decoding+all+you+need%3F+the+inadequacy+of+the+mode+in+neural+machine+translation%2E+In+COLING%2C+pages+4506%E2%80%934520%2E) [our card](https://md.research.elamur.ai/free/en/papers/eikema-2020-is-map-decoding-all-you/)
5. Angela Fan, Mike Lewis, and Yann Dauphin. 2018. Hierarchical neural story generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 889–898, Melbourne, Australia. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Angela+Fan%2C+Mike+Lewis%2C+and+Yann+Dauphin%2E+2018%2E+Hierarchical+neural+story+generation%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29)
6. Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021. SimCSE: Simple contrastive learning of sentence embeddings. In Empirical Methods in Natural Language Processing (EMNLP). [find](https://scholar.google.com/scholar?q=Tianyu+Gao%2C+Xingcheng+Yao%2C+and+Danqi+Chen%2E+2021%2E+SimCSE%3A+Simple+contrastive+learning+of+sentence+embeddings%2E+In+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2E) [our card](https://md.research.elamur.ai/free/en/papers/gao-2021-simcse-simple-contrastive-learning-sentence/)
7. H. Paul Grice. 1975. Logic and conversation. In Peter Cole and Jerry L. Morgan, editors, Speech Acts, volume 3 of Syntax and Semantics. [find](https://scholar.google.com/scholar?q=H%2E+Paul+Grice%2E+1975%2E+Logic+and+conversation%2E+In+Peter+Cole+and+Jerry+L%2E+Morgan%2C+editors%2C+Speech+Acts%2C+volume+3+of+Syntax+and+Semantics%2E)
8. He He, Nanyun Peng, and Percy Liang. 2019. Pun generation with surprise. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 1734–1744, Minneapolis, Minnesota. Assoc… [find](https://scholar.google.com/scholar?q=He+He%2C+Nanyun+Peng%2C+and+Percy+Liang%2E+2019%2E+Pun+generation+with+surprise%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Chapter+of+the+Association+for+Computational+Linguistics%3A+Human+Lan)
9. Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020. The curious case of neural text degeneration. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Ari+Holtzman%2C+Jan+Buys%2C+Li+Du%2C+Maxwell+Forbes%2C+and+Yejin+Choi%2E+2020%2E+The+curious+case+of+neural+text+degeneration%2E+In+International+Conference+on+Learning+Representations%2E)
10. Laurence Horn. 1984. Toward a new taxonomy for pragmatic inference: Q-based and r-based implicature. Meaning, form, and use in context: Linguistic applications, 11:42. [find](https://scholar.google.com/scholar?q=Laurence+Horn%2E+1984%2E+Toward+a+new+taxonomy+for+pragmatic+inference%3A+Q%2Dbased+and+r%2Dbased+implicature%2E+Meaning%2C+form%2C+and+use+in+context%3A+Linguistic+applications%2C+11%3A42%2E)
11. Alex M Lamb, Anirudh Goyal ALIAS PARTH GOYAL, Ying Zhang, Saizheng Zhang, Aaron C Courville, and Yoshua Bengio. 2016. Professor forcing: A new algorithm for training recurrent networks. In Advances in Neural Information Processing Systems, volume 29. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Alex+M+Lamb%2C+Anirudh+Goyal+ALIAS+PARTH+GOYAL%2C+Ying+Zhang%2C+Saizheng+Zhang%2C+Aaron+C+Courville%2C+and+Yoshua+Bengio%2E+2016%2E+Professor+forcing%3A+A+new+algorithm+for+training+recurrent+networks%2E+In+Advances+in)
12. Stephen C Levinson. 2000. Presumptive Meanings: The Theory of Generalized Conversational Implicature. MIT Press. [find](https://scholar.google.com/scholar?q=Stephen+C+Levinson%2E+2000%2E+Presumptive+Meanings%3A+The+Theory+of+Generalized+Conversational+Implicature%2E+MIT+Press%2E)
13. Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A diversity-promoting objective function for neural conversation models. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pag… [find](https://scholar.google.com/scholar?q=Jiwei+Li%2C+Michel+Galley%2C+Chris+Brockett%2C+Jianfeng+Gao%2C+and+Bill+Dolan%2E+2016%2E+A+diversity%2Dpromoting+objective+function+for+neural+conversation+models%2E+In+Proceedings+of+the+2016+Conference+of+the+North) [our card](https://md.research.elamur.ai/free/en/papers/li-2016-diversity-promoting-objective-function-neural/)
14. Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4582–… [find](https://scholar.google.com/scholar?q=Xiang+Lisa+Li+and+Percy+Liang%2E+2021%2E+Prefix%2Dtuning%3A+Optimizing+continuous+prompts+for+generation%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+the+11t)
15. Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, and Yejin Choi. 2021. DExperts: Decoding-time controlled text generation with experts and anti-experts. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th I… [find](https://scholar.google.com/scholar?q=Alisa+Liu%2C+Maarten+Sap%2C+Ximing+Lu%2C+Swabha+Swayamdipta%2C+Chandra+Bhagavatula%2C+Noah+A%2E+Smith%2C+and+Yejin+Choi%2E+2021%2E+DExperts%3A+Decoding%2Dtime+controlled+text+generation+with+experts+and+anti%2Dexperts%2E+In+Pr) [our card](https://md.research.elamur.ai/free/en/papers/liu-2021-dexperts-decoding-time-controlled-text/)
16. Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020. On faithfulness and factuality in abstractive summarization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1906–1919, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Joshua+Maynez%2C+Shashi+Narayan%2C+Bernd+Bohnet%2C+and+Ryan+McDonald%2E+2020%2E+On+faithfulness+and+factuality+in+abstractive+summarization%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Comp)
17. Clara Meister, Tiago Pimentel, Gian Wiher, and Ryan Cotterell. 2022. Typical decoding for natural language generation. CoRR, abs/2202.00666. — [arXiv:2202.00666](https://arxiv.org/abs/2202.00666) [find](https://scholar.google.com/scholar?q=Clara+Meister%2C+Tiago+Pimentel%2C+Gian+Wiher%2C+and+Ryan+Cotterell%2E+2022%2E+Typical+decoding+for+natural+language+generation%2E+CoRR%2C+abs%2F2202%2E00666%2E+%E2%80%94+%5BarXiv%3A2202%2E00666%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2202%2E00666%29)
18. Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017. Pointer sentinel mixture models. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Stephen+Merity%2C+Caiming+Xiong%2C+James+Bradbury%2C+and+Richard+Socher%2E+2017%2E+Pointer+sentinel+mixture+models%2E+In+International+Conference+on+Learning+Representations%2E) [our card](https://md.research.elamur.ai/free/en/papers/merity-2016-pointer-sentinel-mixture-models/)
19. Romain Paulus, Caiming Xiong, and Richard Socher. 2018. A deep reinforced model for abstractive summarization. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Romain+Paulus%2C+Caiming+Xiong%2C+and+Richard+Socher%2E+2018%2E+A+deep+reinforced+model+for+abstractive+summarization%2E+In+International+Conference+on+Learning+Representations%2E) [our card](https://md.research.elamur.ai/free/en/papers/paulus-2017-deep-reinforced-model-abstractive-summarization/)
20. Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, John Thickstun, Sean Welleck, Yejin Choi, and Zaid Harchaoui. 2021. MAUVE: Measuring the gap between neural text and human text using divergence frontiers. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Krishna+Pillutla%2C+Swabha+Swayamdipta%2C+Rowan+Zellers%2C+John+Thickstun%2C+Sean+Welleck%2C+Yejin+Choi%2C+and+Zaid+Harchaoui%2E+2021%2E+MAUVE%3A+Measuring+the+gap+between+neural+text+and+human+text+using+divergence+fr) [our card](https://md.research.elamur.ai/free/en/papers/pillutla-2021-mauve-measuring-gap-between-neural/)
21. Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. [https://openai.com/blog/better-language-models/](https://openai.com/blog/better-language-models/). [↗](https://openai.com/blog/better-language-models/)
22. Marc’Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. 2016. Sequence level training with recurrent neural networks. In 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings. [find](https://scholar.google.com/scholar?q=Marc%E2%80%99Aurelio+Ranzato%2C+Sumit+Chopra%2C+Michael+Auli%2C+and+Wojciech+Zaremba%2E+2016%2E+Sequence+level+training+with+recurrent+neural+networks%2E+In+4th+International+Conference+on+Learning+Representations%2C+ICLR+) [our card](https://md.research.elamur.ai/free/en/papers/ranzato-2015-sequence-level-training-recurrent-neural/)
23. Yixuan Su and Nigel Collier. 2022. Contrastive search is what you need for neural text generation. arXiv preprint arXiv:2210.14140. — [arXiv:2210.14140](https://arxiv.org/abs/2210.14140) [find](https://scholar.google.com/scholar?q=Yixuan+Su+and+Nigel+Collier%2E+2022%2E+Contrastive+search+is+what+you+need+for+neural+text+generation%2E+arXiv+preprint+arXiv%3A2210%2E14140%2E+%E2%80%94+%5BarXiv%3A2210%2E14140%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2210%2E14140%29)
24. Yixuan Su, Tian Lan, Yan Wang, Dani Yogatama, Lingpeng Kong, and Nigel Collier. 2022. A contrastive framework for neural text generation. Neurips, abs/2202.06417. — [arXiv:2202.06417](https://arxiv.org/abs/2202.06417) [find](https://scholar.google.com/scholar?q=Yixuan+Su%2C+Tian+Lan%2C+Yan+Wang%2C+Dani+Yogatama%2C+Lingpeng+Kong%2C+and+Nigel+Collier%2E+2022%2E+A+contrastive+framework+for+neural+text+generation%2E+Neurips%2C+abs%2F2202%2E06417%2E+%E2%80%94+%5BarXiv%3A2202%2E06417%5D%28https%3A%2F%2Farxiv%2Eor)
25. Arun Venkatraman, Martial Hebert, and J.. Bagnell. 2015. Improving multi-step prediction of learned time series models. Proceedings of the AAAI Conference on Artificial Intelligence, 29(1). [find](https://scholar.google.com/scholar?q=Arun+Venkatraman%2C+Martial+Hebert%2C+and+J%2E%2E+Bagnell%2E+2015%2E+Improving+multi%2Dstep+prediction+of+learned+time+series+models%2E+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+29%281%29%2E)
26. Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan, Kyunghyun Cho, and Jason Weston. 2020. Neural text generation with unlikelihood training. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Sean+Welleck%2C+Ilia+Kulikov%2C+Stephen+Roller%2C+Emily+Dinan%2C+Kyunghyun+Cho%2C+and+Jason+Weston%2E+2020%2E+Neural+text+generation+with+unlikelihood+training%2E+In+International+Conference+on+Learning+Representatio) [our card](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/)
27. Sam Wiseman and Alexander M. Rush. 2016. Sequence-to-sequence learning as beam-search optimization. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1296–1306, Austin, Texas. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sam+Wiseman+and+Alexander+M%2E+Rush%2E+2016%2E+Sequence%2Dto%2Dsequence+learning+as+beam%2Dsearch+optimization%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+129)
28. Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, et al. 2016. Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint arXiv:1609.08144. [find](https://scholar.google.com/scholar?q=Yonghui+Wu%2C+Mike+Schuster%2C+Zhifeng+Chen%2C+Quoc+V+Le%2C+Mohammad+Norouzi%2C+Wolfgang+Macherey%2C+Maxim+Krikun%2C+Yuan+Cao%2C+Qin+Gao%2C+Klaus+Macherey%2C+et+al%2E+2016%2E+Google%E2%80%99s+neural+machine+translation+system%3A+Bridg)
29. Yukun Zhu, Ryan Kiros, Richard Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In arXiv preprint arXiv:1506.06724. [find](https://scholar.google.com/scholar?q=Yukun+Zhu%2C+Ryan+Kiros%2C+Richard+Zemel%2C+Ruslan+Salakhutdinov%2C+Raquel+Urtasun%2C+Antonio+Torralba%2C+and+Sanja+Fidler%2E+2015%2E+Aligning+books+and+movies%3A+Towards+story%2Dlike+visual+explanations+by+watching+movi) [our card](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/)