---
title: "Evaluating Verifiability in Generative Search — Liu 2023"
description: "Generative search engines answer queries with synthesized text that contains in-line citations, but it is unclear whether those citations actually back…"
authors: ["Nelson Liu", "Tianyi Zhang", "Percy Liang"]
year: 2023
venue: "Findings of the Association for Computational Linguistics: EMNLP 2023"
source: "https://aclanthology.org/2023.findings-emnlp.467/"
doi: "10.18653/v1/2023.findings-emnlp.467"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/liu-2023-evaluating-verifiability-generative-search-engines/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2023-evaluating-verifiability-generative-search-engines/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/2/) / Evaluating Verifiability in Generative Search Engines

# Evaluating Verifiability in Generative Search Engines

**Authors:** [Nelson Liu](https://md.research.elamur.ai/free/en/authors/nelson-liu/), [Tianyi Zhang](https://md.research.elamur.ai/free/en/authors/tianyi-zhang/), [Percy Liang](https://md.research.elamur.ai/free/en/authors/percy-liang/) · **Year:** 2023 · **Venue:** Findings of the Association for Computational Linguistics: EMNLP 2023 · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2023.findings-emnlp.467/) · [PDF](https://aclanthology.org/2023.findings-emnlp.467.pdf) · [DOI 10.18653/v1/2023.findings-emnlp.467](https://doi.org/10.18653/v1/2023.findings-emnlp.467) · [OpenAlex](https://openalex.org/W4389518954)

**Citations:** 137 citations (openalex-snapshot · 2026-10-14) · [157](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Generative search engines answer queries with synthesized text that contains in-line citations, but it is unclear whether those citations actually back up the claims. The authors call this property verifiability and audit four commercial systems (Bing Chat, NeevaAI, perplexity.ai and YouChat) through human evaluation. The queries come from varied sources, including historical Google searches from NaturalQuestions and open-ended questions collected from Reddit.

Annotators rated each response for fluency and perceived utility on Likert scales. They also checked sentence-level support to compute two proposed metrics, plus a combined citation F1:
- **Citation recall:** the share of verification-worthy sentences that their citations fully back.
- **Citation precision:** the share of citations that genuinely support their sentence.

The answers read smoothly and look helpful. However, only about half of the sentences are fully supported, and roughly one in four citations fails to support its claim. Moreover, the systems judged most useful tend to cite least accurately. Because these tools already reach millions of users, the study exposes a real trust gap and supplies metrics and data for building more reliable systems.

## Key points
- Average citation recall across the four engines is 51.5%, and average citation precision is 74.5%.
- Perceived utility and citation precision are strongly negatively correlated across systems (r = −0.96).
- Higher precision appears to come from copying or closely paraphrasing cited pages: BLEU and BERTScore similarity to the cited evidence correlates with precision at r = 0.80.
- Statements are evaluated at the sentence level. Partially supporting citations count toward precision only in restricted cases, and finer-grained claim splitting is left for future work.
- 34 annotators carried out the evaluation, and the annotations are released at github.com/nelson-liu/evaluating-verifiability-in-generative-search-engines.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

157 papers of our library cite it (of the 140673 whose bibliographies we read); 10 of them have a page here, 147 not yet.

- [Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection](https://md.research.elamur.ai/free/en/papers/asai-2023-self-rag-learning-retrieve-generate/)
- [Benchmarking Large Language Models in Retrieval-Augmented Generation](https://md.research.elamur.ai/free/en/papers/chen-2023-benchmarking-large-language-models-retrieval/)
- [Enabling Large Language Models to Generate Text with Citations](https://md.research.elamur.ai/free/en/papers/gao-2023-enabling-large-language-models-generate/)
- [Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection](https://md.research.elamur.ai/free/en/papers/greshake-2023-ve-signed-up-compromising-real/)
- [Evaluating Large Language Models for Health-related Queries with Presuppositions](https://md.research.elamur.ai/free/en/papers/kaur-2024-evaluating-large-language-models-health/)
- [FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation](https://md.research.elamur.ai/free/en/papers/min-2023-factscore-fine-grained-atomic-evaluation/)
- [PragmatiCQA: A Dataset for Pragmatic Question Answering in Conversations](https://md.research.elamur.ai/free/en/papers/qi-2023-pragmaticqa-dataset-pragmatic-question-answering/)
- [MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents](https://md.research.elamur.ai/free/en/papers/tang-2024-minicheck-efficient-fact-checking-llms/)
- [FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation](https://md.research.elamur.ai/free/en/papers/vu-2023-freshllms-refreshing-large-language-models/)
- [How Language Model Hallucinations Can Snowball](https://md.research.elamur.ai/free/en/papers/zhang-2023-language-model-hallucinations-snowball/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{liu2023evaluating,
  title = {{Evaluating Verifiability in Generative Search Engines}},
  author = {Liu, Nelson and Zhang, Tianyi and Liang, Percy},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2023},
  year = {2023},
  doi = {10.18653/v1/2023.findings-emnlp.467},
  url = {https://doi.org/10.18653/v1/2023.findings-emnlp.467}
}
```

- [← previous Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4](https://md.research.elamur.ai/free/en/papers/liu-2023-evaluating-logical-reasoning-ability-chatgpt/)
- [next → Exclaiming non-sententially: exclamative sluices and the (non-elliptical) nature of ellipsis constructions](https://md.research.elamur.ai/free/en/papers/ginzburg-2023-exclaiming-non-sententially-exclamative-sluices/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/2/)

## References

26 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Michiel Bakker, Martin Chadwick, Hannah Sheahan, Michael Tessler, Lucy Campbell-Gillingham, Jan Balaguer, Nat McAleese, Amelia Glaese, John Aslanides, Matt Botvinick, and Christopher Summerfield. 2022. Fine-tuning language models to find agreement among humans with diverse preferences. In Proc. of N… [find](https://scholar.google.com/scholar?q=Michiel+Bakker%2C+Martin+Chadwick%2C+Hannah+Sheahan%2C+Michael+Tessler%2C+Lucy+Campbell%2DGillingham%2C+Jan+Balaguer%2C+Nat+McAleese%2C+Amelia+Glaese%2C+John+Aslanides%2C+Matt+Botvinick%2C+and+Christopher+Summerfield%2E+2022)
2. Abeba Birhane, Vinay Uday Prabhu, and John Whaley. 2022. Auditing saliency cropping algorithms. In Proc. of WACV. [find](https://scholar.google.com/scholar?q=Abeba+Birhane%2C+Vinay+Uday+Prabhu%2C+and+John+Whaley%2E+2022%2E+Auditing+saliency+cropping+algorithms%2E+In+Proc%2E+of+WACV%2E)
3. Bernd Bohnet, Vinh Q. Tran, Pat Verga, Roee Aharoni, Daniel Andor, Livio Baldini Soares, Massimiliano Ciaramita, Jacob Eisenstein, Kuzman Ganchev, Jonathan Herzig, Kai Hui, Tom Kwiatkowski, Ji Ma, Jianmo Ni, Lierni Sestorain Saralegui, Tal Schuster, William W. Cohen, Michael Collins, Dipanjan Das, D… [find](https://scholar.google.com/scholar?q=Bernd+Bohnet%2C+Vinh+Q%2E+Tran%2C+Pat+Verga%2C+Roee+Aharoni%2C+Daniel+Andor%2C+Livio+Baldini+Soares%2C+Massimiliano+Ciaramita%2C+Jacob+Eisenstein%2C+Kuzman+Ganchev%2C+Jonathan+Herzig%2C+Kai+Hui%2C+Tom+Kwiatkowski%2C+Ji+Ma%2C+Jia) [our card](https://md.research.elamur.ai/free/en/papers/bohnet-2022-attributed-question-answering-evaluation-modeling/)
4. Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proc. of FAccT. [find](https://scholar.google.com/scholar?q=Joy+Buolamwini+and+Timnit+Gebru%2E+2018%2E+Gender+shades%3A+Intersectional+accuracy+disparities+in+commercial+gender+classification%2E+In+Proc%2E+of+FAccT%2E)
5. Sihao Chen, Daniel Khashabi, Wenpeng Yin, Chris Callison-Burch, and Dan Roth. 2019. Seeing things from a different angle: Discovering diverse perspectives about claims. In Proc. of NAACL. [find](https://scholar.google.com/scholar?q=Sihao+Chen%2C+Daniel+Khashabi%2C+Wenpeng+Yin%2C+Chris+Callison%2DBurch%2C+and+Dan+Roth%2E+2019%2E+Seeing+things+from+a+different+angle%3A+Discovering+diverse+perspectives+about+claims%2E+In+Proc%2E+of+NAACL%2E)
6. Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019. ELI5: Long form question answering. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Angela+Fan%2C+Yacine+Jernite%2C+Ethan+Perez%2C+David+Grangier%2C+Jason+Weston%2C+and+Michael+Auli%2E+2019%2E+ELI5%3A+Long+form+question+answering%2E+In+Proc%2E+of+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/fan-2019-eli5-long-form-question-answering/)
7. Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Y. Zhao, Ni Lao, Hongrae Lee, Da-Cheng Juan, and Kelvin Guu. 2022. RARR: Researching and revising what language models say, using language models. ArXiv:2210.08726. [find](https://scholar.google.com/scholar?q=Luyu+Gao%2C+Zhuyun+Dai%2C+Panupong+Pasupat%2C+Anthony+Chen%2C+Arun+Tejasvi+Chaganty%2C+Yicheng+Fan%2C+Vincent+Y%2E+Zhao%2C+Ni+Lao%2C+Hongrae+Lee%2C+Da%2DCheng+Juan%2C+and+Kelvin+Guu%2E+2022%2E+RARR%3A+Researching+and+revising+what) [our card](https://md.research.elamur.ai/free/en/papers/gao-2023-rarr-researching-revising-what-language/)
8. Amelia Glaese, Nat McAleese, Maja Tr˛ebacz, John Aslanides, Vlad Firoiu, Timo Ewalds, Maribeth Rauh, Laura Weidinger, Martin Chadwick, Phoebe Thacker, Lucy Campbell-Gillingham, Jonathan Uesato, Po-Sen Huang, Ramona Comanescu, Fan Yang, Abigail See, Sumanth Dathathri, Rory Greig, Charlie Chen, Doug F… [find](https://scholar.google.com/scholar?q=Amelia+Glaese%2C+Nat+McAleese%2C+Maja+Tr%CB%9Bebacz%2C+John+Aslanides%2C+Vlad+Firoiu%2C+Timo+Ewalds%2C+Maribeth+Rauh%2C+Laura+Weidinger%2C+Martin+Chadwick%2C+Phoebe+Thacker%2C+Lucy+Campbell%2DGillingham%2C+Jonathan+Uesato%2C+Po%2DSen) [our card](https://md.research.elamur.ai/free/en/papers/glaese-2022-improving-alignment-dialogue-agents-targeted/)
9. Ben Green and Yiling Chen. 2019. Disparate interactions: An algorithm-in-the-loop analysis of fairness in risk assessments. In Proc. of FAccT. [find](https://scholar.google.com/scholar?q=Ben+Green+and+Yiling+Chen%2E+2019%2E+Disparate+interactions%3A+An+algorithm%2Din%2Dthe%2Dloop+analysis+of+fairness+in+risk+assessments%2E+In+Proc%2E+of+FAccT%2E)
10. Svetlana Kiritchenko and Saif Mohammad. 2018. Examining gender and race bias in two hundred sentiment analysis systems. In Proc. of *SEM. [find](https://scholar.google.com/scholar?q=Svetlana+Kiritchenko+and+Saif+Mohammad%2E+2018%2E+Examining+gender+and+race+bias+in+two+hundred+sentiment+analysis+systems%2E+In+Proc%2E+of+%2ASEM%2E) [our card](https://md.research.elamur.ai/free/en/papers/kiritchenko-2018-examining-gender-race-bias-two/)
11. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. Natural… [find](https://scholar.google.com/scholar?q=Tom+Kwiatkowski%2C+Jennimaria+Palomaki%2C+Olivia+Redfield%2C+Michael+Collins%2C+Ankur+Parikh%2C+Chris+Alberti%2C+Danielle+Epstein%2C+Illia+Polosukhin%2C+Jacob+Devlin%2C+Kenton+Lee%2C+Kristina+Toutanova%2C+Llion+Jones%2C+Matt) [our card](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
12. Faisal Ladhak, Esin Durmus, He He, Claire Cardie, and Kathleen McKeown. 2022. Faithful or extractive? on mitigating the faithfulness-abstractiveness trade-off in abstractive summarization. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Faisal+Ladhak%2C+Esin+Durmus%2C+He+He%2C+Claire+Cardie%2C+and+Kathleen+McKeown%2E+2022%2E+Faithful+or+extractive%3F+on+mitigating+the+faithfulness%2Dabstractiveness+trade%2Doff+in+abstractive+summarization%2E+In+Proc%2E+of)
13. Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellste… [find](https://scholar.google.com/scholar?q=Amin+Ghafouri%2C+Marcelo+Menegali%2C+Yanping+Huang%2C+Maxim+Krikun%2C+Dmitry+Lepikhin%2C+James+Qin%2C+Dehao+Chen%2C+Yuanzhong+Xu%2C+Zhifeng+Chen%2C+Adam+Roberts%2C+Maarten+Bosma%2C+Vincent+Zhao%2C+Yanqi+Zhou%2C+Chung%2DChing+Cha) [our card](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
14. Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020. On faithfulness and factuality in abstractive summarization. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Joshua+Maynez%2C+Shashi+Narayan%2C+Bernd+Bohnet%2C+and+Ryan+McDonald%2E+2020%2E+On+faithfulness+and+factuality+in+abstractive+summarization%2E+In+Proc%2E+of+ACL%2E)
15. Yusuf Mehdi. 2023. The new Bing and Edge – progress from our first month \| Bing search blog. Accessed on March 28, 2023. [find](https://scholar.google.com/scholar?q=Yusuf+Mehdi%2E+2023%2E+The+new+Bing+and+Edge+%E2%80%93+progress+from+our+first+month+%5C%7C+Bing+search+blog%2E+Accessed+on+March+28%2C+2023%2E)
16. Jacob Menick, Maja Trebacz, Vladimir Mikulik, John Aslanides, Francis Song, Martin Chadwick, Mia Glaese, Susannah Young, Lucy Campbell-Gillingham, Geoffrey Irving, and Nat McAleese. 2022. Teaching language models to support answers with verified quotes. ArXiv:2203.11147. [find](https://scholar.google.com/scholar?q=Jacob+Menick%2C+Maja+Trebacz%2C+Vladimir+Mikulik%2C+John+Aslanides%2C+Francis+Song%2C+Martin+Chadwick%2C+Mia+Glaese%2C+Susannah+Young%2C+Lucy+Campbell%2DGillingham%2C+Geoffrey+Irving%2C+and+Nat+McAleese%2E+2022%2E+Teaching+lan) [our card](https://md.research.elamur.ai/free/en/papers/menick-2022-teaching-language-models-support-answers/)
17. Danaë Metaxa, Joon Sung Park, James A. Landay, and Jeff Hancock. 2019. Search media and elections: A longitudinal investigation of political search results. In Proc. of CSCW. [find](https://scholar.google.com/scholar?q=Dana%C3%AB+Metaxa%2C+Joon+Sung+Park%2C+James+A%2E+Landay%2C+and+Jeff+Hancock%2E+2019%2E+Search+media+and+elections%3A+A+longitudinal+investigation+of+political+search+results%2E+In+Proc%2E+of+CSCW%2E)
18. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. BERTScore: Evaluating text generation with BERT. In Proc. of ICLR. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020%2E+BERTScore%3A+Evaluating+text+generation+with+BERT%2E+In+Proc%2E+of+ICLR%2E)
19. Panagiotis Takis Metaxas and Yada Pruksachatkun. 2017. Manipulation of search engine results during the 2016 us congressional elections. [find](https://scholar.google.com/scholar?q=Panagiotis+Takis+Metaxas+and+Yada+Pruksachatkun%2E+2017%2E+Manipulation+of+search+engine+results+during+the+2016+us+congressional+elections%2E)
20. Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. 2021. WebGPT: Browser-assis… [find](https://scholar.google.com/scholar?q=Reiichiro+Nakano%2C+Jacob+Hilton%2C+Suchir+Balaji%2C+Jeff+Wu%2C+Long+Ouyang%2C+Christina+Kim%2C+Christopher+Hesse%2C+Shantanu+Jain%2C+Vineet+Kosaraju%2C+William+Saunders%2C+Xu+Jiang%2C+Karl+Cobbe%2C+Tyna+Eloundou%2C+Gretchen+K) [our card](https://md.research.elamur.ai/free/en/papers/nakano-2021-webgpt-browser-assisted-question-answering/)
21. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+BLEU%3A+a+method+for+automatic+evaluation+of+machine+translation%2E+In+Proc%2E+of+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
22. Denis Peskoff and Brandon Stewart. 2023. Credible without credit: Domain experts assess generative language models. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Denis+Peskoff+and+Brandon+Stewart%2E+2023%2E+Credible+without+credit%3A+Domain+experts+assess+generative+language+models%2E+In+Proc%2E+of+ACL%2E)
23. Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vladimir Karpukhin, Jean Maillard, Vassilis Plachouras, Tim Rocktäschel, and Sebastian Riedel. 2021. KILT: a benchmark for knowledge intensive language tasks. In Proc. of NAACL. [find](https://scholar.google.com/scholar?q=Fabio+Petroni%2C+Aleksandra+Piktus%2C+Angela+Fan%2C+Patrick+Lewis%2C+Majid+Yazdani%2C+Nicola+De+Cao%2C+James+Thorne%2C+Yacine+Jernite%2C+Vladimir+Karpukhin%2C+Jean+Maillard%2C+Vassilis+Plachouras%2C+Tim+Rockt%C3%A4schel%2C+and+Se) [our card](https://md.research.elamur.ai/free/en/papers/petroni-2020-kilt-benchmark-knowledge-intensive-language/)
24. Hannah Rashkin, Vitaly Nikolaev, Matthew Lamm, Lora Aroyo, Michael Collins, Dipanjan Das, Slav Petrov, Gaurav Singh Tomar, Iulia Turc, and David Reitter. 2022. Measuring attribution in natural language generation models. ArXiv:2112.12870. [find](https://scholar.google.com/scholar?q=Hannah+Rashkin%2C+Vitaly+Nikolaev%2C+Matthew+Lamm%2C+Lora+Aroyo%2C+Michael+Collins%2C+Dipanjan+Das%2C+Slav+Petrov%2C+Gaurav+Singh+Tomar%2C+Iulia+Turc%2C+and+David+Reitter%2E+2022%2E+Measuring+attribution+in+natural+languag) [our card](https://md.research.elamur.ai/free/en/papers/rashkin-2023-measuring-attribution-natural-language-generation/)
25. Ronald E. Robertson, David Lazer, and Christo Wilson. 2018. Auditing the personalization and composition of politically-related search engine results pages. In Proc. of WWW. [find](https://scholar.google.com/scholar?q=Ronald+E%2E+Robertson%2C+David+Lazer%2C+and+Christo+Wilson%2E+2018%2E+Auditing+the+personalization+and+composition+of+politically%2Drelated+search+engine+results+pages%2E+In+Proc%2E+of+WWW%2E)
26. Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, [find](https://scholar.google.com/scholar?q=Romal+Thoppilan%2C+Daniel+De+Freitas%2C+Jamie+Hall%2C+Noam+Shazeer%2C+Apoorv+Kulshreshtha%2C+Heng%2DTze+Cheng%2C+Alicia+Jin%2C+Taylor+Bos%2C+Leslie+Baker%2C+Yu+Du%2C+YaGuang+Li%2C+Hongrae+Lee%2C+Huaixiu+Steven+Zheng%2C)
