---
title: "RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers — Wang 2020"
description: "For both problems, they propose a unified encoder, RAT-SQL. 38 references, cited by 239 papers here."
authors: ["Bailin Wang", "Richard Shin", "Xiaodong Liu", "Oleksandr Polozov", "Matthew Richardson"]
year: 2020
venue: "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/2020.acl-main.677/"
doi: "10.18653/v1/2020.acl-main.677"
arxiv: "1911.04942"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2020-rat-sql-relation-aware-schema/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2020-rat-sql-relation-aware-schema/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) / RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

# RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

**Authors:** [Bailin Wang](https://md.research.elamur.ai/free/en/authors/bailin-wang/), Richard Shin, [Xiaodong Liu](https://md.research.elamur.ai/free/en/authors/xiaodong-liu/), [Oleksandr Polozov](https://md.research.elamur.ai/free/en/authors/oleksandr-polozov/) and [Matthew Richardson](https://md.research.elamur.ai/free/en/authors/matthew-richardson/) · **Year:** 2020 · **Venue:** Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.acl-main.677/) · [PDF](https://aclanthology.org/2020.acl-main.677.pdf) · [DOI 10.18653/v1/2020.acl-main.677](https://doi.org/10.18653/v1/2020.acl-main.677) · [arXiv 1911.04942](https://arxiv.org/abs/1911.04942)

**Citations:** [239](https://md.research.elamur.ai/free/en/papers/wang-2020-rat-sql-relation-aware-schema/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary

The paper addresses the translation of natural language questions into SQL queries over databases whose schemas the model has not seen during training. The authors identify two related problems. The first is how to represent the schema structure: tables, columns, and primary and foreign keys. The second is schema linking, that is, determining which columns and tables the words of the question refer to. For both problems, they propose a unified encoder, RAT-SQL. It builds on relation-aware self-attention, which had previously been applied only to relative word positions. RAT-SQL generalizes this mechanism so that it can encode any kind of relation linking the words of the question to elements of the schema. In this way, the model combines predefined "hard" schema relations with "soft" ones that it learns on its own. On the challenging Spider corpus, the approach clearly outperformed previous models, and with BERT it took first place on the leaderboard. This matters for natural language interfaces to databases, since they must work with new schemas. Moreover, the idea is applicable to any input data with a known structure.

## Key points

- Spider, test: exact match accuracy of 57.2% without BERT, 8.7 pp higher than the best counterparts at the time. With BERT, 65.6%, a new state of the art on the leaderboard.
- The encoder receives typed edges between elements: columns from the same table, foreign keys, primary keys, and column-to-table membership. Matching relations between question words and column and table names are added separately.
- Oracle experiment on dev (baseline accuracy 62.7%): with the correct columns, accuracy rises to 69.8%, with the correct query sketch to 73.0%, and with both hints to 99.4%. Hence, most errors combine a wrong choice of columns with a wrong query structure.
- Error analysis on the Spider dev set revealed three main groups. 18% of the incorrect queries are in fact semantically equivalent to the correct ones. 39% involve wrong columns in SELECT, and 29% a missing WHERE condition.
- On WikiSQL, the model was evaluated without BERT and without execution-guided decoding. Its weak point there turned out to be decoding values consisting of multiple tokens. The code is published at github.com/Microsoft/rat-sql.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Computing & GPUs](https://md.research.elamur.ai/free/en/shelves/computing/)

Topics: [💻 Code & programming languages](https://md.research.elamur.ai/free/en/topics/code-and-programming/) · [🧾 Semantic parsing & meaning representation](https://md.research.elamur.ai/free/en/topics/semantic-parsing/)

## Cite

Cite as: Bailin Wang, Richard Shin, Xiaodong Liu, Oleksandr Polozov and Matthew Richardson. 2020. RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wang2020rat,
  title = {{RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers}},
  author = {Bailin Wang, Richard Shin, Xiaodong Liu, Oleksandr Polozov and Matthew Richardson},
  booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.18653/v1/2020.acl-main.677},
  eprint = {1911.04942},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.18653/v1/2020.acl-main.677}
}
```

- [← previous MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems](https://md.research.elamur.ai/free/en/papers/lin-2020-mintl-minimalist-transfer-learning-task/)
- [next → COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs](https://md.research.elamur.ai/free/en/papers/hwang-2020-comet-atomic-2020-symbolic-neural/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/)

## References

38 references, 13 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer Normalization. arXiv:1607.06450. [our card](https://md.research.elamur.ai/free/en/papers/ba-2016-layer-normalization/)
2. Ben Bogin, Jonathan Berant, and Matt Gardner. 2019a. Representing schema structure with graph neural networks for text-to-SQL parsing. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4560–4565. [our card](https://md.research.elamur.ai/free/en/papers/bogin-2019-representing-schema-structure-graph-neural/)
3. Ben Bogin, Matt Gardner, and Jonathan Berant. 2019b. Global reasoning over database structures for text-to-SQL parsing. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP),… [find](https://scholar.google.com/scholar?q=Ben+Bogin%2C+Matt+Gardner%2C+and+Jonathan+Berant%2E+2019b%2E+Global+reasoning+over+database+structures+for+text%2Dto%2DSQL+parsing%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+P)
4. Gino Brunner, Yang Liu, Damian Pascual, Oliver Richter, Massimiliano Ciaramita, and Roger Wattenhofer. 2020. On identifiability in Transformers. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Gino+Brunner%2C+Yang+Liu%2C+Damian+Pascual%2C+Oliver+Richter%2C+Massimiliano+Ciaramita%2C+and+Roger+Wattenhofer%2E+2020%2E+On+identifiability+in+Transformers%2E+In+International+Conference+on+Learning+Representations)
5. DongHyun Choi, Myeong Cheol Shin, EungGyun Kim, and Dong Ryeol Shin. 2020. RYANSQL: Recursively applying sketch-based slot fillings for complex text-to-SQL in cross-domain databases. arXiv preprint arXiv:2004.03125. [find](https://scholar.google.com/scholar?q=DongHyun+Choi%2C+Myeong+Cheol+Shin%2C+EungGyun+Kim%2C+and+Dong+Ryeol+Shin%2E+2020%2E+RYANSQL%3A+Recursively+applying+sketch%2Dbased+slot+fillings+for+complex+text%2Dto%2DSQL+in+cross%2Ddomain+databases%2E+arXiv+preprint+ar)
6. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
7. Li Dong and Mirella Lapata. 2018. Coarse-to-fine decoding for neural semantic parsing. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 731–742, Melbourne, Australia. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Li+Dong+and+Mirella+Lapata%2E+2018%2E+Coarse%2Dto%2Dfine+decoding+for+neural+semantic+parsing%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers)
8. Catherine Finegan-Dollak, Jonathan K. Kummerfeld, Li Zhang, Karthik Ramanathan, Sesh Sadasivam, Rui Zhang, and Dragomir Radev. 2018. Improving Text-to-SQL Evaluation Methodology. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages… [our card](https://md.research.elamur.ai/free/en/papers/dollak-2018-improving-text-sql-evaluation-methodology/)
9. Yarin Gal and Zoubin Ghahramani. 2016. A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. In Advances in Neural Information Processing Systems 29, pages 1019–1027. [our card](https://md.research.elamur.ai/free/en/papers/gal-2015-theoretically-grounded-application-dropout-recurrent/)
10. Jiaqi Guo, Zecheng Zhan, Yan Gao, Yan Xiao, Jian-Guang Lou, Ting Liu, and Dongmei Zhang. 2019. Towards complex text-to-SQL in cross-domain database with intermediate representation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4524–4535. [find](https://scholar.google.com/scholar?q=Jiaqi+Guo%2C+Zecheng+Zhan%2C+Yan+Gao%2C+Yan+Xiao%2C+Jian%2DGuang+Lou%2C+Ting+Liu%2C+and+Dongmei+Zhang%2E+2019%2E+Towards+complex+text%2Dto%2DSQL+in+cross%2Ddomain+database+with+intermediate+representation%2E+In+Proceedings+of+)
11. Pengcheng He, Yi Mao, Kaushik Chakrabarti, and Weizhu Chen. 2019. X-SQL: reinforce schema representation with context. arXiv preprint arXiv:1908.08113. — [arXiv:1908.08113](https://arxiv.org/abs/1908.08113) [find](https://scholar.google.com/scholar?q=Pengcheng+He%2C+Yi+Mao%2C+Kaushik+Chakrabarti%2C+and+Weizhu+Chen%2E+2019%2E+X%2DSQL%3A+reinforce+schema+representation+with+context%2E+arXiv+preprint+arXiv%3A1908%2E08113%2E+%E2%80%94+%5BarXiv%3A1908%2E08113%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1908%2E)
12. Vincent J. Hellendoorn, Charles Sutton, Rishabh Singh, Petros Maniatis, and David Bieber. 2020. Global relational models of source code. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Vincent+J%2E+Hellendoorn%2C+Charles+Sutton%2C+Rishabh+Singh%2C+Petros+Maniatis%2C+and+David+Bieber%2E+2020%2E+Global+relational+models+of+source+code%2E+In+International+Conference+on+Learning+Representations%2E)
13. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8):1735–1780. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+J%C3%BCrgen+Schmidhuber%2E+1997%2E+Long+short%2Dterm+memory%2E+Neural+computation%2C+9%288%29%3A1735%E2%80%931780%2E)
14. Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, and Douglas Eck. 2019. Music Transformer. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Cheng%2DZhi+Anna+Huang%2C+Ashish+Vaswani%2C+Jakob+Uszkoreit%2C+Ian+Simon%2C+Curtis+Hawthorne%2C+Noam+Shazeer%2C+Andrew+M%2E+Dai%2C+Matthew+D%2E+Hoffman%2C+Monica+Dinculescu%2C+and+Douglas+Eck%2E+2019%2E+Music+Transformer%2E+In+Int)
15. Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, and Xiaodong He. 2018. Natural language to structured query generation via meta-learning. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volum… [find](https://scholar.google.com/scholar?q=Po%2DSen+Huang%2C+Chenglong+Wang%2C+Rishabh+Singh%2C+Wen%2Dtau+Yih%2C+and+Xiaodong+He%2E+2018%2E+Natural+language+to+structured+query+generation+via+meta%2Dlearning%2E+In+Proceedings+of+the+2018+Conference+of+the+North+A)
16. Srinivasan Iyer, Ioannis Konstas, Alvin Cheung, Jayant Krishnamurthy, and Luke Zettlemoyer. 2017. Learning a neural semantic parser from user feedback. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 963–973. [find](https://scholar.google.com/scholar?q=Srinivasan+Iyer%2C+Ioannis+Konstas%2C+Alvin+Cheung%2C+Jayant+Krishnamurthy%2C+and+Luke+Zettlemoyer%2E+2017%2E+Learning+a+neural+semantic+parser+from+user+feedback%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the)
17. Amol Kelkar, Rohan Relan, Vaishali Bhardwaj, Saurabh Vaichal, and Peter Relan. 2020. Bertrand-DR: Improving text-to-SQL using a discriminative re-ranker. arXiv preprint arXiv:2002.00557. — [arXiv:2002.00557](https://arxiv.org/abs/2002.00557) [find](https://scholar.google.com/scholar?q=Amol+Kelkar%2C+Rohan+Relan%2C+Vaishali+Bhardwaj%2C+Saurabh+Vaichal%2C+and+Peter+Relan%2E+2020%2E+Bertrand%2DDR%3A+Improving+text%2Dto%2DSQL+using+a+discriminative+re%2Dranker%2E+arXiv+preprint+arXiv%3A2002%2E00557%2E+%E2%80%94+%5BarXiv%3A2002)
18. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Diederik+P%2E+Kingma+and+Jimmy+Ba%2E+2015%2E+Adam%3A+A+Method+for+Stochastic+Optimization%2E+In+International+Conference+on+Learning+Representations%2E)
19. Fei Li and H. V. Jagadish. 2014. Constructing an interactive natural language interface for relational databases. Proceedings of the VLDB Endowment, 8(1):73–84. [find](https://scholar.google.com/scholar?q=Fei+Li+and+H%2E+V%2E+Jagadish%2E+2014%2E+Constructing+an+interactive+natural+language+interface+for+relational+databases%2E+Proceedings+of+the+VLDB+Endowment%2C+8%281%29%3A73%E2%80%9384%2E)
20. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David Mc-Closky. 2014. The Stanford CoreNLP natural language processing toolkit. In Association for Computational Linguistics (ACL) System Demonstrations, pages 55–60. [our card](https://md.research.elamur.ai/free/en/papers/manning-2014-stanford-corenlp-natural-language-processing/)
21. Bryan McCann, Nitish Shirish Keskar, Caiming Xiong, and Richard Socher. 2018. The natural language decathlon: Multitask learning as question answering. arXiv preprint arXiv:1806.08730. [our card](https://md.research.elamur.ai/free/en/papers/mccann-2018-natural-language-decathlon-multitask-learning/)
22. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. [find](https://scholar.google.com/scholar?q=Adam+Paszke%2C+Sam+Gross%2C+Soumith+Chintala%2C+Gregory+Chanan%2C+Edward+Yang%2C+Zachary+DeVito%2C+Zeming+Lin%2C+Alban+Desmaison%2C+Luca+Antiga%2C+and+Adam+Lerer%2E+2017%2E+Automatic+differentiation+in+PyTorch%2E)
23. Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1532–1543, Doha, Qatar. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/pennington-2014-glove-global-vectors-word-representation/)
24. Ana-Maria Popescu, Oren Etzioni, , and Henry Kautz. 2003. Towards a theory of natural language interfaces to databases. In Proceedings of the 8th International Conference on Intelligent User Interfaces, pages 149–157. [find](https://scholar.google.com/scholar?q=Ana%2DMaria+Popescu%2C+Oren+Etzioni%2C+%2C+and+Henry+Kautz%2E+2003%2E+Towards+a+theory+of+natural+language+interfaces+to+databases%2E+In+Proceedings+of+the+8th+International+Conference+on+Intelligent+User+Interface)
25. Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018. Self-Attention with Relative Position Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 464– 468. [our card](https://md.research.elamur.ai/free/en/papers/shaw-2018-self-attention-relative-position-representations/)
26. Tianze Shi, Kedar Tatwawadi, Kaushik Chakrabarti, Yi Mao, Oleksandr Polozov, and Weizhu Chen. 2018. IncSQL: Training Incremental Text-to-SQL Parsers with Non-Deterministic Oracles. arXiv:1809.05054 [cs]. — [arXiv:1809.05054](https://arxiv.org/abs/1809.05054) [find](https://scholar.google.com/scholar?q=Tianze+Shi%2C+Kedar+Tatwawadi%2C+Kaushik+Chakrabarti%2C+Yi+Mao%2C+Oleksandr+Polozov%2C+and+Weizhu+Chen%2E+2018%2E+IncSQL%3A+Training+Incremental+Text%2Dto%2DSQL+Parsers+with+Non%2DDeterministic+Oracles%2E+arXiv%3A1809%2E05054+%5Bc)
27. Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Kathryn Mazaitis, Ruslan Salakhutdinov, and William Cohen. 2018. Open domain question answering using early fusion of knowledge bases and text. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4231–4242, Brus… [find](https://scholar.google.com/scholar?q=Haitian+Sun%2C+Bhuwan+Dhingra%2C+Manzil+Zaheer%2C+Kathryn+Mazaitis%2C+Ruslan+Salakhutdinov%2C+and+William+Cohen%2E+2018%2E+Open+domain+question+answering+using+early+fusion+of+knowledge+bases+and+text%2E+In+Proceedin)
28. Lappoon R. Tang and Raymond J. Mooney. 2000. Automated construction of database interfaces: Inter-grating statistical and relational learning for semantic parsing. In 2000 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 133–141. [find](https://scholar.google.com/scholar?q=Lappoon+R%2E+Tang+and+Raymond+J%2E+Mooney%2E+2000%2E+Automated+construction+of+database+interfaces%3A+Inter%2Dgrating+statistical+and+relational+learning+for+semantic+parsing%2E+In+2000+Joint+SIGDAT+Conference+on+E)
29. Pengcheng Yin and Graham Neubig. 2017. A Syntactic Neural Model for General-Purpose Code Generation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 440–450. [our card](https://md.research.elamur.ai/free/en/papers/yin-2017-syntactic-neural-model-general-purpose/)
30. Tao Yu, Michihiro Yasunaga, Kai Yang, Rui Zhang, Dongxu Wang, Zifan Li, and Dragomir Radev. 2018a. SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-Domain Text-to-SQL Task. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1653–1663. [find](https://scholar.google.com/scholar?q=Tao+Yu%2C+Michihiro+Yasunaga%2C+Kai+Yang%2C+Rui+Zhang%2C+Dongxu+Wang%2C+Zifan+Li%2C+and+Dragomir+Radev%2E+2018a%2E+SyntaxSQLNet%3A+Syntax+Tree+Networks+for+Complex+and+Cross%2DDomain+Text%2Dto%2DSQL+Task%2E+In+Proceedings+of+t)
31. Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, Zilin Zhang, and Dragomir Radev. 2018b. Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task. In Proceedings of the 2018… [our card](https://md.research.elamur.ai/free/en/papers/yu-2018-spider-large-scale-human-labeled/)
32. John M. Zelle and Raymond J. Mooney. 1996. Learning to parse database queries using inductive logic programming. In Proceedings of the Thirteenth National Conference on Artificial Intelligence - Volume 2, pages 1050–1055. [our card](https://md.research.elamur.ai/free/en/papers/zelle-1996-learning-parse-database-queries-using/)
33. Rui Zhang, Tao Yu, He Yang Er, Sungrok Shim, Eric Xue, Xi Victoria Lin, Tianze Shi, Caiming Xiong, Richard Socher, and Dragomir Radev. 2019. Editing-based SQL query generation for cross-domain context-dependent questions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language… [find](https://scholar.google.com/scholar?q=Rui+Zhang%2C+Tao+Yu%2C+He+Yang+Er%2C+Sungrok+Shim%2C+Eric+Xue%2C+Xi+Victoria+Lin%2C+Tianze+Shi%2C+Caiming+Xiong%2C+Richard+Socher%2C+and+Dragomir+Radev%2E+2019%2E+Editing%2Dbased+SQL+query+generation+for+cross%2Ddomain+context)
34. Victor Zhong, Caiming Xiong, and Richard Socher. 2017. Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning. arXiv:1709.00103 [cs]. [find](https://scholar.google.com/scholar?q=Victor+Zhong%2C+Caiming+Xiong%2C+and+Richard+Socher%2E+2017%2E+Seq2SQL%3A+Generating+Structured+Queries+from+Natural+Language+using+Reinforcement+Learning%2E+arXiv%3A1709%2E00103+%5Bcs%5D%2E)
35. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30, pages 5998–6008. [our card](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)
36. Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph Attention Networks. International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Petar+Velic%CC%8Ckovic%CC%81%2C+Guillem+Cucurull%2C+Arantxa+Casanova%2C+Adriana+Romero%2C+Pietro+Li%C3%B2%2C+and+Yoshua+Bengio%2E+2018%2E+Graph+Attention+Networks%2E+International+Conference+on+Learning+Representations%2E)
37. Chenglong Wang, Kedar Tatwawadi, Marc Brockschmidt, Po-Sen Huang, Yi Mao, Oleksandr Polozov, and Rishabh Singh. 2018. Robust Text-to-SQL Generation with Execution-Guided Decoding. arXiv:1807.03100 [cs]. [find](https://scholar.google.com/scholar?q=Chenglong+Wang%2C+Kedar+Tatwawadi%2C+Marc+Brockschmidt%2C+Po%2DSen+Huang%2C+Yi+Mao%2C+Oleksandr+Polozov%2C+and+Rishabh+Singh%2E+2018%2E+Robust+Text%2Dto%2DSQL+Generation+with+Execution%2DGuided+Decoding%2E+arXiv%3A1807%2E03100+%5Bcs)
38. Navid Yaghmazadeh, Yuepeng Wang, Isil Dillig, and Thomas Dillig. 2017. Sqlizer: Query synthesis from natural language. In International Conference on Object-Oriented Programming, Systems, Languages, and Applications, ACM, pages 63:1–63:26. [find](https://scholar.google.com/scholar?q=Navid+Yaghmazadeh%2C+Yuepeng+Wang%2C+Isil+Dillig%2C+and+Thomas+Dillig%2E+2017%2E+Sqlizer%3A+Query+synthesis+from+natural+language%2E+In+International+Conference+on+Object%2DOriented+Programming%2C+Systems%2C+Languages%2C+a)