---
title: "Joint Universal Syntactic and Semantic — Stengel-Eskin 2021"
description: "Earlier attempts to parse syntax and semantics jointly usually improved one level at the expense of the other."
authors: ["Elias Stengel-Eskin", "Kenton Murray", "Sheng Zhang", "Aaron Steven White", "Benjamin Van Durme"]
year: 2021
venue: "Transactions of the Association for Computational Linguistics"
source: "https://aclanthology.org/2021.tacl-1.46/"
doi: "10.1162/tacl_a_00396"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/eskin-2021-joint-universal-syntactic-semantic-parsing/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/eskin-2021-joint-universal-syntactic-semantic-parsing/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2021](https://md.research.elamur.ai/free/papers/2021/page/2/) / Joint Universal Syntactic and Semantic Parsing

# Joint Universal Syntactic and Semantic Parsing

**Authors:** Elias Stengel-Eskin, [Kenton Murray](https://md.research.elamur.ai/free/authors/kenton-murray/), [Sheng Zhang](https://md.research.elamur.ai/free/authors/sheng-zhang/), [Aaron Steven White](https://md.research.elamur.ai/free/authors/aaron-steven-white/), [Benjamin Van Durme](https://md.research.elamur.ai/free/authors/benjamin-van-durme/) · **Year:** 2021 · **Venue:** Transactions of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2021.tacl-1.46/) · [PDF](https://aclanthology.org/2021.tacl-1.46.pdf) · [DOI 10.1162/tacl\_a\_00396](https://doi.org/10.1162/tacl_a_00396) · [OpenAlex](https://openalex.org/W3157245170)

**Citations:** 7 citations (openalex-snapshot · 2026-10-14) · 8 in our library, of the 140673 papers whose bibliographies we read

## Summary
Earlier attempts to parse syntax and semantics jointly usually improved one level at the expense of the other. The authors address this with Universal Decompositional Semantics (UDS). Its semantic graphs are derived from the UD parses of the English Web Treebank (EWT) and carry crowdsourced scalar attributes for factuality, genericity, time, word sense and semantic proto-roles. Both annotation layers cover the same sentences, so the effect of the semantic signal can be measured without adding data. The authors extend the transductive sequence-to-graph UDS parser of Stengel-Eskin et al. (2020) so that it also outputs UD trees. They compare several multitask designs with LSTM and new Transformer variants. The best design shares its encoder between the semantic decoder and a biaffine UD parser. This joint system clearly beats the previous best UDS results and reaches state-of-the-art LAS on the semantically valid part of EWT. A UD-focused variant matches the leading UD parser on full EWT. Syntax and semantics help each other even on top of pretrained contextual encoders. Transfer experiments with XLM-R show that the English semantic signal can also improve UD parsing in other languages.

## Key points
- **Data:** about 20% of EWT is dropped because those sentences lack predicate-argument structure (e.g., greetings, URLs). The cleaned UD subset is released, and UDS attributes are scored on a −3 to 3 scale.
- **Architecture:** the best model pairs a shared encoder with a Dozat & Manning biaffine parser. Transformer versions beat LSTM versions on every metric, and fine-tuning the top encoder layers gives the largest extra gain.
- **Multilingual transfer:** XLM-R is applied to eight languages drawn from five families: Afrikaans, German, Finnish, French, Galician, Hungarian, Armenian and Kazakh. In the semantics-to-syntax direction, average LAS/UAS rises from 78.56/84.30 to 78.97/84.42 with the encoder-side variant. The intermediate variant lowers it to 77.88/83.43.
- **Per-language results:** Finnish loses performance in every variant. Galician, Hungarian and Armenian, which are among the lower-resource languages, gain notably. Kazakh has only 31 training sentences.
- **Code and models:** available at github.com/esteng/miso_uds (the PDF extraction shows "miso uds"). The paper was published in TACL, vol. 9, 2021, under a CC-BY 4.0 license.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{stengeleskin2021joint,
  title = {{Joint Universal Syntactic and Semantic Parsing}},
  author = {Stengel-Eskin, Elias and Murray, Kenton and Zhang, Sheng and White, Aaron Steven and Durme, Benjamin Van},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2021},
  doi = {10.1162/tacl\_a\_00396},
  url = {https://doi.org/10.1162/tacl_a_00396}
}
```

- [← previous It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners](https://md.research.elamur.ai/free/papers/schick-2021-it-s-not-just-size/)
- [next → Knowledge Enhanced Masked Language Model for Stance Detection](https://md.research.elamur.ai/free/papers/kawintiranon-2021-knowledge-enhanced-masked-language-model/)
- [↑ back to papers of 2021](https://md.research.elamur.ai/free/papers/2021/page/2/)

## References

65 references, 16 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Omri Abend, Tom Kwiatkowski, Nathaniel J. Smith, Sharon Goldwater, and Mark Steedman. 2017. Bootstrapping language acquisition. Cognition, 164:116–143. https://doi.org/10.1016/j.cognition.2017.02.009 — [doi:10.1016/j.cognition.2017.02.009](https://doi.org/10.1016/j.cognition.2017.02.009) [↗](https://doi.org/10.1016/j.cognition.2017.02.009)
2. Rich Caruana. 1997. Multitask learning. Machine Learning, 28(1):41–75. https://doi.org/10.1023/A:1007379606734 — [doi:10.1023/a:1007379606734](https://doi.org/10.1023/a:1007379606734) [↗](https://doi.org/10.1023/A:1007379606734)
3. Omri Abend and Ari Rappoport. 2013. Universal Conceptual Cognitive Annotation (UCCA). In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 228–238, Sofia, Bulgaria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Omri+Abend+and+Ari+Rappoport%2E+2013%2E+Universal+Conceptual+Cognitive+Annotation+%28UCCA%29%2E+In+Proceedings+of+the+51st+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29) [our card](https://md.research.elamur.ai/free/papers/abend-2013-universal-conceptual-cognitive-annotation-ucca/)
4. Danqi Chen and Christopher Manning. 2014. A fast and accurate dependency parser using neural networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 740–750, Doha, Qatar. Association for Computational Linguistics. https://doi.org/10.3115/v1… [↗](https://doi.org/10.3115/v1…) [our card](https://md.research.elamur.ai/free/papers/missing-2014-chen-fast-accurate-dependency-parser-neural/)
5. Yoav Artzi, Kenton Lee, and Luke Zettlemoyer. 2015. Broad-coverage CCG semantic parsing with AMR. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1699–1710, Lisbon, Portugal. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yoav+Artzi%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2015%2E+Broad%2Dcoverage+CCG+semantic+parsing+with+AMR%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+1699%E2%80%93)
6. Carol Chomsky. 1969. The Acquisition of Syntax in Children from 5 to 10. Cambridge, MA. MIT Press. [find](https://scholar.google.com/scholar?q=Carol+Chomsky%2E+1969%2E+The+Acquisition+of+Syntax+in+Children+from+5+to+10%2E+Cambridge%2C+MA%2E+MIT+Press%2E)
7. Yoeng-Jin Chu. 1965. On the shortest arborescence of a directed graph. Scientia Sinica, 14:1396–1400. [find](https://scholar.google.com/scholar?q=Yoeng%2DJin+Chu%2E+1965%2E+On+the+shortest+arborescence+of+a+directed+graph%2E+Scientia+Sinica%2C+14%3A1396%E2%80%931400%2E)
8. Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. 2013. Abstract Meaning Representation for sembanking. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discou… [find](https://scholar.google.com/scholar?q=Laura+Banarescu%2C+Claire+Bonial%2C+Shu+Cai%2C+Madalina+Georgescu%2C+Kira+Griffitt%2C+Ulf+Hermjakob%2C+Kevin+Knight%2C+Philipp+Koehn%2C+Martha+Palmer%2C+and+Nathan+Schneider%2E+2013%2E+Abstract+Meaning+Representation+for+s) [our card](https://md.research.elamur.ai/free/papers/banarescu-2013-abstract-meaning-representation-sembanking/)
9. Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Unsupervised cross-lingual representation learning at scale. In Proceedings of the 58th Annual Meeting of the Association f… [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Kartikay+Khandelwal%2C+Naman+Goyal%2C+Vishrav+Chaudhary%2C+Guillaume+Wenzek%2C+Francisco+Guzma%CC%81n%2C+Edouard+Grave%2C+Myle+Ott%2C+Luke+Zettlemoyer%2C+and+Veselin+Stoyanov%2E+2020%2E+Unsupervised+cross%2Dling)
10. James Bergstra and Yoshua Bengio. 2012. Random search for hyper-parameter optimization. The Journal of Machine Learning Research, 13(1):281–305. [find](https://scholar.google.com/scholar?q=James+Bergstra+and+Yoshua+Bengio%2E+2012%2E+Random+search+for+hyper%2Dparameter+optimization%2E+The+Journal+of+Machine+Learning+Research%2C+13%281%29%3A281%E2%80%93305%2E)
11. Richard F. Cromer. 1970. Children are nice to understand: Surface structure clues for the recovery of a deep structure. British Journal of Psychology, 61(3):397–408. https://doi.org/10.1111/j.2044-8295.1970 .tb01259.x Sebastian Beschke. 2019. Exploring graph-algebraic CCG combinators for syntactic-… — [doi:10.1111/j.2044-8295.1970](https://doi.org/10.1111/j.2044-8295.1970) [↗](https://doi.org/10.1111/j.2044-8295.1970)
12. Jacob Devlin. 2018. README document. [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2E+2018%2E+README+document%2E)
13. Multilingual BERT Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lang… [find](https://scholar.google.com/scholar?q=Multilingual+BERT+Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+C)
14. Goran Glavaš and Ivan Vulić. 2020. Is supervised syntactic parsing beneficial for language understanding? an empirical investigation. arXiv preprint arXiv:2008.06788. — [arXiv:2008.06788](https://arxiv.org/abs/2008.06788) [find](https://scholar.google.com/scholar?q=Goran+Glavas%CC%8C+and+Ivan+Vulic%CC%81%2E+2020%2E+Is+supervised+syntactic+parsing+beneficial+for+language+understanding%3F+an+empirical+investigation%2E+arXiv+preprint+arXiv%3A2008%2E06788%2E+%E2%80%94+%5BarXiv%3A2008%2E06788%5D%28https%3A%2F%2Far)
15. Lila Gleitman. 1990. The structural sources of verb meanings. Language Acquisition, 1(1):3–55. https://doi.org/10.1207/s15327817la0101 2 [↗](https://doi.org/10.1207/s15327817la0101)
16. David Dowty. 1991. Thematic proto-roles and argument selection. Language, 67(3):547–619. [find](https://scholar.google.com/scholar?q=David+Dowty%2E+1991%2E+Thematic+proto%2Droles+and+argument+selection%2E+Language%2C+67%283%29%3A547%E2%80%93619%2E)
17. Jan Hajič, Massimiliano Ciaramita, Richard Johansson, Daisuke Kawahara, Maria Antònia Martı́, Lluı́s Màrquez, Adam Meyers, Joakim Nivre, Sebastian Padó, Jan Štěpánek, Pavel Straňák, Mihai Surdeanu, Nianwen Xue, and Yi Zhang. 2009. The CoNLL-2009 shared task: Syntactic and semantic dependenc… [find](https://scholar.google.com/scholar?q=Jan+Hajic%CC%8C%2C+Massimiliano+Ciaramita%2C+Richard+Johansson%2C+Daisuke+Kawahara%2C+Maria+Anto%CC%80nia+Mart%C4%B1%CC%81%2C+Llu%C4%B1%CC%81s+Ma%CC%80rquez%2C+Adam+Meyers%2C+Joakim+Nivre%2C+Sebastian+Pado%CC%81%2C+Jan+S%CC%8Cte%CC%8Cpa%CC%81nek%2C+Pavel+Stran%CC%8Ca%CC%81k%2C+Mihai+Sur) [our card](https://md.research.elamur.ai/free/papers/hajic-2009-conll-2009-shared-task-syntactic/)
18. Timothy Dozat and Christopher D. Manning. 2017. Deep biaffine attention for neural dependency parsing. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24–26, 2017, Conference Track Proceedings. OpenReview.net. https://doi.org/10.1353/lan.1991 .0021 [↗](https://doi.org/10.1353/lan.1991) [our card](https://md.research.elamur.ai/free/papers/missing-2016-dozat-deep-biaffine-attention-neural-dependency/)
19. Jack Edmonds. 1967. Optimum branchings. Journal of Research of the National Bureau of Standards B, 71(4):233–240. https://doi.org/10.6028/jres.071B.032 — [doi:10.6028/jres.071b.032](https://doi.org/10.6028/jres.071b.032) [↗](https://doi.org/10.6028/jres.071B.032)
20. John Hewitt and Percy Liang. 2019. Designing and interpreting probes with control tasks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 2733–2743, Hong Kong, Chi… [find](https://scholar.google.com/scholar?q=John+Hewitt+and+Percy+Liang%2E+2019%2E+Designing+and+interpreting+probes+with+control+tasks%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th+Internati)
21. Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, N… [find](https://scholar.google.com/scholar?q=Matt+Gardner%2C+Yoav+Artzi%2C+Victoria+Basmov%2C+Jonathan+Berant%2C+Ben+Bogin%2C+Sihao+Chen%2C+Pradeep+Dasigi%2C+Dheeru+Dua%2C+Yanai+Elazar%2C+Ananth+Gottumukkala%2C+Nitish+Gupta%2C+Hannaneh+Hajishirzi%2C+Gabriel+Ilharco%2C+Da) [our card](https://md.research.elamur.ai/free/papers/gardner-2020-evaluating-models-local-decision-boundaries/)
22. Ganesh Jawahar, Benoı̂t Sagot, and Djamé Seddah. 2019. What does BERT learn about the structure of language? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3651–3657, Florence, Italy. Association for Computational Linguistics. https://doi.org/10.18… [find](https://scholar.google.com/scholar?q=Ganesh+Jawahar%2C+Beno%C4%B1%CC%82t+Sagot%2C+and+Djame%CC%81+Seddah%2E+2019%2E+What+does+BERT+learn+about+the+structure+of+language%3F+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics) [our card](https://md.research.elamur.ai/free/papers/jawahar-2019-what-does-bert-learn-about/)
23. Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson F. Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. 2018. AllenNLP: A deep semantic natural language processing platform. In Proceedings of Workshop for NLP Open Source Software (NLP-OSS), pages 1–6, Melbourne,… [find](https://scholar.google.com/scholar?q=Matt+Gardner%2C+Joel+Grus%2C+Mark+Neumann%2C+Oyvind+Tafjord%2C+Pradeep+Dasigi%2C+Nelson+F%2E+Liu%2C+Matthew+Peters%2C+Michael+Schmitz%2C+and+Luke+Zettlemoyer%2E+2018%2E+AllenNLP%3A+A+deep+semantic+natural+language+processing) [our card](https://md.research.elamur.ai/free/papers/gardner-2018-allennlp-deep-semantic-natural-language/)
24. Association Richard Johansson and Pierre Nugues. 2008. Dependency-based syntactic–semantic analysis with PropBank and NomBank. In CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning, pages 183–187, Manchester, England. [find](https://scholar.google.com/scholar?q=Association+Richard+Johansson+and+Pierre+Nugues%2E+2008%2E+Dependency%2Dbased+syntactic%E2%80%93semantic+analysis+with+PropBank+and+NomBank%2E+In+CoNLL+2008%3A+Proceedings+of+the+Twelfth+Conference+on+Computational+Nat)
25. Coling 2008 Organizing Committee. https://doi.org/10.3115/1596324 .1596355 normalization of self-attention. arXiv preprint arXiv:1910.05895. [↗](https://doi.org/10.3115/1596324)
26. Dan Kondratyuk and Milan Straka. 2019. 75 languages, 1 model: Parsing Universal Dependencies universally. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 2779–279… [find](https://scholar.google.com/scholar?q=Dan+Kondratyuk+and+Milan+Straka%2E+2019%2E+75+languages%2C+1+model%3A+Parsing+Universal+Dependencies+universally%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+) [our card](https://md.research.elamur.ai/free/papers/ud-2019-kondratyuk-75-languages-1-model-parsing/)
27. Stephan Oepen, Marco Kuhlmann, Yusuke Miyao, Daniel Zeman, Silvie Cinková, Dan Flickinger, Jan Hajič, Angelina Ivanova, and Zdeňka Urešová. 2016. Towards comparability of linguistic graph Banks for semantic parsing. In Proceedings of the Tenth International Conference on Language Resources and… [find](https://scholar.google.com/scholar?q=Stephan+Oepen%2C+Marco+Kuhlmann%2C+Yusuke+Miyao%2C+Daniel+Zeman%2C+Silvie+Cinkova%CC%81%2C+Dan+Flickinger%2C+Jan+Hajic%CC%8C%2C+Angelina+Ivanova%2C+and+Zden%CC%8Cka+Ures%CC%8Cova%CC%81%2E+2016%2E+Towards+comparability+of+linguistic+graph+Banks+f)
28. Jayant Krishnamurthy and Tom M. Mitchell. 2014. Joint syntactic and semantic parsing with Combinatory Categorial Grammar. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1188–1198, Baltimore, Maryland. Association for Computat… [find](https://scholar.google.com/scholar?q=Jayant+Krishnamurthy+and+Tom+M%2E+Mitchell%2E+2014%2E+Joint+syntactic+and+semantic+parsing+with+Combinatory+Categorial+Grammar%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for+Computational)
29. Stephan Oepen, Marco Kuhlmann, Yusuke Miyao, Daniel Zeman, Dan Flickinger, Jan Hajič, Angelina Ivanova, and Yi Zhang. 2014a. [find](https://scholar.google.com/scholar?q=Stephan+Oepen%2C+Marco+Kuhlmann%2C+Yusuke+Miyao%2C+Daniel+Zeman%2C+Dan+Flickinger%2C+Jan+Hajic%CC%8C%2C+Angelina+Ivanova%2C+and+Yi+Zhang%2E+2014a%2E)
30. SemEval 2014 task 8: Broad-coverage semantic dependency parsing. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 63–72, Dublin, Ireland. Association for Computational Linguistics. https://doi.org/10.3115/v1/S14-2008 [↗](https://doi.org/10.3115/v1/S14-2008)
31. Barbara Landau and Lila R. Gleitman. 1985. Language and Experience: Evidence from the Blind Child, Cognitive Science Series, 8, Cambridge, MA. Harvard University Press. [find](https://scholar.google.com/scholar?q=Barbara+Landau+and+Lila+R%2E+Gleitman%2E+1985%2E+Language+and+Experience%3A+Evidence+from+the+Blind+Child%2C+Cognitive+Science+Series%2C+8%2C+Cambridge%2C+MA%2E+Harvard+University+Press%2E)
32. S. Pinker. 1984. Language Learnability and Language Development. Cambridge, MA. Harvard University Press. [find](https://scholar.google.com/scholar?q=S%2E+Pinker%2E+1984%2E+Language+Learnability+and+Language+Development%2E+Cambridge%2C+MA%2E+Harvard+University+Press%2E)
33. Steven Pinker. 1979. Formal models of language learning. Cognition, 7(3):217–283. https://doi.org/10.1016/0010-0277(79)90001-5 — [doi:10.1016/0010-0277(79)90001-5](https://doi.org/10.1016/0010-0277%2879%2990001-5) [↗](https://doi.org/10.1016/0010-0277(79)90001-5)
34. Mike Lewis, Luheng He, and Luke Zettlemoyer. 2015. Joint A* CCG parsing and semantic role labelling. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1444–1454, Lisbon, Portugal. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mike+Lewis%2C+Luheng+He%2C+and+Luke+Zettlemoyer%2E+2015%2E+Joint+A%2A+CCG+parsing+and+semantic+role+labelling%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+14)
35. Carl Pollard and Ivan A. Sag. 1994. Head-driven Phrase Structure Grammar, University of Chicago Press. [find](https://scholar.google.com/scholar?q=Carl+Pollard+and+Ivan+A%2E+Sag%2E+1994%2E+Head%2Ddriven+Phrase+Structure+Grammar%2C+University+of+Chicago+Press%2E)
36. Tal Schuster, Ori Ram, Regina Barzilay, and Amir Globerson. 2019. Cross-lingual alignment of contextual word embeddings, with applications to zero-shot dependency parsing. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lang… [find](https://scholar.google.com/scholar?q=Tal+Schuster%2C+Ori+Ram%2C+Regina+Barzilay%2C+and+Amir+Globerson%2E+2019%2E+Cross%2Dlingual+alignment+of+contextual+word+embeddings%2C+with+applications+to+zero%2Dshot+dependency+parsing%2E+In+Proceedings+of+the+2019+C)
37. Dipendra Kumar Misra and Yoav Artzi. 2016. Neural shift-reduce CCG semantic parsing. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1775–1786, Austin, Texas. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Dipendra+Kumar+Misra+and+Yoav+Artzi%2E+2016%2E+Neural+shift%2Dreduce+CCG+semantic+parsing%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+1775%E2%80%931786%2C+Austin%2C)
38. Richard Montague. 1970. Universal grammar. Theoria, 36(3):373–398. [find](https://scholar.google.com/scholar?q=Richard+Montague%2E+1970%2E+Universal+grammar%2E+Theoria%2C+36%283%29%3A373%E2%80%93398%2E)
39. Letitia Naigles. 1990. Children use syntax to learn verb meanings. Journal of Child Language, 17(2):357–374. https://doi.org/10.1017/S0305000900013817 — [doi:10.1017/s0305000900013817](https://doi.org/10.1017/s0305000900013817) [↗](https://doi.org/10.1017/S0305000900013817)
40. Abigail See, Peter J. Liu, and Christopher D. Manning. 2017. Get to the point: Summarization with pointer-generator networks. In Proceedings of the 55th Annual Meeting of Toan Q. Nguyen and Julian Salazar. 2019. Transformers without tears: Improving the the Association for Computational Linguistics… [find](https://scholar.google.com/scholar?q=Abigail+See%2C+Peter+J%2E+Liu%2C+and+Christopher+D%2E+Manning%2E+2017%2E+Get+to+the+point%3A+Summarization+with+pointer%2Dgenerator+networks%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+Toan+Q%2E+Nguyen+and+Julian+Sal)
41. Shallow syntax in deep water. arXiv preprint arXiv:1908.11047. — [arXiv:1908.11047](https://arxiv.org/abs/1908.11047) [find](https://scholar.google.com/scholar?q=Shallow+syntax+in+deep+water%2E+arXiv+preprint+arXiv%3A1908%2E11047%2E+%E2%80%94+%5BarXiv%3A1908%2E11047%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1908%2E11047%29)
42. Swabha Swayamdipta, Sam Thomson, Chris Dyer, and Noah A. Smith. 2017. Frame-semantic parsing with softmax-margin segmental RNNs and a syntactic scaffold. arXiv preprint arXiv:1706.09528. [find](https://scholar.google.com/scholar?q=Swabha+Swayamdipta%2C+Sam+Thomson%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2017%2E+Frame%2Dsemantic+parsing+with+softmax%2Dmargin+segmental+RNNs+and+a+syntactic+scaffold%2E+arXiv+preprint+arXiv%3A1706%2E09528%2E) [our card](https://md.research.elamur.ai/free/papers/swayamdipta-2017-frame-semantic-parsing-softmax-margin/)
43. Mark Steedman. 2000. The Syntactic Process, 24, MIT Press, Cambridge, MA. https://doi.org/10.7551/mitpress/6591.001 .0001 — [doi:10.7551/mitpress/6591.001](https://doi.org/10.7551/mitpress/6591.001) [↗](https://doi.org/10.7551/mitpress/6591.001)
44. Swabha Swayamdipta, Sam Thomson, Kenton Lee, Luke Zettlemoyer, Chris Dyer, and Noah A. Smith. 2018. Syntactic scaffolds for semantic structures. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3772–3782, Brussels, Belgium. Association for Computationa… [find](https://scholar.google.com/scholar?q=Swabha+Swayamdipta%2C+Sam+Thomson%2C+Kenton+Lee%2C+Luke+Zettlemoyer%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2018%2E+Syntactic+scaffolds+for+semantic+structures%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Meth)
45. Elias Stengel-Eskin, Aaron Steven White, Sheng Zhang, and Benjamin Van Durme. 2020. Universal decompositional semantic parsing. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8427–8439, Online. Association for Computational Linguistics. https://doi… [find](https://scholar.google.com/scholar?q=Elias+Stengel%2DEskin%2C+Aaron+Steven+White%2C+Sheng+Zhang%2C+and+Benjamin+Van+Durme%2E+2020%2E+Universal+decompositional+semantic+parsing%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computa)
46. Ian Tenney, Dipanjan Das, and Ellie Pavlick. 2019. BERT rediscovers the classical NLP pipeline. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4593–4601, Florence, Italy. Association for Computational Linguistics. https://doi.org/10.18653/v1/P19 -14… [↗](https://doi.org/10.18653/v1/P19) [our card](https://md.research.elamur.ai/free/papers/tenney-2019-bert-rediscovers-classical-nlp-pipeline/)
47. Emma Strubell, Patrick Verga, Daniel Andor, David Weiss, and Andrew McCallum. 2018. Linguistically-informed self-attention for semantic role labeling. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 5027–5038, Brussels, Belgium. Association for Comput… [find](https://scholar.google.com/scholar?q=Emma+Strubell%2C+Patrick+Verga%2C+Daniel+Andor%2C+David+Weiss%2C+and+Andrew+McCallum%2E+2018%2E+Linguistically%2Dinformed+self%2Dattention+for+semantic+role+labeling%2E+In+Proceedings+of+the+2018+Conference+on+Empirica) [our card](https://md.research.elamur.ai/free/papers/strubell-2018-linguistically-informed-self-attention-semantic/)
48. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems, pages 5998–6008. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017%2E+Attention+is+all+you+need%2E+In+Advances+in+neural+information+processi)
49. Mihai Surdeanu, Richard Johansson, Adam Meyers, Lluı́s Màrquez, and Joakim Nivre. 2008. [find](https://scholar.google.com/scholar?q=Mihai+Surdeanu%2C+Richard+Johansson%2C+Adam+Meyers%2C+Llu%C4%B1%CC%81s+Ma%CC%80rquez%2C+and+Joakim+Nivre%2E+2008%2E)
50. The CoNLL 2008 shared task on joint parsing of syntactic and semantic dependencies. In CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning, pages 159–177, Manchester, England. [find](https://scholar.google.com/scholar?q=The+CoNLL+2008+shared+task+on+joint+parsing+of+syntactic+and+semantic+dependencies%2E+In+CoNLL+2008%3A+Proceedings+of+the+Twelfth+Conference+on+Computational+Natural+Language+Learning%2C+pages+159%E2%80%93177%2C+Manc) [our card](https://md.research.elamur.ai/free/papers/surdeanu-2008-conll-2008-shared-task-joint/)
51. Coling 2008 Organizing Committee. https://doi.org/10.3115/1596324 .1596352 — [doi:10.3115/1596324](https://doi.org/10.3115/1596324) [↗](https://doi.org/10.3115/1596324)
52. Aaron Steven White. 2020. Lexically triggered veridicality inferences. Handbook of Pragmatics: 22nd Annual Installment, 22:115. https://doi.org/10.1075/hop.22 .lex4 — [doi:10.1075/hop.22](https://doi.org/10.1075/hop.22) [↗](https://doi.org/10.1075/hop.22)
53. Aaron Steven White, Drew Reisinger, Keisuke Sakaguchi, Tim Vieira, Sheng Zhang, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme. 2016. Universal decompositional semantics on Universal Dependencies. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages… [find](https://scholar.google.com/scholar?q=Aaron+Steven+White%2C+Drew+Reisinger%2C+Keisuke+Sakaguchi%2C+Tim+Vieira%2C+Sheng+Zhang%2C+Rachel+Rudinger%2C+Kyle+Rawlins%2C+and+Benjamin+Van+Durme%2E+2016%2E+Universal+decompositional+semantics+on+Universal+Dependenci) [our card](https://md.research.elamur.ai/free/papers/white-2016-universal-decompositional-semantics-universal-dependencies/)
54. Swabha Swayamdipta, Miguel Ballesteros, Chris Dyer, and Noah A. Smith. 2016. Greedy, joint syntactic-semantic parsing with stack LSTMs. In Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pages 187–197, Berlin, Germany. Association for Computational Linguistics.… [find](https://scholar.google.com/scholar?q=Swabha+Swayamdipta%2C+Miguel+Ballesteros%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2016%2E+Greedy%2C+joint+syntactic%2Dsemantic+parsing+with+stack+LSTMs%2E+In+Proceedings+of+The+20th+SIGNLL+Conference+on+Computational+Na)
55. Aaron Steven White, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme. 2018. Lexicosyntactic inference in neural models. [find](https://scholar.google.com/scholar?q=Aaron+Steven+White%2C+Rachel+Rudinger%2C+Kyle+Rawlins%2C+and+Benjamin+Van+Durme%2E+2018%2E+Lexicosyntactic+inference+in+neural+models%2E)
56. Swabha Swayamdipta, Matthew Peters, Brendan Roof, Chris Dyer, and Noah A. Smith. 2019. [find](https://scholar.google.com/scholar?q=Swabha+Swayamdipta%2C+Matthew+Peters%2C+Brendan+Roof%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2019%2E)
57. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4717–4724, Brussels, Belgium. Association for Computational Linguistics. of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 1–19, Vancouver, Canada. Associ… — [doi:10.18653/v1/k17](https://doi.org/10.18653/v1/k17) [find](https://scholar.google.com/scholar?q=In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+4717%E2%80%934724%2C+Brussels%2C+Belgium%2E+Association+for+Computational+Linguistics%2E+of+the+CoNLL+2017+Shared+Task%3A)
58. Aaron Steven White, Elias Stengel-Eskin, Siddharth Vashishtha, Venkata Subrahmanyan Govindarajan, Dee Ann Reisinger, Tim Vieira, Keisuke Sakaguchi, Sheng Zhang, Francis Ferraro, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme. 2020. The universal decompositional semantics dataset and decomp to… [find](https://scholar.google.com/scholar?q=Aaron+Steven+White%2C+Elias+Stengel%2DEskin%2C+Siddharth+Vashishtha%2C+Venkata+Subrahmanyan+Govindarajan%2C+Dee+Ann+Reisinger%2C+Tim+Vieira%2C+Keisuke+Sakaguchi%2C+Sheng+Zhang%2C+Francis+Ferraro%2C+Rachel+Rudinger%2C+Kyle+)
59. Sheng Zhang, Xutai Ma, Kevin Duh, and Benjamin Van Durme. 2019a. AMR parsing as sequence-to-graph transduction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 80–94, Florence, Italy. Association for Computational Linguistics. https://doi.org/10.186… [find](https://scholar.google.com/scholar?q=Sheng+Zhang%2C+Xutai+Ma%2C+Kevin+Duh%2C+and+Benjamin+Van+Durme%2E+2019a%2E+AMR+parsing+as+sequence%2Dto%2Dgraph+transduction%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguisti)
60. Sheng Zhang, Xutai Ma, Kevin Duh, and Benjamin Van Durme. 2019b. Broad-coverage semantic parsing as transduction. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages… [find](https://scholar.google.com/scholar?q=Sheng+Zhang%2C+Xutai+Ma%2C+Kevin+Duh%2C+and+Benjamin+Van+Durme%2E+2019b%2E+Broad%2Dcoverage+semantic+parsing+as+transduction%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Process)
61. Daniel Zeman, Jan Hajič, Martin Popel, Martin Potthast, Milan Straka, Filip Ginter, Joakim Nivre, and Slav Petrov. 2018. [find](https://scholar.google.com/scholar?q=Daniel+Zeman%2C+Jan+Hajic%CC%8C%2C+Martin+Popel%2C+Martin+Potthast%2C+Milan+Straka%2C+Filip+Ginter%2C+Joakim+Nivre%2C+and+Slav+Petrov%2E+2018%2E)
62. CoNLL 2018 shared task: Multilingual parsing from raw text to Universal Dependencies. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 1–21, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=CoNLL+2018+shared+task%3A+Multilingual+parsing+from+raw+text+to+Universal+Dependencies%2E+In+Proceedings+of+the+CoNLL+2018+Shared+Task%3A+Multilingual+Parsing+from+Raw+Text+to+Universal+Dependencies%2C+pages+) [our card](https://md.research.elamur.ai/free/papers/ud-2018-zeman-conll-2018-shared-task-multilingual/)
63. Sheng Zhang, Rachel Rudinger, and Benjamin Van Durme. 2017. An evaluation of PredPatt and open IE via stage 1 semantic role labeling. In IWCS 2017 — 12th International Conference on Computational Semantics — Short papers. [find](https://scholar.google.com/scholar?q=Sheng+Zhang%2C+Rachel+Rudinger%2C+and+Benjamin+Van+Durme%2E+2017%2E+An+evaluation+of+PredPatt+and+open+IE+via+stage+1+semantic+role+labeling%2E+In+IWCS+2017+%E2%80%94+12th+International+Conference+on+Computational+Sema)
64. Daniel Zeman, Martin Popel, Milan Straka, Jan Hajič, Joakim Nivre, Filip Ginter, Juhani Luotolahti, Sampo Pyysalo, Slav Petrov, Martin Potthast, Francis Tyers, Elena Badmaeva, Memduh Gokirmak, Anna Nedoluzhko, Silvie Cinková, Jan Hajič Jr., Jaroslava Hlaváčová, Václava Kettnerová, Zdeňka Ur… [find](https://scholar.google.com/scholar?q=Daniel+Zeman%2C+Martin+Popel%2C+Milan+Straka%2C+Jan+Hajic%CC%8C%2C+Joakim+Nivre%2C+Filip+Ginter%2C+Juhani+Luotolahti%2C+Sampo+Pyysalo%2C+Slav+Petrov%2C+Martin+Potthast%2C+Francis+Tyers%2C+Elena+Badmaeva%2C+Memduh+Gokirmak%2C+Anna+N)
65. CoNLL 2017 shared task: Multilingual parsing from raw text to Universal Dependencies. In Proceedings Qiji Zhou, Yue Zhang, Donghong Ji, and Hao Tang. 2020. AMR parsing with latent structural information. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, page… [find](https://scholar.google.com/scholar?q=CoNLL+2017+shared+task%3A+Multilingual+parsing+from+raw+text+to+Universal+Dependencies%2E+In+Proceedings+Qiji+Zhou%2C+Yue+Zhang%2C+Donghong+Ji%2C+and+Hao+Tang%2E+2020%2E+AMR+parsing+with+latent+structural+informati) [our card](https://md.research.elamur.ai/free/papers/ud-2017-zeman-conll-2017-shared-task-multilingual/)