---
title: "A Novel Bi-directional Interrelated Model for Joint — E 2019"
description: "Spoken language understanding (SLU) requires two linked predictions: a single intent label for an utterance (intent detection, ID) and a tag for each…"
authors: ["Haihong E", "Peiqing Niu", "Zhongfu Chen", "Meina Song"]
year: 2019
venue: "Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/P19-1544/"
doi: "10.18653/v1/p19-1544"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/e-2019-novel-bi-directional-interrelated-model/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/e-2019-novel-bi-directional-interrelated-model/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/) / A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling

# A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling

**Authors:** Haihong E, Peiqing Niu, Zhongfu Chen, Meina Song · **Year:** 2019 · **Venue:** Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/P19-1544/) · [PDF](https://aclanthology.org/P19-1544.pdf) · [DOI 10.18653/v1/p19-1544](https://doi.org/10.18653/v1/p19-1544) · [OpenAlex](https://openalex.org/W2963066655)

**Citations:** 223 citations (openalex-snapshot · 2026-10-14) · [78](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Spoken language understanding (SLU) requires two linked predictions: a single intent label for an utterance (intent detection, ID) and a tag for each token (slot filling, SF). Earlier joint models connected the tasks only weakly. Some relied on a shared loss. Others, such as the slot-gated model of Goo et al. (2018), passed intent cues to slot tagging but never the reverse.

The authors propose an SF-ID network built on a BLSTM encoder with attention-derived slot and intent context vectors. The SF subnet uses intent information to produce a slot reinforce vector. The ID subnet then pools slot information into an intent reinforce vector. The two subnets exchange these vectors over repeated rounds, which the authors call an iteration mechanism, and an optional CRF layer decodes the slot sequence. Two orderings, SF-First and ID-First, are evaluated on ATIS and Snips.

The model surpasses earlier joint baselines on slot F1, intent accuracy and sentence-level frame accuracy. This suggests that letting information flow both ways between the tasks produces a measurable gain in SLU quality.

## Key points
- On ATIS, the best sentence accuracy is 86.90 (ID-First with CRF), compared with 83.73 for the Slot-Gated baseline, a relative gain of about 3.79%. On Snips, SF-First with CRF reaches 80.57 versus 76.43, a relative gain of about 5.42%.
- The two modes trade strengths:
  - ID-First gives the top slot F1 (95.80 on ATIS, 92.23 on Snips).
  - SF-First gives the top intent accuracy (97.76 on ATIS, 97.43 on Snips).
- In the ablation, using only the SF subnet, only the ID subnet, or both subnets without interaction each beats the plain BLSTM. Full interaction between the subnets performs best.
- Sentence accuracy peaks at three iterations on both datasets and then stays roughly flat with a slight decline. The CRF layer mainly improves slot filling.
- Setup: BLSTM size 64, Adam optimizer, initial learning rate 0.01 with a decay factor of 0.05. Code is released on GitHub (ZephyrChenzf/SF-ID-Network-For-NLU).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

78 papers of our library cite it (of the 140884 whose bibliographies we read); 3 of them have a page here, 75 not yet.

- [SLURP: A Spoken Language Understanding Resource Package](https://md.research.elamur.ai/free/en/papers/bastianelli-2020-slurp-spoken-language-understanding-resource/)
- [A Distance-Aware Multi-Task Framework for Conversational Discourse Parsing](https://md.research.elamur.ai/free/en/papers/fan-2022-distance-aware-multi-task-framework/)
- [A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding](https://md.research.elamur.ai/free/en/papers/qin-2019-stack-propagation-framework-token-level/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{e2019novel,
  title = {{A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling}},
  author = {E, Haihong and Niu, Peiqing and Chen, Zhongfu and Song, Meina},
  booktitle = {Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics},
  year = {2019},
  doi = {10.18653/v1/p19-1544},
  url = {https://doi.org/10.18653/v1/p19-1544}
}
```

- [← previous A Multiscale Visualization of Attention in the Transformer Model](https://md.research.elamur.ai/free/en/papers/vig-2019-multiscale-visualization-attention-transformer-model/)
- [next → A Partially Rule-Based Approach to AMR Generation](https://md.research.elamur.ai/free/en/papers/manning-2019-partially-rule-based-approach-amr/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/)

## References

14 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Yun-Nung Chen, Dilek Hakanni-Tür, Gokhan Tur, Asli Celikyilmaz, Jianfeng Guo, and Li Deng. 2016a. Syntax or semantics? knowledge-guided joint semantic frame parsing. In Spoken Language Technology Workshop (SLT), 2016 IEEE, pages 348–355. IEEE. [find](https://scholar.google.com/scholar?q=Yun%2DNung+Chen%2C+Dilek+Hakanni%2DTu%CC%88r%2C+Gokhan+Tur%2C+Asli+Celikyilmaz%2C+Jianfeng+Guo%2C+and+Li+Deng%2E+2016a%2E+Syntax+or+semantics%3F+knowledge%2Dguided+joint+semantic+frame+parsing%2E+In+Spoken+Language+Technology+Wor)
2. Yun-Nung Chen, Dilek Hakkani-Tür, Gökhan Tür, Jianfeng Gao, and Li Deng. 2016b. End-to-end memory networks with knowledge carryover for multi-turn spoken language understanding. In IN-TERSPEECH, pages 3245–3249. [find](https://scholar.google.com/scholar?q=Yun%2DNung+Chen%2C+Dilek+Hakkani%2DTu%CC%88r%2C+Go%CC%88khan+Tu%CC%88r%2C+Jianfeng+Gao%2C+and+Li+Deng%2E+2016b%2E+End%2Dto%2Dend+memory+networks+with+knowledge+carryover+for+multi%2Dturn+spoken+language+understanding%2E+In+IN%2DTERSPEECH%2C+pa)
3. Alice Coucke, Alaa Saade, Adrien Ball, Théodore Bluche, Alexandre Caulier, David Leroy, Clément Doumouro, Thibault Gisselbrecht, Francesco Caltagirone, Thibaut Lavril, et al. 2018. Snips voice platform: an embedded spoken language understanding system for private-by-design voice interfaces. arXiv… [find](https://scholar.google.com/scholar?q=Alice+Coucke%2C+Alaa+Saade%2C+Adrien+Ball%2C+The%CC%81odore+Bluche%2C+Alexandre+Caulier%2C+David+Leroy%2C+Cle%CC%81ment+Doumouro%2C+Thibault+Gisselbrecht%2C+Francesco+Caltagirone%2C+Thibaut+Lavril%2C+et+al%2E+2018%2E+Snips+voice+platf) [our card](https://md.research.elamur.ai/free/en/papers/coucke-2018-snips-voice-platform-embedded-spoken/)
4. Chih-Wen Goo, Guang Gao, Yun-Kai Hsu, Chih-Li Huo, Tsung-Chieh Chen, Keng-Wei Hsu, and Yun-Nung Chen. 2018. Slot-gated modeling for joint slot filling and intent prediction. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human La… [find](https://scholar.google.com/scholar?q=Chih%2DWen+Goo%2C+Guang+Gao%2C+Yun%2DKai+Hsu%2C+Chih%2DLi+Huo%2C+Tsung%2DChieh+Chen%2C+Keng%2DWei+Hsu%2C+and+Yun%2DNung+Chen%2E+2018%2E+Slot%2Dgated+modeling+for+joint+slot+filling+and+intent+prediction%2E+In+Proceedings+of+the+2018) [our card](https://md.research.elamur.ai/free/en/papers/goo-2018-slot-gated-modeling-joint-slot/)
5. Patrick Haffner, Gokhan Tur, and Jerry H Wright. 2003. Optimizing svms for complex call classification. In Acoustics, Speech, and Signal Processing, 2003. Proceedings.(ICASSP’03). 2003 IEEE International Conference on, volume 1, pages I–I. IEEE. [find](https://scholar.google.com/scholar?q=Patrick+Haffner%2C+Gokhan+Tur%2C+and+Jerry+H+Wright%2E+2003%2E+Optimizing+svms+for+complex+call+classification%2E+In+Acoustics%2C+Speech%2C+and+Signal+Processing%2C+2003%2E+Proceedings%2E%28ICASSP%E2%80%9903%29%2E+2003+IEEE+Internatio)
6. Dilek Hakkani-Tür, Gökhan Tür, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang. 2016. Multi-domain joint semantic frame parsing using bi-directional rnn-lstm. In Interspeech, pages 715–719. [find](https://scholar.google.com/scholar?q=Dilek+Hakkani%2DTu%CC%88r%2C+Go%CC%88khan+Tu%CC%88r%2C+Asli+Celikyilmaz%2C+Yun%2DNung+Chen%2C+Jianfeng+Gao%2C+Li+Deng%2C+and+Ye%2DYi+Wang%2E+2016%2E+Multi%2Ddomain+joint+semantic+frame+parsing+using+bi%2Ddirectional+rnn%2Dlstm%2E+In+Interspeech%2C)
7. Charles T Hemphill, John J Godfrey, and George R Doddington. 1990. The atis spoken language systems pilot corpus. In Speech and Natural Language: Proceedings of a Workshop Held at Hidden Valley, Pennsylvania, June 24-27, 1990. [find](https://scholar.google.com/scholar?q=Charles+T+Hemphill%2C+John+J+Godfrey%2C+and+George+R+Doddington%2E+1990%2E+The+atis+spoken+language+systems+pilot+corpus%2E+In+Speech+and+Natural+Language%3A+Proceedings+of+a+Workshop+Held+at+Hidden+Valley%2C+Penns)
8. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980. [find](https://scholar.google.com/scholar?q=Diederik+P+Kingma+and+Jimmy+Ba%2E+2014%2E+Adam%3A+A+method+for+stochastic+optimization%2E+arXiv+preprint+arXiv%3A1412%2E6980%2E)
9. Siwei Lai, Liheng Xu, Kang Liu, and Jun Zhao. 2015. Recurrent convolutional neural networks for text classification. In AAAI, volume 333, pages 2267– 2273. [find](https://scholar.google.com/scholar?q=Siwei+Lai%2C+Liheng+Xu%2C+Kang+Liu%2C+and+Jun+Zhao%2E+2015%2E+Recurrent+convolutional+neural+networks+for+text+classification%2E+In+AAAI%2C+volume+333%2C+pages+2267%E2%80%93+2273%2E)
10. Bing Liu and Ian Lane. 2016. Attention-based recurrent neural network models for joint intent detection and slot filling. arXiv preprint arXiv:1609.01454. — [arXiv:1609.01454](https://arxiv.org/abs/1609.01454) [find](https://scholar.google.com/scholar?q=Bing+Liu+and+Ian+Lane%2E+2016%2E+Attention%2Dbased+recurrent+neural+network+models+for+joint+intent+detection+and+slot+filling%2E+arXiv+preprint+arXiv%3A1609%2E01454%2E+%E2%80%94+%5BarXiv%3A1609%2E01454%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F16)
11. Christian Raymond and Giuseppe Riccardi. 2007. Generative and discriminative algorithms for spoken language understanding. In Eighth Annual Conference of the International Speech Communication Association. [find](https://scholar.google.com/scholar?q=Christian+Raymond+and+Giuseppe+Riccardi%2E+2007%2E+Generative+and+discriminative+algorithms+for+spoken+language+understanding%2E+In+Eighth+Annual+Conference+of+the+International+Speech+Communication+Associa)
12. Gokhan Tur and Renato De Mori. 2011. Spoken language understanding: Systems for extracting semantic information from speech. John Wiley & Sons. [find](https://scholar.google.com/scholar?q=Gokhan+Tur+and+Renato+De+Mori%2E+2011%2E+Spoken+language+understanding%3A+Systems+for+extracting+semantic+information+from+speech%2E+John+Wiley+%26+Sons%2E)
13. Kaisheng Yao, Baolin Peng, Yu Zhang, Dong Yu, Geoffrey Zweig, and Yangyang Shi. 2014. Spoken language understanding using long short-term memory neural networks. In Spoken Language Technology Workshop (SLT), 2014 IEEE, pages 189–194. IEEE. [find](https://scholar.google.com/scholar?q=Kaisheng+Yao%2C+Baolin+Peng%2C+Yu+Zhang%2C+Dong+Yu%2C+Geoffrey+Zweig%2C+and+Yangyang+Shi%2E+2014%2E+Spoken+language+understanding+using+long+short%2Dterm+memory+neural+networks%2E+In+Spoken+Language+Technology+Workshop)
14. Xiaodong Zhang and Houfeng Wang. 2016. A joint model of intent determination and slot filling for spoken language understanding. In IJCAI, pages 2993–2999. [find](https://scholar.google.com/scholar?q=Xiaodong+Zhang+and+Houfeng+Wang%2E+2016%2E+A+joint+model+of+intent+determination+and+slot+filling+for+spoken+language+understanding%2E+In+IJCAI%2C+pages+2993%E2%80%932999%2E)