---
title: "Interpretable Neural Predictions with — Bastings 2019"
description: "This ACL 2019 paper addresses how to make neural text classifiers explain themselves."
authors: ["Jasmijn Bastings", "Wilker Aziz", "Ivan Titov"]
year: 2019
venue: "Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/P19-1284/"
doi: "10.18653/v1/p19-1284"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bastings-2019-interpretable-neural-predictions-differentiable-binary/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bastings-2019-interpretable-neural-predictions-differentiable-binary/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/page/3/) / Interpretable Neural Predictions with Differentiable Binary Variables

# Interpretable Neural Predictions with Differentiable Binary Variables

**Authors:** [Jasmijn Bastings](https://md.research.elamur.ai/free/en/authors/jasmijn-bastings/), [Wilker Aziz](https://md.research.elamur.ai/free/en/authors/wilker-aziz/), [Ivan Titov](https://md.research.elamur.ai/free/en/authors/ivan-titov/) · **Year:** 2019 · **Venue:** Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/P19-1284/) · [PDF](https://aclanthology.org/P19-1284.pdf) · [DOI 10.18653/v1/p19-1284](https://doi.org/10.18653/v1/p19-1284) · [OpenAlex](https://openalex.org/W2946263948)

**Citations:** 30 citations (openalex-snapshot · 2026-10-14) · [96](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
This ACL 2019 paper addresses how to make neural text classifiers explain themselves. The classifier's decision is based only on a brief, self-sufficient excerpt of the input, called a rationale. The setup follows Lei et al. (2016): one network chooses which words to keep, and a separately parameterised classifier sees only those words. Lei et al. used Bernoulli word masks, which forced them to rely on high-variance REINFORCE training. The authors replace these masks with HardKuma, a new distribution built by stretching a Kumaraswamy variable beyond [0, 1] and clipping it back. Samples can therefore be exactly 0, exactly 1, or in between, and gradients pass through via reparameterisation. Because the distribution has a closed-form CDF, the expected L0 penalty (number of selected words) and a fused-lasso-style transition penalty become differentiable. A Lagrangian relaxation then lets users set the desired fraction of selected text directly. Experiments on beer reviews show results comparable to earlier rationale extractors. HardKuma also works as a sparse attention mechanism for SNLI with the Decomposable Attention model, which matters for transparent, verifiable NLP systems.

## Key points
- **HardKuma distribution.** A Kumaraswamy(a, b) variable is stretched to an interval (l, r) with l \< 0 and r > 1, for example (−0.1, 1.1), then passed through a hard sigmoid. The probability of landing exactly on 0 or 1 is available in closed form.
- **Gradient training.** The selector is trained with reparameterised gradients via the inverse CDF of a uniform sample. This avoids REINFORCE and keeps the estimator unbiased, unlike straight-through or SPIGOT.
- **Controlled rationale length.** The expected L0 and transition penalties are tractable functions of the selector's parameters. Lagrangian relaxation targets a pre-specified selection rate instead of hand-tuning penalty weights.
- **Tasks and models.** Rationale extraction was tested on beer reviews, compared against Lei et al. (2016). Attention experiments used the SNLI corpus with Parikh et al.'s (2016) Decomposable Attention baseline. The provided excerpt omits the exact scores.
- **Code.** Released at github.com/bastings/interpretable_predictions.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

96 papers of our library cite it (of the 140884 whose bibliographies we read); 6 of them have a page here, 90 not yet.

- [Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases](https://md.research.elamur.ai/free/en/papers/chalkidis-2021-paragraph-level-rationale-extraction-through/)
- [ERASER: A Benchmark to Evaluate Rationalized NLP Models](https://md.research.elamur.ai/free/en/papers/deyoung-2020-eraser-benchmark-evaluate-rationalized-nlp/)
- [Learning to Faithfully Rationalize by Construction](https://md.research.elamur.ai/free/en/papers/jain-2020-learning-faithfully-rationalize-construction/)
- [Towards Faithful Model Explanation in NLP: A Survey](https://md.research.elamur.ai/free/en/papers/lyu-2024-faithful-model-explanation-nlp-survey/)
- [Structured Pruning of Large Language Models](https://md.research.elamur.ai/free/en/papers/wang-2020-structured-pruning-large-language-models/)
- [Measuring Association Between Labels and Free-Text Rationales](https://md.research.elamur.ai/free/en/papers/wiegreffe-2021-measuring-association-between-labels-free/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{bastings2019interpretable,
  title = {{Interpretable Neural Predictions with Differentiable Binary Variables}},
  author = {Bastings, Jasmijn and Aziz, Wilker and Titov, Ivan},
  booktitle = {Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics},
  year = {2019},
  doi = {10.18653/v1/p19-1284},
  url = {https://doi.org/10.18653/v1/p19-1284}
}
```

- [← previous Interfacing the Hebrew Bible: past, present and future applications for the BHSA](https://md.research.elamur.ai/free/en/papers/hbo-2019-winther-nielsen-interfacing-hebrew-bible-past-present/)
- [next → Invariant Risk Minimization](https://md.research.elamur.ai/free/en/papers/arjovsky-2019-invariant-risk-minimization/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/page/3/)

## References

42 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Mark Craven and Jude W Shavlik. 1996. Extracting tree-structured representations of trained networks. In Advances in neural information processing systems, pages 24–30. [find](https://scholar.google.com/scholar?q=Mark+Craven+and+Jude+W+Shavlik%2E+1996%2E+Extracting+tree%2Dstructured+representations+of+trained+networks%2E+In+Advances+in+neural+information+processing+systems%2C+pages+24%E2%80%9330%2E)
2. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+Bert%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+N)
3. Manaal Faruqui, Yulia Tsvetkov, Dani Yogatama, Chris Dyer, and Noah A. Smith. 2015. Sparse overcomplete word vector representations. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (V… [find](https://scholar.google.com/scholar?q=Manaal+Faruqui%2C+Yulia+Tsvetkov%2C+Dani+Yogatama%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2015%2E+Sparse+overcomplete+word+vector+representations%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the+Association+for+Co)
4. Leilani H Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. 2018. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), pages 80–89. IEEE. [find](https://scholar.google.com/scholar?q=Leilani+H+Gilpin%2C+David+Bau%2C+Ben+Z+Yuan%2C+Ayesha+Bajwa%2C+Michael+Specter%2C+and+Lalana+Kagal%2E+2018%2E+Explaining+explanations%3A+An+overview+of+interpretability+of+machine+learning%2E+In+2018+IEEE+5th+Internati)
5. David Alvarez-Melis and Tommi Jaakkola. 2017. A causal framework for explaining the predictions of black-box sequence-to-sequence models. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 412– 421. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=David+Alvarez%2DMelis+and+Tommi+Jaakkola%2E+2017%2E+A+causal+framework+for+explaining+the+predictions+of+black%2Dbox+sequence%2Dto%2Dsequence+models%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+)
6. Markus Harva and Ata Kaban. 2005. A variational bayesian method for rectified factor analysis. In Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005., volume 1, pages 185–190. IEEE. [find](https://scholar.google.com/scholar?q=Markus+Harva+and+Ata+Kaban%2E+2005%2E+A+variational+bayesian+method+for+rectified+factor+analysis%2E+In+Proceedings%2E+2005+IEEE+International+Joint+Conference+on+Neural+Networks%2C+2005%2E%2C+volume+1%2C+pages+185%E2%80%931)
7. Yoshua Bengio, Nicholas Léonard, and Aaron Courville. 2013. Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432. [find](https://scholar.google.com/scholar?q=Yoshua+Bengio%2C+Nicholas+Le%CC%81onard%2C+and+Aaron+Courville%2E+2013%2E+Estimating+or+propagating+gradients+through+stochastic+neurons+for+conditional+computation%2E+arXiv+preprint+arXiv%3A1308%2E3432%2E)
8. Aurélie Herbelot and Eva Maria Vecchi. 2015. Building a shared world: mapping distributional to model-theoretic semantic spaces. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 22–32. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Aure%CC%81lie+Herbelot+and+Eva+Maria+Vecchi%2E+2015%2E+Building+a+shared+world%3A+mapping+distributional+to+model%2Dtheoretic+semantic+spaces%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural+)
9. Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. A large annotated corpus for learning natural language inference. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 632–642. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Gabor+Angeli%2C+Christopher+Potts%2C+and+Christopher+D%2E+Manning%2E+2015%2E+A+large+annotated+corpus+for+learning+natural+language+inference%2E+In+Proceedings+of+the+2015+Conference+on+Empirica)
10. Samuel R. Bowman, Jon Gauthier, Abhinav Rastogi, Raghav Gupta, Christopher D. Manning, and Christopher Potts. 2016. A fast unified model for parsing and sentence understanding. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1… [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Jon+Gauthier%2C+Abhinav+Rastogi%2C+Raghav+Gupta%2C+Christopher+D%2E+Manning%2C+and+Christopher+Potts%2E+2016%2E+A+fast+unified+model+for+parsing+and+sentence+understanding%2E+In+Proceedings+of+the+5)
11. Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, and Diana Inkpen. 2017. Enhanced lstm for natural language inference. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1657–1668. Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Qian+Chen%2C+Xiaodan+Zhu%2C+Zhen%2DHua+Ling%2C+Si+Wei%2C+Hui+Jiang%2C+and+Diana+Inkpen%2E+2017%2E+Enhanced+lstm+for+natural+language+inference%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Association+for+Computa)
12. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation, 9(8):1735–1780. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+Ju%CC%88rgen+Schmidhuber%2E+1997%2E+Long+Short%2DTerm+Memory%2E+Neural+Computation%2C+9%288%29%3A1735%E2%80%931780%2E)
13. Jeremy Howard and Sebastian Ruder. 2018. Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 328–339. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jeremy+Howard+and+Sebastian+Ruder%2E+2018%2E+Universal+language+model+fine%2Dtuning+for+text+classification%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volum)
14. Eric Jang, Shixiang Gu, and Ben Poole. 2017. Categorical reparameterization with gumbel-softmax. International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Eric+Jang%2C+Shixiang+Gu%2C+and+Ben+Poole%2E+2017%2E+Categorical+reparameterization+with+gumbel%2Dsoftmax%2E+International+Conference+on+Learning+Representations%2E) [our card](https://md.research.elamur.ai/free/en/papers/jang-2016-categorical-reparameterization-gumbel-softmax/)
15. MichaelI. Jordan, Zoubin Ghahramani, TommiS. Jaakkola, and LawrenceK. Saul. 1999. An introduction to variational methods for graphical models. Machine Learning, 37(2):183–233. [find](https://scholar.google.com/scholar?q=MichaelI%2E+Jordan%2C+Zoubin+Ghahramani%2C+TommiS%2E+Jaakkola%2C+and+LawrenceK%2E+Saul%2E+1999%2E+An+introduction+to+variational+methods+for+graphical+models%2E+Machine+Learning%2C+37%282%29%3A183%E2%80%93233%2E)
16. Diederik P. Kingma and Max Welling. 2014. Autoencoding variational bayes. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Diederik+P%2E+Kingma+and+Max+Welling%2E+2014%2E+Autoencoding+variational+bayes%2E+In+International+Conference+on+Learning+Representations%2E)
17. Ponnambalam Kumaraswamy. 1980. A generalized probability density function for double-bounded random processes. Journal of Hydrology, 46(1-2):79–88. [find](https://scholar.google.com/scholar?q=Ponnambalam+Kumaraswamy%2E+1980%2E+A+generalized+probability+density+function+for+double%2Dbounded+random+processes%2E+Journal+of+Hydrology%2C+46%281%2D2%29%3A79%E2%80%9388%2E)
18. Tao Lei, Regina Barzilay, and Tommi Jaakkola. 2016. Rationalizing neural predictions. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 107–117. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Tao+Lei%2C+Regina+Barzilay%2C+and+Tommi+Jaakkola%2E+2016%2E+Rationalizing+neural+predictions%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+107%E2%80%93117%2E+Associat) [our card](https://md.research.elamur.ai/free/en/papers/lei-2016-rationalizing-neural-predictions/)
19. Zachary Chase Lipton. 2016. The mythos of model interpretability. ICML Workshop on Human Interpretability in Machine Learning (WHI 2016). [find](https://scholar.google.com/scholar?q=Zachary+Chase+Lipton%2E+2016%2E+The+mythos+of+model+interpretability%2E+ICML+Workshop+on+Human+Interpretability+in+Machine+Learning+%28WHI+2016%29%2E)
20. Christos Louizos, Max Welling, and Diederik P Kingma. 2017. Learning sparse neural networks through l 0 regularization. arXiv preprint arXiv:1712.01312. — [arXiv:1712.01312](https://arxiv.org/abs/1712.01312) [find](https://scholar.google.com/scholar?q=Christos+Louizos%2C+Max+Welling%2C+and+Diederik+P+Kingma%2E+2017%2E+Learning+sparse+neural+networks+through+l+0+regularization%2E+arXiv+preprint+arXiv%3A1712%2E01312%2E+%E2%80%94+%5BarXiv%3A1712%2E01312%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1712)
21. Chris J. Maddison, Andriy Mnih, and Yee Whye Teh. 2017. The concrete distribution: A continous relaxation of discrete random variables. International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Chris+J%2E+Maddison%2C+Andriy+Mnih%2C+and+Yee+Whye+Teh%2E+2017%2E+The+concrete+distribution%3A+A+continous+relaxation+of+discrete+random+variables%2E+International+Conference+on+Learning+Representations%2E)
22. Andre Martins and Ramon Astudillo. 2016. From softmax to sparsemax: A sparse model of attention and multi-label classification. In International Conference on Machine Learning, pages 1614–1623. [find](https://scholar.google.com/scholar?q=Andre+Martins+and+Ramon+Astudillo%2E+2016%2E+From+softmax+to+sparsemax%3A+A+sparse+model+of+attention+and+multi%2Dlabel+classification%2E+In+International+Conference+on+Machine+Learning%2C+pages+1614%E2%80%931623%2E)
23. Julian McAuley, Jure Leskovec, and Dan Jurafsky. 2012. Learning attitudes and attributes from multi-aspect reviews. In Data Mining (ICDM), 2012 IEEE 12th International Conference on, pages 1020– 1025. IEEE. [find](https://scholar.google.com/scholar?q=Julian+McAuley%2C+Jure+Leskovec%2C+and+Dan+Jurafsky%2E+2012%2E+Learning+attitudes+and+attributes+from+multi%2Daspect+reviews%2E+In+Data+Mining+%28ICDM%29%2C+2012+IEEE+12th+International+Conference+on%2C+pages+1020%E2%80%93+1025%2E)
24. Eric Nalisnick and Padhraic Smyth. 2016. Stick-breaking variational autoencoders. arXiv preprint arXiv:1605.06197. — [arXiv:1605.06197](https://arxiv.org/abs/1605.06197) [find](https://scholar.google.com/scholar?q=Eric+Nalisnick+and+Padhraic+Smyth%2E+2016%2E+Stick%2Dbreaking+variational+autoencoders%2E+arXiv+preprint+arXiv%3A1605%2E06197%2E+%E2%80%94+%5BarXiv%3A1605%2E06197%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1605%2E06197%29)
25. Vlad Niculae and Mathieu Blondel. 2017. A regularized framework for sparse and structured neural attention. In Advances in Neural Information Processing Systems, pages 3338–3348. [find](https://scholar.google.com/scholar?q=Vlad+Niculae+and+Mathieu+Blondel%2E+2017%2E+A+regularized+framework+for+sparse+and+structured+neural+attention%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+pages+3338%E2%80%933348%2E)
26. Vlad Niculae, André F. T. Martins, and Claire Cardie. 2018. Towards dynamic computation graphs via sparse latent structure. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 905–911. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Vlad+Niculae%2C+Andre%CC%81+F%2E+T%2E+Martins%2C+and+Claire+Cardie%2E+2018%2E+Towards+dynamic+computation+graphs+via+sparse+latent+structure%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Langu)
27. Ankur Parikh, Oscar Täckström, Dipanjan Das, and Jakob Uszkoreit. 2016. A decomposable attention model for natural language inference. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2249–2255. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ankur+Parikh%2C+Oscar+Ta%CC%88ckstro%CC%88m%2C+Dipanjan+Das%2C+and+Jakob+Uszkoreit%2E+2016%2E+A+decomposable+attention+model+for+natural+language+inference%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+N) [our card](https://md.research.elamur.ai/free/en/papers/parikh-2016-decomposable-attention-model-natural-language/)
28. Hao Peng, Sam Thomson, and Noah A. Smith. 2018. Backpropagating through structured argmax using a spigot. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1863–1873. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hao+Peng%2C+Sam+Thomson%2C+and+Noah+A%2E+Smith%2E+2018%2E+Backpropagating+through+structured+argmax+using+a+spigot%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Vo)
29. Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [find](https://scholar.google.com/scholar?q=Matthew+Peters%2C+Mark+Neumann%2C+Mohit+Iyyer%2C+Matt+Gardner%2C+Christopher+Clark%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2018%2E+Deep+contextualized+word+representations%2E+In+Proceedings+of+the+2018+Conference+of+t)
30. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the 31st International Conference on Machine Learning, volume 32 of Proceedings of Machine Learning Research, pages 1278–1286, Bejing, Ch… [find](https://scholar.google.com/scholar?q=Danilo+Jimenez+Rezende%2C+Shakir+Mohamed%2C+and+Daan+Wierstra%2E+2014%2E+Stochastic+backpropagation+and+approximate+inference+in+deep+generative+models%2E+In+Proceedings+of+the+31st+International+Conference+on+) [our card](https://md.research.elamur.ai/free/en/papers/rezende-2014-stochastic-backpropagation-approximate-inference-deep/)
31. Marco Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. “why should i trust you?”: Explaining the predictions of any classifier. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pages 97–101. Association for Computa… [find](https://scholar.google.com/scholar?q=Marco+Ribeiro%2C+Sameer+Singh%2C+and+Carlos+Guestrin%2E+2016%2E+%E2%80%9Cwhy+should+i+trust+you%3F%E2%80%9D%3A+Explaining+the+predictions+of+any+classifier%2E+In+Proceedings+of+the+2016+Conference+of+the+North+American+Chapter+of+) [our card](https://md.research.elamur.ai/free/en/papers/ribeiro-2016-why-should-i-trust-explaining/)
32. Jason Tyler Rolfe. 2017. Discrete variational autoencoders. In ICLR. [find](https://scholar.google.com/scholar?q=Jason+Tyler+Rolfe%2E+2017%2E+Discrete+variational+autoencoders%2E+In+ICLR%2E)
33. Nicholas D. Socci, Daniel D. Lee, and H. Sebastian Seung. 1998. The rectified gaussian distribution. In M. I. Jordan, M. J. Kearns, and S. A. Solla, editors, Advances in Neural Information Processing Systems 10, pages 350–356. MIT Press. [find](https://scholar.google.com/scholar?q=Nicholas+D%2E+Socci%2C+Daniel+D%2E+Lee%2C+and+H%2E+Sebastian+Seung%2E+1998%2E+The+rectified+gaussian+distribution%2E+In+M%2E+I%2E+Jordan%2C+M%2E+J%2E+Kearns%2C+and+S%2E+A%2E+Solla%2C+editors%2C+Advances+in+Neural+Information+Processing+)
34. Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1631–… [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Alex+Perelygin%2C+Jean+Wu%2C+Jason+Chuang%2C+Christopher+D%2E+Manning%2C+Andrew+Ng%2C+and+Christopher+Potts%2E+2013%2E+Recursive+deep+models+for+semantic+compositionality+over+a+sentiment+treebank%2E+In)
35. Sebastian Thrun. 1995. Extracting rules from artificial neural networks with distributed representations. In Advances in neural information processing systems, pages 505–512. [find](https://scholar.google.com/scholar?q=Sebastian+Thrun%2E+1995%2E+Extracting+rules+from+artificial+neural+networks+with+distributed+representations%2E+In+Advances+in+neural+information+processing+systems%2C+pages+505%E2%80%93512%2E)
36. Ivan Titov and Ryan McDonald. 2008. A joint model of text and aspect ratings for sentiment summarization. In Proceedings of ACL. [find](https://scholar.google.com/scholar?q=Ivan+Titov+and+Ryan+McDonald%2E+2008%2E+A+joint+model+of+text+and+aspect+ratings+for+sentiment+summarization%2E+In+Proceedings+of+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/titov-2008-joint-model-text-aspect-ratings/)
37. Ronald J Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8(3-4):229–256. [find](https://scholar.google.com/scholar?q=Ronald+J+Williams%2E+1992%2E+Simple+statistical+gradient%2Dfollowing+algorithms+for+connectionist+reinforcement+learning%2E+Machine+learning%2C+8%283%2D4%29%3A229%E2%80%93256%2E)
38. John Winn and Christopher M Bishop. 2005. Variational message passing. Journal of Machine Learning Research, 6(Apr):661–694. [find](https://scholar.google.com/scholar?q=John+Winn+and+Christopher+M+Bishop%2E+2005%2E+Variational+message+passing%2E+Journal+of+Machine+Learning+Research%2C+6%28Apr%29%3A661%E2%80%93694%2E)
39. Omar Zaidan and Jason Eisner. 2008. Modeling annotators: A generative approach to learning from annotator rationales. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 31–40, Honolulu, Hawaii. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Omar+Zaidan+and+Jason+Eisner%2E+2008%2E+Modeling+annotators%3A+A+generative+approach+to+learning+from+annotator+rationales%2E+In+Proceedings+of+the+2008+Conference+on+Empirical+Methods+in+Natural+Language+Pro)
40. Omar Zaidan, Jason Eisner, and Christine Piatko. 2007. Using “annotator rationales” to improve machine learning for text categorization. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Confere… [find](https://scholar.google.com/scholar?q=Omar+Zaidan%2C+Jason+Eisner%2C+and+Christine+Piatko%2E+2007%2E+Using+%E2%80%9Cannotator+rationales%E2%80%9D+to+improve+machine+learning+for+text+categorization%2E+In+Human+Language+Technologies+2007%3A+The+Conference+of+the+Nort) [our card](https://md.research.elamur.ai/free/en/papers/zaidan-2007-annotator-rationales-improve-machine-learning/)
41. Ye Zhang, Iain Marshall, and Byron C. Wallace. 2016. Rationale-augmented convolutional neural networks for text classification. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 795–804, Austin, Texas. Association for Computational Linguistics. where r… [find](https://scholar.google.com/scholar?q=Ye+Zhang%2C+Iain+Marshall%2C+and+Byron+C%2E+Wallace%2E+2016%2E+Rationale%2Daugmented+convolutional+neural+networks+for+text+classification%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+La)
42. Z t 0 −l (22) 1 f K (k; a, b) (r − l)dk (r − l) −∞   0 −l ; a, b . = F K t r−l = Thus we can obtain samples from this generalised-support Kumaraswamy by sampling from a uniform distribution U(0, 1), applying the inverse transform (19), then shifting and scaling the sample according to (20, left).… [find](https://scholar.google.com/scholar?q=Z+t+0+%E2%88%92l+%2822%29+1+f+K+%28k%3B+a%2C+b%29+%28r+%E2%88%92+l%29dk+%28r+%E2%88%92+l%29+%E2%88%92%E2%88%9E+%11+%10+0+%E2%88%92l+%3B+a%2C+b+%2E+%3D+F+K+t+r%E2%88%92l+%3D+Thus+we+can+obtain+samples+from+this+generalised%2Dsupport+Kumaraswamy+by+sampling+from+a+uniform+distribution+U%280%2C+1%29%2C)