---
title: "A Benchmark Dataset for Learning to Intervene in — Qian 2019"
description: "Most NLP work on online hate speech stops at detection, and existing datasets usually label single posts with no surrounding discussion."
authors: ["Jing Qian", "Anna Bethke", "Yinyin Liu", "Elizabeth Belding", "William Yang Wang"]
year: 2019
venue: "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)"
source: "https://aclanthology.org/D19-1482/"
doi: "10.18653/v1/d19-1482"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/qian-2019-benchmark-dataset-learning-intervene-online/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/qian-2019-benchmark-dataset-learning-intervene-online/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/) / A Benchmark Dataset for Learning to Intervene in Online Hate Speech

# A Benchmark Dataset for Learning to Intervene in Online Hate Speech

**Authors:** Jing Qian, [Anna Bethke](https://md.research.elamur.ai/free/en/authors/anna-bethke/), Yinyin Liu, [Elizabeth Belding](https://md.research.elamur.ai/free/en/authors/elizabeth-belding/), [William Yang Wang](https://md.research.elamur.ai/free/en/authors/william-yang-wang/) · **Year:** 2019 · **Venue:** Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/D19-1482/) · [PDF](https://aclanthology.org/D19-1482.pdf) · [DOI 10.18653/v1/d19-1482](https://doi.org/10.18653/v1/d19-1482) · [OpenAlex](https://openalex.org/W2971050273)

**Citations:** 179 citations (openalex-snapshot · 2026-10-14) · [111](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Most NLP work on online hate speech stops at detection, and existing datasets usually label single posts with no surrounding discussion. Qian et al. propose a new task, generative hate speech intervention: given a conversation that contains hateful content, a system should produce a reply that pushes back. To support the task, they built two conversational datasets, one from Reddit and one from Gab. The authors found candidate hateful posts with hate keywords and then rebuilt the full comment threads around them. Mechanical Turk workers marked which posts were hateful and wrote short intervention replies, so the data also works for classification. The paper benchmarks detection classifiers and three response generators: Seq2Seq, VAE, and RL. All models do better on Gab, which is larger and more balanced. The RL model does not improve automatic scores, yet human judges rate its replies as more effective and more varied. Human-written replies remain clearly superior. The authors argue that BLEU-style metrics capture response quality poorly, which leaves substantial room for future work on counter-speech generation.

## Key points
- The two datasets are roughly 5k Reddit conversations (about 22k posts) and 12k Gab conversations (about 34k posts). Every post carries a hate/non-hate label, and the data is public on GitHub.
- Reddit threads come from the 200 hottest submissions in each of ten subreddits often described as toxic, such as r/MGTOW and r/The Donald. Gab data covers all posts from October 2018. Threads longer than 20 comments were excluded, and replies were limited to 140 characters.
- For detection, SVM and LR outperform CNN and RNN models that use randomly initialized embeddings.
- On Gab, RL won human preference in 41.6% of cases for effectiveness and 40.0% for diversity. VAE tended to repeat stock replies about disability slurs.
- A single generic reply used for every case still scores 4.2 BLEU, 20.4 ROUGE-L, and 18.2 METEOR on Gab. In comparisons with model outputs, human responses were chosen 70% or more of the time.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

111 papers of our library cite it (of the 140884 whose bibliographies we read); 3 of them have a page here, 108 not yet.

- [SemEval-2023 Task 10: Explainable Detection of Online Sexism](https://md.research.elamur.ai/free/en/papers/kirk-2023-semeval-2023-task-10-explainable/)
- [Explainable AI for Ethical Counter Speech Generation in Hate Speech Mitigation](https://md.research.elamur.ai/free/en/papers/ridoy-2026-explainable-ai-ethical-counter-speech/)
- [Social Bias Frames: Reasoning about Social and Power Implications of Language](https://md.research.elamur.ai/free/en/papers/sap-2020-social-bias-frames-reasoning-about/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{qian2019benchmark,
  title = {{A Benchmark Dataset for Learning to Intervene in Online Hate Speech}},
  author = {Qian, Jing and Bethke, Anna and Liu, Yinyin and Belding, Elizabeth and Wang, William Yang},
  booktitle = {Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)},
  year = {2019},
  doi = {10.18653/v1/d19-1482},
  url = {https://doi.org/10.18653/v1/d19-1482}
}
```

- [← previous 75 Languages, 1 Model: Parsing Universal Dependencies Universally](https://md.research.elamur.ai/free/en/papers/ud-2019-kondratyuk-75-languages-1-model-parsing/)
- [next → A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/jiang-2019-challenge-dataset-effective-models-aspect/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/)

## References

33 references, 11 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. space. In Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning, CoNLL 2016, Berlin, Germany, August 11-12, 2016, pages 10–21. [find](https://scholar.google.com/scholar?q=space%2E+In+Proceedings+of+the+20th+SIGNLL+Conference+on+Computational+Natural+Language+Learning%2C+CoNLL+2016%2C+Berlin%2C+Germany%2C+August+11%2D12%2C+2016%2C+pages+10%E2%80%9321%2E)
2. Pete Burnap and Matthew L Williams. 2016. Us and Them: Identifying Cyber Hate on Twitter across Multiple Protected Characteristics. EPJ Data Science, 5(1):11. [find](https://scholar.google.com/scholar?q=Pete+Burnap+and+Matthew+L+Williams%2E+2016%2E+Us+and+Them%3A+Identifying+Cyber+Hate+on+Twitter+across+Multiple+Protected+Characteristics%2E+EPJ+Data+Science%2C+5%281%29%3A11%2E)
3. Pew Research Center. 2017. Online harassment 2017. [find](https://scholar.google.com/scholar?q=Pew+Research+Center%2E+2017%2E+Online+harassment+2017%2E)
4. Despoina Chatzakou, Nicolas Kourtellis, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Athena Vakali. 2017. Mean birds: Detecting aggression and bullying on twitter. In Proceedings of the 2017 ACM on web science conference, pages 13–22. ACM. [find](https://scholar.google.com/scholar?q=Despoina+Chatzakou%2C+Nicolas+Kourtellis%2C+Jeremy+Blackburn%2C+Emiliano+De+Cristofaro%2C+Gianluca+Stringhini%2C+and+Athena+Vakali%2E+2017%2E+Mean+birds%3A+Detecting+aggression+and+bullying+on+twitter%2E+In+Proceedings)
5. Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Lan… [find](https://scholar.google.com/scholar?q=Kyunghyun+Cho%2C+Bart+van+Merrienboer%2C+C%CC%A7aglar+Gu%CC%88lc%CC%A7ehre%2C+Dzmitry+Bahdanau%2C+Fethi+Bougares%2C+Holger+Schwenk%2C+and+Yoshua+Bengio%2E+2014%2E+Learning+phrase+representations+using+RNN+encoder%2Ddecoder+for+statis)
6. Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. Automated hate speech detection and the problem of offensive language. In Eleventh International AAAI Conference on Web and Social Media. [find](https://scholar.google.com/scholar?q=Thomas+Davidson%2C+Dana+Warmsley%2C+Michael+Macy%2C+and+Ingmar+Weber%2E+2017%2E+Automated+hate+speech+detection+and+the+problem+of+offensive+language%2E+In+Eleventh+International+AAAI+Conference+on+Web+and+Social) [our card](https://md.research.elamur.ai/free/en/papers/davidson-2017-automated-hate-speech-detection-problem/)
7. Mai ElSherief, Vivek Kulkarni, Dana Nguyen, William Yang Wang, and Elizabeth Belding. 2018a. Hate lingo: A target-based linguistic analysis of hate speech in social media. In Twelfth International AAAI Conference on Web and Social Media. [find](https://scholar.google.com/scholar?q=Mai+ElSherief%2C+Vivek+Kulkarni%2C+Dana+Nguyen%2C+William+Yang+Wang%2C+and+Elizabeth+Belding%2E+2018a%2E+Hate+lingo%3A+A+target%2Dbased+linguistic+analysis+of+hate+speech+in+social+media%2E+In+Twelfth+International+AAA)
8. Pinkesh Badjatiya, Shashank Gupta, Manish Gupta, and Vasudeva Varma. 2017. Deep learning for hate speech detection in tweets. In Proceedings of the 26th International Conference on World Wide Web Companion, pages 759–760. International World Wide Web Conferences Steering Committee. [find](https://scholar.google.com/scholar?q=Pinkesh+Badjatiya%2C+Shashank+Gupta%2C+Manish+Gupta%2C+and+Vasudeva+Varma%2E+2017%2E+Deep+learning+for+hate+speech+detection+in+tweets%2E+In+Proceedings+of+the+26th+International+Conference+on+World+Wide+Web+Comp)
9. Mai ElSherief, Shirin Nilizadeh, Dana Nguyen, Giovanni Vigna, and Elizabeth Belding. 2018b. Peer to peer hate: Hate speech instigators and their targets. In Twelfth International AAAI Conference on Web and Social Media. [find](https://scholar.google.com/scholar?q=Mai+ElSherief%2C+Shirin+Nilizadeh%2C+Dana+Nguyen%2C+Giovanni+Vigna%2C+and+Elizabeth+Belding%2E+2018b%2E+Peer+to+peer+hate%3A+Hate+speech+instigators+and+their+targets%2E+In+Twelfth+International+AAAI+Conference+on+We)
10. Satanjeev Banerjee and Alon Lavie. 2005. Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, pages 65–72. [find](https://scholar.google.com/scholar?q=Satanjeev+Banerjee+and+Alon+Lavie%2E+2005%2E+Meteor%3A+An+automatic+metric+for+mt+evaluation+with+improved+correlation+with+human+judgments%2E+In+Proceedings+of+the+acl+workshop+on+intrinsic+and+extrinsic+eva) [our card](https://md.research.elamur.ai/free/en/papers/banerjee-2005-meteor-automatic-metric-mt-evaluation/)
11. Antigoni Maria Founta, Constantinos Djouvas, Despoina Chatzakou, Ilias Leontiadis, Jeremy Blackburn, Gianluca Stringhini, Athena Vakali, Michael Sirivianos, and Nicolas Kourtellis. 2018. Large scale crowdsourcing and characterization of twitter abusive behavior. In Twelfth International AAAI Confere… [find](https://scholar.google.com/scholar?q=Antigoni+Maria+Founta%2C+Constantinos+Djouvas%2C+Despoina+Chatzakou%2C+Ilias+Leontiadis%2C+Jeremy+Blackburn%2C+Gianluca+Stringhini%2C+Athena+Vakali%2C+Michael+Sirivianos%2C+and+Nicolas+Kourtellis%2E+2018%2E+Large+scale+c)
12. Heiner Bielefeldt, Frank La Rue, and Githu Muigai. 2011. Ohchr expert workshops on the prohibition of incitement to national, racial or religious hatred. Expert workshop on the Americas. [find](https://scholar.google.com/scholar?q=Heiner+Bielefeldt%2C+Frank+La+Rue%2C+and+Githu+Muigai%2E+2011%2E+Ohchr+expert+workshops+on+the+prohibition+of+incitement+to+national%2C+racial+or+religious+hatred%2E+Expert+workshop+on+the+Americas%2E)
13. Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal Józefowicz, and Samy Bengio. 2016. Generating sentences from a continuous Lei Gao, Alexis Kuppersmith, and Ruihong Huang. 2017. Recognizing explicit and implicit hate speech using a weakly supervised two-path bootstrapping approach.… [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Luke+Vilnis%2C+Oriol+Vinyals%2C+Andrew+M%2E+Dai%2C+Rafal+Jo%CC%81zefowicz%2C+and+Samy+Bengio%2E+2016%2E+Generating+sentences+from+a+continuous+Lei+Gao%2C+Alexis+Kuppersmith%2C+and+Ruihong+Huang%2E+2017%2E+Reco)
14. Jennifer Golbeck, Zahra Ashktorab, Rashad O Banjo, Alexandra Berlinger, Siddharth Bhagwan, Cody Buntain, Paul Cheakalos, Alicia A Geller, Quint Gergory, Rajesh Kumar Gnanasekaran, et al. 2017. A large labeled corpus for online harassment research. In Proceedings of the 2017 ACM on Web Science Confer… [find](https://scholar.google.com/scholar?q=Jennifer+Golbeck%2C+Zahra+Ashktorab%2C+Rashad+O+Banjo%2C+Alexandra+Berlinger%2C+Siddharth+Bhagwan%2C+Cody+Buntain%2C+Paul+Cheakalos%2C+Alicia+A+Geller%2C+Quint+Gergory%2C+Rajesh+Kumar+Gnanasekaran%2C+et+al%2E+2017%2E+A+large)
15. George W. Kennedy III, Andrew W. McCollough, Edward Dixon, Alexie Bastidas, John Ryan, Chris Loo, and Saurav Sahay. 2017. Technology solutions to combat online harassment. In Proceedings of the first workshop on abusive language online, pages 73–77. [find](https://scholar.google.com/scholar?q=George+W%2E+Kennedy+III%2C+Andrew+W%2E+McCollough%2C+Edward+Dixon%2C+Alexie+Bastidas%2C+John+Ryan%2C+Chris+Loo%2C+and+Saurav+Sahay%2E+2017%2E+Technology+solutions+to+combat+online+harassment%2E+In+Proceedings+of+the+first+)
16. Jing Qian, Mai ElSherief, Elizabeth Belding, and William Yang Wang. 2018a. Hierarchical cvae for fine-grained hate speech classification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3550–3559. [find](https://scholar.google.com/scholar?q=Jing+Qian%2C+Mai+ElSherief%2C+Elizabeth+Belding%2C+and+William+Yang+Wang%2E+2018a%2E+Hierarchical+cvae+for+fine%2Dgrained+hate+speech+classification%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+)
17. Jing Qian, Mai ElSherief, Elizabeth Belding, and William Yang Wang. 2018b. Leveraging intra-user and inter-user representation learning for automated hate speech detection. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lan… [find](https://scholar.google.com/scholar?q=Jing+Qian%2C+Mai+ElSherief%2C+Elizabeth+Belding%2C+and+William+Yang+Wang%2E+2018b%2E+Leveraging+intra%2Duser+and+inter%2Duser+representation+learning+for+automated+hate+speech+detection%2E+In+Proceedings+of+the+2018+)
18. Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, pages 1746–1751. [find](https://scholar.google.com/scholar?q=Yoon+Kim%2E+2014%2E+Convolutional+neural+networks+for+sentence+classification%2E+In+Proceedings+of+the+2014+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+EMNLP+2014%2C+October+25%2D29%2C+2014%2C+D) [our card](https://md.research.elamur.ai/free/en/papers/kim-2014-convolutional-neural-networks-sentence-classification/)
19. Marc’Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. 2016. Sequence level training with recurrent neural networks. In 4th International Conference on Learning Representations, ICLR 2016. [find](https://scholar.google.com/scholar?q=Marc%E2%80%99Aurelio+Ranzato%2C+Sumit+Chopra%2C+Michael+Auli%2C+and+Wojciech+Zaremba%2E+2016%2E+Sequence+level+training+with+recurrent+neural+networks%2E+In+4th+International+Conference+on+Learning+Representations%2C+ICLR+) [our card](https://md.research.elamur.ai/free/en/papers/ranzato-2015-sequence-level-training-recurrent-neural/)
20. Diederik P Kingma and Max Welling. 2013. Autoencoding variational bayes. arXiv preprint arXiv:1312.6114. [find](https://scholar.google.com/scholar?q=Diederik+P+Kingma+and+Max+Welling%2E+2013%2E+Autoencoding+variational+bayes%2E+arXiv+preprint+arXiv%3A1312%2E6114%2E) [our card](https://md.research.elamur.ai/free/en/papers/kingma-2013-auto-encoding-variational-bayes/)
21. Anna Schmidt and Michael Wiegand. 2017. A survey on hate speech detection using natural language processing. In Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media, pages 1–10. [find](https://scholar.google.com/scholar?q=Anna+Schmidt+and+Michael+Wiegand%2E+2017%2E+A+survey+on+hate+speech+detection+using+natural+language+processing%2E+In+Proceedings+of+the+Fifth+International+Workshop+on+Natural+Language+Processing+for+Socia) [our card](https://md.research.elamur.ai/free/en/papers/schmidt-2017-survey-hate-speech-detection-natural/)
22. Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, and Jianfeng Gao. 2016. Deep reinforcement learning for dialogue generation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 2016, pages 1192–1202… [find](https://scholar.google.com/scholar?q=Jiwei+Li%2C+Will+Monroe%2C+Alan+Ritter%2C+Dan+Jurafsky%2C+Michel+Galley%2C+and+Jianfeng+Gao%2E+2016%2E+Deep+reinforcement+learning+for+dialogue+generation%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods) [our card](https://md.research.elamur.ai/free/en/papers/li-2016-deep-reinforcement-learning-dialogue-generation/)
23. Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out. [find](https://scholar.google.com/scholar?q=Chin%2DYew+Lin%2E+2004%2E+Rouge%3A+A+package+for+automatic+evaluation+of+summaries%2E+Text+Summarization+Branches+Out%2E)
24. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111–3119. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Ilya+Sutskever%2C+Kai+Chen%2C+Greg+S+Corrado%2C+and+Jeff+Dean%2E+2013%2E+Distributed+representations+of+words+and+phrases+and+their+compositionality%2E+In+Advances+in+neural+information+processing+)
25. Chikashi Nobata, Joel Tetreault, Achint Thomas, Yashar Mehdad, and Yi Chang. 2016. Abusive language detection in online user content. In Proceedings of the 25th international conference on world wide web, pages 145–153. International World Wide Web Conferences Steering Committee. [find](https://scholar.google.com/scholar?q=Chikashi+Nobata%2C+Joel+Tetreault%2C+Achint+Thomas%2C+Yashar+Mehdad%2C+and+Yi+Chang%2E+2016%2E+Abusive+language+detection+in+online+user+content%2E+In+Proceedings+of+the+25th+international+conference+on+world+wide+)
26. Abby Ohlheiser. 2016. Banned from twitter? this site promises you can say whatever you want. The Washington Post. [find](https://scholar.google.com/scholar?q=Abby+Ohlheiser%2E+2016%2E+Banned+from+twitter%3F+this+site+promises+you+can+say+whatever+you+want%2E+The+Washington+Post%2E)
27. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting on association for computational linguistics, pages 311–318. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+Bleu%3A+a+method+for+automatic+evaluation+of+machine+translation%2E+In+Proceedings+of+the+40th+annual+meeting+on+association+for+computat) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
28. Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems. [find](https://scholar.google.com/scholar?q=Ilya+Sutskever%2C+Oriol+Vinyals%2C+and+Quoc+V+Le%2E+2014%2E+Sequence+to+sequence+learning+with+neural+networks%2E+In+Advances+in+neural+information+processing+systems%2E)
29. Cynthia Van Hee, Els Lefever, Ben Verhoeven, Julie Mennes, Bart Desmet, Guy De Pauw, Walter Daelemans, and Véronique Hoste. 2015. Detection and Fine-grained Classification of Cyberbullying Events. In RANLP’15: International Conference Recent Advances in Natural Language Processing, pages 672–680. [find](https://scholar.google.com/scholar?q=Cynthia+Van+Hee%2C+Els+Lefever%2C+Ben+Verhoeven%2C+Julie+Mennes%2C+Bart+Desmet%2C+Guy+De+Pauw%2C+Walter+Daelemans%2C+and+Ve%CC%81ronique+Hoste%2E+2015%2E+Detection+and+Fine%2Dgrained+Classification+of+Cyberbullying+Events%2E+In)
30. William Warner and Julia Hirschberg. 2012. Detecting Hate Speech on the World Wide Web. In ACL’12: Proceedings of the 2nd Workshop on Language in Social Media, pages 19–26. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=William+Warner+and+Julia+Hirschberg%2E+2012%2E+Detecting+Hate+Speech+on+the+World+Wide+Web%2E+In+ACL%E2%80%9912%3A+Proceedings+of+the+2nd+Workshop+on+Language+in+Social+Media%2C+pages+19%E2%80%9326%2E+Association+for+Computation) [our card](https://md.research.elamur.ai/free/en/papers/warner-2012-detecting-hate-speech-world-wide/)
31. Zeerak Waseem and Dirk Hovy. 2016. Hateful symbols or hateful people? predictive features for hate speech detection on twitter. In Proceedings of the NAACL student research workshop, pages 88–93. [find](https://scholar.google.com/scholar?q=Zeerak+Waseem+and+Dirk+Hovy%2E+2016%2E+Hateful+symbols+or+hateful+people%3F+predictive+features+for+hate+speech+detection+on+twitter%2E+In+Proceedings+of+the+NAACL+student+research+workshop%2C+pages+88%E2%80%9393%2E) [our card](https://md.research.elamur.ai/free/en/papers/waseem-2016-hateful-symbols-or-hateful-people/)
32. Haoti Zhong, Hao Li, Anna Cinzia Squicciarini, Sarah Michele Rajtmajer, Christopher Griffin, David J Miller, and Cornelia Caragea. 2016. Content-Driven Detection of Cyberbullying on the Instagram Social Network. In IJCAI’16: Proceedings of the 25th International Joint Conference on Artificial Intell… [find](https://scholar.google.com/scholar?q=Haoti+Zhong%2C+Hao+Li%2C+Anna+Cinzia+Squicciarini%2C+Sarah+Michele+Rajtmajer%2C+Christopher+Griffin%2C+David+J+Miller%2C+and+Cornelia+Caragea%2E+2016%2E+Content%2DDriven+Detection+of+Cyberbullying+on+the+Instagram+Soci)
33. Romain Paulus, Caiming Xiong, and Richard Socher. 2018. A deep reinforced model for abstractive summarization. In 6th International Conference on Learning Representations, ICLR 2018. [find](https://scholar.google.com/scholar?q=Romain+Paulus%2C+Caiming+Xiong%2C+and+Richard+Socher%2E+2018%2E+A+deep+reinforced+model+for+abstractive+summarization%2E+In+6th+International+Conference+on+Learning+Representations%2C+ICLR+2018%2E) [our card](https://md.research.elamur.ai/free/en/papers/paulus-2017-deep-reinforced-model-abstractive-summarization/)