--- title: "P-Stance: A Large Dataset for Stance Detection in — Li 2021" description: "Stance detection asks whether an author supports or opposes a given target." authors: ["Yingjie Li", "Tiberiu Sosea", "Aditya Sawant", "Ajith Jayaraman Nair", "Diana Inkpen", "Cornelia Caragea"] year: 2021 venue: "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021" source: "https://aclanthology.org/2021.findings-acl.208/" doi: "10.18653/v1/2021.findings-acl.208" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/papers/li-2021-p-stance-large-dataset-stance/" --- [Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/li-2021-p-stance-large-dataset-stance/) [home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2021](https://md.research.elamur.ai/free/papers/2021/page/3/) / P-Stance: A Large Dataset for Stance Detection in Political Domain # P-Stance: A Large Dataset for Stance Detection in Political Domain **Authors:** [Yingjie Li](https://md.research.elamur.ai/free/authors/yingjie-li/), Tiberiu Sosea, Aditya Sawant, Ajith Jayaraman Nair, [Diana Inkpen](https://md.research.elamur.ai/free/authors/diana-inkpen/), [Cornelia Caragea](https://md.research.elamur.ai/free/authors/cornelia-caragea/) · **Year:** 2021 · **Venue:** Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2021.findings-acl.208/) · [PDF](https://aclanthology.org/2021.findings-acl.208.pdf) · [DOI 10.18653/v1/2021.findings-acl.208](https://doi.org/10.18653/v1/2021.findings-acl.208) · [OpenAlex](https://openalex.org/W3173838631) **Citations:** 91 citations (openalex-snapshot · 2026-10-14) · [78](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary Stance detection asks whether an author supports or opposes a given target. Progress has been held back by small benchmarks. Their tweets are also short, and the stance often shows through obvious keywords or direct mentions of the target. The authors build P-Stance, an English Twitter corpus from the 2020 U.S. presidential race that covers three politicians: Donald Trump, Joe Biden and Bernie Sanders. They gathered about 2.8 million tweets through the Twitter streaming API using pro, anti and neutral seed hashtags. After length filtering and removing duplicates and retweets, they manually labeled 21,574 tweets. Among the models they test, fine-tuned BERTweet does best with 80.53% macro-F1. Uncertainty-aware Self-Training (UST) on a large unlabeled companion set, P-Stance-EXT, raises this further. The corpus also supports cross-target transfer and a new cross-topic setting, where a model trained on 2016 data about a politician is tested on 2020 tweets about the same person. Overall, it gives political opinion mining a bigger and harder benchmark with less reliance on surface cues. ## Key points - P-Stance has 21,574 labeled tweets, more than three times the size of SemEval-2016 (4,870). Tweets were kept only if they had 10–128 words. - Annotator agreement (Krippendorff's alpha) averages 0.60 for the 3-class setup and 0.81 for the 2-class setup. - BERTweet scores 82.48 / 81.02 / 78.09 F1 on Trump, Biden and Sanders, beating BERT and other baselines. - UST-ALL reaches 82.42 macro-F1, 1.89 points above BERTweet. With only 100 labeled examples, UST is within 1.6 points of the full-data model on Biden. - In cross-topic tests (2016 → 2020), BERTweet scores 73.58 on Trump and 66.48 on Sanders. Dataset and code: github.com/chuchun8/PStance. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) ## Cited by Cited by 78 papers of our library cite it (of the 140673 whose bibliographies we read); 10 of them have a page here, 68 not yet. - [MGKM at StanceEval2024 Fine-Tuning Large Language Models for Arabic Stance Detection](https://md.research.elamur.ai/free/papers/alghaslan-2024-mgkm-stanceeval2024-fine-tuning-large/) - [Infusing Knowledge from Wikipedia to Enhance Stance Detection](https://md.research.elamur.ai/free/papers/he-2022-infusing-knowledge-wikipedia-enhance-stance/) - [Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation](https://md.research.elamur.ai/free/papers/li-2021-improving-stance-detection-multi-dataset/) - [Distilling Calibrated Knowledge for Stance Detection](https://md.research.elamur.ai/free/papers/li-2023-distilling-calibrated-knowledge-stance-detection/) - [A New Direction in Stance Detection: Target-Stance Extraction in the Wild](https://md.research.elamur.ai/free/papers/li-2023-new-direction-stance-detection-target/) - [Stance Detection on Social Media with Background Knowledge](https://md.research.elamur.ai/free/papers/li-2023-stance-detection-social-media-background/) - [Guiding Computational Stance Detection with Expanded Stance Triangle Framework](https://md.research.elamur.ai/free/papers/liu-2023-guiding-computational-stance-detection-expanded/) - [Multilingual Target-Stance Extraction](https://md.research.elamur.ai/free/papers/mines-2026-multilingual-target-stance-extraction/) - [A Challenge Dataset and Effective Models for Conversational Stance Detection](https://md.research.elamur.ai/free/papers/niu-2024-challenge-dataset-effective-models-conversational/) - [C-STANCE: A Large Dataset for Chinese Zero-Shot Stance Detection](https://md.research.elamur.ai/free/papers/zhao-2023-c-stance-large-dataset-chinese/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{li2021p, title = {{P-Stance: A Large Dataset for Stance Detection in Political Domain}}, author = {Li, Yingjie and Sosea, Tiberiu and Sawant, Aditya and Nair, Ajith Jayaraman and Inkpen, Diana and Caragea, Cornelia}, booktitle = {Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021}, year = {2021}, doi = {10.18653/v1/2021.findings-acl.208}, url = {https://doi.org/10.18653/v1/2021.findings-acl.208} } ``` - [← previous Overview of the WANLP 2021 Shared Task on Sarcasm and Sentiment Detection in Arabic](https://md.research.elamur.ai/free/papers/farha-2021-overview-wanlp-2021-shared-task/) - [next → P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks](https://md.research.elamur.ai/free/papers/liu-2021-p-tuning-v2-prompt-tuning/) - [↑ back to papers of 2021](https://md.research.elamur.ai/free/papers/2021/page/3/) ## References 4 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Abeer ALDayel and Walid Magdy. 2021. Stance detection on social media: State of the art and trends. Information Processing & Management, 58(4):102597. [find](https://scholar.google.com/scholar?q=Abeer+ALDayel+and+Walid+Magdy%2E+2021%2E+Stance+detection+on+social+media%3A+State+of+the+art+and+trends%2E+Information+Processing+%26+Management%2C+58%284%29%3A102597%2E) 2. Isabelle Augenstein, Tim Rocktäschel, Andreas Vlachos, and Kalina Bontcheva. 2016. Stance detection with bidirectional conditional encoding. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 876–885. [find](https://scholar.google.com/scholar?q=Isabelle+Augenstein%2C+Tim+Rockt%C3%A4schel%2C+Andreas+Vlachos%2C+and+Kalina+Bontcheva%2E+2016%2E+Stance+detection+with+bidirectional+conditional+encoding%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+) [our card](https://md.research.elamur.ai/free/papers/augenstein-2016-stance-detection-bidirectional-conditional-encoding/) 3. Roy Bar-Haim, Indrajit Bhattacharya, Francesco Din-uzzo, Amrita Saha, and Noam Slonim. 2017. Stance classification of context-dependent claims. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 251–261. [find](https://scholar.google.com/scholar?q=Roy+Bar%2DHaim%2C+Indrajit+Bhattacharya%2C+Francesco+Din%2Duzzo%2C+Amrita+Saha%2C+and+Noam+Slonim%2E+2017%2E+Stance+classification+of+context%2Ddependent+claims%2E+In+Proceedings+of+the+15th+Conference+of+the+European+Ch) 4. Costanza Conforti, Jakob Berndt, Mohammad Taher Pilehvar, Chryssi Giannitsarou, Flavio Toxvaerd, and Nigel Collier. 2020a. STANDER: An expert-annotated dataset for news stance detection and evidence retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4086–4101. [find](https://scholar.google.com/scholar?q=Costanza+Conforti%2C+Jakob+Berndt%2C+Mohammad+Taher+Pilehvar%2C+Chryssi+Giannitsarou%2C+Flavio+Toxvaerd%2C+and+Nigel+Collier%2E+2020a%2E+STANDER%3A+An+expert%2Dannotated+dataset+for+news+stance+detection+and+evidence+r) [our card](https://md.research.elamur.ai/free/papers/conforti-2020-stander-expert-annotated-dataset-news/)