---
title: "SigJBS@LT-EDI 2026 — paper by Sinha et al. (2026)"
description: "The paper describes the SigJBS submission to Task 2 of the LT-EDI@ACL 2026 shared task. 14 references, cited by 1 paper here."
authors: ["Gaurangi Sinha", "Rajarajeswari Palacharla", "Manoj Balaji Jagadeeshan"]
year: 2026
venue: "Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion"
source: "https://aclanthology.org/2026.ltedi-1.29/"
doi: "10.18653/v1/2026.ltedi-1.29"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sinha-2026-sigjbs-lt-edi-2026-qlora/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sinha-2026-sigjbs-lt-edi-2026-qlora/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/) / SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation

# SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation

**Authors:** [Gaurangi Sinha](https://md.research.elamur.ai/free/en/authors/gaurangi-sinha/), [Rajarajeswari Palacharla](https://md.research.elamur.ai/free/en/authors/rajarajeswari-palacharla/) and [Manoj Balaji Jagadeeshan](https://md.research.elamur.ai/free/en/authors/manoj-balaji-jagadeeshan/) · **Year:** 2026 · **Venue:** [Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion](https://md.research.elamur.ai/free/en/venues/ltedi/) ([Workshop on Language Technology for Equality, Diversity, Inclusion 2026](https://md.research.elamur.ai/free/en/venues/ltedi/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.ltedi-1.29/) · [PDF](https://aclanthology.org/2026.ltedi-1.29.pdf) · [DOI 10.18653/v1/2026.ltedi-1.29](https://doi.org/10.18653/v1/2026.ltedi-1.29) · [OpenAlex](https://openalex.org/W7166875770)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper describes the SigJBS submission to Task 2 of the LT-EDI@ACL 2026 shared task. The task is to automatically write respectful counter-narratives in reply to homophobic and transphobic comments in English and Tamil. Tamil is a low-resource language here, with far less training data than English. The authors compare in-context prompting (0 to 10 examples) against supervised adaptation of a 4-bit quantized Gemma 3 12B instruction model using QLoRA. After joint bilingual training, they add a second stage that oversamples Tamil to counter the language imbalance. They also test, and reject, a variant that romanizes Tamil into SLP1. Fine-tuning proved more reliable than long few-shot prompts, which tended to produce shorter, template-like replies. Native-script Tamil also beat the transliterated input. The system placed 2nd in English and 6th in Tamil. This shows that cheap, parameter-efficient tuning works well for English, while Tamil counter-speech generation remains hard.

## Key points
- **Data:** The training data has 1,800 English and 800 Tamil pairs. The test sets have 66 English and 109 Tamil items.
- **Scoring:** The official score averages five metrics: Distinct-2, BERTScore, PRS, QS and CCNC.
- **Model and tuning setup:**
  - Backbone: `unsloth/gemma-3-12b-it-unsloth-bnb-4bit`.
  - LoRA settings: r=16, α=32, applied to attention and MLP projections.
  - Stage 1: 3 epochs on the combined English and Tamil data.
  - Stage 2: Tamil oversampled 3× to give 4,200 examples, trained for 1 more epoch.
  - Hardware: a single A100 40GB GPU.
- **Official results:**
  - English: 86.35% overall, rank 2.
  - Tamil: 63.77% overall, rank 6.
  - The gap is largest in diversity: Distinct-2 was 25.29 for Tamil versus 69.32 for English.
- **Few-shot length effect:** Moving from 0-shot to 10-shot shrank average output length. English replies fell from 53.3 to 17.9 words, and Tamil replies from 25.7 to 11.6 words.
- **Exploratory diagnostics (not official scores):**
  - The SLP1 transliteration variant scored worst on all diagnostics, with a BERTScore of 70.41.
  - Tamil rebalancing raised BERTScore from 80.80 to 94.09.
  - After rebalancing, Tamil replies were longer and addressed the specific hateful claim more directly.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Texas A&M University](https://md.research.elamur.ai/free/en/universities/texas-a-m-university/) — University, College Station, United States · 26 works · 1,871 citations
- [Indian Institute of Technology Kharagpur](https://md.research.elamur.ai/free/en/universities/indian-institute-of-technology-kharagpur/) — University, Kharagpur, India · 24 works · 714 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

## Cite

Cite as: Gaurangi Sinha, Rajarajeswari Palacharla and Manoj Balaji Jagadeeshan. 2026. SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation. Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sinha2026sigjbs,
  title = {{SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation}},
  author = {Gaurangi Sinha, Rajarajeswari Palacharla and Manoj Balaji Jagadeeshan},
  booktitle = {Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion},
  year = {2026},
  doi = {10.18653/v1/2026.ltedi-1.29},
  url = {https://doi.org/10.18653/v1/2026.ltedi-1.29}
}
```

- [← previous SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification](https://md.research.elamur.ai/free/en/papers/sinha-2026-sigjbs-lt-edi-2026-multimodal/)
- [next → SimLex-999 for Modern Greek](https://md.research.elamur.ai/free/en/papers/mylonadis-2026-simlex-999-modern-greek/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/)

## References

14 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Manoj J Balaji and HS Chinmaya. 2022. A study on sentimental analysis, homophobia-transphobia detection for dravidian languages. In CEUR Workshop Proceedings. [https://ceur-ws.org](https://ceur-ws.org), volume 3395, pages T2–7. [↗](https://ceur-ws.org)
2. Bharathi Raja Chakravarthi. 2024. Detection of homophobia and transphobia in YouTube comments. International Journal of Data Science and Analytics, 18(1):49–68. [find](https://scholar.google.com/scholar?q=Bharathi+Raja+Chakravarthi%2E+2024%2E+Detection+of+homophobia+and+transphobia+in+YouTube+comments%2E+International+Journal+of+Data+Science+and+Analytics%2C+18%281%29%3A49%E2%80%9368%2E)
3. Yi-Ling Chung, Elizaveta Kuzmenko, Serra Sinem Tekiroglu, and Marco Guerini. 2019. [CONAN -COunter NArratives through nichesourcing: a multilingual dataset of responses to fight online hate speech](https://md.research.elamur.ai/free/en/papers/chung-2019-conan-counter-narratives-through-nichesourcing/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 2819–…
4. Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. [QLoRA: Efficient finetuning of quantized LLMs](https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/). arXiv preprint arXiv:2305.14314.
5. Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. [LoRA: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). arXiv preprint arXiv:2106.09685.
6. Prasanna Kumar Kumaresan, Devendra Deepak Kayande, Ruba Priyadharshini, Paul Buitelaar, and Bharathi Raja Chakravarthi. 2025. Homophobia and transphobia span identification in low-resource languages. Natural Language Processing Journal, 12:100169. [find](https://scholar.google.com/scholar?q=Prasanna+Kumar+Kumaresan%2C+Devendra+Deepak+Kayande%2C+Ruba+Priyadharshini%2C+Paul+Buitelaar%2C+and+Bharathi+Raja+Chakravarthi%2E+2025%2E+Homophobia+and+transphobia+span+identification+in+low%2Dresource+languages%2E+)
7. Hongyi Ling, Shubham Parashar, Sambhav Khurana, Blake Olson, Anwesha Basu, Gaurangi Sinha, Zhengzhong Tu, James Caverlee, and Shuiwang Ji. 2025. Complex llm planning via automated heuristics discovery. Preprint, arXiv:2502.19295. — [arXiv:2502.19295](https://arxiv.org/abs/2502.19295) [find](https://scholar.google.com/scholar?q=Hongyi+Ling%2C+Shubham+Parashar%2C+Sambhav+Khurana%2C+Blake+Olson%2C+Anwesha+Basu%2C+Gaurangi+Sinha%2C+Zhengzhong+Tu%2C+James+Caverlee%2C+and+Shuiwang+Ji%2E+2025%2E+Complex+llm+planning+via+automated+heuristics+discovery)
8. LT-EDI 2026 Organizers. 2026. Counter-narrative generation on homophobic and transphobic comments - LT-EDI@ACL 2026. [https://www.codabench.org/competitions/11333/](https://www.codabench.org/competitions/11333/). Shared task overview and evaluation page, accessed March 3, 2026. [↗](https://www.codabench.org/competitions/11333/)
9. Sumedh Pendurkar and Guni Sharon. 2025. Policy-guided search on tree-of-thoughts for efficient problem solving with bounded language model queries. Transactions on Machine Learning Research. [find](https://scholar.google.com/scholar?q=Sumedh+Pendurkar+and+Guni+Sharon%2E+2025%2E+Policy%2Dguided+search+on+tree%2Dof%2Dthoughts+for+efficient+problem+solving+with+bounded+language+model+queries%2E+Transactions+on+Machine+Learning+Research%2E)
10. Praveen Prasannan, Prasanna Kumar Kumaresan, Saranya Rajiakodi, C. N. Subalalitha, and Bharathi Raja Chakravarthi. 2025. Counter-speech generation for homophobic and transphobic social media content in Malayalam. Social Network Analysis and Mining, 15(1):87. [find](https://scholar.google.com/scholar?q=Praveen+Prasannan%2C+Prasanna+Kumar+Kumaresan%2C+Saranya+Rajiakodi%2C+C%2E+N%2E+Subalalitha%2C+and+Bharathi+Raja+Chakravarthi%2E+2025%2E+Counter%2Dspeech+generation+for+homophobic+and+transphobic+social+media+content+i)
11. Gemma Team, Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard, Ramona Merhej, Sarah Perrin, Tatiana Matejovicova, Alexandre Ramé, Morgane Rivière, Louis Rouillard, Thomas Mesnard, Geoffrey Cideron, Jean bastien Grill, Sabela Ramos, Edouard Yvinec, Michelle Casbon, Etienne Pot, Ivo Penche… [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Aishwarya+Kamath%2C+Johan+Ferret%2C+Shreya+Pathak%2C+Nino+Vieillard%2C+Ramona+Merhej%2C+Sarah+Perrin%2C+Tatiana+Matejovicova%2C+Alexandre+Ram%C3%A9%2C+Morgane+Rivi%C3%A8re%2C+Louis+Rouillard%2C+Thomas+Mesnard%2C+Geoffrey)
12. Serra Sinem Tekiroğlu, Yi-Ling Chung, and Marco Guerini. 2020. [Generating counter narratives against online hate speech: Data and strategies](https://md.research.elamur.ai/free/en/papers/tekiroglu-2020-generating-counter-narratives-against-online/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1177–1190, Online. Association for Computational Linguistic…
13. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. BERTScore: Evaluating text generation with BERT. In Proceedings of the International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020%2E+BERTScore%3A+Evaluating+text+generation+with+BERT%2E+In+Proceedings+of+the+International+Conference+on+Learning+Represen)
14. Michael Han Daniel Han and Unsloth team. 2023. Unsloth. [find](https://scholar.google.com/scholar?q=Michael+Han+Daniel+Han+and+Unsloth+team%2E+2023%2E+Unsloth%2E)

*Updated 31 October 2026*