---
title: "Cross-Domain Evaluation of Transformer-Based Models for"
description: "The authors build a new 893-utterance dataset covering four emotions: angry, happy, sad, and neutral. 7 references, cited by 1 paper here."
authors: ["Fatima Tu Zahra", "Kulsoom Asim", "Sandesh Kumar", "Abdul Samad"]
year: 2026
venue: "Proceedings of the Second workshop on Challenges in Processing South Asian Languages (CHiPSAL2026)"
source: "https://aclanthology.org/2026.chipsal-1.7/"
doi: "10.63317/3ao5m9p6ni9x"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zahra-2026-cross-domain-evaluation-transformer-based/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zahra-2026-cross-domain-evaluation-transformer-based/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/11/) / Cross-Domain Evaluation of Transformer-Based Models for Punjabi Speech Emotion Recognition

# Cross-Domain Evaluation of Transformer-Based Models for Punjabi Speech Emotion Recognition

**Authors:** Fatima Tu Zahra, Kulsoom Asim, [Sandesh Kumar](https://md.research.elamur.ai/free/en/authors/sandesh-kumar/) and [Abdul Samad](https://md.research.elamur.ai/free/en/authors/abdul-samad/) · **Year:** 2026 · **Venue:** [Proceedings of the Second workshop on Challenges in Processing South Asian Languages (CHiPSAL2026)](https://md.research.elamur.ai/free/en/venues/chipsal/) ([workshop on Challenges in Processing South Asian Languages 2026](https://md.research.elamur.ai/free/en/venues/chipsal/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.chipsal-1.7/) · [PDF](https://aclanthology.org/2026.chipsal-1.7.pdf) · [DOI 10.63317/3ao5m9p6ni9x](https://doi.org/10.63317/3ao5m9p6ni9x) · [OpenAlex](https://openalex.org/W7166534120)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/zahra-2026-cross-domain-evaluation-transformer-based/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper addresses speech emotion recognition (SER) for Punjabi, a widely spoken but low-resource language. Existing Punjabi resources are mostly private or studio-recorded. The authors build a new 893-utterance dataset covering four emotions: angry, happy, sad, and neutral. It mixes three sources: scripted recordings from ten Pakistani Punjabi volunteers in quiet and noisy settings, clips from Indian Punjabi films and TV, and neutral speech taken from the Shrutilipi corpus. They compare CNN-BiLSTM, ResNet-34, and Wav2Vec 2.0 under four setups:
- **E1:** in-domain training and testing on the new data
- **E2:** training on RASA, testing on the new data
- **E3:** the reverse of E2
- **E4:** training on both corpora combined

Results:
- **In-domain:** accuracy is high. Wav2Vec 2.0 reaches about 92.5% in E1.
- **Combined training:** ResNet-34 performs best in E4, at 96%.
- **Cross-corpus transfer:** accuracy drops sharply, and neutral speech is especially hard to recognise.

The work matters because it provides a public benchmark for Punjabi SER. It also shows that models trained on clean studio data handle naturalistic speech poorly.

## Key points
- **Curated dataset:** 893 labelled utterances (sad 327, angry 241, neutral 165, happy 160), released on Kaggle. Audio is 16 kHz mono WAV, and neutral samples come exclusively from Shrutilipi (All India Radio news).
- **RASA Punjabi subset:** 8,672 training and 962 test samples, studio-recorded TTS speech. Neutral is heavily overrepresented (6,039 training samples). It was capped at 2,000 for ResNet-34, while the other two models used class-weighted loss.
- **Best results:** ResNet-34 reaches 96% test accuracy in E4, with perfect happy and sad scores. Wav2Vec 2.0 reaches 92.48% macro accuracy in E1.
- **Cross-domain baselines:** E2 reaches only 37.7–41.3% and E3 only 25.0–34.0%, showing the models are brittle under domain shift.
- **Limitations:** the E1 80/20 split is not speaker-independent. Dialect coverage is uneven, since all volunteers speak Pakistani Punjabi and all media clips are Indian Punjabi.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Habib University](https://md.research.elamur.ai/free/en/universities/habib-university/) — University, Karachi, Pakistan · 5 works · 4 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 870 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 452 works

🧭 Topics (3): [😊 Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · 972 works · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works · [🎙️ Speech & spoken language](https://md.research.elamur.ai/free/en/topics/speech/) · 480 works

## Cite

Cite as: Fatima Tu Zahra, Kulsoom Asim, Sandesh Kumar and Abdul Samad. 2026. Cross-Domain Evaluation of Transformer-Based Models for Punjabi Speech Emotion Recognition. Proceedings of the Second workshop on Challenges in Processing South Asian Languages (CHiPSAL2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zahra2026cross,
  title = {{Cross-Domain Evaluation of Transformer-Based Models for Punjabi Speech Emotion Recognition}},
  author = {Fatima Tu Zahra, Kulsoom Asim, Sandesh Kumar and Abdul Samad},
  booktitle = {Proceedings of the Second workshop on Challenges in Processing South Asian Languages (CHiPSAL2026)},
  year = {2026},
  doi = {10.63317/3ao5m9p6ni9x},
  url = {https://doi.org/10.63317/3ao5m9p6ni9x}
}
```

- [← previous Cross-Cultural Transfer of Emoji Semantics and Sentiment in Financial Social Media](https://md.research.elamur.ai/free/en/papers/mahrous-2026-cross-cultural-transfer-emoji-semantics/)
- [next → Cross-Lingual Emotion Recognition in Balinese Text using Multilingual-LLMs under Peer-Collaborations Settings](https://md.research.elamur.ai/free/en/papers/utama-2026-cross-lingual-emotion-recognition-balinese/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/11/)

## References

7 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Aggarwal, S., Singh, P. & Sharma, K. (2023). A survey on speech emotion recognition: Datasets, features, and classification methods. Journal of Intelligent Systems, 33(1), pp. 203– 220. [12] Varadhan, P. S., Sankar, A., Raju, G. & Khapra, M. M. (2024). Rasa: Building Expressive Speech Synthesis Syst… [find](https://scholar.google.com/scholar?q=Aggarwal%2C+S%2E%2C+Singh%2C+P%2E+%26+Sharma%2C+K%2E+%282023%29%2E+A+survey+on+speech+emotion+recognition%3A+Datasets%2C+features%2C+and+classification+methods%2E+Journal+of+Intelligent+Systems%2C+33%281%29%2C+pp%2E+203%E2%80%93+220%2E+%5B12%5D+Varadhan%2C)
2. Baevski, A., Zhou, H., Mohamed, A. & Auli, M. (2020). [wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/). In Proceedings of the 34th International Conference on Neural Information Processing Systems (NeurIPS 2020). [13] Ververidis, D. & Kotropoulos, C. (2006). Emotional…
3. Barhoumi, C. & Ben Ayed, Y. (2023). Real-Time Speech Emotion Recognition Using Deep Learning and Data Augmentation. Research Square [Preprint]. doi: 10.21203/rs.3.rs-2874039/v1.12. — [doi:10.21203/rs.3.rs-2874039/v1.12](https://doi.org/10.21203/rs.3.rs-2874039/v1.12) [find](https://scholar.google.com/scholar?q=Barhoumi%2C+C%2E+%26+Ben+Ayed%2C+Y%2E+%282023%29%2E+Real%2DTime+Speech+Emotion+Recognition+Using+Deep+Learning+and+Data+Augmentation%2E+Research+Square+%5BPreprint%5D%2E+doi%3A+10%2E21203%2Frs%2E3%2Ers%2D2874039%2Fv1%2E12%2E+%E2%80%94+%5Bdoi%3A10%2E21203%2Frs%2E)
4. Bhogale, K. S., Jain, N., Raman, A., Agarwal, S., Chhimwal, A., Bansal, D. & Jyothi, P. (2022). Effectiveness of Mining Audio and Text Pairs from Public Data for Improving ASR Systems for Low-Resource Languages. arXiv preprint arXiv:2208.12666. [1] Singla, C. & Singh, S. (2022). PEMO: A New Validate… — [arXiv:2208.12666](https://arxiv.org/abs/2208.12666) [find](https://scholar.google.com/scholar?q=Bhogale%2C+K%2E+S%2E%2C+Jain%2C+N%2E%2C+Raman%2C+A%2E%2C+Agarwal%2C+S%2E%2C+Chhimwal%2C+A%2E%2C+Bansal%2C+D%2E+%26+Jyothi%2C+P%2E+%282022%29%2E+Effectiveness+of+Mining+Audio+and+Text+Pairs+from+Public+Data+for+Improving+ASR+Systems+for+Low%2DResource)
5. El Ayadi, M., Kamel, M. S. & Karray, F. (2011). Survey on speech emotion recognition: Features, classification schemes, and databases. Pattern Recognition, 44(3), pp. 572–587. [find](https://scholar.google.com/scholar?q=El+Ayadi%2C+M%2E%2C+Kamel%2C+M%2E+S%2E+%26+Karray%2C+F%2E+%282011%29%2E+Survey+on+speech+emotion+recognition%3A+Features%2C+classification+schemes%2C+and+databases%2E+Pattern+Recognition%2C+44%283%29%2C+pp%2E+572%E2%80%93587%2E)
6. Gourisaria, M. K., Agrawal, R., Sahni, M. & Singh, P. K. (2024). Comparative analysis of audio classification with MFCC and STFT features using machine learning techniques. Discover Internet of Things, 4(1). [find](https://scholar.google.com/scholar?q=Gourisaria%2C+M%2E+K%2E%2C+Agrawal%2C+R%2E%2C+Sahni%2C+M%2E+%26+Singh%2C+P%2E+K%2E+%282024%29%2E+Comparative+analysis+of+audio+classification+with+MFCC+and+STFT+features+using+machine+learning+techniques%2E+Discover+Internet+of+Things)
7. Kaur, K. & Singh, P. (2022). Impact of Feature Extraction and Feature Selection Algorithms on Punjabi Speech Emotion Recognition Using Convolutional Neural Network. ACM Transactions on Asian and Low-Resource Language Information Processing, 21(5), Article 100. Language Resource References [find](https://scholar.google.com/scholar?q=Kaur%2C+K%2E+%26+Singh%2C+P%2E+%282022%29%2E+Impact+of+Feature+Extraction+and+Feature+Selection+Algorithms+on+Punjabi+Speech+Emotion+Recognition+Using+Convolutional+Neural+Network%2E+ACM+Transactions+on+Asian+and+Low%2DR)

*Updated 31 October 2026*