---
title: "Language Identification and Morphosyntactic — Zampieri 2018"
description: "This report describes the second VarDial Evaluation Campaign, held at the VarDial 2018 workshop alongside COLING 2018."
authors: ["Marcos Zampieri", "Shervin Malmasi", "Preslav Nakov", "Ahmed Ali", "Suwon Shon", "James Glass", "Yves Scherrer", "Tanja Samardžić", "Nikola Ljubešić", "Jörg Tiedemann", "Chris van der Lee", "Stefan Grondelaers", "Nelleke Oostdijk", "Dirk Speelman", "Antal van den Bosch", "Ritesh Kumar", "Bornini Lahiri", "Mayank Jain"]
year: 2018
venue: "Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018)"
source: "https://aclanthology.org/W18-3901/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/zampieri-2018-language-identification-morphosyntactic-tagging-second/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/zampieri-2018-language-identification-morphosyntactic-tagging-second/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2018](https://md.research.elamur.ai/free/papers/2018/page/2/) / Language Identification and Morphosyntactic Tagging: The Second VarDial Evaluation Campaign

# Language Identification and Morphosyntactic Tagging: The Second VarDial Evaluation Campaign

**Authors:** [Marcos Zampieri](https://md.research.elamur.ai/free/authors/marcos-zampieri/), [Shervin Malmasi](https://md.research.elamur.ai/free/authors/shervin-malmasi/), [Preslav Nakov](https://md.research.elamur.ai/free/authors/preslav-nakov/), [Ahmed Ali](https://md.research.elamur.ai/free/authors/ahmed-ali/), Suwon Shon, [James Glass](https://md.research.elamur.ai/free/authors/james-glass/), [Yves Scherrer](https://md.research.elamur.ai/free/authors/yves-scherrer/), [Tanja Samardžić](https://md.research.elamur.ai/free/authors/tanja-samardzic/), [Nikola Ljubešić](https://md.research.elamur.ai/free/authors/nikola-ljubesic/), [Jörg Tiedemann](https://md.research.elamur.ai/free/authors/jorg-tiedemann/), [Chris van der Lee](https://md.research.elamur.ai/free/authors/chris-van-der-lee/), Stefan Grondelaers et al. (18 authors) · **Year:** 2018 · **Venue:** Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/W18-3901/) · [PDF](https://aclanthology.org/W18-3901.pdf) · [OpenAlex](https://openalex.org/W2899166839)

**Citations:** 84 citations (openalex-snapshot · 2026-10-14) · [84](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
This report describes the second VarDial Evaluation Campaign, held at the VarDial 2018 workshop alongside COLING 2018. The campaign provides shared benchmarks for NLP on closely related languages, language varieties and dialects. It had five shared tasks.

Two tasks returned from earlier years:
- **Arabic Dialect Identification (ADI)**, which now included phonetic features alongside the lexical and acoustic inputs.
- **Swiss German Dialect Identification (GDI)**, which added a "surprise" dialect that had no training data.

Three tasks were new:
- **Morphosyntactic Tagging of Tweets (MTT)**, focused on tweets written in South-Slavic languages.
- **Telling Dutch apart from Flemish in subtitle text (DFS)**.
- **Indo-Aryan Language Identification (ILI)**.

The organizers supplied the datasets, ran the evaluations and summarized each team's approach. A record 54 teams registered, 24 submitted runs, and 22 wrote system description papers. The approaches varied widely, from character n-gram models and SVMs to neural networks. In ILI, the SUKI system took first place. The campaign matters because it released new resources for under-studied varieties, including the first public corpus for several Indo-Aryan languages. It also offers standardized comparisons of methods on fine-grained language discrimination.

## Key points
- **ADI:** the organizers reused the 2017 training and development data. The test set secretly combined in-domain broadcast speech with out-of-domain YouTube clips of 5–30 seconds, and the two parts were scored separately.
- **GDI:** the task covered Basel, Bern, Lucerne and Zurich dialects. It offered a four-way track and a five-way track that included the surprise dialect.
- **MTT and DFS:** MTT asked teams to tag Slovene, Croatian and Serbian tweets with 900+ morphosyntactic labels. DFS provided over 50,000 subtitle phrases labelled as Netherlandic or Flemish Dutch.
- **ILI data:** the corpus has about 15,000 sentences per language for Hindi, Braj Bhasha, Awadhi, Bhojpuri and Magahi, mostly from literature. The texts were digitized with Google OCR and then corrected by native speakers.
- **ILI results:** there were eight submissions. SUKI won with a macro F1 of 0.958, using HeLI with adaptive character n-gram models (n = 1–6). The lowest score was 0.819 (LaMa).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

## Cited by

Cited by

84 papers of our library cite it (of the 140673 whose bibliographies we read); 2 of them have a page here, 82 not yet.

- [Camelira: An Arabic Multi-Dialect Morphological Disambiguator](https://md.research.elamur.ai/free/papers/aclbulk-2022-obeid-camelira-arabic-multi-dialect-morphological/)
- [Predicting the Type and Target of Offensive Posts in Social Media](https://md.research.elamur.ai/free/papers/zampieri-2019-predicting-type-target-offensive-posts/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zampieri2018language,
  title = {{Language Identification and Morphosyntactic Tagging: The Second VarDial Evaluation Campaign}},
  author = {Zampieri, Marcos and Malmasi, Shervin and Nakov, Preslav and Ali, Ahmed and Shon, Suwon and Glass, James and Scherrer, Yves and Samardžić, Tanja and Ljubešić, Nikola and Tiedemann, Jörg and Lee, Chris van der and Grondelaers, Stefan and Oostdijk, Nelleke and Speelman, Dirk and Bosch, Antal van den and Kumar, Ritesh and Lahiri, Bornini and Jain, Mayank},
  booktitle = {Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018)},
  year = {2018},
  url = {https://aclanthology.org/W18-3901/}
}
```

- [← previous Know What You Don't Know: Unanswerable Questions for SQuAD](https://md.research.elamur.ai/free/papers/rajpurkar-2018-know-what-you-don-t/)
- [next → Large-Scale QA-SRL Parsing](https://md.research.elamur.ai/free/papers/fitzgerald-2018-large-scale-qa-srl-parsing/)
- [↑ back to papers of 2018](https://md.research.elamur.ai/free/papers/2018/page/2/)

## References

59 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ahmed Ali, Stephan Vogel, and Steve Renals. 2017. Speech recognition challenge in the wild: Arabic MGB-3. In Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). [find](https://scholar.google.com/scholar?q=Ahmed+Ali%2C+Stephan+Vogel%2C+and+Steve+Renals%2E+2017%2E+Speech+recognition+challenge+in+the+wild%3A+Arabic+MGB%2D3%2E+In+Proceedings+of+the+IEEE+Automatic+Speech+Recognition+and+Understanding+Workshop+%28ASRU%29%2E) [our card](https://md.research.elamur.ai/free/papers/ali-2017-speech-recognition-challenge-wild-arabic/)
2. Mohamed Ali. 2018a. Character level convolutional neural network for Arabic dialect identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Mohamed+Ali%2E+2018a%2E+Character+level+convolutional+neural+network+for+Arabic+dialect+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dialects+%28VarDial%29%2E)
3. Mohamed Ali. 2018b. Character level convolutional neural network for German dialect identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Mohamed+Ali%2E+2018b%2E+Character+level+convolutional+neural+network+for+German+dialect+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dialects+%28VarDial%29%2E)
4. Mohamed Ali. 2018c. Character level convolutional neural network for Indo-Aryan language identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Mohamed+Ali%2E+2018c%2E+Character+level+convolutional+neural+network+for+Indo%2DAryan+language+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dialects+%28VarD)
5. Adrien Barbaresi. 2017. Discriminating between similar languages using weighted subword features. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Adrien+Barbaresi%2E+2017%2E+Discriminating+between+similar+languages+using+weighted+subword+features%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
6. Adrien Barbaresi. 2018. Computationally efficient discrimination between language varieties with large feature vectors and regularized classifiers. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Adrien+Barbaresi%2E+2018%2E+Computationally+efficient+discrimination+between+language+varieties+with+large+feature+vectors+and+regularized+classifiers%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Simi)
7. Fernando Benites, Ralf Grubenmann, Pius von Däniken, Dirk von Grünigen, Jan Deriu, and Mark Cieliebak. 2018. Twist Bytes – German dialect identification with data mining optimization. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Fernando+Benites%2C+Ralf+Grubenmann%2C+Pius+von+Da%CC%88niken%2C+Dirk+von+Gru%CC%88nigen%2C+Jan+Deriu%2C+and+Mark+Cieliebak%2E+2018%2E+Twist+Bytes+%E2%80%93+German+dialect+identification+with+data+mining+optimization%2E+In+Proceedings)
8. Yves Bestgen. 2017. Improving the character ngram model for the DSL task with BM25 weighting and less frequently used feature sets. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Yves+Bestgen%2E+2017%2E+Improving+the+character+ngram+model+for+the+DSL+task+with+BM25+weighting+and+less+frequently+used+feature+sets%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
9. Andrei M. Butnaru and Radu Ionescu. 2018. UnibucKernel Reloaded: First place in Arabic dialect identification for the second year in a row. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Andrei+M%2E+Butnaru+and+Radu+Ionescu%2E+2018%2E+UnibucKernel+Reloaded%3A+First+place+in+Arabic+dialect+identification+for+the+second+year+in+a+row%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Lang)
10. Çağrı Çöltekin and Taraka Rama. 2016. Discriminating similar languages with linear SVMs and neural networks. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=C%CC%A7ag%CC%86r%C4%B1+C%CC%A7o%CC%88ltekin+and+Taraka+Rama%2E+2016%2E+Discriminating+similar+languages+with+linear+SVMs+and+neural+networks%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
11. Çağrı Çöltekin and Taraka Rama. 2017. Tübingen system in VarDial 2017 shared task: Experiments with language identification and cross-lingual parsing. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=C%CC%A7ag%CC%86r%C4%B1+C%CC%A7o%CC%88ltekin+and+Taraka+Rama%2E+2017%2E+Tu%CC%88bingen+system+in+VarDial+2017+shared+task%3A+Experiments+with+language+identification+and+cross%2Dlingual+parsing%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarD)
12. Çağrı Çöltekin, Taraka Rama, and Verena Blaschke. 2018. Tübingen-Oslo team at the VarDial 2018 evaluation campaign: An analysis of n-gram features in language variety identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=C%CC%A7ag%CC%86r%C4%B1+C%CC%A7o%CC%88ltekin%2C+Taraka+Rama%2C+and+Verena+Blaschke%2E+2018%2E+Tu%CC%88bingen%2DOslo+team+at+the+VarDial+2018+evaluation+campaign%3A+An+analysis+of+n%2Dgram+features+in+language+variety+identification%2E+In+Proceedin)
13. Narayan Choudhary and Girish Nath Jha. 2011. Creating multilingual parallel corpora in Indian languages. In Proceedings of LTC. [find](https://scholar.google.com/scholar?q=Narayan+Choudhary+and+Girish+Nath+Jha%2E+2011%2E+Creating+multilingual+parallel+corpora+in+Indian+languages%2E+In+Proceedings+of+LTC%2E)
14. Alina Maria Ciobanu, Shervin Malmasi, and Liviu P. Dinu. 2018a. German dialect identification using classifier ensembles. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Alina+Maria+Ciobanu%2C+Shervin+Malmasi%2C+and+Liviu+P%2E+Dinu%2E+2018a%2E+German+dialect+identification+using+classifier+ensembles%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+a)
15. Alina Maria Ciobanu, Marcos Zampieri, Shervin Malmasi, Santanu Pal, and Liviu P. Dinu. 2018b. Discriminating between Indo-Aryan languages using SVM ensembles. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Alina+Maria+Ciobanu%2C+Marcos+Zampieri%2C+Shervin+Malmasi%2C+Santanu+Pal%2C+and+Liviu+P%2E+Dinu%2E+2018b%2E+Discriminating+between+Indo%2DAryan+languages+using+SVM+ensembles%2E+In+Proceedings+of+the+Fifth+Workshop+on+N)
16. Eugen Dieth. 1986. Schwyzertütschi Dialäktschrift. 2 edition. [find](https://scholar.google.com/scholar?q=Eugen+Dieth%2E+1986%2E+Schwyzertu%CC%88tschi+Diala%CC%88ktschrift%2E+2+edition%2E)
17. Steven Du and Yuan Yuan Wang. 2018. STEVENDU2018’s system in VarDial 2018: Discriminating between Dutch and Flemish in subtitles. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Steven+Du+and+Yuan+Yuan+Wang%2E+2018%2E+STEVENDU2018%E2%80%99s+system+in+VarDial+2018%3A+Discriminating+between+Dutch+and+Flemish+in+subtitles%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Var)
18. Tomaž Erjavec, Nikola Ljubešić, and Nataša Logar. 2015. The slWaC corpus of the Slovene web. Informatica, 39(1):35–42. [find](https://scholar.google.com/scholar?q=Tomaz%CC%8C+Erjavec%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+and+Natas%CC%8Ca+Logar%2E+2015%2E+The+slWaC+corpus+of+the+Slovene+web%2E+Informatica%2C+39%281%29%3A35%E2%80%9342%2E)
19. Tomaž Erjavec, Darja Fišer, Jaka Čibej, Špela Arhar Holdt, Nikola Ljubešić, and Katja Zupan. 2017. CMC training corpus Janes-Tag 2.0. Slovenian language resource repository CLARIN.SI. [find](https://scholar.google.com/scholar?q=Tomaz%CC%8C+Erjavec%2C+Darja+Fis%CC%8Cer%2C+Jaka+C%CC%8Cibej%2C+S%CC%8Cpela+Arhar+Holdt%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+and+Katja+Zupan%2E+2017%2E+CMC+training+corpus+Janes%2DTag+2%2E0%2E+Slovenian+language+resource+repository+CLARIN%2ESI%2E)
20. Divyanshu Gupta, Gourav Dhakad, Jayprakash Gupta, and Anil Kumar Singh. 2018. IIT (BHU) System for Indo-Aryan language identification (ILI) at VarDial 2018. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Divyanshu+Gupta%2C+Gourav+Dhakad%2C+Jayprakash+Gupta%2C+and+Anil+Kumar+Singh%2E+2018%2E+IIT+%28BHU%29+System+for+Indo%2DAryan+language+identification+%28ILI%29+at+VarDial+2018%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP)
21. Radu Tudor Ionescu and Andrei Butnaru. 2017. Learning to identify Arabic and German dialects using multiple kernels. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Radu+Tudor+Ionescu+and+Andrei+Butnaru%2E+2017%2E+Learning+to+identify+Arabic+and+German+dialects+using+multiple+kernels%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
22. Radu Tudor Ionescu and Marius Popescu. 2016. UnibucKernel: An approach for Arabic dialect identification based on multiple string kernels. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Radu+Tudor+Ionescu+and+Marius+Popescu%2E+2016%2E+UnibucKernel%3A+An+approach+for+Arabic+dialect+identification+based+on+multiple+string+kernels%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
23. Tommi Jauhiainen, Heidi Jauhiainen, and Krister Lindén. 2018a. HeLI-based experiments in discriminating between Dutch and Flemish subtitles. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Tommi+Jauhiainen%2C+Heidi+Jauhiainen%2C+and+Krister+Linde%CC%81n%2E+2018a%2E+HeLI%2Dbased+experiments+in+discriminating+between+Dutch+and+Flemish+subtitles%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+La)
24. Tommi Jauhiainen, Heidi Jauhiainen, and Krister Lindén. 2018b. HeLI-based experiments in Swiss German dialect identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Tommi+Jauhiainen%2C+Heidi+Jauhiainen%2C+and+Krister+Linde%CC%81n%2E+2018b%2E+HeLI%2Dbased+experiments+in+Swiss+German+dialect+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Variet)
25. Tommi Jauhiainen, Heidi Jauhiainen, and Krister Lindén. 2018c. Iterative language model adaptation for Indo-Aryan language identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Tommi+Jauhiainen%2C+Heidi+Jauhiainen%2C+and+Krister+Linde%CC%81n%2E+2018c%2E+Iterative+language+model+adaptation+for+Indo%2DAryan+language+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Lang)
26. Tommi Jauhiainen, Marco Lui, Marcos Zampieri, Timothy Baldwin, and Krister Lindén. 2018d. Automatic language identification in texts: A survey. arXiv preprint arXiv:1804.08186. [find](https://scholar.google.com/scholar?q=Tommi+Jauhiainen%2C+Marco+Lui%2C+Marcos+Zampieri%2C+Timothy+Baldwin%2C+and+Krister+Linde%CC%81n%2E+2018d%2E+Automatic+language+identification+in+texts%3A+A+survey%2E+arXiv+preprint+arXiv%3A1804%2E08186%2E) [our card](https://md.research.elamur.ai/free/papers/jauhiainen-2019-automatic-language-identification-texts/)
27. Sameer Khurana and Ahmed Ali. 2016. QCRI advanced transcription system (QATS) for the Arabic Multi-Dialect Broadcast Media Recognition: MGB-2 Challenge. In Proceedings of SLT. [find](https://scholar.google.com/scholar?q=Sameer+Khurana+and+Ahmed+Ali%2E+2016%2E+QCRI+advanced+transcription+system+%28QATS%29+for+the+Arabic+Multi%2DDialect+Broadcast+Media+Recognition%3A+MGB%2D2+Challenge%2E+In+Proceedings+of+SLT%2E)
28. Tim Kreutz and Walter Daelemans. 2018. Exploring classifier combinations for language variety identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Tim+Kreutz+and+Walter+Daelemans%2E+2018%2E+Exploring+classifier+combinations+for+language+variety+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dialects+)
29. Martin Kroon, Maria Medvedeva, and Barbara Plank. 2018. When simple n-gram models outperform syntactic approaches: Discriminating between Dutch and Flemish. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Martin+Kroon%2C+Maria+Medvedeva%2C+and+Barbara+Plank%2E+2018%2E+When+simple+n%2Dgram+models+outperform+syntactic+approaches%3A+Discriminating+between+Dutch+and+Flemish%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP)
30. Ritesh Kumar, Bornini Lahiri, Deepak Alok, Atul Kr. Ojha, Mayank Jain, Abdul Basit, and Yogesh Dawar. 2018. Automatic identification of closely-related Indian languages: Resources and experiments. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC). [find](https://scholar.google.com/scholar?q=Ritesh+Kumar%2C+Bornini+Lahiri%2C+Deepak+Alok%2C+Atul+Kr%2E+Ojha%2C+Mayank+Jain%2C+Abdul+Basit%2C+and+Yogesh+Dawar%2E+2018%2E+Automatic+identification+of+closely%2Drelated+Indian+languages%3A+Resources+and+experiments%2E+In+)
31. Ritesh Kumar. 2012. Challenges in the development of annotated corpora of computer-mediated communication in Indian languages: A case of Hindi. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC). [find](https://scholar.google.com/scholar?q=Ritesh+Kumar%2E+2012%2E+Challenges+in+the+development+of+annotated+corpora+of+computer%2Dmediated+communication+in+Indian+languages%3A+A+case+of+Hindi%2E+In+Proceedings+of+the+Eight+International+Conference+on+)
32. Ritesh Kumar. 2014a. Developing politeness annotated corpus of Hindi blogs. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC). [find](https://scholar.google.com/scholar?q=Ritesh+Kumar%2E+2014a%2E+Developing+politeness+annotated+corpus+of+Hindi+blogs%2E+In+Proceedings+of+the+Ninth+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%29%2E)
33. Ritesh Kumar. 2014b. Politeness in Online Hindi Texts: Pragmatic and Computational Aspects. Ph.D. thesis, Jawaharlal Nehru University. [find](https://scholar.google.com/scholar?q=Ritesh+Kumar%2E+2014b%2E+Politeness+in+Online+Hindi+Texts%3A+Pragmatic+and+Computational+Aspects%2E+Ph%2ED%2E+thesis%2C+Jawaharlal+Nehru+University%2E)
34. Nikola Ljubešić and Filip Klubička. 2014. {bs,hr,sr}wac - web corpora of Bosnian, Croatian and Serbian. In Proceedings of the 9th Web as Corpus Workshop (WaC-9), pages 29–35. [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81+and+Filip+Klubic%CC%8Cka%2E+2014%2E+%7Bbs%2Chr%2Csr%7Dwac+%2D+web+corpora+of+Bosnian%2C+Croatian+and+Serbian%2E+In+Proceedings+of+the+9th+Web+as+Corpus+Workshop+%28WaC%2D9%29%2C+pages+29%E2%80%9335%2E)
35. Nikola Ljubešić, Tomaž Erjavec, Maja Miličević, and Tanja Samardžić. 2017a. Croatian Twitter training corpus ReLDI-NormTagNER-hr 2.0. Slovenian language resource repository CLARIN.SI. [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81%2C+Tomaz%CC%8C+Erjavec%2C+Maja+Milic%CC%8Cevic%CC%81%2C+and+Tanja+Samardz%CC%8Cic%CC%81%2E+2017a%2E+Croatian+Twitter+training+corpus+ReLDI%2DNormTagNER%2Dhr+2%2E0%2E+Slovenian+language+resource+repository+CLARIN%2ESI%2E)
36. Nikola Ljubešić, Tomaž Erjavec, Maja Miličević, and Tanja Samardžić. 2017b. Serbian Twitter training corpus ReLDI-NormTagNER-sr 2.0. Slovenian language resource repository CLARIN.SI. [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81%2C+Tomaz%CC%8C+Erjavec%2C+Maja+Milic%CC%8Cevic%CC%81%2C+and+Tanja+Samardz%CC%8Cic%CC%81%2E+2017b%2E+Serbian+Twitter+training+corpus+ReLDI%2DNormTagNER%2Dsr+2%2E0%2E+Slovenian+language+resource+repository+CLARIN%2ESI%2E)
37. Nikola Ljubešić. 2018. Comparing CRF and LSTM performance on the task of morphosyntactic tagging of non-standard varieties of South Slavic languages. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81%2E+2018%2E+Comparing+CRF+and+LSTM+performance+on+the+task+of+morphosyntactic+tagging+of+non%2Dstandard+varieties+of+South+Slavic+languages%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+)
38. Nikola Ljubešić and Tomaž Erjavec. 2016. Corpus vs. lexicon supervision in morphosyntactic tagging: the case of Slovene. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC). [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81+and+Tomaz%CC%8C+Erjavec%2E+2016%2E+Corpus+vs%2E+lexicon+supervision+in+morphosyntactic+tagging%3A+the+case+of+Slovene%2E+In+Proceedings+of+the+Tenth+International+Conference+on+Language+Resources+a)
39. Nikola Ljubešić, Filip Klubička, Željko Agić, and Ivo-Pavao Jazbec. 2016. New inflectional lexicons and training corpora for improved morphosyntactic annotation of Croatian and Serbian. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC). [find](https://scholar.google.com/scholar?q=Nikola+Ljubes%CC%8Cic%CC%81%2C+Filip+Klubic%CC%8Cka%2C+Z%CC%8Celjko+Agic%CC%81%2C+and+Ivo%2DPavao+Jazbec%2E+2016%2E+New+inflectional+lexicons+and+training+corpora+for+improved+morphosyntactic+annotation+of+Croatian+and+Serbian%2E+In+Procee)
40. Shervin Malmasi and Marcos Zampieri. 2016. Arabic dialect identification in speech transcripts. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Shervin+Malmasi+and+Marcos+Zampieri%2E+2016%2E+Arabic+dialect+identification+in+speech+transcripts%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
41. Shervin Malmasi and Marcos Zampieri. 2017a. Arabic dialect identification using iVectors and ASR transcripts. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Shervin+Malmasi+and+Marcos+Zampieri%2E+2017a%2E+Arabic+dialect+identification+using+iVectors+and+ASR+transcripts%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
42. Shervin Malmasi and Marcos Zampieri. 2017b. German dialect identification in interview transcriptions. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Shervin+Malmasi+and+Marcos+Zampieri%2E+2017b%2E+German+dialect+identification+in+interview+transcriptions%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E)
43. Shervin Malmasi, Marcos Zampieri, Nikola Ljubešić, Preslav Nakov, Ahmed Ali, and Jörg Tiedemann. 2016. Discriminating between similar languages and Arabic dialect identification: A report on the third DSL shared task. [find](https://scholar.google.com/scholar?q=Shervin+Malmasi%2C+Marcos+Zampieri%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+Preslav+Nakov%2C+Ahmed+Ali%2C+and+Jo%CC%88rg+Tiedemann%2E+2016%2E+Discriminating+between+similar+languages+and+Arabic+dialect+identification%3A+A+report+on+the+th) [our card](https://md.research.elamur.ai/free/papers/malmasi-2016-discriminating-between-similar-languages/)
44. Pavel Matejka, Petr Schwarz, Jan Cernockỳ, and Pavel Chytil. 2005. Phonotactic language identification using high quality phoneme recognition. In Proc. Interspeech. [find](https://scholar.google.com/scholar?q=Pavel+Matejka%2C+Petr+Schwarz%2C+Jan+Cernocky%CC%80%2C+and+Pavel+Chytil%2E+2005%2E+Phonotactic+language+identification+using+high+quality+phoneme+recognition%2E+In+Proc%2E+Interspeech%2E)
45. Sara Meftah and Nasredine Semmar. 2018. Using neural transfer learning for morpho-syntactic tagging of South-Slavic languages tweets. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Sara+Meftah+and+Nasredine+Semmar%2E+2018%2E+Using+neural+transfer+learning+for+morpho%2Dsyntactic+tagging+of+South%2DSlavic+languages+tweets%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C)
46. Elise Michon, Minh Quang Pham, Josep Crego, and Jean Senellart. 2018. Neural network architectures for Arabic dialect identification. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Elise+Michon%2C+Minh+Quang+Pham%2C+Josep+Crego%2C+and+Jean+Senellart%2E+2018%2E+Neural+network+architectures+for+Arabic+dialect+identification%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C)
47. Maryam Najafian, Sameer Khurana, Suwon Shon, Ahmed Ali, and James Glass. 2018. Exploiting convolutional neural networks for phonotactic based dialect identification. In IEEE ICASSP, pages 5174–5178. [find](https://scholar.google.com/scholar?q=Maryam+Najafian%2C+Sameer+Khurana%2C+Suwon+Shon%2C+Ahmed+Ali%2C+and+James+Glass%2E+2018%2E+Exploiting+convolutional+neural+networks+for+phonotactic+based+dialect+identification%2E+In+IEEE+ICASSP%2C+pages+5174%E2%80%935178%2E)
48. Rabee Naser and Abualsoud Hanani. 2018. Birzeit Arabic dialect identication system for the 2018 VarDial challenge. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Rabee+Naser+and+Abualsoud+Hanani%2E+2018%2E+Birzeit+Arabic+dialect+identication+system+for+the+2018+VarDial+challenge%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dial)
49. Tanja Samardžić, Yves Scherrer, and Elvira Glaser. 2016. ArchiMob – a corpus of spoken Swiss German. In Proceedings of LREC. [find](https://scholar.google.com/scholar?q=Tanja+Samardz%CC%8Cic%CC%81%2C+Yves+Scherrer%2C+and+Elvira+Glaser%2E+2016%2E+ArchiMob+%E2%80%93+a+corpus+of+spoken+Swiss+German%2E+In+Proceedings+of+LREC%2E)
50. Yves Scherrer and Philipp Stoeckle. 2016. A quantitative approach to Swiss German – dialectometric analyses and comparisons of linguistic levels. Dialectologia et Geolinguistica, 24(1):92–125. [find](https://scholar.google.com/scholar?q=Yves+Scherrer+and+Philipp+Stoeckle%2E+2016%2E+A+quantitative+approach+to+Swiss+German+%E2%80%93+dialectometric+analyses+and+comparisons+of+linguistic+levels%2E+Dialectologia+et+Geolinguistica%2C+24%281%29%3A92%E2%80%93125%2E)
51. Suwon Shon, Ahmed Ali, and James Glass. 2017. MIT-QCRI Arabic dialect identification system for the 2017 multi-genre broadcast challenge. In IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), pages 374–380. [find](https://scholar.google.com/scholar?q=Suwon+Shon%2C+Ahmed+Ali%2C+and+James+Glass%2E+2017%2E+MIT%2DQCRI+Arabic+dialect+identification+system+for+the+2017+multi%2Dgenre+broadcast+challenge%2E+In+IEEE+Workshop+on+Automatic+Speech+Recognition+and+Understan)
52. Suwon Shon, Ahmed Ali, and James Glass. 2018. Convolutional neural network and language embeddings for end-to-end dialect recognition. In Proceedings of the Speaker and Language Recognition Workshop (Odyssey). [find](https://scholar.google.com/scholar?q=Suwon+Shon%2C+Ahmed+Ali%2C+and+James+Glass%2E+2018%2E+Convolutional+neural+network+and+language+embeddings+for+end%2Dto%2Dend+dialect+recognition%2E+In+Proceedings+of+the+Speaker+and+Language+Recognition+Workshop+%28)
53. Miikka Silfverberg and Senka Drobac. 2018. Sub-label dependencies for neural morphological tagging – the joint submission of University of Colorado and University of Helsinki for VarDial 2018. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Miikka+Silfverberg+and+Senka+Drobac%2E+2018%2E+Sub%2Dlabel+dependencies+for+neural+morphological+tagging+%E2%80%93+the+joint+submission+of+University+of+Colorado+and+University+of+Helsinki+for+VarDial+2018%2E+In+Proc)
54. Liling Tan, Marcos Zampieri, Nikola Ljubešic, and Jörg Tiedemann. 2014. Merging comparable data sources for the discrimination of similar languages: The DSL corpus collection. In Proceedings of the BUCC Workshop. [find](https://scholar.google.com/scholar?q=Liling+Tan%2C+Marcos+Zampieri%2C+Nikola+Ljubes%CC%8Cic%2C+and+Jo%CC%88rg+Tiedemann%2E+2014%2E+Merging+comparable+data+sources+for+the+discrimination+of+similar+languages%3A+The+DSL+corpus+collection%2E+In+Proceedings+of+the+)
55. Chris van der Lee and Antal van den Bosch. 2017. Exploring lexical and syntactic features for language variety identification. In Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Chris+van+der+Lee+and+Antal+van+den+Bosch%2E+2017%2E+Exploring+lexical+and+syntactic+features+for+language+variety+identification%2E+In+Proceedings+of+the+Fourth+Workshop+on+NLP+for+Similar+Languages%2C+Varie)
56. Hans van Halteren and Nelleke Oostdijk. 2018. Identification of differences between Dutch language varieties with the VarDial2018 Dutch-Flemish subtitle data. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Hans+van+Halteren+and+Nelleke+Oostdijk%2E+2018%2E+Identification+of+differences+between+Dutch+language+varieties+with+the+VarDial2018+Dutch%2DFlemish+subtitle+data%2E+In+Proceedings+of+the+Fifth+Workshop+on+N)
57. Marcos Zampieri, Liling Tan, Nikola Ljubešić, and Jörg Tiedemann. 2014. A report on the DSL shared task 2014. In Proceedings of the VarDial Workshop (VarDial). [find](https://scholar.google.com/scholar?q=Marcos+Zampieri%2C+Liling+Tan%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+and+Jo%CC%88rg+Tiedemann%2E+2014%2E+A+report+on+the+DSL+shared+task+2014%2E+In+Proceedings+of+the+VarDial+Workshop+%28VarDial%29%2E) [our card](https://md.research.elamur.ai/free/papers/zampieri-2014-report-dsl-shared-task/)
58. Marcos Zampieri, Liling Tan, Nikola Ljubešić, Jörg Tiedemann, and Preslav Nakov. 2015. Overview of the DSL shared task 2015. In Proceedings of the LT4VarDial Workshop (LT4VarDial). [find](https://scholar.google.com/scholar?q=Marcos+Zampieri%2C+Liling+Tan%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+Jo%CC%88rg+Tiedemann%2C+and+Preslav+Nakov%2E+2015%2E+Overview+of+the+DSL+shared+task+2015%2E+In+Proceedings+of+the+LT4VarDial+Workshop+%28LT4VarDial%29%2E) [our card](https://md.research.elamur.ai/free/papers/zampieri-2015-overview-dsl-shared-task/)
59. Marcos Zampieri, Shervin Malmasi, Nikola Ljubešić, Preslav Nakov, Ahmed Ali, Jörg Tiedemann, Yves Scherrer, and Noëmi Aepli. 2017. Findings of the VarDial evaluation campaign 2017. In Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial). [find](https://scholar.google.com/scholar?q=Marcos+Zampieri%2C+Shervin+Malmasi%2C+Nikola+Ljubes%CC%8Cic%CC%81%2C+Preslav+Nakov%2C+Ahmed+Ali%2C+Jo%CC%88rg+Tiedemann%2C+Yves+Scherrer%2C+and+Noe%CC%88mi+Aepli%2E+2017%2E+Findings+of+the+VarDial+evaluation+campaign+2017%2E+In+Proceedings+) [our card](https://md.research.elamur.ai/free/papers/zampieri-2017-findings-vardial-evaluation-campaign/)