The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0

Name: The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0
License: https://creativecommons.org/licenses/by-sa/4.0/

Ljubešić, Nikola; Rupnik, Peter

The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0

CLARIN.SI data & tools

Avtorji: Ljubešić, Nikola and Rupnik, Peter

Identifikator vnosa: http://hdl.handle.net/11356/1461

URL projekta: https://www.clarin.si/info/k-centre/

Dokumentirano v: https://aclanthology.org/C12-1160/

Datum objave: 2022-01-26

Vrsta: corpus, text

Velikost: 9258 texts

Jezik(i): Bosnian , Croatian , Serbian

Opis: The SETimes.HBS dataset consists of parallel documents written in Bosnian, Croatian and Serbian, harvested from the already inactive setimes.com website publishing news in the languages of South-Eastern Europe. While the writing process of the documents is not known, they are quite likely independent translations from English. The main intended usage of this dataset is closely-related language discrimination. This dataset is not a traditional parallel dataset as there are no explicit links between parallel documents. Special care was taken that the training, development and testing bins of the dataset contain the same documents in all three languages as data leakage between the three bins, given the similarity of the three languages, could be problematic for benchmarking.