Comparable corpora of South-Slavic Wikipedias CLASSLA-Wikipedia 1.0

Comparable corpora of South-Slavic Wikipedias CLASSLA-Wikipedia 1.0

CLARIN.SI data & tools

Authors: Ljubešić, Nikola ; Markoski, Filip ; Markoska, Elena and Erjavec, Tomaž

Item identifier: http://hdl.handle.net/11356/1427

Project URL: https://github.com/clarinsi/classla-wikipedia

Referenced by: https://aclanthology.org/2021.ranlp-1.104.pdf

Date issued: 2021-05-05

Type: corpus, text

Size: 1928450 articles, 37677016 sentences, 486258862 tokens

Language(s): Bosnian , Croatian , Macedonian , Montenegrin , Serbian , Serbo-Croatian , Slovenian

Description: This comparable corpus collection consists of Wikipedia dumps of the Bosnian, Croatian, Macedonian, Montenegrin, Serbian, Serbo-Croatian and Slovenian Wikipedia, harvested on October 17th 2020. The text was extracted from the dumps with the process documented at https://github.com/clarinsi/classla-wikipedia, and linguistic annotation was performed with the classla package (https://pypi.org/project/classla/), on all levels available for a specific language, with the Bosnian and Serbo-Croatian Wikipedias processed with the standard Croatian models.

Publisher: Jožef Stefan Institute

Subject(s): comparable corpus Wikipedia

Collection(s): CLARIN.SI data & tools

Show full item record

Files in this item

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution 4.0 International (CC BY 4.0)

Name: classlawiki-bg.conllu.gz
Size: 1.09 GB
Format: application/gzip
Description: Bulgarian Wikipedia
MD5: ed4f11056abc4f265e2ba995961683e0

Name: classlawiki-bs.conllu.gz
Size: 258.13 MB
Format: application/gzip
Description: Bosnian Wikipedia
MD5: 3f82c98d4ff85a1c41eade4ba194c585

Name: classlawiki-hr.conllu.gz
Size: 745.75 MB
Format: application/gzip
Description: Croatian Wikipedia
MD5: a60256fccf9203845ab27565e0ee7362

Name: classlawiki-mk.conllu.gz
Size: 422.35 MB
Format: application/gzip
Description: Macedonian Wikipedia
MD5: 76320c89294557ef8115911ed1cab18f

Name: classlawiki-sh.conllu.gz
Size: 753.29 MB
Format: application/gzip
Description: Serbo-Croatian Wikipedia
MD5: cb33f6f5f16ac36c97279b429d0c23e3

Name: classlawiki-sl.conllu.gz
Size: 620.25 MB
Format: application/gzip
Description: Slovenian Wikipedia
MD5: 43b88ff0d5d6b9b11d6a49e933819243

Name: classlawiki-sr.conllu.gz
Size: 1.22 GB
Format: application/gzip
Description: Serbian Wikipedia
MD5: 4229eb9ac932e95498ad9e33f0453c5a