Bosnian web corpus bsWaC 1.1

Bosnian web corpus bsWaC 1.1

CLARIN.SI data & tools

Authors: Ljubešić, Nikola and Klubička, Filip

Item identifier: http://hdl.handle.net/11356/1062

Project URL: http://nlp.ffzg.hr/resources/corpora/bswac/

Date issued: 2016-05-12

Type: corpus, text

Size: 286865790 tokens, 12886124 sentences, 896059 texts

Language(s): Bosnian

Description: The Bosnian web corpus bsWaC was built by crawling the .ba top-level domain in 2014. The corpus was near-deduplicated on paragraph level, normalised via diacritic restoration, morphosyntactically annotated and lemmatised. The corpus is shuffled by paragraphs. Each paragraph contains metadata on the URL, domain and language identification (Bosnian vs. Croatian vs. Serbian). Version 1.0 of this corpus is described in http://www.aclweb.org/anthology/W14-0405. Version 1.1 contains newer and better linguistic annotations.

Publisher: Jožef Stefan Institute

Subject(s): web corpus

Collection(s): CLARIN.SI data & tools

Show full item record

Files in this item

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

Name: bsWaC1.1.01.xml.gz
Size: 660.72 MB
Format: application/gzip
Description: Batch of 100 million tokens in XML (vertical) format.
MD5: a96819c59df194644c4bb078f70189cf

Name: bsWaC1.1.02.xml.gz
Size: 660.27 MB
Format: application/gzip
Description: Batch of 100 million tokens in XML (vertical) format.
MD5: 565b6fe0e5fd917c8c57e3d00049f55d

Name: bsWaC1.1.03.xml.gz
Size: 575.41 MB
Format: application/gzip
Description: Batch of 100 million tokens in XML (vertical) format.
MD5: 7720dc117126fa6855cd21506606e176