CMC training corpus Janes-Tag 2.1

  Avtorji

Erjavec, Tomaž ; et al.prikaži vse

Erjavec, Tomaž ; Fišer, Darja ; Čibej, Jaka ; Arhar Holdt, Špela ; Ljubešić, Nikola ; Zupan, Katja ; Dobrovoljc, Kaja

  Identifikator vnosa

http://hdl.handle.net/11356/1238

 URL projekta

http://nl.ijs.si/janes/

 Dokumentirano v

http://nl.ijs.si/janes/viri/rocno-oznaceni-korpusi/#Janes-Tag
https://rdcu.be/7RX4

 Datum objave

2019-09-11

 Vrsta

corpus, text

 Velikost

2958 texts, 75276 tokens

 Jezik(i)

Slovenian

 Opis

Janes-Tag is a manually annotated corpus of Slovene Computer-Mediated Communication (CMC). It is meant as a gold-standard training and testing dataset for tokenisation, sentence segmentation, word normalisation, morphosyntactic tagging, lemmatisation and named entity annotation of non-standard Slovene. As the corpus has been carefully manually annotated, it is also suitable for detailed linguistic explorations which require highly accurate and reliable annotations. As an update to version 2.0, this version corrects some minor errors in NER annotation and introduces, in addition to MULTEXT-East morphosyntactic descriptions, also Universal Dependencies morphological features and the corpus in CoNLL-U format. The UD features are also included in the vert file. The first version of this corpus is described in: ERJAVEC, Tomaž, ČIBEJ, Jaka, ARHAR HOLDT, Špela, LJUBEŠIĆ, Nikola, FIŠER, Darja. 2016. Gold-standard datasets for annotation of Slovene computer-mediated communication. In Proceedings of RASLAN 2016: Recent Advances in Slavonic Natural Language Processing. Brno: Tribun EU, 2016, pp. 29-40, https://nlp.fi.muni.cz/raslan/raslan16.pdf FIŠER, Darja, LJUBEŠIĆ, Nikola, ERJAVEC, Tomaž. 2018. The Janes project: language resources and tools for Slovene user generated content. Language Resources & Evaluation. https://rdcu.be/7RX4 Note that a related corpus, Janes-Norm is also available, cf. http://hdl.handle.net/11356/1084.

 Izdajatelj

Jožef Stefan Institute

 Zahvala

ARRS (Slovenian Research Agency) J6-6842 "JANES: Resources, Tools and Methods for the Research of Nonstandard Internet Slovene"

ARRS (Slovenian Research Agency) P2-103 "Knowledge Technologies"

Swiss National Science Foundation 160501 "ReLDI"

ARRS (Slovenian Research Agency) MR-37487 "Young Researcher Programme"

Jožef Stefan Institute CLARIN "CLARIN.SI"

 Ključne besede

computer-mediated communication tokenisation word normalisation part-of-speech tagging lemmatisation manual annotation TEI named entities

 Zbirke

CLARIN.SI data & tools

 

Ta vnos je bil nadomeščen z novejšim.

http://hdl.handle.net/11356/1732

Seznam vseh različic  

Prikaži polni zapis vnosa