The CLASSLA-Stanza model for lemmatisation of non-standard Slovenian 2.1

  Authors

Terčon, Luka and Ljubešić, Nikola

  Item identifier

http://hdl.handle.net/11356/1784

 Project URL

https://github.com/clarinsi/classla

 Referenced by

https://aclanthology.org/W19-3704/

 Date issued

2023-03-30

 Type

toolService

 Language(s)

Slovenian

 Description

This model for lemmatisation of non-standard Slovenian was built with the CLASSLA-Stanza tool (https://github.com/clarinsi/classla) by training on the SUK training corpus (http://hdl.handle.net/11356/1747) and the Janes-Tag corpus (http://hdl.handle.net/11356/1732), using the CLARIN.SI-embed.sl word embeddings (http://hdl.handle.net/11356/1204) that were expanded with the MaCoCu-sl Slovene web corpus (http://hdl.handle.net/11356/1517). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~91.45. The difference to the previous version of the model is that the model was trained on the SUK training corpus and the 3.0 version of Janes-tag, uses new embeddings and the new version of the Slovene morphological lexicon Sloleks 3.0 (http://hdl.handle.net/11356/1745).

 Publisher

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

ARRS (Slovenian Research Agency) J7-4642 "MEZZANINE"

 Subject(s)

lemmatisation computer-mediated communication language model

 Collection(s)

CLARIN.SI data & tools

 Other versions

List all versions  

Show full item record