The CLASSLA-Stanza model for lemmatisation of non-standard Slovenian 2.1

Name: The CLASSLA-Stanza model for lemmatisation of non-standard Slovenian 2.1
License: https://creativecommons.org/licenses/by-sa/4.0/

Terčon, Luka; Ljubešić, Nikola

Show simple item record

dc.contributor.author	Terčon, Luka
dc.contributor.author	Ljubešić, Nikola
dc.date.accessioned	2023-03-31T11:27:27Z
dc.date.available	2023-03-31T11:27:27Z
dc.date.issued	2023-03-30
dc.identifier.uri	http://hdl.handle.net/11356/1784
dc.description	This model for lemmatisation of non-standard Slovenian was built with the CLASSLA-Stanza tool (https://github.com/clarinsi/classla) by training on the SUK training corpus (http://hdl.handle.net/11356/1747) and the Janes-Tag corpus (http://hdl.handle.net/11356/1732), using the CLARIN.SI-embed.sl word embeddings (http://hdl.handle.net/11356/1204) that were expanded with the MaCoCu-sl Slovene web corpus (http://hdl.handle.net/11356/1517). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~91.45. The difference to the previous version of the model is that the model was trained on the SUK training corpus and the 3.0 version of Janes-tag, uses new embeddings and the new version of the Slovene morphological lexicon Sloleks 3.0 (http://hdl.handle.net/11356/1745).
dc.language.iso	slv
dc.publisher	Jožef Stefan Institute
dc.relation.isreferencedby	https://aclanthology.org/W19-3704/
dc.relation.replaces	http://hdl.handle.net/11356/1350
dc.rights	Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
dc.rights.uri	https://creativecommons.org/licenses/by-sa/4.0/
dc.rights.label	PUB
dc.source.uri	https://github.com/clarinsi/classla
dc.subject	lemmatisation
dc.subject	computer-mediated communication
dc.subject	language model
dc.title	The CLASSLA-Stanza model for lemmatisation of non-standard Slovenian 2.1
dc.type	toolService
metashare.ResourceInfo#ContentInfo.detailedType	tool
metashare.ResourceInfo#ResourceComponentType#ToolServiceInfo.languageDependent	true
has.files	yes
branding	CLARIN.SI data & tools
contact.person	Nikola Ljubešić nikola.ljubesic@ijs.si Jožef Stefan Institute
contact.person	Luka Terčon luka.tercon@gmail.com Faculty of Computer and Information Science, University of Ljubljana
sponsor	ARRS (Slovenian Research Agency) P6-0411 Language Resources and Technologies for Slovene nationalFunds
sponsor	Ministry of Culture C3340-20-278001 Development of Slovene in a Digital Environment Other
sponsor	ARRS (Slovenian Research Agency) J7-4642 MEZZANINE nationalFunds
files.count	1
files.size	2467458