| dc.contributor.author |
Žagar, Aleš |
| dc.contributor.author |
Kavaš, Matic |
| dc.contributor.author |
Robnik-Šikonja, Marko |
| dc.contributor.author |
Erjavec, Tomaž |
| dc.contributor.author |
Fišer, Darja |
| dc.contributor.author |
Ljubešić, Nikola |
| dc.contributor.author |
Ferme, Marko |
| dc.contributor.author |
Borovič, Mladen |
| dc.contributor.author |
Boškovič, Borko |
| dc.contributor.author |
Ojsteršek, Milan |
| dc.contributor.author |
Hrovat, Goran |
| dc.date.accessioned |
2022-02-10T09:35:00Z |
| dc.date.available |
2022-02-10T09:35:00Z |
| dc.date.issued |
2022-02-04 |
| dc.identifier.uri |
http://hdl.handle.net/11356/1446 |
| dc.description |
Summarization datasets were created from the text bodies in the KAS 2.0 corpus (http://hdl.handle.net/11356/1448) and the abstracts from the KAS-Abs 2.0 corpus (http://hdl.handle.net/11356/1449). The monolingual slo2slo dataset contains 69,730 Slovene abstracts and Slovene body texts. The cross-lingual slo2eng dataset contains 52,351 Slovene body texts and English abstracts. It is suitable for building cross-lingual summarization models. Total number of words represent the sum of words in bodies, Slovene abstracts, and English abstracts.
The files are stored in the same manner as the complete KAS corpus, i.e. in 1,000 directories with the same filename prefix as in KAS. They are in the JSON format that contains chapter segmented text. In addition to a unique chapter ID, each JSON file contains a key titled “abstract” that contains a list with abstract text as its first element. The file with the metadata for the corpus texts is also included.
The datasets are suitable for training monolingual Slovene summarization models and cross-lingual Slovene-English summarization models on long texts.
References:
Žagar, A., Kavaš, M., & Robnik Šikonja, M. (2021). Corpus KAS 2.0: cleaner and with new datasets. In Information Society - IS 2021: Proceedings of the 24th International Multiconference. https://doi.org/10.5281/zenodo.5562228 |
| dc.language.iso |
slv |
| dc.language.iso |
eng |
| dc.publisher |
Faculty of Electrical Engineering and Computer Science, University of Maribor |
| dc.publisher |
Faculty of Computer and Information Science, University of Ljubljana |
| dc.relation |
info:eu-repo/grantAgreement/EC/H2020/825153 |
| dc.relation.isreferencedby |
https://doi.org/10.5281/zenodo.5562228 |
| dc.rights |
CLARIN.SI Licence ACA ID-BY-NC-INF-NORED 1.0 |
| dc.rights.uri |
https://clarin.si/repository/xmlui/page/licence-aca-id-by-nc-inf-nored-1.0 |
| dc.rights.label |
ACA |
| dc.source.uri |
https://nl.ijs.si/kas/ |
| dc.subject |
abstracts |
| dc.subject |
PhD theses |
| dc.subject |
MSc/MA theses |
| dc.subject |
BSc/BA theses |
| dc.subject |
academic writing |
| dc.subject |
text summarization |
| dc.title |
Summarization datasets from the KAS corpus KAS-Sum 1.0 |
| dc.type |
corpus |
| metashare.ResourceInfo#ContentInfo.mediaType |
text |
| has.files |
yes |
| branding |
CLARIN.SI data & tools |
| contact.person |
Aleš Žagar Ales.Zagar@fri.uni-lj.si Faculty of Computer and Information Science |
| sponsor |
Jožef Stefan Institute CLARIN CLARIN.SI nationalFunds |
| sponsor |
Ministry of Culture C3340-20-278001 Development of Slovene in a Digital Environment Other |
| sponsor |
European Union EC/H2020/825153 EMBEDDIA - Cross-Lingual Embeddings for Less-Represented Languages in European News Media euFunds info:eu-repo/grantAgreement/EC/H2020/825153 |
| sponsor |
ARRS (Slovenian Research Agency) J6-2581 Računalniško podprta večjezična analiza novičarskega diskurza s kontekstualnimi besednimi vložitvami nationalFunds |
| size.info |
122081 texts |
| size.info |
1079637118 words |
| files.count |
1 |
| files.size |
4414817806 |
