Summarization datasets from the KAS corpus KAS-Sum 1.0

  Avtorji

Žagar, Aleš ; et al.prikaži vse

Žagar, Aleš ; Kavaš, Matic ; Robnik-Šikonja, Marko ; Erjavec, Tomaž ; Fišer, Darja ; Ljubešić, Nikola ; Ferme, Marko ; Borovič, Mladen ; Boškovič, Borko ; Ojsteršek, Milan ; Hrovat, Goran

  Identifikator vnosa

http://hdl.handle.net/11356/1446

 URL projekta

https://nl.ijs.si/kas/

 Dokumentirano v

https://doi.org/10.5281/zenodo.5562228

 Datum objave

2022-02-04

 Vrsta

corpus, text

 Velikost

122081 texts, 1079637118 words

 Jezik(i)

English , Slovenian

 Opis

Summarization datasets were created from the text bodies in the KAS 2.0 corpus (http://hdl.handle.net/11356/1448) and the abstracts from the KAS-Abs 2.0 corpus (http://hdl.handle.net/11356/1449). The monolingual slo2slo dataset contains 69,730 Slovene abstracts and Slovene body texts. The cross-lingual slo2eng dataset contains 52,351 Slovene body texts and English abstracts. It is suitable for building cross-lingual summarization models. Total number of words represent the sum of words in bodies, Slovene abstracts, and English abstracts. The files are stored in the same manner as the complete KAS corpus, i.e. in 1,000 directories with the same filename prefix as in KAS. They are in the JSON format that contains chapter segmented text. In addition to a unique chapter ID, each JSON file contains a key titled “abstract” that contains a list with abstract text as its first element. The file with the metadata for the corpus texts is also included. The datasets are suitable for training monolingual Slovene summarization models and cross-lingual Slovene-English summarization models on long texts. References: Žagar, A., Kavaš, M., & Robnik Šikonja, M. (2021). Corpus KAS 2.0: cleaner and with new datasets. In Information Society - IS 2021: Proceedings of the 24th International Multiconference. https://doi.org/10.5281/zenodo.5562228

 Izdajatelj

Faculty of Electrical Engineering and Computer Science, University of Maribor

 

Faculty of Computer and Information Science, University of Ljubljana

 Zahvala

Jožef Stefan Institute CLARIN "CLARIN.SI"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

European Union EC/H2020/825153 "EMBEDDIA - Cross-Lingual Embeddings for Less-Represented Languages in European News Media"

ARRS (Slovenian Research Agency) J6-2581 "Računalniško podprta večjezična analiza novičarskega diskurza s kontekstualnimi besednimi vložitvami"

 Ključne besede

abstracts PhD theses MSc/MA theses BSc/BA theses academic writing text summarization

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa