Summarization datasets from the KAS corpus KAS-Sum 1.0

  Authors

Žagar, Aleš ; et al.show everyone

Žagar, Aleš ; Kavaš, Matic ; Robnik-Šikonja, Marko ; Erjavec, Tomaž ; Fišer, Darja ; Ljubešić, Nikola ; Ferme, Marko ; Borovič, Mladen ; Boškovič, Borko ; Ojsteršek, Milan ; Hrovat, Goran

  Item identifier

http://hdl.handle.net/11356/1446

 Project URL

https://nl.ijs.si/kas/

 Referenced by

https://doi.org/10.5281/zenodo.5562228

 Date issued

2022-02-04

 Type

corpus, text

 Size

122081 texts, 1079637118 words

 Language(s)

English , Slovenian

 Description

Summarization datasets were created from the text bodies in the KAS 2.0 corpus (http://hdl.handle.net/11356/1448) and the abstracts from the KAS-Abs 2.0 corpus (http://hdl.handle.net/11356/1449). The monolingual slo2slo dataset contains 69,730 Slovene abstracts and Slovene body texts. The cross-lingual slo2eng dataset contains 52,351 Slovene body texts and English abstracts. It is suitable for building cross-lingual summarization models. Total number of words represent the sum of words in bodies, Slovene abstracts, and English abstracts. The files are stored in the same manner as the complete KAS corpus, i.e. in 1,000 directories with the same filename prefix as in KAS. They are in the JSON format that contains chapter segmented text. In addition to a unique chapter ID, each JSON file contains a key titled “abstract” that contains a list with abstract text as its first element. The file with the metadata for the corpus texts is also included. The datasets are suitable for training monolingual Slovene summarization models and cross-lingual Slovene-English summarization models on long texts. References: Žagar, A., Kavaš, M., & Robnik Šikonja, M. (2021). Corpus KAS 2.0: cleaner and with new datasets. In Information Society - IS 2021: Proceedings of the 24th International Multiconference. https://doi.org/10.5281/zenodo.5562228

 Publisher

Faculty of Electrical Engineering and Computer Science, University of Maribor

 

Faculty of Computer and Information Science, University of Ljubljana

 Acknowledgement

Jožef Stefan Institute CLARIN "CLARIN.SI"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

European Union EC/H2020/825153 "EMBEDDIA - Cross-Lingual Embeddings for Less-Represented Languages in European News Media"

ARRS (Slovenian Research Agency) J6-2581 "Računalniško podprta večjezična analiza novičarskega diskurza s kontekstualnimi besednimi vložitvami"

 Subject(s)

abstracts PhD theses MSc/MA theses BSc/BA theses academic writing text summarization

 Collection(s)

CLARIN.SI data & tools

Show full item record