Dataset and baseline model of moderated content FRENK-MMC-RTV 1.0

  Avtorji

Ljubešić, Nikola ; Erjavec, Tomaž and Fišer, Darja

  Identifikator vnosa

http://hdl.handle.net/11356/1201

 URL projekta

https://nl.ijs.si/frenk/

 Dokumentirano v

https://drive.google.com/file/d/13m7PFn49_tnEfFjcbqk8cugG4ZTy2A5I/view

 Datum objave

2018-10-27

 Vrsta

corpus, text

 Velikost

7597560 texts, 325225576 words

 Jezik(i)

Slovenian

 Opis

FRENK-MMC-RTV is a dataset of moderated newspaper comments from the website rtvslo.si with metadata on the time of publishing, user identifier, thread identifier and whether the comment was deleted by the moderators or not. The full text of each comment is encrypted via a character-replacement method so that the comments are not readable by humans. Basic punctuation is not encrypted in order to enable tokenization. The main use of this dataset are experiments on automating comment moderation. For real-world usage, a fastText classification model trained on non-encrypted data is made available as well.

 Izdajatelj

Jožef Stefan Institute

 Zahvala

ARRS (Slovenian Research Agency) J7-8280 "FRENK: Resources, methods, and tools for the understanding, identification, and classification of various forms of socially unacceptable discourse in the information society"

 Ključne besede

computer-mediated communication news comments content moderation

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa