Dataset and baseline model of moderated content FRENK-MMC-RTV 1.0

  Authors

Ljubešić, Nikola ; Erjavec, Tomaž and Fišer, Darja

  Item identifier

http://hdl.handle.net/11356/1201

 Project URL

https://nl.ijs.si/frenk/

 Referenced by

https://drive.google.com/file/d/13m7PFn49_tnEfFjcbqk8cugG4ZTy2A5I/view

 Date issued

2018-10-27

 Type

corpus, text

 Size

7597560 texts, 325225576 words

 Language(s)

Slovenian

 Description

FRENK-MMC-RTV is a dataset of moderated newspaper comments from the website rtvslo.si with metadata on the time of publishing, user identifier, thread identifier and whether the comment was deleted by the moderators or not. The full text of each comment is encrypted via a character-replacement method so that the comments are not readable by humans. Basic punctuation is not encrypted in order to enable tokenization. The main use of this dataset are experiments on automating comment moderation. For real-world usage, a fastText classification model trained on non-encrypted data is made available as well.

 Publisher

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) J7-8280 "FRENK: Resources, methods, and tools for the understanding, identification, and classification of various forms of socially unacceptable discourse in the information society"

 Subject(s)

computer-mediated communication news comments content moderation

 Collection(s)

CLARIN.SI data & tools

Show full item record