Extensions to the Slovene translation of SuperGLUE

  Authors

Borovič, Mladen ; et al.show everyone

Borovič, Mladen ; Žagar, Kristjan ; Ferme, Marko ; Majninger, Sandi ; Ojsteršek, Milan ; Žagar, Aleš ; Robnik-Šikonja, Marko

  Item identifier

http://hdl.handle.net/11356/1704

 Project URL

https://rsdo.slovenscina.eu/en/semantic-resources-and-technologies

 Referenced by

https://super.gluebenchmark.com/

 Date issued

2022-11-07

 Type

corpus, text

 Language(s)

Slovenian

 Description

SuperGLUE is a benchmark styled after GLUE with a new set of more difficult language understanding tasks, improved resources, and a public leaderboard. It is comprised of 8 corpora (BoolQ, CB, COPA, MultiRC, ReCoRD, RTE, WiC, WSC), which cover 4 different types of tasks (QA, NLI, WSD, coref.). Slovene translation of SuperGLUE consists of machine and human translations of the benchmark. ReCoRD is completely translated by the Google Machine Translation service. Questions and answers from the project "Slovene in the Palm of your Hand (Slovenščina na dlani)" are also included for the BoolQ, MultiRC and ReCoRD tasks and are in form of extensions to the existing datasets. The data is provided in jsonl format.

 Publisher

Faculty of Electrical Engineering and Computer Science, University of Maribor

 Acknowledgement

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

Slovene Ministry of Culture and European Social Fund C3340-17-208002 "Slovenščina na dlani"

 Subject(s)

natural language processing Q&A SuperGLUE

 Collection(s)

CLARIN.SI data & tools

Show full item record