Slovene instruction-following dataset for large language models GaMS-Instruct-DH 1.0

  Authors

Šorn, Mojca ; et al.show everyone

Šorn, Mojca ; Cvek, Ana ; Skubic, Jure ; Logar, Tamara ; Zagoranski, Sašo ; Bratanović, Alen

  Item identifier

http://hdl.handle.net/11356/1975

 Project URL

https://www.cjvt.si/povejmo/en/project/

 Date issued

2024-09-25

 Type

corpus, text

 Size

10150 units

 Language(s)

Slovenian

 Description

GaMS-Instruct-DH is an instruction-following dataset designed to fine-tune Slovene large language models to follow instructions. It consists of pairs of prompts and responses, some of which contain an additional context field, as well as a field in which the source of the information included in the response is listed. The dataset focuses on prompts from the field of digital humanities and museum documentation. Its primary goal is to provide a resource that allows existing large language models already available for the field of digital humanities to be expanded to cover Slovene and other similar, but less-resourced languages (e.g. Bosnian). Version 1.0 include approx. 10,000 prompt-response pairs which were compiled entirely by hand by a team of linguists and experts from the field of digital humanities.

 Publisher

Institute of Contemporary History

 

Semantika d.o.o.

 

Faculty of Computer and Information Science, University of Ljubljana

 Acknowledgement

ARIS (Slovenian Research and Innovation Agency) NOO "PoVeJMo research project (Adaptive Natural Language Processing with Large Language Models)"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Subject(s)

instruction following dataset large language models digital humanities museum documentation

 Collection(s)

CLARIN.SI data & tools

Show full item record