Slovene instruction-following dataset for large language models GaMS-Instruct-DH 1.0

  Avtorji

Šorn, Mojca ; et al.prikaži vse

Šorn, Mojca ; Cvek, Ana ; Skubic, Jure ; Logar, Tamara ; Zagoranski, Sašo ; Bratanović, Alen

  Identifikator vnosa

http://hdl.handle.net/11356/1975

 URL projekta

https://www.cjvt.si/povejmo/en/project/

 Datum objave

2024-09-25

 Vrsta

corpus, text

 Velikost

10150 units

 Jezik(i)

Slovenian

 Opis

GaMS-Instruct-DH is an instruction-following dataset designed to fine-tune Slovene large language models to follow instructions. It consists of pairs of prompts and responses, some of which contain an additional context field, as well as a field in which the source of the information included in the response is listed. The dataset focuses on prompts from the field of digital humanities and museum documentation. Its primary goal is to provide a resource that allows existing large language models already available for the field of digital humanities to be expanded to cover Slovene and other similar, but less-resourced languages (e.g. Bosnian). Version 1.0 include approx. 10,000 prompt-response pairs which were compiled entirely by hand by a team of linguists and experts from the field of digital humanities.

 Izdajatelj

Institute of Contemporary History

 

Semantika d.o.o.

 

Faculty of Computer and Information Science, University of Ljubljana

 Zahvala

ARIS (Slovenian Research and Innovation Agency) NOO "PoVeJMo research project (Adaptive Natural Language Processing with Large Language Models)"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Ključne besede

instruction following dataset large language models digital humanities museum documentation

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa