Frequency lists of word-level n-grams from the Gigafida 2.0 corpus

  Authors

Čibej, Jaka ; Arhar Holdt, Špela ; Dobrovoljc, Kaja and Krek, Simon

  Item identifier

http://hdl.handle.net/11356/1274

 Project URL

http://slovnica.ijs.si/

 Date issued

2019-11-18

 Type

lexicalConceptualResource, text

 Language(s)

Slovenian

 Description

Frequency lists of word-level n-grams (or word sets) were extracted from the Gigafida 2.0 Corpus of Written Standard Slovene (https://viri.cjvt.si/gigafida/) using the LIST corpus extraction tool (http://hdl.handle.net/11356/1227). The lists contain all word-level 2-, 3-, 4- and 5-grams with minimum relative frequency of 2 per million occurring in the corpus, along with their absolute and relative frequencies, percentages, distribution across the text-types included in the corpus taxonomy, and five collocation measures: Dice, t-score, MI, MI3, logDice, and simple LL. The n-grams were extracted from lower-case word forms and morphosyntactic tags. For large lists, shortened versions with the first 150,000 lines were also prepared to facilitate further processing in spreadsheet analysis software.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) J6-8256 "New grammar of contemporary standard Slovene: sources and methods"

 Subject(s)

n-grams standard language lemmas morphosyntactic tags normalized word forms word sets

 Collection(s)

CLARIN.SI data & tools

Show full item record