Linguistically annotated multilingual comparable corpora of parliamentary debates ParlaMint.ana 4.1

  Authors

Erjavec, Tomaž ; et al.show everyone

Erjavec, Tomaž ; Kopp, Matyáš ; Ogrodniczuk, Maciej ; Osenova, Petya ; Agerri, Rodrigo ; Agirrezabal, Manex ; Agnoloni, Tommaso ; Aires, José ; Albini, Monica ; Alkorta, Jon ; Antiba-Cartazo, Iván ; Arrieta, Ekain ; Barcala, Mario ; Bardanca, Daniel ; Barkarson, Starkaður ; Bartolini, Roberto ; Battistoni, Roberto ; Bel, Nuria ; Bonet Ramos, Maria del Mar ; Calzada Pérez, María ; Cardoso, Aida ; Çöltekin, Çağrı ; Coole, Matthew ; Darģis, Roberts ; de Does, Jesse ; de Libano, Ruben ; Depoorter, Griet ; Depuydt, Katrien ; Diwersy, Sascha ; Dodé, Réka ; Fernandez, Kike ; Fernández Rei, Elisa ; Frontini, Francesca ; Garcia, Marcos ; García Díaz, Noelia ; García Louzao, Pedro ; Gavriilidou, Maria ; Gkoumas, Dimitris ; Grigorov, Ilko ; Grigorova, Vladislava ; Haltrup Hansen, Dorte ; Iruskieta, Mikel ; Jarlbrink, Johan ; Jelencsik-Mátyus, Kinga ; Jongejan, Bart ; Kahusk, Neeme ; Kirnbauer, Martin ; Kryvenko, Anna ; Ligeti-Nagy, Noémi ; Ljubešić, Nikola ; Luxardo, Giancarlo ; Magariños, Carmen ; Magnusson, Måns ; Marchetti, Carlo ; Marx, Maarten ; Meden, Katja ; Mendes, Amália ; Mochtak, Michal ; Mölder, Martin ; Montemagni, Simonetta ; Navarretta, Costanza ; Nitoń, Bartłomiej ; Norén, Fredrik Mohammadi ; Nwadukwe, Amanda ; Ojsteršek, Mihael ; Pančur, Andrej ; Papavassiliou, Vassilis ; Pereira, Rui ; Pérez Lago, María ; Piperidis, Stelios ; Pirker, Hannes ; Pisani, Marilina ; Pol, Henk van der ; Prokopidis, Prokopis ; Quochi, Valeria ; Rayson, Paul ; Regueira, Xosé Luís ; Rii, Andriana ; Rudolf, Michał ; Ruisi, Manuela ; Rupnik, Peter ; Schopper, Daniel ; Simov, Kiril ; Sinikallio, Laura ; Skubic, Jure ; Tamper, Minna ; Tungland, Lars Magne ; Tuominen, Jouni ; van Heusden, Ruben ; Varga, Zsófia ; Vázquez Abuín, Marta ; Venturi, Giulia ; Vidal Miguéns, Adrián ; Vider, Kadri ; Vivel Couso, Ainhoa ; Vladu, Adina Ioana ; Wissik, Tanja ; Yrjänäinen, Väinö ; Zevallos, Rodolfo ; Fišer, Darja

  Item identifier

http://hdl.handle.net/11356/1911

 Project URL

https://www.clarin.eu/content/parlamint

 Demo URL

https://github.com/clarin-eric/ParlaMint/

 Referenced by

https://doi.org/10.21203/rs.3.rs-4176128/v1

 Date issued

2024-06-03

 Type

corpus, text

 Size

8132022 utterances, 1231036093 words

 Language(s)

Basque , Bosnian , Bulgarian , Catalan , Croatian , Czech , Danish , Dutch , English , Estonian , Finnish , French , Galician , German , Hungarian , Icelandic , Italian , Latvian , Modern Greek (1453-) , Norwegian , Polish , Portuguese , Russian , Serbian , Slovenian , Spanish , Swedish , Turkish , Ukrainian

 Description

ParlaMint 4.1 is a set of comparable corpora containing transcriptions of parliamentary debates of 29 European countries and autonomous regions, mostly starting in 2015 and extending to mid-2022. The individual corpora comprise between 9 and 126 million words and the complete set contains over 1.2 billion words. The transcriptions are divided by days with information on the term, session and meeting, and contain speeches marked by the speaker and their role (e.g. chair, regular speaker). The speeches also contain marked-up transcriber comments, such as gaps in the transcription, interruptions, applause, etc. The corpora have extensive metadata, most importantly on speakers (name, gender, MP and minister status, party affiliation), on their political parties and parliamentary groups (name, coalition/opposition status, Wikipedia-sourced left-to-right political orientation, and CHES variables, https://www.chesdata.eu/). Note that some corpora have further metadata, e.g. the year of birth of the speakers, links to their Wikipedia articles, their membership in various committees, etc. The transcriptions are also marked with the subcorpora they belong to ("reference", until 2020-01-30, "covid", from 2020-01-31, and "war", from 2022-02-24). An overview of the statistics of the corpora is avaialable on GitHub in the folder Build/Metadata, in particular for the release 4.1 at https://github.com/clarin-eric/ParlaMint/tree/v4.1/Build/Metadata. The corpora are encoded according to the ParlaMint encoding guidelines (https://clarin-eric.github.io/ParlaMint/) and schemas (included in the distribution). The ParlaMint.ana linguistic annotation includes tokenization; sentence segmentation; lemmatisation; Universal Dependencies part-of-speech, morphological features, and syntactic dependencies; and the 4-class CoNLL-2003 named entities. Some corpora also have further linguistic annotations, in particular PoS tagging according a language-specific scheme, with their corpus TEI headers giving further details on the annotation vocabularies and tools used. This entry contains the ParlaMint.ana TEI-encoded linguistically annotated corpora; the derived CoNLL-U files along with TSV metadata of the speeches; and the derived vertical files (with their registry file), suitable for use with CQP-based concordancers, such as CWB, noSketch Engine or KonText. Also included is the 4.1 release of the sample data and scripts available at the GitHub repository of the ParlaMint project at https://github.com/clarin-eric/ParlaMint and the log files produced in the process of building the corpora for this release. The log files show e.g. known errors in the corpora, while more information about known problems is available in the open issues at the GitHub repository of the project. This entry contains the linguistically marked-up version of the corpus, while the text version, i.e. without the linguistic annotation is also available at http://hdl.handle.net/11356/1912. Another related resource, namely the ParlaMint corpora machine translated to English ParlaMint-en.ana 4.1 can be found at http://hdl.handle.net/11356/1910. As opposed to the previous version 4.0, this version fixes a number of bugs and restructures the ParlaMint GitHub repository. The DK corpus has been linguistically re-annotated to remove bugs, while its speeches are now also marked with topics. The PT corpus has been extended to 2024-03 and the UA corpus to 2023-11, which also has improved language marking (uk vs. ru) on segments.

 Publisher

CLARIN ERIC

 Acknowledgement

CLARIN ERIC - "ParlaMint: Towards Comparable Parliamentary Corpora"

Austrian Academy of Sciences - "ÖAW"

European Commission POIR.04.02.00-00C002/19 "European Regional Development Fund as a part of the 2014-2020 Smart Growth Operational Programme, CLARIN – Common Language Resources and Technology Infrastructure"

Dutch Language Institute - "-"

Ministry of Education, Youth and Sports of the Czech Republic LM2023062 "LINDAT/CLARIAH-CZ: Digital Research Infrastructure for Language Technologies, Arts and Humanities"

Department of Nordic Studies and Linguistics (NorS), University of Copenhagen CLARIN-DK "CLARIN-DK"

Galician Language Institute, University of Santiago de Compostela - "-"

Xunta de Galicia - University of Santiago de Compostela 2021-CP080 "Nós: Galician in the society and economy of artificial intelligence (2021-CP080), agreement between Xunta de Galicia and the University of Santiago de Compostela"

Hungarian Research Centre for Linguistics - "-"

National Library of Norway - "-"

Institute of Computer Science, Polish Academy of Sciences - "-"

Polish Ministry of Education and Science 2022/WK/09 "National contribution to CLARIN ERIC – European Research Infrastructure Consortium: Common Language Resources and Technology Infrastructure 2022–2023 (CLARIN Q)"

Fundação para a Ciência e a Tecnologia UIDP/00214/2020 "-"

Jožef Stefan Institute CLARIN "CLARIN.SI"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

Nederlandse Organisatie voor Wetenschappelijk Onderwijs CISC.CC.016 "Access to City Councils using Exploratory Search Systems"

Bulgarian Ministry of Education and Science DO1-301/17.12.21 "Bulgarian National Interdisciplinary Research e-Infrastructure for Resources and Technologies in favor of the Bulgarian Language and Cultural Heritage, part of the EU infrastructures CLARIN and DARIAH"

Institute for Language and Speech Processing / ATHENA RC - "-"

ARRS (Slovenian Research Agency) J7-4642 "MEZZANINE"

The Árni Magnsússon Institute for Icelandic Studies - "-"

Slovenian Research Agency (ARRS) P6-0436 "Basic national research program 'Digital Humanities' (2022-2027)"

ARRS (Slovenian Research Agency) N6-0099 "Flemish-Slovenian bilateral basic research project ‘Linguistic landscape of hate speech online’ (2019-2023)"

ARRS (Slovenian Research Agency) N6-0288 "the MSCA Seal of Excellence postdoctoral project 'The Changing Discursive Semantics of EU Representations' (2022-2024)"

Ministry of Science and Innovation of Spain - "-"

HiTZ - Ixa Group (UPV/EHU) - "-"

 Subject(s)

Parla-CLARIN parliamentary debates COVID-19 TEI Bulgarian Parliament Croatian Parliament Polish Parliament Slovenian Parliament Czech Parliament Icelandic Parliament Belgian Parliament Danish Parliament Spanish Parliament Dutch Parliament Turkish Parliament Italian Parliament Hungarian Parliament Latvian Parliament French Parliament Bosnian Parliament Catalonian Parliament Galician Parliament Greek Parliament Norwegian Parliament Serbian Parliament Swedish Parliament Ukrainian Parliament Finnish Parliament Estonian Parliament Basque Parliament Portuguese parliament Austrian Parliament UK Parliament

 Collection(s)

CLARIN.SI data & tools

 Other versions

List all versions  

Show full item record