Investigating interoperable event corpora: limitations of reusability of resources and portability of models

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F23%3A9M7KNHL5" target="_blank" >RIV/00216208:11320/23:9M7KNHL5 - isvavai.cz</a>

Výsledek na webu

<a href="https://link.springer.com/10.1007/s10579-023-09643-6" target="_blank" >https://link.springer.com/10.1007/s10579-023-09643-6</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s10579-023-09643-6" target="_blank" >10.1007/s10579-023-09643-6</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Investigating interoperable event corpora: limitations of reusability of resources and portability of models

Popis výsledku v původním jazyce

"Abstractn Studies on the applicability of heterogeneous semantically interoperable corpora are rare. We investigate to what extent reusability (both of systems and of annotations) is entailed by corpora whose interoperability is based on compliance to standards. In particular, we look at event detection in English texts, supported by the ISO-TimeML annotation scheme. We run two sets of experiments using a common neural network architecture and extensively evaluate our results on both in-distribution and out-of-distribution settings. In all experimental settings, systems obtain state-of-the-art results on the in-distribution data and underperform out-of-distribution ones, setting limits to the benefits of semantically interoperable corpora. By means of a detailed error analysis, we show that while being compliant to a standard guarantees semantic interoperability, this becomes only a necessary condition for reusability, with factors such as differences in the quality of the annotations having a much stronger impact."

Název v anglickém jazyce

Investigating interoperable event corpora: limitations of reusability of resources and portability of models

Popis výsledku anglicky

"Abstractn Studies on the applicability of heterogeneous semantically interoperable corpora are rare. We investigate to what extent reusability (both of systems and of annotations) is entailed by corpora whose interoperability is based on compliance to standards. In particular, we look at event detection in English texts, supported by the ISO-TimeML annotation scheme. We run two sets of experiments using a common neural network architecture and extensively evaluate our results on both in-distribution and out-of-distribution settings. In all experimental settings, systems obtain state-of-the-art results on the in-distribution data and underperform out-of-distribution ones, setting limits to the benefits of semantically interoperable corpora. By means of a detailed error analysis, we show that while being compliant to a standard guarantees semantic interoperability, this becomes only a necessary condition for reusability, with factors such as differences in the quality of the annotations having a much stronger impact."

Druh

J_ost - Ostatní články v recenzovaných periodicích

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

—

Rok uplatnění

2023

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

"Language Resources and Evaluation"

ISSN

1574-020X

e-ISSN

—

Svazek periodika

57

Číslo periodika v rámci svazku

3

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

31

Strana od-do

1107-1137

Kód UT WoS článku

—

EID výsledku v databázi Scopus

—