The Impact of Edge Displacement Vaserstein Distance on UD Parsing Performance
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F22%3AQEMDAR97" target="_blank" >RIV/00216208:11320/22:QEMDAR97 - isvavai.cz</a>
Result on the web
<a href="https://doi.org/10.1162/coli_a_00440" target="_blank" >https://doi.org/10.1162/coli_a_00440</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1162/coli_a_00440" target="_blank" >10.1162/coli_a_00440</a>
Alternative languages
Result language
angličtina
Original language name
The Impact of Edge Displacement Vaserstein Distance on UD Parsing Performance
Original language description
We contribute to the discussion on parsing performance in NLP by introducing a measurement that evaluates the differences between the distributions of edge displacement (the directed distance of edges) seen in training and test data. We hypothesize that this measurement will be related to differences observed in parsing performance across treebanks. We motivate this by building upon previous work and then attempt to falsify this hypothesis by using a number of statistical methods. We establish that there is a statistical correlation between this measurement and parsing performance even when controlling for potential covariants. We then use this to establish a sampling technique that gives us an adversarial and complementary split. This gives an idea of the lower and upper bounds of parsing systems for a given treebank in lieu of freshly sampled data. In a broader sense, the methodology presented here can act as a reference for future correlation-based exploratory work in NLP.
Czech name
—
Czech description
—
Classification
Type
J<sub>SC</sub> - Article in a specialist periodical, which is included in the SCOPUS database
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
—
Others
Publication year
2022
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
Computational Linguistics
ISSN
0891-2017
e-ISSN
1530-9312
Volume of the periodical
48
Issue of the periodical within the volume
3
Country of publishing house
US - UNITED STATES
Number of pages
38
Pages from-to
517-554
UT code for WoS article
—
EID of the result in the Scopus database
2-s2.0-85138714217