Evaluating the Performance of wav2vec Embedding for Parkinson's Disease Detection

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21460%2F23%3A00370047" target="_blank" >RIV/68407700:21460/23:00370047 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.2478/msr-2023-0033" target="_blank" >https://doi.org/10.2478/msr-2023-0033</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.2478/msr-2023-0033" target="_blank" >10.2478/msr-2023-0033</a>

Result language

angličtina

Original language name

Evaluating the Performance of wav2vec Embedding for Parkinson's Disease Detection

Original language description

Speech is one of the most serious manifestations of Parkinson's disease (PD). Sophisticated language/speech models have already demonstrated impressive performance on a variety of tasks, including classification. By analysing large amounts of data from a given setting, these models can identify patterns that would be difficult for clinicians to detect. We focus on evaluating the performance of a large self-supervised speech representation model, wav2vec, for PD classification. Based on the computed wav2vec embedding for each available speech signal, we calculated two sets of 512 derived features, wav2vec-sum and wav2vec-mean. Unlike traditional signal processing methods, this approach can learn a suitable representation of the signal directly from the data without requiring manual or hand-crafted feature extraction. Using an ensemble random forest classifier, we evaluated the embedding-based features on three different healthy vs. PD datasets (participants rhythmically repeat syllables /pa/, Italian dataset and English dataset). The obtained results showed that the wav2vec signal representation was accurate, with a minimum area under the receiver operating characteristic curve (AUROC) of 0.77 for the /pa/ task and the best AUROC of 0.98 for the Italian speech classification. The findings highlight the potential of the generalisability of the wav2vec features and the performance of these features in the cross-database scenarios. 2023 Ondřej Klempíř et al., published by Sciendo.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

20601 - Medical engineering

Project

<a href="/en/project/LX22NPO5107" target="_blank" >LX22NPO5107: National institute for Neurological Research</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>S - Specificky vyzkum na vysokych skolach

Publication year

2023

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Measurement Science Review

ISSN

1335-8871

e-ISSN

1335-8871

Volume of the periodical

23

Issue of the periodical within the volume

6

Country of publishing house

SK - SLOVAKIA

Number of pages

8

Pages from-to

260-267

UT code for WoS article

001111312600002

EID of the result in the Scopus database

2-s2.0-85178023933