Improving Machine Learning Prediction of Constructs : Mental Fatigue

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14210%2F24%3A00136982" target="_blank" >RIV/00216224:14210/24:00136982 - isvavai.cz</a>

Result on the web

<a href="https://inpact-psychologyconference.org/wp-content/uploads/2024/05/202401OP062.pdf" target="_blank" >https://inpact-psychologyconference.org/wp-content/uploads/2024/05/202401OP062.pdf</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.36315/2024inpact062" target="_blank" >10.36315/2024inpact062</a>

Result language

angličtina

Original language name

Improving Machine Learning Prediction of Constructs : Mental Fatigue

Original language description

Mental fatigue is a psychophysiological state that plays an important role in various domains of human machine interaction where it may increase risk of injury or accidents. To prevent threats to life and property, novel techniques combining psychological and computational approaches are needed and thus explored. Previous research has focused on training machine learning (ML) models on different types of fatigue input data and experiment settings, and recently on the generalizability of the models. However, current ML development struggles with various issues such as unclear analysis of what the model is actually learning. When trained on data that are only partially correctly labeled, it can learn artifacts of the dataset construction instead of the construct state. Psychometric measures that are used to label data have usually imperfect/questionable reliability, thus even if administered correctly may label some data incorrectly. The most widely used method for labeling mental fatigue states are subjective scales, which also possess limitations on construct validity. In this contribution, an iterative procedure to improve both reliability and validity of the labeling based on generalizability theory is proposed. This labeling procedure is constructed from components already present in the dataset and relevant to the construct being predicted. In the case of mental fatigue, a subjective scale, performance decrease and environmental reference extracted in 7 datasets collected on different sites is used, with several methods used to induce fatigue, all with heart rate variability as input data. The quality of combinations and levels of the label is assessed by analyzing unwanted variances and by using an equivalent of reliability from generalizability theory. Applying this procedure, components can be added to a label and created labels can be directly compared. Considering the iterative nature of this process, labels can be dynamically adjusted based on added new data. The whole procedure adds flexibility to dataset design, allowing for easier integration of datasets, even those that were not originally intended for ML. As a result, we enhance increasing variability and amount of data that is available for researchers, promoting its use beyond the ML-based mental fatigue prediction.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

50101 - Psychology (including human - machine relations)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

INPACT24 Proceedings : Psychological Applications and Trends 2024

ISBN

9789893510667

ISSN

2184-2205

e-ISSN

2184-3414

Number of pages

5

Pages from-to

299-303

Publisher name

inScience Press

Place of publication

Lisabon

Event location

Porto, Portugal

Event date

Jan 1, 2024

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—