The Length and Verbal Labels Do Not Matter : The Influence of Various Likert-Like Response Formats on Scales’ Psychometric Properties

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14230%2F24%3A00139466" target="_blank" >RIV/00216224:14230/24:00139466 - isvavai.cz</a>

Výsledek na webu

—

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

The Length and Verbal Labels Do Not Matter : The Influence of Various Likert-Like Response Formats on Scales’ Psychometric Properties

Popis výsledku v původním jazyce

While the Likert scale is the most commonly used response format to measure personality traits, there is no clear consensus on how the scale’s parameters moderate its performance. In two within-subject experiments, we manipulated the extremity of outer verbal labels and the presence of inner labels in a 5-point Likert-type scale (Study 1, N1 = 1044) and the scale length using 2, 6, and 10 options (Study 2, N2 = 846). We used the Height Inventory that allows for the comparison with the criterion of self-reported height and replicated the results using a typical psychological measure. In both studies, we assessed the measurement model and criterion validity. We utilized reliability analysis, path analysis, ordinal SEM, invariance analysis, and latent regressions . With more extreme outer labels and longer response scales, responses are slightly more central, impacting raw score variances (and means in skewed scales). With non-extreme labels and longer response scales, observed scores have negligibly higher reliability. Criterion validity of observed scores is only negligibly related to the presence of inner verbal labels. Reliability was higher in the all-labeled variants. We demonstrate that the measurement model can be equated across all experimental conditions, leading to an equivalent, invariant single latent trait with the same population characteristics and association with the criterion. The two-point scales resulted in lower reliability, but their criterion validity seemed unimpacted and could be advantageous in some contexts. The performance of the Likert response scale was stable across the conditions we manipulated, especially if SEM is used instead of raw score analysis. Still, we argue for verbally labeling all points on the scale and for non-extreme labels of endpoints.

Název v anglickém jazyce

The Length and Verbal Labels Do Not Matter : The Influence of Various Likert-Like Response Formats on Scales’ Psychometric Properties

Popis výsledku anglicky

While the Likert scale is the most commonly used response format to measure personality traits, there is no clear consensus on how the scale’s parameters moderate its performance. In two within-subject experiments, we manipulated the extremity of outer verbal labels and the presence of inner labels in a 5-point Likert-type scale (Study 1, N1 = 1044) and the scale length using 2, 6, and 10 options (Study 2, N2 = 846). We used the Height Inventory that allows for the comparison with the criterion of self-reported height and replicated the results using a typical psychological measure. In both studies, we assessed the measurement model and criterion validity. We utilized reliability analysis, path analysis, ordinal SEM, invariance analysis, and latent regressions . With more extreme outer labels and longer response scales, responses are slightly more central, impacting raw score variances (and means in skewed scales). With non-extreme labels and longer response scales, observed scores have negligibly higher reliability. Criterion validity of observed scores is only negligibly related to the presence of inner verbal labels. Reliability was higher in the all-labeled variants. We demonstrate that the measurement model can be equated across all experimental conditions, leading to an equivalent, invariant single latent trait with the same population characteristics and association with the criterion. The two-point scales resulted in lower reliability, but their criterion validity seemed unimpacted and could be advantageous in some contexts. The performance of the Likert response scale was stable across the conditions we manipulated, especially if SEM is used instead of raw score analysis. Still, we argue for verbally labeling all points on the scale and for non-extreme labels of endpoints.

Druh

O - Ostatní výsledky

CEP obor

—

OECD FORD obor

50101 - Psychology (including human - machine relations)

Projekt

<a href="/cs/project/GA23-06924S" target="_blank" >GA23-06924S: Vliv formátu odpověďové stupnice na psychometrické parametry položek</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů