The Length and Verbal Labels Do Not Matter : The Influence of Various Likert-Like Response Formats on Scales’ Psychometric Properties

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14230%2F24%3A00139466" target="_blank" >RIV/00216224:14230/24:00139466 - isvavai.cz</a>

Result on the web

—

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

The Length and Verbal Labels Do Not Matter : The Influence of Various Likert-Like Response Formats on Scales’ Psychometric Properties

Original language description

While the Likert scale is the most commonly used response format to measure personality traits, there is no clear consensus on how the scale’s parameters moderate its performance. In two within-subject experiments, we manipulated the extremity of outer verbal labels and the presence of inner labels in a 5-point Likert-type scale (Study 1, N1 = 1044) and the scale length using 2, 6, and 10 options (Study 2, N2 = 846). We used the Height Inventory that allows for the comparison with the criterion of self-reported height and replicated the results using a typical psychological measure. In both studies, we assessed the measurement model and criterion validity. We utilized reliability analysis, path analysis, ordinal SEM, invariance analysis, and latent regressions . With more extreme outer labels and longer response scales, responses are slightly more central, impacting raw score variances (and means in skewed scales). With non-extreme labels and longer response scales, observed scores have negligibly higher reliability. Criterion validity of observed scores is only negligibly related to the presence of inner verbal labels. Reliability was higher in the all-labeled variants. We demonstrate that the measurement model can be equated across all experimental conditions, leading to an equivalent, invariant single latent trait with the same population characteristics and association with the criterion. The two-point scales resulted in lower reliability, but their criterion validity seemed unimpacted and could be advantageous in some contexts. The performance of the Likert response scale was stable across the conditions we manipulated, especially if SEM is used instead of raw score analysis. Still, we argue for verbally labeling all points on the scale and for non-extreme labels of endpoints.

Czech name

—

Czech description

—

Type

O - Miscellaneous

CEP classification

—

OECD FORD branch

50101 - Psychology (including human - machine relations)

Project

<a href="/en/project/GA23-06924S" target="_blank" >GA23-06924S: Response-scale format effects on the psychometric parameters of items</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů