The discrepancy between manifest response on a Likerttype scale and the most fixated response option as an indicator of social-desirable responding

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14230%2F24%3A00139619" target="_blank" >RIV/00216224:14230/24:00139619 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.commsmultilingual.com/conferences-events-us-uk/international-test-commission-itc-conference-2024-granada-spain-july-2-5-2024-working-together-to-improve-cross-cultural-assessment-and-research/" target="_blank" >https://www.commsmultilingual.com/conferences-events-us-uk/international-test-commission-itc-conference-2024-granada-spain-july-2-5-2024-working-together-to-improve-cross-cultural-assessment-and-research/</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

The discrepancy between manifest response on a Likerttype scale and the most fixated response option as an indicator of social-desirable responding

Popis výsledku v původním jazyce

Eye-tracking studies have been showing that gaze fixations are a useful source of information about cognitive processing of questionnaire items. We analyzed an existing dataset (Jakubek &amp; Krafčíková, 2016) comparing observed responses with responses derived from eye-tracking (ET) data. We derived 2 ET responses: the most fixated option (ET response) and a weighted mean of fixated options (weighted ET response). The dataset comprised responses to Slovak version of NEO-FFI with 5-point Likert-type response scales administered to 50 university students. The inventory was administered twice in random order; in one condition the participants were instructed to respond honestly and in the other fake good. In planned analyses of the honest-condition responses we found a high level of agreement between the observed responses and the ET responses; the overall agreement was 86%. The observed scale scores correlated with the scores based on weighted ET responses from .92 to .97. The weighted ET scores have slightly smaller variances than manifest scores and their popularities are slightly and systematically different. The fit and parameters of unidimensional CFA models did not systematically differ between observed and weighted ET responses. Additionally, post-hoc analyses suggested that the discrepancies between observed and weighted ET responses were in the direction of social desirability and that the discrepancies correlate highly with the popularity of items in the fake-good condition. We discuss whether the discrepancies represent social-desirable editing during the response phase of responding as conceptualized by Tourangeau et al. (2000) or are an artefact of boundedness of the response scale. These findings are based on a limited sample not allowing us to fit multidimensional models. Data were originally collected for other purposes and contain limited ET information. The agreement of observed and ET responses is somewhat inflated by the use of mouse for responding.

Název v anglickém jazyce

The discrepancy between manifest response on a Likerttype scale and the most fixated response option as an indicator of social-desirable responding

Popis výsledku anglicky

Eye-tracking studies have been showing that gaze fixations are a useful source of information about cognitive processing of questionnaire items. We analyzed an existing dataset (Jakubek &amp; Krafčíková, 2016) comparing observed responses with responses derived from eye-tracking (ET) data. We derived 2 ET responses: the most fixated option (ET response) and a weighted mean of fixated options (weighted ET response). The dataset comprised responses to Slovak version of NEO-FFI with 5-point Likert-type response scales administered to 50 university students. The inventory was administered twice in random order; in one condition the participants were instructed to respond honestly and in the other fake good. In planned analyses of the honest-condition responses we found a high level of agreement between the observed responses and the ET responses; the overall agreement was 86%. The observed scale scores correlated with the scores based on weighted ET responses from .92 to .97. The weighted ET scores have slightly smaller variances than manifest scores and their popularities are slightly and systematically different. The fit and parameters of unidimensional CFA models did not systematically differ between observed and weighted ET responses. Additionally, post-hoc analyses suggested that the discrepancies between observed and weighted ET responses were in the direction of social desirability and that the discrepancies correlate highly with the popularity of items in the fake-good condition. We discuss whether the discrepancies represent social-desirable editing during the response phase of responding as conceptualized by Tourangeau et al. (2000) or are an artefact of boundedness of the response scale. These findings are based on a limited sample not allowing us to fit multidimensional models. Data were originally collected for other purposes and contain limited ET information. The agreement of observed and ET responses is somewhat inflated by the use of mouse for responding.

Druh

O - Ostatní výsledky

CEP obor

—

OECD FORD obor

50101 - Psychology (including human - machine relations)

Projekt

<a href="/cs/project/GA23-06924S" target="_blank" >GA23-06924S: Vliv formátu odpověďové stupnice na psychometrické parametry položek</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů