Practices in Data-Quality Evaluation: A Large-Scale Review of Online Survey Studies Published in 2022

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F60076658%3A12410%2F24%3A43907944" target="_blank" >RIV/60076658:12410/24:43907944 - isvavai.cz</a>

Výsledek na webu

<a href="https://journals.sagepub.com/doi/10.1177/25152459241236414" target="_blank" >https://journals.sagepub.com/doi/10.1177/25152459241236414</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1177/25152459241236414" target="_blank" >10.1177/25152459241236414</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Practices in Data-Quality Evaluation: A Large-Scale Review of Online Survey Studies Published in 2022

Popis výsledku v původním jazyce

In this study, I examine data-quality evaluation methods in online surveys and their frequency of use. Drawing from survey-methodology literature, I identified 11 distinct assessment categories and analyzed their prevalence across 3,298 articles published in 2022 from 200 psychology journals in the Web of Science Master Journal List. These English-language articles employed original data from self-administered online questionnaires. Strikingly, 55% of articles opted not to employ any data-quality evaluation, and 24% employed only one method despite the wide repertoire of methods available. The most common data-quality indicators were attention-control items (22%) and nonresponse rates (13%). Strict and unjustified nonresponse-based data-exclusion criteria were often observed. The results highlight a trend of inadequate quality control in online survey research, leaving results vulnerable to biases from automated response bots or respondents’ carelessness and fatigue. More thorough data-quality assurance is currently needed for online surveys.

Název v anglickém jazyce

Practices in Data-Quality Evaluation: A Large-Scale Review of Online Survey Studies Published in 2022

Popis výsledku anglicky

In this study, I examine data-quality evaluation methods in online surveys and their frequency of use. Drawing from survey-methodology literature, I identified 11 distinct assessment categories and analyzed their prevalence across 3,298 articles published in 2022 from 200 psychology journals in the Web of Science Master Journal List. These English-language articles employed original data from self-administered online questionnaires. Strikingly, 55% of articles opted not to employ any data-quality evaluation, and 24% employed only one method despite the wide repertoire of methods available. The most common data-quality indicators were attention-control items (22%) and nonresponse rates (13%). Strict and unjustified nonresponse-based data-exclusion criteria were often observed. The results highlight a trend of inadequate quality control in online survey research, leaving results vulnerable to biases from automated response bots or respondents’ carelessness and fatigue. More thorough data-quality assurance is currently needed for online surveys.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

50101 - Psychology (including human - machine relations)

Projekt

—

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Advances in Methods and Practices in Psychological Science

ISSN

2515-2459

e-ISSN

2515-2467

Svazek periodika

7

Číslo periodika v rámci svazku

2

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

7

Strana od-do

—

Kód UT WoS článku

001222800800001

EID výsledku v databázi Scopus

—