A simulation study of repeated covariate equating

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985807%3A_____%2F23%3A00580479" target="_blank" >RIV/67985807:_____/23:00580479 - isvavai.cz</a>

Výsledek na webu

<a href="https://eam2023.ugent.be/images/eam2023_abstracts_book.pdf" target="_blank" >https://eam2023.ugent.be/images/eam2023_abstracts_book.pdf</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

A simulation study of repeated covariate equating

Popis výsledku v původním jazyce

ZÁKLADNÍ ÚDAJE: The 10th European Congress of Methodology (EAM2023) Book of Abstracts. Ghent: Ghent University, 2023. s. 267-267. [EAM2023: European Congress of Methodology /10./. 11.07.2023-13.07.2023, Ghent]. ABSTRAKT: When performing test equating with non-equivalent groups and without an anchor test, one potential solution how to adjust for group differences is to substitute the anchor test score with covariates, such as grades or scores from another test. A key assumption for this approach is that the conditional distribution of test scores, given the covariates, is the same in all groups. In this work, we conduct a simulation study to investigate how different types of violations of the same conditional distribution assumption can affect the resulting equated scores. We consider two non-equivalent groups differing in ability. As covariates, we use two binary variables (which can, for example, refer to student’s educational status and school type) and one continuous variable referring to a score from another test. The continuous variable was generated to be correlated with the other two binary variables. In the simulations, we explore several scenarios differing in sample size and the relationship between the test score and the continuous covariate. We show that if the assumption of equal conditional distribution is not met due to the fact that the covariate itself is measured using different test forms, the accuracy of the resulting equated scores can be improved by equating the covariate before incorporating it into the primary test scores equating algorithm.

Název v anglickém jazyce

A simulation study of repeated covariate equating

Popis výsledku anglicky

ZÁKLADNÍ ÚDAJE: The 10th European Congress of Methodology (EAM2023) Book of Abstracts. Ghent: Ghent University, 2023. s. 267-267. [EAM2023: European Congress of Methodology /10./. 11.07.2023-13.07.2023, Ghent]. ABSTRAKT: When performing test equating with non-equivalent groups and without an anchor test, one potential solution how to adjust for group differences is to substitute the anchor test score with covariates, such as grades or scores from another test. A key assumption for this approach is that the conditional distribution of test scores, given the covariates, is the same in all groups. In this work, we conduct a simulation study to investigate how different types of violations of the same conditional distribution assumption can affect the resulting equated scores. We consider two non-equivalent groups differing in ability. As covariates, we use two binary variables (which can, for example, refer to student’s educational status and school type) and one continuous variable referring to a score from another test. The continuous variable was generated to be correlated with the other two binary variables. In the simulations, we explore several scenarios differing in sample size and the relationship between the test score and the continuous covariate. We show that if the assumption of equal conditional distribution is not met due to the fact that the covariate itself is measured using different test forms, the accuracy of the resulting equated scores can be improved by equating the covariate before incorporating it into the primary test scores equating algorithm.

Druh

O - Ostatní výsledky

CEP obor

—

OECD FORD obor

50301 - Education, general; including training, pedagogy, didactics [and education systems]

Projekt

Výsledek vznikl pri realizaci vícero projektů. Více informací v záložce Projekty.

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2023

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů