Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
Guardat en:
| Publicat a: | International Journal of Assessment Tools in Education vol. 12, no. 3 (2025), p. 681 |
|---|---|
| Autor principal: | |
| Altres autors: | |
| Publicat: |
International Journal of Assessment Tools in Education
|
| Matèries: | |
| Accés en línia: | Citation/Abstract Full text outside of ProQuest |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|
| Resum: | Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis. |
|---|---|
| Font: | ERIC |