Using a novel multiple-source indicator to investigate the effect of scale format on careless and insufficient effort responding in a large-scale survey experiment
Gardado en:
| Publicado en: | Large-Scale Assessments in Education vol. 12, no. 1 (Dec 2024), p. 18 |
|---|---|
| Autor Principal: | |
| Outros autores: | , , , |
| Publicado: |
Springer Nature B.V.
|
| Materias: | |
| Acceso en liña: | Citation/Abstract Full Text - PDF |
| Etiquetas: |
Sen Etiquetas, Sexa o primeiro en etiquetar este rexistro!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3066157710 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 2196-0739 | ||
| 024 | 7 | |a 10.1186/s40536-024-00205-y |2 doi | |
| 035 | |a 3066157710 | ||
| 045 | 2 | |b d20241201 |b d20241231 | |
| 084 | |a 243836 |2 nlm | ||
| 100 | 1 | |a Ulitzsch, Esther |u University of Oslo, Centre for Educational Measurement, Oslo, Norway (GRID:grid.5510.1) (ISNI:0000 0004 1936 8921); University of Oslo, Centre for Research on Equality in Education, Oslo, Norway (GRID:grid.5510.1) (ISNI:0000 0004 1936 8921); IPN-Leibniz Institute for Science and Mathematics Education, Kiel, Germany (GRID:grid.461789.5) | |
| 245 | 1 | |a Using a novel multiple-source indicator to investigate the effect of scale format on careless and insufficient effort responding in a large-scale survey experiment | |
| 260 | |b Springer Nature B.V. |c Dec 2024 | ||
| 513 | |a Journal Article | ||
| 520 | 3 | |a Common indicator-based approaches to identifying careless and insufficient effort responding (C/IER) in survey data scan response vectors or timing data for aberrances, such as patterns signaling straight lining, multivariate outliers, or signals that respondents rushed through the administered items. Each of these approaches is susceptible to unique types of misidentifications. We developed a C/IER indicator that requires agreement on C/IER identification from multiple behavioral sources, thereby alleviating the effect of each source’s standalone C/IER misidentifications and increasing the robustness of C/IER identification. To this end, we combined a response-pattern-based multiple-hurdle approach with a recently developed screen-time-based mixture decomposition approach. In an application of the proposed multiple-source indicator to PISA 2022 field trial data we (a) showcase how the indicator hedges against (presumed) C/IER overidentification of its constituting components, (b) replicate associations with commonly reported external correlates of C/IER, namely agreement with self-reported effort and C/IER position effects, and (c) employ the indicator to study the effects of changes of scale characteristics on C/IER occurrence. To this end, we leverage a large-scale survey experiment implemented in the PISA 2022 field trial and investigate the effects of using frequency instead of agreement scales as well as approximate instead of abstract frequency scale labels. We conclude that neither scale format manipulation has the potential to curb C/IER occurrence. | |
| 653 | |a Educational tests & measurements | ||
| 653 | |a Educational evaluation | ||
| 653 | |a Disproportionate Representation | ||
| 700 | 1 | |a Buchholz, Janine |u Institute for Educational Quality Improvement (IQB), Berlin, Germany (GRID:grid.461789.5) (ISNI:0000 0001 0279 2505) | |
| 700 | 1 | |a Shin, Hyo Jeong |u Sogang University, Seoul, South Korea (GRID:grid.263736.5) (ISNI:0000 0001 0286 5954) | |
| 700 | 1 | |a Bertling, Jonas |u Educational Testing Service (ETS), Princeton, USA (GRID:grid.286674.9) (ISNI:0000 0004 1936 9051) | |
| 700 | 1 | |a Lüdtke, Oliver |u IPN-Leibniz Institute for Science and Mathematics Education, Kiel, Germany (GRID:grid.461789.5); Centre for International Student Assessment (ZIB), Munich, Germany (GRID:grid.6936.a) (ISNI:0000000123222966) | |
| 773 | 0 | |t Large-Scale Assessments in Education |g vol. 12, no. 1 (Dec 2024), p. 18 | |
| 786 | 0 | |d ProQuest |t Education Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3066157710/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3066157710/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch |