Combining cognitive theory and data driven approaches to examine students’ search behaviors in simulated digital environments

I tiakina i:
Ngā taipitopito rārangi puna kōrero
I whakaputaina i:Large-Scale Assessments in Education vol. 11, no. 1 (Dec 2023), p. 28
Kaituhi matua: Tenison, Caitlin
Ētahi atu kaituhi: Sparks, Jesse R.
I whakaputaina:
Springer Nature B.V.
Ngā marau:
Urunga tuihono:Citation/Abstract
Full Text - PDF
Ngā Tūtohu: Tāpirihia he Tūtohu
Kāore He Tūtohu, Me noho koe te mea tuatahi ki te tūtohu i tēnei pūkete!

MARC

LEADER 00000nab a2200000uu 4500
001 2841213063
003 UK-CbPIL
022 |a 2196-0739 
024 7 |a 10.1186/s40536-023-00164-w  |2 doi 
035 |a 2841213063 
045 2 |b d20231201  |b d20231231 
084 |a 243836  |2 nlm 
100 1 |a Tenison, Caitlin  |u Educational Testing Service, Princeton, USA (GRID:grid.286674.9) (ISNI:0000 0004 1936 9051) 
245 1 |a Combining cognitive theory and data driven approaches to examine students’ search behaviors in simulated digital environments 
260 |b Springer Nature B.V.  |c Dec 2023 
513 |a Journal Article 
520 3 |a BackgroundDigital Information Literacy (DIL) refers to the ability to obtain, understand, evaluate, and use information in digital contexts. To accurately capture various dimensions of DIL, assessment designers have increasingly looked toward complex, interactive simulation-based environments that afford more authentic learner performances. These rich assessment environments can capture process data produced by students’ goal driven interactions with digital sources but linking this data to inferences about the target constructs introduces significant measurement challenges which cognitive theory can help us address.MethodsIn this paper, we analyzed data generated from a simulated web search tool embedded within a theoretically-grounded virtual world assessment of multiple-source inquiry skills. We describe a multi-step clustering approach to identify patterns in student’s search processes by bringing together theory-informed process data indicators and sequence clustering methods.ResultsWe identified four distinct search behaviors captured in students’ process data. We found that these search behaviors differed both in their contribution to the web search tool subscores as well as correlations with task level multiple-source inquiry subconstructs such as locating, evaluating, and synthesizing information. We argue that the search behaviors reflect differences in how students generate and update their task goals.ConclusionThe data-driven approach we describe affords a qualitative understanding of student strategy use in a complex, dynamic simulation- and scenario-based environment. We discuss some of the strengths and challenges of using a theoretical understanding of multiple-source inquiry to inform how we processed, analyzed, and interpreted the data produced from this assessment tool and the implications of this approach for future research and development. 
653 |a Data processing 
653 |a Students 
653 |a Information literacy 
653 |a Educational evaluation 
653 |a Cognition & reasoning 
653 |a Epistemology 
653 |a Research and Development 
653 |a Inferences 
700 1 |a Sparks, Jesse R.  |u Educational Testing Service, Princeton, USA (GRID:grid.286674.9) (ISNI:0000 0004 1936 9051) 
773 0 |t Large-Scale Assessments in Education  |g vol. 11, no. 1 (Dec 2023), p. 28 
786 0 |d ProQuest  |t Education Database 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/2841213063/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch 
856 4 0 |3 Full Text - PDF  |u https://www.proquest.com/docview/2841213063/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch