Evaluation of diagnostic tools that tertiary teachers can apply to profile their students’ conceptions

Schultz, Madeleine , Lawrie, Gwendolyn A., Bailey, Chantal H. , Bedford, Simon B. , Dargaville, Tim R. , O'Brien, Glennys , Tasker, Roy , Thompson, Christopher D. , Williams, Mark and Wright, Anthony H. (2017) Evaluation of diagnostic tools that tertiary teachers can apply to profile their students’ conceptions. International Journal of Science Education, 1-22. doi:10.1080/09500693.2017.1296980


Author Schultz, Madeleine
Lawrie, Gwendolyn A.
Bailey, Chantal H.
Bedford, Simon B.
Dargaville, Tim R.
O'Brien, Glennys
Tasker, Roy
Thompson, Christopher D.
Williams, Mark
Wright, Anthony H.
Title Evaluation of diagnostic tools that tertiary teachers can apply to profile their students’ conceptions
Journal name International Journal of Science Education   Check publisher's open access policy
ISSN 1464-5289
0950-0693
Publication date 2017-03-21
Sub-type Article (original research)
DOI 10.1080/09500693.2017.1296980
Open Access Status Not yet assessed
Start page 1
End page 22
Total pages 22
Place of publication Abingdon, Oxon, United Kingdom
Publisher Routledge
Collection year 2018
Language eng
Abstract A multi-institution collaborative team of Australian chemistry education researchers, teaching a total of over 3000 first year chemistry students annually, has explored a tool for diagnosing students' prior conceptions as they enter tertiary chemistry courses. Five core topics were selected and clusters of diagnostic items were assembled linking related concepts in each topic together. An ordered multiple choice assessment strategy was adopted to enable provision of formative feedback to students through combination of the specific distractors that they chose. Concept items were either sourced from existing research instruments or developed by the project team. The outcome is a diagnostic tool consisting of five topic clusters of five concept items that has been delivered in large introductory chemistry classes at five Australian institutions. Statistical analysis of data has enabled exploration of the composition and validity of the instrument including a comparison between delivery of the complete 25 item instrument with subsets of five items, clustered by topic. This analysis revealed that most items retained their validity when delivered in small clusters. Tensions between the assembly, validation and delivery of diagnostic instruments for the purposes of acquiring robust psychometric research data versus their pragmatic use are considered in this study.
Keyword Concept diagnostic instrument
General chemistry
Ordered multiple choice
Psychometric analysis
Q-Index Code C1
Q-Index Status Provisional Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: HERDC Pre-Audit
School of Chemistry and Molecular Biosciences
School of Education Publications
 
Versions
Version Filter Type
Citation counts: Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Created: Fri, 07 Apr 2017, 11:49:18 EST by Mrs Louise Nimwegen on behalf of School of Chemistry & Molecular Biosciences