A portrait of evaluation studies of learning technology innovations 2005-2010: Addressing the elephant in the room

Steel, Caroline and Gunn, Cathy (2011). A portrait of evaluation studies of learning technology innovations 2005-2010: Addressing the elephant in the room. In: G. Williams, P. Statham, N. Brown and B. Cleland, Proceedings of ascilite 2011. ascilite 2011, Hobart, Australia, (1178-1183). 4-7 December 2011.

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads
Author Steel, Caroline
Gunn, Cathy
Title of paper A portrait of evaluation studies of learning technology innovations 2005-2010: Addressing the elephant in the room
Conference name ascilite 2011
Conference location Hobart, Australia
Conference dates 4-7 December 2011
Convener Gary Williams and Peta Statham
Proceedings title Proceedings of ascilite 2011
Journal name ASCILITE 2011 - The Australasian Society for Computers in Learning in Tertiary Education
Place of Publication Hobart, Australia
Publisher The University of Tasmania
Publication Year 2011
Sub-type Fully published paper
ISBN 9781862956445
Editor G. Williams
P. Statham
N. Brown
B. Cleland
Start page 1178
End page 1183
Total pages 6
Collection year 2012
Language eng
Abstract/Summary Much effort has gone into the development of evaluation methods for learning technology. Yet the mantra remains the same; that studies fail to produce reliable evidence to answer important questions about the impact of technology on student learning and behaviour. The authors conducted a meta-analysis of 100 evaluation studies published in two leading learning technology journals from 2005 – 2010. A set of thirteen criteria to critique the articles was derived from the principles of educational design research. This paper discusses findings concerned with the extent to which studies are a) theoretically grounded, b) show evidence of impact on student learning and behaviour and c) potentially transferable to other higher education contexts. The findings resonate with comments in a recent report on Learning with Technology (ALT 2010) that ‗research typically doesn‘t address the problem of building an ecology of learning, or treat integration of the innovation as a research issue‘ (p.5). The authors are keen to discuss ways to improve the quality of evaluation studies in learning technology for the future. Some recommendations are proposed to stimulate discussion and feedback.
Keyword Evaluation studies
Research design
Evidence
Impact
Q-Index Code E1
Q-Index Status Confirmed Code
Institutional Status UQ
Additional Notes Conference theme: Changing demands, changing directions

Document type: Conference Paper
Collections: Official 2012 Collection
School of Languages and Cultures Publications
 
Versions
Version Filter Type
Citation counts: Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Created: Tue, 13 Dec 2011, 10:26:36 EST by Dr Caroline Steel on behalf of School of Languages and Cultures