Enhancing feedback provision and use through in situ audio commenting

Colthorpe, K. L., Zimbardi, K., Dekker, A., Hay, P., Engstrom, C., Bugarcic, A., Long, P., Lluka, L. J., Chunduri, P., Worthy, P. and Marrington, J. (2013). Enhancing feedback provision and use through in situ audio commenting. In: Proceedings of the International Union of Physiological Societies 37th Congress. IUPS 2013: International Union of Physiological Societies XXXVII Congress, Birmingham, UK, (310P-310P). 21-26 July, 2013.

Author Colthorpe, K. L.
Zimbardi, K.
Dekker, A.
Hay, P.
Engstrom, C.
Bugarcic, A.
Long, P.
Lluka, L. J.
Chunduri, P.
Worthy, P.
Marrington, J.
Title of paper Enhancing feedback provision and use through in situ audio commenting
Formatted title
Enhancing feedback provision and use through in situ audio commenting
Conference name IUPS 2013: International Union of Physiological Societies XXXVII Congress
Conference location Birmingham, UK
Conference dates 21-26 July, 2013
Proceedings title Proceedings of the International Union of Physiological Societies 37th Congress
Journal name Proceedings of The Physiological Society
Place of Publication Oxford, UK
Publisher London Physiological Society
Publication Year 2013
Sub-type Published abstract
ISSN 1749-6187
Start page 310P
End page 310P
Total pages 1
Language eng
Formatted Abstract/Summary
Assessment reforms in higher education recognize the need for effective feedback that is timely, informative, and encourages positive attitudes towards future learning amongst students. Although it is well established that feedback to students is one of the educational practices with large positive impacts on student learning, evaluating the actual extent to which students engage with and utilize feedback is difficult. Studies show that when students do receive feedback it is often too brief, too broadly stated, and is often misinterpreted by students. Recent studies have suggested that students find audio feedback more engaging and informative than traditional written feedback, and prefer either audio or a combination of text and audio to text alone.

During this study, we have developed a ‘rich media' marking system, to help markers provide students with timely, detailed and situated feedback, and to investigate the potential of technology to facilitate new methods of feedback provision, such as in situ audio comments. The system can support large cohorts of students, large teams of markers, moderation of markers, and provides learning analytics during the feedback process. It consists of three components: 1) Administration interface that processes submissions for marking and moderation, 2) iPad application that allows markers to provide feedback as audio, handwritten and typed annotations, and to grade using criteria rubrics, and 3) Feedback viewer allowing students to view their feedback on any web browser. In addition, the in-built learning analytics allows for extensive evaluation of the provision and use of feedback, providing empirical evidence of both marker and student behaviors. To date, the system has been trialled on 852 student assignments in two separate trials, the first based on a final student laboratory report, and the second on a draft of a scientific literature review.

Preliminary analysis of the learning analytics data indicates extensive provision of feedback by markers and use of the in-situ feedback by students. However, it also revealed differences in the ways in which markers use the annotation modalities, with almost half avoiding use of audio annotations whilst the remainder used audio annotations extensively. Differences were also found in student use of feedback, with students in the second trial viewing their feedback for considerably longer time periods than the first, suggesting there was an effect of timeliness of feedback provision. For audio feedback specifically, students reported in interviews that they (i) favoured audio feedback for its greater detail and personalized nature; (ii) valued contextualized, in-situ feedback; and (iii) were concerned if audio comments were too long or lacked meaning. These findings are currently being used to target professional development for markers and to enhance the provision of quality feedback.
Q-Index Code EX
Q-Index Status Provisional Code
Institutional Status UQ
Additional Notes Published as Poster Communications #PCA165

 
Versions
Version Filter Type
Citation counts: Google Scholar Search Google Scholar
Created: Fri, 31 Jan 2014, 16:55:51 EST by Dr Kirsten Zimbardi on behalf of School of Biomedical Sciences