Student Practice Evaluation Form-Revised edition online comment bank: development and reliability analysis

Rodger, Sylvia, Turpin, Merrill, Copley, Jodie, Coleman, Allison, Chien, Chi-Wen, Caine, Anne-Maree and Brown, Ted (2014) Student Practice Evaluation Form-Revised edition online comment bank: development and reliability analysis. Australian Occupational Therapy Journal, Early View 1-8. doi:10.1111/1440-1630.12115

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads

Author Rodger, Sylvia
Turpin, Merrill
Copley, Jodie
Coleman, Allison
Chien, Chi-Wen
Caine, Anne-Maree
Brown, Ted
Title Student Practice Evaluation Form-Revised edition online comment bank: development and reliability analysis
Journal name Australian Occupational Therapy Journal   Check publisher's open access policy
ISSN 0045-0766
Publication date 2014-02-06
Year available 2014
Sub-type Article (original research)
DOI 10.1111/1440-1630.12115
Open Access Status
Volume Early View
Start page 1
End page 8
Total pages 8
Place of publication Richmond, VIC, Australia
Publisher Wiley-Blackwell Publishing Asia
Collection year 2015
Language eng
Formatted abstract
Background/aim The reliable evaluation of occupational therapy students completing practice education placements along with provision of appropriate feedback is critical for both students and for universities from a quality assurance perspective. This study describes the development of a comment bank for use with an online version of the Student Practice Evaluation Form-Revised Edition (SPEF-R Online) and investigates its reliability.

Methods A preliminary bank of 109 individual comments (based on previous students’ placement performance) was developed via five stages. These comments reflected all 11 SPEF-R domains. A purpose-designed online survey was used to examine the reliability of the comment bank. A total of 37 practice educators returned surveys, 31 of which were fully completed. Participants were asked to rate each individual comment using the five-point SPEF-R rating scale.

Results One hundred and two of 109 comments demonstrated satisfactory agreement with their respective default ratings that were determined by the development team. At each domain level, the intra-class correlation coefficients (ranging between 0.86 and 0.96) also demonstrated good to excellent inter-rater reliability. There were only seven items that required rewording prior to inclusion in the final SPEF-R Online comment bank.

Conclusion The development of the SPEF-R Online comment bank offers a source of reliable comments (consistent with the SPEF-R rating scale across different domains) and aims to assist practice educators in providing reliable and timely feedback to students in a user-friendly manner.
Keyword Education
Reproducibility of results
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: Official 2015 Collection
School of Health and Rehabilitation Sciences Publications
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 1 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 1 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Mon, 07 Apr 2014, 13:00:05 EST by Professor Sylvia Rodger on behalf of Occupational Therapy