Intra- and inter-rater reliability of the Assessment of Children’s Hand Skills based on video recordings

Chien, Chi-Wen, Scanlan, Clare, Rodger, Sylvia and Copley, Jodie (2014) Intra- and inter-rater reliability of the Assessment of Children’s Hand Skills based on video recordings. British Journal of Occupational Therapy, 77 2: 82-90. doi:10.4276/030802214X13916969447191

Author Chien, Chi-Wen
Scanlan, Clare
Rodger, Sylvia
Copley, Jodie
Title Intra- and inter-rater reliability of the Assessment of Children’s Hand Skills based on video recordings
Journal name British Journal of Occupational Therapy   Check publisher's open access policy
ISSN 0308-0226
Publication date 2014-01-01
Year available 2014
Sub-type Article (original research)
DOI 10.4276/030802214X13916969447191
Open Access Status Not yet assessed
Volume 77
Issue 2
Start page 82
End page 90
Total pages 9
Place of publication London, United Kingdom
Publisher College of Occupational Therapists Ltd.
Language eng
Formatted abstract
 Introduction: Hand skills are essential for children's occupational performance. The Assessment of Children's Hand Skills is a new assessment that utilizes naturalistic observations to capture children's actual hand-skill performance in everyday contexts. This study aimed to explore intra- and inter-rater reliability of the assessment based on video recordings, which are different from original naturalistic observations.

Method: Two raters scored video recordings of 54 hand-skill activities performed by 12 children with developmental disabilities, twice in 2 weeks. Intra- and interrater reliability was examined at the individual hand-skill item scores, activity scores, and children's composite scores of the Assessment of Children's Hand Skills.

Findings: Intra-rater reliability at item levels was generally acceptable, and both raters exhibited moderate to high agreement between the first and second evaluations (intraclass correlation coefficients = 0.61–0.93) at activity scores and children's composite scores. However, the agreement between the two raters was unacceptable for most hand-skill items and activity scores. After rater effects were adjusted by Rasch analysis in children's composite scores, the inter-rater reliability was improved (intraclass correlation coefficient = 0.81).

Conclusion: This study shows that the Assessment of Children's Hand Skills based on video recordings is reliable within the same raters. Further research is required to confirm its inter-rater reliability by involving more training and raters with varied clinical experience.
Keyword Reliability
Occupational therapy
Hand skills
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: Official 2015 Collection
School of Health and Rehabilitation Sciences Publications
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 1 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 3 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Sat, 01 Mar 2014, 02:54:10 EST by Professor Sylvia Rodger on behalf of School of Health & Rehabilitation Sciences