Understanding the common inter-rater reliability measures

Lim, Sok Mui, Palenthorpe, Natasha and Rodger, Sylvia (2012) Understanding the common inter-rater reliability measures. International Journal of Therapy and Rehabilitation, 19 9: 488-496.

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads
Author Lim, Sok Mui
Palenthorpe, Natasha
Rodger, Sylvia
Title Understanding the common inter-rater reliability measures
Journal name International Journal of Therapy and Rehabilitation   Check publisher's open access policy
ISSN 1741-1645
Publication date 2012-09-06
Sub-type Article (original research)
Volume 19
Issue 9
Start page 488
End page 496
Total pages 9
Place of publication London, United Kingdom
Publisher Mark Allen Publishing
Collection year 2013
Language eng
Abstract Health and rehabilitation professionals use a range of outcome instruments to evaluate the effectiveness of their interventions. In order to be evidenced-based practitioners, we need to understand the psychometric properties of these instruments and to be able to interpret the statistics used to test their psychometric properties. This paper focuses on inter-rater reliability. Different statistical methods for computing inter-rater reliability can be classified into one of three categories: consensus estimates, consistency estimates, and measurement estimates. The common statistical methods such as Kappa, intraclass correlation and Many-Facets Rasch Model are described along with the advantages and disadvantages of each approach. For each category of estimates, one paper has been chosen from the therapy and rehabilitation literature to illustrate the use of a number of commonly utilised inter-rater reliability measures. It is hoped that this overview will provide practitioners, students and/or new researchers with a ready reference of key measurements used for determining inter-rater reliability.
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: Official 2013 Collection
School of Health and Rehabilitation Sciences Publications
Version Filter Type
Citation counts: Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Created: Mon, 08 Oct 2012, 12:41:51 EST by Professor Sylvia Rodger on behalf of School of Health & Rehabilitation Sciences