Mobile app rating scale: A new tool for assessing the quality of health mobile apps

Stoyanov, Stoyan R., Hides, Leanne, Kavanagh, David J., Zelenko, Oksana, Tjondronegoro, Dian and Mani, Madhavan (2015) Mobile app rating scale: A new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth, 3 1: e27. doi:10.2196/mhealth.3422

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads
UQ491017_OA.pdf Full text (open access) application/pdf 545.35KB 0

Author Stoyanov, Stoyan R.
Hides, Leanne
Kavanagh, David J.
Zelenko, Oksana
Tjondronegoro, Dian
Mani, Madhavan
Title Mobile app rating scale: A new tool for assessing the quality of health mobile apps
Journal name JMIR mHealth and uHealth   Check publisher's open access policy
ISSN 2291-5222
Publication date 2015-01-01
Year available 2015
Sub-type Article (original research)
DOI 10.2196/mhealth.3422
Open Access Status DOI
Volume 3
Issue 1
Start page e27
Total pages 9
Place of publication Toronto, ON, Canada
Publisher J M I R Publications
Language eng
Abstract The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond "star"-ratings.

The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps.

A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability.

There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79).

The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.
Formatted abstract
Background: The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond “star”-ratings.

Objective: The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps.

Methods: A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability.

Results: There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79).

Conclusions: The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.
Keyword Well being
Mental health
e-health
Mobile health (mhealth)
Mobile application
Assessment
Q-Index Code C1
Q-Index Status Provisional Code
Institutional Status Non-UQ

Document type: Journal Article
Sub-type: Article (original research)
Collection: School of Psychology Publications
 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 74 times in Thomson Reuters Web of Science Article | Citations
Google Scholar Search Google Scholar
Created: Sat, 04 Mar 2017, 01:00:43 EST by Web Cron on behalf of Learning and Research Services (UQ Library)