Validity and reliability of dermoscopic criteria used to differentiate nevi from melanoma aweb-based international dermoscopy society study

Carrera, Cristina, Marchetti, Michael A., Dusza, Stephen W., Argenziano, Giuseppe, Braun, Ralph P., Halpern, Allan C., Jaimes, Natalia, Kittler, Harald J., Malvehy, Josep, Menzies, Scott W., Pellacani, Giovanni, Puig, Susana, Rabinovitz, Harold S., Scope, Alon, Soyer, H. Peter, Stolz, Wilhelm, Hofmann-Wellenhof, Rainer, Zalaudek, Iris and Marghoob, Ashfaq A. (2016) Validity and reliability of dermoscopic criteria used to differentiate nevi from melanoma aweb-based international dermoscopy society study. JAMA Dermatology, 152 7: 798-806. doi:10.1001/jamadermatol.2016.0624

Author Carrera, Cristina
Marchetti, Michael A.
Dusza, Stephen W.
Argenziano, Giuseppe
Braun, Ralph P.
Halpern, Allan C.
Jaimes, Natalia
Kittler, Harald J.
Malvehy, Josep
Menzies, Scott W.
Pellacani, Giovanni
Puig, Susana
Rabinovitz, Harold S.
Scope, Alon
Soyer, H. Peter
Stolz, Wilhelm
Hofmann-Wellenhof, Rainer
Zalaudek, Iris
Marghoob, Ashfaq A.
Title Validity and reliability of dermoscopic criteria used to differentiate nevi from melanoma aweb-based international dermoscopy society study
Journal name JAMA Dermatology   Check publisher's open access policy
ISSN 2168-6068
Publication date 2016-07-01
Sub-type Article (original research)
DOI 10.1001/jamadermatol.2016.0624
Open Access Status Not yet assessed
Volume 152
Issue 7
Start page 798
End page 806
Total pages 9
Place of publication Chicago, IL, United States
Publisher American Medical Association
Collection year 2017
Language eng
Subject 2708 Dermatology
Formatted abstract
Importance: The comparative diagnostic performance of dermoscopic algorithms and their individual criteria are not well studied.

Objectives: To analyze the discriminatory power and reliability of dermoscopic criteria used in melanoma detection and compare the diagnostic accuracy of existing algorithms.

Design, Setting, and Participants: Thiswas a retrospective, observational study of 477 lesions (119 melanomas [24.9%] and 358 nevi [75.1%]), which were divided into 12 image sets that consisted of 39 or 40 images per set. A link on the International Dermoscopy Society website from January 1, 2011, through December 31, 2011, directed participants to the study website. Data analysis was performed from June 1, 2013, through May 31, 2015. Participants included physicians, residents, and medical students, and there were no specialty-Type or experience-level restrictions. Participants were randomly assigned to evaluate 1 of the 12 image sets.

Main Outcomes and Measure:
Associations with melanoma and intraclass correlation coefficients (ICCs) were evaluated for the presence of dermoscopic criteria. Diagnostic accuracy measures were estimated for the following algorithms: The ABCD rule, the Menzies method, the 7-point checklist, the 3-point checklist, chaos and clues, and CASH (color, architecture, symmetry, and homogeneity).

Results: A total of 240 participants registered, and 103 (42.9%) evaluated all images. The 110 participants (45.8%) who evaluated fewer than 20 lesions were excluded, resulting in data from 130 participants (54.2%), 121 (93.1%) of whom were regular dermoscopy users. Criteria associated with melanoma included marked architectural disorder (odds ratio [OR], 6.6; 95%CI, 5.6-7.8), pattern asymmetry (OR, 4.9; 95%CI, 4.1-5.8), nonorganized pattern (OR, 3.3; 95%CI, 2.9-3.7), border score of 6 (OR, 3.3; 95%CI, 2.5-4.3), and contour asymmetry (OR, 3.2; 95%CI, 2.7-3.7) (P < .001 for all). Most dermoscopic criteria had poor to fair interobserver agreement. Criteria that reached moderate levels of agreement included comma vessels (ICC, 0.44; 95%CI, 0.40-0.49), absence of vessels (ICC, 0.46; 95%CI, 0.42-0.51), dark brown color (ICC, 0.40; 95%CI, 0.35-0.44), and architectural disorder (ICC, 0.43; 95%CI, 0.39-0.48). The Menziesmethod had the highest sensitivity for melanoma diagnosis (95.1%) but the lowest specificity (24.8%) compared with any other method (P < .001). The ABCD rule had the highest specificity (59.4%). All methods had similar areas under the receiver operating characteristic curves.

Conclusions and Relevance:
Important dermoscopic criteria for melanoma recognition were revalidated by participants with varied experience. Six algorithms tested had similar but modest levels of diagnostic accuracy, and the interobserver agreement of most individual criteria was poor.
Q-Index Code C1
Q-Index Status Provisional Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: HERDC Pre-Audit
Admin Only - School of Medicine
School of Medicine Publications
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 0 times in Thomson Reuters Web of Science Article
Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Created: Sun, 07 Aug 2016, 00:34:03 EST by System User on behalf of Learning and Research Services (UQ Library)