Performance of physician-certified verbal autopsies: Multisite validation study using clinical diagnostic gold standards

Lozano, Rafael, Lopez, Alan D., Atkinson, Charles, Naghavi, Mohsen, Flaxman, Abraham D., Murray, Christopher J. L. and for the Population Health Metrics Research Consortium (2011) Performance of physician-certified verbal autopsies: Multisite validation study using clinical diagnostic gold standards. Population Health Metrics, 9 32.1-32.13. doi:10.1186/1478-7954-9-32


Author Lozano, Rafael
Lopez, Alan D.
Atkinson, Charles
Naghavi, Mohsen
Flaxman, Abraham D.
Murray, Christopher J. L.
for the Population Health Metrics Research Consortium
Title Performance of physician-certified verbal autopsies: Multisite validation study using clinical diagnostic gold standards
Journal name Population Health Metrics   Check publisher's open access policy
ISSN 1478-7954
Publication date 2011-08-04
Sub-type Article (original research)
DOI 10.1186/1478-7954-9-32
Open Access Status DOI
Volume 9
Start page 32.1
End page 32.13
Total pages 13
Place of publication London, England, U.K.
Publisher BioMed Central
Collection year 2012
Language eng
Formatted abstract
Background: Physician review of a verbal autopsy (VA) and completion of a death certificate remains the most widely used approach for VA analysis. This study provides new evidence about the performance of physician-certified verbal autopsy (PCVA) using defined clinical diagnostic criteria as a gold standard for a multisite sample of 12,542 VAs. The study was also designed to analyze issues related to PCVA, such as the impact of a second physician reader on the cause of death assigned, the variation in performance with and without household recall of health care experience (HCE), and the importance of local information for physicians reading VAs.

Methods: The certification was performed by 24 physicians. The assignment of VA was random and blinded. Each VA was certified by one physician. Half of the VAs were reviewed by a different physician with household recall of health care experience included. The completed death certificate was processed for automated ICD-10 coding of the underlying cause of death. PCVA was compared to gold standard cause of death assignment based on strictly defined clinical diagnostic criteria that are part of the Population Health Metrics Research Consortium (PHMRC) gold standard verbal autopsy study.

Results: For individual cause assignment, the overall chance-corrected concordance for PCVA against the gold standard cause of death is less than 50%, with substantial variability by cause and physician. Physicians assign the correct cause around 30% of the time without HCE, and addition of HCE improves performance in adults to 45% and slightly higher in children to 48%. Physicians estimate cause-specific mortality fractions (CSMFs) with considerable error for adults, children, and neonates. Only for neonates for a cause list of six causes with HCE is accuracy above 0.7. In all three age groups, CSMF accuracy improves when household recall of health care experience is available.

Conclusions: Results show that physician coding for cause of death assignment may not be as robust as previously thought. The time and cost required to initially collect the verbal autopsies must be considered in addition to the analysis, as well as the impact of diverting physicians from servicing immediate health needs in a population to review VAs. All of these considerations highlight the importance and urgency of developing better methods to more reliably analyze past and future verbal autopsies to obtain the highest quality mortality data from populations without reliable death certification.
Keyword Cause of death
Validation
Verbal Autopsy
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ
Additional Notes Article #32

Document type: Journal Article
Sub-type: Article (original research)
Collections: Official 2012 Collection
School of Public Health Publications
 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 40 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 12 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Fri, 16 Mar 2012, 12:43:54 EST by Geraldine Fitzgerald on behalf of School of Public Health