Validation of Stroke Meaningful Use Measures in a National Electronic Health Record System

Date
2016-04
Language
American English
Embargo Lift Date
Committee Members
Degree
Degree Year
Department
Grantor
Journal Title
Journal ISSN
Volume Title
Found At
Springer-Verlag
Abstract

BACKGROUND: The Meaningful Use (MU) program has increased the national emphasis on electronic measurement of hospital quality. OBJECTIVE: To evaluate stroke MU and one VHA stroke electronic clinical quality measure (eCQM) in national VHA data and determine sources of error in using centralized electronic health record (EHR) data. DESIGN: Our study is a retrospective cross-sectional study of stroke quality measure eCQMs vs. chart review in a national EHR. We developed local SQL algorithms to generate the eCQMs, then modified them to run on VHA Central Data Warehouse (CDW) data. eCQM results were generated from CDW data in 2130 ischemic stroke admissions in 11 VHA hospitals. Local and CDW results were compared to chart review. MAIN MEASURES: We calculated the raw proportion of matching cases, sensitivity/specificity, and positive/negative predictive values (PPV/NPV) for the numerators and denominators of each eCQM. To assess overall agreement for each eCQM, we calculated a weighted kappa and prevalence-adjusted bias-adjusted kappa statistic for a three-level outcome: ineligible, eligible-passed, or eligible-failed. KEY RESULTS: In five eCQMs, the proportion of matched cases between CDW and chart ranged from 95.4 %-99.7 % (denominators) and 87.7 %-97.9 % (numerators). PPVs tended to be higher (range 96.8 %-100 % in CDW) with NPVs less stable and lower. Prevalence-adjusted bias-adjusted kappas for overall agreement ranged from 0.73-0.95. Common errors included difficulty in identifying: (1) mechanical VTE prophylaxis devices, (2) hospice and other specific discharge disposition, and (3) contraindications to receiving care processes. CONCLUSIONS: Stroke MU indicators can be relatively accurately generated from existing EHR systems (nearly 90 % match to chart review), but accuracy decreases slightly in central compared to local data sources. To improve stroke MU measure accuracy, EHRs should include standardized data elements for devices, discharge disposition (including hospice and comfort care status), and recording contraindications.

Description
item.page.description.tableofcontents
item.page.relation.haspart
Cite As
Phipps, M. S., Fahner, J., Sager, D., Coffing, J., Maryfield, B., & Williams, L. S. (2016). Validation of Stroke Meaningful Use Measures in a National Electronic Health Record System. Journal of General Internal Medicine, 31(Suppl 1), 46–52. http://doi.org/10.1007/s11606-015-3562-5
ISSN
1525-1497
Publisher
Series/Report
Sponsorship
Major
Extent
Identifier
Relation
Journal
Journal of General Internal Medicine
Rights
Publisher Policy
Source
PMC
Alternative Title
Type
Article
Number
Volume
Conference Dates
Conference Host
Conference Location
Conference Name
Conference Panel
Conference Secretariat Location
Version
Final published version
This item is under embargo {{howLong}}