Estimating and Reporting on the Quality of Inpatient Stroke Care by Veterans Health Administration Medical Centers

Abstract

Background—Reporting of quality indicators (QIs) in Veterans Health Administration Medical Centers is complicated by estimation error caused by small numbers of eligible patients per facility. We applied multilevel modeling and empirical Bayes (EB) estimation in addressing this issue in performance reporting of stroke care quality in the Medical Centers.

Methods and Results—We studied a retrospective cohort of 3812 veterans admitted to 106 Medical Centers with ischemic stroke during fiscal year 2007. The median number of study patients per facility was 34 (range, 12–105). Inpatient stroke care quality was measured with 13 evidence-based QIs. Eligible patients could either pass or fail each indicator. Multilevel modeling of a patient's pass/fail on individual QIs was used to produce facility-level EB-estimated QI pass rates and confidence intervals. The EB estimation reduced interfacility variation in QI rates. Small facilities and those with exceptionally high or low rates were most affected. We recommended 8 of the 13 QIs for performance reporting: dysphagia screening, National Institutes of Health Stroke Scale documentation, early ambulation, fall risk assessment, pressure ulcer risk assessment, Functional Independence Measure documentation, lipid management, and deep vein thrombosis prophylaxis. These QIs displayed sufficient variation across facilities, had room for improvement, and identified sites with performance that was significantly above or below the population average. The remaining 5 QIs were not recommended because of too few eligible patients or high pass rates with little variation.

Conclusions—Considerations of statistical uncertainty should inform the choice of QIs and their application to performance reporting.