Measuring agreement between decision support reminders: the cloud vs. the local expert

dc.contributor.authorDixon, Brian Edward
dc.contributor.authorSimonaitis, Linas
dc.contributor.authorPerkins, Susan M.
dc.contributor.authorWright, Adam
dc.contributor.authorMiddleton, Blackford
dc.contributor.departmentBiomedical Engineering and Informatics, Luddy School of Informatics, Computing, and Engineering
dc.date.accessioned2025-04-11T15:13:59Z
dc.date.available2025-04-11T15:13:59Z
dc.date.issued2014-04-10
dc.description.abstractBackground: A cloud-based clinical decision support system (CDSS) was implemented to remotely provide evidence-based guideline reminders in support of preventative health. Following implementation, we measured the agreement between preventive care reminders generated by an existing, local CDSS and the new, cloud-based CDSS operating on the same patient visit data. Methods: Electronic health record data for the same set of patients seen in primary care were sent to both the cloud-based web service and local CDSS. The clinical reminders returned by both services were captured for analysis. Cohen's Kappa coefficient was calculated to compare the two sets of reminders. Kappa statistics were further adjusted for prevalence and bias due to the potential effects of bias in the CDS logic and prevalence in the relative small sample of patients. Results: The cloud-based CDSS generated 965 clinical reminders for 405 patient visits over 3 months. The local CDSS returned 889 reminders for the same patient visit data. When adjusted for prevalence and bias, observed agreement varied by reminder from 0.33 (95% CI 0.24 - 0.42) to 0.99 (95% CI 0.97 - 1.00) and demonstrated almost perfect agreement for 7 of the 11 reminders. Conclusions: Preventive care reminders delivered by two disparate CDS systems show substantial agreement. Subtle differences in rule logic and terminology mapping appear to account for much of the discordance. Cloud-based CDSS therefore show promise, opening the door for future development and implementation in support of health care providers with limited resources for knowledge management of complex logic and rules.
dc.eprint.versionFinal published version
dc.identifier.citationDixon BE, Simonaitis L, Perkins SM, Wright A, Middleton B. Measuring agreement between decision support reminders: the cloud vs. the local expert. BMC Med Inform Decis Mak. 2014;14:31. Published 2014 Apr 10. doi:10.1186/1472-6947-14-31
dc.identifier.urihttps://hdl.handle.net/1805/46991
dc.language.isoen_US
dc.publisherSpringer Nature
dc.relation.isversionof10.1186/1472-6947-14-31
dc.relation.journalBMC Medical Informatics and Decision Making
dc.rightsAttribution 4.0 Internationalen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/
dc.sourcePMC
dc.subjectDecision support systems
dc.subjectClinical decision making
dc.subjectComputer-assisted knowledge management
dc.subjectStatistical data analysis
dc.subjectPreventive health services
dc.titleMeasuring agreement between decision support reminders: the cloud vs. the local expert
dc.typeArticle
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Dixon2014Measuring-CCBY.pdf
Size:
218.77 KB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.04 KB
Format:
Item-specific license agreed upon to submission
Description: