IU Indianapolis ScholarWorks :: Browsing by Author "Saleem, Jason J."

Browsing by Author "Saleem, Jason J."

Now showing 1 - 10 of 12

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation
(Oxford University Press, 2014-10) Russ, Alissa L.; Zillich, Alan J.; Melton, Brittany L.; Russell, Scott A.; Chen, Siying; Spina, Jeffrey R.; Weiner, Michael; Johnson, Elizabette G.; Daggy, Joanne K.; McAnas, M. Sue; Hawsey, Jason M.; Puleo, Anthony G.; Doebbeling, Bradley N.; Saleem, Jason J.; Medicine Faculty Volunteers, IU School of Medicine
OBJECTIVE: To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND METHODS: We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. RESULTS: Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. CONCLUSIONS: This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes.
Clinician Perspectives on Unmet Needs for Mobile Technology Among Hospitalists:Workflow Analysis Based on Semistructured Interviews
(JMIR Publications, 2022) Savoy, April; Saleem, Jason J.; Barker, Barry C.; Patel, Himalaya; Kara, Areeba
Background: The hospitalist workday is cognitively demanding and dominated by activities away from patients’ bedsides. Although mobile technologies are offered as solutions, clinicians report lower expectations of mobile technology after actual use. Objective: The purpose of this study is to better understand opportunities for integrating mobile technology and apps into hospitalists’ workflows. We aim to identify difficult tasks and contextual factors that introduce inefficiencies and characterize hospitalists’ perspectives on mobile technology and apps. Methods: We conducted a workflow analysis based on semistructured interviews. At a Midwestern US medical center, we recruited physicians and nurse practitioners from hospitalist and inpatient teaching teams and internal medicine residents. Interviews focused on tasks perceived as frequent, redundant, and difficult. Additionally, participants were asked to describe opportunities for mobile technology interventions. We analyzed contributing factors, impacted workflows, and mobile app ideas. Results: Over 3 months, we interviewed 12 hospitalists. Participants collectively identified chart reviews, orders, and documentation as the most frequent, redundant, and difficult tasks. Based on those tasks, the intake, discharge, and rounding workflows were characterized as difficult and inefficient. The difficulty was associated with a lack of access to electronic health records at the bedside. Contributing factors for inefficiencies were poor usability and inconsistent availability of health information technology combined with organizational policies. Participants thought mobile apps designed to improve team communications would be most beneficial. Based on our analysis, mobile apps focused on data entry and presentation supporting specific tasks should also be prioritized. Conclusions: Based on our results, there are prioritized opportunities for mobile technology to decrease difficulty and increase the efficiency of hospitalists’workflows. Mobile technology and task-specific mobile apps with enhanced usability could decrease overreliance on hospitalists’ memory and fragmentation of clinical tasks across locations. This study informs the design and implementation processes of future health information technologies to improve continuity in hospital-based medicine.
A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation
(Elsevier, 2018-09) Savoy, April; Militello, Laura G.; Patel, Himalaya; Flanagan, Mindy E.; Russ, Alissa L.; Daggy, Joanne K.; Weiner, Michael; Saleem, Jason J.; Biostatistics, School of Public Health
Background During medical referrals, communication barriers between referring and consulting outpatient clinics delay patients’ access to health care. One notable opportunity for reducing these barriers is improved usefulness and usability of electronic medical consultation order forms. The cognitive systems engineering (CSE) design approach focuses on supporting humans in managing cognitive complexity in sociotechnical systems. Cognitive complexity includes communication, decision-making, problem solving, and planning. Objective The objective of this research was to implement a CSE design approach to develop a template that supports the cognitive needs of referring clinicians and improves referral communication. Methods We conducted interviews and observations with primary care providers and specialists at two major tertiary, urban medical facilities. Using qualitative analysis, we identified cognitive requirements and design guidelines. Next, we designed user interface (UI) prototypes and compared their usability with that of a currently implemented UI at a major Midwestern medical facility. Results Physicians’ cognitive challenges were summarized in four cognitive requirements and 13 design guidelines. As a result, two UI prototypes were developed to support order template search and completion. To compare UIs, 30 clinicians (referrers) participated in a consultation ordering simulation complemented with the think-aloud elicitation method. Oral comments about the UIs were coded for both content and valence (i.e., positive, neutral, or negative). Across 619 comments, the odds ratio for the UI prototype to elicit higher-valenced comments than the implemented UI was 13.5 (95% CI = [9.2, 19.8]), p < .001. Conclusion This study reinforced the significance of applying a CSE design approach to inform the design of health information technology. In addition, knowledge elicitation methods enabled identification of physicians’ cognitive requirements and challenges when completing electronic medical consultation orders. The resultant knowledge was used to derive design guidelines and UI prototypes that were more useful and usable for referring physicians. Our results support the implementation of a CSE design approach for electronic medical consultation orders.
Development of a Workflow Integration Survey (WIS) for Implementing Computerized Clinical Decision Support
(2011-10) Flanagan, Mindy; Arbuckle, Nicole; Saleem, Jason J.; Militello, Laura G.; Haggstrom, David A.; Doebbeling, Bradley N.
Interventions that focus on improving computerized clinical decision support (CDS) demonstrate that successful workflow integration can increase the adoption and use of CDS. However, metrics for assessing workflow integration in clinical settings are not well established. The goal of this study was to develop and validate a survey to assess the extent to which CDS is integrated into workflow. Qualitative data on CDS design, usability, and integration from four sites was collected by direct observation, interviews, and focus groups. Thematic analysis based on the sociotechnical systems theory revealed consistent themes across sites. Themes related to workflow integration included navigation, functionality, usability, and workload. Based on these themes, a brief 12-item scale to assess workflow integration was developed, refined, and validated with providers in a simulation study. To our knowledge, this is one of the first tools developed to specifically measure workflow integration of CDS.
Efficiency Strategies for Facilitating Computerized Clinical Documentation in Ambulatory Care
(2013) Saleem, Jason J.; Adams, Stephanie; Frankel, Richard M.; Doebbeling, Bradley N.; Patterson, Emily S.
Most providers have experienced increased documentation demands with the use of electronic health records (EHRs). We sought to identify efficiency strategies that providers use to complete clinical documentation tasks in ambulatory care. Two observers performed ethnographic observations and interviews with 22 ambulatory care providers in a U.S. Veterans Affairs Medical Center. Observation notes and interview transcripts were coded for recurrent strategies relating to completion of the EHR progress notes. Findings included: the use of paper artifacts for handwritten notations; electronic templates for automation of certain parts of the note; use of shorthand and phrases rather than narrative writing; copying and pasting from previous EHR notes; directly entering information into the EHR note during the patient encounter; reliance on memory; and pre-populating an EHR note prior to seeing the patient. We discuss the findings in the context of distributed cognition to understand how clinical information is propagated and represented toward completion of a progress note. The study findings have important implications for improving and streamlining clinical documentation related to human factors workload management strategies.
Evaluating a Modular Decision Support Application For Colorectal Cancer Screening
(Schattauer, 2017-02-15) Militello, Laura G.; Diiulio, Julie B.; Borders, Morgan R.; Sushereba, Christen E.; Saleem, Jason J.; Haverkamp, Donald; Imperiale, Thomas F.; Medicine, School of Medicine
BACKGROUND: There is a need for health information technology evaluation that goes beyond randomized controlled trials to include consideration of usability, cognition, feedback from representative users, and impact on efficiency, data quality, and clinical workflow. This article presents an evaluation illustrating one approach to this need using the Decision-Centered Design framework. OBJECTIVE: To evaluate, through a Decision-Centered Design framework, the ability of the Screening and Surveillance App to support primary care clinicians in tracking and managing colorectal cancer testing. METHODS: We leveraged two evaluation formats, online and in-person, to obtain feedback from a range primary care clinicians and obtain comparative data. Both the online and in-person evaluations used mock patient data to simulate challenging patient scenarios. Primary care clinicians responded to a series of colorectal cancer-related questions about each patient and made recommendations for screening. We collected data on performance, perceived workload, and usability. Key elements of Decision-Centered Design include evaluation in the context of realistic, challenging scenarios and measures designed to explore impact on cognitive performance. RESULTS: Comparison of means revealed increases in accuracy, efficiency, and usability and decreases in perceived mental effort and workload when using the Screening and Surveillance App. CONCLUSION: The results speak to the benefits of using the Decision-Centered Design approach in the analysis, design, and evaluation of Health Information Technology. Furthermore, the Screening and Surveillance App shows promise for filling decision support gaps in current electronic health records.
Iterative Development and Evaluation of a Pharmacogenomic-Guided Clinical Decision Support System for Warfarin Dosing
(Schattauer, 2016-11-23) Melton, Brittany L.; Zillich, Alan J.; Saleem, Jason J.; Russ, Alissa L.; Tisdale, James E.; Overholser, Brian R.; Medicine, School of Medicine
Objective Pharmacogenomic-guided dosing has the potential to improve patient outcomes but its implementation has been met with clinical challenges. Our objective was to develop and evaluate a clinical decision support system (CDSS) for pharmacogenomic-guided warfarin dosing designed for physicians and pharmacists. Methods Twelve physicians and pharmacists completed 6 prescribing tasks using simulated patient scenarios in two iterations (development and validation phases) of a newly developed pharmacogenomic-driven CDSS prototype. For each scenario, usability was measured via efficiency, recorded as time to task completion, and participants’ perceived satisfaction which were compared using Kruskal-Wallis and Mann Whitney U tests, respectively. Debrief interviews were conducted and qualitatively analyzed. Usability findings from the first (i.e. development) iteration were incorporated into the CDSS design for the second (i.e. validation) iteration. Results During the CDSS validation iteration, participants took more time to complete tasks with a median (IQR) of 183 (124–247) seconds versus 101 (73.5–197) seconds in the development iteration (p=0.01). This increase in time on task was due to the increase in time spent in the CDSS corresponding to several design changes. Efficiency differences that were observed between pharmacists and physicians in the development iteration were eliminated in the validation iteration. The increased use of the CDSS corresponded to a greater acceptance of CDSS recommended doses in the validation iteration (4% in the first iteration vs. 37.5% in the second iteration, p<0.001). Overall satisfaction did not change statistically between the iterations but the qualitative analysis revealed greater trust in the second prototype. Conclusions A pharmacogenomic-guided CDSS has been developed using warfarin as the test drug. The final CDSS prototype was trusted by prescribers and significantly increased the time using the tool and acceptance of the recommended doses. This study is an important step toward incorporating pharmacogenomics into CDSS design for clinical testing.
Paper Persistence and Computer-based Workarounds with the Electronic Health Record in Primary Care
(2011-09) Saleem, Jason J.; Flanagan, Mindy; Militello, Laura G.; Arbuckle, Nicole; Russ, Alissa L.; Burgo-Black, A. Lucile; Doebbeling, Bradley N.
With the United States national goal and incentive program to transition from paper to electronic health records (EHRs), healthcare organizations are increasingly implementing EHRs and other related health information technology (IT). However, in institutions which have long adopted these computerized systems, such as the Veterans Health Administration, healthcare workers continue to rely on paper to complete their work. Furthermore, insufficient EHR design also results in computer-based workarounds. Using direct observation with opportunistic interviewing, we investigated the use of paper- and computer-based workarounds to the EHR with a multi-site study of 54 healthcare workers, including primary care providers, nurses, and other healthcare staff. Our analysis revealed several paper- and computer-based workarounds to the VA’s EHR. These workarounds, including clinician-designed information tools, provide evidence for how to enhance the design of the EHR to better support the needs of clinicians.
Persuasive health educational materials for colorectal cancer screening
(2014-09) Militello, Laura G.; Borders, Morgan R.; Arbuckle, Nicole B.; Flanagan, Mindy E.; Hall, Nathan P.; Saleem, Jason J.; Doebbeling, Bradley N.
This paper describes an effort to design and evaluate persuasive educational materials for colorectal cancer (CRC) screening. Although CRC screening is highly effective, screening rates in the US remain low. Educational materials represent one strategy for educating patients about screening options and increasing openness to screening. We developed a one-page brochure, leveraging factual information from the Centers for Disease Control and Prevention (CDC) and national guidelines, and strategies for persuasion from the human factors and behavioral economics literatures. We evaluated the resulting brochure with adults over the age of 50. Findings suggest that the educational brochure increases knowledge of CRC and screening options, and increases openness to screening. Furthermore, no significant difference was found between the new one-page brochure and an existing multi-page Screen for Life brochure recommended by the CDC. We interpret these findings as indication that the more practical and potentially less intimidating one-page brochure is as effective as the existing multi-page Screen for Life brochure.
Provider Perceptions of Colorectal Cancer Screening Clinical Decision Support at Three Benchmark Institutions
(2009-11) Saleem, Jason J.; Militello, Laura G.; Arbuckle, Nicole; Flanagan, Mindy; Haggstrom, David A.; Linder, Jeffrey A.; Doebbeling, Bradley N.
Implementation of computerized clinical decision support (CDS), and its integration into workflow has not reached its potential. To better understand the use of CDS for colorectal cancer (CRC) screening at benchmark institutions for health information technology (HIT), we conducted direct observation, including opportunistic interviews of primary care providers, as well as key informant interviews and focus groups, to document current challenges to CRC screening and follow-up at clinics affiliated with the Veterans Heath Administration, Regenstrief Institute, and Partners HealthCare System. Analysis revealed six common barriers across institutions from the primary care providers’ perspective: receiving and documenting “outside” exam results, inaccuracy of the CDS, compliance issues, poor usability, lack of coordination between primary care and gastroenterology, and the need to attend to more urgent patient issues. Strategies should be developed to enhance current HIT to address these challenges and better support primary care providers and staff.

Browsing by Author "Saleem, Jason J."

Results Per Page

Sort Options