IU Indianapolis ScholarWorks :: Browsing by Author "Russ, Alissa L."

Browsing by Author "Russ, Alissa L."

Now showing 1 - 10 of 10

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation
(Oxford University Press, 2014-10) Russ, Alissa L.; Zillich, Alan J.; Melton, Brittany L.; Russell, Scott A.; Chen, Siying; Spina, Jeffrey R.; Weiner, Michael; Johnson, Elizabette G.; Daggy, Joanne K.; McAnas, M. Sue; Hawsey, Jason M.; Puleo, Anthony G.; Doebbeling, Bradley N.; Saleem, Jason J.; Medicine Faculty Volunteers, IU School of Medicine
OBJECTIVE: To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND METHODS: We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. RESULTS: Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. CONCLUSIONS: This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes.
A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation
(Elsevier, 2018-09) Savoy, April; Militello, Laura G.; Patel, Himalaya; Flanagan, Mindy E.; Russ, Alissa L.; Daggy, Joanne K.; Weiner, Michael; Saleem, Jason J.; Biostatistics, School of Public Health
Background During medical referrals, communication barriers between referring and consulting outpatient clinics delay patients’ access to health care. One notable opportunity for reducing these barriers is improved usefulness and usability of electronic medical consultation order forms. The cognitive systems engineering (CSE) design approach focuses on supporting humans in managing cognitive complexity in sociotechnical systems. Cognitive complexity includes communication, decision-making, problem solving, and planning. Objective The objective of this research was to implement a CSE design approach to develop a template that supports the cognitive needs of referring clinicians and improves referral communication. Methods We conducted interviews and observations with primary care providers and specialists at two major tertiary, urban medical facilities. Using qualitative analysis, we identified cognitive requirements and design guidelines. Next, we designed user interface (UI) prototypes and compared their usability with that of a currently implemented UI at a major Midwestern medical facility. Results Physicians’ cognitive challenges were summarized in four cognitive requirements and 13 design guidelines. As a result, two UI prototypes were developed to support order template search and completion. To compare UIs, 30 clinicians (referrers) participated in a consultation ordering simulation complemented with the think-aloud elicitation method. Oral comments about the UIs were coded for both content and valence (i.e., positive, neutral, or negative). Across 619 comments, the odds ratio for the UI prototype to elicit higher-valenced comments than the implemented UI was 13.5 (95% CI = [9.2, 19.8]), p < .001. Conclusion This study reinforced the significance of applying a CSE design approach to inform the design of health information technology. In addition, knowledge elicitation methods enabled identification of physicians’ cognitive requirements and challenges when completing electronic medical consultation orders. The resultant knowledge was used to derive design guidelines and UI prototypes that were more useful and usable for referring physicians. Our results support the implementation of a CSE design approach for electronic medical consultation orders.
Crossing the Communication Chasm: Challenges and Opportunities in Transitions of Care from the Hospital to the Primary Care Clinic
(Elsevier, 2017-03) Rattray, Nicholas A.; Sico, Jason J.; Cox, LeeAnn M.; Russ, Alissa L.; Matthias, Marianne S.; Frankel, Richard M.; Anthropology, School of Liberal Arts
Background Transitions of care from specialty and acute settings to primary care abound. Compared to the continuity in end-of-shift handoffs, care transitions involve provider communication between practices and facilities with their own cultures and bureaucracies. Using the transition from acute care to outpatient primary care for stroke/transient ischemic attack (TIA) patients as a case study, this qualitative research explored communication practices and institutional arrangements among clinical providers responsible for longitudinal management of hypertension. In this study, researchers investigated the barriers and facilitators of effective communication between acute stroke/TIA inpatient and primary care providers at a Veterans Affairs Medical Center. Methods A multidisciplinary team conducted consensus-based coding and thematic analysis of semistructured interviews with 21 clinical providers (9 with primary responsibilities for inpatient care and 12 with primary responsibilities in outpatient, primary care). Results Thematic analysis of responses identified three factors that influenced communication between clinical providers: (1) consistent, concise but complete medication and treatment plans; (2) reliable, standardized discharge documentation; (3) use of multiple modes of communication. Participants identified cultural barriers, including challenges with rotating providers at a teaching hospital and local discharge practices. Conclusion Ambiguity about who is being handed off to and time pressures in the acute setting may lead inpatient providers to give lower priority to discharge communication, leaving outpatient providers with low-quality information. While electronic templates have standardized key components of discharge documentation, improvement opportunities remain. Increased awareness of the challenges and opportunities on each side of the care transfer could foster communication practices that systematically account for the information needs of inpatient and outpatient providers.
Faculty perceptions of a tobacco cessation train-the-trainer workshop and experiences with implementation: A qualitative follow-up study
(Elsevier, 2019) Elkhadragy, Nervana; Corelli, Robin L.; Russ, Alissa L.; Snyder, Margie; Clabaugh, Mercedes; Suchanek Hudmon, Karen; Medicine, School of Medicine
Background Between 2003 and 2005, pharmacy faculty members (n = 191) participated in a national train-the-trainer workshop designed to equip faculty with the necessary knowledge and skills to implement a shared curriculum, Rx for Change: Clinician-Assisted Tobacco Cessation, at pharmacy schools across the United States. Objective To conduct a long-term, qualitative follow-up study of faculty participants to describe (a) perceptions of the train-the-trainer workshop, and (b) subsequent experiences with curricular implementation. Results of this investigation will inform a national survey of all train-the-trainer participants. Methods Participants were selected via random sampling from the group of 191 faculty members who participated in the workshop. Semi-structured telephone interviews with participants were audio-recorded and transcribed, and qualitative thematic analysis was conducted. Results Eighteen (62%) of 29 invited individuals participated in the interviews. All participants reported implementing components of Rx for Change at their institution. The analysis yielded eight major themes pertaining to faculty perceptions and experiences with implementation: (1) accessibility to tools for teaching, (2) increased confidence and skills, (3) flexibility delivering the curriculum, (4) factors facilitating implementation and challenges encountered by faculty, (5) enhancement in treating tobacco users in clinical practice, (6) students' confidence and cognizance of the pharmacists' role as a public health advocate, (7) networking and career development opportunities, and (8) useful background for research. Conclusion Participation in the train-the-trainer workshop increased self-reported confidence for teaching tobacco cessation, and faculty valued access to useful, updated tools for teaching. Furthermore, their newly acquired counseling skills were deemed helpful for treating patients' tobacco use and dependence in clinical practice. Participants also perceived improved pharmacy students' confidence and beneficial networking opportunities. Results can help future trainers understand faculty experiences with implementing a shared, national curriculum and inform faculty participants of some of the potential long-term outcomes as a result of participation.
Iterative Development and Evaluation of a Pharmacogenomic-Guided Clinical Decision Support System for Warfarin Dosing
(Schattauer, 2016-11-23) Melton, Brittany L.; Zillich, Alan J.; Saleem, Jason J.; Russ, Alissa L.; Tisdale, James E.; Overholser, Brian R.; Medicine, School of Medicine
Objective Pharmacogenomic-guided dosing has the potential to improve patient outcomes but its implementation has been met with clinical challenges. Our objective was to develop and evaluate a clinical decision support system (CDSS) for pharmacogenomic-guided warfarin dosing designed for physicians and pharmacists. Methods Twelve physicians and pharmacists completed 6 prescribing tasks using simulated patient scenarios in two iterations (development and validation phases) of a newly developed pharmacogenomic-driven CDSS prototype. For each scenario, usability was measured via efficiency, recorded as time to task completion, and participants’ perceived satisfaction which were compared using Kruskal-Wallis and Mann Whitney U tests, respectively. Debrief interviews were conducted and qualitatively analyzed. Usability findings from the first (i.e. development) iteration were incorporated into the CDSS design for the second (i.e. validation) iteration. Results During the CDSS validation iteration, participants took more time to complete tasks with a median (IQR) of 183 (124–247) seconds versus 101 (73.5–197) seconds in the development iteration (p=0.01). This increase in time on task was due to the increase in time spent in the CDSS corresponding to several design changes. Efficiency differences that were observed between pharmacists and physicians in the development iteration were eliminated in the validation iteration. The increased use of the CDSS corresponded to a greater acceptance of CDSS recommended doses in the validation iteration (4% in the first iteration vs. 37.5% in the second iteration, p<0.001). Overall satisfaction did not change statistically between the iterations but the qualitative analysis revealed greater trust in the second prototype. Conclusions A pharmacogenomic-guided CDSS has been developed using warfarin as the test drug. The final CDSS prototype was trusted by prescribers and significantly increased the time using the tool and acceptance of the recommended doses. This study is an important step toward incorporating pharmacogenomics into CDSS design for clinical testing.
Paper Persistence and Computer-based Workarounds with the Electronic Health Record in Primary Care
(2011-09) Saleem, Jason J.; Flanagan, Mindy; Militello, Laura G.; Arbuckle, Nicole; Russ, Alissa L.; Burgo-Black, A. Lucile; Doebbeling, Bradley N.
With the United States national goal and incentive program to transition from paper to electronic health records (EHRs), healthcare organizations are increasingly implementing EHRs and other related health information technology (IT). However, in institutions which have long adopted these computerized systems, such as the Veterans Health Administration, healthcare workers continue to rely on paper to complete their work. Furthermore, insufficient EHR design also results in computer-based workarounds. Using direct observation with opportunistic interviewing, we investigated the use of paper- and computer-based workarounds to the EHR with a multi-site study of 54 healthcare workers, including primary care providers, nurses, and other healthcare staff. Our analysis revealed several paper- and computer-based workarounds to the VA’s EHR. These workarounds, including clinician-designed information tools, provide evidence for how to enhance the design of the EHR to better support the needs of clinicians.
Reducing prescribing errors through creatinine clearance alert redesign
(Elsevier, 2015-10) Melton, Brittany L.; Zillich, Alan J.; Russell, Scott A.; Weiner, Michael; McManus, M. Sue; Spina, Jeffrey R.; Russ, Alissa L.; Department of Medicine, IU School of Medicine
Background Literature has shown that computerized creatinine clearance alerts reduce errors during prescribing, and applying human factors principles may further reduce errors. Our objective was to apply human factors principles to creatinine clearance alert design and assess whether the redesigned alerts increase usability and reduce prescribing errors compared with the original alerts. Methods Twenty Veterans Affairs (VA) outpatient providers (14 physicians, 2 nurse practitioners, and 4 clinical pharmacists) completed 2 usability sessions in a counterbalanced study to evaluate original and redesigned alerts. Each session consisted of fictional patient scenarios with 3 medications that warranted prescribing changes because of renal impairment, each associated with creatinine clearance alerts. Quantitative and qualitative data were collected to assess alert usability and the occurrence of prescribing errors. Results There were 43% fewer prescribing errors with the redesigned alerts compared with the original alerts (P = .001). Compared with the original alerts, redesigned alerts significantly reduced prescribing errors for allopurinol and ibuprofen (85% vs 40% and 65% vs 25%, P = .012 and P = .008, respectively), but not for spironolactone (85% vs 65%). Nine providers (45%) voiced confusion about why the alert was appearing when they encountered the original alert design. When laboratory links were presented on the redesigned alert, laboratory information was accessed 3.5 times more frequently. Conclusions Although prescribing errors were high with both alert designs, the redesigned alerts significantly improved prescribing outcomes. This investigation provides some of the first evidence on how alerts may be designed to support safer prescribing for patients with renal impairment.
Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians’ and Human Factors Engineers’ Perspectives
(Springer, 2017-08) Savoy, April; Patel, Himalaya; Flanagan, Mindy E.; Weiner, Michael; Russ, Alissa L.; Medicine, School of Medicine
We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians’ statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers’ information needs (10%). Severe violations were attributed mostly to meet referrers’ information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants’ requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates’ inability to support referring clinicians’ information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts.
Utilizing a user-centered approach to develop and assess pharmacogenomic clinical decision support for thiopurine methyltransferase
(BMC, 2019-10-17) Nguyen, Khoa A.; Patel, Himalaya; Haggstrom, David A.; Zillich, Alan J.; Imperiale, Thomas F.; Russ, Alissa L.; Medicine, School of Medicine
BACKGROUND: A pharmacogenomic clinical decision support tool (PGx-CDS) for thiopurine medications can help physicians incorporate pharmacogenomic results into prescribing decisions by providing up-to-date, real-time decision support. However, the PGx-CDS user interface may introduce errors and promote alert fatigue. The objective of this study was to develop and evaluate a prototype of a PGx-CDS user interface for thiopurine medications with user-centered design methods. METHODS: This study had two phases: In phase I, we conducted qualitative interviews to assess providers' information needs. Interview transcripts were analyzed through a combination of inductive and deductive qualitative analysis to develop design requirements for a PGx-CDS user interface. Using these requirements, we developed a user interface prototype and evaluated its usability (phase II). RESULTS: In total, 14 providers participated: 10 were interviewed in phase I, and seven providers completed usability testing in phase II (3 providers participated in both phases). Most (90%) participants were interested in PGx-CDS systems to help improve medication efficacy and patient safety. Interviews yielded 11 themes sorted into two main categories: 1) health care providers' views on PGx-CDS and 2) important design features for PGx-CDS. We organized these findings into guidance for PGx-CDS content and display. Usability testing of the PGx-CDS prototype showed high provider satisfaction. CONCLUSION: This is one of the first studies to utilize a user-centered design approach to develop and assess a PGx-CDS interface prototype for Thiopurine Methyltransferase (TPMT). This study provides guidance for the development of a PGx-CDS, and particularly for biomarkers such as TPMT.
You and me and the computer makes three: variations in exam room use of the electronic health record
(Oxford University Press, 2014-02) Saleem, Jason J.; Flanagan, Mindy E.; Russ, Alissa L.; McMullen, Carmit K.; Elli, Leora; Russell, Scott A.; Bennett, Katelyn J.; Matthias, Marianne S.; Rehman, Shakaib U.; Schwartz, Mark D.; Frankel, Richard M.; Medicine, School of Medicine
Challenges persist on how to effectively integrate the electronic health record (EHR) into patient visits and clinical workflow, while maintaining patient-centered care. Our goal was to identify variations in, barriers to, and facilitators of the use of the US Department of Veterans Affairs (VA) EHR in ambulatory care workflow in order better to understand how to integrate the EHR into clinical work. We observed and interviewed 20 ambulatory care providers across three geographically distinct VA medical centers. Analysis revealed several variations in, associated barriers to, and facilitators of EHR use corresponding to different units of analysis: computer interface, team coordination/workflow, and organizational. We discuss our findings in the context of different units of analysis and connect variations in EHR use to various barriers and facilitators. Findings from this study may help inform the design of the next generation of EHRs for the VA and other healthcare systems.

Browsing by Author "Russ, Alissa L."

Results Per Page

Sort Options