IU Indianapolis ScholarWorks :: Browsing by Subject "Evaluation"

Browsing by Subject "Evaluation"

Now showing 1 - 10 of 22

Clinician Perceptions of a Computerized Decision Support System for Pediatric Type 2 Diabetes Screening
(Thieme, 2020-03) El Mikati, Hala K.; Yazel-Smith, Lisa; Grout, Randall W.; Downs, Stephen M.; Carroll, Aaron E.; Hannon, Tamara S.; Pediatrics, School of Medicine
Objective: With the increasing prevalence of type 2 diabetes (T2D) in youth, primary care providers must identify patients at high risk and implement evidence-based screening promptly. Clinical decision support systems (CDSSs) provide clinicians with personalized reminders according to best evidence. One example is the Child Health Improvement through Computer Automation (CHICA) system, which, as we have previously shown, significantly improves screening for T2D. Given that the long-term success of any CDSS depends on its acceptability and its users' perceptions, we examined what clinicians think of the CHICA diabetes module. Methods: CHICA users completed an annual quality improvement and satisfaction questionnaire. Between May and August of 2015 and 2016, the survey included two statements related to the T2D-module: (1) "CHICA improves my ability to identify patients who might benefit from screening for T2D" and (2) "CHICA makes it easier to get the lab tests necessary to identify patients who have diabetes or prediabetes." Answers were scored using a 5-point Likert scale and were later converted to a 2-point scale: agree and disagree. The Pearson chi-square test was used to assess the relationship between responses and the respondents. Answers per cohort were compared using the Mann-Whitney U-test. Results: The majority of respondents (N = 60) agreed that CHICA improved their ability to identify patients who might benefit from screening but disagreed as to whether it helped them get the necessary laboratories. Scores were comparable across both years. Conclusion: CHICA was endorsed as being effective for T2D screening. Research is needed to improve satisfaction for getting laboratories with CHICA.
Creating with Confidence. Design Thinking for Public Art. Evaluation Report
(2017-07-30) Garcia, Silvia
Warren Central High School in collaboration with Arts for Learning explored design thinking, a creative and collaborative process that is user-centered and solution-focused to engage students in the process of designing public art. The project engaged thirty 12th grade, art-major students, in a series of workshops presented by the Herron School of Art and Design, and Arts for Learning as they learned to be mindful of the audience, navigate real situations and revise their work to get to a truly original, personal, and professional product. Students also developed practices to involve residents of their community in a public art project to enhance neighborhood identity and foster a real spirit of place. The report presents the main results of the Evaluation of Creating with Confidence: Design Thinking for Public Art project that took place in the school in the school year 2016-2017.
Development and use of an instrument adapted to assess the clinical skills learning environment in the pre-clinical years
(Springer, 2015-09) Rdesinski, Rebecca E.; Chappelle, Kathryn G.; Elliot, Diane L.; Litzelman, Debra K.; Palmer, Ryan; Biagioli, Frances E.; Department of Medicine, IU School of Medicine
BACKGROUND: The Communication, Curriculum, and Culture (C3) instrument is a well-established survey for measuring the professional learning climate or hidden curriculum in the clinical years of medical school. However, few instruments exist for assessing professionalism in the pre-clinical years. We adapted the C3 instrument and assessed its utility during the pre-clinical years at two U.S. medical schools. METHODS: The ten-item Pre-Clinical C3 survey was adapted from the C3 instrument. Surveys were administered at the conclusion of the first and second years of medical school using a repeated cross-sectional design. Factor analysis was performed and Cronbach's alphas were calculated for emerging dimensions. RESULTS: The authors collected 458 and 564 surveys at two medical schools during AY06-07 and AY07-09 years, respectively. Factor analysis of the survey data revealed nine items in three dimensions: "Patients as Objects", "Talking Respectfully of Colleagues", and "Patient-Centered Behaviors". Reliability measures (Cronbach's alpha) for the Pre-Clinical C3 survey data were similar to those of the C3 survey for comparable dimensions for each school. Gender analysis revealed significant differences in all three dimensions. CONCLUSIONS: The Pre-Clinical C3 instrument's performance was similar to the C3 instrument in measuring dimensions of professionalism. As medical education moves toward earlier and more frequent clinical and inter-professional educational experiences, the Pre-Clinical C3 instrument may be especially useful in evaluating the impact of curricular revisions.
An evaluation of an Extension for Community Healthcare Outcomes (ECHO) intervention in cancer prevention and survivorship care
(BMC, 2022-05-17) Milgrom, Zheng Z.; Severance, Tyler S.; Scanlon, Caitlin M.; Carson, Anyé T.; Janota, Andrea D.; Vik, Terry A.; Duwve, Joan M.; Dixon, Brian E.; Mendonca, Eneida A.; Pediatrics, School of Medicine
To improve cancer care in Indiana, a telementoring program using the Extension for Community Healthcare Outcomes (ECHO) model was introduced in September 2019 to promote best-practice cancer prevention, screening, and survivorship care by primary care providers (PCPs). The aim of this study was to evaluate the program's educational outcomes in its pilot year, using Moore's Evaluation Framework for Continuing Medical Education and focusing on the program's impact on participants' knowledge, confidence, and professional practice. We collected data in 22 semi-structured interviews (13 PCPs and 9 non-PCPs) and 30 anonymous one-time surveys (14 PCPs and 16 non-PCPs) from the program participants (hub and spoke site members), as well as from members of the target audience who did not participate. In the first year, average attendance at each session was 2.5 PCPs and 12 non-PCP professionals. In spite of a relatively low PCP participation, the program received very positive satisfaction scores, and participants reported improvements in knowledge, confidence, and practice. Both program participants and target audience respondents particularly valued three features of the program: its conversational format, the real-life experiences gained, and the support received from a professional interdisciplinary community. PCPs reported preferring case discussions over didactics. Our results suggest that the Cancer ECHO program has benefits over other PCP-targetted cancer control interventions and could be an effective educational means of improving cancer control capacity among PCPs and others. Further study is warranted to explain the discrepancies among study participants' perceptions of the program's strengths and the relatively low PCP participation before undertaking a full-scale effectiveness study.
Evaluation of the Indianapolis Mobile Crisis Assistance Team
(2018) Bailey, Katie; Ray, Brad; Grommon, Eric; Lowder, Evan; Rising Paquet, Staci
Image Sharing Technologies and Reduction of Imaging Utilization: A Systematic Review and Meta-analysis
(Elsevier, 2015-12) Vest, Joshua R.; Jung, Hye-Young; Ostrovsky, Aaron; Das, Lala Tanmoy; McGinty, Geraldine B.; Department of Health Policy and Management, Richard M. Fairbanks School of Public Health
INTRODUCTION: Image sharing technologies may reduce unneeded imaging by improving provider access to imaging information. A systematic review and meta-analysis were conducted to summarize the impact of image sharing technologies on patient imaging utilization. METHODS: Quantitative evaluations of the effects of PACS, regional image exchange networks, interoperable electronic heath records, tools for importing physical media, and health information exchange systems on utilization were identified through a systematic review of the published and gray English-language literature (2004-2014). Outcomes, standard effect sizes (ESs), settings, technology, populations, and risk of bias were abstracted from each study. The impact of image sharing technologies was summarized with random-effects meta-analysis and meta-regression models. RESULTS: A total of 17 articles were included in the review, with a total of 42 different studies. Image sharing technology was associated with a significant decrease in repeat imaging (pooled effect size [ES] = -0.17; 95% confidence interval [CI] = [-0.25, -0.09]; P < .001). However, image sharing technology was associated with a significant increase in any imaging utilization (pooled ES = 0.20; 95% CI = [0.07, 0.32]; P = .002). For all outcomes combined, image sharing technology was not associated with utilization. Most studies were at risk for bias. CONCLUSIONS: Image sharing technology was associated with reductions in repeat and unnecessary imaging, in both the overall literature and the most-rigorous studies. Stronger evidence is needed to further explore the role of specific technologies and their potential impact on various modalities, patient populations, and settings.
Improving data management in academic research: Assessment results for a pilot lab
(2014-05-19) Coates, Heather L.
Common practices for data collection, storage, organization, documentation, sharing, re-use, and preservation are often suboptimal. Issues often arising from common data practices include data loss, corruption, poor data integrity, and an inability to demonstrate the provenance (i.e., the origin) of the data. Ineffective data management can result in data that are unusable for re-use and re-analysis. However, effective data management practices exist to support data integrity, interoperability, and re-use. These practices maximize the value and potential impact of any particular dataset. In light of the gap between common practice and known effective strategies, we developed an intensive lab curriculum to train students and research support staff in implementing these strategies. This lab addresses the lack of formal data management training available on our campus and targets key processes in the data life cycle, promoting strategies that facilitate generation of quality data appropriate for re-use.
Indiana Housing & Community Development Authority: Policy Evaluation of Aging in Place
(2014-08-28) Norwood, Connor W.; Omenka, Isaac O.
Aging in place refers to making the living environment safe and adaptable for everyone to remain independent and thrive in their homes and community even as circumstances change. The primary target populations for aging in place strategies are seniors and persons with disabilities. The effort involves construction of buildings and communities that are accessible, and livable. Creation of these housing opportunities means Hoosiers can choose how and where they live: rent or own, urban or rural, close to school or close to work. The Indiana Housing and Community Development Authority (IHCDA) has been working on developing a working definition of “Aging in Place” (AiP) in order to enhance the aging in place strategic initiative to support seniors and persons with disabilities in Indiana. As a result an evaluation of the current initiative was completed to determine the needs of the target population and to enhance the strategic priority. The goal of the program evaluation is to determine if the working definition of AiP fully encompasses the needs of the community and target population. The evaluation design involves learning and improvement of the IHCDA AiP priority and intends to improve the process. The evaluation team conducted one focus group to collect more in-depth information on perceptions, insights, attitudes, experiences, and beliefs regarding AiP. Five major themes from the focus group were identified including family, accessibility, independence, community integration, and finances. The evaluation was also able to identify a unique perspective of the definition of “home” shared by the aging in place community. To establish a home a physical and psychological component must be met. Furthermore, independent senior living communities were identified as being in high demand. Based on the findings of the evaluation, three recommendations were developed to enhance the AiP priority at IHCDA. It is recommended that IHCDA amend the working definition to explicitly characterize the meaning of home based on the findings of this evaluation. IHCDA should also increase allocation of funds to independent senior living communities and should perform ongoing evaluations to ensure that current needs of the AiP community are being identified and met. Ongoing evaluation with the data collection tool developed in this evaluation will ensure that the AiP strategic priority at IHCDA is on the right path moving forward.
Interpreting Clinical Reaction Time Change and Recovery After Concussion: A Baseline Versus Norm-Based Cutoff Score Comparison
(National Athletic Trainers' Associaton, 2021) Caccese, Jaclyn B.; Eckner, James T.; Franco-MacKendrick, Lea; Hazzard, Joseph B.; Ni, Meng; Broglio, Steven P.; McAllister, Thomas W.; McCrea, Michael A.; Pasquina, Paul F.; Buckley, Thomas A.; Psychiatry, School of Medicine
Context: Preseason testing can be time intensive and cost prohibitive. Therefore, using normative data for postconcussion interpretation in lieu of preseason testing is desirable. Objective: To establish the recovery trajectory for clinical reaction time (RTclin) and assess the usefulness of changes from baseline (comparison of postconcussion scores with individual baseline scores) and norm-based cutoff scores (comparison of postconcussion scores with a normative mean) for identifying impairments postconcussion. Design: Case-control study. Setting: Multisite clinical setting. Patients or other participants: An overlapping sample of 99 participants (age = 19.0 ± 1.1 years) evaluated within 6 hours postconcussion, 176 participants (age = 18.9 ± 1.1 years) evaluated at 24 to 48 hours postconcussion, and 214 participants (age = 18.9 ± 1.1 years) evaluated once they were cleared to begin a return-to-play progression were included. Participants with concussion were compared with 942 control participants (age = 19.0 ± 1.0 years) who did not sustain a concussion during the study period but completed preseason baseline testing at 2 points separated by 1 year (years 1 and 2). Main outcome measure(s): At each time point, follow-up RTclin (ie, postconcussion or year 2) was compared with the individual year 1 preseason baseline RTclin and normative baseline data (ie, sex and sport specific). Receiver operating characteristic curves were calculated to compare the sensitivity and specificity of RTclin change from baseline and norm-based cutoff scores. Results: Clinical reaction time performance declined within 6 hours (18 milliseconds, 9.2% slower than baseline). The decline persisted at 24 to 48 hours (15 milliseconds, 7.6% slower than baseline), but performance recovered by the time of return-to-play initiation. Within 6 hours, a change from baseline of 16 milliseconds maximized combined sensitivity (52%) and specificity (79%, area under the curve [AUC] = 0.702), whereas a norm-based cutoff score of 19 milliseconds maximized combined sensitivity (46%) and specificity (86%, AUC = 0.700). At 24 to 48 hours, a change from baseline of 2 milliseconds maximized combined sensitivity (64%) and specificity (61%, AUC = 0.666), whereas a norm-based cutoff score of 0 milliseconds maximized combined sensitivity (63%) and specificity (62%, AUC = 0.647). Conclusions: Norm-based cutoff scores can be used for interpreting RTclin scores postconcussion in collegiate athletes when individual baseline data are not available, although low sensitivity and specificity limit the use of RTclin as a stand-alone test.
Making Nonprofits More Effective: Performance Management and Performance Appraisals
(Routledge, 2017) Walk, Marlene; Kennedy, Troy
Performance management and performance appraisals have long been regarded as key for effective strategic human resource management (SHRM) in the for-profit sector. When well- designed, performance management in general and performance appraisals in particular positively affect employees, managers, and organizations. Given the specific setup of nonprofit organizations, tools for performance management from the for-profit sector might not be easily applicable to nonprofit organizations. Nonprofit scholars have begun to study performance management, but to date the field lacks a comprehensive overview of this research. It is the aim of this chapter to summarize the research on performance management and performance appraisals in the nonprofit context and, based on this summary, to propose a comprehensive model of performance management and performance appraisals in nonprofit organizations.

Browsing by Subject "Evaluation"

Results Per Page

Sort Options