Browsing by Subject "Program evaluation"
Now showing 1 - 10 of 20
Results Per Page
Sort Options
Item Assessing HIV-infected patient retention in a program of differentiated care in sub-Saharan Africa: a G-estimation approach(De Gruyter, 2023-09-18) Yiannoutsos, Constantin T.; Wools-Kaloustian, Kara; Musick, Beverly S.; Kosgei, Rose; Kimaiyo, Sylvester; Siika, Abraham; Biostatistics and Health Data Science, Richard M. Fairbanks School of Public HealthDifferentiated care delivery aims to simplify care of people living with HIV, reflect their preferences, reduce burdens on the healthcare system, maintain care quality and preserve resources. However, assessing program effectiveness using observational data is difficult due to confounding by indication and randomized trials may be infeasible. Also, benefits can reach patients directly, through enrollment in the program, and indirectly, by increasing quality of and accessibility to care. Low-risk express care (LREC), the program under evaluation, is a nurse-centered model which assigns patients stable on ART to a nurse every two months and a clinician every third visit, reducing annual clinician visits by two thirds. Study population is comprised of 16,832 subjects from 15 clinics in Kenya. We focus on patient retention in care based on whether the LREC program is available at a clinic and whether the patient is enrolled in LREC. We use G-estimation to assess the effect on retention of two “strategies”: (i) program availability but no enrollment; (ii) enrollment at an available program; versus no program availability. Compared to no availability, LREC results in a non-significant increase in patient retention, among patients not enrolled in the program (indirect effect), while enrollment in LREC is associated with a significant extension of the time retained in care (direct effect). G-estimation provides an analytical framework useful to the assessment of similar programs using observational data.Item Developing new pathways into the biomedical informatics field: the AMIA High School Scholars Program(Oxford University Press, 2016) Unertl, Kim M.; Finnell, John T.; Sarkar, Indra Neil; Emergency Medicine, School of MedicineIncreasing access to biomedical informatics experiences is a significant need as the field continues to face workforce challenges. Looking beyond traditional medical school and graduate school pathways into the field is crucial for expanding the number of individuals and increasing diversity in the field. This case report provides an overview of the development and initial implementation of the American Medical Informatics Association (AMIA) High School Scholars Program. Initiated in 2014, the program's primary goal was to provide dissemination opportunities for high school students engaged in biomedical informatics research. We discuss success factors including strong cross-institutional, cross-organizational collaboration and the high quality of high school student submissions to the program. The challenges encountered, especially around working with minors and communicating program expectations clearly, are also discussed. Finally, we present the path forward for the continued evolution of the AMIA High School Scholars Program.Item Discovering Value and Impact: Evaluating a New Art Therapy in Neuroscience and Medicine Program(2017) Riddle, Maria; King, JulietThis study is a mixed-method approach for evaluating a new Art Therapy in Neuroscience and Medicine (ATNM) program within an outpatient academic medical center that provides a range of medical and psychiatric services to individuals with neurologic and psychiatric conditions. The aims were to assess the value of the ATNM program and the impact it has on affecting depressive mood among individuals who were receiving art therapy services (N=15). The Patient Health Questionnaire-9 (PHQ-9) and Client Satisfaction Questionnaire-8 (CSQ-8) were used to obtain baseline data regarding depressive mood and client satisfaction. Patient demographics were gathered using the ATNM tracking system and the medical center’s electronic medical record system to further understand the value and impact of the program. The preliminary data indicated an overall significant level of depression and anxiety among the referrals of patients having chronic neurological conditions. A high level of patient satisfaction and substantial benefit from art therapy intervention was noted in the results from the CSQ-8. Further evaluation of the program is recommended as an ongoing part of assessing the impact and value of the ATNM program.Item Effectiveness of the VA-Geriatric Resources for Assessment and Care of Elders (VA-GRACE) program: An observational cohort study(Wiley, 2022) Schubert, Cathy C.; Perkins, Anthony J.; Myers, Laura J.; Damush, Teresa M.; Penney, Lauren S.; Zhang, Ying; Schwartzkopf, Ashley L.; Preddie, Alaina K.; Riley, Sam; Menen, Tetla; Bravata, Dawn M.; Medicine, School of MedicineBackground: As the Department of Veterans Affairs (VA) healthcare system seeks to expand access to comprehensive geriatric assessments, evidence-based models of care are needed to support community-dwelling older persons. We evaluated the VA Geriatric Resources for Assessment and Care of Elders (VA-GRACE) program's effect on mortality and readmissions, as well as patient, caregiver, and staff satisfaction. Methods: This retrospective cohort included patients admitted to the Richard L. Roudebush VA hospital (2010-2019) who received VA-GRACE services post-discharge and usual care controls who were potentially eligible for VA-GRACE but did not receive services. The VA-GRACE program provided home-based comprehensive, multi-disciplinary geriatrics assessment, and ongoing care. Primary outcomes included 90-day and 1-year all-cause readmissions and mortality, and patient, caregiver, and staff satisfaction. We used propensity score modeling with overlapping weighting to adjust for differences in characteristics between groups. Results: VA-GRACE patients (N = 683) were older than controls (N = 4313) (mean age 78.3 ± 8.2 standard deviation vs. 72.2 ± 6.9 years; p < 0.001) and had greater comorbidity (median Charlson Comorbidity Index 3 vs. 0; p < 0.001). VA-GRACE patients had higher 90-day readmissions (adjusted odds ratio [aOR] 1.55 [95%CI 1.01-2.38]) and higher 1-year readmissions (aOR 1.74 [95%CI 1.22-2.48]). However, VA-GRACE patients had lower 90-day mortality (aOR 0.31 [95%CI 0.11-0.92]), but no statistically significant difference in 1-year mortality was observed (aOR 0.88 [95%CI 0.55-1.41]). Patients and caregivers reported that VA-GRACE home visits reduced travel burden and the program linked Veterans and caregivers to needed resources. Primary care providers reported that the VA-GRACE team helped to reduce their workload, improved medication management for their patients, and provided a view into patients' daily living situation. Conclusions: The VA-GRACE program provides comprehensive geriatric assessments and care to high-risk, community-dwelling older persons with high rates of satisfaction from patients, caregivers, and providers. Widespread deployment of programs like VA-GRACE will be required to support Veterans aging in place.Item Evaluating the Efficacy of Medical-Legal Partnerships that Address Social Determinants of Health(Johns Hopkins University Press, 2021) Nerlinger, Abby L.; Alberti, Philip M.; Gilbert, Amy L.; Goodman, Tracy L.; Fair, Malika A.; Johnson, Sherese B.; Pettignano, Robert; Pediatrics, School of MedicineBackground: Medical-legal partnerships (MLPs) are health system-community partnerships composed of multi-disciplinary teams designed to improve patient and community health. MLPs provide legal services to address health-harming legal needs that contribute to health inequities. Methods: A grant provided by the Association of American Medical Colleges (AAMC) and the Centers for Disease Control and Prevention established the Accelerating Health Equity, Advancing through Discovery (AHEAD) Initiative to identify, evaluate, and disseminate community-based interventions that improve health equity. Three geographically and demographically diverse institutions were chosen to strengthen the evidence-base surrounding MLP by developing standardized evaluation tools in the areas of community health, health system savings, and learner outcomes. Results: The generalizable process leading to evaluation tool development is described herein, and includes the formation of multi-institutional teams, logic model development, and stakeholder interviews. Conclusions: Although MLP is presented, this process can be used by various types of community health partnerships to develop evaluation tools surrounding social determinants of health (SDOH).Item Expanding Access to Comprehensive Geriatric Evaluation via Telehealth: Development of Hybrid-Virtual Home Visits(Springer, 2024) Schubert, Cathy C.; Penney, Lauren S.; Schwartzkopf, Ashley L.; Damush, Teresa M.; Preddie, Alaina; Flemming, Soyna; Myers, Jennifer; Myers, Laura J.; Perkins, Anthony J.; Zhang, Ying; Bravata, Dawn M.; Medicine, School of MedicineBackground: In response to the aging population, the Department of Veterans Affairs (VA) seeks to expand access to evidence-based practices which support community-dwelling older persons such as the Geriatric Resources for Assessment and Care of Elders (GRACE) program. GRACE is a multidisciplinary care model which provides home-based geriatric evaluation and management for older Veterans residing within a 20-mile drive radius from the hospital. We sought to expand the geographic reach of VA-GRACE by developing a hybrid-virtual home visit (TeleGRACE). Objectives: The objectives were to: (1) describe challenges encountered and solutions implemented during the iterative, pre-implementation program development process; and (2) illustrate potential successes of the program with two case examples. Design: Quality improvement project with longitudinal qualitative data collection. Program description: The hybrid-virtual home visit involved a telehealth technician travelling to patients' homes and connecting virtually to VA-GRACE team members who participated remotely. Approach & participants: We collected multiple data streams throughout program development: TeleGRACE staff periodic reflections, fieldnotes, and team meeting notes; and VA-GRACE team member interviews. Key results: The five program domains that required attention and problem-solving were: telehealth connectivity and equipment, virtual physical examination, protocols and procedures, staff training, and team integration. For each domain, we describe several challenges and solutions. An example from the virtual physical examination domain: several iterations were required to identify the combination of telehealth stethoscope with dedicated headphones that allowed remote nurse practitioners to hear heart and lung sounds. The two cases illustrate how this hybrid-virtual home visit model provided care for patients who would not otherwise have received timely healthcare services. Conclusions: These results provide a blueprint to translate an in-person home-based geriatrics program into a hybrid-virtual model and support the feasibility of using hybrid-virtual home visits to expand access to comprehensive geriatric evaluation and ongoing care for high-risk, community-dwelling older persons who reside geographically distant from the primary VA facility.Item Facility-level conditions leading to higher reach: a configurational analysis of national VA weight management programming(Springer Nature, 2021-08-11) Miech, Edward J.; Freitag, Michelle B.; Evans, Richard R.; Burns, Jennifer A.; Wiitala, Wyndy L.; Annis, Ann; Raffa, Susan D.; Spohr, Stephanie A.; Damschroder, Laura J.; Emergency Medicine, School of MedicineBackground: While the Veterans Health Administration (VHA) MOVE! weight management program is effective in helping patients lose weight and is available at every VHA medical center across the United States, reaching patients to engage them in treatment remains a challenge. Facility-based MOVE! programs vary in structures, processes of programming, and levels of reach, with no single factor explaining variation in reach. Configurational analysis, based on Boolean algebra and set theory, represents a mathematical approach to data analysis well-suited for discerning how conditions interact and identifying multiple pathways leading to the same outcome. We applied configurational analysis to identify facility-level obesity treatment program arrangements that directly linked to higher reach. Methods: A national survey was fielded in March 2017 to elicit information about more than 75 different components of obesity treatment programming in all VHA medical centers. This survey data was linked to reach scores available through administrative data. Reach scores were calculated by dividing the total number of Veterans who are candidates for obesity treatment by the number of "new" MOVE! visits in 2017 for each program and then multiplied by 1000. Programs with the top 40 % highest reach scores (n = 51) were compared to those in the lowest 40 % (n = 51). Configurational analysis was applied to identify specific combinations of conditions linked to reach rates. Results: One hundred twenty-seven MOVE! program representatives responded to the survey and had complete reach data. The final solution consisted of 5 distinct pathways comprising combinations of program components related to pharmacotherapy, bariatric surgery, and comprehensive lifestyle intervention; 3 of the 5 pathways depended on the size/complexity of medical center. The 5 pathways explained 78 % (40/51) of the facilities in the higher-reach group with 85 % consistency (40/47). Conclusions: Specific combinations of facility-level conditions identified through configurational analysis uniquely distinguished facilities with higher reach from those with lower reach. Solutions demonstrated the importance of how local context plus specific program components linked together to account for a key implementation outcome. These findings will guide system recommendations about optimal program structures to maximize reach to patients who would benefit from obesity treatment such as the MOVE!Item Facility-level program components leading to population impact: a coincidence analysis of obesity treatment options within the Veterans Health Administration(Oxford University Press, 2022) Damschroder, Laura J.; Miech, Edward J.; Freitag, Michelle B.; Evans, Richard; Burns, Jennifer A.; Raffa, Susan D.; Goldstein, Michael G.; Annis, Ann; Spohr, Stephanie A.; Wiitala, Wyndy L.; Emergency Medicine, School of MedicineObesity is a well-established risk factor for increased morbidity and mortality. Comprehensive lifestyle interventions, pharmacotherapy, and bariatric surgery are three effective treatment approaches for obesity. The Veterans Health Administration (VHA) offers all three domains but in different configurations across medical facilities. Study aim was to explore the relationship between configurations of three types of obesity treatments, context, and population impact across VHA using coincidence analysis. This was a cross-sectional analysis of survey data describing weight management treatment components linked with administrative data to compute population impact for each facility. Coincidence analysis was used to identify combinations of treatment components that led to higher population impact. Facilities with higher impact were in the top two quintiles for (1) reach to eligible patients and (2) weight outcomes. Sixty-nine facilities were included in the analyses. The final model explained 88% (29/33) of the higher-impact facilities with 91% consistency (29/32) and was comprised of five distinct pathways. Each of the five pathways depended on facility complexity-level plus factors from one or more of the three domains of weight management: comprehensive lifestyle interventions, pharmacotherapy, and/or bariatric surgery. Three pathways include components from multiple treatment domains. Combinations of conditions formed "recipes" that lead to higher population impact. Our coincidence analyses highlighted both the importance of local context and how combinations of specific conditions consistently and uniquely distinguished higher impact facilities from lower impact facilities for weight management.Item Factors Influencing Progress of Health Information Exchange Organizations in the United States(IOS Press, 2017) Overhage, Lauren M.; Covich-Bordenick, Jennifer; Li, Xiouchun; Overhage, J. Marc; Biostatistics, School of Public HealthProgress is being made toward improved healthcare interoperability in the United States, but exchange between electronic health records alone is insufficient. Using data from the eHealth Initiative's Annual Survey of Health Information Exchange, we developed models of HIE financial and operational progress. Our analysis suggests that organizations that focus on enabling exchange thorugh education and policy need to be considered separately from those focused on the actual exchange. The associations between characteristics and progress in data exchanging HIEs suggest that diversity of participants as both originators and receivers of data and breadth of data are important underlying success factors.Item Impact of Illness Management and Recovery Programs on Hospital and Emergency Room Use by Medicaid Enrollees(2011-05) Salyers, Michelle P.; Rollins, Angela L.; Clendenning, Daniel; McGuire, Alan B.; Kim, EdwardObjective—Illness management and recovery is a structured program that helps consumers with severe mental illness learn effective ways to manage illness and pursue recovery goals. This study examined the impact of the program on health service utilization. Methods—This was a retrospective cohort study of five assertive community treatment (ACT) teams in Indiana that implemented illness management and recovery. With Medicaid claims data from July 1, 2003, to June 30, 2008, panel data were created with person-months as the level of analysis, resulting in 14,261 observations, for a total of 498 unique individuals. Zero-inflated negative binomial regression models were used to predict hospitalization days and emergency room visits, including covariates of demographic characteristics, employment status, psychiatric diagnosis, and concurrent substance use disorder. The main predictor variables of interest were receipt of illness management and recovery services, dropout from the program, and program graduation status. Results—Consumers who received some illness management and recovery services had fewer hospitalization days than those receiving only ACT. Graduates had fewer emergency room visits than did ACT-only consumers. Conclusions—This is the first study to examine the impact of illness management and recovery on service utilization. Controlling for a number of background variables, the study showed that illness management and recovery programs were associated with reduced inpatient hospitalization and emergency room use over and above ACT.