Browsing by Subject "Fidelity"

Now showing 1 - 6 of 6
  • Thumbnail Image
    Item
    Comparison of Assertive Community Treatment Fidelity Assessment Methods: Reliability and Validity
    (Springer, 2016-03) Rollins, Angela L.; McGrew, John H.; Kukla, Marina; McGuire, Alan B.; Flanagan, Mindy E.; Hunt, Marcia G.; Leslie, Doug L.; Collins, Linda A.; Wright-Berryman, Jennifer L.; Hicks, Lia J.; Salyers, Michelle P.; Department of Psychology, School of Science
    Assertive community treatment is known for improving consumer outcomes, but is difficult to implement. On-site fidelity measurement can help ensure model adherence, but is costly in large systems. This study compared reliability and validity of three methods of fidelity assessment (on-site, phone-administered, and expert-scored self-report) using a stratified random sample of 32 mental health intensive case management teams from the Department of Veterans Affairs. Overall, phone, and to a lesser extent, expert-scored self-report fidelity assessments compared favorably to on-site methods in inter-rater reliability and concurrent validity. If used appropriately, these alternative protocols hold promise in monitoring large-scale program fidelity with limited resources.
  • Thumbnail Image
    Item
    The "Critical" Elements of Illness Management and Recovery: Comparing Methodological Approaches
    (Springer, 2016-01) McGuire, Alan B.; Luther, Lauren; White, Dominique; White, Laura M.; McGrew, John H.; Salyers, Michelle P.; Department of Psychology, School of Science
    This study examined three methodological approaches to defining the critical elements of Illness Management and Recovery (IMR), a curriculum-based approach to recovery. Sixty-seven IMR experts rated the criticality of 16 IMR elements on three dimensions: defining, essential, and impactful. Three elements (Recovery Orientation, Goal Setting and Follow-up, and IMR Curriculum) met all criteria for essential and defining and all but the most stringent criteria for impactful. Practitioners should consider competence in these areas as preeminent. The remaining 13 elements met varying criteria for essential and impactful. Findings suggest that criticality is a multifaceted construct, necessitating judgments about model elements across different criticality dimensions.
  • Thumbnail Image
    Item
    Development and Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment
    (JMIR, 2015-12-30) Ruggiero, Kenneth J.; Bunnell, Brian E.; Andrews, Arthur R., III; Davidson, Tatiana M.; Hanson, Rochelle F.; Danielson, Carla Kmett; Saunders, Benjamin E.; Soltis, Kathryn; Yarian, Caleb; Chu, Brian; Adams, Zachary W.; Psychiatry, School of Medicine
    Background: Children need access to high quality mental health care. Effective treatments now exist for a wide range of mental health conditions. However, these interventions are delivered with variable effectiveness in traditional mental health service settings. Innovative solutions are needed to improve treatment delivery quality and effectiveness. Objective: The aim of this study was to develop a scalable, sustainable technology-based approach to improve the quality of care in child mental health treatment. Methods: A tablet-based resource was developed with input from mental health training experts, mental health providers, and patients. A series of qualitative data collection phases (ie, expert interviews, patient and provider focus groups, usability testing) guided the initial concept and design of the resource, and then its refinement. The result was an iPad-based "e-workbook" designed to improve child engagement and provider fidelity in implementation of a best-practice treatment. We are currently conducting a small scale randomized controlled trial to evaluate the feasibility of e-workbook facilitated child mental health treatment with 10 providers and 20 families recruited from 4 local community-based mental health clinics. Results: Usability and focus group testing yielded a number of strong, favorable reactions from providers and families. Recommendations for refining the e-workbook also were provided, and these guided several improvements to the resource prior to initiating the feasibility trial, which is currently underway. Conclusions: This study aimed to develop and preliminarily evaluate a tablet-based application to improve provider fidelity and child engagement in child mental health treatment. If successful, this approach may serve as a key step toward making best-practice treatment more accessible to children and families. As various technologies continue to increase in popularity worldwide and within the health care field more specifically, it is essential to rigorously test the usability, feasibility, acceptability, and effectiveness of novel health technology solutions. It is also essential to ensure that patients and providers drive decision making that supports the development of these resources to ensure that they can be seamlessly integrated into practice.
  • Thumbnail Image
    Item
    Housing First and harm reduction: a rapid review and document analysis of the US and Canadian open-access literature
    (BioMed Central, 2017-05-23) Watson, Dennis P.; Shuman, Valery; Kowalsky, James; Golembiewski, Elizabeth; Brown, Molly; Social and Behavioral Sciences, School of Public Health
    BACKGROUND: Housing First is an evidence-based practice intended to serve chronically homeless individuals with co-occurring serious mental illness and substance use disorders. Despite housing active substance users, harm reduction is an often-overlooked element during the Housing First implementation process in real-world settings. In this paper, we explore the representation of the Housing First model within the open-access scholarly literature as a potential contributing factor for this oversight. METHODS: We conducted a rapid review of the US and Canadian open-access Housing First literature. We followed a document analysis approach, to form an interpretation of the articles' content related to our primary research questions. RESULTS: A total of 55 articles on Housing First were included in the final analysis. Only 21 of these articles (38.1%) included explicit mention of harm reduction. Of the 34 articles that did not discuss harm reduction, 22 provided a description of the Housing First model indicating it does not require abstinence from substance use; however, descriptions did not all clearly indicate abstinence was not required beyond program entry. Additional Housing First descriptions focused on the low-barrier entry criteria and/or the intervention's client-centeredness. CONCLUSIONS: Our review demonstrated a lack of both explicit mention and informed discussion of harm reduction in the Housing First literature, which is likely contributing to the Housing First research-practice gap to some degree. Future Housing First literature should accurately explain the role of harm reduction when discussing it in the context of Housing First programming, and public agencies promoting Housing First uptake should provide resources for proper implementation and monitor program fidelity to prevent model drift.
  • Thumbnail Image
    Item
    Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment
    (Elsevier, 2019) Davidson, Tatiana M.; Bunnell, Brian E.; Saunders, Benjamin E.; Hanson, Rochelle F.; Danielson, Carla K.; Cook, Danna; Chu, Brian C.; Dorsey, Shannon; Adams, Zachary W.; Andrews, Arthur R., III; Walker, Jesse H.; Soltis, Kathryn E.; Cohen, Judith A.; Deblinger, Esther; Ruggiero, Kenneth J.; Psychiatry, School of Medicine
    Mental health systems need scalable solutions that can reduce the efficacy-effectiveness gap and improve mental health outcomes in community mental health service settings. Two major challenges to delivery of high-quality care are providers' fidelity to evidence-based treatment models and children's and caregivers' engagement in the treatment process. We developed a novel, tablet-based application designed to enhance via technology the quality of delivery of trauma-focused cognitive-behavioral therapy (TF-CBT). We piloted its use in four community mental health service organizations using a blocked randomized controlled trial to examine the feasibility of implementing tablet-facilitated TF-CBT versus standard TF-CBT with 13 providers and 27 families. Provider fidelity and child engagement in treatment were observationally measured via session audio recording. Parent and child perceptions of the tablet application were assessed using structured interviews and mixed-method analyses. Providers actively and appropriately used tablet TF-CBT to facilitate treatment activities. Providers and families expressed high satisfaction with its use, demonstrating acceptability of this approach. Youth and caregivers in both conditions reported high alliance with their providers. Overall, we found that tablet-facilitated treatment is accepted by providers and families and may be integrated into mental health treatment with minimal training. Further study is needed to examine the extent to which technology-based applications may enhance the reach, quality, and clinical outcomes of mental health treatment delivered to children and families.
  • Thumbnail Image
    Item
    The Relationship Between Provider Competence, Content Exposure, and Consumer Outcomes in Illness Management and Recovery Programs
    (Springer, 2015) McGuire, Alan B.; White, Dominique A.; Bartholomew, Tom; Flanagan, Mindy E.; McGrew, John H.; Rollins, Angela L.; Mueser, Kim T.; Salyers, Michelle P.; Department of Psychology, School of Science
    Provider competence may affect the impact of a practice. The current study examined this relationship in sixty-three providers engaging in Illness Management and Recovery with 236 consumers. Improving upon previous research, the present study utilized a psychometrically validated competence measure in the ratings of multiple Illness Management and Recovery sessions from community providers, and mapped outcomes onto the theory underlying the practice. Provider competence was positively associated with illness self-management and adaptive coping. Results also indicated baseline self-management skills and working alliance may affect the relationship between competence and outcomes.