From Daunting to Doable: Tools for Qualitative Evaluation of a Complex Public Health Intervention

Abstract

To address complex problems like health disparities, public health interventions have become increasingly ‘‘complex’’—engaging multisector partners and communities at multiple ecological levels. Complex interventions are intentionally flexible, making them challenging to evaluate with predetermined measures. While innovative evaluation methods tailored to complex interventions have been developed, there is a need for practical guidance to enhance capacity within public health. This article describes the qualitative FIND (Frame, Identify, Narrow, Do) evaluation process for a complex, community-engaged health equity intervention. Illustrative examples and take-away tools are provided. The FIND process is sensitive to complexity, involving ongoing data collection that helps guide implementation. The evaluator is embedded within the project team, facilitating frequent, direct interaction between the evaluator and those whose roles position them to hear or see happenings with the on-the-ground implementation in real time. The FIND process includes (a) developing a flexible framework for determining relevant processes and outcomes, (b) identifying important project events, (c) narrowing in on the most impactful events, and (d) making decisions informed by data. Using the FIND process, the project team learned about significant project events that would have been missed without a complexity-sensitive approach. Having the evaluator embedded within the project team, rather than as an independent entity, was crucial for understanding and utilizing on-the-ground developments in an evolving intervention. There is a need for more practical guidance to build capacity for evaluating complex public health interventions, including strategies for communicating with stakeholders about approaches that diverge from traditional scientific norms.