Browsing by Subject "Agile implementation"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Improving the User Interface and Guiding the Development of Effective Training Material for a Clinical Research Recruitment and Retention Dashboard: Usability Testing Study
    (JMIR, 2025-02-24) Gardner, Leah Leslie; Parvari, Pezhman Raeisian; Seidman, Mark; Holden, Richard J.; Fowler, Nicole R.; Zarzaur, Ben L.; Summanwar, Diana; Barboi, Cristina; Boustani, Malaz; Medicine, School of Medicine
    Background: Participant recruitment and retention are critical to the success of clinical trials, yet challenges such as low enrollment rates and high attrition remain ongoing obstacles. RecruitGPS is a scalable dashboard with integrated control charts to address these issues by providing real-time data monitoring and analysis, enabling researchers to better track and improve recruitment and retention. Objective: This study aims to identify the challenges and inefficiencies users encounter when interacting with the RecruitGPS dashboard. By identifying these issues, the study aims to inform strategies for improving the dashboard's user interface and create targeted, effective instructional materials that address user needs. Methods: Twelve clinical researchers from the Midwest region of the United States provided feedback through a 10-minute, video-recorded usability test session, during which participants were instructed to explore the various tabs of the dashboard, identify challenges, and note features that worked well while thinking aloud. Following the video session, participants took a survey on which they answered System Usability Scale (SUS) questions, ease of navigation questions, and a Net Promoter Score (NPS) question. Results: A quantitative analysis of survey responses revealed an average SUS score of 61.46 (SD 23.80; median 66.25) points, indicating a need for improvement in the user interface. The NPS was 8, with 4 of 12 (33%) respondents classified as promoters and 3 of 12 (25%) as detractors, indicating a slightly positive satisfaction. When participants compared RecruitGPS to other recruitment and study management tools they had used, 8 of 12 (67%) of participants rated RecruitGPS as better or much better. Only 1 of 12 (8%) participants rated RecruitGPS as worse but not much worse. A qualitative analysis of participants' interactions with the dashboard diagnosed a confusing part of the dashboard that could be eliminated or made optional and provided valuable insight for the development of instructional videos and documentation. Participants liked the dashboard's data visualization capabilities, including intuitive graphs and trend tracking; progress indicators, such as color-coded status indicators and comparison metrics; and the overall dashboard's layout and design, which consolidated relevant data on a single page. Users also valued the accuracy and real-time updates of data, especially the integration with external sources like Research Electronic Data Capture (REDCap). Conclusions: RecruitGPS demonstrates significant potential to improve the efficiency of clinical trials by providing researchers with real-time insights into participant recruitment and retention. This study offers valuable recommendations for targeted refinements to enhance the user experience and maximize the dashboard's effectiveness. Additionally, it highlights navigation challenges that can be addressed through the development of clear and focused instructional videos.
  • Thumbnail Image
    Item
    The Feasibility of AgileNudge+ Software to Facilitate Positive Behavioral Change: Mixed Methods Design
    (JMIR, 2024-11-13) Shojaei, Fereshtehossadat; Shojaei, Fatemehalsadat; Desai, Archita P.; Long, Emily; Mehta, Jade; Fowler, Nicole R.; Holden, Richard J.; Orman, Eric S.; Boustani, Malaz; Medicine, School of Medicine
    Background: In today's digital age, web-based apps have become integral to daily life, driving transformative shifts in human behavior. "AgileNudge+" (Indiana University Center for Health Innovation and Implementation Science) is a web-based solution to simplify the process of positive behavior change using nudging as an intervention. By integrating knowledge from behavioral economics with technology, AgileNudge+ organizes multiple steps, simplifies complex tasks, minimizes errors by enhancing user engagement, and provides resources for creating and testing nudge interventions. Objective: This paper aimed to outline the design process, methodologies, and usefulness of "AgileNudge+" for the development of evidence-based nudges. It used a mixed methods approach to evaluate the software's interface usability and usefulness for creating and testing nudge interventions. Methods: AgileNudge+ was developed through iterative processes integrating principles from behavioral economics and user-centered design. The content of AgileNudge+ operationalizes an Agile science-based process to efficiently design, embed, and disseminate evidence-based nudges that encourage positive behavior change without limiting choice. Using a mixed methods approach, we tested AgileNudge+ software's ability to organize and simplify the nudge intervention process, allowing a diverse range of scholars with limited knowledge of Agile science to use nudges. Usability testing assessed the tool's usefulness and interface with a sample of 18 health care professionals, each asked to interact with the software and create a nudge intervention to solve a problem within their professional project's sphere. Results: The study was funded in August 2022, with data collection occurring from June 2023 to July 2024. As of July 2024, we have enrolled 18 participants. Quantitative results found a mean usefulness rating of AgileNudge+ of 3.83 (95% CI 3.00-4.66). Qualitative results highlighted ways to modify the language used in AgileNudge+ to be more comprehensible to a diverse user base and promoted modifications to the software that facilitate real-time assistance and prioritize time efficiency in user interactions. Feedback further supported the positive impact of gamification on participant motivation when using the software. Conclusions: AgileNudge+ is an effective assistive tool for simplifying the positive behavior change process using nudge interventions, with tailored content and interactions to meet users' needs and demands. Building onto the current design, future iterations of AgileNudge+ will use artificial intelligence to process large volumes of data while reducing the time and mental energy required to scan for existing cognitive biases and nudge prototypes. The software is also being upgraded to build on current gamification efforts, encouraging more sustained motivation by increasing the temporal resolution of the digital interface. These modifications stay true to the agility and user-centered aspects of AgileNudge+, emphasizing the novelty of the constantly evolving software design process.