Supporting the GME scholarship requirement: A pilot study of two library interventions

Abstract

Introduction ACGME continues to require Family Medicine (FM) residents to complete two Scholarly Projects.1 To increase residents’ library skills in searching for and identifying high-quality literature, a pilot study was created to determine the training needs of FM residents and the effectiveness of the targeted training. In the first year, residents were provided with training on efficiently locating targeted and relevant articles and were introduced to the myriad of library resources available. Based on feedback from the 2021-2022 intervention, librarian liaisons developed an asynchronous educational intervention focused on citation management software (e.g., EndNote, Mendeley). The intervention addressed EndNote skills and the utility of using EndNote to create a library of citations and to easily cite that literature in their scholarly presentations. This pilot study assessed differences in residents' knowledge, usage of resources, and confidence before and after library interventions. [Fig. 1]

Hypothesis Family Medicine residents' knowledge and utilization of library resources and citation management tools will increase after the library interventions.

Methods To capture Family Medicine (FM) residents' knowledge and confidence about their scholarship projects, library liaisons created a pretest and a posttest, each with nine questions. Both tests were based on the Research Readiness-Focused Assessment Instrument developed by Rui Wang and outlined in the article “Assessment for One-Shot Library Instruction: A Conceptual Approach”2 Wang’s single-session assessment instrument was adapted to fit the multiple-session library intervention and questions specifically about citation management were added. Pre and posttests asked residents about their comfort using a citation manager and their level of confidence in completing the scholarship project. It also assessed database searching skills. Residents completed the pretest at the beginning of the first library intervention and the posttest directly after the second library intervention. The first library intervention was in-person in a library classroom where database searching skills were taught, and library resources were highlighted. The second library intervention was a 15-minute video about citation management and how to use EndNote software. QR codes were included in both library interventions which allowed residents to access the pretest and posttest on their phone. Data was collected and analyzed.

Results Ten of 13 Family Medicine residents completed the pretest in 2022 before attending the first library session. Eleven of 12 remaining Family Medicine residents completed the posttest in 2023 after watching a 15-minute video on citation management tools and on EndNote, specifically.

Pretest data confirmed: *residents lack knowledge in locating library resources. [Fig. 2] *residents are not comfortable with citation management tools. *some residents understood how to use Boolean terms to narrow and expand search results in PubMed. [Fig. 3]

Posttest data showed: *residents were clearer about where to search for sources for their research. [Fig 2] *all residents understood how to use Boolean terms to narrow and expand search results in PubMed. [Fig. 3] *residents were more comfortable using citation managers. [Fig. 4] *residents identified more precise and suitable resources for scholarly research (ex. PubMed mentioned by 3 residents in the pretest and mentioned by 7 residents in the posttest) [Table 1]

Conclusions These educational interventions provided residents with tools to meet the ACGME scholarship requirements. The majority of PGY-2 residents found the addition of a citation management session to provide useful information.

Next Steps Seek IRB approval to conduct further research on this topic. Modify pre and posttests to only measure library resource knowledge and skills. Adjust timing of the 2nd library intervention to better fit into residents’ schedules.

References Accreditation Council on Graduate Medical Education. ACGME Program Requirements for Graduate Medical Education in Family Medicine. June 12, 2022. Wang R. Assessment for one-shot library instruction: A conceptual approach. portal: Libraries and the Academy. 2016;16(3):619-48.