Browsing by Author "Dolan, Levi"
Now showing 1 - 10 of 14
Results Per Page
Sort Options
Item 184 Cross-institutional collaborations for health equity research at a CTSA(Cambridge University Press, 2022-04-19) Whipple, Elizabeth C.; Ramirez, Mirian; Dolan, Levi; Hunt, Joe D.; Ruth Lilly Medical Library, School of MedicineOBJECTIVES/GOALS: We were interested in health equity research for each CTSA-affiliated institution, specifically focusing on cross department and cross-campus co-authorship. We conducted a bibliometric analysis of our CTSA-funded papers relating to diversity and inclusion to identify cross department and cross-campus collaborations. METHODS/STUDY POPULATION: We worked with our CTSAs Racial Justice, Diversity, Equity and Inclusion Task Force to conduct an environmental scan of diversity and inclusion research across our CTSA partner institutions. Using the Scopus database, searches were constructed to identify and retrieve the variety of affiliations for each of the CTSA authors, a health equity/health disparities search hedge, and all of our CTSA grant numbers. We limited the dates from the beginning of our CTSA in 2008-November 2021. We used PubMed to retrieve all MeSH terms for the articles. We used Excel to analyze the data, Python and NCBIs Entrez Programming Utilities to analyze MeSH terms, and VOSviewer to produce the visualizations. RESULTS/ANTICIPATED RESULTS: The results of this search yielded 94 articles overall. We broke these up into subsets (not mutually exclusive) to represent five of the researcher groups across our CTSA. We analyzed the overall dataset for citation count, normalized citation count, CTSA average authors, gender trends, and co-term analysis. We also developed cross department co-authorship maps and cross-institutional/group co-authorship maps. DISCUSSION/SIGNIFICANCE: This poster will demonstrate both the current areas where cross-departmental and cross-institutional collaboration exists among our CTSA authors, as well as identify potential existing areas for collaboration to occur. These findings may determine areas our CTSA can support to improve institutional performance in addressing health equity.Item Analysis of Public Preprint Server Comments on NIH Preprint Pilot Articles(2022-05-04) Sawyer, Amanda; Cruise, Allison; Dolan, Levi; Chatmon, BriannaObjectives: Given the increased prevalence of preprints during the COVID-19 pandemic, this project sought to analyze public comments left on a sample of preprint articles from the NIH Preprint Pilot to determine if they were substantive in nature. Analysis of article titles and qualitative coding of the comments was conducted. This analysis was designed to obtain both quantitative and qualitative measures of comments on a selected group of articles so that the relationship between public commenting and scientific rigor could be explored. Methods: The first 1,000 preprint articles to be indexed in PubMed Central and hosted on two preprint platforms (bioRxiv and medRxiv) were selected. Using the preprint servers’ associated commenting platforms, full text comment threads and Twitter information was obtained, and summary statistics of commenting platforms were produced. From the article sample a total of 494 comments were collected from public commenters using the Disqus platform to provide feedback on the articles. Using the article titles, the authors explored indications of the relationship between article topic and frequency of commenter engagement. Preliminary coding was conducted using a ‘thumbs up/thumbs down’ method and potential categorizations were suggested. Utilizing these suggestions, the authors created and refined a draft codebook. Finally, thirteen categorizations, ten for substantive comments and three for not substantive comments, were created and used to qualitatively code the comment sample. Results: Two rounds of coding were completed to reach sufficient interrater reliability. The authors found that most of the public comments were substantive, with over 28% meeting the criteria for critique, 21.5% as questions for authors, and over 11% having aspects of a formal peer review process. The analysis revealed engagement between commenters and preprint authors, demonstrated through author responses to questions, updates, and feedback. Commenters also provided suggestions for future research (3.6%) and indicated their intent to utilize the preprint findings in future research projects of their own (2.6%). Conclusions: This project provides evidence of the impact of public commenting on scientific rigor. Public commenting was frequently substantive, and provided critique which sometimes led to direct revisions of the preprint article. Commenters also provided responses similar in nature to the formal peer review process, providing authors with feedback faster than the traditional process. Through preprints authors can disseminate their research to a wide audience earlier, and comments indicated that some readers intended to use the preprint findings in their own research, accelerating the potential for scientific discovery. As the prevalence of preprints continues to grow and public engagement with preprints increases, this paper’s methodology can be replicated and refined to further analyze the value of public commenting on preprints.Item Asking Data Analysis Questions with PandasAI(2023-11-08) Dolan, LeviAs easily accessible AI models have increased in visibility, one area of interest for those working with datasets programmatically is how AI might streamline common data analysis tasks. The recently-released PandasAI library is a Python library that connects to an OpenAI model (known for ChatGPT) and allows users to ask natural language-style questions about dataframes created in Pandas syntax. This lightning talk demonstrates how to start exploring this data analysis method using sample World Bank and World Happiness Report data. Potential limitations are also discussed.Item Copy and Pasting vs. Customization: Using Qualitative Analysis of NIH Grantees’ Data Management Plans to Shape Future DMP Support(2022-03-17) Dolan, Levi; Whipple, Elizabeth C.; Coates, Heather L.In 2019, our school began requiring all of its NIH grantees to submit data management plans designed to prepare researchers for future requirements, such as the NIH Final Policy on Data Management and Sharing. In 2020-2021, the second year of this mandate, we achieved near 100% compliance with 600+ project-level DMP submitted. This presentation discusses analyzing the free text responses for the 2020-2021 set of DMPs. These responses describe practices related to data collection procedures, QA/QC procedures, data retention periods, data sharing, and access permissions when team members leave. Additionally, we asked respondents to identify relevant funder data management or sharing requirements, citations for data reuse, and applicable standards for data and metadata so that we could gauge awareness of these topics. Our analytical process involves iteratively creating a codebook based on a randomly selected subset of DMP responses. Once the codebook has been developed, we will independently code a second subset of DMP responses to establish inter-rater reliability, then code the entire data set of DMP responses. We will summarize these results using descriptive statistics and visualizations of the themes identified. We will also explain how we plan to use these findings to create guidance for future support and development of DMPs for NIH grantees. Of particular interest will be any evidence for substantive customization of DMPs when the research warrants the sharing of data, versus evidence of “box ticking” behaviors and other priorities that take precedence over sharing. By identifying existing practices, this analysis may also help us surface successful data management and sharing strategies that can be propagated across communities of practice.Item Cross-institutional collaborations for health equity research at a CTSA(2022-04-20) Whipple, Elizabeth C.; Ramirez, Mirian; Dolan, Levi; Hunt, Joe D.Objective/Goals: We were interested in health equity research for each CTSA-affiliated institution, specifically focusing on cross department and cross-campus co-authorship. We conducted a bibliometric analysis of our CTSA-funded papers relating to diversity and inclusion to identify cross department and cross-campus collaborations. Methods/Study Population: We worked with our CTSA’s Racial Justice, Diversity, Equity and Inclusion Task Force to conduct an environmental scan of diversity and inclusion research across our CTSA partner institutions. Using the Scopus database, searches were constructed to identify and retrieve the variety of affiliations for each of the CTSA authors, a health equity/health disparities search hedge, and all of our CTSA grant numbers. We limited the dates from the beginning of our CTSA in 2008-November 2021. We used PubMed to retrieve all MeSH terms for the articles. We used Excel to analyze the data, Python and NCBI’s Entrez Programming Utilities to analyze MeSH terms, and VOSviewer to produce the visualizations. Results/Anticipated Results: The results of this search yielded 94 articles overall. We broke these up into subsets (not mutually exclusive) to represent five of the researcher groups across our CTSA. We analyzed the overall dataset for citation count, normalized citation count, CTSA average authors, gender trends, and co-term analysis. We also developed cross department co-authorship maps and cross-institutional/group co-authorship maps. Discussion/Significance of Impact: This poster will demonstrate both the current areas where cross-departmental and cross-institutional collaboration exists among our CTSA authors, as well as identify potential existing areas for collaboration to occur. These findings may determine areas our CTSA can support to improve institutional performance in addressing health equity.Item Electronic Lab Notebooks in Practice(2023-03-29) Dolan, Levi; Whipple, Elizabeth C.Electronic lab notebooks (ELN ) are increasingly being adopted by research institutions to manage lab data organization, sharing, and preservation, and also for physical lab space efficiency. LabArchives, one popular ELN product, has been in use at Indiana University since 2019 and is supported by the Ruth Lilly Medical Library. To assess the impact of ELNs at IU since they have been introduced at IU, we analyzed LabArchives data monthly reports from the Spring 0f 2019-Fall 2022 using a Python script in order to develop new usage metrics to track. From these metrics, we identified recent “super users”. Then we reached out for their feedback on how ELNs are being used in practice. This feedback will inform future library training workshops and outreach to improve support for ELNs at IU.Item From Overview to Hands-On Practice: Iterating NIH Data Management & Sharing Plan Support(2023-10-12) Dolan, Levi; Whipple, Elizabeth C.OBJECTIVES: In the past year, many librarians have been providing enhanced data management user support relating to NIH Data Management and Sharing Policy (DMSP) implementation. This study aims to make preliminary comparisons of attendee response and librarian workload surrounding two different hour-long library classes offered on the NIH DMSP. One class focused on policy overview and another was structured around active engagement with our institutional workflow, using materials and guidance we created. METHODS: Both classes were offered five times during the Fall 2022-beginning of Summer 2023. In Fall 2022, only the overview class was offered. The workflow class debuted in Spring 2023. We compared attendance numbers, demographics of attendees, and librarian time spent in DMSP consults before and after the second class was implemented. RESULTS: Mean attendance for both classes was similar; the overview class had slightly higher mean attendance than the workflow class. The highest attendance for a single class was for the first workflow class offered. The time spent on individual consults decreased after the workflow class was implemented. CONCLUSIONS: The decrease in time spent on consults after the workflow class was implemented is a potential indicator that this format increased instruction effectiveness and librarian efficiency. The comparisons are limited by small sample size and an unknown degree of variable dependency on timing related to other factors, such as the academic year and the NIH grant cycle calendar.Item Impact metrics for non-traditional research outlets Cheat Sheet(2024-03-07) Ramirez, Mirian; Whipple, Elizabeth C.; Dolan, LeviItem Mapping Diversity, Equity, and Inclusion research in medical education journals: An exploratory bibliometric analysis, 2018-2022(2023-05-16) Ramirez, Mirian; Dolan, LeviObjectives: More medical schools are incorporating Diversity, Equity, and Inclusion (DEI) competencies into their institutional practices as the academic medicine community support programs and projects designed to build cultural humility in medical education, clinical care, and research. This study aims to identify and analyze items covering DEI-related topics published in medical education journals in the last five years (2018-2022). We performed a bibliometric analysis investigating the overall patterns of published articles, including the annual publication distribution, distribution by journal, and analysis of keywords. This approach aims to contribute to a better understanding of the characteristics of DEI-related research in medical education. Methods: We conducted a bibliometric analysis on articles published in a set of 56 core medical education journals indexed in Pubmed from 2018 to 2022. The searches were conducted in January 2023. To retrieve and gather citations for published articles, we used the Pubmed database. First, we used the NLM catalog to search and identify the subset of journals that are referenced in NCBI database records classified with “Education,Medical”[Mesh] OR "education"[MeSH Subheading] in the English language. Next, we developed and executed a comprehensive search to find articles that contained terms related to DEI; we used the Association of American Medical Colleges (AAMC) "Diversity, Equity, and Inclusion Competencies Across the Learning Continuum" ([LINK]https://store.aamc.org/downloadable/download/sample/sample_id/512/[/LINK]) as a guide to identifying the terminology to use in the search. We used Excel to aggregate, clean up and analyze the data,and VOSviewer software was utilized to create the topic analysis and visualization map. Results: For the 2018-2022 time frame, 3,158 (out of 33,395, 9.5%) publications covering DEI topics were published in the selected journals. We will undertake term co-occurrence analysis on the keywords in the abstract as well as publishing trend analysis, source analysis, and overall dataset analysis as part of our study. Conclusions: This poster will show an examination of articles about DEI subjects written in medical education journals over the previous five years and indexed in Pubmed. We will outline the characteristics of the top journals that published the research and topic trends of articles. The findings may support researchers and faculty in the health sciences disciplines when making decisions for developing a publication and research strategy. Researchers who seek DEI pathways to meet their promotion and tenure criteria will also benefit from understanding the results of this analysis.Item Methods for Medical Student Research Projects(2024-05-20) Dolan, Levi; Han, AmySymposium participation by invitation, no abstract submitted.