Browsing by Subject "altmetrics"
Now showing 1 - 10 of 13
Results Per Page
Sort Options
Item Altmetrics 101(2016-12-08) Coates, Heather L.Item Changing the culture of P&T through conversations about research metrics(IUPUI University Library, 2019-02-26) Coates, Heather L.Since 2012, librarians at the IUPUI University Library have been providing support for faculty use of metrics in dossiers for promotion and tenure. During these consultations to learn about their research, faculty were willing to discuss their values as a scholar, the types of work they feel are most important and valuable, the pressures and expectations of their departments and schools, among other things. The richness of these conversations led us to expand our metrics services beyond provision of data. We developed a proactive strategy to help faculty take charge of their digital profiles and scholarly dissemination, as well as outreach and trainings to engage with campus administrators, associate deans for research, and department chairs, with the goal of promoting responsible use of metrics in the promotion and tenure process. This presentation will describe our approach to consultations, training, and advocacy in developing P&T standards and processes that align with institutional and disciplinary values and promote scholar choice in methodology, product, and dissemination.Item Defining and Measuring Research Impact in the Humanities(2023-04-05) Coates, Heather L.Research impact is loosely defined as how broadly scholarly research is being read, discussed, and used both inside and outside of the academy. Metrics tools are firmly established in the Sciences, but they are not designed to capture the impact of Humanities research. This talk will review the evidence base for citation-based and alternative research impact metrics for the Humanities (HuMetricsHSS and Metrics Toolkit), and will offer an opportunity to investigate and challenge the biases of Anglophone and science-based ranking systems.Item Demonstrating impact as a practitioner-researcher(Figshare: https://dx.doi.org/10.6084/m9.figshare.3180370.v3, 2016-04-18) Coates, Heather L.Librarians have a unique perspective on the scholarly ecosystem as authors, consumers, and stewards. This perspective, combined with our roles in collecting and curating information, enables librarians to identify changes in policy, practice, and technology that can improve the openness, transparency, and sustainability of the scholarly ecosystem. It also reveals opportunities for aligning institutional and professional incentives with these changes. I will share examples of evidence used in my promotion and tenure dossier to demonstrate how librarian practitioner-scholars can be both advocates and exemplars for the changes we want to see in open access, data, and educational resources.Item Law Libraries as Publishers: Counting Things, with Altmetrics(2016-01) Keele, Benjamin J.; Ruth Lilly Law LibraryItem Metrics for Evaluating the Impact of Data Sets(MIT Press Direct, 2022-01) Champieux, Robin; Coates, Heather L.Research is a social activity, involving a complex array of resources, actors, activities, attitudes, and traditions (Sugimoto & Larivière 2018). There are many norms, including the sharing of new work in the form of books and journal articles and the use of citations and acknowledgments to recognize the influence of earlier work, but what it means to produce impactful scholarship is difficult to define and measure. The goals, methods, metrics, and utility of evaluating the impact of data sets are situated within this broader context of scholarly communication and evaluation. An understanding of the dynamic history, current practices, concepts, and critiques of measuring impact for and beyond research data sets can help researchers navigate the scholarly dissemination landscape more strategically and gain agency in regard to how they and their work are evaluated and described. What is research impact? As Roemer and Borchardt (2015) describe, the concept involves two important ideas: the change a work influences and the strength of this effect. These effects can include, but are not limited to, advances in understanding and decision making, policy creation and change, economic development, and societal benefits. For example, rich documentation of an endangered language might lead to and support community and governmental revitalization efforts. However, the linkages between a specific scholarly product and its effects are rarely direct, there are disciplinary differences between how research is communicated and endorsed, and some outcomes take a very long time to manifest (Greenhalgh et al. 2016). This makes the assessment of research impact very labor intensive, even at a small scale, so researchers and decision makers often rely on data and metrics that are regarded as indicative of certain kinds of impact.Item News coverage of public health research: An exploratory study of topics, coverage, and open access status(2022-04-27) Ramirez, Mirian; Hinrichs, Rachel J.OBJECTIVES: This study aims to identify and analyze the news outlets that mention research published by a School of Public Health at a Midwestern university. We analyzed the overall patterns of news sources, including the content type and overall coverage, the correlation with open access (OA) status (both gold and green OA), and the topics that received the most attention in the news. Our results will contribute to a better understanding of the characteristics of news outlets that disseminate public health information, and the types of research mentioned most often in the news. METHODS: We conducted a bibliometric analysis of publications from authors affiliated with a School of Public Health over five years (2015-2019). The searches were conducted in December 2021. We queried Scopus using an affiliation search to identify and retrieve the publications. Then we queried Altmetric Explorer for all the citations from the Scopus search, using the identifiers and the titles to compile the altmetrics data and identify the titles mentioned in news outlets. We used Excel to aggregate, clean up and analyze the data, and VOSviewer software to generate the topic analysis and visualization map. RESULTS: Between 2015 and 2019, 778 publications were published by the School of Public Health. A total of 144 (18.5%) were mentioned in 2,079 news stories from 643 news sources. We analyzed the overall dataset of news outlets according to the source and content type, subject area, and country of publication. We also determined whether OA articles were discussed more often in the news than subscription access articles. We also performed a co-occurrence analysis of the author and abstract keywords of the articles mentioned in news outlets. CONCLUSIONS: Mentions of scholarly articles in news outlets can identify patterns and trends of attention and interest in research beyond academia. This poster analyzed the top news sources that mentioned the research generated by the faculty of a School of Public Health, and the OA status of articles that received mentioned in the news. These findings may support the decision-making of leaders of the school regarding future publication and research strategy development directions.Item Policy impact of COVID-19 research published by the IU School of Medicine: An exploratory bibliometric analysis, 2020-2021(2023-04-28) Ramirez, Mirian; Whipple, Elizabeth C.Introduction/Background: Policy documents serve as an essential reference point in the process of developing and implementing policies that have an impact on various aspects of society, including healthcare. This is especially evident in the way that governments around the world have responded to the COVID-19 pandemic by implementing measures to control the spread of the virus and to protect public health. Policies outline actions and provide guidance for policy implementation to inform decision-making at all levels of government and society. Regulations, guidelines, white papers, and reports are just a few examples of the different types of policy documents that can be issued by governmental agencies and institutions, intergovermental organizations, research institutes, think tanks, and other groups. These written statements are the outcome of the research and evidence analysis that has been conducted. Regarding research impact, the citations of publications used in policy documents provide evidence that the policies are based on reliable and authoritative sources of information. They also reflect the utility and quality of research output. In this exploratory bibliometric analysis, we present an overview of altmetrics (or alternative metrics) data, specifically for citations in policy documents, for IU School of Medicine (IUSM) publications. Study objective: This study aims to identify and analyze the policy documents that mention research published by the IU School of Medicine from 2020-2021. We analyzed the overall characteristics of policy documents, including type, geography, institution of origin, language, year of publication, and time-lag. We also analyzed the overall publication patterns of the articles cited in policy documents, including the availability of preprint versions of the publications cited in policy documents and funding support information. This approach aims to contribute to a better understanding of the characteristics of policy document sources that disseminate COVID-19 publications generated by the IUSM, and the types of research mentioned most often in the policy documents. Methods We used the PubMed database to search and find accurate citations of research articles published by IUSM authors during 2020-2021 related to COVID-19. Articles were searched using a combination of keywords and MeSH Terms related to “COVID-19” OR “Sars-Cov-2 ”, combined with our in-house developed affiliation name search. To identify mentions in policy documents the Overton.io platform, bibliometric database of policy documents citations, was used. Excel was used to aggregate, clean up and analyze the data and to generate the analysis and network visualizations. Results and Conclusions Overall, 71 (14.5%) of the 564 publications have been cited 192 times in 161 policy sources (1.2 average citations per document) by time of data collection (January 10, 2023). The cited articles identified were published in 57 journals; the journal with the most cited articles (2 articles, ≥ 31 citations) was JAMA. Most of the citations associated with these articles come from sources generated by the Centers for Disease Control and Prevention (CDC) (33 citations). The findings provide relevant insight to the IUSM research community concerning policy documents mentioned and may support researchers when making decisions for developing a publication and research strategy.Item Research Evaluation: Imagining a Better Way(2016-11-13) Coates, Heather L.Item Upskilling the promotion and tenure process: Training administrators for responsible use of research impact metrics(IUPUI University Library, 2018-10) Coates, Heather L.; Odell, Jere D.; Pike, CaitlinSchool and departmental administrators are tasked with evaluating the research output of their faculty as part of the promotion and tenure review process. At our institution, this evaluation is communicated in a letter describing the dissemination venues for the candidate’s research publications, typically journals. Seen in one light, the letter is an opportunity for the school or departmental administrator to advocate for the candidate. However, the focus on dissemination venue rather than on the article or product itself wastes an opportunity to describe the value of the candidate’s work in the context of their discipline and institution. Instead of providing rich information about the work, these letters often copy content from the publisher website and provide Journal Impact Factors, when available, without context. To encourage schools and departments to produce stronger letters in the assessment of a candidate’s dissemination venues, we developed a targeted training for Associate Deans for Research and Department Chairs. The opportunity to develop this training resulted from a broader conversation with faculty about journal cuts and other changes in the library’s strategy for providing access to scholarly content. The faculty asked the library to provide training about changes in scholarly publishing, citation metrics, and altmetrics. Given the time constraints of the audience, our training focuses on providing practical guidance for using and understanding new sources of evidence when writing and reading evaluation letters for promotion and tenure. In addition to describing the content and the institutional context for the training sessions, we will discuss the long-term implications of this effort.