Browsing by Author "Waldron, Levi"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Best practices to evaluate the impact of biomedical research software-metric collection beyond citations
    (Oxford University Press, 2024) Afiaz, Awan; Ivanov, Andrey A.; Chamberlin, John; Hanauer, David; Savonen, Candace L.; Goldman, Mary J.; Morgan, Martin; Reich, Michael; Getka, Alexander; Holmes, Aaron; Pati, Sarthak; Knight, Dan; Boutros, Paul C.; Bakas, Spyridon; Caporaso, J. Gregory; Del Fiol, Guilherme; Hochheiser, Harry; Haas, Brian; Schloss, Patrick D.; Eddy, James A.; Albrecht, Jake; Fedorov, Andrey; Waldron, Levi; Hoffman, Ava M.; Bradshaw, Richard L.; Leek, Jeffrey T.; Wright, Carrie; Pathology and Laboratory Medicine, School of Medicine
    Motivation: Software is vital for the advancement of biology and medicine. Impact evaluations of scientific software have primarily emphasized traditional citation metrics of associated papers, despite these metrics inadequately capturing the dynamic picture of impact and despite challenges with improper citation. Results: To understand how software developers evaluate their tools, we conducted a survey of participants in the Informatics Technology for Cancer Research (ITCR) program funded by the National Cancer Institute (NCI). We found that although developers realize the value of more extensive metric collection, they find a lack of funding and time hindering. We also investigated software among this community for how often infrastructure that supports more nontraditional metrics were implemented and how this impacted rates of papers describing usage of the software. We found that infrastructure such as social media presence, more in-depth documentation, the presence of software health metrics, and clear information on how to contact developers seemed to be associated with increased mention rates. Analysing more diverse metrics can enable developers to better understand user engagement, justify continued funding, identify novel use cases, pinpoint improvement areas, and ultimately amplify their software's impact. Challenges are associated, including distorted or misleading metrics, as well as ethical and security concerns. More attention to nuances involved in capturing impact across the spectrum of biomedical software is needed. For funders and developers, we outline guidance based on experience from our community. By considering how we evaluate software, we can empower developers to create tools that more effectively accelerate biological and medical research progress. Availability and implementation: More information about the analysis, as well as access to data and code is available at https://github.com/fhdsl/ITCR_Metrics_manuscript_website.
  • Thumbnail Image
    Item
    Refining colorectal cancer classification and clinical stratification through a single-cell atlas
    (Springer, 2022-05-11) Khaliq, Ateeq M.; Erdogan, Cihat; Kurt, Zeyneb; Turgut, Sultan Sevgi; Grunvald, Miles W.; Rand, Tim; Khare, Sonal; Borgia, Jeffrey A.; Hayden, Dana M.; Pappas, Sam G.; Govekar, Henry R.; Kam, Audrey E.; Reiser, Jochen; Turaga, Kiran; Radovich, Milan; Zang, Yong; Qiu, Yingjie; Liu, Yunlong; Fishel, Melissa L.; Turk, Anita; Gupta, Vineet; Al-Sabti, Ram; Subramanian, Janakiraman; Kuzel, Timothy M.; Sadanandam, Anguraj; Waldron, Levi; Hussain, Arif; Saleem, Mohammad; El-Rayes, Bassel; Salahudeen, Ameen A.; Masood, Ashiq; Medicine, School of Medicine
    Background Colorectal cancer (CRC) consensus molecular subtypes (CMS) have different immunological, stromal cell, and clinicopathological characteristics. Single-cell characterization of CMS subtype tumor microenvironments is required to elucidate mechanisms of tumor and stroma cell contributions to pathogenesis which may advance subtype-specific therapeutic development. We interrogate racially diverse human CRC samples and analyze multiple independent external cohorts for a total of 487,829 single cells enabling high-resolution depiction of the cellular diversity and heterogeneity within the tumor and microenvironmental cells. Results Tumor cells recapitulate individual CMS subgroups yet exhibit significant intratumoral CMS heterogeneity. Both CMS1 microsatellite instability (MSI-H) CRCs and microsatellite stable (MSS) CRC demonstrate similar pathway activations at the tumor epithelial level. However, CD8+ cytotoxic T cell phenotype infiltration in MSI-H CRCs may explain why these tumors respond to immune checkpoint inhibitors. Cellular transcriptomic profiles in CRC exist in a tumor immune stromal continuum in contrast to discrete subtypes proposed by studies utilizing bulk transcriptomics. We note a dichotomy in tumor microenvironments across CMS subgroups exists by which patients with high cancer-associated fibroblasts (CAFs) and C1Q+TAM content exhibit poor outcomes, providing a higher level of personalization and precision than would distinct subtypes. Additionally, we discover CAF subtypes known to be associated with immunotherapy resistance. Conclusions Distinct CAFs and C1Q+ TAMs are sufficient to explain CMS predictive ability and a simpler signature based on these cellular phenotypes could stratify CRC patient prognosis with greater precision. Therapeutically targeting specific CAF subtypes and C1Q + TAMs may promote immunotherapy responses in CRC patients.