Browsing by Author "Lipori, Gloria"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    A large language model for electronic health records
    (Springer Nature, 2022-12-26) Yang, Xi; Chen, Aokun; PourNejatian, Nima; Shin, Hoo Chang; Smith, Kaleb E.; Parisien, Christopher; Compas, Colin; Martin, Cheryl; Costa, Anthony B.; Flores, Mona G.; Zhang, Ying; Magoc, Tanja; Harle, Christopher A.; Lipori, Gloria; Mitchell, Duane A.; Hogan, William R.; Shenkman, Elizabeth A.; Bian, Jiang; Wu, Yonghui; Health Policy and Management, Richard M. Fairbanks School of Public Health
    There is an increasing interest in developing artificial intelligence (AI) systems to process and interpret electronic health records (EHRs). Natural language processing (NLP) powered by pretrained language models is the key technology for medical AI systems utilizing clinical narratives. However, there are few clinical language models, the largest of which trained in the clinical domain is comparatively small at 110 million parameters (compared with billions of parameters in the general domain). It is not clear how large clinical language models with billions of parameters can help medical AI systems utilize unstructured EHRs. In this study, we develop from scratch a large clinical language model—GatorTron—using >90 billion words of text (including >82 billion words of de-identified clinical text) and systematically evaluate it on five clinical NLP tasks including clinical concept extraction, medical relation extraction, semantic textual similarity, natural language inference (NLI), and medical question answering (MQA). We examine how (1) scaling up the number of parameters and (2) scaling up the size of the training data could benefit these NLP tasks. GatorTron models scale up the clinical language model from 110 million to 8.9 billion parameters and improve five clinical NLP tasks (e.g., 9.6% and 9.5% improvement in accuracy for NLI and MQA), which can be applied to medical AI systems to improve healthcare delivery. The GatorTron models are publicly available at: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/clara/models/gatortron_og
  • Thumbnail Image
    Item
    Implementation context for addressing social needs in a learning health system: a qualitative study
    (Cambridge University Press, 2021-08-31) Theis, Ryan P.; Blackburn, Katherine; Lipori, Gloria; Harle, Christopher A.; Alvarado, Michelle M.; Carek, Peter J.; Zemon, Nadine; Howard, Angela; Salloum, Ramzi G.; Shenkman, Elizabeth A.; UF CTSI Learning Health System Program; Health Policy and Management, Richard M. Fairbanks School of Public Health
    Introduction: Unmet social needs contribute to growing health disparities and rising health care costs. Strategies to collect and integrate information on social needs into patients' electronic health records (EHRs) show promise for connecting patients with community resources. However, gaps remain in understanding the contextual factors that impact implementing these interventions in clinical settings. Methods: We conducted qualitative interviews with patients and focus groups with providers (January-September 2020) in two primary care clinics to inform the implementation of a module that collects and integrates patient-reported social needs information into the EHR. Questions addressed constructs within the Theoretical Framework for Acceptability and the Consolidated Framework for Implementation Research. Data were coded deductively using team-based framework analysis, followed by inductive coding and matrix analyses. Results: Forty patients participated in interviews, with 20 recruited at the clinics and 20 from home. Two focus groups were conducted with a total of 12 providers. Factors salient to acceptability and feasibility included patients' discomfort answering sensitive questions, concerns about privacy, difficulty reading/understanding module content, and technological literacy. Rapport with providers was a facilitator for patients to discuss social needs. Providers stressed that limited time with patients would be a barrier, and expressed concerns about the lack of available community resources. Conclusion: Findings highlight the need for flexible approaches to assessing and discussing social needs with patients. Feasibility of the intervention is contingent upon support from the health system to facilitate social needs assessment and discussion. Further study of availability of community resources is needed to ensure intervention effectiveness.