A Systematic Review of ChatGPT and Other Conversational Large Language Models in Healthcare.

Background: The launch of the Chat Generative Pre-trained Transformer (ChatGPT) in November 2022 has attracted public attention and academic interest to large language models (LLMs), facilitating the emergence of many other innovative LLMs. These LLMs have been applied in various fields, including healthcare. Numerous studies have since been conducted regarding how to employ state-of-the-art LLMs in health-related scenarios to assist patients, doctors, and public health administrators. Objective: This review aims to summarize the applications and concerns of applying conversational LLMs in healthcare and provide an agenda for future research on LLMs in healthcare. Methods: We utilized PubMed, ACM, and IEEE digital libraries as primary sources for this review. We followed the guidance of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) to screen and select peer-reviewed research articles that (1) were related to both healthcare applications and conversational LLMs and (2) were published before September 1st, 2023, the date when we started paper collection and screening. We investigated these papers and classified them according to their applications and concerns. Results: Our search initially identified 820 papers according to targeted keywords, out of which 65 papers met our criteria and were included in the review. The most popular conversational LLM was ChatGPT from OpenAI (60), followed by Bard from Google (1), Large Language Model Meta AI (LLaMA) from Meta (1), and other LLMs (5). These papers were classified into four categories in terms of their applications: 1) summarization, 2) medical knowledge inquiry, 3) prediction, and 4) administration, and four categories of concerns: 1) reliability, 2) bias, 3) privacy, and 4) public acceptability. There are 49 (75%) research papers using LLMs for summarization and/or medical knowledge inquiry, and 58 (89%) research papers expressing concerns about reliability and/or bias. We found that conversational LLMs exhibit promising results in summarization and providing medical knowledge to patients with a relatively high accuracy. However, conversational LLMs like ChatGPT are not able to provide reliable answers to complex health-related tasks that require specialized domain expertise. Additionally, no experiments in our reviewed papers have been conducted to thoughtfully examine how conversational LLMs lead to bias or privacy issues in healthcare research. Conclusions: Future studies should focus on improving the reliability of LLM applications in complex health-related tasks, as well as investigating the mechanisms of how LLM applications brought bias and privacy issues. Considering the vast accessibility of LLMs, legal, social, and technical efforts are all needed to address concerns about LLMs to promote, improve, and regularize the application of LLMs in healthcare.

Protecting Privacy of Pregnant and LGBTQ+ Research Participants.

This Viewpoint summarizes existing federal regulations aimed at protecting research data, describes the challenges of enforcing these regulations, and discusses how evolving privacy technologies could be used to reduce health disparities and advance health equity among pregnant and LGBTQ+ research participants.

Selection, optimization and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse US populations.

Polygenic risk scores (PRSs) have improved in predictive performance, but several challenges remain to be addressed before PRSs can be implemented in the clinic, including reduced predictive performance of PRSs in diverse populations, and the interpretation and communication of genetic results to both providers and patients. To address these challenges, the National Human Genome Research Institute-funded Electronic Medical Records and Genomics (eMERGE) Network has developed a framework and pipeline for return of a PRS-based genome-informed risk assessment to 25,000 diverse adults and children as part of a clinical study. From an initial list of 23 conditions, ten were selected for implementation based on PRS performance, medical actionability and potential clinical utility, including cardiometabolic diseases and cancer. Standardized metrics were considered in the selection process, with additional consideration given to strength of evidence in African and Hispanic populations. We then developed a pipeline for clinical PRS implementation (score transfer to a clinical laboratory, validation and verification of score performance), and used genetic ancestry to calibrate PRS mean and variance, utilizing genetically diverse data from 13,475 participants of the All of Us Research Program cohort to train and test model parameters. Finally, we created a framework for regulatory compliance and developed a PRS clinical report for return to providers and for inclusion in an additional genome-informed risk assessment. The initial experience from eMERGE can inform the approach needed to implement PRS-based testing in diverse clinical settings.

Intellectual conflicts of interest among cardiology and pulmonology clinical practice guidelines.

BACKGROUND: Intellectual conflicts of interest (COI), like financial COI, may threaten the validity and trustworthiness of clinical practice guidelines (CPGs). However, comparatively little is known about intellectual COI in CPGs. This study sought to estimate the prevalence of intellectual COI and corresponding management strategies among cardiology and pulmonology CPGs. METHODS: We conducted a retrospective document review of CPGs published by cardiology or pulmonology professional societies from the United States, Canada, or Europe from 2018 to 2019 available via the Emergency Care Research Institute, Guidelines International Network, or Medscape databases. We assessed the percentage of authors with an intellectual COI, defined as i) authorship on a study reviewed by the CPG, ii) authorship of a prior editorial related to a CPG recommendation, or iii) authorship of a prior related CPG. Management strategies assessed included use of GRADE methodology, inclusion of a methodologist, and recusals due to intellectual COI. Outcomes were assessed overall and compared between cardiology and pulmonology CPGs. RESULTS: Among the 39 CPGs identified (14 cardiology, 25 pulmonology), there were a total of 737 authors, of whom 473 (64%) had at least one intellectual COI. Among all CPGs, a median of 67% (Interquartile Range 50%-76%) of authors had at least one intellectual COI, and COI was more prevalent among cardiology compared with pulmonology CPGs (84% vs 57%, p<0.001). There was variable use of management strategies among the CPGs, including use of GRADE methodology (64% of CPGs), inclusion of a methodologist (49%), and recusals due to intellectual COI (0%). CONCLUSION: Intellectual conflicts of interest appear to be highly prevalent and under-reported among cardiology and pulmonology CPGs, which may threaten their validity. Greater attention to and improved management of intellectual COI by CPG-producing organizations is needed.

Selection, optimization, and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse populations.

Polygenic risk scores (PRS) have improved in predictive performance supporting their use in clinical practice. Reduced predictive performance of PRS in diverse populations can exacerbate existing health disparities. The NHGRI-funded eMERGE Network is returning a PRS-based genome-informed risk assessment to 25,000 diverse adults and children. We assessed PRS performance, medical actionability, and potential clinical utility for 23 conditions. Standardized metrics were considered in the selection process with additional consideration given to strength of evidence in African and Hispanic populations. Ten conditions were selected with a range of high-risk thresholds: atrial fibrillation, breast cancer, chronic kidney disease, coronary heart disease, hypercholesterolemia, prostate cancer, asthma, type 1 diabetes, obesity, and type 2 diabetes. We developed a pipeline for clinical PRS implementation, used genetic ancestry to calibrate PRS mean and variance, created a framework for regulatory compliance, and developed a PRS clinical report. eMERGE's experience informs the infrastructure needed to implement PRS-based implementation in diverse clinical settings.

Studying the impact of translational genomic research: Lessons from eMERGE.

Two major goals of the Electronic Medical Record and Genomics (eMERGE) Network are to learn how best to return research results to patient/participants and the clinicians who care for them and also to assess the impact of placing these results in clinical care. Yet since its inception, the Network has confronted a host of challenges in achieving these goals, many of which had ethical, legal, or social implications (ELSIs) that required consideration. Here, we share impediments we encountered in recruiting participants, returning results, and assessing their impact, all of which affected our ability to achieve the goals of eMERGE, as well as the steps we took to attempt to address these obstacles. We divide the domains in which we experienced challenges into four broad categories: (1) study design, including recruitment of more diverse groups; (2) consent; (3) returning results to participants and their health care providers (HCPs); and (4) assessment of follow-up care of participants and measuring the impact of research on participants and their families. Since most phases of eMERGE have included children as well as adults, we also address the particular ELSI posed by including pediatric populations in this research. We make specific suggestions for improving translational genomic research to ensure that future projects can effectively return results and assess their impact on patient/participants and providers if the goals of genomic-informed medicine are to be achieved.

Concordance of International Regulation of Pediatric Health Research.

OBJECTIVE: To assess the comparability of international ethics principles and practices used in regulating pediatric research as a first step in determining whether reciprocal deference for international ethics review is feasible. Prior studies by the authors focused on other aspects of international health research, such as biobanks and direct-to-participant genomic research. The unique nature of pediatric research and its distinctive regulation by many countries warranted a separate study. STUDY DESIGN: A representative sample of 21 countries was selected, with geographical, ethnic, cultural, political, and economic diversity. A leading expert on pediatric research ethics and law was selected to summarize the ethics review of pediatric research in each country. To ensure the comparability of the responses, a 5-part summary of pediatric research ethics principles in the US was developed by the investigators and distributed to all country representatives. The international experts were asked to assess and describe whether principles in their country and the US were congruent. Results were obtained and compiled in the spring and summer of 2022. RESULTS: Some of the countries varied in their conceptualization or description of one or more ethical principles for pediatric research, but overall, the countries in the study demonstrated a fundamental concordance. CONCLUSIONS: Similar regulation of pediatric research in 21 countries suggests that international reciprocity is a viable strategy.

Education and electronic medical records and genomics network, challenges, and lessons learned from a large-scale clinical trial using polygenic risk scores.

Polygenic risk scores (PRS) have potential to improve health care by identifying individuals that have elevated risk for common complex conditions. Use of PRS in clinical practice, however, requires careful assessment of the needs and capabilities of patients, providers, and health care systems. The electronic Medical Records and Genomics (eMERGE) network is conducting a collaborative study which will return PRS to 25,000 pediatric and adult participants. All participants will receive a risk report, potentially classifying them as high risk (∼2-10% per condition) for 1 or more of 10 conditions based on PRS. The study population is enriched by participants from racial and ethnic minority populations, underserved populations, and populations who experience poorer medical outcomes. All 10 eMERGE clinical sites conducted focus groups, interviews, and/or surveys to understand educational needs among key stakeholders-participants, providers, and/or study staff. Together, these studies highlighted the need for tools that address the perceived benefit/value of PRS, types of education/support needed, accessibility, and PRS-related knowledge and understanding. Based on findings from these preliminary studies, the network harmonized training initiatives and formal/informal educational resources. This paper summarizes eMERGE's collective approach to assessing educational needs and developing educational approaches for primary stakeholders. It discusses challenges encountered and solutions provided.

A game theoretic approach to balance privacy risks and familial benefits.

As recreational genomics continues to grow in its popularity, many people are afforded the opportunity to share their genomes in exchange for various services, including third-party interpretation (TPI) tools, to understand their predisposition to health problems and, based on genome similarity, to find extended family members. At the same time, these services have increasingly been reused by law enforcement to track down potential criminals through family members who disclose their genomic information. While it has been observed that many potential users shy away from such data sharing when they learn that their privacy cannot be assured, it remains unclear how potential users' valuations of the service will affect a population's behavior. In this paper, we present a game theoretic framework to model interdependent privacy challenges in genomic data sharing online. Through simulations, we find that in addition to the boundary cases when (1) no player and (2) every player joins, there exist pure-strategy Nash equilibria when a relatively small portion of players choose to join the genomic database. The result is consistent under different parametric settings. We further examine the stability of Nash equilibria and illustrate that the only equilibrium that is resistant to a random dropping of players is when all players join the genomic database. Finally, we show that when players consider the impact that their data sharing may have on their relatives, the only pure strategy Nash equilibria are when either no player or every player shares their genomic data.

Human-Centered Design to Address Biases in Artificial Intelligence.

The potential of artificial intelligence (AI) to reduce health care disparities and inequities is recognized, but it can also exacerbate these issues if not implemented in an equitable manner. This perspective identifies potential biases in each stage of the AI life cycle, including data collection, annotation, machine learning model development, evaluation, deployment, operationalization, monitoring, and feedback integration. To mitigate these biases, we suggest involving a diverse group of stakeholders, using human-centered AI principles. Human-centered AI can help ensure that AI systems are designed and used in a way that benefits patients and society, which can reduce health disparities and inequities. By recognizing and addressing biases at each stage of the AI life cycle, AI can achieve its potential in health care.

Managing re-identification risks while providing access to the All of Us research program.

OBJECTIVE: The All of Us Research Program makes individual-level data available to researchers while protecting the participants' privacy. This article describes the protections embedded in the multistep access process, with a particular focus on how the data was transformed to meet generally accepted re-identification risk levels. METHODS: At the time of the study, the resource consisted of 329 084 participants. Systematic amendments were applied to the data to mitigate re-identification risk (eg, generalization of geographic regions, suppression of public events, and randomization of dates). We computed the re-identification risk for each participant using a state-of-the-art adversarial model specifically assuming that it is known that someone is a participant in the program. We confirmed the expected risk is no greater than 0.09, a threshold that is consistent with guidelines from various US state and federal agencies. We further investigated how risk varied as a function of participant demographics. RESULTS: The results indicated that 95th percentile of the re-identification risk of all the participants is below current thresholds. At the same time, we observed that risk levels were higher for certain race, ethnic, and genders. CONCLUSIONS: While the re-identification risk was sufficiently low, this does not imply that the system is devoid of risk. Rather, All of Us uses a multipronged data protection strategy that includes strong authentication practices, active monitoring of data misuse, and penalization mechanisms for users who violate terms of service.

Returning integrated genomic risk and clinical recommendations: The eMERGE study.

PURPOSE: Assessing the risk of common, complex diseases requires consideration of clinical risk factors as well as monogenic and polygenic risks, which in turn may be reflected in family history. Returning risks to individuals and providers may influence preventive care or use of prophylactic therapies for those individuals at high genetic risk. METHODS: To enable integrated genetic risk assessment, the eMERGE (electronic MEdical Records and GEnomics) network is enrolling 25,000 diverse individuals in a prospective cohort study across 10 sites. The network developed methods to return cross-ancestry polygenic risk scores, monogenic risks, family history, and clinical risk assessments via a genome-informed risk assessment (GIRA) report and will assess uptake of care recommendations after return of results. RESULTS: GIRAs include summary care recommendations for 11 conditions, education pages, and clinical laboratory reports. The return of high-risk GIRA to individuals and providers includes guidelines for care and lifestyle recommendations. Assembling the GIRA required infrastructure and workflows for ingesting and presenting content from multiple sources. Recruitment began in February 2022. CONCLUSION: Return of a novel report for communicating monogenic, polygenic, and family history-based risk factors will inform the benefits of integrated genetic risk assessment for routine health care.

Avoiding Liability and Other Legal Land Mines in the Evolving Genomics Landscape.

This article reviews evolving legal implications for clinicians and researchers as genomics is used more widely in both the clinic and in translational research, reflecting rapid changes in scientific knowledge as well as the surrounding cultural and political environment. Professionals will face new and changing duties to make or act upon a genetic diagnosis, address direct-to-consumer genetic testing in patient care, consider the health implications of results for patients' family members, and recontact patients when test results change over time. Professional duties in reproductive genetic testing will need to be recalibrated in response to disruptive changes to reproductive rights in the United States. We also review the debate over who controls the flow of genetic information and who is responsible for its protection, considering the globally influential European Union General Data Protection Regulation and the rapidly evolving data privacy law landscape of the United States.

Mapping parents' journey following prenatal diagnosis of CHD: a qualitative study.

OBJECTIVE: To better understand parents' accounts of their prenatal and postnatal experience after prenatal diagnosis of CHD - particularly emotional processing and coping mechanisms - to identify strategies to improve support. METHODS: This single-centre, longitudinal qualitative study included pregnant mothers and their support persons seen in Fetal Cardiology Clinic at Vanderbilt Children's Hospital from May through August 2019 for probable complex CHD. Twenty-seven individuals from 17 families participated in 62 phone interviews during pregnancy and postpartum: 27 conducted after the initial prenatal cardiology consultation, 15 after a follow-up prenatal visit, and 20 after birth. Applied thematic analysis approach was used to code and analyse transcribed interviews. Coding and codebook revisions occurred iteratively; intercoder reliability was >80%. RESULTS: Patients included mothers (16 [59%]), fathers (8 [30%]), and other support persons (3 [11%]). Initial fetal diagnoses included a range of moderate to severe CHD. Prenatally, parents sought to maintain hope while understanding the diagnosis; planning for the future rather than focusing on day-to-day was more common if prognoses were better. Postnatally, with confirmation of prenatal diagnoses, parents' sense of control expanded, and they desired more active engagement in clinical decision making. CONCLUSIONS: To enhance effective communication and support, understanding how parents conceptualise hope in relation to diagnosis and how that may evolve over time is critical. Expectant parents whose child has a significant risk of mortality may demonstrate hope by focusing on positivity. As prognostic uncertainty diminishes postpartum, the parental role on the team may shift, requiring clinicians to provide different support.

Outcomes of Returning Medically Actionable Genomic Results in Pediatric Research.

PURPOSE: The electronic Medical Records and Genomics (eMERGE) Phase III study was undertaken to assess clinical utility of returning medically actionable genomic screening results. We assessed pediatric clinical outcomes following return of pathogenic/likely pathogenic (P/LP) variants in autosomal dominant conditions with available effective interventions. METHODS: The two eMERGE III pediatric sites collected outcome data and assessed changes in medical management at 6 and 12 months. RESULTS: We returned P/LP results to 29 participants with outcome data. For 23 of the 29 participants, the P/LP results were previously unknown. Five of the 23 participants were already followed for conditions related to the P/LP variant. Of those receiving novel results and not being followed for the condition related to the P/LP result (n = 18), 14 (77.8%) had a change in healthcare after return of results (RoR). Following RoR, cascade testing of family members occurred for 10 of 23 (43.5%). CONCLUSIONS: The most common outcomes post-RoR included imaging/laboratory testing and health behavior recommendations. A change in healthcare was documented in 77.8% of those receiving results by 6 months. Our findings demonstrate how return of genomic screening results impacts healthcare in pediatric populations.

Dobbs and the future of health data privacy for patients and healthcare organizations.

The Supreme Court recently overturned settled case law that affirmed a pregnant individual's Constitutional right to an abortion. While many states will commit to protect this right, a large number of others have enacted laws that limit or outright ban abortion within their borders. Additional efforts are underway to prevent pregnant individuals from seeking care outside their home state. These changes have significant implications for delivery of healthcare as well as for patient-provider confidentiality. In particular, these laws will influence how information is documented in and accessed via electronic health records and how personal health applications are utilized in the consumer domain. We discuss how these changes may lead to confusion and conflict regarding use of health information, both within and across state lines, why current health information security practices may need to be reconsidered, and what policy options may be possible to protect individuals' health information.

LGBTQ+ Perspectives on Conducting Genomic Research on Sexual Orientation and Gender Identity.

We conducted in-depth, semi-structured interviews with LGBTQ+-identified individuals (n = 31) to explore the range of LGBTQ+ perspectives on genomic research using either sexual orientation or gender identity (SOGI) data. Most interviewees presumed that research would confirm genetic contributions to sexual orientation and gender identity. Primary hopes for such confirmation included validating LGBTQ+ identities, improved access to and quality of healthcare and other resources, and increased acceptance in familial, socio-cultural, and political environments. Areas of concern included threats of pathologizing and medicalizing LGBTQ+ identities and experiences, undermining reproductive rights, gatekeeping of health or social systems, and malicious testing or misuse of genetic results, particularly for LGBTQ+ youth. Overall, interviewees were divided on the acceptability of genomic research investigating genetic contributions to sexual orientation and gender identity. Participants emphasized researchers' ethical obligations to LGBTQ+ individuals and endorsed engagement with LGBTQ+ communities throughout all aspects of genomic research using SOGI data.

Impact of returning unsolicited genomic results to nongenetic health care providers in the eMERGE III Network.

PURPOSE: As genomic sequencing becomes more common, medically actionable secondary findings will increasingly be returned to health care providers (HCPs), who will be faced with managing the resulting patient care. These findings are generally unsolicited, ie, unrelated to the sequencing indication and/or ordered by another clinician. METHODS: To understand the impact of receiving unsolicited results, we interviewed HCPs who received genomic results for patients enrolled in the Electronic Medical Records and Genomics (eMERGE) Phase III Network, which returned results on >100 actionable genes to eMERGE participants and HCPs. RESULTS: In total, 16 HCPs across 3 eMERGE sites were interviewed about their experience of receiving a positive (likely pathogenic or pathogenic), negative, or variant of uncertain significance result for a patient enrolled in eMERGE Phase III and about managing their patient on the basis of the result. Although unsolicited, HCPs felt responsible for managing the patient's resulting medical care. HCPs indicated that clinical utility depended on the actionability of results, and whereas comfort levels varied, confidence was improved by the availability of subspecialist consults. HCPs were concerned about patient anxiety, insurability, and missing an actionable result in the electronic health record. CONCLUSION: Our findings help inform best practices for return of unsolicited genomic screening findings in the future.