Maternal COVID-19 Infection Associated with Fetal Systemic Inflammatory Complications in COVID-19-Negative Neonates: A Case-Series.

OBJECTIVE: This study aimed to examine fetal and neonatal inflammatory and neurologic complications associated with maternal coronavirus disease 2019 (COVID-19) infection. STUDY DESIGN: Case-series using a convenience sample of neonates cared for in a large referral-based children's hospital neonatal intensive care unit between September 2021 and May 2022. RESULTS: We identified seven neonates with exposure to maternal severe acute respiratory syndrome related coronavirus 2 (SARS-CoV-2) and a presentation consistent with inflammatory complications. All had some degree of neurologic injury with neuroimaging findings including restricted diffusion indicating injury in the white matter, cortex, deep gray structures, and splenium of the corpus callosum as well as intracranial hemorrhage. In addition, many infants had cytopenia and abnormal coagulation studies. Placental pathology, when available, revealed inflammation, clot with calcifications, and hematomas with associated infarcts. CONCLUSION: Neonates born to mothers with SARS-CoV-2, even when negative for the virus themselves, may have complications consistent with a systemic inflammatory syndrome. Placental pathology as well as neurologic imaging in infants with neurologic findings may help to support this diagnosis. KEY POINTS: · A systemic inflammatory response may cause illness in babies born to mothers with a history of COVID-19.. · Inflammatory markers and placental pathology are helpful in supporting this diagnosis.. · Consider neuroimaging in infants of mothers with a history of COVID-19 with neurologic findings..

Validity Evidence for a Novel, Comprehensive Bag-Mask Ventilation Assessment Tool.

OBJECTIVE: To develop a comprehensive competency assessment tool for pediatric bag-mask ventilation (pBMV) and demonstrate multidimensional validity evidence for this tool. STUDY DESIGN: A novel pBMV assessment tool was developed consisting of 3 components: a 22-item-based checklist (trichotomized response), global rating scale (GRS, 5-point), and entrustment assessment (4-point). Participants' performance in a realistic simulation scenario was video-recorded and assessed by blinded raters. Multidimensional validity evidence for procedural assessment, including evidence for content, response-process, internal structure, and relation to other variables, was assessed. The scores of each scale were compared with training level. Item-based checklist scores also were correlated with GRS and entrustment scores. RESULTS: Fifty-eight participants (9 medical students, 10 pediatric residents, 18 critical care/neonatology fellows, 21 critical care/neonatology attendings) were evaluated. The pBMV tool was supported by high internal consistency (Cronbach α = 0.867). Inter-rater reliability for the item-based checklist component was acceptable (r = 0.65, P < .0001). The item-based checklist scores differentiated between medical students and other providers (P < .0001), but not by other trainee level. GRS and entrustment scores significantly differentiated between training levels (P < .001). Correlation between skill item-based checklist and GRS was r = 0.489 (P = .0001) and between item-based checklist and entrustment score was r = 0.52 (P < .001). This moderate correlation suggested each component measures pBMV skills differently. The GRS and entrustment scores demonstrated moderate inter-rater reliability (0.42 and 0.46). CONCLUSIONS: We established evidence of multidimensional validity for a novel entrustment-based pBMV competence assessment tool, incorporating global and entrustment-based assessments. This comprehensive tool can provide learner feedback and aid in entrustment decisions as learners progress through training.

Comparison of a dichotomous versus trichotomous checklist for neonatal intubation.

BACKGROUND: To compare validity evidence for dichotomous and trichotomous versions of a neonatal intubation (NI) procedural skills checklist. METHODS: NI skills checklists were developed utilizing an existing framework. Experts were trained on scoring using dichotomous and trichotomous checklists, and rated recordings of 23 providers performing simulated NI. Videolaryngoscope recordings of glottic exposure were evaluated using Cormack-Lehane (CL) and Percent of Glottic Opening scales. Internal consistency and reliability of both checklists were analyzed, and correlations between checklist scores, airway visualization, entrustable professional activities (EPA), and global skills assessment (GSA) were calculated. RESULTS: During rater training, raters gave significantly higher scores on better provider performance in standardized videos (both p < 0.001). When utilized to evaluate study participants' simulated NI attempts, both dichotomous and trichotomous checklist scores demonstrated very good internal consistency (Cronbach's alpha 0.868 and 0.840, respectively). Inter-rater reliability was higher for dichotomous than trichotomous checklists [Fleiss kappa of 0.642 and 0.576, respectively (p < 0.001)]. Sum checklist scores were significantly different among providers in different disciplines (p < 0.001, dichotomous and trichotomous). Sum dichotomous checklist scores correlated more strongly than trichotomous scores with GSA and CL grades. Sum dichotomous and trichotomous checklist scores correlated similarly well with EPA. CONCLUSIONS: Neither dichotomous or trichotomous checklist was superior in discriminating provider NI skill when compared to GSA, EPA, or airway visualization assessment. Sum scores from dichotomous checklists may provide sufficient information to assess procedural competence, but trichotomous checklists may permit more granular feedback to learners and educators. The checklist selected may vary with assessment needs.

Impact of Task-Oriented Role Assignment on Neonatal Resuscitation Performance: A Simulation-Based Randomized Controlled Trial.

OBJECTIVE: Task-oriented role assignment (TORA) is the assignment of a specific role, a list of tasks, and a location to stand to each resuscitation team member. We performed this study to examine the impact of TORA training during a Neonatal Resuscitation Program (NRP) course on neonatal resuscitation team technical performance and behavioral skills. STUDY DESIGN: Participants were cluster randomized into either a standard NRP course (control) or an NRP course with TORA training. Both technical and behavioral skills were evaluated using standardized simulations. The simulations were video recorded and then scored by two blinded reviewers using previously validated instruments. RESULTS: A total of 65 participants (62 resident physicians and 3 nurses) participated in 108 simulations (48 controls, 60 TORA). Technical skill scores were similar between the two groups (control = 77.6% [±8.4] vs. TORA = 78.1% [±8.1]; p = 0.74). The TORA group had higher behavior skill scores in 8 of the 10 NRP key behavioral skills and had higher overall behavioral skill scores (control = 30.1 [±7.2] vs. TORA = 34.9 [±4.8]; p < 0.001). CONCLUSION: In resuscitation teams comprising mostly resident physicians, TORA training resulted in better behavioral skills during simulated neonatal resuscitation. Further study on the impact of TORA training on actual resuscitation performance in interdisciplinary teams is warranted.

Telehealth Training During the COVID-19 Pandemic: A Feasibility Study of Large Group Multiplatform Telesimulation Training.

Background:Video telehealth is an important tool for health care delivery during the COVID-19 pandemic. Given physical distancing recommendations, access to traditional in-person telehealth training for providers has been limited. Telesimulation is an alternative to in-person telehealth training. Telesimulation training with both remote participants and facilitators using telehealth software has not been described.Objective:We investigated the feasibility of a large group telesimulation provider training of telehealth software for remote team leadership skills with common neonatal cases and procedures.Methods:We conducted a 90-min telesimulation session with a combination of InTouch™ provider access software and Zoom™ teleconferencing software. Zoom facilitators activated InTouch software and devices and shared their screen with remote participants. Participants rotated through skill stations and case scenarios through Zoom and directed bedside facilitators to perform simulated tasks using the shared screen and audio connection. Participants engaged in a debrief and a pre- and postsurvey assessing participants' comfort and readiness to use telemedicine. Data were analyzed using descriptive statistics and paired t tests.Results:Twenty (n = 20) participants, five Zoom and eight bedside facilitators participated. Twenty-one (21) pre- and 16 postsurveys were completed. Most participants were attending neonatologists who rarely used telemedicine software. Postsession, participants reported increased comfort with some advanced InTouch features, including taking and sharing pictures with the patient (p < 0.01) and drawing on the shared image (p < 0.05), but less comfort with troubleshooting technical issues, including audio and stethoscope (p < 0.01). Frequently stated concerns were troubleshooting technical issues during a call (75%, n = 16) and personal discomfort with telemedicine applications and technology (56%, n = 16).Conclusion:Large group telesimulation is a feasible way to offer telehealth training for physicians and can increase provider comfort with telehealth software.

Therapeutic Plasma Exchange in Neonatal Septic Shock: A Retrospective Cohort Study.

OBJECTIVE: This study aimed to examine the use of therapeutic plasma exchange (TPE) as adjunctive therapy in neonatal septic shock. STUDY DESIGN: This retrospective cohort study was performed on a convenience sample of neonates in a quaternary children's hospital between January 2018 and February 2019. RESULTS: We identified three neonates with septic shock who received TPE. Two neonates had adenovirus sepsis, and one had group B streptococcal sepsis. All neonates were on extracorporeal life support (ECLS) when TPE was started. The median duration of TPE was 6 days (interquartile range [IQR]: 3-15), with a median of four cycles (IQR: 3-5). Lactate levels decreased significantly after TPE (median before TPE: 5.4 mmol/L [IQR: 2.4-6.1] vs. median after TPE: 1.2 mmol/L [IQR: 1.0-5.8]; p < 0.001). Platelet levels did not change (median before TPE: 73,000/mm3 [IQR: 49,000-100,000] vs. median after TPE: 80,000/mm3 (IQR: 62,000-108,000); p = 0.2). Organ failure indices improved after TPE in two of the three neonates. Hypocalcemia was seen in all cases despite prophylactic calcium infusions. One neonate died, and two survived to ICU discharge. CONCLUSION: TPE can be safely performed in neonates with septic shock. TPE may have a role as an adjunctive therapy in neonates with septic shock requiring ECLS.

Simulation in Neonatal-Perinatal Medicine Fellowship Programs.

OBJECTIVE: This study aimed to investigate the use of simulation in neonatal-perinatal medicine (NPM) fellowship programs. STUDY DESIGN: This was a cross-sectional survey of program directors (PDs) and simulation educators in Accreditation Council for Graduate Medical Education (ACGME) accredited NPM fellowship programs. RESULTS: Responses were received from 59 PDs and 52 simulation educators, representing 60% of accredited programs. Of responding programs, 97% used simulation, which most commonly included neonatal resuscitation (94%) and procedural skills (94%) training. The time and scope of simulation use varied significantly. The majority of fellows (51%) received ≤20 hours of simulation during training. The majority of PDs (63%) wanted fellows to receive >20 hours of simulation. Barriers to simulation included lack of faculty time, experience, funding, and curriculum. CONCLUSION: While the majority of fellowship programs use simulation, the time and scope of fellow exposure to simulation experiences are limited. The creation of a standardized simulation curriculum may address identified barriers to simulation.

Team Stress and Adverse Events during Neonatal Tracheal Intubations: A Report from NEAR4NEOS.

OBJECTIVE: This study aimed to examine the association between team stress level and adverse tracheal intubation (TI)-associated events during neonatal intubations. STUDY DESIGN: TIs from 10 academic neonatal intensive care units were analyzed. Team stress level was rated immediately after TI using a 7-point Likert scale (1 = high stress). Associations among team stress, adverse TI-associated events, and TI characteristics were evaluated. RESULT: In this study, 208 of 2,009 TIs (10%) had high stress levels (score < 4). Oxygenation failure, hemodynamic instability, and family presence were associated with high stress level. Video laryngoscopy and premedication were associated with lower stress levels. High stress level TIs were associated with adverse TI-associated event rates (31 vs. 16%, p < 0.001), which remained significant after adjusting for potential confounders including patient, provider, and practice factors associated with high stress (odds ratio: 1.90, 96% confidence interval: 1.36-2.67, p < 0.001). CONCLUSION: High team stress levels during TI were more frequently reported among TIs with adverse events.

Expanding phenotype with severe midline brain anomalies and missense variant supports a causal role for FOXA2 in 20p11.2 deletion syndrome.

Rare individuals with 20p11.2 proximal deletions have been previously reported, with a variable phenotype that includes heterotaxy, biliary atresia, midline brain defects associated with panhypopituitarism, intellectual disability, scoliosis, and seizures. Deletions have ranged in size from 277 kb to 11.96 Mb. We describe a newborn with a de novo 2.7 Mb deletion of 20p11.22p11.21 that partially overlaps previously reported deletions and encompasses FOXA2. Her clinical findings further expand the 20p11.2 deletion phenotype to include severe midline cranial and intracranial defects such as aqueductal stenosis with hydrocephalus, mesencephalosynapsis with diencephalic-mesencephalic junction dysplasia, and pyriform aperture stenosis. We also report one individual with a missense variant in FOXA2 who had abnormal glucose homeostasis, panhypopituitarism, and endodermal organ dysfunction. Together, these findings support the critical role of FOXA2 in panhypopituitarism and midline defects.

Cardiopulmonary Resuscitation in the Pediatric Cardiac Catheterization Laboratory: A Report From the American Heart Association's Get With the Guidelines-Resuscitation Registry.

OBJECTIVES: Hospitalized children with underlying heart disease are at high risk for cardiac arrest, particularly when they undergo invasive catheterization procedures for diagnostic and therapeutic interventions. Outcomes for children experiencing cardiac arrest in the cardiac catheterization laboratory remain under-reported with few studies reporting survival beyond the catheterization laboratory. We aim to describe survival outcomes after cardiac arrest in the cardiac catheterization laboratory while identifying risk factors associated with hospital mortality after these events. DESIGN: Retrospective observational study of data from a multicenter cardiac arrest registry from November 2005 to November 2016. Cardiac arrest in the cardiac catheterization laboratory was defined as the need for chest compressions greater than or equal to 1 minute in the cardiac catheterization laboratory. Primary outcome was survival to discharge. Variables analyzed using generalized estimating equations for association with survival included age, illness category (surgical cardiac, medical cardiac), preexisting conditions, pharmacologic interventions, and event duration. SETTING: American Heart Association's Get With the Guidelines-Resuscitation registry of in-hospital cardiac arrest. PATIENTS: Consecutive patients less than 18 years old experiencing an index (i.e., first) cardiac arrest event reported to the Get With the Guidelines-Resuscitation. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: A total of 203 patients met definition of index cardiac arrest in the cardiac catheterization laboratory composed primarily of surgical and medical cardiac patients (54% and 41%, respectively). Children less than 1 year old comprised the majority of patients, 58% (117/203). Overall survival to hospital discharge was 69% (141/203). No differences in survival were observed between surgical and medical cardiac patients (p = 0.15). The majority of deaths (69%, 43/62) occurred in patients less than 1 year old. Bradycardia (with pulse) followed by pulseless electrical activity/asystole were the most common first documented rhythms observed (50% and 27%, respectively). Preexisting metabolic/electrolyte abnormalities (p = 0.02), need for vasoactive infusions (p = 0.03) prior to arrest, and use of calcium products (p = 0.005) were found to be significantly associated with lower rates of survival to discharge on multivariable regression. CONCLUSIONS: The majority of children experiencing cardiac arrest in the cardiac catheterization laboratory in this large multicenter registry analysis survived to hospital discharge, with no observable difference in outcomes between surgical and medical cardiac patients. Future investigations that focus on stratifying medical complexity in addition to procedural characteristics at the time of catheterization are needed to better identify risks for mortality after cardiac arrest in the cardiac catheterization laboratory.

Development and Testing of a Neonatal Intubation Checklist for an Air Medical Transport Team.

OBJECTIVE: We developed a Neonatal Intubation Checklist for Airlift Northwest. Our goal was to improve the preparation, technical proficiency, and safety of neonatal intubation without increasing the time required to perform the procedure. METHODS: The Neonatal Intubation Checklist, a "call and response" checklist for neonatal intubation, was developed. Its effectiveness was evaluated during a baseline assessment and 2 practice sessions after a checklist orientation. Intubation proficiency was evaluated using a validated assessment tool that included a proficiency score, a global rating scale (GRS) score, and time to perform the procedure. RESULTS: Significant improvements in intubation proficiency and time to intubation were noted when teams used the intubation checklist (proficiency score: 29 [7] at baseline vs. 57 [1] with checklist, P < .001; GRS 2 [2, 2.5] at baseline vs. 5 [3, 5] with checklist, P < .001; baseline intubation time 626 [93] seconds vs. 479 (44) seconds with checklist, P < .001). These changes were associated with a large effect on proficiency (ƞ2 = 0.89), GRS (ƞ2 = 0.6), and time to successful intubation (ƞ2 = 0.52). CONCLUSION: The use of the Neonatal Intubation Checklist improved transport team performance during simulated neonatal intubations and decreased the time required to successfully perform the procedure.

Effect of Video-based Telemedicine on Transport Management of Simulated Newborns.

OBJECTIVE: Video-based telemedicine is a reliable tool to assess the severity of respiratory distress in children, increasing the appropriateness of triage and disposition for acutely ill children. Telemedicine simulations may identify patterns in regional transport management and influence attitudes toward telemedicine. METHODS: The objective was to determine the effect of videos on simulated neonatal transport care compared with telephone management. Participants received information about a newborn requiring respiratory support by an audio recording and made management decisions based on only that information. Four videos of varying respiratory distress on respiratory support were then shown. After each video, participants again rated patient stability and recommended management. RESULTS: Sixteen neonatologists completed the cases. Compared with the telephone call, there were significant differences in ratings of patient stability and confidence in their assessment after watching the videos. When given the same information, participants were less likely to recommend intubation after viewing an infant in mild respiratory distress than after the telephone call (P < .05). Most participants felt that viewing the videos was helpful in formulating their assessment and plan. CONCLUSION: Video-based telemedicine simulations influenced the perceived stability of neonates during transport. Viewing the patient increased provider confidence in their assessment and recommendations.

The Development of Tracheal Intubation Proficiency Outside the Operating Suite During Pediatric Critical Care Medicine Fellowship Training: A Retrospective Cohort Study Using Cumulative Sum Analysis.

OBJECTIVE: Tracheal intubation is a core technical skill for pediatric critical care medicine fellows. Limited data exist to describe current pediatric critical care medicine fellow tracheal intubation skill acquisition through the training. We hypothesized that both overall and first-attempt tracheal intubation success rates by pediatric critical care medicine fellows improve over the course of training. DESIGN: Retrospective cohort study at a single large academic children's hospital. MATERIALS AND METHODS: The National Emergency Airway Registry for Children database and local QI database were merged for all tracheal intubations outside the Operating Suite by pediatric critical care medicine fellows from July 2011 to January 2015. Primary outcomes were tracheal intubation overall success (regardless of number of attempts) and first attempt success. Patient-level covariates were adjusted in multivariate analysis. Learning curves for each fellow were constructed by cumulative sum analysis. RESULTS: A total of 730 tracheal intubation courses performed by 33 fellows were included in the analysis. The unadjusted overall and first attempt success rates were 87% and 80% during the first 3 months of fellowship, respectively, and 95% and 73%, respectively, during the past 3 months of fellowship. Overall success, but not first attempt success, improved during fellowship training (odds ratio for each 3 months, 1.08; 95% CI, 1.01-1.17; p = 0.037) after adjusting for patient-level covariates. Large variance in fellow's tracheal intubation proficiency outside the operating suite was demonstrated with a median number of tracheal intubation equal to 26 (range, 19-54) to achieve a 90% overall success rate. All fellows who completed 3 years of training during the study period achieved an acceptable 90% overall tracheal intubation success rate. CONCLUSIONS: Tracheal intubation overall success improved significantly during the course of fellowship; however, the tracheal intubation first attempt success rates did not. Large variance existed in individual tracheal intubation performance over time. Further investigations on a larger scale across different training programs are necessary to clarify intensity and duration of the training to achieve tracheal intubation procedural competency.

Retention of pediatric resuscitation performance after a simulation-based mastery learning session: a multicenter randomized trial.

OBJECTIVES: Using simulation-based mastery learning, residents can be trained to achieve a predefined performance standard in resuscitation. After mastery is achieved, performance degradation occurs over time. Prior investigations have shown performance retention of 12-14 months following intensive simulation-based mastery learning sessions. We sought to investigate the duration of mastery-level resuscitation performance retention after a single 1- to 2-hour simulation-based mastery learning session. DESIGN: Randomized, prospective trial. SETTING: Medical simulation laboratory. SUBJECTS: Convenience sample of 42 pediatric residents. INTERVENTIONS: Baseline resuscitation performance was determined on four standardized simulation scenarios. After determination of baseline performance, each resident repeated each scenario, as needed, until mastery-level performance was achieved. Residents were then randomized and retested 2, 4, or 6 months later. Statistical analysis on scores at baseline and retesting were used to determine performances changes from baseline and performance retention over time. MEASUREMENTS AND MAIN RESULTS: Forty-two residents participated in the study (12 in 2 mo group, 14 in 4 mo group, and 16 in 6 mo group). At baseline, postgraduate year-3 residents performed better than postgraduate year-1 residents (p = 0.003). Overall performance on each of the four scenarios improved at retesting. The percent of residents maintaining mastery-level performance showed a significant linear decline (p = 0.039), with a drop at each retesting interval; 92% retained mastery at 2 months, 71% at 4 months, and 56% at 6 months. There was no difference in retention between postgraduate year-1, postgraduate year-2, and postgraduate year-3 residents (p = 0.14). CONCLUSIONS: Residents displayed significant improvements in resuscitation performance after a single simulation-based mastery learning session, but performance declined over time, with less than 60% retaining mastery-level performance at 6 months. Our results suggest that relatively frequent refresher training is needed after a single simulation-based mastery learning session. Additional research is needed to determine the duration of performance retention following any specific simulation-based mastery learning intervention.

Beyond the delivery room: Resuscitation in the neonatal intensive care unit.

Cardiopulmonary resuscitation is a critical component of neonatal care. While the basic principles of resuscitation are consistent across different settings, the specific challenges and resources available in the delivery room and the Neonatal Intensive Care Unit (NICU) vary significantly. Understanding the differences between these settings is essential for optimizing resuscitation outcomes. This article explores four key areas of difference-environment and equipment, team composition and roles, care protocols and practices, and patient population and condition-and how they impact neonatal resuscitation efforts. By examining these differences, healthcare neonatal care teams can better prepare for the specific resuscitation needs in each setting, ultimately improving neonatal survival and long-term health outcomes.

Gamified learning for resuscitation education: A systematic review.

Aim: To systematically review published literature to evaluate the impact of gamified learning on educational and clinical outcomes during life support education. Methods: This systematic review was conducted as part of the continuous evidence evaluation process of the International Liaison Committee on Resuscitation (ILCOR). A search of PubMed, Embase, and Cochrane was conducted from inception until February 12, 2024. Studies examining incorporation of gamified learning were eligible for inclusion. Reviewers independently extracted data on study design and outcomes; appropriate risk of bias assessment tools were used across all outcomes. Results: 2261 articles were identified and screened, yielding sixteen articles (seven randomized trials, nine observational studies) which comprised the final review. No meta-analyses were conducted due to significant heterogeneity of intervention, population, and outcome. Only one study was found to have a low risk of bias; the remaining studies were found to have moderate to high risk. Fourteen studies were in healthcare providers and two were in laypersons. Most studies (11 of 16) examined the impact of a digital platform (computer or smartphone). Most (15 of 16) studies found a positive effect on at least one educational domain; one study found no effect. No included study found a negative effect on any educational domain. Conclusion: This systematic review found a very heterogeneous group of studies with low certainty evidence, all but one of which demonstrated a positive effect on one or more educational domains. Future studies should examine the underlying causes of improved learning with gamification and assess the resource requirements with implementation and dissemination of gamified learning.

Rapid cycle deliberate practice approach on resuscitation training: A systematic review.

Aim: To evaluate the effectiveness of Rapid Cycle Deliberate Practice (RCDP) compared to traditional instruction or other forms of learning on resuscitation training outcomes and on clinical and/or patient-related outcomes. Methods: As part of the continuous evidence evaluation process of the International Liaison Committee on Resuscitation it was conducted this review and searched Medline, Embase and Cochrane from inception to Feb 12th, 2024. Risk of bias assessment was performed with the Risk of Bias in Non-randomized Studies of Interventions assessment tool and the Revised Cochrane risk-of-bias tool for randomized trials. The GRADE approach was used to evaluate the overall certainty of evidence for each outcome. Results: 4420 abstracts were retrieved by the initial search and 10 additional studies were identified through other resources. Sixty-five studies were selected for eligibility and nine simulated studies met the inclusion criteria. A meta-analysis was performed on three outcomes: time to chest compressions, time to defibrillation and time to first epinephrine given, which showed that RCDP had significantly shorter time to defibrillation and time to administration of epinephrine than controls. The overall certainty of evidence was very low across all outcomes due to risk of bias, inconsistency, indirectness, and imprecision. Conclusion: It may be reasonable to include RCDP as an instructional design feature of basic and advanced life support training. However, substantial variations of delivering RCDP exist and there is no uniform use of RCDP. Further research is necessary on medium/long-term effects of RCDP training, and on the effects on different target groups of training.

Increasing Realism and Variety of Virtual Patient Dialogues for Prenatal Counseling Education Through a Novel Application of ChatGPT: Exploratory Observational Study.

BACKGROUND: Using virtual patients, facilitated by natural language processing, provides a valuable educational experience for learners. Generating a large, varied sample of realistic and appropriate responses for virtual patients is challenging. Artificial intelligence (AI) programs can be a viable source for these responses, but their utility for this purpose has not been explored. OBJECTIVE: In this study, we explored the effectiveness of generative AI (ChatGPT) in developing realistic virtual standardized patient dialogues to teach prenatal counseling skills. METHODS: ChatGPT was prompted to generate a list of common areas of concern and questions that families expecting preterm delivery at 24 weeks gestation might ask during prenatal counseling. ChatGPT was then prompted to generate 2 role-plays with dialogues between a parent expecting a potential preterm delivery at 24 weeks and their counseling physician using each of the example questions. The prompt was repeated for 2 unique role-plays: one parent was characterized as anxious and the other as having low trust in the medical system. Role-play scripts were exported verbatim and independently reviewed by 2 neonatologists with experience in prenatal counseling, using a scale of 1-5 on realism, appropriateness, and utility for virtual standardized patient responses. RESULTS: ChatGPT generated 7 areas of concern, with 35 example questions used to generate role-plays. The 35 role-play transcripts generated 176 unique parent responses (median 5, IQR 4-6, per role-play) with 268 unique sentences. Expert review identified 117 (65%) of the 176 responses as indicating an emotion, either directly or indirectly. Approximately half (98/176, 56%) of the responses had 2 or more sentences, and half (88/176, 50%) included at least 1 question. More than half (104/176, 58%) of the responses from role-played parent characters described a feeling, such as being scared, worried, or concerned. The role-plays of parents with low trust in the medical system generated many unique sentences (n=50). Most of the sentences in the responses were found to be reasonably realistic (214/268, 80%), appropriate for variable prenatal counseling conversation paths (233/268, 87%), and usable without more than a minimal modification in a virtual patient program (169/268, 63%). CONCLUSIONS: Generative AI programs, such as ChatGPT, may provide a viable source of training materials to expand virtual patient programs, with careful attention to the concerns and questions of patients and families. Given the potential for unrealistic or inappropriate statements and questions, an expert should review AI chat outputs before deploying them in an educational program.