Development and validity evidence for the resident-led large group teaching assessment instrument in the United States: a methodological study.

PURPOSE: Despite educational mandates to assess resident teaching competence, limited instruments with validity evidence exist for this purpose. Existing instruments do not allow faculty to assess resident-led teaching in a large group format or whether teaching was interactive. This study gathers validity evidence on the use of the Resident-led Large Group Teaching Assessment Instrument (Relate), an instrument used by faculty to assess resident teaching competency. Relate comprises 23 behaviors divided into six elements: learning environment, goals and objectives, content of talk, promotion of understanding and retention, session management, and closure. METHODS: Messick's unified validity framework was used for this study. Investigators used video recordings of resident-led teaching from three pediatric residency programs to develop Relate and a rater guidebook. Faculty were trained on instrument use through frame-of-reference training. Resident teaching at all sites was video-recorded during 2018-2019. Two trained faculty raters assessed each video. Descriptive statistics on performance were obtained. Validity evidence sources include: rater training effect (response process), reliability and variability (internal structure), and impact on Milestones assessment (relations to other variables). RESULTS: Forty-eight videos, from 16 residents, were analyzed. Rater training improved inter-rater reliability from 0.04 to 0.64. The Φ-coefficient reliability was 0.50. There was a significant correlation between overall Relate performance and the pediatric teaching Milestone, r = 0.34, P = .019. CONCLUSION: Relate provides validity evidence with sufficient reliability to measure resident-led large-group teaching competence.

Confidence of Faculty in Writing Letters of Recommendation for Pediatric Fellowship Applicants.

BACKGROUND: The assessment of pediatric residents applying to subspecialty fellowship programs relies on faculty letters of recommendation (LOR). However, it is unclear if pediatric faculty are confident that their LOR are effective. OBJECTIVE: This study aims to assess the confidence of pediatric faculty in writing an effective LOR for pediatric residents applying to subspecialty fellowship programs. METHODS: Survey development was conducted using evidence-based best practices. Surveys were distributed via email in 2021 to all full-time pediatric faculty members who taught pediatric residents in a large academic medical center. Categorical values were compared by chi-square test. RESULTS: Eighty-five out of 150 (57%) faculty members completed the survey. Forty-one percent of participants were very confident that their LOR provided adequate content to assess residents during the application process. Confidence was associated with higher academic rank (p=0.02), frequent contact with residents (p=0.01), and writing >2 LOR in the last five years (p=0.0002). Confident LOR writers were more likely to describe their own background, details about the resident's scholarly activity, and the resident's ability to work as part of a team. Thirty-five percent of respondents reported never considering gender bias when writing LOR, whereas 28% reported always considering gender bias. Eighty-seven percent of respondents reported an interest in receiving LOR writing guidelines. CONCLUSION: Half of the faculty respondents were not very confident in their ability to write an effective LOR for pediatric residents applying for a fellowship. Faculty development and standardized instructions on writing effective LOR may be helpful both at the institutional and national levels, including the importance of considering gender bias when writing LOR.

Necrotizing Enterocolitis in Neonates With Hyperinsulinemic Hypoglycemia Treated With Diazoxide.

The most common cause of persistent hypoglycemia in the neonatal period is hyperinsulinism. Severe, refractory hypoglycemia resulting from hyperinsulinism can lead to significant brain injury and permanent cognitive disability. Diazoxide is the first-line and only US Food and Drug Administration-approved, pharmacologic treatment for refractory hyperinsulinism. In recent years, the use of diazoxide in neonates with persistent hyperinsulinemic hypoglycemia has increased in the United States. Known adverse effects of diazoxide include fluid retention, hypertrichosis, neutropenia, thrombocytopenia, and more recently, pulmonary hypertension. It is currently unknown if diazoxide exposure is associated with an increased risk of necrotizing enterocolitis (NEC) in neonates. We reviewed the cases of 24 patients in a level IV NICU at Massachusetts General Hospital who received diazoxide over 12 years (April 2006-April 2018). All 24 patients received enteral diazoxide for refractory hyperinsulinemic hypoglycemia. A total of 5 patients developed NEC after initiation of diazoxide based on clinical and radiographic findings, corresponding to 20% of infants exposed to diazoxide. This is above our baseline incidence of NEC (1% for all inborn infants and 6% for all inborn very low birth weight infants). More research and monitoring are necessary to characterize the potential risk of NEC associated with the use of diazoxide in the neonatal period.

Taking the Pulse on Pediatric Simulation: A National Survey of Pediatric Residency Programs' Simulation Practices and Challenges.

OBJECTIVES: There is abundant literature on simulation use in individual pediatric residency programs but limited overall data on simulation in US pediatric residency programs. This study sought to determine how US pediatric residency programs use simulation for teaching and assessment and the challenges programs face in their use of simulation. METHODS: The Association of Pediatric Program Director's Healthcare Simulation in Pediatrics Learning Community members developed a 15-multipart question survey on the use of simulation in US pediatric residency programs using best practices in survey design. The survey was distributed electronically to US pediatric residency program directors. Qualitative questions were analyzed by content analysis and quantitative questions using descriptive statistics. RESULTS: The survey response rate was 21%; respondents were disproportionately from large academic medical centers. Qualitative analysis found that respondents use simulation to teach pediatric residents in the areas of urgent/emergent situations, procedures, and communication, and common challenges to simulation implementation are time, physical resources, expertise, competing priorities, logistics, and buy-in. Quantitative analysis demonstrated that, although respondents are largely confident that their simulation programs improve resident preparedness and competence, few objectively evaluate their simulation programs. CONCLUSIONS: Pediatric residency programs use simulation for similar purposes and face similar challenges. By collaborating, the resources of the national pediatric simulation community can be leveraged to collect evidence for best practices for simulation use in pediatric residency training.

Developmental differences between newborn and adult mice in response to romiplostim.

Thrombocytopenia is frequent among sick neonates. While most cases are transient, some neonates experience prolonged and severe thrombocytopenia. These infants often pose diagnostic and therapeutic challenges, and may receive large numbers of platelet transfusions. Romiplostim (ROM) is a thrombopoietin (TPO)-receptor-agonist approved for treatment of adults with chronic immune thrombocytopenia (ITP). The immature platelet fraction (IPF) is a novel measure of newly produced platelets, which could aid with the diagnostic evaluation of thrombocytopenic neonates. This study had the following two objectives: (1) compare the response of newborn and adult mice to escalating doses of ROM in vivo and (2) assess the correlation between IPF and megakaryocyte (MK) mass in newborn and adult treated and untreated mice. In the first set of studies, newborn (day 1) and adult mice received a single subcutaneous (SC) dose of ROM ranging from 0 to 300 ng/g, and platelet counts were followed every other day for 14 days. Both sets of mice responded with dose-dependent platelet and IPF increases, peaking on days 5-7 post-treatment, but neonates had a blunted response (2.1-fold compared to 4.2-fold maximal increase in platelet counts, respectively). On day 5 post-treatment with 300 ng/g ROM, MKs in the bone marrow (BM) and spleen of adult mice were significantly increased in numbers and size (p < 0.0001 for both) compared to controls. MKs in the spleen and BM (but not liver) of treated neonates also increased in number, but not in size. The immature platelet count (IPC, calculated as IPF x platelet count) was highly correlated with the MK number and size in neonatal and adult BM and spleen, but not neonatal liver. The lack of response of neonatal liver MKs was not due to a cell-intrinsic reduced responsiveness to TPO, since neonatal liver progenitors were more sensitive to murine TPO (mTPO) in vitro than adult BM progenitor. In vivo treatment of newborn mice with high mTPO doses or with higher doses of ROM (900 ng/g) resulted in peak platelet counts approaching 3-fold of controls. Taken together, our data indicate that newborn mice are less responsive to ROM than adult mice in vivo, due to a combination of likely pharmacokinetic differences and developmental differences in the response of MKs to thrombopoietic stimulation, evidenced by neonatal MKs increasing in numbers but not in size. PK/PD studies in human infants treated with ROM are warranted.

Platelet Transfusion Practices Among Very-Low-Birth-Weight Infants.

IMPORTANCE: Thrombocytopenia and intraventricular hemorrhage (IVH) are common among very-low-birth-weight (VLBW) infants. Survey results suggest that US neonatologists frequently administer platelet transfusions to VLBW infants with mild to moderate thrombocytopenia. OBJECTIVES: To characterize platelet transfusion practices in US neonatal intensive care units (NICUs), to determine whether severity of illness influences platelet transfusion decisions, and to examine the association between platelet count (PCT) and the risk for IVH in the first 7 days of life. DESIGN, SETTING, AND PARTICIPANTS: This multicenter, retrospective cohort study included 972 VLBW infants treated in 6 US NICUs, with admission dates from January 1, 2006, to December 31, 2007. Data were collected from all infants until NICU discharge or death (last day of data collected, December 4, 2008). Data were entered into the central database, cleaned, and analyzed from May 1, 2009, to February 11, 2016. INTERVENTION: Platelet transfusion. MAIN OUTCOMES AND MEASURES: Number of platelet transfusions and incidence of IVH. RESULTS: Among the 972 VLBW infants (520 [53.5%] male; mean [SD] gestational age, 28.2 [2.9] weeks), 231 received 1002 platelet transfusions (mean [SD], 4.3 [6.0] per infant; range, 1-63 per infant). The pretransfusion PCT was at least 50 000/µL for 653 of 998 transfusions (65.4%) with this information. Two hundred eighty-one transfusions (28.0%) were given during the first 7 days of life. During that period, platelet transfusions were given on 35 of 53 days (66.0%) when the patient had a PCT less than 50 000/µL and on 203 of 436 days (46.6%) when the patient had a PCT of 50 000/µL to 99 000/µL. At least 1 marker of severe illness was present on 198 of 212 patient-days (93.4%) with thrombocytopenia (PCT, <100 000/µL) when a platelet transfusion was given compared with 113 of 190 patient-days (59.5%) with thrombocytopenia when no platelet transfusion was given. Thrombocytopenia was a risk factor for intraventricular hemorrhage during the first 7 days of life (hazard ratio, 2.17; 95% CI, 1.53-3.08; P < .001). However, no correlation was found between severity of thrombocytopenia and risk for IVH. After controlling for significant clinical factors and thrombocytopenia, platelet transfusions did not have a significant effect on the incidence of IVH (hazard ratio, 0.92; 95% CI, 0.49-1.73; P = .80). CONCLUSIONS AND RELEVANCE: A large proportion of platelet transfusions were given to VLBW infants with PCT greater than 50 000/µL. Severity of illness influenced transfusion decisions. However, the severity of thrombocytopenia did not correlate with the risk for IVH, and platelet transfusions did not reduce this risk.

Platelet Transfusions in the Neonatal Intensive Care Unit.

There is significant world-wide variability in platelet transfusion thresholds used to transfuse thrombocytopenic neonates. A large multicenter randomized controlled trial comparing 2 different platelet transfusion thresholds in neonates is currently ongoing, and should provide data to guide transfusion practice. However, several studies have found that factors other than the degree of thrombocytopenia determine the bleeding risk. Thus, it will be important to develop better tests to assess primary hemostasis and bleeding risk in neonates.