Applying a validated scoring rubric to pre-clerkship medical students' standardized patient notes: a pilot study.

BACKGROUND: With the elimination in 2021 of the United States Medical Licensing Examination Step 2 Clinical Skills test, it is incumbent upon U.S. medical schools to develop local validated assessments of clinical reasoning. While much attention has been paid to summative exams for graduating students, formative exams for pre-clerkship students have not been well studied. METHODS: We applied the University of Illinois at Chicago College of Medicine (UIC-COM) Patient Note (PN) Scoring Rubric to templated PNs written by 103 pre-clerkship students for two cases in an objective structured clinical examination (OSCE) at the Yale School of Medicine. The rubric consists of four section scores (Documentation, Differential Diagnosis, Justification, and Workup, each scored 1 to 4) and a composite score (scaled 23 to 100). We calculated item discrimination for each section score and Cronbach's alpha for each case. We surveyed students about their experience writing the templated PN. RESULTS: Mean Documentation, Differential Diagnosis, Justification, Workup, and composite scores for case A were 2.16, 1.80, 1.65, 2.29, and 47.67, respectively. For case B, the scores were 2.13, 1.21, 1.60, 1.67, and 40.54, respectively. Item discrimination ranged from 0.41 to 0.80. Cronbach's alpha for cases A and B was 0.48 and 0.25, respectively. A majority of the students felt that the exercise was useful and appropriate to their level of training. CONCLUSIONS: Despite performing poorly, pre-clerkship students found the note-writing task beneficial. Reliability of the scoring rubric was suboptimal, and modifications are needed to make this exercise a suitable measure of clinical reasoning.

Fluid management of the critically Ill child.

PURPOSE OF REVIEW: This review summarizes current literature pertaining to fluid management for critically ill children. It includes an overview on crystalloid fluid used throughout the critical illness course, management of fluid output and complications with fluid overload. RECENT FINDINGS: Observational paediatric studies and adult randomized trials show mixed results regarding risk of mortality and kidney injury with 0.9% saline and crystalloid fluid. A recent adult randomized trial suggests that a fluid restrictive strategy may be well tolerated in critically ill adults with septic shock, but further randomized trials are needed in paediatrics. Fluid overload has been associated with increased morbidity and mortality. Trials exploring ways to decrease fluid accumulation must be done in paediatrics. SUMMARY: Additional high-quality studies are needed to precisely define the type, timing and rate of intravenous fluid critically ill children should receive throughout their clinical illness course.

Benefits and Limitations of Virtual Recruitment: Perspectives From Subspeciality Directors.

BACKGROUND AND OBJECTIVES: Because of the coronavirus disease 2019 pandemic and recommendations from a range of leaders and organizations, the pediatrics subspecialty 2020 recruitment season was entirely virtual. Minimal data exist on the effect of this change to guide future strategies. The aim of this study was to understand the effects of virtual recruitment on pediatric subspecialty programs as perceived by program leaders. METHODS: This concurrent, triangulation, mixed-methods study used a survey that was developed through an iterative (3 cycles), consensus-building, modified Delphi process and sent to all pediatric subspecialty program directors (PSPDs) between April and May 2021. Descriptive statistics and thematic analysis were used, and a conceptual framework was developed. RESULTS: Forty-two percent (352 of 840) of PSPDs responded from 16 of the 17 pediatric (94%) subspecialties; 60% felt the virtual interview process was beneficial to their training program. A majority of respondents (72%) reported cost savings were a benefit; additional benefits included greater efficiency of time, more applicants per day, greater faculty involvement, and perceived less time away from residency for applicants. PSPDs reported a more diverse applicant pool. Without an in-person component, PSPDs worried about programs and applicants missing informative, in-person interactions and applicants missing hospital tours and visiting the city. A model based upon theory of change was developed to aid program considerations for future application cycles. CONCLUSIONS: PSPDs identified several benefits to virtual recruitment, including ease of accommodating increased applicants with a diverse applicant pool and enhanced faculty involvement. Identified limitations included reduced interaction between the applicant and the larger institution/city.

Entrustment Decision Making in the Core Entrustable Professional Activities: Results of a Multi-Institutional Study.

PURPOSE: In 2014, the Association of American Medical Colleges defined 13 Core Entrustable Professional Activities (EPAs) that all graduating students should be ready to do with indirect supervision upon entering residency and commissioned a 10-school, 5-year pilot to test implementing the Core EPAs framework. In 2019, pilot schools convened trained entrustment groups (TEGs) to review assessment data and render theoretical summative entrustment decisions for class of 2019 graduates. Results were examined to determine the extent to which entrustment decisions could be made and the nature of these decisions. METHOD: For each EPA considered (4-13 per student), TEGs recorded an entrustment determination (ready, progressing but not yet ready, evidence against student progressing, could not make a decision); confidence in that determination (none, low, moderate, high); and the number of workplace-based assessments (WBAs) considered (0->15) per determination. These individual student-level data were de-identified and merged into a multischool database; chi-square analysis tested the significance of associations between variables. RESULTS: The 2,415 EPA-specific determinations (for 349 students by 4 participating schools) resulted in a decision of ready (n = 997/2,415; 41.3%), progressing but not yet ready (n = 558/2,415; 23.1%), or evidence against student progression (n = 175/2,415; 7.2%). No decision could be made for the remaining 28.4% (685/2,415), generally for lack of data. Entrustment determinations' distribution varied across EPAs (chi-square P < .001) and, for 10/13 EPAs, WBA availability was associated with making (vs not making) entrustment decisions (each chi-square P < .05). CONCLUSIONS: TEGs were able to make many decisions about readiness for indirect supervision; yet less than half of determinations resulted in a decision of readiness to perform this EPA with indirect supervision. More work is needed at the 10 schools to enable authentic summative entrustment in the Core EPAs framework.

Optimizing preclinical learning with retrieval practice: A call to action.

This Personal View is about our experience with preclinical education as medical students. We discuss the problem with current medical education in light of an ever-growing body of medical knowledge and increasing student disengagement with preclinical lectures. We briefly review the concept of retrieval practice as an effective, evidence-based learning strategy that helped us retain knowledge for longer periods and propose that medical educators should adopt this strategy to best prepare medical students to navigate the vastly expanding scope of modern medicine.

Outcomes of paediatric cardiac patients after 30 minutes of cardiopulmonary resuscitation prior to extracorporeal support.

OBJECTIVES: To characterise the mortality and neurological outcomes of paediatric cardiac patients requiring cardiopulmonary resuscitation for more than 30 minutes prior to extracorporeal membrane oxygenation cannulation and to identify risk factors associated with adverse outcomes in this population. MATERIALS AND METHODS: Observational retrospective cohort study in paediatric cardiac patients undergoing cardiopulmonary resuscitation for greater than 30 minutes prior to cannulation in a tertiary children's hospital, from July 2000 to July 2013. RESULTS: Seventy-three paediatric cardiac patients requiring cardiopulmonary resuscitation for more than 30 minutes prior to cannulation were included in the study. Survival to hospital discharge was 43.8%, with 75% of survivors having either normal neurologic function or only mild disability. Multivariable logistic regression analysis demonstrated that increased use of calcium during resuscitation (odds ratio 14.5, p 0.01), cardiopulmonary resuscitation duration >50 minutes (odds ratio 4.12, p 0.03), >6 interruptions of chest compressions during cannulation (odds ratio 6.40, p 0.03), the need for continuous renal replacement therapy (odds ratio 11.1, p 0.001), and abnormal pupillary response during extracorporeal membrane oxygenation (odds ratio 33.9, p 0.006) were independent predictors for hospital mortality. CONCLUSION: Survival after cardiopulmonary resuscitation for more than 30 minutes prior to extracorporeal membrane oxygenation cannulation in our paediatric cardiac cohort was 43.8%. Factors associated with mortality included calcium use during resuscitation, longer cardiopulmonary resuscitation, increased chest compression pauses during cannulation, the use of continuous renal replacement therapy, and abnormal pupils during extracorporeal membrane oxygenation support. A prospective assessment of these factors in paediatric cardiac patients may be beneficial in improving outcomes.

The Changing Face of HIV Care: Expanding HIV Training in an Internal Medicine Residency Program.

PROBLEM: People with HIV/AIDS are living longer and are at an increased risk of comorbidities. A qualified physician workforce is needed to care for this growing population. APPROACH: In 2012, a novel three-year HIV training track (HIV TT) was implemented as part of the Yale Primary Care Residency Program. To prepare for the implementation of this program, a needs assessment was performed, a web-based curriculum and 12 HIV-specific entrustable professional activities (EPAs) were created, and adequate clinical training opportunities in HIV and primary care were established. Program evaluation included process, learner, and outcome evaluations from 2012 to 2017. OUTCOMES: Since its inception, the HIV TT has enrolled a total of 11 residents (6-7 at a time), with 5 graduating to date. Residents delivered high-quality HIV and primary care for a diverse panel of patients; improved their knowledge and performance in HIV care, including according to the HIV-specific EPAs; and were highly satisfied with the program. All faculty remained with the program, and patients indicated satisfaction. NEXT STEPS: Next steps include enhanced coordination of residents' schedules, improved EPA documentation, evaluation of residents' HIV and non-HIV competence beyond residency, and monitoring graduates' career trajectories. Expanding HIV training within internal medicine residency programs is feasible and effective and has the potential to alleviate the shortage of physicians trained to provide HIV care and primary care in a single setting.

Underweight Status Is an Independent Predictor of In-Hospital Mortality in Pediatric Patients on Extracorporeal Membrane Oxygenation.

BACKGROUND: Malnutrition is associated with an increased risk of mortality in patients admitted to the intensive care unit. Children requiring extracorporeal membrane oxygenation (ECMO) support represent an extremely ill subset of this population. There is a lack of data on the impact of nutrition state on survival in this cohort. We examined the association between being underweight and in-hospital mortality among children supported with ECMO. MATERIALS AND METHODS: This article reports on an observational retrospective cohort study performed among neonatal and pediatric patients supported with ECMO in a tertiary children's hospital from May 1996 through June 2013. Nutrition status on intensive care unit admission was defined with z scores on weight for length and body mass index. RESULTS: Patients (N = 491) had a median age of 31 days (interquartile range, 2-771): 24.4% were underweight, and 8.9% were obese. During ECMO support, 88.3% received total parenteral nutrition, and 30.3% received enteral nutrition. Median maximum energy intake while receiving ECMO was 82 kcal/kg/d (interquartile range, 54.7-105). Multiple logistic regression showed that underweight status was associated with increased predicted odds of in-hospital mortality when compared with normal weight (odds ratio: 1.99, 95% confidence interval: 1.21-3.25, P = .006). Other factors associated with increased odds of mortality included extracorporeal cardiopulmonary resuscitation and the need for continuous renal replacement therapy. CONCLUSION: Underweight status was an independent predictor for in-hospital mortality in our cohort of pediatric ECMO patients. Prospective studies evaluating the impact of metabolic state of children on ECMO should further define this relationship.

Test-enhanced learning in health professions education: A systematic review: BEME Guide No. 48.

BACKGROUND: Cognitive psychology studies demonstrate that subjects who attempt to recall information show better learning, retention, and transfer than subjects who spend the same time studying the same material (test-enhanced learning, TEL). We systematically reviewed TEL interventions in health professions education. METHODS: We searched 13 databases, 14 medical education journals, and reference lists. Inclusion criteria included controlled studies of TEL that compared TEL to studying the same material or to a different TEL strategy. Two raters screened articles for inclusion, abstracted information, determined quality scores, and calculated the standardized mean difference (SMD) for the learning outcomes. RESULTS: Inter-rater agreement was excellent for all comparisons. The 19 included studies reported 41 outcomes with data sufficient to determine a SMD. TEL interventions included short answer questions, multiple choice questions, simulation, and standardized patients. Five of six immediate learning outcomes (SMD 0.09-0.44), 21 of 23 retention outcomes (SMD 0.12-2.5), and all seven transfer outcomes (SMD 0.33-1.1) favored TEL over studying. CONCLUSIONS: TEL demonstrates robust effects across health professions, learners, TEL formats, and learning outcomes. The effectiveness of TEL extends beyond knowledge assessed by examinations to clinical applications. Educators should include TEL in health professions curricula to enhance recall, retention, and transfer.

Beneficial effect of recombinant rC1rC2 collagenases on human islet function: Efficacy of low-dose enzymes on pancreas digestion and yield.

A high number of human islets can be isolated by using modern purified tissue dissociation enzymes; however, this requires the use of >20 Wunsch units (WU)/g of pancreas for digestion. Attempts to reduce this dose have resulted in pancreas underdigestion and poor islet recovery but improved islet function. In this study, we achieved a high number of functional islets using a low dose of recombinant collagenase enzyme mixture (RCEM-1200 WU rC2 and 10 million collagen-degrading activity [CDA] U of rC1 containing about 209 mg of collagenase to digest a 100-g pancreas). The collagenase dose used in these isolations is about 42% of the natural collagenase enzyme mixture (NCEM) dose commonly used to digest a 100-g pancreas. Low-dose RCEM was efficient in digesting entire pancreases to obtain higher yield (5535 ± 830 and 2582 ± 925 islet equivalent/g, P < .05) and less undigested tissue (16.7 ± 5% and 37.8 ± 3%, P < .05) compared with low-dose NCEM (12WU/g). Additionally, low-dose RCEM islets retained better morphology (confirmed with scanning electron microscopy) and higher in vitro basal insulin release (2391 ± 1342 and 1778 ± 978 µU/mL; P < .05) compared with standard-dose NCEM. Nude mouse bioassay demonstrated better islet function for low-dose RCEM (area under the curve [AUC] 24 968) compared with low-dose (AUC-38 225) or standard-dose NCEM (AUC-38 685), P < .05. This is the first report indicating that islet function can be improved by using low-dose rC1rC2 (RCEM).

Effectiveness of different molecular forms of C. histolyticum class I collagenase to recover islets.

One factor that may contribute to variability between different lots of purified collagenase to recover islets is the molecular form of C. histolyticum class I (C1) collagenase used in the isolation procedure. Two different enzyme mixtures containing C1, class II (C2) collagenase and BP Protease were compared for their effectiveness to recover islets from split adult porcine pancreas. The same enzyme activities per g trimmed tissue were used for all isolations with the only difference being the mass of C1 required to achieve 25,000 collagen degradation activity U/g tissue. The results show no differences in performance of the two enzyme mixtures. The only significant difference is 19 fold more truncated C1 was required to achieve the same result as intact C1.

Defining leadership competencies for pediatric critical care fellows: Results of a national needs assessment.

INTRODUCTION: Physicians in training, including those in Pediatric Critical Care Medicine, must develop clinical leadership skills in preparation to lead multidisciplinary teams during their careers. This study seeks to identify multidisciplinary perceptions of leadership skills important for Pediatric Critical Care Medicine fellows to attain prior to fellowship completion. METHODS: We performed a multi-institutional survey of Pediatric Critical Care Medicine attendings, fellows, and nurses. Subjects were asked to rate importance of 59 leadership skills, behaviors, and attitudes for Pediatric Critical Care practitioners and to identify whether these skills should be achieved before completing fellowship. Skills with the highest ratings by respondents were deemed essential. RESULTS: Five hundred and eighteen subjects completed the survey. Of 59 items, only one item ("displays honesty and integrity") was considered essential by all respondents. When analyzed by discipline, nurses identified 21 behaviors essential, fellows 3, and attendings 1 (p < 0.05). Nurses differed (p < 0.05) from attendings in their opinion of importance in 64% (38/59) of skills. CONCLUSIONS: Despite significant variability among Pediatric Critical Care attendings, fellows, and nurses in identifying which clinical leadership competencies are important for graduating Pediatric Critical Care fellows, they place the highest importance on skills in self-management and self-awareness. Leadership skills identified as most important may guide the development of interventions to improve trainee education and interprofessional care.

Optimizing Porcine Islet Isolation to Markedly Reduce Enzyme Consumption Without Sacrificing Islet Yield or Function.

BACKGROUND: Human allogeneic islet transplantation for treatment of type 1 diabetes provides numerous clinical benefits, such as fewer episodes of hypoglycemic unawareness and tighter control of blood glucose levels. Availability of human pancreas for clinical and research use, however, is severely limited. Porcine pancreas offers an abundant source of tissue for optimization of islet isolation methodology and future clinical transplantation, thereby increasing patient access to this potentially lifesaving procedure. METHODS: Porcine islet isolations were performed using varying amounts of collagenase (7.5, 3.75, or 2.5 Wunsch units per gram tissue) and neutral protease activity (12 000, 6000, or 4000 neutral protease units per gram tissue) and perfusion volumes (1.7 or 0.85 mL/g tissue) to assess their effects on isolation outcomes. Retention of dissociative enzymes within the pancreas during perfusion and digestion was evaluated, along with distribution of the perfusion solution within the tissue. RESULTS: Reducing enzyme usage by as much as 67% and perfusion volume by 50% led to equally successful islet isolation outcomes when compared with the control group (48 ± 7% of tissue digested and 1088 ± 299 islet equivalents per gram of pancreas vs 47 ± 11% and 1080 ± 512, respectively). Using margin-marking dye in the perfusion solution to visualize enzyme distribution demonstrated that increasing perfusion volume did not improve tissue infiltration. CONCLUSIONS: Current protocols for porcine islet isolation consume excessive amounts of dissociative enzymes, elevating cost and limiting research and development. These data demonstrate that islet isolation protocols can be optimized to significantly reduce enzyme usage while maintaining yield and function and thus accelerating progress toward clinical application.

Identifying Effective Enzyme Activity Targets for Recombinant Class I and Class II Collagenase for Successful Human Islet Isolation.

UNLABELLED: Isolation following a good manufacturing practice-compliant, human islet product requires development of a robust islet isolation procedure where effective limits of key reagents are known. The enzymes used for islet isolation are critical but little is known about the doses of class I and class II collagenase required for successful islet isolation. METHODS: We used a factorial approach to evaluate the effect of high and low target activities of recombinant class I (rC1) and class II (rC2) collagenase on human islet yield. Consequently, 4 different enzyme formulations with divergent C1:C2 collagenase mass ratios were assessed, each supplemented with the same dose of neutral protease. Both split pancreas and whole pancreas models were used to test enzyme targets (n = 20). Islet yield/g pancreas was compared with historical enzymes (n = 42). RESULTS: Varying the Wunsch (rC2) and collagen degradation activity (CDA, rC1) target dose, and consequently the C1:C2 mass ratio, had no significant effect on tissue digestion. Digestions using higher doses of Wunsch and CDA resulted in comparable islet yields to those obtained with 60% and 50% of those activities, respectively. Factorial analysis revealed no significant main effect of Wunsch activity or CDA for any parameter measured. Aggregate results from 4 different collagenase formulations gave 44% higher islet yield (>5000 islet equivalents/g) in the body/tail of the pancreas (n = 12) when compared with those from the same segment using a standard natural collagenase/protease mixture (n = 6). Additionally, islet yields greater than 5000 islet equivalents/g pancreas were also obtained in whole human pancreas. CONCLUSIONS: A broader C1:C2 ratio can be used for human islet isolation than has been used in the past. Recombinant collagenase is an effective replacement for the natural enzyme and we have determined that high islet yield can be obtained even with low doses of rC1:rC2, which is beneficial for the survival of islets.

Developing a Tool to Assess Placement of Central Venous Catheters in Pediatrics Patients.

BACKGROUND: Pediatric critical care medicine requires the acquisition of procedural skills, but to date no criteria exist for assessing trainee competence in central venous catheter (CVC) insertion. OBJECTIVE: The goal of this study was to create and demonstrate validity evidence for a direct observation tool for assessing CVC insertion. METHODS: Ten experts used the modified Delphi technique to create a 15-item direct observation tool to assess 5 scripted and filmed simulated scenarios of CVC placement. The scenarios were hosted on a dedicated website from March to May 2013, and respondents recruited by e-mail completed the observation tool in real time while watching the scenarios. The goal was to obtain 50 respondents and a total of 250 scenario ratings. RESULTS: A total of 49 pediatrics intensive care faculty physicians (6.3% of 780 potential subjects) responded and generated 188 scenario observations. Of these, 150 (79.8%) were recorded from participants who scored 4 or more on the 5 scenarios. The tool correctly identified the expected reference standard in 96.8% of assessments with an interrater agreement kappa (standard error) = 0.94 (0.07) and receiver operating characteristic = 0.97 (95% CI 0.94-0.99). CONCLUSIONS: This direct observation assessment tool for central venous catheterization demonstrates excellent performance in identifying the reference standard with a high degree of interrater reliability. These assessments support a validity construct for a pediatric critical care medicine faculty member to assess a provider placing a CVC in a pediatrics patient.

The diverse surgeons' initiative: longitudinal assessment of a successful national program.

BACKGROUND: The Diverse Surgeons Initiative (DSI) is a program that was created to provide underrepresented minority surgical residents with the clinical knowledge and minimally invasive surgical skills necessary to excel in surgical residency and successfully transition into surgical practice. The early success of the graduates of the program has been published; however, a more longitudinal assessment of the program was suggested and warranted. This study provides a 5-year follow-up of the 76 physicians that participated in the DSI from 2002 to 2009 to determine if the trend toward fellowship placement and academic appointments persisted. Additionally, this extended evaluation yields an opportunity to assess these young surgeons' professional progress and contributions to the field. STUDY DESIGN: The most current professional development and employment information was obtained for the 76 physicians that completed the DSI from 2002 to 2009. The percentage of DSI graduates completing surgical residency, obtaining subspecialty fellowships, attaining board certification, receiving fellowship in the American College of Surgeons, contributing to the peer-reviewed literature, acquiring academic faculty positions, and ascending to professional leadership roles were calculated and compared with the original assessment. RESULTS: Of the 76 DSI graduates, 99% completed general surgery residency. Of those eligible, 87% completed subspecialty fellowships; 87% were board certified; 50% received fellowship in the American College of Surgeons; 76% had contributed to the peer-reviewed literature; 41% had obtained faculty positions; and 18% held local, regional, or national professional leadership positions. CONCLUSIONS: This longitudinal analysis has revealed sustained success of the DSI in preparing underrepresented minority residents to excel in their training and transition into practice, obtain postsurgical fellowships, acquire faculty appointments, and contribute to the advancement of the field of surgery.

Transforming primary care training--patient-centered medical home entrustable professional activities for internal medicine residents.

INTRODUCTION: The U.S. faces a critical gap between residency training and clinical practice that affects the recruitment and preparation of internal medicine residents for primary care careers. The patient-centered medical home (PCMH) represents a new clinical microsystem that is being widely promoted and implemented to improve access, quality, and sustainability in primary care practice. AIM: We address two key questions regarding the training of internal medicine residents for practice in PCMHs. First, what are the educational implications of practice transformations to primary care home models? Second, what must we do differently to prepare internal medicine residents for their futures in PCMHs? PROGRAM DESCRIPTION: The 2011 Society of General Internal Medicine (SGIM) PCMH Education Summit established seven work groups to address the following topics: resident workplace competencies, teamwork, continuity of care, assessment, faculty development, 'medical home builder' tools, and policy. The output from the competency work group was foundational for the work of other groups. The work group considered several educational frameworks, including developmental milestones, competencies, and entrustable professional activities (EPAs). RESULTS: The competency work group defined 25 internal medicine resident PCMH EPAs. The 2011 National Committee for Quality Assurance (NCQA) PCMH standards served as an organizing framework for EPAs. DISCUSSION: The list of PCMH EPAs has the potential to begin to transform the education of internal medicine residents for practice and leadership in the PCMH. It will guide curriculum development, learner assessment, and clinical practice redesign for academic health centers.

Screening, brief intervention, and referral to treatment (SBIRT) for alcohol and other drug use among adolescents: evaluation of a pediatric residency curriculum.

The objective of this study was to evaluate the integration of a screening, brief intervention, and referral to treatment (SBIRT) curriculum for alcohol and other drug use into a pediatric residency program. Pediatric and medicine/pediatric residents in an adolescent medicine rotation located in an urban teaching hospital participated in the study. Main outcome measures were pre- and post-training knowledge scores, performance of the Brief Negotiation Interview (BNI), training satisfaction, and adoption of the BNI into clinical practice. Thirty-four residents were trained. Significant pre- to post-training improvements were seen in knowledge scores (P < .001) and performance as measured by the BNI Adherence Scale (P < .001). Residents reported high satisfaction immediately post-training and at 30 days on a 1-5 Likert scale: mean 1.41 to 1.59 (1 = very satisfied) (P = 0.23). Over a 9-month period, 53% of residents documented performing at least 1 BNI, of which 2/3 reported ≥2 BNIs in a subsequent clinical setting. The results show that integrating a SBIRT curriculum into a pediatric residency program increases residents' knowledge and skills.