Development and Pilot Testing of a Programmatic System for Competency Assessment in US Anesthesiology Residency Training.

BACKGROUND: In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS: Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS: New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS: A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.

Development and Pilot Testing of Entrustable Professional Activities for US Anesthesiology Residency Training.

BACKGROUND: Modern medical education requires frequent competency assessment. The Accreditation Council for Graduate Medical Education (ACGME) provides a descriptive framework of competencies and milestones but does not provide standardized instruments to assess and track trainee competency over time. Entrustable professional activities (EPAs) represent a workplace-based method to assess the achievement of competency milestones at the point-of-care that can be applied to anesthesiology training in the United States. METHODS: Experts in education and competency assessment were recruited to participate in a 6-step process using a modified Delphi method with iterative rounds to reach consensus on an entrustment scale, a list of EPAs and procedural skills, detailed definitions for each EPA, a mapping of the EPAs to the ACGME milestones, and a target level of entrustment for graduating US anesthesiology residents for each EPA and procedural skill. The defined EPAs and procedural skills were implemented using a website and mobile app. The assessment system was piloted at 7 anesthesiology residency programs. After 2 months, faculty were surveyed on their attitudes on usability and utility of the assessment system. The number of evaluations submitted per month was collected for 1 year. RESULTS: Participants in EPA development included 18 education experts from 11 different programs. The Delphi rounds produced a final list of 20 EPAs, each differentiated as simple or complex, a defined entrustment scale, mapping of the EPAs to milestones, and graduation entrustment targets. A list of 159 procedural skills was similarly developed. Results of the faculty survey demonstrated favorable ratings on all questions regarding app usability as well as the utility of the app and EPA assessments. Over the 2-month pilot period, 1636 EPA and 1427 procedure assessments were submitted. All programs continued to use the app for the remainder of the academic year resulting in 12,641 submitted assessments. CONCLUSIONS: A list of 20 anesthesiology EPAs and 159 procedural skills assessments were developed using a rigorous methodology to reach consensus among education experts. The assessments were pilot tested at 7 US anesthesiology residency programs demonstrating the feasibility of implementation using a mobile app and the ability to collect assessment data. Adoption at the pilot sites was variable; however, the use of the system was not mandatory for faculty or trainees at any site.

Assessment of circulating blood volume with fluid administration targeting euvolemia or hypervolemia.

BACKGROUND: The occurrence of hypovolemia in the setting of cerebral vasospasm reportedly increases the risk for delayed ischemic neurologic deficits. Few studies have objectively assessed blood volume (BV) in response to fluid administration targeting normovolemia (NV) or hypervolemia (HV) and none have done so with crystalloids alone. The primary purpose was to evaluate the BV of patients with SAH receiving crystalloid fluid administration targeting NV or HV. METHODS: The University of Washington IRB approved the study. Prospectively collected data was obtained from patients enrolled in a clinical trial and a concurrent group of patients who received IV fluids during the ICU stay. We defined a normovolemia (NV) and hypervolemia (HV) group based on the cumulative amount of IV fluid administered in mL/kg from ICU admission to day 5; ≥30-60 mL/kg/day (NV) and ≥60 mL/kg/day (HV), respectively. In a subgroup of patients, BV was measured on day 5 post ictus using iodinated (131)I-labeled albumin injection and the BVA-100 (Daxor Corp, New York, NY). Differences between the NV and HV groups were compared using Student's t-test with assumption for unequal variance. RESULTS: Twenty patients in the NV and 19 in the HV groups were included. The HV group received more fluid and had a higher fluid balance than the NV group. The subgroup of patients in whom BV was measured on day 5 (n = 19) was not different from the remainder of the cohort with respect to the total amount of administered fluid and net cumulative fluid balance by day 5. BV was not different between the two groups and varied widely. CONCLUSIONS: Routinely targeting prophylactic HV using crystalloids does not result in a higher circulating BV compared to targeting NV, but the possibility of clinically unrecognized hypovolemia remains.

Differences in end-of-life care in the ICU across patients cared for by medicine, surgery, neurology, and neurosurgery physicians.

BACKGROUND: Some of the challenges in the delivery of high-quality end-of-life care in the ICU include the variability in the characteristics of patients with certain illnesses and the practice of critical care by different specialties. METHODS: We examined whether ICU attending specialty was associated with quality of end-of-life care by using data from a clustered randomized trial of 14 hospitals. Patients died in the ICU or within 30 h of transfer and were categorized by specialty of the attending physician at time of death (medicine, surgery, neurology, or neurosurgery). Outcomes included family ratings of satisfaction, family and nurse ratings of quality of dying, and documentation of palliative care in medical records. Associations were tested using multipredictor regression models adjusted for hospital site and for patient, family, or nurse characteristics. RESULTS: Of 3,124 patients, the majority were cared for by an attending physician specializing in medicine (78%), with fewer from surgery (12%), neurology (3%), and neurosurgery (6%). Family satisfaction did not vary by attending specialty. Patients with neurology or neurosurgery attending physicians had higher family and nurse ratings of quality of dying than patients of attending physicians specializing in medicine (P < .05). Patients with surgery attending physicians had lower nurse ratings of quality of dying than patients with medicine attending physicians (P < .05). Chart documentation of indicators of palliative care differed by attending specialty. CONCLUSIONS: Patients cared for by neurology and neurosurgery attending physicians have higher family and nurse ratings of quality of dying than patients cared for by medicine attending physicians and have a different pattern of indicators of palliative care. Patients with surgery attending physicians had fewer documented indicators of palliative care. These findings may provide insights into potential ways to improve the quality of dying for all patients. TRIAL REGISTRY: ClinicalTrials.gov; No.: NCT00685893; URL: www.clinicaltrials.gov.

Validity of exchangeable solute balance as a measure of blood volume in neurologically injured adults.

BACKGROUND: Daily weight (DW) and examination of fluid balances (FB) are commonly used in assessments of extracellular fluid (ECF) and circulating blood volume (BV). We hypothesized that a calculated total body exchangeable solute, the main determinant of the ECF, would have high agreement and correlation with actual BV. METHODS: The University of Washington IRB approved the study. We included a sample of consecutive adult patients in whom a BV was measured, while in the neuroscience intensive care units of a large academic medical center. BV was measured as part of routine care using iodinated (131)I albumin injection and the BVA-100 (Daxor Corp, New York, NY, USA). Total body exchangeable solute was estimated at the time of BV measurement by multiplying the calculated total body water by the sum of the sodium plus potassium and chloride measured in plasma. The correlation between the change in DW, FB (adjusted for insensible fluid loss), exchangeable solute, and BV was performed using linear regression with adjustment for number of days between admit and BV measurement, and capillary leak. Errors were computed using robust variance estimation. RESULTS: 55 patients had BV tests available, and 43 of them had subarachnoid hemorrhage. Total body exchangeable solute strongly correlated with BV (r = 0.75, 95% CI 0.63-0.84, p < 0.01 for Na(+)/K(+), and r = 0.71, 95% CI 0.58-0.81, p < 0.01 for Cl(-)). DW (r = 0.21) and FB (r = 0.11) were not correlated with BV. CONCLUSIONS: Total body exchangeable solute appears to be a valid and reliable measure of BV and can be calculated using information readily available at the bedside. The value of having this information automatically calculated and available at the bedside should be explored.

Rat intubation and ventilation for surgical research.

Effective outcomes in cardiothoracic surgical research using rodents are dependent upon adequate techniques for intubation and mechanical ventilation. Multiple methods are available for intubation of the rat; however, not all techniques are appropriate for survival studies. This article presents a refinement of intubation techniques and a simplified mechanical ventilation setup necessary for intrathoracic surgical procedures using volatile anesthetics. The procedure is defined and complications of the procedure are elucidated that provide a justification for animal numbers needed for initiating new studies. Lewis rats weighing 178-400 g (287 +/- 44) were anesthetized using Enflurane and intubated with a 16-G angiocatheter using transillumination. Mechanical ventilation (85 bpm, 2.5 mL TV, enflurane 1.5-2%) maintained adequate sedation for completion of an intrathoracic procedure. Complications of the intubation and ventilation included mortality from anesthetic overdose, intubation difficulty, pneumothorax, traumatic extubation, and ventilation disconnection. Anesthetic agents and their related effects on the rat heart and reflexes are compared. This article also underscores the importance of refinement, reduction, and replacement in the context of cardiothoracic surgery using rodent models.