Development and Pilot Testing of a Programmatic System for Competency Assessment in US Anesthesiology Residency Training.

BACKGROUND: In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS: Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS: New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS: A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.

Effects of General Anesthesia Plus Multimodal Analgesia on Immediate Perioperative Outcomes of Hamstring Tendon Autograft ACL Reconstruction: A Randomized, Double-Blinded, Placebo-Controlled Trial.

Anterior cruciate ligament reconstruction with hamstring tendon autograft (H-ACLR) is a standard ambulatory procedure with the potential for considerable postoperative pain. We hypothesized that general anesthesia combined with a multimodal analgesia regimen would reduce postoperative opioid use associated with H-ACLR. Methods: This study was a single-center, surgeon-stratified, double-blinded, placebo-controlled, randomized clinical trial. The primary end point was the total postoperative opioid use during the immediate postoperative period, and secondary outcomes included postoperative knee pain, adverse events, and ambulatory discharge efficiency. Results: One hundred and twelve subjects, 18 to 52 years of age, were randomized to placebo (57 subjects) or combination multimodal analgesia (MA) (55 subjects). The MA group required fewer opioids postoperatively (mean ± standard deviation, 9.81 ± 7.58 versus 13.88 ± 8.49 morphine milligram equivalents; p = 0.010; effect size = -0.51). Similarly, the MA group required fewer opioids within the first 24 hours postoperatively (mean ± standard deviation, 16.56 ± 10.77 versus 22.13 ± 10.66 morphine milligram equivalents; p = 0.008; effect size = -0.52). The subjects in the MA group reported lower posteromedial knee pain (median [interquartile range, IQR]: 3.0 [0.0 to 5.0] versus 4.0 [2.0 to 5.0]; p = 0.027) at 1 hour postoperatively. Nausea medication was required for 10.5% of the subjects receiving the placebo versus 14.5% of the subjects receiving MA (p = 0.577). Pruritis was reported for 17.5% of subjects receiving the placebo versus 14.5% receiving MA (p = 0.798). The median time to discharge was 177 minutes (IQR, 150.5 to 201.0 minutes) for subjects receiving placebo versus 188 minutes (IQR, 160.0 to 222.0 minutes) for those receiving MA (p = 0.271). Conclusions: A combination of general anesthesia and local, regional, oral, and intravenous multimodal analgesia appears to reduce postoperative opioid requirements after H-ACLR compared with placebo. Adding preoperative patient education and focusing on donor-site analgesia may maximize perioperative outcomes. Level of Evidence: Therapeutic Level I. See Instructions for Authors for a complete description of levels of evidence.

Development and Pilot Testing of Entrustable Professional Activities for US Anesthesiology Residency Training.

BACKGROUND: Modern medical education requires frequent competency assessment. The Accreditation Council for Graduate Medical Education (ACGME) provides a descriptive framework of competencies and milestones but does not provide standardized instruments to assess and track trainee competency over time. Entrustable professional activities (EPAs) represent a workplace-based method to assess the achievement of competency milestones at the point-of-care that can be applied to anesthesiology training in the United States. METHODS: Experts in education and competency assessment were recruited to participate in a 6-step process using a modified Delphi method with iterative rounds to reach consensus on an entrustment scale, a list of EPAs and procedural skills, detailed definitions for each EPA, a mapping of the EPAs to the ACGME milestones, and a target level of entrustment for graduating US anesthesiology residents for each EPA and procedural skill. The defined EPAs and procedural skills were implemented using a website and mobile app. The assessment system was piloted at 7 anesthesiology residency programs. After 2 months, faculty were surveyed on their attitudes on usability and utility of the assessment system. The number of evaluations submitted per month was collected for 1 year. RESULTS: Participants in EPA development included 18 education experts from 11 different programs. The Delphi rounds produced a final list of 20 EPAs, each differentiated as simple or complex, a defined entrustment scale, mapping of the EPAs to milestones, and graduation entrustment targets. A list of 159 procedural skills was similarly developed. Results of the faculty survey demonstrated favorable ratings on all questions regarding app usability as well as the utility of the app and EPA assessments. Over the 2-month pilot period, 1636 EPA and 1427 procedure assessments were submitted. All programs continued to use the app for the remainder of the academic year resulting in 12,641 submitted assessments. CONCLUSIONS: A list of 20 anesthesiology EPAs and 159 procedural skills assessments were developed using a rigorous methodology to reach consensus among education experts. The assessments were pilot tested at 7 US anesthesiology residency programs demonstrating the feasibility of implementation using a mobile app and the ability to collect assessment data. Adoption at the pilot sites was variable; however, the use of the system was not mandatory for faculty or trainees at any site.

Isokinetic Strength Deficit 6 Months After Adductor Canal Blockade for Anterior Cruciate Ligament Reconstruction.

BACKGROUND: Recent evidence shows a delayed return to sport in children and delayed quadriceps recovery in both adults and children who have undergone anterior cruciate ligament (ACL) reconstruction with concomitant femoral nerve blockade (FNB) compared with those who had no blockade. We evaluated the use of adductor canal blockade (ACB), as an alternative to FNB, at the time of ACL reconstruction. HYPOTHESIS: Patients who receive ACB will have greater isokinetic strength at 6 months postoperative compared with patients who receive FNB at the time of ACL reconstruction. STUDY DESIGN: Cohort study; Level of evidence, 3. METHODS: A retrospective record review was performed at a single academic medical center to identify all patients aged ≥16 years who had undergone ACL reconstruction with blockade between January 2010 and January 2015. Exclusion criteria included (1) non-sports medicine fellowship-trained surgeon performing the procedure, (2) continuous nerve catheter or concurrent epidural used, (3) revision ACL reconstruction or multiligament reconstruction as the index procedure, (4) previous contralateral ACL reconstruction, (5) concurrent microfracture, and (6) additional surgery within the 6-month outcome period that affected recovery. Isokinetic strength testing was performed using a computerized dynamometer, measuring total work at fast speed and peak torque at slow speed at 6 months; results were evaluated as a percentage of the nonoperative side. Multivariate regression analysis was used to evaluate the effect of block type on isokinetic strength outcome variables, controlling for age, sex, body mass index, graft type, and surgeon. RESULTS: There were 230 patients receiving FNB and 30 patients receiving ACB included in the study. The multivariate regression analysis identified a greater side-to-side deficit in extension total work for the ACB group compared with the FNB group (P = .040), after controlling for age, sex, body mass index, graft type, and surgeon. CONCLUSION: Compared with FNB, ACB for ACL reconstruction is associated with a persistent fast-activation isokinetic strength deficit at 6 months after surgery. This is the first study to compare FNB to ACB, and results are concerning for patients planning an early return to sport.

Validation of the unassisted, gum-elastic bougie-guided, laryngeal mask airway-ProSeal™ placement technique in anaesthetized patients.

AIMS: The laryngeal mask airway-ProSeal™ can be inserted digitally, by introducer tool, or by railroading it over a bougie placed first in the patient's oesophagus, which is highly successful, but as originally described, requires an assistant. An unassisted bougie-guided placement technique has also been described, but no data on its effectiveness have been reported. METHODS: We reviewed data collected during a randomized, controlled trial comparing the air-Q(®) Intubating Laryngeal Airway and LMA-Proseal™, in which all LMA-Proseal™ devices were inserted using the unassisted (one-operator), bougie-guided placement technique. RESULTS: Forty-eight devices were placed. All devices were placed successfully. Successful placement was achieved in 47 (98%) patients on first attempt and in one (2%) patient on the third attempt. Mean (SD) time required for insertion establishing ventilation was 28 (11) s. Mean (SD) airway seal pressure was 30 (6) cmH(2)O. Gross blood was found on four (8%) devices upon removal, but no oropharyngeal injuries were noted on oral exam in the recovery unit prior to discharge. The most common complaints in recovery and 24 h post-operatively were sore throat [discharge: mild = 18/48 (38%); 24 h: mild = 9/38 (19%), moderate = 1/38 (3%)] and pain on swallowing [discharge: mild = 7/48 (15%); 24 h: mild = 2/38 (6%)]. CONCLUSIONS: Our data confirm that in experienced hands, bougie-guided placement of the LMA-Proseal™ without the aid of an assistant can be accomplished quickly and successfully without affecting the expected clinical performance of the device.