Competency-Based Time-Variable Anesthesiology Residency Training: Identification of Problems and Solutions.

BACKGROUND: Global medical education is gradually moving toward more comprehensive implementations of a competency-based education (CBE) model. Elimination of standard time-based training and adoption of time-variable training (competency-based time-variable training [CB-TVT]) is one of the final stages of implementation of CBE. While CB-TVT has been implemented in some programs outside the United States, residency programs in the United States are still exploring this approach to training. The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) are encouraging member boards and residency review committees to consider innovative ways programs could implement CB-TVT. The goals of this study were to (1) identify potential problems with the implementation of CB-TVT in anesthesiology residency training, (2) rank the importance of the problems and the perceived difficulty of solving them, and (3) develop proposed solutions to the identified problems. METHODS: Study participants were recruited from key stakeholder groups in anesthesiology education, including current or former program directors, department chairs, residents, fellows, American Board of Anesthesiology (ABA) board members, ACGME residency review committee members or ACGME leaders, designated institutional officials, residency program coordinators, clinical operations directors, and leaders of large anesthesiology community practice groups. This study was conducted in 2 phases. In phase 1, survey questionnaires were iteratively distributed to participants to identify problems with the implementation of CB-TVT. Participants were also asked to rank the perceived importance and difficulty of each problem and to identify relevant stakeholder groups that would be responsible for solving each problem. In phase 2, surveys focused on identifying potential solutions for problems identified in phase 1. RESULTS: A total of 36 stakeholders identified 39 potential problems, grouped into 7 major categories, with the implementation of CB-TVT in anesthesiology residency training. Of the 39 problems, 19 (48.7%) were marked as important or very important on a 5-point scale and 12 of 19 (63.2%) of the important problems were marked as difficult or very difficult to solve on a 5-point scale. Stakeholders proposed 165 total solutions to the identified problems. CONCLUSIONS: CB-TVT is a promising educational model for anesthesiology residency, which potentially results in learner flexibility, individualization of curricula, and utilization of competencies to determine learner advancement. Because of the potential problems with the implementation of CB-TVT, it is important for future pilot implementations of CB-TVT to document realized problems, efficacy of solutions, and effects on educational outcomes to justify the burden of implementing CB-TVT.

A Multi-Site Survey Study on the Association Between the COVID-19 Pandemic and United States Anesthesiology Residents' Mental Health.

BACKGROUND:  At the onset of the coronavirus disease 2019 (COVID-19) pandemic, anesthesiology residency programs were impacted differently due to various factors such as the local severity of COVID-19, exposure to patient suffering, and inability to complete rotations. We sought to investigate the impact of local-level pandemic severity on the well-being of anesthesiology residents. METHODS:  This multi-site study surveyed postgraduate year two residents from 15 United States (US) anesthesiology programs using the Perceived Stress Scale, Mini-Z, Patient Health Questionnaire-9,WHO-5 Well-Being Index,and the Multidimensional Scale of Perceived Social Support before the pandemic (baseline survey) and during the first COVID-19 surge (post survey). RESULTS:  A total of 144 (65%) residents responded to the initial baseline survey; 73 (33%) responded to the post survey, and 49 (22%) completed both surveys. There was not a statistically significant difference in any well-being outcomes of participants between the surveys, nor was there a significant difference based on the severity of COVID-19 impact at the program's hospital. Male participants had higher perceived stress scores (ß = 4.05, 95%CI: 0.42, 7.67, P = 0.03) and lower social support from family (ß = -6.57, 95%CI: -11.64, -1.51, P = 0.01) at the post survey compared to female participants after controlling for baseline scores. Additionally, married participants or those with domestic partners reported higher perceived social support in the post survey (ß = 5.79, 95%CI: -0.65, 12.23, P = 0.03). CONCLUSION:  The local COVID-19 severity at a residency program did not disproportionately impact well-being scores among anesthesiology residents. Those most vulnerable to diminished well-being appeared to be male and single participants. As a result, targeted well-being interventions, including those aiming to increase social support, to higher-risk resident groups may be indicated. Future work is needed to assess the longstanding COVID-19 pandemic impacts on resident well-being.

Transitioning to Virtual Meetings: Experiences From the Society for Education in Anesthesia Virtual Fall 2020 Meeting.

The COVID-19 pandemic has forced organizers of traditional in-person continuing medical education conferences to transition to a virtual format. There are both advantages and disadvantages to this change in format. When planning a virtual meeting, several factors require consideration, including costs, virtual platforms, sponsorship, networking, and meeting logistics. This manuscript describes the authors' experiences of transforming the Society of Education in Anesthesia 2020 Fall Meeting into a virtual conference and explores the lessons learned and future impacts of this new medium.

Using Machine Learning to Evaluate Attending Feedback on Resident Performance.

BACKGROUND: High-quality and high-utility feedback allows for the development of improvement plans for trainees. The current manual assessment of the quality of this feedback is time consuming and subjective. We propose the use of machine learning to rapidly distinguish the quality of attending feedback on resident performance. METHODS: Using a preexisting databank of 1925 manually reviewed feedback comments from 4 anesthesiology residency programs, we trained machine learning models to predict whether comments contained 6 predefined feedback traits (actionable, behavior focused, detailed, negative feedback, professionalism/communication, and specific) and predict the utility score of the comment on a scale of 1-5. Comments with ≥4 feedback traits were classified as high-quality and comments with ≥4 utility scores were classified as high-utility; otherwise comments were considered low-quality or low-utility, respectively. We used RapidMiner Studio (RapidMiner, Inc, Boston, MA), a data science platform, to train, validate, and score performance of models. RESULTS: Models for predicting the presence of feedback traits had accuracies of 74.4%-82.2%. Predictions on utility category were 82.1% accurate, with 89.2% sensitivity, and 89.8% class precision for low-utility predictions. Predictions on quality category were 78.5% accurate, with 86.1% sensitivity, and 85.0% class precision for low-quality predictions. Fifteen to 20 hours were spent by a research assistant with no prior experience in machine learning to become familiar with software, create models, and review performance on predictions made. The program read data, applied models, and generated predictions within minutes. In contrast, a recent manual feedback scoring effort by an author took 15 hours to manually collate and score 200 comments during the course of 2 weeks. CONCLUSIONS: Harnessing the potential of machine learning allows for rapid assessment of attending feedback on resident performance. Using predictive models to rapidly screen for low-quality and low-utility feedback can aid programs in improving feedback provision, both globally and by individual faculty.

Improving intraoperative temperature management in elective repeat cesarean deliveries: a retrospective observational cohort study.

BACKGROUND: Inadvertent perioperative hypothermia (< 36 °C) occurs frequently during elective cesarean delivery and most institutions do employ perioperative active warming. The purpose of this retrospective observational cohort study was to determine if the addition of preoperative forced air warming in conjunction with intraoperative underbody forced air warming improved core temperature and reducing inadvertent perioperative hypothermia during elective repeat elective cesarean delivery with neuraxial anesthesia. METHODS: We evaluated the addition of perioperative active warming to standard passive warming methods (preheated intravenous/irrigation fluids and cotton blankets) in 120 parturients scheduled for repeat elective cesarean delivery (passive warming, n = 60 vs. active + passive warming, n = 60) in a retrospective observational cohort study. The primary outcomes of interest were core temperature at the end of the procedure and a decrease in inadvertent perioperative hypothermia (< 36 °C). Secondary outcomes were surgical site infections and adverse markers of neonatal outcome. RESULTS: The mean temperature at the end of surgery after instituting the active warming protocol was 36.0 ± 0.5 °C (mean ± SD, 95% CI 35.9-36.1) vs. 35.4 ± 0.5 °C (mean ± SD, 95% CI 35.3-35.5) compared to passive warming techniques (p <  0.001) and the incidence of inadvertent perioperative hypothermia at the end of the procedure was less in the active warming group - 68% versus 92% in the control group (p <  0.001). There was no difference in surgical site infections or neonatal outcomes. CONCLUSIONS: Perioperative active warming in combination with passive warming techniques was associated with a higher maternal temperature and lower incidence of inadvertent perioperative hypothermia with no detectable differences in surgical site infections or indicators of adverse neonatal outcomes.

Enhancing Feedback on Professionalism and Communication Skills in Anesthesia Residency Programs.

BACKGROUND: Despite its importance, training faculty to provide feedback to residents remains challenging. We hypothesized that, overall, at 4 institutions, a faculty development program on providing feedback on professionalism and communication skills would lead to (1) an improvement in the quantity, quality, and utility of feedback and (2) an increase in feedback containing negative/constructive feedback and pertaining to professionalism/communication. As secondary analyses, we explored these outcomes at the individual institutions. METHODS: In this prospective cohort study (October 2013 to July 2014), we implemented a video-based educational program on feedback at 4 institutions. Feedback records from 3 months before to 3 months after the intervention were rated for quality (0-5), utility (0-5), and whether they had negative/constructive feedback and/or were related to professionalism/communication. Feedback records during the preintervention, intervention, and postintervention periods were compared using the Kruskal-Wallis and χ tests. Data are reported as median (interquartile range) or proportion/percentage. RESULTS: A total of 1926 feedback records were rated. The institutions overall did not have a significant difference in feedback quantity (preintervention: 855/3046 [28.1%]; postintervention: 896/3327 [26.9%]; odds ratio: 1.06; 95% confidence interval, 0.95-1.18; P = .31), feedback quality (preintervention: 2 [1-4]; intervention: 2 [1-4]; postintervention: 2 [1-4]; P = .90), feedback utility (preintervention: 1 [1-3]; intervention: 2 [1-3]; postintervention: 1 [1-2]; P = .61), or percentage of feedback records containing negative/constructive feedback (preintervention: 27%; intervention: 32%; postintervention: 25%; P = .12) or related to professionalism/communication (preintervention: 23%; intervention: 33%; postintervention: 24%; P = .03). Institution 1 had a significant difference in feedback quality (preintervention: 2 [1-3]; intervention: 3 [2-4]; postintervention: 3 [2-4]; P = .001) and utility (preintervention: 1 [1-3]; intervention: 2 [1-3]; postintervention: 2 [1-4]; P = .008). Institution 3 had a significant difference in the percentage of feedback records containing negative/constructive feedback (preintervention: 16%; intervention: 28%; postintervention: 17%; P = .02). Institution 2 had a significant difference in the percentage of feedback records related to professionalism/communication (preintervention: 26%; intervention: 57%; postintervention: 31%; P < .001). CONCLUSIONS: We detected no overall changes but did detect different changes at each institution despite the identical intervention. The intervention may be more effective with new faculty and/or smaller discussion sessions. Future steps include refining the rating system, exploring ways to sustain changes, and investigating other factors contributing to feedback quality and utility.

Racial disparities in the use of blood transfusion in major surgery.

BACKGROUND: Racial disparities in healthcare in the United States are widespread and have been well documented. However, it is unknown whether racial disparities exist in the use of blood transfusion for patients undergoing major surgery. METHODS: We used the University HealthSystem Consortium database (2009-2011) to examine racial disparities in perioperative red blood cells (RBCs) transfusion in patients undergoing coronary artery bypass surgery (CABG), total hip replacement (THR), and colectomy. We estimated multivariable logistic regressions to examine whether black patients are more likely than white patients to receive perioperative RBC transfusion, and to investigate potential sources of racial disparities. RESULTS: After adjusting for patient-level factors, black patients were more likely to receive RBC transfusions for CABG (AOR = 1.41, 95% CI: [1.13, 1.76], p = 0.002) and THR (AOR = 1.39, 95% CI: [1.20, 1.62], p < 0.001), but not for colectomy (AOR = 1.08, 95% CI: [0.90, 1.30], p = 0.40). Black-white disparities in blood transfusion persisted after controlling for patient insurance and hospital effects (CABG: AOR = 1.42, 95% CI: [1.30, 1.56], p < 0.001; THR: AOR = 1.43, 95% CI: [1.29, 1.58], p < 0.001). CONCLUSIONS: We detected racial disparities in the use of blood transfusion for CABG and THR (black patients tended to receive more transfusions compared with whites), but not for colectomy. Reporting racial disparities in contemporary transfusion practices may help reduce potentially unnecessary blood transfusions in minority patients.

Variation of blood transfusion in patients undergoing major noncardiac surgery.

OBJECTIVE: To examine the hospital variability in use of red blood cells (RBCs), fresh-frozen plasma (FFP), and platelet transfusions in patients undergoing major noncardiac surgery. BACKGROUND: Blood transfusion is commonly used in surgical procedures in the United States. Little is known about the hospital variability in perioperative transfusion rates for noncardiac surgery. METHODS: We used the University HealthSystem Consortium database (2006-2010) to examine hospital variability in use of allogeneic RBC, FFP, and platelet transfusions in patients undergoing major noncardiac surgery. We used regression-based techniques to quantify the variability in hospital transfusion practices and to study the association between hospital characteristics and the likelihood of transfusion. RESULTS: After adjusting for patient risk factors, hospital transfusion rates varied widely for patients undergoing total hip replacement (THR), colectomy, and pancreaticoduodenectomy. Compared with patients undergoing THR in average-transfusion hospitals, patients treated in high-transfusion hospitals have a greater than twofold higher odds of being transfused with RBCs [adjusted odds ratio (AOR) = 2.41; 95% confidence interval (CI), 1.89-3.09], FFP (AOR = 2.81; 95% CI, 2.02-3.91), and platelets (AOR = 2.52; 95% CI, 1.95-3.25), whereas patients in low-transfusion hospitals have an approximately 50% lower odds of receiving RBCs (AOR = 0.45; 95% CI, 0.35-0.57), FFP (AOR = 0.37; 95% CI, 0.27-0.51), and platelets (AOR = 0.42; 95% CI, 0.29-0.62). Similar results were obtained for colectomy and pancreaticoduodenectomy. CONCLUSIONS: There was dramatic hospital variability in perioperative transfusion rates among patients undergoing major noncardiac surgery at academic medical centers. In light of the potential complications of transfusion therapy, reducing this variability in hospital transfusion practices may result in improved surgical outcomes.

Association between Leapfrog safe practices score and hospital mortality in major surgery.

BACKGROUND: The Leapfrog Group reports on hospitals' adoption of the National Quality Forum Patient Safety Practices. However, it is unknown whether hospital compliance with these safe practices is associated with improved outcomes in patients undergoing major surgery. METHODS: We analyzed the association between hospital mortality and Leapfrog Safe Practices among patients undergoing coronary artery bypass graft surgery (n=18,565), abdominal aortic aneurysm repair (n=2777), and hip replacement (n=25,067) in hospitals participating in the 2007 Leapfrog Hospital Survey using logistic regression. RESULTS: After adjusting for patient and hospital factors, we found that the total safety score (adjusted odds ratio: 1.000, 95% confidence interval: 0.999-1.001) was not associated with hospital mortality. Computerized physician order entry and ICU physician staffing were also not associated with hospital mortality. CONCLUSIONS: We did not find evidence that patients undergoing major surgery at hospitals which scored higher on the Leapfrog Safe Practices Survey had lower mortality rates. The Leapfrog safe practices score as a standalone quality measure may have limited power to distinguish between high-quality and low-quality hospitals.

Perioperative outcomes among patients with the modified metabolic syndrome who are undergoing noncardiac surgery.

BACKGROUND: Previous studies have demonstrated that obesity is paradoxically associated with a lower risk of mortality after noncardiac surgery. This study will determine the impact of the modified metabolic syndrome (defined as the presence of obesity, hypertension, and diabetes) on perioperative outcomes. METHODS: This study is based on data from 310,208 patients in the American College of Surgeons National Surgical Quality Improvement Program database. We estimated separate multivariate logistic regression models for 30-day mortality and for 30-day complications. RESULTS: Patients with the modified metabolic syndrome who are super obese had a 2-fold increased risk of death (adjusted odds ratio [AOR] 1.99; 95% CI 1.41-2.80). As stratified by body mass index, patients with the modified metabolic syndrome had a 2- to 2.5-fold higher risk of cardiac adverse events (CAE) compared with normal-weight patients: obese (AOR 1.70; 95% CI 1.40-2.07), morbidly obese (AOR 2.01; 95% CI 1.48-2.73), and super obese (AOR 2.66; 95% CI 1.68-4.19). In addition, the risk of acute kidney injury (AKI) was 3- to 7-fold higher in these patients: obese (AOR 3.30; 95% CI 2.75-3.94), morbidly obese (AOR 5.01; 95% CI 3.87-6.49), and super obese (AOR 7.29; 95% CI 5.27-10.1). CONCLUSION: Patients with the modified metabolic syndrome undergoing noncardiac surgery are at substantially higher risk of complications compared with patients of normal weight.

Is there a selection bias in applying endovascular aneurysm repair for rupture?

Accumulating data suggest that endovascular repair (EVAR) of ruptured abdominal aortic aneurysms (RAAAs) leads to reduced mortality, but concern exists that this may reflect selection bias. We reviewed our overall rupture experience early after our protocol was instituted to explore this question. We instituted a defined protocol for RAAA with emphasis on EVAR in July 2002, which included device availability (consignment), preoperative training, 24-hr access to our surgical endosuite and ability to operate imaging in an emergency, and immediate availability of a transbrachial balloon cutdown cart for all cases. Charts of all RAAA patients who arrived in the operating room alive since institution of our protocol were reviewed. Computed tomographic (CT) scans were re-reviewed to assess potentially suitable anatomic candidates. From July 2002 to May 2006, a total of 52 RAAAs were treated at our institution: 15 pararenal RAAAs, all treated by open repair (PR-OPEN), and 37 infrarenal RAAAs, 20 treated by open repair (IR-OPEN) and 17 treated by EVAR (IR-EVAR, 32% of all ruptures). Mortality rates in the three groups were 47%, 75%, and 35% (p < 0.02 vs. IR-OPEN), respectively. Although mortality was significantly lower in the EVAR group, overall mortality was 53% (28/52). On re-review of the operative notes and CT scans, it is estimated that more than half of those cases repaired using open techniques could have been repaired using EVAR based on anatomic criteria alone. The most common reason for open repair was hemodynamic instability preoperatively; only a minority of cases were excluded from EVAR based on unfavorable anatomy after CT scan review in the emergency room. In conclusion, during our early experience EVAR for rupture was associated with significantly reduced mortality. However, our overall mortality was no different from historical values, and this fact along with the extremely high mortality seen in the IR-OPEN group suggest that we are simply selecting patients with the greatest chance of survival to undergo EVAR. It also appears that many patients who are anatomically suitable for EVAR are undergoing open operation because of hemodynamic instability. If EVAR for rupture truly decreases mortality in all patients, a much more aggressive attitude toward EVAR may be required to lower the overall mortality rate.