The Quality of Operative Performance Narrative Feedback: A Retrospective Data Comparison Between End of Rotation Evaluations and Workplace-based Assessments.

OBJECTIVE: To describe the quality of operative performance feedback using evaluation tools commonly used by general surgery residency training programs. SUMMARY OF BACKGROUND DATA: The majority of surgical training programs administer an evaluation through which faculty members may rate and comment on trainee operative performance at the end of the rotation (EOR). Many programs have also implemented the system for improving and measuring procedural learning (SIMPL), a workplace-based assessment tool with which faculty can rate and comment on a trainee's operative performance immediately after a case. It is unknown how the quality of narrative operative performance feedback delivered with these tools compares. METHODS: The authors collected EOR evaluations and SIMPL narrative comments on trainees' operative performance from 3 university-based surgery training programs during the 2016-2017 academic year. Two surgeon raters categorized comments relating to operative skills as being specific or general and as encouraging and/or corrective. Comments were then classified as effective, mediocre, ineffective, or irrelevant. The frequencies with which comments were rated as effective were compared using Chi-square analysis. RESULTS: The authors analyzed a total of 600 comments. 10.7% of EOR and 58.3% of SIMPL operative performance evaluation comments were deemed effective (P < 0.0001). CONCLUSIONS: Evaluators give significantly higher quality operative performance feedback when using workplace-based assessment tools rather than EOR evaluations.

A Proposed Blueprint for Operative Performance Training, Assessment, and Certification.

OBJECTIVE: The aim of this study was to propose an evidence-based blueprint for training, assessment, and certification of operative performance for surgical trainees. SUMMARY BACKGROUND DATA: Operative skill is a critical aspect of surgical performance. High-quality assessment of operative skill therefore has profound implications for training, accreditation, certification, and the public trust of the profession. Current methods of operative skill assessment for surgeons rely heavily on global assessment strategies across a very broad domain of procedures. There is no mechanism to assure technical competence for individual procedures. The science and scalability of operative skill assessment has progressed significantly in recent decades, and can inform a much more meaningful strategy for competency-based assessment of operative skill than has been previously achieved. METHODS: The present article reviews the current status and science of operative skill assessment and proposes a template for competency-based assessment which could be used to update training, accreditation, and certification processes. The proposal is made in reference to general surgery but is more generally applicable to other procedural specialties. RESULTS: Streamlined, routine assessment of every procedure performed by surgical trainees is feasible and would enable a more competency-based educational paradigm. In light of the constraints imposed by both clinical volume and assessment bias, trainees should be expected to become proficient and be measured against a mastery learning standard only for the most important and highest-frequency procedures. For less frequently observed procedures, performance can be compared to a norm-referenced standard and, to provide an overall trajectory of performance, analyzed in aggregate. Key factors in implementing this approach are the number of evaluations, the number of raters, the timeliness of evaluation, and evaluation items. CONCLUSIONS: A competency-based operative skill assessment can be incorporated into surgical training, assessment, and certification. The time has come to develop a systematic approach to this issue as a means of demonstrating professional standards worthy of the public trust.

How Many Observations are Needed to Assess a Surgical Trainee's State of Operative Competency?

OBJECTIVE: To establish the number of operative performance observations needed for reproducible assessments of operative competency. BACKGROUND: Surgical training is transitioning from a time-based to a competency-based approach, but the number of assessments needed to reliably establish operative competency remains unknown. METHODS: Using a smart phone based operative evaluation application (SIMPL), residents from 13 general surgery training programs were evaluated performing common surgical procedures. Two competency metrics were investigated separately: autonomy and overall performance. Analyses were performed for laparoscopic cholecystectomy performances alone and for all operative procedures combined. Variance component analyses determined operative performance score variance attributable to resident operative competency and measurement error. Generalizability and decision studies determined number of assessments needed to achieve desired reliability (0.80 or greater) and determine standard errors of measurement. RESULTS: For laparoscopic cholecystectomy, 23 ratings are needed to achieve reproducible autonomy ratings and 17 ratings are needed to achieve reproducible overall operative performance ratings. For the undifferentiated mix of procedures, 60 ratings are needed to achieve reproducible autonomy ratings and 40 are needed for reproducible overall operative performance ratings. CONCLUSION: The number of observations needed to achieve reproducible assessments of operative competency far exceeds current certification requirements, yet remains an important and achievable goal. Attention should also be paid to the mix of cases and raters in order to assure fair judgments about operative competency and fair comparisons of trainees.

Readiness of US General Surgery Residents for Independent Practice.

OBJECTIVE: This study evaluates the current state of the General Surgery (GS) residency training model by investigating resident operative performance and autonomy. BACKGROUND: The American Board of Surgery has designated 132 procedures as being "Core" to the practice of GS. GS residents are expected to be able to safely and independently perform those procedures by the time they graduate. There is growing concern that not all residents achieve that standard. Lack of operative autonomy may play a role. METHODS: Attendings in 14 General Surgery programs were trained to use a) the 5-level System for Improving and Measuring Procedural Learning (SIMPL) Performance scale to assess resident readiness for independent practice and b) the 4-level Zwisch scale to assess the level of guidance (ie, autonomy) they provided to residents during specific procedures. Ratings were collected immediately after cases that involved a categorical GS resident. Data were analyzed using descriptive statistics and supplemented with Bayesian ordinal model-based estimation. RESULTS: A total of 444 attending surgeons rated 536 categorical residents after 10,130 procedures. Performance: from the first to the last year of training, the proportion of Performance ratings for Core procedures (n = 6931) at "Practice Ready" or above increased from 12.3% to 77.1%. The predicted probability that a typical trainee would be rated as Competent after performing an average Core procedure on an average complexity patient during the last week of residency training is 90.5% (95% CI: 85.7%-94%). This falls to 84.6% for more complex patients and to less than 80% for more difficult Core procedures. Autonomy: for all procedures, the proportion of Zwisch ratings indicating meaningful autonomy ("Passive Help" or "Supervision Only") increased from 15.1% to 65.7% from the first to the last year of training. For the Core procedures performed by residents in their final 6 months of training (cholecystectomy, inguinal/femoral hernia repair, appendectomy, ventral hernia repair, and partial colectomy), the proportion of Zwisch ratings (n = 357) indicating near-independence ("Supervision Only") was 33.3%. CONCLUSIONS: US General Surgery residents are not universally ready to independently perform Core procedures by the time they complete residency training. Progressive resident autonomy is also limited. It is unknown if the amount of autonomy residents do achieve is sufficient to ensure readiness for the entire spectrum of independent practice.

Pretransplantation Portal Vein Recanalization and Transjugular Intrahepatic Portosystemic Shunt Creation for Chronic Portal Vein Thrombosis: Final Analysis of a 61-Patient Cohort.

PURPOSE: To report the final analysis of the safety and efficacy of portal vein (PV) recanalization (PVR) and transjugular intrahepatic portosystemic shunt (TIPS) creation (PVR-TIPS) in patients with PV thrombosis (PVT) in need of liver transplantation. MATERIALS AND METHODS: Sixty-one patients with cirrhosis and PVT underwent PVR-TIPS to improve transplantation candidacy. Median patient age was 58 years (range, 22-75 y), and median pre-TIPS Model for End-Stage Liver Disease score was 14 (range, 7-42). The most common etiologies of cirrhosis were nonalcoholic fatty liver disease in 18 patients (30%) and hepatitis C in 13 patients (21%). Twenty-seven patients (44%) had partial PVT, and 34 patients (56%) had complete thrombosis. Forty-nine patients (80%) had Yerdel grade 2 PVT, and 12 (20%) had Yerdel grade 3 PVT. Twenty-nine patients (48%) had cavernous transformation of the PV. RESULTS: PVR-TIPS was technically successful in 60 of 61 patients (98%). PV/TIPS patency was maintained in 55 patients (92%) at a median follow-up of 19.2 months (range, 0-105.9 mo). Recurrent PV/TIPS thrombosis occurred in 5 patients (8%), all of whom initially presented with complete PVT. The most common adverse events were TIPS stenosis in 13 patients (22%) and transient encephalopathy in 11 patients (18%). Twenty-four patients (39%) underwent transplantation, 23 of whom (96%) received an end-to-end anastomosis. There were no cases of recurrent PVT following transplantation, with a median imaging follow-up of 32.5 months (range, 0.4-75.4 mo). Five-year overall survival rate was 82%. CONCLUSIONS: PVR-TIPS is a safe, effective, and durable treatment option for patients with chronic PVT who need liver transplantation.

(90) Y radiation lobectomy: Outcomes following surgical resection in patients with hepatic tumors and small future liver remnant volumes.

BACKGROUND: The purpose of this study is to assess operative, post-operative, and long-term outcomes in patients who underwent radiation lobectomy (RL) for tumor control and/or hypertrophy of small future liver remnant (FLR) prior to resection. METHODS: Right lobar +/- segment 4 radioembolization was performed prior to lobectomy/tri-segmentectomy in patients with hepatic tumor but inadequate FLR. Parenchymal/tumor volumes were calculated from pre/post-RL imaging; FLR/%FLR hypertrophy were determined. Complications were graded by the Clavien-Dindo classification. RESULTS: Thirteen patients (HCC n = 10, cholangiocarcinoma n = 2, mCRC n = 1) underwent RL prior to resection. The median time between RL and post-RL imaging was 40 days (23-190 days); the median time to resection was 86 days (30-210 days). Median FLR increased significantly [pre: 33% (22-43%); post: 43% (29-69%), P < 0.01] to yield a median %FLR hypertrophy of 30% (4-105%). The median hospital stay after resection was 4 days (3-11 days). Transient hepatobiliary toxicities normalized post-operatively. Ninety-two percent of resected tumors had >50% pathologic necrosis. Median follow up time after surgery was 604 days (144-1,416 days); one death occurred. CONCLUSIONS: In this preliminary study, radiation lobectomy was a safe and effective method to achieve remnant liver hypertrophy while providing tumor control. This approach may facilitate safe resection and favorable post-operative outcomes.J. Surg. Oncol. 2016;114:99-105. © 2016 Wiley Periodicals, Inc.

Unresectable solitary hepatocellular carcinoma not amenable to radiofrequency ablation: multicenter radiology-pathology correlation and survival of radiation segmentectomy.

UNLABELLED: Resection and radiofrequency ablation (RFA) are treatment options for hepatocellular carcinoma (HCC) <3 cm; there is interest in expanding the role of ablation to 3-5 cm. RFA is considered high-risk when the lesion is in close proximity to critical structures. Combining microcatheter technology and the localized emission properties of Y90, highly selective radioembolization is a possible alternative to RFA in such cases. We assessed the efficacy (response, radiology-pathology correlation, survival) of radiation segmentectomy in solitary HCC not amenable to RFA or resection. Patients with treatment-naïve, unresectable, solitary HCC ≤ 5 cm not amenable to RFA were included in this multicenter study. Administered dose, response rate, time-to-progression (modified Response Evaluation Criteria in Solid Tumors [mRECIST]), radiology-pathology correlation and long-term survival were assessed. In all, 102 patients were included in this study. mRECIST complete response (CR), partial response (PR), and stable disease (SD) were 47/99 (47%), 39/99 (39%), and 12/99 (12%), respectively. Median time-to-disease-progression was 33.1 months. In all, 33/102 (32%) patients were transplanted with a median (interquartile range [IQR]) time-to-transplantation of 6.3 months (3.6-9.7). Pathology revealed 100% and 50-99% necrosis in 17/33 (52%) and 16/33 (48%), respectively. Median overall survival was 53.4 months. Univariate analysis demonstrated a survival benefit for Eastern Cooperative Oncology Group (ECOG) 0 patients. In the multivariate model, age <65, ECOG 0, and Child-Pugh A were characteristics associated with longer survival. CONCLUSION: Radiation segmentectomy is an effective technique with a favorable risk profile and radiology-pathology outcomes for solitary HCC ≤ 5 cm. This approach may allow for treatment of HCC in difficult locations. Since RFA and resection are not options given tumor location, there appears to be a strong rationale for this technique as second choice.

Radiation lobectomy: time-dependent analysis of future liver remnant volume in unresectable liver cancer as a bridge to resection.

BACKGROUND & AIMS: Portal vein embolization (PVE) is a standard technique for patients not amenable to liver resection due to small future liver remnant ratio (FLR). Radiation lobectomy (RL) with (90)Y-loaded microspheres (Y90) is hypothesized to induce comparable volumetric changes in liver lobes, while potentially controlling the liver tumor and limiting tumor progression in the untreated lobe. We aimed at testing this concept by performing a comprehensive time-dependent analysis of liver volumes following radioembolization. METHODS: 83 patients with right unilobar disease with hepatocellular carcinoma (HCC; N=67), cholangiocarcinoma (CC; N=8) or colorectal cancer (CRC; N=8) were treated by Y90 RL. The total liver volume, lobar (parenchymal) and tumor volumes, FLR and percentage of FLR hypertrophy from baseline (%FLR hypertrophy) were assessed on pre- and post-Y90 CT/MRI scans in a dynamic fashion. RESULTS: Right lobe atrophy (p=0.003), left lobe hypertrophy (p<0.001), and FLR hypertrophy (p<0.001) were observed 1 month after Y90 and this was consistent at all follow-up time points. Median %FLR hypertrophy reached 45% (5-186) after 9 months (p<0.001). The median maximal %FLR hypertrophy was 26% (-14 → 86). Portal vein thrombosis was correlated to %FLR hypertrophy (p=0.02). Median Child-Pugh score worsening (6 → 7) was seen at 1 to 3 months (p=0.03) and 3 to 6 months (p=0.05) after treatment. Five patients underwent successful right lobectomy (HCC N=3, CRC N=1, CC N=1) and 6 HCCs were transplanted. CONCLUSIONS: Radiation lobectomy by Y90 is a safe and effective technique to hypertrophy the FLR. Volumetric changes are comparable (albeit slightly slower) to PVE while the right lobe tumor is treated synchronously. This novel technique is of particular interest in the bridge-to-resection setting.

Epithelial NF-kappaB enhances transmucosal fluid movement by altering tight junction protein composition after T cell activation.

In inflammatory bowel disease (IBD), aberrant activation of innate and adaptive immune responses enhances mucosal permeability through mechanisms not completely understood. To examine the role of epithelial nuclear factor (NF-kappaB) in IBD-induced enhanced permeability, epithelial-specific IkappaBalpha mutant (NF-kappaB super repressor) transgenic (TG) mice were generated. NF-kB activation was inhibited in TG mice, relative to wild-type mice, following T cell-mediated immune cell activation using an anti-CD3 monoclonal antibody. Furthermore, epithelial NF-kappaB super repressor protein inhibited diarrhea and blocked changes in transepithelial resistance and transmucosal flux of alexa350 (0.35 kDa) and dextran3000 (3 kDa). In vivo perfusion loop studies in TG mice revealed reversed net water secretion and reduced lumenal flux of different molecular probes (bovine serum albumin, alexa350, and dextran3000). Cell-imaging and immunoblotting of low-density, detergent-insoluble membrane fractions confirmed that tight junction proteins (occludin, claudin-1 and zona occludens-1) are internalized through an NF-kappaB-dependent pathway. Taken together, these data suggest that IBD-associated diarrhea results from NF-kappaB-mediated tight junction protein internalization and increased paracellular permeability. Thus, reduction of epithelial NF-kappaB activation in IBD may repair defects in epithelial barrier function, reduce diarrhea, and limit protein (eg, serum albumin) losses. Epithelial NF-kappaB activation induced by mucosal T cells, therefore, actively plays a role in opening paracellular spaces to promote transmucosal fluid effux into the intestinal lumen.

A decade of minimally invasive donation: experience with more than 1200 laparoscopic donor nephrectomies at a single institution.

BACKGROUND: The past decade has seen laparoscopic donor nephrectomy (LDN) transform into a standard of care procedure. Furthermore, LDN has evolved with the introduction of new technologies aimed at increasing efficiency and safety. There are few large, single center experiences detailing the results of LDN, its associated complications, and their management. METHODS: We performed a retrospective review of 1200 LDN performed at our center for both pediatric and adult recipients. RESULTS: Mean body mass index of donors was 27.1 (range 17-48). Twenty-six percent of kidneys had multiple renal arteries. Greater than 99% were left LDN. Mean length of stay was 1.37 +/- 0.6 d, which decreased to 1.1 +/- 0.5 d for the last 475 cases. The overall complication rate was 5.6%. Among those patients, 1.6% of the patients experienced an intraoperative complication, including eight renovascular injuries; 7/8 renovascular injuries led to open conversion. Four conversions were elective; our overall conversion rate was 0.92%; 4.0% had a post-operative complication; 1.2% required readmission for complication management. Three of 1200 patients have required reoperation for prolonged ileus and internal hernia (2), respectively. There have been no cases of donor renal failure or death. Since 2003, we have routinely used hand-assisted LDN (HALDN). There have been no cases of primary non-function. Urologic complications have been uncommon. CONCLUSIONS: Our series supports the safety and efficacy of LDN/HALDN.

Transplant renoportal vein conduit for complete mesenteric thrombosis: a case report.

Portal vein thrombosis, which is present in up to one quarter of patients with end-stage liver disease, presents a technical challenge at the time of liver transplantation. Thromboendovenectomy when feasible has been advocated in these patients. However, in patients with complete mesenteric thrombosis where this technique is typically not successful, a number of alternative techniques have been attempted including caval transposition, portal arterialization, and multivisceral transplantation often with discouraging results. We present herein a single case where transplant renal vein outflow was used to provide portal vein inflow in a patient with complete mesenteric thrombosis undergoing simultaneous liver-kidney transplant.

Using smartphones for trainee performance assessment: A SIMPL case study.

Workplace-based assessments are used by raters to evaluate observed performance of trainees in actual clinical practice. These types of assessments are of growing interest, especially because observed performance is prioritized within the larger competency-based medical educational movement. Implementation of workplace-based assessments has, however, been challenging. This article describes the motivations and implications for workplace-based assessments that leverage smartphone technology. It does so in reference to an app called SIMPL (System for Improving and Measuring Procedural Learning) in order to highlight some of the challenges and benefits one might encounter during implementation of similar systems.

Beyond the Surgical Time-Out: A National Needs Assessment of Preoperative Communication in US General Surgery Residency Programs.

OBJECTIVE: Perioperative communication is critical for procedural learning. In order to develop a periprocedural faculty development tool, we aimed to characterize the current status of preoperative communication in US General Surgery residency programs. DESIGN: After Association of Program Directors in Surgery approval, a survey was distributed to general surgery programs. Participants were asked about perioperative communication, including the frequency of preoperative briefings, defined as dedicated educational discussions prior to a procedure. Data were analyzed using descriptive statistics. SETTING: An anonymous electronic survey was distributed to interested programs in early 2019. PARTICIPANTS: US General Surgery trainees and attending surgeons. RESULTS: A total of 348 responses were recorded from 27 programs: 199 (57%) attending surgeons and 149 (43%) surgical trainees. Most respondents (83%) were from a university-affiliated program. Attending surgeons indicated a higher frequency of performing preoperative briefings compared to trainees (p < 0.001). Both trainees and attending surgeons were more likely to select their own group when asked who initiates a preoperative briefing. The majority of respondents (58%) agreed that discussing autonomy preoperatively improves resident autonomy for the case. In regards to the timing of preoperative briefings, most took place in/adjacent to the operating room, with only 60 participants (17%) participating in preoperative briefings the day/night prior to the operation. The most frequent topic discussed during preoperative briefings was "procedural content." Most participants selected "time constraints" as the greatest barrier to preoperative briefings and indicated that attending surgeon engagement was necessary to facilitate their use. Trainees were less likely to report engaging in immediate postoperative feedback, but more likely to report postoperative self-reflection. CONCLUSIONS: Preoperative briefings are not necessarily routine and attendings and trainees differ on their perceptions related to their content and frequency. Efforts to address timing and scheduling and encourage dual-party engagement in perioperative communication are key to the development of tools to enhance this important aspect of procedural learning.

A Preoperative Educational Time-Out is Associated with Improved Resident Goal Setting and Strengthens Educational Experiences.

OBJECTIVE: The purpose of this study was to assess the impact of a preoperative Educational Time-Out (ETO) with structured postoperative feedback on resident preoperative goal-setting and the educational experience of a clinical rotation. DESIGN: A preoperative ETO was developed during which trainees and faculty jointly identified an operative goal and discussed the trainee's operative autonomy. Postoperative feedback with a smartphone application was encouraged. From November 2016 to October 2017, the intervention was piloted with 1 surgical service. Outcomes included ETO completion rate, goal setting rate, and subjects' perception of the impact of the ETO on identification of performance deficits, trainee autonomy, and receipt of feedback. Data were analyzed using descriptive statistics. SETTING: This study was performed in an institutional hospital setting. PARTICIPANTS: Third-year general surgery residents and surgical faculty in the Department of Hepatobiliary Surgery and Liver Transplantation at Vanderbilt University Medical Center took part in the intervention. RESULTS: Seven residents and 7 attending surgeons participated in this study. Residents performed a median of 15 procurements during an average of 6.5 weeks each on service. The ETO completion rate was 83%. Resident-reported preoperative goal setting increased after the intervention (from 36% to 78%, p = 0.015). Subjects reported a positive impact of the intervention, with high resident agreement that the ETO helped identify deficits (82% median agreement), increased autonomy (82% median agreement), and increased receipt of feedback (84% median agreement). Residents and attendings agreed that the educational experience was stronger due to the ETO (median 81% and 77%, respectively). CONCLUSIONS: The ETO intervention improved rates of resident preoperative goal setting and strengthened perceived educational experiences. Resident participants also reported improvements in autonomy and rates of postoperative feedback. Broader implementation of this brief preoperative pause is an easy way to emphasize procedural education in the operating room.

Trainee Autonomy in Minimally Invasive General Surgery in the United States: Establishing a National Benchmark.

OBJECTIVE: Minimally invasive surgery (MIS) is an integral component of General Surgery training and practice. Yet, little is known about how much autonomy General Surgery residents achieve in MIS procedures, and whether that amount is sufficient. This study aims to establish a contemporary benchmark for trainee autonomy in MIS procedures. We hypothesize that trainees achieve progressive autonomy, but fail to achieve meaningful autonomy in a substantial percentage of MIS procedures prior to graduation. SETTING/PARTICIPANTS: Fifty General Surgery residency programs in the United States, from September 1, 2015 to March 19, 2020. All Categorical General Surgery Residents and Attending Surgeons within these programs were eligible. DESIGN: Data were collected prospectively from attending surgeons and categorical General Surgery residents. Trainee autonomy was assessed using the 4-level Zwisch scale (Show and Tell, Active Help, Passive Help, and Supervision Only) on a smartphone application (SIMPL). MIS procedures included all laparoscopic, thoracoscopic, endoscopic, and endovascular/percutaneous procedures performed by residents during the study. Primary outcomes of interest were "meaningful autonomy" rates (i.e., scores in the top 2 categories of the Zwisch scale) by postgraduate year (PGY), and "progressive autonomy" (i.e., differences in autonomy between PGYs) in MIS procedures, as rated by attending surgeons. Primary outcomes were determined with descriptive statistics, one-way analysis of variance (ANOVA) and Z-tests. Secondary analyses compared (i) progressive autonomy between common MIS procedures, and (ii) progressive autonomy in MIS vs. non-MIS procedures. RESULTS: A total of 106,054 evaluations were performed across 50 General Surgery residency programs, of which 38,985 (37%) were for MIS procedures. Attendings performed 44,842 (42%) of all evaluations, including 16,840 (43%) of MIS evaluations, while residents performed the rest. Overall, meaningful autonomy in MIS procedures increased from 14.1% (PGY1s) to 75.9% (PGY5s), with significant (p < 0.001) increases between each PGY level. Meaningful autonomy rates were higher in the MIS vs. non-MIS group [57.2% vs. 48.0%, p < 0.001], and progressed more rapidly in MIS vs. non-MIS, (p < 0.05). The 7 most common MIS procedures accounted for 83.5% (n = 14,058) of all MIS evaluations. Among PGY5s performing these procedures, meaningful autonomy rates (%) were: laparoscopic appendectomy (95%); laparoscopic cholecystectomy (93%); diagnostic laparoscopy (87%); upper/lower endoscopy (85%); laparoscopic hernia repair (72%); laparoscopic partial colectomy (58%); and laparoscopic sleeve gastrectomy (45%). CONCLUSIONS: US General Surgery residents receive progressive autonomy in MIS procedures, and appear to progress more rapidly in MIS versus non-MIS procedures. However, residents fail to achieve meaningful autonomy in nearly 25% of MIS cases in their final year of residency, with higher rates of meaningful autonomy only achieved in a small subset of basic MIS procedures.

Mind the Gap: The Autonomy Perception Gap in the Operating Room by Surgical Residents and Faculty.

OBJECTIVE: Examine the concordance of perceived operative autonomy between attendings and resident trainees. DESIGN: Faculty and trainees rated trainee operative autonomy using the 4-level Zwisch scale over a variety of cases and training years. The respective ratings were then compared to explore the effects of experience, gender, case complexity, trainee, trainer, and other covariates to perceived autonomy. SETTING: This study was conducted over 14 general surgery programs in the United States, members of the Procedural Learning and Safety Collaborative. PARTICIPANTS: Participants included faculty and categorical trainees from 14 general surgery programs. RESULTS: A total of 8681 observations was obtained. The sample included 619 unique residents and 457 different attendings. A total of 598 distinct procedures was performed. In 60% of the cases, the autonomy ratings between trainees and attendings were concordant, with only 3.5% of cases discrepant by more than 1 level. An autonomy perception gap was modeled based on the discrepancy between the trainee and attending Zwisch ratings for the same case. The mean Zwisch score expected for a trainee was lower than the attending across all scenarios. Trainees were more likely to perceive relatively more autonomy in the second half of the year. The autonomy perception gap decreased with increasing case complexity. As trainees gained experience, the perception gap increased with trainees underestimating autonomy. CONCLUSIONS: Trainees and attendings generally demonstrated concordance on autonomy perception scores. However, in 40% of cases, a perception gap exists between trainee and attending with the trainee generally underestimating autonomy. The gap worsens as the trainee progresses through residency. This perception gap suggests that attendings and trainees could be better aligned on teaching goals and expectations.

Concordance Between Expert and Nonexpert Ratings of Condensed Video-Based Trainee Operative Performance Assessment.

OBJECTIVE: We examined the impact of video editing and rater expertise in surgical resident evaluation on operative performance ratings of surgical trainees. DESIGN: Randomized independent review of intraoperative video. SETTING: Operative video was captured at a single, tertiary hospital in Boston, MA. PARTICIPANTS: Six common general surgery procedures were video recorded of 6 attending-trainee dyads. Full-length and condensed versions (n = 12 videos) were then reviewed by 13 independent surgeon raters (5 evaluation experts, 8 nonexperts) using a crossed design. Trainee performance was rated using the Operative Performance Rating Scale, System for Improving and Measuring Procedural Learning (SIMPL) Performance scale, the Zwisch scale, and ten Cate scale. These ratings were then standardized before being compared using Bayesian mixed models with raters and videos treated as random effects. RESULTS: Editing had no effect on the Operative Performance Rating Scale Overall Performance (-0.10, p = 0.30), SIMPL Performance (0.13, p = 0.71), Zwisch (-0.12, p = 0.27), and ten Cate scale (-0.13, p = 0.29). Additionally, rater expertise (evaluation expert vs. nonexpert) had no effect on the same scales (-0.16 (p = 0.32), 0.18 (p = 0.74), 0.25 (p = 0.81), and 0.25 (p = 0.17). CONCLUSIONS: There is little difference in operative performance assessment scores when raters use condensed videos or when raters who are not experts in surgical resident evaluation are used. Future validation studies of operative performance assessment scales may be facilitated by using nonexpert surgeon raters viewing videos condensed using a standardized protocol.

An evaluation of the model for end-stage liver disease and serum C-reactive protein as prognostic markers in intestinal failure patients on parenteral nutrition.

BACKGROUND: Intestinal failure (IF) patients require parenteral nutrition (PN) to avoid malnutrition and death. However, they face complications of recurrent sepsis and liver failure. By the time liver failure is discovered, it is often too late for intervention and prognosis on the waiting list is grim. The Model for End-Stage Liver Disease (MELD) has traditionally been used to predict mortality in patients with liver failure but has never been analyzed in IF patients who are at risk for liver complications. C-reactive protein (CRP) is an acute inflammatory marker that has been shown to reflect disease progression in nonalcoholic steatohepatitis, a disease that in many ways resembles PN-associated liver disease. MELD and CRP are promising clinical markers of disease progression in IF patients on PN. METHODS: The authors performed a retrospective, case-control study to compare levels of MELD and CRP within the entire population of 133 adult patients referred to Northwestern Memorial Hospital for IF from 1999 to 2006. RESULTS: Elevated MELD score is strongly predictive of increased mortality over the subsequent 6 months. Elevated CRP is strongly predictive over a smaller 3-month window. One-year mortality was significantly greater in patients who have either elevated MELD scores or serum CRP levels. CONCLUSIONS: In this study, the authors evaluated for the first time use of MELD and serum CRP as predictive markers of mortality in IF patients. Both seem to be promising clinical tools to identify which patients are at highest risk for complication.