A Video-Based Procedure-Specific Competency Assessment Tool for Minimally Invasive Esophagectomy.

Importance: Minimally invasive esophagectomy (MIE) is a complex procedure with substantial learning curves. In other complex minimally invasive procedures, suboptimal surgical performance has convincingly been associated with less favorable patient outcomes as assessed by peer review of the surgical procedure. Objective: To develop and validate a procedure-specific competency assessment tool (CAT) for MIE. Design, Setting, and Participants: In this international quality improvement study, a procedure-specific MIE-CAT was developed and validated. The MIE-CAT contains 8 procedural phases, and 4 quality components per phase are scored with a Likert scale ranging from 1 to 4. For evaluation of the MIE-CAT, intraoperative MIE videos performed by a single surgical team in the Esophageal Center East Netherlands were peer reviewed by 18 independent international MIE experts (with more than 120 MIEs performed). Each video was assessed by 2 or 3 blinded experts to evaluate feasibility, content validity, reliability, and construct validity. MIE-CAT version 2 was composed with refined content aimed at improving interrater reliability. A total of 32 full-length MIE videos from patients who underwent MIE between 2011 and 2020 were analyzed. Data were analyzed from January 2021 to January 2023. Exposure: Performance assessment of transthoracic MIE with an intrathoracic anastomosis. Main Outcomes and Measures: Feasibility, content validity, interrater and intrarater reliability, and construct validity, including correlations with both experience of the surgical team and clinical parameters, of the developed MIE-CAT. Results: Experts found the MIE-CAT easy to understand and easy to use to grade surgical performance. The MIE-CAT demonstrated good intrarater reliability (range of intraclass correlation coefficients [ICCs], 0.807 [95% CI, 0.656 to 0.892] for quality component score to 0.898 [95% CI, 0.846 to 0.932] for phase score). Interrater reliability was moderate (range of ICCs, 0.536 [95% CI, -0.220 to 0.994] for total MIE-CAT score to 0.705 [95% CI, 0.473 to 0.846] for quality component score), and most discrepancies originated in the lymphadenectomy phases. Hypothesis testing for construct validity showed more than 75% of hypotheses correct: MIE-CAT performance scores correlated with experience of the surgical team (r = 0.288 to 0.622), blood loss (r = -0.034 to -0.545), operative time (r = -0.309 to -0.611), intraoperative complications (r = -0.052 to -0.319), and severe postoperative complications (r = -0.207 to -0.395). MIE-CAT version 2 increased usability. Interrater reliability improved but remained moderate (range of ICCs, 0.666 to 0.743), and most discrepancies between raters remained in the lymphadenectomy phases. Conclusions and Relevance: The MIE-CAT was developed and its feasibility, content validity, reliability, and construct validity were demonstrated. By providing insight into surgical performance of MIE, the MIE-CAT might be used for clinical, training, and research purposes.

Crowd-sourced and expert video assessment in minimally invasive esophagectomy.

BACKGROUND: Video-based assessment by experts may structurally measure surgical performance using procedure-specific competency assessment tools (CATs). A CAT for minimally invasive esophagectomy (MIE-CAT) was developed and validated previously. However, surgeon's time is scarce and video assessment is time-consuming and labor intensive. This study investigated non-procedure-specific assessment of MIE video clips by MIE experts and crowdsourcing, collective surgical performance evaluation by anonymous and untrained laypeople, to assist procedure-specific expert review. METHODS: Two surgical performance scoring frameworks were used to assess eight MIE videos. First, global performance was assessed with the non-procedure-specific Global Operative Assessment of Laparoscopic Skills (GOALS) of 64 procedural phase-based video clips < 10 min. Each clip was assessed by two MIE experts and > 30 crowd workers. Second, the same experts assessed procedure-specific performance with the MIE-CAT of the corresponding full-length video. Reliability and convergent validity of GOALS for MIE were investigated using hypothesis testing with correlations (experience, blood loss, operative time, and MIE-CAT). RESULTS: Less than 75% of hypothesized correlations between GOALS scores and experience of the surgical team (r < 0.3), blood loss (r = - 0.82 to 0.02), operative time (r = - 0.42 to 0.07), and the MIE-CAT scores (r = - 0.04 to 0.76) were met for both crowd workers and experts. Interestingly, experts' GOALS and MIE-CAT scores correlated strongly (r = 0.40 to 0.79), while crowd workers' GOALS and experts' MIE-CAT scores correlations were weak (r = - 0.04 to 0.49). Expert and crowd worker GOALS scores correlated poorly (ICC ≤ 0.42). CONCLUSION: GOALS assessments by crowd workers lacked convergent validity and showed poor reliability. It is likely that MIE is technically too difficult to assess for laypeople. Convergent validity of GOALS assessments by experts could also not be established. GOALS might not be comprehensive enough to assess detailed MIE performance. However, expert's GOALS and MIE-CAT scores strongly correlated indicating video clip (instead of full-length video) assessments could be useful to shorten assessment time.

Neoadjuvant treatment for advanced esophageal cancer: response assessment before surgery and how to predict response to chemoradiation before starting treatment.

Patients with advanced esophageal cancer (T3-4, N) have a poor prognosis. Chemoradiation or chemotherapy before esophagectomy with adequate lymphadenectomy is the standard treatment for patients with resectable advanced esophageal carcinoma. However, only patients with major histopathologic response (regression to less than 10% of the primary tumor) after preoperative treatment will have a prognostic benefit of preoperative chemoradiation. Using current therapy regimens about 40% to 50% of the patients show major histopathological response. The remaining cohort does not benefit from this neoadjuvant approach but might benefit from earlier surgical resection. Therefore, it is an aim to develop tools for response prediction before starting the treatment and for early response assessment identifying responders. The current review discusses the different imaging techniques and the most recent studies about molecular markers for early response prediction. The results show that [(18)F]-fluorodeoxyglucose-positron emission tomography (FDG-PET) has a good sensitivity but the specificity is not robust enough for routine clinical use. Newer positron emission tomography detector technology, the combination of FDG-PET with computed tomography, additional evaluation criteria and standardization of evaluation may improve the predictive value. There exist a great number of retrospective studies using molecular markers for prediction of response. Until now the clinical use is missing. But the results of first prospective studies are promising. A future perspective may be the combination of imaging technics and special molecular markers for individualized therapy. Another aspect is the response assessment after finishing neoadjuvant treatment protocol. The different clinical methods are discussed. The results show that until now no non-invasive method is valid enough to assess complete histopathological response.

[18F]-Fluorodeoxyglucose-positron emission tomography for the assessment of histopathologic response and prognosis after completion of neoadjuvant chemoradiation in esophageal cancer.

OBJECTIVE: To evaluate the potential of [(18)F]-fluorodeoxyglucose-positron emission tomography (FDG-PET) after the completion of neoadjuvant chemoradiation for the assessment of histopathologic response and prognosis in the multimodality treatment of patients with esophageal cancer. BACKGROUND: Combined chemoradiation with and without surgery are widely accepted treatment options for patients with locally advanced esophageal cancer. Evidence suggests that patients with response to chemoradiation have no additional benefit from surgery compared with definitive chemoradiation. However, there is still a great lack in noninvasive markers for response assessment in patients with esophageal cancer undergoing multimodality treatment. Interestingly, recent studies imply that FDG-PET significantly correlates with histopathologic response and survival in patients with esophageal cancer undergoing neoadjuvant chemotherapy followed by surgical resection. METHODS: Study patients were recruited from a prospective clinical observation trial on neoadjuvant chemoradiation for esophageal cancer between 1997 and 2006. The study included 119 (98 men, 21 women; median age, 59.4 years; squamous cell cancer: 66; adenocarcinoma: 53) patients with locally advanced esophageal cancer (cT2- 4, N(x), M(0)). All patients received neoadjuvant chemoradiation (cisplatin, 5-FU, 36 Gy) and subsequently underwent transthoracic en bloc esophagectomy. Histomorphologic regression was defined as major histopathologic response when resected specimens contained less than 10% vital residual tumor cells (major response: 47 patients [39.5%]; minor response: 72 patients [60.5%]). FDG-PET was performed before and 2 to 3 weeks after the end of chemoradiation with assessment of the intratumoral FDG-uptake (pretreatment standardized uptake value; post-treatment standardized uptake value; percentage change). These variables were correlated with histopathologic response and survival. RESULTS: Major histomorphologic response was confirmed as an important prognostic factor (P = 0.005; log-rank test). Neoadjuvant chemoradiation led to a significant reduction of intratumoral FDG-uptake (P = 0.0001). A nonsignificant association was seen between major responders and FDG-PET results (P = 0.056). However, the receiver operating characteristic analysis could not identify a standardized uptake value threshold with a relevant predictive value for histomorphologic response. No significant association between metabolic imaging and prognosis was found. CONCLUSION: FDG-PET seems not to be an imaging system that effectively characterizes the groups of major and minor response as well as survival in patients with esophageal cancer after multimodality treatment.