Nationwide Association of Surgical Performance of Minimally Invasive Esophagectomy With Patient Outcomes.

Importance: Suboptimal surgical performance is hypothesized to be associated with less favorable patient outcomes in minimally invasive esophagectomy (MIE). Establishing this association may lead to programs that promote better surgical performance of MIE and improve patient outcomes. Objective: To investigate associations between surgical performance and postoperative outcomes after MIE. Design, Setting, and Participants: In this nationwide cohort study of 15 Dutch hospitals that perform more than 20 MIEs per year, 7 masked expert MIE surgeons assessed surgical performance using videos and a previously developed and validated competency assessment tool (CAT). Each hospital submitted 2 representative videos of MIEs performed between November 4, 2021, and September 13, 2022. Patients registered in the Dutch Upper Gastrointestinal Cancer Audit between January 1, 2020, and December 31, 2021, were included to examine patient outcomes. Exposure: Hospitals were divided into quartiles based on their MIE-CAT performance score. Outcomes were compared between highest (top 25%) and lowest (bottom 25%) performing quartiles. Transthoracic MIE with gastric tube reconstruction. Main Outcome and Measure: The primary outcome was severe postoperative complications (Clavien-Dindo ≥3) within 30 days after surgery. Multilevel logistic regression, with clustering of patients within hospitals, was used to analyze associations between performance and outcomes. Results: In total, 30 videos and 970 patients (mean [SD] age, 66.6 [9.1] years; 719 men [74.1%]) were included. The mean (SD) MIE-CAT score was 113.6 (5.5) in the highest performance quartile vs 94.1 (5.9) in the lowest. Severe postoperative complications occurred in 18.7% (41 of 219) of patients in the highest performance quartile vs 39.2% (40 of 102) in the lowest (risk ratio [RR], 0.50; 95% CI, 0.24-0.99). The highest vs the lowest performance quartile showed lower rates of conversions (1.8% vs 8.9%; RR, 0.21; 95% CI, 0.21-0.21), intraoperative complications (2.7% vs 7.8%; RR, 0.21; 95% CI, 0.04-0.94), and overall postoperative complications (46.1% vs 65.7%; RR, 0.54; 95% CI, 0.24-0.96). The R0 resection rate (96.8% vs 94.2%; RR, 1.03; 95% CI, 0.97-1.05) and lymph node yield (mean [SD], 38.9 [14.7] vs 26.2 [9.0]; RR, 3.20; 95% CI, 0.27-3.21) increased with oncologic-specific performance (eg, hiatus dissection, lymph node dissection). In addition, a high anastomotic phase score was associated with a lower anastomotic leakage rate (4.6% vs 17.7%; RR, 0.14; 95% CI, 0.06-0.31). Conclusions and Relevance: These findings suggest that better surgical performance is associated with fewer perioperative complications for patients with esophageal cancer on a national level. If surgical performance of MIE can be improved with MIE-CAT implementation, substantially better patient outcomes may be achievable.

A Video-Based Procedure-Specific Competency Assessment Tool for Minimally Invasive Esophagectomy.

Importance: Minimally invasive esophagectomy (MIE) is a complex procedure with substantial learning curves. In other complex minimally invasive procedures, suboptimal surgical performance has convincingly been associated with less favorable patient outcomes as assessed by peer review of the surgical procedure. Objective: To develop and validate a procedure-specific competency assessment tool (CAT) for MIE. Design, Setting, and Participants: In this international quality improvement study, a procedure-specific MIE-CAT was developed and validated. The MIE-CAT contains 8 procedural phases, and 4 quality components per phase are scored with a Likert scale ranging from 1 to 4. For evaluation of the MIE-CAT, intraoperative MIE videos performed by a single surgical team in the Esophageal Center East Netherlands were peer reviewed by 18 independent international MIE experts (with more than 120 MIEs performed). Each video was assessed by 2 or 3 blinded experts to evaluate feasibility, content validity, reliability, and construct validity. MIE-CAT version 2 was composed with refined content aimed at improving interrater reliability. A total of 32 full-length MIE videos from patients who underwent MIE between 2011 and 2020 were analyzed. Data were analyzed from January 2021 to January 2023. Exposure: Performance assessment of transthoracic MIE with an intrathoracic anastomosis. Main Outcomes and Measures: Feasibility, content validity, interrater and intrarater reliability, and construct validity, including correlations with both experience of the surgical team and clinical parameters, of the developed MIE-CAT. Results: Experts found the MIE-CAT easy to understand and easy to use to grade surgical performance. The MIE-CAT demonstrated good intrarater reliability (range of intraclass correlation coefficients [ICCs], 0.807 [95% CI, 0.656 to 0.892] for quality component score to 0.898 [95% CI, 0.846 to 0.932] for phase score). Interrater reliability was moderate (range of ICCs, 0.536 [95% CI, -0.220 to 0.994] for total MIE-CAT score to 0.705 [95% CI, 0.473 to 0.846] for quality component score), and most discrepancies originated in the lymphadenectomy phases. Hypothesis testing for construct validity showed more than 75% of hypotheses correct: MIE-CAT performance scores correlated with experience of the surgical team (r = 0.288 to 0.622), blood loss (r = -0.034 to -0.545), operative time (r = -0.309 to -0.611), intraoperative complications (r = -0.052 to -0.319), and severe postoperative complications (r = -0.207 to -0.395). MIE-CAT version 2 increased usability. Interrater reliability improved but remained moderate (range of ICCs, 0.666 to 0.743), and most discrepancies between raters remained in the lymphadenectomy phases. Conclusions and Relevance: The MIE-CAT was developed and its feasibility, content validity, reliability, and construct validity were demonstrated. By providing insight into surgical performance of MIE, the MIE-CAT might be used for clinical, training, and research purposes.

Crowd-sourced and expert video assessment in minimally invasive esophagectomy.

BACKGROUND: Video-based assessment by experts may structurally measure surgical performance using procedure-specific competency assessment tools (CATs). A CAT for minimally invasive esophagectomy (MIE-CAT) was developed and validated previously. However, surgeon's time is scarce and video assessment is time-consuming and labor intensive. This study investigated non-procedure-specific assessment of MIE video clips by MIE experts and crowdsourcing, collective surgical performance evaluation by anonymous and untrained laypeople, to assist procedure-specific expert review. METHODS: Two surgical performance scoring frameworks were used to assess eight MIE videos. First, global performance was assessed with the non-procedure-specific Global Operative Assessment of Laparoscopic Skills (GOALS) of 64 procedural phase-based video clips < 10 min. Each clip was assessed by two MIE experts and > 30 crowd workers. Second, the same experts assessed procedure-specific performance with the MIE-CAT of the corresponding full-length video. Reliability and convergent validity of GOALS for MIE were investigated using hypothesis testing with correlations (experience, blood loss, operative time, and MIE-CAT). RESULTS: Less than 75% of hypothesized correlations between GOALS scores and experience of the surgical team (r < 0.3), blood loss (r = - 0.82 to 0.02), operative time (r = - 0.42 to 0.07), and the MIE-CAT scores (r = - 0.04 to 0.76) were met for both crowd workers and experts. Interestingly, experts' GOALS and MIE-CAT scores correlated strongly (r = 0.40 to 0.79), while crowd workers' GOALS and experts' MIE-CAT scores correlations were weak (r = - 0.04 to 0.49). Expert and crowd worker GOALS scores correlated poorly (ICC ≤ 0.42). CONCLUSION: GOALS assessments by crowd workers lacked convergent validity and showed poor reliability. It is likely that MIE is technically too difficult to assess for laypeople. Convergent validity of GOALS assessments by experts could also not be established. GOALS might not be comprehensive enough to assess detailed MIE performance. However, expert's GOALS and MIE-CAT scores strongly correlated indicating video clip (instead of full-length video) assessments could be useful to shorten assessment time.

Roles of general practitioners in shared decision-making for patients with cancer: A qualitative study.

OBJECTIVE: The shared decision-making (SDM) process for the treatment of pancreatic and oesophageal cancer primarily takes place with healthcare professionals (HCPs) in the hospital setting. This study aims to explore the perspectives of general practitioners (GPs) on their possible roles during this SDM process, their added value and their requirements for involvement in SDM. METHODS: Semi-structured interviews were conducted with 12 GPs about their views on SDM for patients with cancer. The interviews were analysed by two researchers using an inductive open coding approach. RESULTS: Five potential roles in SDM were described by the interviewed GPs, of which the role as 'coach' of the patient was mentioned by all. GPs see their main added value as their long-standing relationship with the patient. To be able to participate optimally in SDM, GPs indicated that they need to be kept up to date during the patient's care process and should receive enough medical information about treatment options and contextual information. CONCLUSION: GPs see different potential roles for themselves when involved in SDM. Hospital HCPs that want to facilitate GP involvement should take the initiative, provide the GPs with enough and timely information and must be easy to consult.

Development of a patient-reported outcome measure for patients who have recovered from a subarachnoid hemorrhage: the "questionnaire for the screening of symptoms in aneurysmal subarachnoid hemorrhage" (SOS-SAH).

BACKGROUND: Patients who have been successfully treated for an aneurysmal subarachnoid hemorrhage (aSAH) often retain multiple health complaints, including mood disorders, cognitive complaints, fatigue, and problems with social participation. These problems are not always fully addressed during hospital visits or in current outcome measures, such as the modified Rankin score and the Glasgow Outcome Scale. Here, we present the development of the "Questionnaire for the Screening of Symptoms in aneurysmal Subarachnoid Hemorrhage" (SOS-SAH), which screens for the self-reported symptoms of patients with mild disabilities. METHODS: During the development of the SOS-SAH we adhered to the PROM-cycle framework for the selection and implementation of patient-reported outcome measures (PROMs). The SOS-SAH was developed in an iterative process informed by a literature study. Patients and healthcare professionals were involved in the development process through participating in a working group, interviews, and a cognitive validation study. RESULTS AND CONCLUSIONS: Relevant patient-reported outcomes (PROs) were identified for patients with aSAH. The SOS-SAH was developed primarily using domains and items from existing PROMs and, if necessary, by developing new items. The SOS-SAH consists of 40 items and covers 14 domains: cognitive abilities, hypersensitivity to stimuli, anxiety, depression, fatigue, social roles, personality change, language, vision, taste, smell, hearing, headache, and sexual function. It also includes a proxy measurement for use by family members to assess cognitive functioning and personality change.

Translation and validation of two disease-specific patient-reported outcome measures (Bladder Cancer Index and FACT-Bl-Cys) in Dutch bladder cancer patients.

BACKGROUND: The Bladder Cancer Index (BCI) and Functional Assessment of Cancer Therapy-Bladder-Cystectomy (FACT-Bl-Cys) were developed to measure disease-specific health-related quality of life (HRQOL) in bladder cancer patients and patients treated with radical cystectomy, respectively. Both patient-reported outcome measures (PROMs) are frequently used in clinical practice, but are not yet validated according to the COSMIN criteria and not yet available in Dutch. Therefore, the aim of this study was to translate the BCI and FACT-Bl-Cys into Dutch and to evaluate their measurement properties according to the COSMIN criteria. METHODS: The BCI and FACT-Bl-Cys were translated into Dutch using a forward-backward method, and subsequently administered at baseline (pre-operatively) and 3 months post-operatively in bladder cancer patients who received a radical cystectomy. Validity (content and construct), reliability (internal consistency, test-retest reliability, and measurement error), floor and ceiling effects, and responsiveness were assessed according to the COSMIN criteria. RESULTS: Forward-backward translation encountered no particular linguistic problems. In total 260 patients completed the baseline measurement, while 182 patients completed the three-month measurement. Only a ceiling effect was identified for the BCI. Hypotheses testing for construct validity was satisfying, as 67% and 92% of the hypothesized correlations were confirmed. Structural validity was moderate for both measures, as confirmatory factor analyses showed limited fit. Reliability of both PROMs was good. The intraclass correlation coefficient (ICC) of the BCI domains ranged from 0.47 to 0.93, minimal value of Cronbach's α was 0.70, smallest detectable change on group level (SDC group) ranged from 1.9 to 8.6. The ICC of the FACT-Bl-Cys domains ranged from 0.43 to 0.83, minimal value of Cronbach's α was 0.77, SDC group was around 1. Only the FACT-Bl-Cys total score was found to be responsive to changes in generic quality of life. CONCLUSIONS: The Dutch versions of the BCI and FACT-Bl-Cys were shown to be reliable and have good content validity. Structural validity was limited for both measures. Only the FACT-Bl-Cys total score was responsive to changes in generic HRQOL. Despite some limitations, both PROMs seem suitable for use in clinical practice and research.