Introduction of a novel service model to improve uptake and adherence with cardiac rehabilitation within Buckinghamshire Healthcare NHS Trust.

BACKGROUND: Buckinghamshire Healthcare NHS Trust (BHT) carried out a cardiac rehabilitation (CR) service redesign aimed at optimising patient recruitment and retention and decreasing readmissions. METHODS: A single centre observational study and local service evaluation were carried out to describe the impact of the novel technology-enabled CR model. Data were collected for adult patients referred for CR at BHT, retrospectively for patients referred during the 12-month pre-implementation period (Cohort 1) and prospectively for patients referred during the 12-month post-implementation period (Cohort 2). The observational study included 350 patients in each cohort, seasonally matched; the service evaluation included all eligible patients. No data imputation was performed. RESULTS: In the observational study, a higher proportion of referred patients entered CR in Cohort 2 (84.3%) than Cohort 1 (76.0%, P = 0.006). Fewer patients in Cohort 2 had ≥1 cardiac-related emergency readmission within 6 months of discharge (4.3%) than Cohort 1 (8.9%, P = 0.015); readmissions within 30 days and 12 months were not significantly different. Median time to CR entry from discharge was significantly shorter in Cohort 2 (35.0 days) than Cohort 1 (46.0 days, P < 0.001). The CR completion rate was significantly higher in Cohort 2 (75.6%) than Cohort 1 (47.4%, P < 0.001); median CR duration for completing patients was significantly longer in Cohort 2 (80.0 days) than Cohort 1 (49.0 days, P < 0.001). Overall, similar results were observed in the service evaluation. CONCLUSIONS: Introduction of the novel technology-enabled CR model was associated with short-term improvements in emergency readmissions and sustained increases in CR entry, duration and completion.

The surgical efficiency score: a feasible, reliable, and valid method of skills assessment.

BACKGROUND: Technical skills assessments are being increasingly used in surgical residency programs, with the objectivity and validity of several techniques well established. However, many of these methods are labor and time intensive, limiting their feasibility. This study aims to compare more efficient techniques of skills appraisals with an established gold standard. METHODS: Thirty surgeons completed 2 previously validated laboratory-based surgical models: small bowel anastomosis and vein patch insertion. Gold standard evaluation was the Objective Structured Assessment of Technical Skills (OSATS) method. "Efficient" techniques used were (1) quality of final product (FP); (2) snapshot assessment (SS), in which task performance was edited to a 2-minute sound bite and scored with OSATS; and (3) the surgical efficiency score (SES), a combination of final product quality and hand-motion analysis. All human observer evaluations used retrospective video analysis with 3 trained observers. Nonparametric tests were used to analyze the results. RESULTS: With respect to small bowel anastomosis, correlations with OSATS were as follows: FP 0.341 (P=.07), SS 0.577 (P<.001), and SES 0.842 (P<.001). For vein patch insertion, the correlations were as follows: FP 0.545 (P=.001), SS 0.609 (P<.001), and SES 0.700 (P<.001). Interobserver concordance was high for both models with respect to FP (Cronbach's alpha 0.80 for small bowel anastomosis and 0.84 for vein patch insertion). With respect to SS, interobserver reliability was high for vein patch insertion (Cronbach's alpha 0.80) but only moderate for small bowel anastomosis (0.59). CONCLUSIONS: The surgical efficiency score and snap shot assessments both show significant correlations with the traditional OSATS appraisals and suggest that skills assessment can be made more feasible. Correlations were closer with the former and interobserver concordance more variable with the latter, suggesting the surgical efficiency score as the most reliable of the methods evaluated.

Relationship between skill and outcome in the laboratory-based model.

BACKGROUND: Recent attention has been directed at developing quantitative assessments of surgical skill. This study aims to demonstrate whether objectively measuring differences in manual dexterity has an impact on a simulated surgical procedure. METHODS: Six general surgical trainees performed 5 polytetrafluoroethylene graft to artery anastomoses on a vascular model by using a standardized technique. Manual dexterity was objectively measured with (1) electromagnetic motion analysis: trackers applied to the backs of hands recorded and analyzed both hand movements and procedural time and (2) 4-parameter evaluation of the final product. Outcome parameters were assessed by (1) rate of anastomotic leakage and (2) smallest cross-sectional area of the anastomosis. RESULTS: The 2 objective measures of manual dexterity correlated closely (Pearson coefficient, 0.423; P <.02). Trainees with better manual dexterity scores produced better outcome measures. Those with better motion analysis scores produced anastomoses that leaked less (Pearson coefficient, 0.514; P <.01) and those with higher global evaluation scores had a larger anastomotic cross-sectional area (Pearson coefficient, 0.495; P <.01). Time taken for the procedure did not appear to influence either outcome measure. CONCLUSIONS: There is a significant correlation between objective measures of manual dexterity and the outcome measures in this model. This suggests that the outcome of a procedure can be predicted by measuring surgical skill.

Comparison of bench test evaluations of surgical skill with live operating performance assessments.

BACKGROUND: Attempts at assessing surgical proficiency have generally used laboratory simulation to evaluate skill. The aim of this study was to compare technical ability as measured on a bench simulation with actual operative performance. STUDY DESIGN: Twenty-two general surgeons and trainees were recruited: consultants (n = 4), specialist registrars (n = 14), and senior house officers (n = 4). They were assessed while performing a saphenofemoral dissection on an anesthetized patient in the operating theater, and performing the same procedure on an inanimate model within the laboratory. The Objective Structured Assessment of Technical Skill method, consisting of a 7-parameter global rating (maximum score 35) and 17-point step-by-step checklist (maximum score 17) was used to measure performance in both environments. Face, content, and construct validity of the synthetic model were established as part of this study. RESULTS: There was a significant relationship between technical skill as measured on the bench test model and performance within the operating theater with respect to both global rating (Spearman correlation coefficient 0.824, p < 0.001; alpha coefficient 0.89) and checklist ratings (r = 0.514, p < 0.02; alpha coefficient 0.68) rating assessments. Global rating scores correlated with experience for both operative (r = 0.822, p < 0.001) and bench (r = 0.515, p < 0.05) settings. There was no difference in level of measured performance between operating theater and bench model (global rating mean 23.25 +/- 6.66 versus 23.75 +/- 5.62, respectively; paired t-test p = 0.559). CONCLUSIONS: Assessment of technical skill using inanimate procedural simulation translates to actual surgical performance within the operating theater. This further validates use of bench test evaluations to measure surgical technical ability.

Electromagnetic motion analysis in the assessment of surgical skill: Relationship between time and movement.

INTRODUCTION: Electromagnetic motion analysis is a promising method of assessing surgical skill in a skills-laboratory setting. There is a very strong correlation between movement and time data, and this study was conducted to determine whether this relationship is fixed, or whether it can vary. METHODS: : After a pilot study, four subjects were recruited. Each performed 30 trials of a simple standardized suturing task, alternating between 'normal', 'precise', and 'fast' strategies. The number of movements, and time to complete each task were recorded. RESULTS: Comparing the 'fast' to 'normal' strategies, there was a significant decrease in total number of movements per trial (P < 0.001), and time taken (P < 0.001). Regression analysis was performed to examine the relationship between the time taken and the number of movements, and revealed significant differences between both the fast (P = 0.006), and precise (P = 0.002) strategies, when compared to the normal strategy. DISCUSSION: This study confirms that the relationship between time and movements is not fixed, but varies with the operative strategy adopted for this simple suturing task.