Educational Impact Drives Feasibility of Implementing Daily Assessment in the Workplace.

Construct: Authors investigated the perspectives of stakeholders on feasibility elements of workplace-based assessments (WBA) with varying designs. Background: In the transition to competency-based medical education, WBA are taking a more prominent role in assessment programs. However, the increased demand for WBA leads to new challenges for implementing suitable WBA tools with published validity evidence, while also being feasible and useful in practice. Despite the availability of published WBA tools, implementation does not necessarily occur; a more fulsome understanding of the perspectives of stakeholders who are ultimately the end-users of these tools, as well as the system factors that both deter or support their use, could help to explain why evidence-based assessment tools may not be incorporated into residency programs. Approach: We examined the perspectives of two groups of stakeholders, surgical teachers and resident learners, during an assessment intervention that varied the assessment tools while keeping the assessment process constant. We chose diverse exemplars from published assessment tools that each represented a different response format: global rating scales, step-by-step surgical rubrics, and an entrustability scale. The primary purpose was to investigate how stakeholders are impacted by WBA tools with varying response formats to better understand their feasibility for assessment of cataract surgery. Secondarily, we were able to explore the culture of assessment in cataract surgery education including stakeholders' perceptions of WBA unrelated to assessment form design. Semi-structured interviews with teachers and a focus group with the residents enabled discussion of their perspectives on dimensions of the tools such as acceptability, demand, implementation, practicality, adaptation, and integration. Findings: Three themes summarize teachers' and residents' experiences with the assessment tools: (1) Feedback is the priority; (2) Forms informing coaching; and (3) Forcing the conversation. The tools helped to facilitate the feedback conversation by serving as a reminder to initiate the conversation, a framework to structure the conversation, and a memory aid for providing detailed feedback. Surgical teachers preferred the assessment tool with a design that best aligned with their approach to teaching and how they wanted to provide feedback. Orientation to the tools, combined with established remediation pathways, may help preceptors to better use assessment tools and improve their ability to give critical feedback. Conclusions: Feedback, more so than assessment, dominated the comments provided by both teachers and residents after using the various WBA tools. Our typical assessment design efforts focus on the creation or selection of a robust assessment tool according to good design and measurement principles, but the current findings would encourage us to also prioritize the coaching relationship and include efforts to design WBA tools to function as a mediator to augment teaching, learning, and feedback exchange within that relationship in the workplace.

Cataract Surgery Quality and Capacity.

Cataract surgery is the most common operation performed in most developed countries, including Canada. Nuanced, evidence-driven policies are needed to ensure appropriate access to this sight-saving operation while maintaining the highest standards in quality of care. The Vision Health Services Research Program at Queen's University, in partnership with members of the Ontario Provincial Vision Task Force, has developed evidence to inform policies aimed at optimizing both access and quality across the eye care spectrum.

Preventing Adverse Events in Cataract Surgery: Recommendations From a Massachusetts Expert Panel.

Massachusetts health care facilities reported a series of cataract surgery-related adverse events (AEs) to the state in recent years, including 5 globe perforations during eye blocks performed by 1 anesthesiologist in a single day. The Betsy Lehman Center for Patient Safety, a nonregulatory Massachusetts state agency, responded by convening an expert panel of frontline providers, patient safety experts, and patients to recommend strategies for mitigating patient harm during cataract surgery. The purpose of this article is to identify contributing factors to the cataract surgery AEs reported in Massachusetts and present the panel's recommended strategies to prevent them. Data from state-mandated serious reportable event reports were supplemented by online surveys of Massachusetts cataract surgery providers and semistructured interviews with key stakeholders and frontline staff. The panel identified 2 principal categories of contributing factors to the state's cataract surgery-related AEs: systems failures and choice of anesthesia technique. Systems failures included inadequate safety protocols (48.7% of contributing factors), communication challenges (18.4%), insufficient provider training (17.1%), and lack of standardization (15.8%). Choice of anesthesia technique involved the increased relative risk of needle-based eye blocks. The panel's surveys of Massachusetts cataract surgery providers show wide variation in anesthesia practices. While 45.5% of surgeons and 69.6% of facilities reported increased use of topical anesthesia compared to 10 years earlier, needle-based blocks were still used in 47.0% of cataract surgeries performed by surgeon respondents and 40.9% of those performed at respondent facilities. Using a modified Delphi approach, the panel recommended several strategies to prevent AEs during cataract surgery, including performing a distinct time-out with at least 2 care-team members before block administration; implementing standardized, facility-wide safety protocols, including a uniform site-marking policy; strengthening the credentialing and orientation of new, contracted and locum tenens anesthesia staff; ensuring adequate and documented training in block administration for any provider who is new to a facility, including at least 10 supervised blocks before practicing independently; using the least invasive form of anesthesia appropriate to the patient; and finally, adjusting anesthesia practices, including preferred techniques, as evidence-based best practices evolve. Future research should focus on evaluating the impact of these recommendations on patient outcomes.

Utility of the optical quality analysis system for decision-making in cataract surgery.

BACKGROUND: A cataract is a common cause of vision impairment that requires surgery in older subjects. The Optical Quality Analysis System (OQAS, Visiometrics SL, Terrassa, Spain) assesses the optical quality of the eye in cataract patients. This study shows the role of the optical quality evaluation system for decision-making in cataract surgery. We investigated the clinical utility of the OQAS for decision-making in cataract surgery. METHODS: Sixty-seven eyes from 67 patients undergoing cataract surgery and 109 eyes from 109 control subjects were compared. The best corrected visual acuity (BCVA) was measured. The objective scatter index (OSI), modulation transfer function (MTF), Strehl ratio, predicted visual acuity (PVA) 100%, PVA 20%, and PVA 10% were measured using the OQAS. The sensitivity and specificity of the different parameters were analyzed using the receiver operating characteristic (ROC) curve. The main parameters measured were sensitivity and specificity. RESULTS: The BCVA, OSI, PVA 100%, PVA 20%, and PVA 10% were higher in the cataract group compared to those in the control group, while the MTF and Strehl ratios were lower (p <  0.001 for all). ROC analysis showed that the OSI had the largest area under the curve and that the sensitivity and specificity of the OSI were 83.9 and 84.6%, respectively, at the optimal cut-off point of 2.35. CONCLUSION: The MTF, OSI, Strehl ratio, PVA 100%, PVA 20% and PVA 10% may be useful parameters for preoperative decision-making in cataract surgery. The OSI appears to be the most effective parameter for this purpose.

[One Year Experience with Quality Control of Cataract Surgery Using an Internet-Based EUREQUO Database]. / Ein Jahr Erfahrung mit der Qualitätssicherung der Kataraktoperation (EUREQUO) an einem öffentlichen Spital.

Purpose Quality control is particularly important in invasive medicine. As cataract surgery is the most frequently performed and most successful ophthalmic surgery, quality control should become mandatory. Patients and Methods Retrospective analysis of all cataract procedures performed in a 12 months period (01. 07. 2014 - 30. 06. 2015) at our hospital, using an internet-based EUREQOU database. This database is easy to use and allows local results to be compared with all participants in Switzerland and elsewhere in Europe. Results During one year, 904 cataract procedures were performed at our hospital. Of these, 892 with complete data were compared to 2918 operations performed in Switzerland and 274,644 in other European countries. Our sample contained more patients with markedly reduced visual acuity (< 0.1; 8.4/4.8/3.5 %; KSW/Switzerland/Europe), more patients with glaucoma (28.1/13.9/7.1 %) and more patients with pseudoexfoliation (22.8/11.5/0.56 %). Despite our training of young ophthalmic surgeons, the rate of capsular complications was as low (0.67/0.34/0.67 %) as in other series. Four to 6 weeks after surgery, the majority of patients achieved a best corrected visual acuity of ≥ 0.8 (79.2 vs. 87.4 % in Europe, not enough data from Switzerland). Biometric prediction error (79.2 % within ± 0.75 D) was within the target range, but in the lower quartile. Conclusions Despite the relatively high number of complex patients in our hospital, quality control reveals that we performed cataract surgery with low complication rates and good results. Although quality control is rapid and easy, only three centres in Switzerland are participating.

Coding Accuracy for Outpatient Ophthalmic Surgery: St. Joseph's Healthcare Hamilton.

Coding accuracy is an important factor in ensuring hospitals receive adequate reimbursement from the government for healthcare services rendered. A retrospective review of 100 charts, the purpose of this study was to determine the degree of coding accuracy from the surgeon perspective, for outpatient procedures performed for ophthalmic services at St. Joseph's Healthcare Hamilton from July to December 2016. Using ICD-10-CA, Canadian Classification of Health Interventions, Quality-Based Procedures criteria where applicable, and the 3M Coding and Reimbursement system, this paper reveals three primary sources of coding errors and presents recommendations to increase accuracy of reimbursement for the benefit of both the Ministry of Health and hospital organizations.

Novel system for distant assessment of cataract surgical quality in rural China.

BACKGROUND: This study aims to assess the quality of various steps of manual small incision cataract surgery and predictors of quality, using video recordings. DESIGN: This paper applies a retrospective study. PARTICIPANTS: Fifty-two trainees participated in a hands-on small incision cataract surgery training programme at rural Chinese hospitals. METHODS: Trainees provided one video each recorded by a tripod-mounted digital recorder after completing a one-week theoretical course and hands-on training monitored by expert trainers. Videos were graded by two different experts, using a 4-point scale developed by the International Council of Ophthalmology for each of 12 surgical steps and six global factors. Grades ranged from 2 (worst) to 5 (best), with a score of 0 if the step was performed by trainers. MAIN OUTCOME MEASURES: Mean score for the performance of each cataract surgical step rated by trainers. RESULTS: Videos and data were available for 49/52 trainees (94.2%, median age 38 years, 16.3% women and 77.5% completing > 50 training cases). The majority (53.1%, 26/49) had performed ≤ 50 cataract surgeries prior to training. Kappa was 0.57∼0.98 for the steps (mean 0.85). Poorest-rated steps were draping the surgical field (mean ± standard deviation = 3.27 ± 0.78), hydro-dissection (3.88 ± 1.22) and wound closure (3.92 ± 1.03), and top-rated steps were insertion of viscoelastic (4.96 ± 0.20) and anterior chamber entry (4.69 ± 0.74). In linear regression models, higher total score was associated with younger age (P = 0.015) and having performed >50 independent manual small incision cases (P = 0.039). CONCLUSIONS: More training should be given to preoperative draping, which is poorly performed and crucial in preventing infection. Surgical experience improves ratings.

A methodological approach to identify external factors for indicator-based risk adjustment illustrated by a cataract surgery register.

BACKGROUND: Risk adjustment is crucial for comparison of outcome in medical care. Knowledge of the external factors that impact measured outcome but that cannot be influenced by the physician is a prerequisite for this adjustment. To date, a universal and reproducible method for identification of the relevant external factors has not been published. The selection of external factors in current quality assurance programmes is mainly based on expert opinion. We propose and demonstrate a methodology for identification of external factors requiring risk adjustment of outcome indicators and we apply it to a cataract surgery register. METHODS: Defined test criteria to determine the relevance for risk adjustment are "clinical relevance" and "statistical significance". Clinical relevance of the association is presumed when observed success rates of the indicator in the presence and absence of the external factor exceed a pre-specified range of 10%. Statistical significance of the association between the external factor and outcome indicators is assessed by univariate stratification and multivariate logistic regression adjustment.The cataract surgery register was set up as part of a German multi-centre register trial for out-patient cataract surgery in three high-volume surgical sites. A total of 14,924 patient follow-ups have been documented since 2005. Eight external factors potentially relevant for risk adjustment were related to the outcome indicators "refractive accuracy" and "visual rehabilitation" 2-5 weeks after surgery. RESULTS: The clinical relevance criterion confirmed 2 ("refractive accuracy") and 5 ("visual rehabilitation") external factors. The significance criterion was verified in two ways. Univariate and multivariate analyses revealed almost identical external factors: 4 were related to "refractive accuracy" and 7 (6) to "visual rehabilitation". Two ("refractive accuracy") and 5 ("visual rehabilitation") factors conformed to both criteria and were therefore relevant for risk adjustment. CONCLUSION: In a practical application, the proposed method to identify relevant external factors for risk adjustment for comparison of outcome in healthcare proved to be feasible and comprehensive. The method can also be adapted to other quality assurance programmes. However, the cut-off score for clinical relevance needs to be individually assessed when applying the proposed method to other indications or indicators.

European registry for quality improvement in cataract surgery.

PURPOSE: A project aimed at creating a multi-national database for cataract and refractive surgery was initiated in 2008. The database was intended for learning and clinical improvement, not supervision. The project was co-funded by the European Union, under the Executive Agency for Health and Consumers and the European Society of Cataract and Refractive Surgeons (ESCRS) and supported by 11 national societies for cataract and refractive surgery. The purpose of this article is to describe the setup of the database and the ensuing achievements within cataract surgery after four years. DESIGN/METHODOLOGY/APPROACH: A web-based system was created for input and output of data, with a software interface to two databases, one for cataract surgery and one for refractive surgery. Data can be put in either manually through web forms or by transfer of data from existing national registries or large electronic medical record systems. Output of reports from the system or export of one's own data is available on the web. The data are anonymous to all users, with the sole exception that reporting surgeons and clinics have access to their own data. The system does not include any patient identification. FINDINGS: After four years, data from 16 countries have been entered into the system, including reports of more than 900,000 cataract extractions. The database has been used by individual clinics for benchmarking and clinical improvement work, and has also served as the basis for new clinical guidelines for cataract surgery. The ESCRS has guaranteed the sustainability of the database after the project period. ORIGINALITY/VALUE: A European quality registry with data input from surgeons and clinics in 16 European countries has been established. Close to one million surgeries have been entered into the system during the first four years. Evidence-based guidelines have been published based on data in the registry. The system is used for benchmarking by both experienced surgeons and trainees.

Pre-anaesthesia assessment in cataract surgery: Recommendations from the SEDAR Working Group.

INTRODUCTION AND OBJECTIVES: Cataract surgery is one of the most common procedures in outpatient surgery units. The use of information and communication technologies (ICT) in clinical practice and the advent of new health scenarios, such as the Covid pandemic, have driven the development of pre-anaesthesia assessment models that free up resources to improve access to cataract surgery without sacrificing patient safety. The approach to cataract surgery varies considerably among public, subsidised and private hospitals. This raises the need for guidelines to standardise patient assessment, pre-operative tests, management of background medication, patient information and informed consent. RESULTS: In this document, the SEDAR Clinical Management Division together with the Major Outpatient Surgery Division SEDAR Working Group put forward a series of consensus recommendations on pre-anaesthesia testing based on the use of ITCs, health questionnaires, patient information and informed consent supervised and evaluated by an anaesthesiologist. CONCLUSIONS: This consensus document will effectivise pre-anaesthesia assessment in cataract surgery while maintaining the highest standards of quality, safety and legality.

Efficacy and safety of mass cataract surgery campaign in a developing country.

PURPOSE: To determine the visual outcomes achieved in terms of efficacy and safety during a mass eye surgery campaign in a low-income developing country. METHODS: Three hundred fifteen eyes of 305 patients underwent extracapsular cataract extraction with intraocular lens implantation in a prospective, analytical, experimental, and nonrandomized study on patients who underwent cataract surgery during the campaign that two Spanish nongovernmental organizations conducted in December 2008 in a district hospital in Bobo-Dioulasso (Burkina Faso). RESULTS: Mean age was 61.97 ± 14.39 years. The mean uncorrected distance visual acuity before surgery was 2.17 ± 0.7 (20/3000), which improved to 0.86 ± 0.64 logMAR (20/150) 3 months after cataract surgery. The mean spherical equivalent at 3 months was -0.87 ± 1.90 diopters. The corrected distance visual acuity was 0.52 ± 0.44 logMAR (20/60) 3 months after surgery, 68.7% of the patients had good visual outcomes, and 9.16% had poor outcomes. A total of 41.4% of the operated eyes showed a spherical equivalent within ± 1.00 diopter of emmetropia. The most common intraoperative complication was posterior capsule rupture (incidence, 2.9%, 9 of 315), and the most serious complication was expulsive hemorrhage (incidence, 0.3%, 1 of 315). Three months after surgery, 2.9% (9 of 315) of the eyes was affected by posterior capsular opacity. CONCLUSIONS: A mass cataract campaign performed in a developing country with the proper technique and standardized protocols of action improved the visual outcome of the patients. The rate of incidence of extracapsular extractions is comparable to that estimated for developed countries.

Application of Six Sigma methodology to a cataract surgery unit.

PURPOSE: The article's aim is to focus on the application of Six Sigma to minimise intraoperative and post-operative complications rates in a Turkish public hospital cataract surgery unit. DESIGN/METHODOLOGY/APPROACH: Implementing define-measure-analyse-improve and control (DMAIC) involves process mapping, fishbone diagrams and rigorous data-collection. Failure mode and effect analysis (FMEA), pareto diagrams, control charts and process capability analysis are applied to redress cataract surgery failure root causes. FINDINGS: Inefficient skills of assistant surgeons and technicians, low quality of IOLs used, wrong IOL placement, unsystematic sterilisation of surgery rooms and devices, and the unprioritising network system are found to be the critical drivers of intraoperative-operative and post-operative complications. Sigma level was increased from 2.60 to 3.75 subsequent to extensive training of assistant surgeons, ophthalmologists and technicians, better quality IOLs, systematic sterilisation and air-filtering, and the implementation of a more sophisticated network system. PRACTICAL IMPLICATIONS: This article shows that Six Sigma measurement and process improvement can become the impetus for cataract unit staff to rethink their process and reduce malpractices. Measuring, recording and reporting data regularly helps them to continuously monitor their overall process and deliver safer treatments. ORIGINALITY/VALUE: This is the first Six Sigma ophthalmology study in Turkey.

Prevalence of myopic shifts among patients seeking cataract surgery.

Modern cataract surgery by phacoemulsification is a widely accepted procedure with a rapid recovery time. The prescription of specific intraocular lens, implanted during surgery, makes it possible to anticipate whether the patient will need reading glasses after the procedure. The present study analyses a sample of cataract surgery patients to show the frequency of myopic shifts related to nuclear opacity, which can result in clear near vision before surgery. A non-selected sample of consecutive patients who underwent elective cataract surgery in a private clinic was studied retrospectively. The myopic shift in refraction was assessed by comparing the old prescription with the spectacle correction at the time of interviewing.The mean age of the 229 subjects studied was 71.5 ± 10.4 years (109, 47.6%, males). A myopic shift in refraction, defined as at least - 0.5 diopters, was present in 37.1% of subjects (95% CI: 30.8%-43.4%). The mean change in refraction in these subjects was -2.52 ± 1.52 diopters. The percentage of subjects who had developed a myopic shift was significantly greater in those who presented greater nuclear opalescence. There were also differences in the mean myopic shift by refractive group, with the emmetropes having the greatest myopic shift. In this study of patients seeking cataract surgery in a clinical setting, more than one third had myopic shifts in refraction. This must be taken into account in order that patients maintain the benefit of clear near vision after surgery.

Development of a code-free machine learning model for the classification of cataract surgery phases.

This study assessed the performance of automated machine learning (AutoML) in classifying cataract surgery phases from surgical videos. Two ophthalmology trainees without coding experience designed a deep learning model in Google Cloud AutoML Video Classification for the classification of 10 different cataract surgery phases. We used two open-access publicly available datasets (total of 122 surgeries) for model training, validation and testing. External validation was performed on 10 surgeries issued from another dataset. The AutoML model demonstrated excellent discriminating performance, even outperforming bespoke deep learning models handcrafter by experts. The area under the precision-recall curve was 0.855. At the 0.5 confidence threshold cut-off, the overall performance metrics were as follows: sensitivity (81.0%), recall (77.1%), accuracy (96.0%) and F1 score (0.79). The per-segment metrics varied across the surgical phases: precision 66.7-100%, recall 46.2-100% and specificity 94.1-100%. Hydrodissection and phacoemulsification were the most accurately predicted phases (100 and 92.31% correct predictions, respectively). During external validation, the average precision was 54.2% (0.00-90.0%), the recall was 61.1% (0.00-100%) and specificity was 96.2% (91.0-99.0%). In conclusion, a code-free AutoML model can accurately classify cataract surgery phases from videos with an accuracy comparable or better than models developed by experts.

Effects of Cataract Surgery on Vision-Related Quality of Life in Patients with Retinitis Pigmentosa and the Predictive Factors of Quality of Life Improvement.

PURPOSE: To determine the effects of cataract surgery and preoperative factors on the vision-related quality of life (QOL) in patients with retinitis pigmentosa (RP). MATERIALS AND METHODS: This was a prospective, interventional study of 54 patients diagnosed with RP. The 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25) was used to determine the QOL before and after the cataract surgery. The correlations between the scores of the questionnaire and the best-corrected visual acuity (BCVA), macular structure, and degree of improvement of the NEI VFQ-25 scores were also determined. RESULTS: Statistically significant improvements were observed in the BCVA and all of the NEI VFQ-25 subscale scores except for color vision. The improvement of general vision was the largest. The postoperative BCVA of the better-seeing eye was more strongly and significantly correlated with the postoperative NEI VFQ-25 scores than that of the worse-seeing eye. All of the postoperative NEI VFQ-25 scores were significantly correlated with the length of the ellipsoid zone (EZ) of the photoreceptors. No significant correlation was found between the preoperative general vision, near vision, mental health scores, and EZ length. All of the preoperative NEI VFQ-25 scores except the social function and mental health scores were negatively and significantly correlated with the degree of improvement of the NEI VFQ-25 score. The EZ length was significantly correlated with the degree of improvement of the NEI VFQ-25 scores of the general vision, distance vision, mental health, dependency, and composite 9 scores. CONCLUSIONS: Cataract surgery can significantly improve the NEI VFQ-25 scores in RP patients. The EZ length can be used to predict the postoperative VFQ scores. We conclude that the NEI VFQ-25 is a useful method to evaluate the impact of cataract surgery on the BCVA in patients with RP.