Computer analysis of individual cataract surgery segments in the operating room.

PURPOSE: Objective feedback is important for the continuous development of surgical skills. Motion tracking, which has previously been validated across an entire cataract procedure, can be a useful adjunct. We aimed to measure quantitative differences between junior and senior surgeons' performance in three distinct segments. We further explored whether automated analysis of trainee surgical videos through PhacoTracking could be aligned with metrics from the EyeSi virtual reality simulator, allowing focused improvement of these areas in a controlled environment. METHODS: Prospective cohort analysis, comparing junior vs. senior surgeons' real-life performance in distinct segments of cataract surgery: continuous curvilinear capsulorhexis (CCC), phacoemulsification, and irrigation and aspiration (I&A). EyeSi metrics that could be aligned with motion tracking parameters were identified. Motion tracking parameters (instrument path length, number of movements and total time) were measured. t-test used between the two cohorts for each component to check for any significance (p < 0.05). RESULTS: A total of 120 segments from videos of 20 junior and 20 senior surgeons were analysed. Significant differences between junior and senior surgeons were found during CCC (path length p = 0.0004; number of movements p < 0.0001; time taken p < 0.0001), phacoemulsification (path length p < 0.0001; number of movements p < 0.0001; time taken p < 0.0001), and irrigation and aspiration (path length p = 0.006; number of movements p = 0.013; time taken p = 0.036). CONCLUSION: Individual segments of cataract surgery analysed using motion tracking appear to discriminate between junior and senior surgeons. Alignment of motion tracking and EyeSi parameters could enable independent, task specific, objective and quantitative feedback for each segment of surgery thus mirroring the widely utilised modular training.

Intraoperative head drift and eye movement: two under addressed challenges during cataract surgery.

PURPOSE: To objectively measure head drift during cataract surgery, and subjectively simulate eye movements and assess impact on surgical technique. MATERIALS AND METHODS: Twelve consecutively recorded routine cataract operations in the Tennent Institute of Ophthalmology, Gartnavel General Hospital, Glasgow, were reviewed. The speculum was used as a fixed point and correlated with a superimposed virtual ruler to measure maximum head drift in each direction throughout the operations. To simulate intraoperative eye movement, we attached string to the cataract surgical simulator (Eyesi) eye and manually induced abduction and adduction. A calibrated scale secured to the Eyesi head ensured 5 mm eye movements were consistently created. Ophthalmology trainees performed the continuous curvilinear capsulorhexis (CCC) exercise without and with sequential eye movements. Movements were induced every three seconds. Scores were compared using a paired Student's T-test. RESULTS: Mean head drift in the surgical recordings was 3.1 mm medially (range 2-7 mm), 2.9 mm laterally (range 2-4 mm), 2.6 mm superiorly (range 1-5 mm), and 1.9 mm inferiorly (range 1-4 mm). In 11 of 12 cases, the operating microscope had to be adjusted for head drift. Six junior trainees completed the CCC module on the Eyesi without then with eye movements. After introducing eye movements the mean Eyesi score reduced from 92.7 to 76.9 (P = 0.014), 'roundness of rhexis' score reduced from 89.4 to 57.5 (P = 0.020), and trainees operated 17 s faster (P = 0.016). CONCLUSION: This study objectively demonstrates the under-reported clinical scenario of head drift during cataract surgery. By manipulating the Eyesi we have shown that eye movements reduce the quality of cataract surgery.

Effect of music on surgical skill during simulated intraocular surgery.

OBJECTIVE: To evaluate the effect of Mozart music compared to silence on anterior segment surgical skill in the context of simulated intraocular surgery. DESIGN: Prospective stratified and randomized noninferiority trial. PARTICIPANTS: Fourteen ophthalmologists and 12 residents in ophthalmology. METHODS: All participants were asked to perform 4 sets of predetermined tasks on the EyeSI surgical simulator (VRmagic, Mannheim, Germany). The participants completed 1 Capsulorhexis task and 1 Anti-Tremor task during 3 separate visits. The first 2 sets determined the basic level on day 1. Then, the participants were stratified by surgical experience and randomized to be exposed to music (Mozart sonata for 2 pianos in D-K448) during either the third or the fourth set of tasks (day 2 or 3). Surgical skill was evaluated using the parameters recorded by the simulator such as "Total score" and "Time" for both tasks and task-specific parameters such as "Out of tolerance percentage" for the Anti-Tremor task and "Deviation of rhexis radius from 2.5 mm," "Roundness," and "Centering" for the Capsulorhexis task. The data were analyzed using the Wilcoxon signed-rank test. RESULTS: No statistically significant differences were noted between exposure and nonexposure for all the Anti-Tremor task parameters as well as most parameters for the Capsulorhexis task. Two parameters for the Capsulorhexis task showed a strong trend for improvement with exposure to music ("Total score" +23.3%, p = 0.025; "Roundness" +33.0%, p = 0.037). CONCLUSION: Exposure to music did not negatively impact surgical skills. Moreover, a trend for improvement was shown while listening to Mozart music.

Continuous Curvilinear Capsulorhexis Training and Non-Rhexis Related Vitreous Loss: The Specificity of Virtual Reality Simulator Surgical Training (An American Ophthalmological Society Thesis).

PURPOSE: To assess the specificity of simulation-based virtual reality ophthalmic cataract surgery training on the Eyesi ophthalmic virtual reality surgical simulator, and test the hypothesis that microsurgical motor learning is highly specific. METHODS: Retrospective educational interventional case series. The rates of vitreous loss and retained lens material, and vitreous loss and retained lens material associated with an errant continuous curvilinear capsulorhexis (CCC) were assessed among 1037 consecutive cataract surgeries performed during four consecutive academic years at a teaching hospital. The data were grouped by Eyesi use and capsulorhexis intensive training curriculum (CITC) completion. The main intervention was the completion of the CITC on the Eyesi. RESULTS: In the Eyesi simulator experience-based stratification, the vitreous loss rate was similar in each group (chi square p=0.95) and was not preceded by an errant CCC in 86.2% for "CITC done at least once", 57.1% for "CITC not done, but some Eyesi use", and 48.9% for "none" training groups (p=4×10-5). Retained lens material overall and occurring among the errant CCC cases was similar among training groups (p=0.82 and p=0.71, respectively). CONCLUSIONS: Eyesi capsulorhexis training was not associated with lower vitreous loss rates overall. However, non-errant CCC associated vitreous loss was higher among those who underwent Eyesi capsulorhexis training. Training focused on the CCC portion of cataract surgery may not reduce vitreous loss unassociated with an errant CCC. It is likely that surgical training is highly specific to the task being trained. Residents may need to be trained for all surgical steps with adequate intensity to minimize overall complication rates.

Efficacy of Eyesi surgical simulator training in improving high-tension capsules capsulorhexis performance / Eficácia do treinamento com simulador cirúrgico Eyesi em melhorar a capsulorrexe em cápsulas de alta tensão

ABSTRACT Purpose: To evaluate if Eyesi cataract surgical simulator training using its standard course curriculum is effective in improving performance of cataract surgery trainees on creating capsulorhexis on high-tension capsules on the simulator. Methods: We retrospectively analyzed training reports of ophthalmic surgery trainees (2nd and 3rd year residents and cataract fellowship trainees) that have accomplished the standard Eyesi cataract surgery simulator training course version 2.1 between May 2012 and August 2013 at Instituto de Diagnostico e Terapia Ocular, Rio de Janeiro, Brazil. We compared the mean score (from 0 to 100) attributed by the simulator on performing the same task, a capsulorhexis on a high-tension capsule, on the surgical simulator "before training" (during beginning of the course) and "after training" (at later stages of the course). Results: Thirty-seven trainees' reports were analyzed. Mean and standard deviation "before training" high-tension capsulorhexis score was 41.73 ± 27.08 points and the mean "after training" score was 72.55 ± 16.40 points, a difference of +30.82 points (p value <0.001 on Paired t test), representing a 73% improvement on performance. Conclusions: Eyesi surgical simulator training on course version 2.1 curriculum was effective in improving performance of cataract surgery trainees on creating capsulorhexis on high-tension capsules.

RESUMO Objetivos: Avaliar se o treinamento realizado com o simulador cirúrgico de catarata Eyesi e o seu currículo de exercícios padrão são efetivos em melhorar o desempenho de cirurgiões de catarata em formação na confecção de capsulorrexe em cápsulas de alta tensão realizadas no simulador. Métodos: Analisamos retrospectivamente relatórios de treinamento de residentes de 2º e 3º ano e fellows de catarata que realizaram o curso versão 2.1 de treinamento com o simulador cirúrgico de catarata Eyesi no período de maio de 2012 a agosto de 2013 no Instituto de Diagnóstico e Terapia Ocular, Rio de Janeiro, Brasil. Comparamos o escore médio (de 0 a 100 pontos) atribuído na confecção de capsulorrexe em cápsula de alta tensão no simulador "antes do treinamento" (durante início do curso) e "depois do treinamento" (nos estágios finais do curso). Resultados: Trinta e sete relatórios de cirurgiões em treinamento foram analisados. O escore médio e desvio padrão da capsulorrexe em cápsula de alta tensão "antes do treinamento" foi de 41,73 ± 27,08 pontos e "depois do treinamento" de 72,55 ± 16,40 pontos, uma diferença de +30,82 pontos (p <0.001 no teste t pareado), representando uma melhora de 73% no desempenho. Conclusão: O treinamento realizado com o simulador cirúrgico de catarata Eyesi seguindo o currículo do curso versão 2.1 foi eficaz em melhorar o desempenho de cirurgiões em treinamento na confecção de capsulorrexe em cápsulas de alta tensão.

Virtual phacoemulsification surgical simulation using visual guidance and performance parameters as a feasible proficiency assessment tool.

BACKGROUND: Computer based surgical training is believed to be capable of providing a controlled virtual environment for medical professionals to conduct standardized training or new experimental procedures on virtual human body parts, which are generated and visualised three-dimensionally on a digital display unit. The main objective of this study was to conduct virtual phacoemulsification cataract surgery to compare performance by users with different proficiency on a virtual reality platform equipped with a visual guidance system and a set of performance parameters. METHODS: Ten experienced ophthalmologists and six medical residents were invited to perform the virtual surgery of the four main phacoemulsification cataract surgery procedures - 1) corneal incision (CI), 2) capsulorhexis (C), 3) phacoemulsification (P), and 4) intraocular lens implantation (IOL). Each participant was required to perform the complete phacoemulsification cataract surgery using the simulator for three consecutive trials (a standardized 30-min session). The performance of the participants during the three trials was supported using a visual guidance system and evaluated by referring to a set of parameters that was implemented in the performance evaluation system of the simulator. RESULTS: Subjects with greater experience obtained significantly higher scores in all four main procedures - CI1 (ρ = 0.038), CI2 (ρ = 0.041), C1 (ρ = 0.032), P2 (ρ = 0.035) and IOL1 (ρ = 0.011). It was also found that experience improved the completion times in all modules - CI4 (ρ = 0.026), C4 (ρ = 0.018), P6 (ρ = 0.028) and IOL4 (ρ = 0.029). Positive correlation was observed between experience and anti-tremor - C2 (ρ = 0.026), P3 (ρ = 0.015), P4 (ρ = 0.042) and IOL2 (ρ = 0.048) and similarly with anti-rupture - CI3 (ρ = 0.013), C3 (ρ = 0.027), P5 (ρ = 0.021) and IOL3 (ρ = 0.041). No significant difference was observed between the groups with regards to P1 (ρ = 0.077). CONCLUSIONS: Statistical analysis of the results obtained from repetitive trials between two groups of users reveal that augmented virtual reality (VR) simulators have the potential and capability to be used as a feasible proficiency assessment tool for the complete four main procedures of phacoemulsification cataract surgery (ρ < 0.05), indicating the construct validity of the modules simulated with augmented visual guidance and assessed through performance parameters.

Ophthalmic Surgical Simulation in Training Dexterity in Dominant and Nondominant Hands: Results From a Pilot Study.

PURPOSE: To determine whether a structured training program using the validated EYESI surgical simulator improves dexterity in nondominant (ND) hands. SETTING: Academic tertiary referral center. DESIGN: Nonrandomized, prospective study. METHODS: Subjects who chose to participate and provided informed consent completed a structured simulation training program, which included a baseline test, 3 sessions of repeated tasks, and a final test on capsulorhexis in dominant (D) and ND hands. Participants completed demographic and satisfaction questionnaires. Performances at each session were recorded. We compared overall scores at baseline and at the end of the study, and analyzed trends over time. Statistical analysis was performed using JMP by SAS. RESULTS: Overall, 14 subjects completed the training program. In all, 3 (21.4%) were attending physicians and 11 (78.6%) were trainees. There was a significant improvement in the average overall scores (baseline vs. final) in both the D hand (33.4 vs. 46.5; p < 0.05) and the ND hand (28.9 vs. 47.7; p < 0.001). The structured training program demonstrated significantly faster performance times in both hands at the end of the study (D p< 0.001, ND p < 0.02). However, the learning curve was significantly steeper in the ND hand (p < 0.01). Participants agreed that simulation training improved the ND hand dexterity. CONCLUSIONS: We found a significantly greater trend for improvement in the ND compared with the D hand. These results suggest that an elaborate, structured curriculum targeting teaching dexterity results in better simulated performance.

Establishment of a validated training programme on the Eyesi cataract simulator. A prospective randomized study.

PURPOSE: To establish and evaluate a systematic training programme to be included into the ophthalmologic resident curriculum. METHODS: Medical students (n = 20) within a year from graduation and with no previous ophthalmic experience were included in this prospective study and randomized into two groups. Group A (n = 10) completed the Eyesi cataract simulator training programme once a week for 4 weeks, while Group B (n = 10) completed it once a week at the first and the last week. Two cataract surgeons were used to determine two different levels of reference scores. Score per analysed module [two different levels of Capsulorhexis (A and B), Hydromaneuver, Phaco divide and conquer], Overall score, Total time, Cornea injury, Capsule rupture and Capsule damage by ultrasound were recorded. RESULTS: Group A outperformed Group B in several modules, reached a significant higher number of reference scores (p < 0.01) and caused fewer complications with regard to Capsule rupture (p = 0.01) and Capsule damage by ultrasound (p < 0.05). Both Groups A and B improved their performance and also became more time efficient (p < 0.01 for both groups). Group A showed positive learning curves for Overall score (p < 0.01), Capsulorhexis A (p < 0.01), Capsulorhexis B (p < 0.01) and Hydromaneuver (p = 0.01). Group B showed a significant improvement for Overall score (p < 0.01), Hydromaneuver (p = 0.02) and Phaco divide and conquer (p < 0.01). CONCLUSION: Repetitive training with a systematic training programme, based on validated modules in the Eyesi simulator, was shown to improve simulated cataract surgery skills. Higher level of skills and more reference scores were reached with more training. Furthermore, the programme was optimized to be applied into the standard ophthalmological curriculum for cataract surgery training.

Efficacy of surgical simulator training versus traditional wet-lab training on operating room performance of ophthalmology residents during the capsulorhexis in cataract surgery.

PURPOSE: To compare the operating room performance of ophthalmology residents trained by traditional wet-lab versus surgical simulation on the continuous curvilinear capsulorhexis (CCC) portion of cataract surgery. SETTING: Academic tertiary referral center. DESIGN: Prospective randomized study. METHODS: Residents who chose to participate and provided informed consent were randomized to preoperative CCC training in the wet lab or on a simulator. Residents completed pre-practice demographic questionnaires including habits of daily living. After completion of their preoperative training (wet lab versus simulator), residents performed their first CCC of the clinical rotation under the direct supervision of an attending physician as part of their standard training at the facility. Residents then completed satisfaction questionnaires regarding their preoperative training. Two attending surgeons reviewed and graded each video of operating room performance. The mean score between the 2 attending physicians was used as the individual performance score for each of the 12 performance criteria. The overall score was calculated as the sum of these 12 individual performance scores (standardized). RESULTS: Ten residents trained in the wet lab and 11 on the simulator. There was no significant difference in overall score between the 2 groups (P=.608). There was no significant difference in any individual score except time (wet-lab group faster than simulator group) (P=.038). CONCLUSIONS: Preoperative simulator training prepared residents for the operating room as effectively as the wet lab. The time to pass the simulator curriculum was predictive of the time and overall performance in the operating room. FINANCIAL DISCLOSURE: No author has a financial or proprietary interest in any material or method mentioned.

[Design and validation of a simulator for training in continuous circular capsulotomy for phacoemulsification]. / Diseño y validación de un simulador para el entrenamiento en la capsulotomía circular continua en la facoemulsificación.

INTRODUCTION: To design and validate a simulator for learning and training in the capsulorhexis technique. METHODS: The system consists of a methacrylate support inclined 15° for the surgeon's hand, an area of commercially available aluminum foil, and another one of similar characteristics, where the student performs the technique through some slots that are previously made in the support. In order to evaluate the feasibility of this simulator, data were collected from 65 ophthalmologists performing the technique during training activities. The ophthalmologists were randomly divided into one group of 30 specialists who start their learning on the eyes of an animal cadaver, and into another of 35 specialists who previously started with this simulator. RESULTS: A simulator is developed for training in the capsulorhexis technique. The students from the simulator group achieved a reduction in the use of cadaver eyes, and a higher efficiency in correct capsulorhexis, unlike the group who started directly on the cadaver eyes. CONCLUSIONS: This simulator is an innovation in training of the capsulorhexis technique as regards simplicity, cost, and reuse, as compared to other virtual simulators with more expensive computer equipment (CE) equipment that are more difficult to transport. It is an important step prior to the use of cadaver parts and experimental animals, decreasing the number of both, and therefore the teaching costs.

The development of a virtual reality training programme for ophthalmology: repeatability and reproducibility (part of the International Forum for Ophthalmic Simulation Studies).

PURPOSE: To evaluate the variability of performance among novice ophthalmic trainees in a range of repeated tasks using the Eyesi virtual reality (VR) simulator. METHODS: Eighteen subjects undertook three attempts of five cataract specific and generic three-dimensional tasks: continuous curvilinear capsulorhexis, cracking and chopping, cataract navigation, bimanual cataract training, anti-tremor. Scores for each attempt were out of a maximum of 100 points. A non-parametric test was used to analyse the data, where a P-value of <0.05 was considered statistically significant. RESULTS: Highly significant differences were found between the scores achieved in the first attempt and that during the second (P<0.0001) and third (P<0.0001) but not between the second and third attempt (P=0.65). There was no significant variability in the overall score between the users (P=0.1104) or in the difference between their highest and lowest score (P=0.3878). Highly significant differences between tasks were shown both in the overall score (P=0.0001) and in the difference between highest and lowest score (P=0.003). CONCLUSION: This study, which is the first to quantify reproducibility of performance in entry level trainees using a VR tool, demonstrated significant intra-novice variability. The cohort of subjects performed equally overall in the range of tasks (no inter-novice variability) but each showed that performance varies significantly with the complexity of the task when using this high-fidelity instrument.

Ophthalmic surgery simulator training improves resident performance of capsulorhexis in the operating room.

PURPOSE: To assess the effect of a Capsulorhexis Intensive Training Curriculum (CITC) on the rates of errant, continuous, curvilinear capsulorhexes (CCCs) during cataract surgery among resident surgeons at a teaching hospital. DESIGN: Retrospective educational interventional case series. PARTICIPANTS AND CONTROLS: A total of 1037 consecutive cataract surgeries performed at Harbor-UCLA Medical Center during 4 consecutive academic years were considered. The baseline cohort consists of 434 cataract surgeries performed during the 2 academic years before the intervention. The postintervention cohort consists of 603 cataract surgeries performed during the following 2 consecutive academic years. INTERVENTION: The principal intervention was the introduction of the CITC for residents on the Eyesi (VRmagic, Mannheim, Germany) ophthalmic virtual reality surgical simulator. MAIN OUTCOME MEASURES: The main outcome measure was the rate of errant CCCs among the capsulorhexes performed during resident surgical cases. Errant CCCs were defined as attempted CCCs that resulted in the attending physician taking over, radialization of the CCC, conversion to can-opener capsulorhexis, or any combination of the 3 aforementioned conditions. Secondary measures included the use of trypan blue during CCC and correlating errant CCC and surgeons' level of training (postgraduate year [PGY]). RESULTS: There were 68 errant CCCs (15.7%) in the baseline cohort and 30 errant CCCs (5.0%; P<0.0001) in the postintervention cohort, a 3.2-fold or 68% reduction. The use of trypan blue increased from 55.3% in the baseline cohort to 76.0% in the postintervention cohort (P<0.00001), but within each cohort there was no significant difference in the rate of errant CCCs whether trypan blue was used or not. In the baseline cohort, there was a statistical trend toward fewer errant CCCs among PGY 4 (14.6%) compared with PGY 3 (22.8%) surgeons (P = 0.12). The postintervention cohort showed no significant difference in errant CCC rates between PGY 3 (4.4%) and PGY 4 (5.1%) surgeons (P = 1.00). CONCLUSIONS: This study strongly suggests that virtual reality surgical simulation training with the CITC on the Eyesi reduces the rate of errant capsulorhexes. The incorporation of a formal program for surgical training via virtual reality simulation should be strongly considered in ophthalmology resident surgical education to reduce the unnecessary risk of complications for live patients.

The international forum of ophthalmic simulation: developing a virtual reality training curriculum for ophthalmology.

BACKGROUND: To investigate the effect of a structured, supervised, cataract simulation programme on ophthalmic surgeons in their first year of training, and to evaluate the level of skill transfer. METHODS: Trainees with minimal intraocular and simulator experience in their first year of ophthalmology undertook a structured, sequential, customised, virtual reality (VR) cataract training programme developed through the International Forum of Ophthalmic Simulation. A set of one-handed, bimanual, static and dynamic tasks were evaluated before and after the course and scores obtained. Statistical significance was evaluated with the Wilcoxon sign-rank test. RESULTS: The median precourse score of 101.50/400 (IQR 58.75-145.75) was significantly improved after completing the training programme ((postcourse score: 302/400, range: 266.25-343), p<0.001). While improvement was evident and found to be statistically significant in all parameters, greatest improvements were found for capsulorhexis and antitremor training ((Capsulorhexis: precourse score=0/100, range 0-4.5; postcourse score=81/100, range 13-87.75; p=0.002), (antitremor training: precourse score=0/100, range 0-0; postcourse score=80/100, range 60.25-91.50; p=0.001)). CONCLUSIONS: Structured and supervised VR training can offer a significant level of skills transfer to novice ophthalmic surgeons. VR training at the earliest stage of ophthalmic surgical training may, therefore, be of benefit.

Rabbit models for continuous curvilinear capsulorhexis instruction.

PURPOSE: To develop a rabbit model for continuous curvilinear capsulorhexis (CCC) instruction. SETTING: University of California San Francisco, San Francisco, California, USA. DESIGN: Experimental study. METHODS: Isolated rabbit lenses were immersed in 2% to 8% paraformaldehyde (PFA) fixative from 15 minutes to 6 hours. Rabbit eyes were treated by substituting aqueous with 2% to 4% PFA for 30 minutes to 6 hours, followed by washes with a balanced salt solution. Treated lenses and eyes were held in purpose-designed holders using vacuum. A panel of 6 cataract surgeons with 5 to 15 years of experience performed CCC on treated lenses and eyes and responded to a questionnaire regarding the utility of these models for resident teaching using a 5-item Likert scale. RESULTS: The expert panel found that rabbit lenses treated with increasing amounts of fixative simulated CCC on human lens capsules from the third to the seventh decade of life. The panel also found fixative-treated rabbit eyes to simulate some of the experience of CCC within the human anterior chamber but noted a shallower anterior chamber depth, variation in pupil size, and corneal clouding under some treatment conditions. CONCLUSIONS: Experienced cataract surgeons who performed CCC on these rabbit models strongly agreed that isolated rabbit lenses treated with fixative provide a realistic simulation of CCC in human patients and that both models were useful tools for capsulorhexis instruction. Results indicate that rabbit lenses treated with 8% PFA for 15 minutes is a model with good fidelity for CCC training. FINANCIAL DISCLOSURE: No author has a financial or proprietary interest in any material or method mentioned.

Evaluating teaching methods of cataract surgery: validation of an evaluation tool for assessing surgical technique of capsulorhexis.

PURPOSE: To develop and assess the validity of an evaluation tool to quantitatively assess the capsulorhexis portion of cataract surgery performed by residents. SETTING: University of California at Los Angeles (UCLA), Department of Ophthalmology, Jules Stein Eye Institute, Los Angeles, California, USA. DESIGN: Masked prospective case series. METHODS: Ophthalmology faculty members at UCLA were surveyed and literature was reviewed to develop a grading tool comprising 12 questions to evaluate surgical technique, including 4 from the Global Rating Assessment of Skills in Intraocular Surgery and 2 from the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric. Video clips of continuous curvilinear capsulorhexis (CCC) performed by 2 postgraduate year (PGY) 3 residents, 2 PGY 4 residents, and 2 advanced surgeons were independently graded in a masked fashion by a 7-member faculty panel. RESULTS: Four questions had low interobserver variability and a significant correlation with surgical skill level (intraclass correlation coefficient >0.75; P<.05, analysis of variance; 42 observations). The 4 questions were visual Likert-scale questions grading flow of operation, set up for regrasp, commencement of flap and formation, and circular completion of the CCC. CONCLUSIONS: Surgical performance can be validly measured using an evaluation tool. However, not all evaluation questions produced reliable results. The reliability and accuracy of the measurements appear to depend on the form and content of the question. Studies to optimize assessment tools identifying the best questions for evaluating each step of cataract surgery may help ophthalmic educators more precisely measure outcomes for improving teaching interventions. FINANCIAL DISCLOSURE: No author has a financial or proprietary interest in any material or method mentioned.