Convolutional Neural Network-Based Deep Learning Engine for Mastoidectomy Instrument Recognition and Movement Tracking.

OBJECTIVE: To develop a convolutional neural network-based computer vision model to recognize and track 2 mastoidectomy surgical instruments-the drill and the suction-irrigator-from intraoperative video recordings of mastoidectomies. STUDY DESIGN: Technological development and model validation. SETTING: Academic center. METHODS: Ten 1-minute videos of mastoidectomies done for cochlear implantation by varying levels of resident surgeons were collected. For each video, containing 900 frames, an open-access computer vision annotation tool was used to annotate the drill and suction-irrigator class images with bounding boxes. A mastoidectomy instrument tracking module, which extracts the center coordinates of bounding boxes, was developed using a feature pyramid network and layered with DETECTRON, an open-access faster-region-based convolutional neural network. Eight videos were used to train the model, and 2 videos were used for testing. Outcome measures included Intersection over Union (IoU) ratio, accuracy, and average precision. RESULTS: For an IoU of 0.5, the mean average precision for the drill was 99% and 86% for the suction-irrigator. The model proved capable of generating maps of drill and suction-irrigator stroke direction and distance for the entirety of each video. CONCLUSIONS: This computer vision model can identify and track the drill and suction-irrigator from videos of intraoperative mastoidectomies performed by residents with excellent precision. It can now be employed to retrospectively study objective mastoidectomy measures of expert and resident surgeons, such as drill and suction-irrigator stroke concentration, economy of motion, speed, and coordination, setting the stage for characterization of objective expectations for safe and efficient mastoidectomies.

Comparison of tympanometric volume measurement with temporal bone CT findings in the assessment of mastoid bone pneumatization in chronic otitis media patients.

OBJECTIVE: Since mastoid bone aeration is a pressure buffer for the middle ear, it can be accepted as a prognostic factor for tympanoplasty. Temporal bone computed tomography (TBCT) is a primary method for estimating mastoid aeration. However, due to the risk of radiation and its high cost, there is a need for a more straightforward, faster, and more reliable method in non-complicated chronic otitis media cases (COM). Tympanometric volume measurement might be used for this purpose. This study investigated tympanometric volume measurement's reliability in showing mastoid bone aeration by comparing tympanometric volume measurement with TBCT aeration grading. PATIENTS AND METHODS: Preoperative tympanometric volume measurements were performed in patients who underwent audiological examination and temporal computerized tomography (CT) with the diagnosis of COM and sequela of COM without discharge for the last three months and were indicated for surgery. CT was classified into six grades: grade 0: there is no aeration, sclerotic mastoid; grade 1: pneumatization only in the mastoid antrum; grade 2: <25% pneumatization; grade 3: 25-50% pneumatization; grade 4: >50 pneumatization, grade 5: full pneumatization. Averages of tympanometric volume values were determined according to CT degrees. RESULTS: 48 left and 52 right ears (n: 100) of 81 patients, 24 females and 57 males, were included in the study. The mean age was 37.69±13.38. Mastoid pneumatization grades of patients were 32 grade 0, 23 grade 1, 16 grade 2, 14 grade 3, 11 grade 4, and 4 grade 5, respectively. Each grade's mean tympanometric volume (mL) was grade 0: 1.1594, grade 1: 1.6991, grade 2: 2.2250, grade 3: 3.0471, grade 4: 4.0327, and grade 5: 2.9775. CONCLUSIONS: There is a statistically significant relationship between tympanometrically measured ear volume and mastoid degrees of pneumatization on temporal bone tomography. As the degree of mastoid aeration increases, the tympanometric volume also increases. According to the results of this study, tympanometric air volume can be used reliably in the preoperative evaluation of mastoid bone aeration in cases of simple COM without ear drainage.

Am I doing this right? Structured self-assessment during simulation training of mastoidectomy improves cadaver dissection performance: a prospective educational study.

PURPOSE: Temporal bone surgery requires excellent surgical skills and simulation-based training can aid novices' skills acquisition. However, simulation-based training is challenged by early stagnation of performance after few performances. Structured self-assessment during practice might enhance learning by inducing reflection and engagement in the learning task. In this study, structured self-assessment was introduced during virtual reality (VR) simulation of mastoidectomy to investigate the effects on subsequent performance during cadaveric dissection. METHODS: A prospective educational study with comparison with historical controls (reference cohort). At a temporal bone dissection course, eighteen participants performed structured self-assessment during 3 h of VR simulation mastoidectomy training before proceeding to cadaver dissection (intervention cohort). At a previous course, eighteen participants received identical VR simulation training but without the structured self-assessment (reference cohort). Final products from VR simulation and cadaveric dissection were recorded and assessed by two blinded raters using a 19-point modified Welling Scale. RESULTS: The intervention cohort completed fewer procedures (average 4.2) during VR simulation training than the reference cohort (average 5.7). Nevertheless, the intervention cohort achieved a significantly higher average performance score both in VR simulation (11.1 points, 95% CI [10.6-11.5]) and subsequent cadaveric dissection (11.8 points, 95% CI [10.7-12.8]) compared with the reference cohort, who scored 9.1 points (95% CI [8.7-9.5]) during VR simulation and 5.8 points (95% CI [4.8-6.8]) during cadaveric dissection. CONCLUSIONS: Structured self-assessment is a valuable learning support during self-directed VR simulation training of mastoidectomy and the positive effect on performance transfers to subsequent cadaveric dissection performance.

Prevalence and surgical management of cholesteatoma in Down Syndrome children.

OBJECTIVE: The objective was to report the outcomes of surgical management of cholesteatoma in Down Syndrome (DS) children and to determine the prevalence of cholesteatoma in DS children at three academic tertiary care centers. METHODS: A retrospective chart review was performed of all DS children diagnosed with cholesteatoma from three tertiary care academic centers. Demographic data, comorbidities, imaging findings, surgical management, and pre- and postoperative pure tone averages were collected. RESULTS: The prevalence of cholesteatoma in DS patients at these three institutions was calculated to be 8/802 (0.998%), 4/448 (0.893%), and 4/1016 (0.394%), with an average prevalence of 0.762%. Of the 16 patients with cholesteatoma identified, the average age of diagnosis was 10.8 years, and 5/16 (31%) had at least three sets of pressure equalizing tubes (PETs) placed. Of the 13 patients with preoperative CTs, 4/13 (30.8%) had blunting of the scutum, 4/13 (30.8%) had tegmen involvement, 1/13 (7.7%) had erosion of the semicircular canal, 2/13 had facial nerve dehiscence, and 7/13 (53.8%) had ossicular chain erosion. For surgical management, disease control was attained in 4/16 children with tympanoplasty only and canal wall up (CWU) tympanomastoidectomy in 11/16 patients. Available pre- and postoperative audiograms were evaluated; however, there was insufficient audiological data to contribute to outcomes. CONCLUSION: Cholesteatoma occurs in nearly 1% of DS patients, and the disease tends to be advanced with tegmen involvement in nearly a third of patients, and ossicular erosion seen in more than half the patients. A CWU procedure can be successful in managing DS patients with cholesteatoma when consistent long term follow-up is planned. Close monitoring and a high index of suspicion for cholesteatoma are essential to prevent delays in diagnosis and treatment of DS patients with a history of multiple sets of PET placement.

Postoperative radiological assessment of the mastoid facial canal in cochlear implant patients in correlation with facial nerve stimulation.

OBJECTIVES: To correlate the radiological assessment of the mastoid facial canal in postoperative cochlear implant (CI) cone-beam CT (CBCT) and other possible contributing clinical or implant-related factors with postoperative facial nerve stimulation (FNS) occurrence. METHODS: Two experienced radiologists evaluated retrospectively 215 postoperative post-CI CBCT examinations. The mastoid facial canal diameter, wall thickness, distance between the electrode cable and mastoid facial canal, and facial-chorda tympani angle were assessed. Additionally, the intracochlear position and the insertion angle and depth of electrodes were evaluated. Clinical data were analyzed for postoperative FNS within 1.5-year follow-up, CI type, onset, and causes for hearing loss such as otosclerosis, meningitis, and history of previous ear surgeries. Postoperative FNS was correlated with the measurements and clinical data using logistic regression. RESULTS: Within the study population (mean age: 56 ± 18 years), ten patients presented with FNS. The correlations between FNS and facial canal diameter (p = 0.09), wall thickness (p = 0.27), distance to CI cable (p = 0.44), and angle with chorda tympani (p = 0.75) were statistically non-significant. There were statistical significances for previous history of meningitis/encephalitis (p = 0.001), extracochlear-electrode-contacts (p = 0.002), scala-vestibuli position (p = 0.02), younger patients' age (p = 0.03), lateral-wall-electrode type (p = 0.04), and early/childhood onset hearing loss (p = 0.04). Histories of meningitis/encephalitis and extracochlear-electrode-contacts were included in the first two steps of the multivariate logistic regression. CONCLUSION: The mastoid-facial canal radiological assessment and the positional relationship with the CI electrode provide no predictor of postoperative FNS. Histories of meningitis/encephalitis and extracochlear-electrode-contacts are important risk factors. KEY POINTS: • Post-operative radiological assessment of the mastoid facial canal and the positional relationship with the CI electrode provide no predictor of post-cochlear implant facial nerve stimulation. • Radiological detection of extracochlear electrode contacts and the previous clinical history of meningitis/encephalitis are two important risk factors for postoperative facial nerve stimulation in cochlear implant patients. • The presence of scala vestibuli electrode insertion as well as the lateral wall electrode type, the younger patient's age, and early onset of SNHL can play important role in the prediction of post-cochlear implant facial nerve stimulation.

Projected Cost Simulation in Chronic Ear Surgery: Cost in Chronic Ear Surgery.

OBJECTIVE: To examine the projected healthcare costs of intact canal wall (ICW) and canal wall down (CWD) tympanomastoidectomy surgery and associated clinic follow-up visits in the management of chronic ear disease. STUDY DESIGN: A review of literature was performed to analyze the cholesteatoma recidivism rates of ICW and CWD tympanomastoidectomy. Projected Medicare cost simulation applied to representative samples of patients undergoing otologic surgery and follow-up clinic appointments projected over 15 years with an annual 25% cholesteatoma recidivism rate. SETTING: Tertiary academic center. PATIENTS: Simulated patient population status postchronic ear surgery and representative follow-up clinic visits with or without in-office mastoid debridement procedures. INTERVENTIONS: Therapeutic and rehabilitative. MAIN OUTCOME MEASURES: Healthcare cost. RESULTS: Simulation of cost for chronic ear surgery with follow-up visits produced a higher mean cost for the ICW group compared with the CWD group at year 1 ($9112.06 versus $4954.16). However, CWD patients accumulate cost over time due to routine mastoid debridements. The accumulated costs for the CWD group surpassed the ICW group at 12.54 (CI: 12.02-13.11) years. CONCLUSIONS: Using a projected cost analysis model, intact canal wall tympanomastoidectomy incurs a larger upfront cost than the canal wall down technique. However, long-term mastoid cavity maintenance costs accumulate to surpass the intact canal wall group at 12.54 years.

Endoscopic Assessment of the Isthmus Tympanicum and Tensor Tympani Fold and their Relationship with Mastoid Pneumatization in Chronic Otitis Media.

OBJECTIVES: To endoscopically evaluate the patency of the isthmus tympanicum and integrity of the tensor tympani fold as routes of ventilation of the attic and mastoid in chronic otitis media (COM) and to assess their effects on mastoid pneumatization. MATERIALS AND METHODS: Sixty patients with COM were categorized into two groups: (1) Group A: 36 patients with tympanic membrane perforation (2) Group B: 24 patients with limited attic disease of whom 14 patients had attic retraction pockets and 10 with limited attic cholesteatoma. A multislice computed tomography scan of the temporal bone was performed for each patient to assess the degree of mastoid pneumatization. Notably, either myringoplasty or tympanomastoid surgery was performed in all patients. An endoscope was inserted into the middle ear for evaluation of the isthmus tympanicum and tensor fold area. RESULTS: The isthmus tympanicum was patent in most ears (83.3%) of group A, whereas it was blocked in most ears (83.3%) of group B. The tensor fold was complete in 77.8% of ears in group A and 83.3% of ears in group B. It was observed that 94.1% of ears with patent isthmus in both groups had normal mastoid pneumatization and 5.9% of ears had poorly pneumatized mastoid. By contrast, 7.7% of ears with blocked isthmus tympanicum had normal mastoid pneumatization and 92.3% had poor mastoid pneumatization. Normal mastoid pneumatization was observed in 50% of ears in both groups with complete tensor fold, and 83.3% of ears with an incomplete tensor fold. CONCLUSION: A significant correlation was observed between COM with limited attic disease and obstruction of the isthmus tympanicum. Obstruction of isthmus tympanicum was associated with poor mastoid pneumatization. Furthermore, an incomplete tensor fold was associated with well pneumatized mastoid.

The effect of structured self-assessment in virtual reality simulation training of mastoidectomy.

PURPOSE: Virtual reality (VR) simulation surgical skills training is well established, but self-directed practice is often associated with a learning curve plateau. In this study, we investigate the effects of structured self-assessment as a means to improve performance in mastoidectomy training. METHODS: The study was a prospective, educational study. Two cohorts of novices (medical students) were recruited for practice of anatomical mastoidectomy in a training program with five distributed training blocks. Fifteen participants performed structured self-assessment after each procedure (intervention cohort). A reference cohort of another 14 participants served as controls. Performances were assessed by two blinded raters using a modified Welling Scale and simulator-recorded metrics. RESULTS: The self-assessment cohort performed superiorly to the reference cohort (mean difference of final product score 0.87 points, p = 0.001) and substantially reduced the number of repetitions needed. The self-assessment cohort also had more passing performances for the combined metrics-based score reflecting increased efficiency. Finally, the self-assessment cohort made fewer collisions compared with the reference cohort especially with the chorda tympani, the facial nerve, the incus, and the malleus. CONCLUSIONS: VR simulation training of surgical skills benefits from having learners perform structured self-assessment following each procedure as this increases performance, accelerates the learning curve thereby reducing time needed for training, and induces a safer performance with fewer collisions with critical structures. Structured self-assessment was in itself not sufficient to counter the learning curve plateau and for continued skills development additional supports for deliberate practice are needed.

Clinical Utility of Intraoperative Tympanomastoidectomy Assessment Using a Surgical Microscope Integrated with an Optical Coherence Tomography.

Significant technical and optical advances are required for intraoperative optical coherence tomography (OCT) to be utilized during otological surgeries. Integrating OCT with surgical microscopy makes it possible to evaluate soft tissue in real-time and at a high resolution. Herein, we describe an augmented-reality, intraoperative OCT/microscope system with an extended working distance of 280 mm, providing more space for surgical manipulation than conventional techniques. We initially performed ex vivo experiments to evaluate system performance. In addition, we validated the system by performing preliminary clinical assessments of tympanomastoidectomy outcomes in six patients with chronic otitis media. The system evaluated residual inflammation in the region-of-interest of the mastoid bone. Most importantly, the system intraoperatively revealed the connection between the graft and the remnant tympanic membrane. The extended working distance allows otological surgeons to evaluate the status of both the mastoid bone and tympanic membrane during manipulation, affording full intraoperative imaging.

Pressure dressings in mastoid and middle ear surgery: are they necessary? A retrospective review of patient outcomes.

BACKGROUND: The application of mastoid pressure dressings following mastoid and middle ear surgery is widely practised to reduce the risk of haematoma and seroma. There are a number of minor morbidities associated with use of the dressings, as well as a financial cost associated with an overnight stay in hospital or a return appointment for removal of the dressings. The benefit of having these dressings in situ overnight is questionable. METHODS: A retrospective review of 133 patients who had their mastoid dressing removed 2 h after their procedure was undertaken at our Hospital. The patient records were scanned for procedure-related morbidities, and perioperative data were analysed. RESULTS: No haematomas or seromas occurred in any of the 133 patients studied. Minor morbidities associated with prolonged use of mastoid pressure dressings were avoided. CONCLUSION: Removal of mastoid pressure dressings 2 h following ear surgery is safe and effective. Furthermore, a mastoid dressing should not be a factor in the decision as to whether to treat a patient as a day case or overnight admission.

Population Statistics Approach for Safety Assessment in Robotic Cochlear Implantation.

HYPOTHESIS: Descriptive statistics with respect to patient anatomy and image guidance accuracy can be used to assess the effectiveness of any system for minimally invasive cochlear implantation, on both an individual patient and wider population level. BACKGROUND: Minimally invasive cochlear implantation involves the drilling of a tunnel from the surface of the mastoid to cochlea, with the trajectory passing through the facial recess. The facial recess anatomy constrains the drilling path and places prohibitive accuracy requirements on the used system. Existing single thresholds are insufficient for assessing the effectiveness of these systems. METHODS: A statistical model of the anatomical situation encountered during minimally invasive drilling of the mastoid for cochlear implantation was developed. A literature review was performed to determine the statistical distribution of facial recess width; these values were confirmed through facial recess measurements on computed tomography (CT) data. Based on the accuracy of a robotic system developed by the authors, the effect of variation of system accuracy, precision, and tunnel diameter examined with respect to the potential treatable portion of the population. RESULTS: A facial recess diameter of 2.54 ±â€Š0.51 mm (n = 74) was determined from a review of existing literature; subsequent measurements on CT data revealed a facial recess diameter of 2.54 ±â€Š0.5 mm (n = 23). The developed model demonstrated the effects of varying accuracy on the treatable portion of the population. CONCLUSIONS: The presented model allows the assessment of the applicability of a system on a wider population scale beyond examining only the system's ability to reach an arbitrary threshold accuracy.

Performance Assessment for Mastoidectomy.

Objective The aim of this report is to provide a review of the current literature for assessment of performance for mastoidectomy, to identify the current assessment tools available in the literature, and to summarize the evidence for their validity. Data Sources The MEDLINE database was accessed via PubMed. Review Methods Inclusion criteria consisted of English-language published articles that reported use of a mastoidectomy performance assessment tool. Studies ranged from 2007 to November 2015 and were divided into 2 groups: intraoperative assessments and those performed with simulation (cadaveric laboratory or virtual reality). Studies that contained specific reliability analyses were also highlighted. For each publication, validity evidence data were analyzed and interpreted according to conceptual definitions provided in a recent systematic review on the modern framework of validity evidence. Conclusions Twenty-three studies were identified that met our inclusion criteria for review, including 4 intraoperative objective assessment studies, 5 cadaveric studies, 10 virtual reality simulation studies, and 4 that used both cadaveric assessment and virtual reality. Implications for Practice A review of the literature revealed a wide variety of mastoidectomy assessment tools and varying levels of reliability and validity evidence. The assessment tool developed at Johns Hopkins possesses the most validity evidence of those reviewed. However, a number of agreed-on specific metrics could be integrated into a standardized assessment instrument to be used nationally. A universally agreed-on assessment tool will provide a means for developing standardized benchmarks for performing mastoid surgery.

Therapeutic Mastoidectomy in the Management of Noncholesteatomatous Chronic Otitis Media: Literature Review and Cost Analysis.

OBJECTIVE: Despite evidence that therapeutic mastoidectomy does not improve outcomes in noncholesteatomatous chronic otitis media, it remains widely performed. An up-to-date systematic review is undertaken and conclusions drawn regarding the best evidence-based practice of its management. DATA SOURCES: PubMed, Google Scholar, Medline Embase, Cochrane, and Web of Science. REVIEW METHOD: A combination of the following words was used: chronic otitis media, chronic suppurative otitis media, COM, CSOM, mastoidectomy, tympanoplasty, atelectasis, retraction, tympanic perforation, and therapeutic. RESULTS: From 1742 studies, 7 were selected for full analysis with respect to the benefit of mastoidectomy in the management of active and inactive mucosal chronic otitis media. Most were retrospective studies, with 1 prospective randomized controlled trial available. Overall, there was no evidence to support routine mastoidectomy in conjunction with tympanoplasty in chronic otitis media. For ears with sclerotic mastoids, the evidence suggested that there may be some benefit as a staged procedure. Two studies were analyzed for the benefit of mastoidectomy in addition to tympanoplasty for the management of the atelectatic ear (inactive squamous chronic otitis media). The conclusion was also that mastoidectomy added no benefit. CONCLUSIONS: Examination of the available literature supports the notion that therapeutic mastoidectomy does not lend any additional benefit to the management of noncholesteatomatous chronic otitis media. This has implications for patient care, both clinically and financially. Further research, ideally in the form of a prospective, multi-institutional, geographically wide, ethnically diverse, randomized controlled trial, is needed to further support this notion.

The economic impact of revision otologic surgery.

Revision otologic surgery places a significant economic burden on patients and the healthcare system. We conducted a retrospective chart analysis to estimate the economic impact of revision canal-wall-down (CWD) mastoidectomy. We reviewed the medical records of all 189 adults who had undergone CWD mastoidectomy performed by the senior author between June 2006 and August 2011 at Loyola University Medical Center in Maywood, Ill. Institutional charges and collections for all patients were extrapolated to estimate the overall healthcare cost of revision surgery in Illinois and at the national level. Of the 189 CWD mastoidectomies, 89 were primary and 100 were revision procedures. The total charge for the revision cases was $2,783,700, and the net reimbursement (collections) was $846,289 (30.4%). Using Illinois Hospital Association data, we estimated that reimbursement for 387 revision CWD mastoidectomies that had been performed in fiscal year 2011 was nearly $3.3 million. By extrapolating our data to the national level, we estimated that 9,214 patients underwent revision CWD mastoidectomy in the United States during 2011, which cost the national healthcare system roughly $76 million, not including lost wages and productivity. Known causes of failed CWD mastoidectomies that often result in revision surgery include an inadequate meatoplasty, a facial ridge that is too high, residual diseased air cells, and recurrent cholesteatoma. A better understanding of these factors can reduce the need for revision surgery, which could have a positive impact on the economic strain related to this procedure at the local, state, and national levels.

Cost analysis and outcomes of a second-look tympanoplasty-mastoidectomy strategy for cholesteatoma.

OBJECTIVES/HYPOTHESIS: To analyze cost and compare cholesteatoma recidivism and hearing outcomes with single-stage and second-look operative strategies. STUDY DESIGN: Retrospective review and cost analysis. METHODS: Adult and pediatric patients who underwent a tympanoplasty with mastoidectomy for cholesteatoma with a single-stage or second-look operative strategy were identified. Variables included procedure approach, residual or recurrent cholesteatoma, ossicular chain reconstruction frequency, and operative complications. Audiologic outcomes included pre-/postoperative air bone gap (ABG) and word recognition score (WRS). Cost analysis included charges for consultation and follow-up visits, surgical procedures, computed tomography temporal bone scans, and audiology visits. RESULTS: One hundred and six patients had a tympanoplasty with mastoidectomy for cholesteatoma, with 80 canal wall-up procedures (CWU) as initial approach. Of these, 46 (57.5%) CWU patients had a planned second look. Two (4.3%) CWU patients had recurrent cholesteatoma and 20 (43.4%) had residual identified at second look. Four (11.7%) single-stage CWU strategy patients developed recurrent cholesteatoma. There was no significant difference in pre-/postoperative ABG and WRS between second look and single stage (P > 0.05). Compared to second-look patients, single-stage patients had significantly fewer postoperative visits (6.32 vs. 10.4; P = 0.007), and significantly lower overall charges for care ($23,529. vs. $41.411; P < 0.0001). CONCLUSION: The goal of cholesteatoma surgery is to produce a safe ear, and a second-look strategy after CWU has historically been used to evaluate for recurrent or residual disease. The cholesteatoma recurrence rate at a second look after a CWU tympanoplasty-mastoidectomy is low. Costs of operative procedures are a significant proportion of healthcare resource expenditures. Considering the low rate of cholesteatoma recurrence and relatively high cost of care, implementation of a second-look strategy should be individually tailored and not universally performed. LEVEL OF EVIDENCE: 4. Laryngoscope, 126:2574-2579, 2016.

Construct validity of cadaveric temporal bones for training and assessment in mastoidectomy.

OBJECTIVE: To determine the construct validity of cadaveric temporal bones in mastoidectomy training. STUDY DESIGN: A prospective observational study. METHODS: Trainees from the North London otolaryngology training program performed step-wise modified radical mastoidectomy on cadaveric temporal bones under faculty supervision. Performance was assessed using a validated mastoidectomy assessment tool. A longitudinal assessment of nine trainees was also carried out over two sessions separated by 12 months. The main outcomes measures were task-specific (TS) and global skills (GS). RESULTS: Twenty-six intermediate and eight novice trainees participated and were assessed by a minimum of two assessors each. Intermediate trainees performed significantly better than novices in TS and GS (P < 0.001). Performance correlated well with training level using Spearman rank correlation coefficient (r(s)) (TS r(s) 0.265 and GS r(s) 0.503). The number of otological procedures performed, and in particular mastoidectomies, correlated well with performance (TS r(s) 0.327 and GS r(s) 0.528). Longitudinal assessment showed significant improvement with iteration (TS P = 0.008 and GS P = 0.008). Attending otological courses also improved performance significantly (TS r(s) 0.345 and GS r(s) 0.469). CONCLUSIONS: The cadaveric temporal bone demonstrated construct validity and can be used to detect progress in performance of otolaryngology trainees. This is a keystone in moving toward a competency-based training system. LEVEL OF EVIDENCE: N/A.

Mastoidectomy performance assessment of virtual simulation training using final-product analysis.

OBJECTIVES/HYPOTHESIS: The future development of integrated automatic assessment in temporal bone virtual surgical simulators calls for validation against currently established assessment tools. This study aimed to explore the relationship between mastoidectomy final-product performance assessment in virtual simulation and traditional dissection training. STUDY DESIGN: Prospective trial with blinding. METHODS: A total of 34 novice residents performed a mastoidectomy on the Visible Ear Simulator and on a cadaveric temporal bone. Two blinded senior otologists assessed the final-product performance using a modified Welling scale. The simulator gathered basic metrics on time, steps, and volumes in relation to the on-screen tutorial and collisions with vital structures. RESULTS: Substantial inter-rater reliability (kappa = 0.77) for virtual simulation and moderate inter-rater reliability (kappa = 0.59) for dissection final-product assessment was found. The simulation and dissection performance scores had significant correlation (P = .014). None of the basic simulator metrics correlated significantly with the final-product score except for number of steps completed in the simulator. CONCLUSIONS: A modified version of a validated final-product performance assessment tool can be used to assess mastoidectomy on virtual temporal bones. Performance assessment of virtual mastoidectomy could potentially save the use of cadaveric temporal bones for more advanced training when a basic level of competency in simulation has been achieved. LEVEL OF EVIDENCE: NA.

The construct validity and reliability of an assessment tool for competency in cochlear implant surgery.

INTRODUCTION: We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. METHODS: Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos. RESULTS: Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components. CONCLUSION: Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

Patient information leaflet on mastoid surgery risks: assessment of readability and patient understanding.

INTRODUCTION: It is important that patients have a good understanding of surgery-related risks, particularly for mastoid surgery, which exposes patients to the risk of very serious complications, despite addressing conditions which often have only minor symptoms. MATERIALS AND METHODS: A patient information leaflet describing the risks of mastoid surgery was prepared. However, the Hospital Patient Advice and Liaison Services team thought it was too long and complicated. It was introduced unchanged. Fifty-four consecutive mastoidectomy patients were given a questionnaire asking for their opinion of the leaflet. The leaflet was also assessed with readability formulae and the Ensuring Quality Information for Patients tool. RESULTS AND ANALYSIS: Ninety-eight per cent of respondents thought the leaflet's writing style was easy to understand. The majority (96 per cent) thought the length was 'just right'. The 7 readability formulae used established readability at a grade 9 level (i.e. appropriate for a reading age of 13-15 years). The Ensuring Quality Information for Patients score was 87.5 per cent. DISCUSSION: Despite the drive to simplify patient information leaflets, quite detailed information is sometimes required. A style which is too simple may be perceived as patronising and may encourage patients to underestimate potential risks. It is important to ask patients their opinion.