Using Intraoperative Recordings to Evaluate Surgical Technique and Performance in Mastoidectomy.

Importance: Otolaryngology residency programs currently lack rigorous methods for assessing surgical skill and often rely on biased tools of evaluation. Objectives: To evaluate which techniques used in mastoidectomy can serve as indicators of surgeon level (defined as the level of training) and whether these determinations of technique can be made based solely on the movement of the drill head or suction. Design, Setting, and Participants: In this prospective, observational study conducted from January 1, 2015, to December 31, 2019, at a single tertiary care institution, 3 independent observers made blinded evaluations on 24 intraoperative recordings of surgeons (6 junior residents, 4 senior residents, and 2 attending surgeons) performing mastoidectomies. Main Outcomes and Measures: Observers assessed drill stroke count, drilling efficiency, stroke pattern, use of suction and irrigation, and estimated surgeon level. Assessments were made on both original videos and animated videos that show only the path of the burr head or suction as dots against a white background. Results: Among the 24 recorded mastoidectomies performed by the 12 study surgeons, intraclass correlation was excellent for original video assessment of drill stroke count (0.98 [95% CI, 0.97-1.00]), use of suction (0.75 [95% CI, 0.52-0.89]), use of irrigation (0.83 [95% CI, 0.66-0.92]), and estimated surgeon level (0.82 [95% CI, 0.64-0.92]) and fair for drilling efficiency (0.54 [95% CI, 0.09-0.79]) and stroke pattern (0.49 [95% CI, -0.02 to 0.76]). Intraclass correlation was excellent for animated video assessment of drill stroke count per unit time (0.98 [95% CI, 0.96-0.99]) and drilling efficiency (0.80 [95% CI, 0.60-0.91]), good for stroke pattern (0.68 [95% CI, 0.38-0.85]) and estimated surgeon level (based on path of drill) (0.69 [95% CI, 0.38-0.85]), and fair for use of suction (0.58 [95% CI, 0.16-0.80]) and estimated surgeon level (based on path of suction) (0.58 [95% CI, 0.17-0.80]). On evaluation of original videos, junior residents had lower drill stroke count compared with senior residents and attending surgeons (6.0 [interquartile range (IQR), 3.0-8.0] vs 9.5 [IQR, 5.0-13.0] vs 10.5 [IQR, 5.0-17.8]; η2 = 0.14 [95% CI, 0.01-0.28]). On evaluation of animated videos, junior residents also had lower drill stroke count compared with senior residents and attending surgeons (6.0 [IQR, 4.0-9.0] vs 10.5 [IQR, 10.0-13.8] vs 10.5 [IQR, 4.3-21.0]; η2 = 0.19 [95% CI, 0.04-0.33]). Compared with junior and senior residents, attending surgeons had higher median ratings of drilling efficiency (original videos: junior residents, 4.0 [IQR, 3.0-4.0]; senior residents, 4.0 [IQR, 3.0-4.8]; attending surgeons, 5.0 [IQR, 4.3-5.0]; η2 = 0.23 [95% CI, 0.06-0.37]; animated videos: junior residents, 4.0 [IQR, 3.0-4.0]; senior residents, 3.0 [IQR, 2.0-4.0]; attending surgeons, 5.0 [IQR, 4.0-5.0]; η2 = 0.25 [95% CI, 0.08-0.39]) and stroke pattern (original videos: junior residents, 4.0 [IQR, 3.0-4.0]; senior residents, 4.0 [IQR, 3.0-4.8]; attending surgeons, 5.0 [IQR, 5.0-5.0]; η2 = 0.17 [95% CI, 0.03-0.31]; animated videos: junior residents, 4.0 [IQR, 3.0-4.0]; senior residents, 4.0 [IQR, 2.0-4.0]; attending surgeons, 5.0 [IQR, 5.0-5.0]; η2 = 0.15 [95% CI, 0.02-0.29]). Conclusions and Relevance: This study suggests that observation of intraoperative mastoidectomy recordings is a feasible method of evaluating surgeon level. Reasonable indicators of surgeon level include the drill stroke count, drilling efficiency, stroke pattern, and use of the suction irrigator. Observing the path of the drill alone is sufficient to appreciate differences in drilling technique but not sufficient to accurately determine surgeon level. Intraoperative recordings can serve as a useful addition to resident education and evaluation.

Vitamin D Deficiency, Hypocalcemia, and Hearing Loss in Children.

OBJECTIVE: Characterize relations between vitamin D deficiency (VDD), hypocalcemia, and hearing loss (HL) in children. STUDY DESIGN: Retrospective review. SETTING: Tertiary referral hospital. PATIENTS: Children in the Audiological and Genetic Database with a diagnosis of VDD, rickets, or osteomalacia. INTERVENTION: None. MAIN OUTCOME MEASURES: Prevalence, type, severity (4-tone pure-tone average, PTA), and progression of HL. HL was defined as greater than 15 dB HL at any threshold by pure tone, greater than 20 dB HL by sound field audiometry, or greater than 25 dB in infants less than 1 year of age. RESULTS: Of 888 children with VDD, 474 (53.4%) had HL, with 17% having moderate-profound HL. Compared with an age-matched cohort of 13,320 children drawn from the same database, children with VDD were significantly more likely to have sensorineural HL (SNHL) (adjusted odds ratios [aOR] 1.26 [95% confidence interval [CI] 1.01-1.58]). Among children with VDD, children with femur fracture had a significantly higher rate of HL (81% versus 53%, p = 0.008) and children with hypocalcemia had a significantly higher rate of moderate-profound HL (36% versus 18%, p = 0.016). Additionally, hypocalcemia with and without VDD was associated with SNHL (aOR 2.30 [1.07-4.56]). CONCLUSIONS: Both vitamin D deficiency and hypocalcemia were found to be independently associated with SNHL, a type of HL that is less likely to improve over time. Recognition of VDD and hypocalcemia as independent risk factors for the development of SNHL could allow for better evaluation and treatment of this patient population. Routine audiological evaluation should be considered in this population.

Subjective vs Computerized Assessment of Surgeon Skill Level During Mastoidectomy.

This pilot study examines the use of surgical instrument tracking and motion analysis in objectively measuring surgical performance. Accuracy of objective measures in distinguishing between surgeons of different levels was compared to that of subjective assessments. Twenty-four intraoperative video clips of mastoidectomies performed by junior residents (n = 12), senior residents (n = 8), and faculty (n = 4) were sent to otolaryngology programs via survey, yielding 708 subjective ratings of surgical experience level. Tracking software captured the total distance traveled by the drill, suction irrigator, and patient's head. Measurements were used to predict surgeon level of training, and accuracy was estimated via area under the curve (AUC) of receiver operating characteristic curves. Key objective metrics proved more accurate than subjective evaluations in determining both faculty vs resident level and senior vs junior resident level. The findings of this study suggest that objective analysis using computer software has the potential to improve the accuracy of surgical skill assessment.

Impact of early gastroesophageal reflux disease on childhood otologic outcomes.

OBJECTIVE: Recent evidence has suggested that children with gastroesophageal reflux disease (GERD) face increased risk for otologic disease. This study aims to evaluate otologic outcomes in children with GERD using a large pediatric hearing database. METHODS: Data pertaining to children with GERD in the first year of life were extracted from the Audiological and Genetic Database. Subgroups included children with uncomplicated GERD, complicated GERD (with esophagitis), and GERD requiring surgery (fundoplication or fundoplasty). Main outcome measures included hearing loss (HL) prevalence, type, severity, and progression. Children without GERD in the first year of life served as controls. RESULTS: 5747 children were diagnosed with GERD in the first year of life. Evidence of HL was present in 40.9% children with uncomplicated GERD, 63.1% in children with complicated GERD, 75% in children with GERD requiring surgical intervention, and 43.3% in controls (p < 0.001). Children with GERD requiring surgery demonstrated the highest odds of developing any HL (aOR 3.02 [1.40-7.26]), moderate-to-profound HL (aOR 3.44 [1.56-7.29]), and mixed HL (aOR 4.58 [2.07-9.65]) relative to children with uncomplicated or complicated GERD. GERD requiring surgery was independently associated with Eustachian tube dysfunction (aOR 2.41 [1.17-5.20]) and tympanostomy tube placement (aOR 6.23 [3.05-13.01]). CONCLUSION: GERD diagnosed within the first year of life is associated with pediatric hearing impairment and otologic issues, including otitis media, Eustachian tube dysfunction, and need for tympanostomy tube placement. GERD requiring surgical intervention is particularly associated with hearing loss in this population. Children with GERD and HL deserve close audiologic follow-up.