A quality assessment of YouTube as an information resource for tonsillectomy.

PURPOSE: Online resources are increasingly being utilised by patients to guide their clinical decision making, as an alternative or supplement to the traditional clinical-patient relationship. YouTube is an online repository of user and community generated videos, which is one of the most popular websites globally. We undertook a study to examine the quality of information presented in YouTube videos related to tonsillectomy. METHODS: We completed a systematic search of YouTube in May 2023 and identified 88 videos for inclusion in our study. Videos were published in the English language, focussing on tonsillectomy and tonsillectomy recovery, and were greater than 2 min in length. We recorded video quality metrics and two authors independently analysed the quality of information using three validated quality assessment tools described in the literature including the modified DISCERN, Global Quality Score, and the JAMA Benchmark Criteria. RESULTS: The overall quality of the information was low with mean quality scores of Modified DISCERN (1.8 ± 1.3), GQS (2.6 ± 1.2), and JAMA Benchmark Criteria (1.6 ± 0.7). Information published by medical sources including medical professionals, healthcare organisations, and medical education channels scored significantly higher compared to non-medical sources across all quality measures and were of moderate overall quality and usefulness: Modified DISCERN (2.5 ± 1.1 vs 0.8 ± 0.9, z = -6.0, p < 0.001), GQS (3.2 ± 1.0 vs 1.7 ± 0.9, z = -5.7, p < 0.001), and JAMA (1.9 ± 0.8 vs 1.1 ± 0.3, z = -5.2, p < 0.001). Videos published during or after 2018 scored higher on Modified DISCERN (z = -3.2,p = 0.001) but not on GQS or JAMA. Video quality metrics such as total view count, likes, and comments, and channel subscriber count, did not correlate with higher video quality. However, amongst videos published by authoritative medical sources, total view count correlated positively with higher Modified DISCERN quality scores (p = 0.037). CONCLUSION: The overall quality and usefulness of YouTube videos on tonsillectomy is of low quality, but information published by authoritative medical sources score significantly higher. Clinicians should be mindful of increasing use of online information sources such as YouTube when counselling patients. Further research is needed in the medical community to create engaging, high-quality content to provide guidance for patients.

Validation of an Objective Assessment Tool for Tonsillectomy in Otolaryngology Resident Training.

OBJECTIVE: Create and validate an objective structured assessment of technical skills (OSATS) for otolaryngology residents learning how to perform a tonsillectomy. STUDY DESIGN: Multicenter prospective longitudinal validation study. METHODS: A multi-institutional study at six tertiary academic otolaryngology residency programs from July 2009 to May 2012. Using the modified Delphi technique, a panel of pediatric otolaryngologists created a tonsillectomy task-based checklist (TBC) for a tonsil OSATS using a 5-point Likert-type scale. Residents were assessed by pediatric otolaryngology staff at the time of surgery with the TBC and a global rating scale. Procedure time, patient age, number of previously performed tonsillectomies, and surgical technique were also collected. RESULTS: One hundred sixty-seven tonsil OSATS were completed for 38 residents, and competency was recorded for 99 (59.2%). Residents scored as competent had performed significantly more previous tonsillectomies than those deemed noncompetent, 44.4 ± 35.6 and 13.5 ± 11.6, respectively (P < .001). The mean overall score on the tonsil TBC was 4.0 ± 0.8 and 2.6 ± 1.0 for competent and noncompetent, respectively (P < .001). Higher number of tonsillectomies performed and mean tonsil TBC score significantly increased the likelihood of competency (P < .001). Each additional tonsillectomy performed increased the likelihood of achieving competency by 6.3% (P = .006, 95% confidence interval (CI): 1.330-1.110), and each 1.0 point increase in mean tonsil TBC score increased the likelihood of competency by a factor of 2.71 (P = .006, 95% CI:1.330-5.513). There is a 95% likelihood of competency at 48 tonsillectomies or a tonsil TBC score of 4.91. CONCLUSION: The tonsil OSATS is a valid and feasible instrument to assess resident competency with tonsillectomy and provides timely objective feedback. LEVEL OF EVIDENCE: 4. Laryngoscope, 131:E359-E366, 2021.

Can Tonsillectomy Be Safely Performed by Residents? A Comparative Retrospective Study.

OBJECTIVE: To assess whether a surgeon's level of training is associated with outcomes in pediatric tonsillectomy. DESIGN: A retrospective cohort study of the outcomes of pediatric tonsillectomies performed between 2006 and 2016 by senior surgeons versus resident surgeons under the supervision of senior surgeons. SETTING: An otolaryngology department in a tertiary academic hospital. PATIENTS: Children younger than 18 years who underwent bilateral tonsillectomy with or without adenoidectomy. MAIN OUTCOME MEASURES: Intraoperative bleeding, initiation of oral intake, and intraoperative and postoperative complications. RESULTS: Of 785 children, 397 (50.5%) were operated on by a resident surgeon and 388 (49.5%) by a senior surgeon. Patient demographics and surgical techniques were similar between the groups. The mean surgical time was 33.2 minutes in the residents' group and 27.1 minutes in the seniors' group (P = .032). The groups were similar in intraoperative bleeding, while same-day initiation of oral intake was 71% for children in the residents' group versus 61% in the seniors' group (P = .28). Reports of postoperative bleeding necessitating readmission and revised operations were similar for both groups (3.0% and 0.7%, respectively, in the residents' group; and 2.5% and 1.0%, respectively, in the seniors' group). CONCLUSION: Children undergoing tonsillectomy showed similar short-term outcomes, whether the operations were performed by a senior surgeon or a resident surgeon supervised by an attending surgeon. This study demonstrates the safety of pediatric tonsillectomy performed by resident surgeons supervised by attending physicians.

The use of video glasses improved learning of tonsillectomy and adenoidectomy surgery: A randomized controlled trial.

OBJECTIVE: One of the most common challenges in surgical education for trainees is gaining practical experience through observing procedures in the operating room. Due to the nature of some procedures, a narrow surgical view severely limits the learning experience. Video glasses are new devices that offer the potential to project the primary surgeon's exact view to learners in real-time, allowing for an enhanced operative learning experience. STUDY DESIGN: Single center randomized prospective trial. SETTING: Tertiary care pediatric hospital. PARTICIPANTS: Using block randomization, medical students and surgical residents observed either a tonsillectomy or adenoidectomy, either directly at table-side or by real-time video feed from the surgeon's video glasses projected to a screen in the operating room, in random order. Participants then completed a survey comparing aspects of their learning experience viewing the procedure through the video feed in comparison to direct observation. MAIN OUTCOME MEASURES: Evaluating the hypothesis that video glasses provided an improved overall learning experience and a realistic simulation of the open surgical procedures tested. RESULTS: 23 trainees participated in the study. Survey results demonstrated that the overall learning experience with the use of video glasses was significantly improved when compared to direct visualization (average Visual Analog Scale (VAS) score 82/100 vs. 64/100, p = 0.021). Video glasses were shown to be superior when comparing the view of the surgical field (83/100 vs. 54/100 on VAS, p < 0.001) and the ability to identify anatomical structures (79/100 vs. 56/100 on VAS, p = 0.001). The ease of following surgical steps with video glasses was also shown to be better than by direct visualization (81/100 vs. 69/100 on VAS, p = 0.039). All participants stated that video glasses closely simulated the learning environment of the real-life open procedure. CONCLUSION: This study showed that the use of video glasses was beneficial for surgical education and a realistic tool for learners at varying levels of training. Video glasses may significantly improve the learning experience for procedures with a narrow field of view.

The coblation tonsillectomy learning curve.

OBJECTIVE: To establish if there is a learning curve for coblation tonsillectomy. STUDY DESIGN: Regression analysis of data obtained from surgeons identified from the Australian Tonsillectomy Survey. SUBJECTS AND METHODS: Thirty otolaryngologists were invited to contribute audit data. Data were stratified into groups of 10 procedures and analysed with regression analysis. RESULTS: Nineteen (70%) surgeons responded. Complete data were obtained for 1700 cases and return to theatre data on 2062 cases. There was a significant learning curve with respect to both primary (P = 0.050) and secondary (P = 0.028) hemorrhage rates. Mean rates were 0.3% (95% CI 0.1% to 0.7%) and 2.1% (95% CI 1.5% to 2.9%) for primary and secondary bleeds, respectively, with return to theatre in 0.2% (95% CI 0.1% to 0.5%) and 1.3% (95% CI 0.9% to 1.9%), respectively. CONCLUSION: The introduction of coblation tonsillectomy into Australia was associated with a statistically significant learning curve with respect to both primary and secondary hemorrhage rates.

Assessment of progress and competence in tonsillectomy surgery using cumulative sum analysis.

OBJECTIVE: To assess the feasibility of using cumulative sum analysis to show trainees' performance curves and highlight concerns in tonsillectomy surgery. METHODS: In this prospective study, the performance of eight otolaryngology trainees (in their first 6-12 months in the specialty) was compared to that of experts (over 150 tonsillectomies performed) in terms of operative time and post-operative complications. Cumulative sum analysis curves were generated to highlight trainees' performance, and were updated after each performance. RESULTS: The average operative time was 23 minutes (standard deviation = 11) for experts and 38 minutes (standard deviation = 16) for trainees (p < 0.0001). Cumulative sum analysis charts for trainees' operative time initially rose and then started to plateau after a number of cases (range, 25-30), while that of experts remained low. Cumulative sum analysis charts for complications can be used to monitor performance. In this study, complications were combined (because of low incidence) to allow use of this outcome measure. CONCLUSION: The flexibility of the cumulative sum analysis makes it adaptable to any outcome. It is a strong adjunct in surgical training to monitor progress and competence. Its sensitivity also allows early detection of poor performance, to instigate intervention.

Learning curve of tonsillectomy.

OBJECTIVE: To determine the time required to sufficiently educate a well-trained surgeon to perform tonsillectomy. MATERIAL AND METHODS: From July 1, 2000 to June 30, 2008, we analyzed 110 patients who underwent bilateral tonsillectomy. All the procedures were performed by 16 ENT surgeons trained in the same tertiary referral medical center during their residency. This training included a 4-year training program before 2002, and a 5-year training program thereafter. We stratified the patients into groups according to each surgeon's residency year at the time the operations were performed. Operation time, estimated blood loss and length of hospital stay of these patients were compared by the surgeon's residency year and by different training program of residency. RESULTS: There was a trend of decreased operation time in the senior year of residency, especially for 5th year surgeons, without reaching statistical significance. When comparing different training program, the operation time was statistically shorter in the 5-year training program than in the 4-year training program. However, no difference was noted in estimated blood loss and hospital stay length. CONCLUSION: The operation time of residents in the 5-year training program was shorter than that of residents in the 4-year training program, which implies that extending the training program by one year may improve the quality of training.

Quality and readability of websites for patient information on tonsillectomy and sleep apnea.

OBJECTIVES: Tonsillectomy is a common treatment for obstructive sleep apnea (OSA). The Internet allows patients direct access to medical information. Since information on the Internet is largely unregulated, quality and readability are variable. This study evaluates the quality and readability of the most likely visited websites presenting information on sleep apnea and tonsillectomy. METHODS: The three most popular search engines (Google, Bing, Yahoo) were queried with the phrase "sleep apnea AND tonsillectomy." The DISCERN instrument was used to assess quality of information. Readability was evaluated using the Flesch-Kincaid Reading Grade Level (FKGL) and Flesch Reading Ease Score (FRES). RESULTS: Out of the maximum of 80, the average DISCERN quality score for the websites was 55.1 (SD- 12.3, Median- 60.5). The mean score for FRES was 42.3 (SD- 15.9, Median- 45.5), which falls in the range defined as difficult. No website was above the optimal score of 65. The mean score for the FKGL was US grade-level of 10.7 (SD- 1.6, Median- 11.6). Only 4(27%) websites were in the optimal range of 6-8. There was very weak correlation between FRES and DISCERN (r = 0.07) and FKGL and DISCERN (r = 0.21). CONCLUSIONS: Tonsillectomy is one of the most common surgeries in the US. However, the internet information readily available to patients varies in quality. Additionally, much of the information is above the recommended grade level for comprehension by the public. By being aware of what information patients are reading online, physicians can better explain treatments and address misunderstandings. Physicians may consider using similar methods to test the readability for their own resources for patient education.

Experience is more important than technology in paediatric post-tonsillectomy bleeding.

BACKGROUND: Paediatric tonsillectomy is a common procedure and one of the first skills acquired by surgical trainees. Post-tonsillectomy bleeding is one of the most significant complications. This study examined post-tonsillectomy bleed rates associated with technology and level of surgical experience. METHODS: Data were collected on all tonsillectomies performed by surgical consultants (n = 6) and trainees (n = 10) at affiliated hospitals over a nine-month period. Hospital records were audited for post-tonsillectomy bleeding re-admissions and returns to the operating theatre. RESULTS: A total of 1396 tonsillectomies were performed (279 by trainees, 1117 by consultant surgeons). Primary post-tonsillectomy bleed rates were equivalent between trainees and consultants. Secondary bleed rates were significantly greater for trainees (10.0 per cent) compared to consultants (3.3 per cent), as were return to operating theatre rates (2.5 per cent vs 0.7 per cent). Amongst consultants, technology used was not associated with differences in secondary post-tonsillectomy bleeding and returns to the operating theatre. CONCLUSION: Our data suggest that experience of the surgeon may have greater bearing on post-tonsillectomy bleed rates than the technology used.

Utilization of a postoperative adenotonsillectomy teaching video: A pilot study.

BACKGROUND: Pediatric tonsillectomies are increasingly being performed as an outpatient procedure thereby increasing the parental role in post-operative pain management. However, it is unclear if parents receive adequate teaching regarding pain management. We introduced a video teaching tool and compared its efficacy alone and in combination with the standard verbal instruction. METHODS: A prospective study which randomized parents or caregivers of children undergoing tonsillectomy ± adenoidectomy into three groups: 1) standard verbal post-operative instructions; 2) watching the video teaching tool along with standard verbal instructions or 3) video teaching tool only. Parents completed pre and post-instruction assessments of their knowledge of post-operative pain management with responses scored from 0 to 8. Telephone assessments were conducted within 48 post-operative hours with a subjective rating of the helpfulness of the video teaching tool. RESULTS: The study cohort included 99 patients and their families. The median pre-instruction score was 5 of 8 points (Interquartile range [IQR]: 4, 6) and this remained at 5 following instruction. (IQR:4, 6; p = 0.702 difference from baseline). Baseline scores did not vary across the groups (p = 0.156) and there was no increase in the knowledge score from pre to post-test across the three groups. Groups B and C rated the helpfulness of the video teaching tool with a median score of 4 of 5. (IQR: 4, 5). CONCLUSIONS: A baseline deficit exists in parental understanding of post-operative pain management that did not statistically improve regardless of the form post-operative instruction used (verbal vs. video-based instruction). However, the high helpfulness scores in both video groups support the use of video instruction as an alternative to or to complement to verbal instruction. However, further identification of knowledge deficits is required for optimization of post-operative educational materials.

Implementation of a comprehensive competency-based transoral robotic surgery training curriculum with ex vivo dissection models.

BACKGROUND: Despite its increasingly widespread adoption of transoral robotic surgery (TORS), there is still no uniform training curriculum. The purpose of this study was to describe the results of our novel TORS curriculum training program in which we introduce ex vivo dissection models for radical tonsillectomy and base of tongue (BOT) resections. METHODS: Prospective blinded data collection and objective assessment of a novel training curriculum. Trainee performance was evaluated on objective structured assessments of technical skills (OSATS) metrics, measured resection time, and margin analysis. Additionally, 4 expert TORS surgeons completed the ex vivo dissections. RESULTS: Trainees achieved OSATS scores similar to those of experts in both the BOT resection and radical tonsillectomy models. Peripheral and deep surgical margin measurements in the BOT model were significantly improved after training and were comparable to experts. CONCLUSION: This graduated curriculum provides a realistic training experience to develop competency with oropharyngeal resections before transition to the operating room. © 2016 Wiley Periodicals, Inc. Head Neck 38: First-1563, 2016.

YouTube as an information source for pediatric adenotonsillectomy and ear tube surgery.

OBJECTIVES: Assess the overall quality of information on adenotonsillectomy and ear tube surgery presented on YouTube (www.youtube.com) from the perspective of a parent or patient searching for information on surgery. METHODS: The YouTube website was systematically searched on select dates with a formal search strategy to identify videos pertaining to pediatric adenotonsillectomy and ear tube surgery. Only videos with at least 5 (ear tube surgery) or 10 (adenotonsillectomy) views per day were included. Each video was viewed and scored by two independent scorers. Videos were categorized by goal and scored for video/audio quality, accuracy, comprehensiveness, and procedure-specific content. STUDY DESIGN: Cross-sectional study. SETTING: Public domain website. RESULTS: Fifty-five videos were scored for adenotonsillectomy and forty-seven for ear tube surgery. The most common category was educational (65.3%) followed by testimonial (28.4%), and news program (9.8%). Testimonials were more common for adenotonsillectomy than ear tube surgery (41.8% vs. 12.8%, p=0.001). Testimonials had a significantly lower mean accuracy (2.23 vs. 2.62, p=0.02), comprehensiveness (1.71 vs. 2.22, p=0.007), and TA specific content (0.64 vs. 1.69, p=0.001) score than educational type videos. Only six videos (5.9%) received high scores in both video/audio quality and accuracy/comprehensiveness of content. There was no significant association between the accuracy and comprehensive score and views, posted "likes", posted "dislikes", and likes/dislikes ratio. There was an association between "likes" and mean video quality (Spearman's rho=0.262, p=0.008). CONCLUSION: Parents/patients searching YouTube for information on pediatric adenotonsillectomy and ear tube surgery will generally encounter low quality information with testimonials being common but of significantly lower quality. Viewer perceived quality ("likes") did not correlate to formally scored content quality.

Tonsil tie simulator.

BACKGROUND: The surgical trainee has to acquire surgical skills in an era of reduced training hours and greater demands for efficient use of operating theatre time. Many surgical specialties are utilising model and simulation-based training to provide safe, low-pressure training opportunities for today's trainee. METHOD AND RESULTS: This paper describes a simple, relatively inexpensive tonsillectomy model that enables the practice of tonsil removal and ligation of bleeding vessels. The model is beneficial for the patient, trainee and trainer. CONCLUSION: The pseudo mouth and active bleeding components of this model provide the trainee with a relatively inexpensive, realistic model with which to gain confidence and competence in the skill of ligating tonsillar blood vessels with a tonsil tie.

Assessment of improvement of trainee surgical skills in the operating room for tonsillectomy.

OBJECTIVES/HYPOTHESIS: To determine the feasibility, reliability, and validity of an objective surgical assessment tool designed to measure the development of tonsillectomy skills by resident trainees in the operating room. A tonsillectomy evaluation instrument created previously serves as a basis for this tool, which incorporates many similar concepts but was optimized to maximize feasibility and reliability with simplified anchors and inclusion of global and task-specific sections. STUDY DESIGN: Prospective longitudinal validation study. METHODS: Faculty input via modified Delphi technique was used to develop a new objective structured assessment of technical skills-based instrument for tonsillectomy. The task-specific checklist (TSC) and global rating scale (GRS) measured tonsillectomy technical skills and overall surgical performance, respectively. Twenty-one otolaryngology-head and neck residents (ranging from postgraduate year 1 to 6) were evaluated for a period of 3 years by 11 faculty members. RESULTS: Eighty-three evaluations were completed showing strong correlation between both instruments (r = 0.95, P < .001). Our tool demonstrated construct validity for both TSC and GRS, showing higher scores with increasing surgical experience. Both instruments showed high interitem reliability with Cronbach α coefficients of 0.97 for both parts. CONCLUSIONS: This assessment tool is a feasible, reliable, and valid instrument for the assessment of surgical competency in tonsillectomy. It is effective in providing structured feedback at the end of each procedure, which encourages specific, targeted development.