Unintended consequences of technology in competency-based education: a qualitative study of lessons learned in an OtoHNS program.

BACKGROUND: Formative feedback and entrustment ratings on assessments of entrustable professional activities (EPAs) are intended to support learner self-regulation and inform entrustment decisions in competency-based medical education. Technology platforms have been developed to facilitate these goals, but little is known about their effects on these new assessment practices. This study investigates how users interacted with an e-portfolio in an OtoHNS surgery program transitioning to a Canadian approach to competency-based assessment, Competence by Design. METHODS: We employed a sociomaterial perspective on technology and grounded theory methods of iterative data collection and analysis to study this OtoHNS program's use of an e-portfolio for assessment purposes. All residents (n = 14) and competency committee members (n = 7) participated in the study; data included feedback in resident portfolios, observation of use of the e-portfolio in a competency committee meeting, and a focus group with residents to explore how they used the e-portfolio and visualize interfaces that would better meet their needs. RESULTS: Use of the e-portfolio to document, access, and interpret assessment data was problematic for both residents and faculty, but the residents faced more challenges. While faculty were slowed in making entrustment decisions, formative assessments were not actionable for residents. Workarounds to these barriers resulted in a "numbers game" residents played to acquire EPAs. Themes prioritized needs for searchable, contextual, visual, and mobile aspects of technology design to support use of assessment data for resident learning. CONCLUSION: Best practices of technology design begin by understanding user needs. Insights from this study support recommendations for improved technology design centred on learner needs to provide OtoHNS residents a more formative experience of competency-based training.

Real-World Experience of Vismodegib in Advanced Basal Cell Carcinoma at a Canadian Cancer Center.

BACKGROUND: Vismodegib is a novel Hedgehog pathway inhibitor that has revolutionized the treatment of patients with advanced basal cell carcinoma (BCC) who are poor candidates for surgery or radiation. Few studies have explored the use of vismodegib to facilitate further surgery or radiotherapy, and the optimal treatment duration to balance outcomes with adverse effects. OBJECTIVES: To characterize the disease response, progression, and recurrence outcomes of BCC patients, and to report the impact of subsequent therapies. METHODS: We performed a retrospective study of 46 adult patients with advanced basal cell carcinoma (aBCC), including both locally advanced (laBCC) and metastatic (mBCC) disease, treated with vismodegib at a single center from 2012 to 2019. RESULTS: Thirty-six had laBCC, and 10 had mBCC. Treatment was given over a mean of 21.9 months. Twenty-three (50%) had a complete response (CR), and 19 (41.3%) achieved partial response (PR). Median time to maximal response was 5.3 months. Eleven (23.9%) had resected disease at median 17.2 months, and 11 patients (23.9%) received radiotherapy. Thirty-two (69.6%) experienced progressive disease after achievement of CR or PR. Among 17 CR patients, who stopped treatment, 14 (82.3%) experienced subsequent relapse; 6 (85%) attained a repeat response. Twenty (43.5%) discontinued treatment at least once due to adverse effects. CONCLUSIONS: With a response rate of 91%, London Regional Cancer Center's (LRCP)'s experience with vismodegib supports its effectiveness in treatment of aBCC. Moreover, a significant number of patients treated with vismodegib became amenable to surgery or radiotherapy. Toxicity remained an important factor that limited treatment duration.

The embodiment of practice thresholds: from standardization to stabilization in surgical education.

Surgeons practice their own variations on a procedure. Residents experience shifting thresholds between variations that one surgeon holds firmly as principle and another takes more lightly as preference. Such variability has implications for surgical education, but the impact is not well understood. This is a critical problem to investigate as programs seek to define procedures for competency-based medical education (CBME) and improve learning through deliberate practice. Our study analyzes the emergence of procedural variation in an early-adopter CBME program through a situational analysis of tonsillectomy, a foundation level procedure in this otolaryngology, head and neck surgical program. An earlier phase of the study identified frequent variations (n = 12) on tonsillectomy among co-located surgeons who routinely perform this procedure (n = 6). In the phase reported here we interviewed these surgeons (n = 4) and residents at different stages of training (n = 3) about their experiences of these variations to map the relations of contributing social and material actors. Our results show that even a basic procedure resists standardization. This study contributes a sociomaterial grounded theory of surgical practice as an embodied response to conditions materialized by intra-relations of human and more-than-human actors. Shifting root metaphors about practice in surgical education from standardization to stabilization can help residents achieve stable-for-now embodiments of performance as their practice thresholds continue to emerge.

Scut to Scholarship: Can Operative Notes be Educationally Useful?

OBJECTIVE: Efforts to implement competency-based medical education require new sources of workplace-based evidence of growth in learning. We used qualitative analysis of operative notes to explore procedural variation in a simple surgical procedure. DESIGN: We used a grounded theory-based mixed methods approach to depict intersurgeon procedural variation. Our grounded theory approach to analysis included follow up interviews with surgeons and residents to probe their understandings of the reasons for variation in the dictated notes and the current and potential utility of operative notes as a reliable source of data for learning and assessment. SETTING: Publicly funded tertiary care otolaryngology-head & neck surgery residency program in Ontario, Canada PARTICIPANTS: Using maximum variability sampling, all surgeons performing tonsillectomy in the department (n = 6) contributed operative notes from 65 tonsillectomies, 5 intraoperative observations, and 4 semi-structured interviews. An additional 3 residents from various levels of training contributed semistructured interviews. RESULTS: Intersurgeon procedural variations persist even in simple surgical procedures such as tonsillectomy. Operative notes appear to capture procedural variations in a limited way. Surgeons and resident make informal educational use of the clerical work of writing and assessing operative notes, but optimization will be required to shift such hidden work into the formal educational domain. CONCLUSIONS: The implementation of competency-based medical education requires surgical educators to both eliminate low-yield tasks for learning and to find new opportunities for multiple low-stakes assessment. Analysis of operative notes may become a high-yield strategy for learning and assessment if residents and surgeons are coached to use operative notes more reliably and efficiently.

Development of a novel simulation-based task trainer for management of retrobulbar hematoma.

BACKGROUND: Retrobulbar hematoma (RH) is a rare but devastating complication of sinus surgery. It is treated initially with a lateral canthotomy and cantholysis at the bedside. Due to the high stakes and urgency of this complication, teaching this in the clinical setting is difficult. The objective of this study was to develop a cadaveric model for addressing this problem. METHODS: A fresh-frozen human cadaveric model of RH was created using a Foley catheter to simulate elevated intraocular pressure. Residents who participated in an emergencies in otolaryngology-head & neck surgery "boot camp" were included in the study. A survey measuring confidence levels in performing lateral canthotomy and cantholysis was administered. After completing the skill station, a postintervention survey was administered to assess the confidence of the learner as well as fidelity and usefulness of the task trainer. RESULTS: Thirty-three residents participated in the boot camp. Residents rated their confidence preintervention at 1.3/5, which suggests the majority were unable to perform the procedure. After using the model, residents rated their confidence at 3.5/5, which falls between basic knowledge and reasonably confident; this improvement achieved statistical significance (p < 0.0001). The fidelity of the model was rated 3.9/5; a score of 4 is defined as realistic. The residents rated the usefulness of the model as 4.7; a score of 5 is defined as very useful. CONCLUSION: A cadaveric model of RH was successfully developed. This novel simulator was perceived to be useful, realistic, and effective by junior residents.

Simulation of Urgent Airway Management in a Postthyroidectomy Hematoma.

Introduction: An expanding neck hematoma following thyroidectomy is a rare complication requiring urgent airway management and potential bedside evacuation before definitive surgical intervention. Due to its rare occurrence and life-threatening consequences, appropriate crisis resource management and a systematic approach are critical for patient safety. Methods: In this simulation scenario using a high-fidelity mannequin, a 68-year-old male presented with an expanding cervical hematoma 2 hours after a total thyroidectomy. The target audience was junior residents (PGY 1, PGY 2) in otolaryngology-head and neck surgery. Residents were given a case stem to encourage active information gathering through history and physical examination. Setup and flow of the scenario were designed for residents to prioritize establishing an airway through bedside decompression of the hematoma prior to making operating room arrangements for definitive management. Standardized patients playing a ward nurse and patient family member added complexity to the case. Results: Since 2012, the simulation has been used with a total of 96 residents as part of an annual boot camp. Surveys conducted after the boot camp verified the effectiveness of simulations in learning and, specifically, the usefulness of this scenario. Discussion: Simulation-based training is an effective learning modality for critical cases in health care disciplines involving emergency airway management. A well-developed simulation that closely resembles a real-life scenario is essential in creating a rich learning environment for trainees. Our scenario can be a valuable resource for other institutions implementing simulation-based training as part of their medical education.

Novel minimally invasive transoral surgery bleeding model implemented in a nationwide otolaryngology emergencies bootcamp.

Post-operative hemorrhage is the most concerning complication after minimally invasive transoral surgery, as can result in airway compromise. Simulation-based medical education provides trainees with structured learning in an intensive and immersive environment allowing deliberate practice of skills and behaviors in the management of real-life situations. We implemented a novel post-oropharyngeal surgery bleeding model in a nationwide otolaryngology emergencies bootcamp, to teach and evaluate technical and non-technical skills required to competently manage this clinical scenario. 28 Otolaryngology residents from 11 programs in Canada participated in the annual Otolaryngology Emergencies Bootcamp of Western University in London, Ontario. After teaching technical aspects of emergency surgical airways in models, the course culminated with a complex scenario of a post-minimally invasive transoral surgery bleeding model using a fresh cadaver. The Non-Technical Skills for Surgeons (NOTSS) rating scale was applied to video analysis and a scenario-specific Medical Expert Checklist was implemented. The model design in a cadaveric torso is described for use in a simulation of a high-volume oropharyngeal bleed after a minimally invasive approach. Participants agreed that the model evoked an elevated degree of realism and conveyed the emotion of a life-threatening event. NOTSS analysis identified a marginal score in the domains of decision-making and communication and teamwork. Critical action checklist analysis highlighted the early mobilization of available resources and time to decision for surgical airway. We present the first report of a post-minimally invasive transoral surgery bleeding model. It was successful in recreating with high fidelity such a high-stake event and to teach technical and non-technical skills.

Assessing nontechnical skills in otolaryngology emergencies through simulation-based training.

OBJECTIVE: Nontechnical skills (NTS) are essential to emergency crisis management. Due to the rarity of true emergencies, they are challenging to teach and assess within a competency-based curriculum. Our purpose is to evaluate the utility of the Non-Technical Skills in Surgery (NOTSS) scale in NTS assessment in simulated otolaryngology and head and neck surgery (OTO-HNS) emergencies and identify common challenges that residents encounter. METHODS: Mixed methods analysis of 15 junior OTO-HNS resident teams in four simulated emergency scenarios. Six raters rated resident NTS performance using the NOTSS score. Constructivist-grounded theory was used to analyze scenario video transcripts to identify areas of learner difficulty to guide future simulation development. RESULTS: Residents scored highest in situational awareness and lowest in leadership domains. Raters showed good consistency and reliability overall (Cronbach's alpha = 0.885). There was no statistical difference in ratings between surgical experts and nonexperts. Qualitative analysis demonstrated challenges with closed-loop communication and handling transitions of leadership with the scenarios. CONCLUSION: Simulation-based training is an effective modality to teach NTS in crisis resource management. The NOTSS rating scale is a reliable instrument for assessing NTS in simulated OTO-HNS emergencies. Incorporating the NOTSS scale for NTS assessment within a competency-based curriculum is recommended. LEVEL OF EVIDENCE: NA. Laryngoscope, 128:2301-2306, 2018.

Factors associated with lingual tonsil hypertrophy in Canadian adults.

BACKGROUND: Hypertrophy of the lingual tonsil tissue in the adult patient is thought to contribute to the pathophysiology of obstructive sleep apnea. The underlying etiology of lingual tonsil hypertrophy (LTH) in the adult patient is unclear and likely multifactorial. Previous studies have suggested that the lingual tonsils may undergo compensatory hyperplasia post-tonsillectomy in children, although it is unknown if this occurs or persists into adulthood. The purpose of this study was to determine what factors are associated with LTH in a population of Canadian adults. METHODS: Adult patients presenting for consultation to an academic Rhinology/General Otolaryngology practice were eligible for enrollment. Demographic data including age, body mass index (BMI), Reflux Symptom Index (RSI), history of allergy, and history of tonsillectomy was collected via questionnaire. Endoscopic photographs of the base of tongue and larynx were captured. These were graded for LTH and Reflux Finding Scale (RFS) by blinded examiners. Statistical analysis was performed by comparing the mean LTH value to the variables of interest using two-tailed T-test. P < .05 was considered significant. RESULTS: One hundred two subjects were enrolled. Age ranged from 18 to 78. 28 patients had previous tonsillectomy. This was not associated with a significant increase in lingual tonsil tissue (r = -0.05, p = 0.61). RFS >7 or RSI >13 was considered positive for laryngopharyngeal reflux. There was no difference in LTH based on RSI positivity (p = 0.44). RFS positivity correlated with increased lingual tonsil tissue (p < 0.05). BMI >30 was associated with increased lingual tonsil hypertrophy (p < 0.05). CONCLUSIONS: An elevated body mass index and positive Reflux Finding Score are associated with lingual tonsil hypertrophy in adults. Reflux symptom index, history of allergy and history of childhood tonsillectomy are not associated with LTH.

Malignant Proliferating Trichilemmal Tumor Treated with Radical Radiotherapy: A Case Report and Literature Review.

Reported here is the first case of a malignant proliferating trichilemmal tumor treated with radical radiotherapy. Complete clinical response was achieved, and this obviated the need for aggressive surgery. These tumors have a tendency to develop in older patients, and have a propensity for affecting women more than men. The standard of treatment is surgical excision with a margin of normal tissue. Given that not all patients are good surgical candidates, the role of different treatment modalities in the management of this tumor is discussed.

Novel High-Fidelity Peritonsillar Abscess Simulator.

OBJECTIVE: To create and assess a novel high-fidelity peritonsillar abscess simulation task trainer with junior otolaryngology-head and neck surgery residents. STUDY DESIGN: Prospective cohort study. SETTING: Third annual Emergencies in Otolaryngology Head & Neck Surgery Bootcamp course at the Canadian Surgical Technologies & Advanced Robotics in London, Canada. SUBJECTS AND METHODS: Fresh cadaveric material was obtained consisting of a head and neck. Abscess pockets were simulated with a finger of a latex glove containing vanilla pudding to represent pus, tied off with a silk suture. These abscess pockets were inserted into the peritonsillar space from the transected neck inferiorly, passing medial to the great vessels into the parapharyngeal space. Faculty members evaluated the models to test content validity. The primary outcome measure was a postbootcamp survey evaluation assessing specific domains: learning objectives, effectiveness of faculty, and the quality and realism of models. RESULTS: When working with this model, learners were able to locate, visualize, and manipulate the abscess. The materials and positioning of the pockets created high-fidelity models that were realistic in appearance and haptics feedback. CONCLUSIONS: A novel high-fidelity task trainer has been successfully developed to teach the technique of peritonsillar abscess incision and drainage. This task trainer is currently the highest-fidelity model reported in the literature. This model allows learners to practice a high-stakes emergency skill in a controlled environment, affording the opportunity to practice localization, visualization, and drainage of the abscess with a high level of realism.

Evaluation of a novel high-fidelity epistaxis task trainer.

OBJECTIVES/HYPOTHESIS: To assess the efficacy of a novel high-fidelity epistaxis simulator in teaching epistaxis management to junior otolaryngology head and neck surgery residents. STUDY DESIGN: Prospective cohort study. METHODS: A novel high-fidelity epistaxis task trainer was developed using a cadaver head, intravenous tubing, and a food coloring-filled saline bag to emulate blood. Learners were instructed on two techniques of nasal packing (formal nasal pack and nasal tampon) for the management of epistaxis using the task trainer. Learners were videotaped attempting to pack the nose of the task trainer pre- and postintervention (verbal instruction, and practice time with task trainer). Five board-certified otolaryngologists (blinded to pre- and postintervention status) evaluated the packing technique using standardized subjective outcome measures. RESULTS: There were 13 junior otolaryngology residents enrolled in the study. This cohort showed a statistically significant increase in global rating scores (P < 0.05) in all items measured for both packing methods. CONCLUSION: This novel cadaveric epistaxis simulator has been successful in teaching and the practical application of various skills in epistaxis management. This task trainer appears to confer an educational benefit in technical skills acquisition in novice learners. Further studies are needed to determine long-term skill retention. Simulation is a promising educational adjunct that effectively enhances epistaxis management skills acquisition while maximizing patient safety. LEVEL OF EVIDENCE: NA. Laryngoscope, 126:1501-1503, 2016.

Objective assessment of Myringotomy and tympanostomy tube insertion: A prospective single-blinded validation study.

OBJECTIVES/HYPOTHESIS: Despite the transition to competency-based education in surgery, few standardized assessment tools exist in otolaryngology training. In particular, myringotomy and tympanostomy tube insertion (M+T) is a common surgical procedure with few validated assessment tools available. Our objectives were to develop an objective structured assessment of operative skills in M+T and to provide validity evidence for the developed assessment tool within otolaryngology training. STUDY DESIGN: Prospective study involving the evaluation of an assessment tool. METHODS: Through consultation with a panel of experts in otolaryngology and medical education we developed a Task-Specific Checklist and Global Rating Scale for M+T. Postgraduate year 2 junior residents, postgraduate year 3 senior residents, and attending otolaryngologists were video recorded performing M+T at a tertiary care pediatric hospital. The videos were subsequently reviewed and independently evaluated by three blinded raters from an unaffiliated academic institution. RESULTS: The average score of junior residents, senior residents, and attending otolaryngologists using the Task-Specific Checklist was 21.7/30 (±7.1), 26.3/30 (±3.5), and 27.3/30 (±6.2), respectively (P = .04). For the Global Rating Scale, the scores for junior residents, senior residents, and attending surgeons were 27.7/50 (±11.2), 34.5/50 (±9.5), and 45.1/50 (±4.6), respectively (P < .001). The inter-rater and intrarater reliability were both above 0.88. CONCLUSIONS: The Task-Specific Checklist and Global Rating Scale for M+T appear reliable, with validity evidence supporting their use in otolaryngology training. LEVEL OF EVIDENCE: NA Laryngoscope, 126:2140-2146, 2016.

Prospective study of sentinel node biopsy for high-risk cutaneous squamous cell carcinoma of the head and neck.

BACKGROUND: Nodal metastasis from cutaneous squamous cell carcinoma (SCC) is poorly predicted clinically and is associated with a high mortality rate. METHODS: From 2010 to 2013, patients with high-risk cutaneous SCC were assessed with sentinel node biopsy (SNB) either at the time of primary cutaneous tumor resection or at secondary wide local excision. RESULTS: Of 57 patients, 8 (14%) had nodal metastasis. Significant predictors of metastasis are the number of high-risk factors (p = .008), perineural invasion (PNI; p = .05), and lymphovascular invasion (LVI; p = .05). During a mean of 19.4 months, 9 patients developed recurrence and 6 died of cutaneous SCC, indicating that over 1300 patients would be required for a randomized controlled trial with 80% power to detect a significant difference in disease-free survival. CONCLUSION: Lymph node metastasis occurs in 14% of patients with high-risk cutaneous SCC. Larger studies will be required to identify which "high-risk" factors should be considered as an indication for surgical assessment of the nodal basin. © 2015 Wiley Periodicals, Inc. Head Neck 38: E884-E889, 2016.

Emergencies in otolaryngology-head and neck surgery bootcamp: a novel Canadian experience.

OBJECTIVES/HYPOTHESIS: A 1-day intensive course (bootcamp) was developed, to teach junior otolaryngology-head and neck surgery (OTO-HNS) residents emergency procedural skills, clinical reasoning, and communication skills. This learning paradigm utilized a number of novel task trainers, panel discussions, and emergency simulations. The study objective was to assess the educational value of this bootcamp. STUDY DESIGN: Prospective cohort survey. METHODS: Residents were recruited from regional teaching centers within a 2000-km radius of the simulation center. Preceptors fluent in English and in French were in attendance. Pre-bootcamp outcome measures included the Kolb Learning Style Inventory and a self-administered survey measuring confidence levels in performing specific OTO-HNS tasks. Post-bootcamp outcome measures included a survey evaluating the bootcamp experience and a structured follow-up telephone interview. RESULTS: Twenty-eight residents participated in the bootcamp from across the United States and Canada. When asked if they felt that "overall, the educational day was an effective learning process," the average score was 4.75/5.0. The vast majority of participants (92.9%) felt they would recommend the bootcamp to a future junior resident. Kolb learning styles that prefer active experimentation (acting, initiating, and deciding) were more common than those that utilize reflective observation (imagining, analyzing, reflecting), which favors a hands-on model of learning. CONCLUSION: This first Canadian OTO-HNS bootcamp demonstrated the feasibility and effectiveness of conducting a centralized bootcamp for regional training centers spanning multiple states/provinces and languages. Future bootcamps will be held annually and will ideally continue the natural evolution of surgical, hands-on training.

Biomechanical properties of the facial retaining ligaments.

OBJECTIVE: Osteocutaneous facial retaining ligaments play an important role in the aging face. We sought to better characterize the biophysical properties of these ligaments and, in doing so, provide an empirical basis for the natural descent seen in facial aging. METHODS: Five fresh frozen cadaver heads yielding 10 hemifaces were dissected to expose the orbital, zygomatic, buccomaxillary, and mandibular osteocutaneous ligaments. Each ligament was assessed and subjected to biomechanical testing. The main outcome measures included ligament dimensions, stiffness, percentage of elongation, and force to initial and ultimate failure. RESULTS: Initial and ultimate failure testing revealed the zygomatic ligament to be strongest, followed by the orbital, mandibular, and maxillary ligaments. The zygomatic ligament was also stiffest, followed by the orbital, maxillary, and mandibular ligaments. The percentage of elongation acted as a surrogate marker of elasticity, with the greatest elasticity maintained by the mandibular ligament, followed by the orbital, zygomatic, and buccomaxillary ligaments. Ligament dimensions and biophysical properties did not vary relative to cadaveric hemiface, age, or sex. CONCLUSIONS: To our knowledge, this is the first investigation to quantify the biomechanical properties of the facial retaining ligaments. Inherent ligament properties seem to be related to the changes observed in facial aging, although further study is required.

Type I thyroplasty: risk stratification approach to inpatient versus outpatient postoperative management.

BACKGROUND: type I thyroplasty is an effective and safe procedure for unilateral vocal fold paralysis and is shifting toward outpatient postoperative care. However, serious airway complications have been reported. OBJECTIVES: the aims of this study were to investigate whether risk stratification into inpatient/outpatient postoperative care reduces outpatient airway complications and to compare the cost-effectiveness and surgical outcomes of risk stratification to a historical inpatient control group (non-risk stratified). SETTING: tertiary, university-based medical centre. DESIGN AND RESULTS: Three retrospective groups were examined: historical inpatient control (n = 15), risk-stratified (RS)- inpatient (n = 16), and RS outpatient (n = 17). Laryngeal edema was encountered in two historical controls (13.3%), two RS inpatients (12.5%), and one RS outpatient (5.9%). One case of implant extrusion occurred in the RS outpatient group. There was no difference in maximum phonation time or voice-related quality of life between RS versus historical controls (p > .5). The cost savings of risk stratification versus entirely inpatient care was $CAD 633.12/patient. The average duration in hospital for RS inpatient versus RS outpatient was 29.8 and 8.3 hours, respectively. CONCLUSIONS: postoperative RS may reduce potentially serious outpatient airway complications and cost while improving patient satisfaction.

Evaluation of postoperative drainage with application of platelet-rich and platelet-poor plasma following hemithyroidectomy: a randomized controlled clinical trial.

BACKGROUND: Platelet-rich plasma (PRP) and platelet-poor plasma (PPP) have been used to improve hemostasis and wound healing after surgery; however, randomized controlled trials proving their efficacy are lacking. METHODS: Hemithyroidectomy was performed on 52 patients. Autologous PRP and PPP were applied during wound closure in the treatment group, while saline was applied in the controls. Outcome measures were postoperative drainage, pain, analgesic use, and length of hospital stay. RESULTS: The 24-hour cumulative drainage was reduced by 29.3% in the treatment group (44.9 mL vs 63.5 mL, p = .039). The treatment group required less analgesic medication despite similar pain scores; however, the difference was not significant. There was a trend toward decreased length of stay for the PRP/PPP group (p = .059). CONCLUSIONS: Hemithyroidectomy served as a stringent test to evaluate the wound-healing capacity of platelet-rich and platelet-poor plasma. This study provides evidence that PRP and PPP reduced postoperative drainage in soft-tissue surgery.