Implementation and Analysis of a 5-Year Online Esophageal Motility Curriculum for Gastroenterology Fellows.

BACKGROUND: Motility disorders are frequently encountered in gastroenterology (GI) practice, yet a national structured training curriculum for GI fellows in motility disorders is lacking. Since GI fellowships vary considerably in opportunities for specialized esophageal motility (EM) training, novel educational technology may be leveraged to provide standardized EM curriculum to train GI fellows in esophageal manometry. METHODS: GI fellows participated in an online EM learning program at a single academic center from 2017 to 2022. Fellows answered case-based questions and were provided with evidence-based, corrective feedback related to core EM learning objectives. The primary outcome was change in knowledge and comfort in interpretation and clinical application of EM studies. RESULTS: Sixty-nine fellows actively participated in the online EM curriculum. 65 fellows completed a pre-curriculum test, and 54 fellows completed a post-curriculum test. There was a cumulative improvement between pre-curriculum test and post-curriculum test scores from 70 to 87%, respectively (p < 0.001). Fellows had a mean improvement of 19% in questions as they progressed through the curriculum. Prior to enrolling in the EM course, 26% of fellows felt comfortable in interpreting EM studies compared to 54% of fellows after completion of the program (p < 0.001). CONCLUSION: An online, technology-based curriculum was effective in educating GI fellows on core competencies of EM. Fellows demonstrated improvement in proficiency of clinically important EM studies and increased comfort in interpreting EM studies. Further studies are needed to evaluate the use of technology-based learning to widely disseminate a structured training curriculum in EM, particularly in training programs without a motility presence.

Evidence for validity for the Cognitive Load Inventory for Handoffs.

CONTEXT: Patient handovers remain a significant patient safety challenge. Cognitive load theory (CLT) can be used to identify the cognitive mechanisms for handover errors. The ability to measure cognitive load types during handovers could drive the development of more effective curricula and protocols. No such measure currently exists. METHODS: The authors developed the Cognitive Load Inventory for Handoffs (CLIH) using a multi-step process, including expert interviews to enhance content validity and talk-alouds to optimise response process validity. The final version contained 28 items. From January to March 2019, we administered a cross-sectional survey to 1807 residents and fellows from a large health care system in the USA. Participants completed the CLIH following a handover. Exploratory factor analysis of data from one-third of respondents identified high-performing items; confirmatory factor analysis of data from the remaining sample assessed model fit. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TFI) (>0.80), standardised root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08). RESULTS: Participants included 693 trainees (38.4%) (231 in the exploratory study and 462 in the confirmatory study). Eleven items were removed during exploratory factor analysis. Confirmatory factor analysis of the 16 remaining items (five for intrinsic load, seven for extraneous load and four for germane load) supported a three-factor model and met criteria for good model fit: the CFI was 0.95, TFI was 0.93, RMSEA was 0.074 and SRMR was 0.07. The factor structure was comparable for gender and role. Intrinsic, extraneous and germane load scales had high internal consistency. With one exception, scale scores were associated, as hypothesised, with postgraduate level and clinical setting. CONCLUSIONS: The CLIH measures three types of cognitive load during patient handovers. Evidencefor validity is provided for the CLIH's content, response process, internal structure and association with other variables. This instrument can be used to determine the relative drivers of cognitive load during handovers in order to optimize handover instruction and protocols.

Exploring the relationship between emotion and cognitive load types during patient handovers.

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Best Practices in Teaching Endoscopy Based on a Delphi Survey of Gastroenterology Program Directors and Experts in Endoscopy Education.

BACKGROUND AND AIMS: Teaching endoscopy is a key objective of gastroenterology (GI) fellowship programs but the best approach is not known. We sought to characterize which teaching competencies experts considered most critical for endoscopy education. METHODS: We developed and refined 18 endoscopy teaching competencies based on literature review, personal experience, and interviews with experts. We invited GI fellowship program directors and endoscopy education experts to participate in a Delphi process to rate each proposed competency as essential, important but not essential, or not important using a 70% agreement threshold for consensus. Thirty-four GI fellowship program directors and 2 experts in endoscopy education participated (n = 36). RESULTS: Most survey participants were male (61.8%), associate professors (55.9%), and had performed at least a quarter of procedures with fellows (80.6%). Survey response rates were 94% (34 of 36) for round 1 and 91% (31 of 34) for round 2 (overall 31 of 36; 86.1%). After 2 rounds we achieved the predefined consensus level for most competencies. Fourteen of 18 competencies (77.8%) reached consensus after round 2: 10 (55.6%) were deemed essential and 4 (22.2%) were deemed important but not essential. Essential competencies included the following: discusses patient history and plans for procedure with trainee (100%), assumes control of procedure when trainee is unable to progress or if patient safety concerns arise (100%), maintains attention throughout the case (96.8%), and discusses the next steps in management for the patient (96.8%). CONCLUSIONS: In a national Delphi survey of endoscopy education experts, we identified 10 essential endoscopy teaching competencies. These can be used to frame faculty development and standardize GI fellowship programs to promote high-quality endoscopy education.

How do attending physicians describe cognitive overload among their workplace learners?

OBJECTIVES: Cognitive load theory (CLT) focuses on the limited bandwidth of working memory. Core to CLT is the concept of cognitive overload, which occurs when working memory demands exceed working memory capacity, and learning and performance suffer. Within health professions education (HPE), workplace learning settings are very complex, placing learners at high risk of cognitive overload. Although continuous monitoring of physiologic parameters can indicate states of high cognitive load, how to practically identify cognitively overloaded learners within everyday workplace settings is not well understood. We sought to characterise how attending physicians described their perceiving of cognitive overload among learners in two different workplace settings: the gastrointestinal endoscopy suite and the intensive care unit. METHODS: We performed a secondary qualitative analysis of transcripts of interviews with workplace teachers that had been carried out during two previous studies. These studies had addressed different objectives but both were informed by CLT. Each included questions that prompted participants to reflect on how they perceived cognitive overload to manifest among learners in the workplace. To investigate the phenomenon of cognitive overload, we developed a new codebook and performed content analysis. RESULTS: We analysed 42 interview transcripts (22 endoscopists, 12 hospitalists, eight intensivists). Participants described four behaviours they had witnessed among learners they thought were cognitively overloaded: poor performance on workplace tasks; non-verbal physical manifestations (including posture, eye and body movements and autonomic functions); verbal utterances (words and sounds), and interpersonal interactions with team members. Endoscopists often described individually oriented examples, whereas intensivists and hospitalists tended to frame examples within an interpersonal context. CONCLUSIONS: We identified four overarching ways in which HPE workplace teachers perceived learners as appearing to be cognitively overloaded. Workplace teachers and learners should be mindful of and watch for these signs, which may signal states of cognitive overload. Earlier recognition of cognitive overload may facilitate timely action to reduce cognitive overload and promote learning.

Trainee perception of cognitive load during observed faculty staff teaching of procedural skills.

OBJECTIVES: Although teachers impact learners' cognitive load, how specific teaching activities affect intrinsic, germane and extraneous load during procedural skills training is unknown. We sought to characterise teaching activities used in the exemplar procedural setting of colonoscopy, and to explore how they were enacted and how learners perceived them as affecting intrinsic, germane and extraneous cognitive load. METHODS: We observed 10 colonoscopies performed by eight different gastroenterology fellows and supervised by 10 different attending physicians at two hospitals, and recorded the teaching activities observed, as well as details of when they were used and how they were enacted. After the colonoscopy, each fellow completed the Cognitive Load Inventory for Colonoscopy to quantify intrinsic, germane and extraneous load. We then interviewed each fellow to determine how he or she perceived teaching as affecting cognitive load. Qualitative data were subjected to content analysis. Instances of germane load-promoting activities were correlated with measured germane load. RESULTS: We observed 515 instances of teaching activities. The intensity of teaching varied substantially, ranging from 0.7 to 3.3 activities per minute, as did the pattern of teaching activities used by different attending physicians. Little teaching occurred immediately before or after a procedure. Fellows usually perceived teaching as affecting cognitive load in ways that promoted learning, particularly by reducing intrinsic load and increasing germane load. Fellows strongly perceived that the provision of autonomy promoted germane load. Conversely, fellows perceived that excessive teaching increased extraneous load. Instances of germane load-promoting teaching activities correlated moderately with measured germane load. CONCLUSIONS: Teaching in the exemplar procedural setting of colonoscopy affected learners' cognitive load in mostly beneficial ways, yet even 'good' teaching activities had detrimental effects when used excessively. Teachers of procedures should consider learner experience, task complexity and environmental factors to modulate the modality, content and intensity of teaching to promote balanced cognitive load and learning. Teaching more reservedly during the procedure and taking advantage of pre- and post-procedure opportunities may help.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53.

AIM: Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear. METHOD: To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks. RESULT: Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning. CONCLUSION: The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Gastroenterologist and primary care perspectives on a post-endoscopy discharge policy: impact on clinic wait times, provider satisfaction and provider workload.

BACKGROUND: To reduce unnecessary ambulatory gastroenterology (GI) visits and increase access to GI care, San Francisco Health Network gastroenterologists and primary care providers implemented guidelines in 2013 that discharged certain patients back to primary care after endoscopy with formal written recommendations. This study assesses the longer-term impact of this policy on GI clinic access, workflow, and provider satisfaction. METHODS: An email-based survey assessed gastroenterologist and primary care provider (PCP) opinions about the discharge process. Administrative data and chart review were used to assess clinic access, intervention fidelity, and re-referral rates. RESULTS: 102/299 (34%) of PCPs and 5/7 (71%) of gastroenterologists responded to the survey. 74% of PCPs and 100% of gastroenterologists were satisfied or very satisfied with the discharge process. 80% of gastroenterologists believed the discharge process decreased their workload, while 53.5% of primary care providers believed it increased their workload. 6.7% of patients discharged to primary care in 2013 had re-referrals to GI. Wait time for the third-next-available new outpatient GI clinic appointment had previously decreased from 158 days (2012, pre-intervention) to 74 days (2013, post-intervention). In 2015, wait time was 19 days (p < 0.001 for 2012 vs. 2015). CONCLUSIONS: Primary care providers and gastroenterologists are satisfied with an intervention to discharge patients from gastroenterology to primary care after certain endoscopic procedures, although this conclusion is limited by a relatively low PCP survey response rate. Discharging appropriate patients using consensus criteria from the gastroenterology clinic was instrumental in sustainably reducing clinic wait times with low re-referral rates.

Urgent colonoscopy in patients with lower GI bleeding: a systematic review and meta-analysis.

BACKGROUND AND AIMS: Lower GI bleeding (LGIB) is a common cause of morbidity and mortality. Colonoscopy is indicated in all hospitalized patients with LGIB, yet the time frame for performing colonoscopy remains unclear. Prior studies of outcomes in urgent versus elective colonoscopy have yielded conflicting results and were often underpowered. Our study objective was to compare several outcomes between urgent and elective colonoscopy in patients hospitalized for LGIB. METHODS: Systematic review and meta-analysis were performed on studies that compared urgent and elective colonoscopy in patients with LGIB. Pooled rates were calculated for specific outcomes, and rate ratios were determined for selected comparison groups. RESULTS: Twelve studies met inclusion criteria, with a total sample size of 10,172 patients in the urgent colonoscopy arm and 14,224 patients in the elective colonoscopy arm. Urgent colonoscopy was associated with increased use of endoscopic therapeutic intervention (RR, 1.70; 95% CI, 1.08-2.67). There were no significant differences in bleeding source localization (RR, 1.08; 95% CI, .92-1.25), adverse event rates (RR, 1.05; 95% CI, .65-1.71), rebleeding rates (RR, 1.14; 95% CI, .74-1.78), transfusion requirement (RR, 1.02; 95% CI, .73-1.41), or mortality (RR, 1.17; 95% CI, .45-3.02). CONCLUSIONS: Urgent colonoscopy appears to be safe and well tolerated, but there is no clear evidence that it alters important clinical outcomes.

Using Search Engine Query Data to Explore the Epidemiology of Common Gastrointestinal Symptoms.

BACKGROUND: Internet searches are an increasingly used tool in medical research. To date, no studies have examined Google search data in relation to common gastrointestinal symptoms. AIMS: The aim of this study was to compare trends in Internet search volume with clinical datasets for common gastrointestinal symptoms. METHODS: Using Google Trends, we recorded relative changes in volume of searches related to dysphagia, vomiting, and diarrhea in the USA between January 2008 and January 2011. We queried the National Inpatient Sample (NIS) and the National Hospital Ambulatory Medical Care Survey (NHAMCS) during this time period and identified cases related to these symptoms. We assessed the correlation between Google Trends and these two clinical datasets, as well as examined seasonal variation trends. RESULTS: Changes to Google search volume for all three symptoms correlated significantly with changes to NIS output (dysphagia: r = 0.5, P = 0.002; diarrhea: r = 0.79, P < 0.001; vomiting: r = 0.76, P < 0.001). Both Google and NIS data showed that the prevalence of all three symptoms rose during the time period studied. On the other hand, the NHAMCS data trends during this time period did not correlate well with either the NIS or the Google data for any of the three symptoms studied. Both the NIS and Google data showed modest seasonal variation. CONCLUSIONS: Changes to the population burden of chronic GI symptoms may be tracked by monitoring changes to Google search engine query volume over time. These data demonstrate that the prevalence of common GI symptoms is rising over time.

A Novel Decision Aid for Surgical Patients with Ulcerative Colitis: Results of a Pilot Study.

BACKGROUND: Up to 30% of patients who have ulcerative colitis are faced with the complex decision between end ileostomy and IPAA. We developed a decision aid to encourage shared decision making between patients and surgeons. OBJECTIVE: The aim of this study is to determine whether a decision aid is effective and acceptable for surgical patients with ulcerative colitis and their treating surgeons. DESIGN: This was a prospective cohort study. SETTINGS: Patients and surgeons were enrolled from 3 colorectal surgery clinics. PATIENTS: Consecutive adult patients with ulcerative colitis who were candidates for IPAA and end ileostomy were selected. INTERVENTIONS: Patients used a multilingual decision aid before meeting with the surgeon. MAIN OUTCOME MEASURES: We measured changes in knowledge, treatment preference, and stage of decision making, as well as preparation for decision making, patient satisfaction, and surgeon satisfaction after using the decision aid. RESULTS: Twenty-five patients were enrolled; 5 had previously undergone subtotal colectomy. After using the decision aid, patients' knowledge scores improved by 39% (p < 0.006), 6 patients changed their treatment preference, and 8 reported increased certainty in treatment preference. The median for preparation for decision making was 75 of 100. Patient satisfaction with the decision aid (median score, 37/41) and surgeon satisfaction with the clinical encounter (median score, 38/45) were high. Patients who previously underwent subtotal colectomy had lower preparation for decision-making scores (median score, 58 vs 78 for surgery-naïve patients, p = 0.06), and did not report increased certainty in treatment preference after using the decision aid. LIMITATIONS: The study included a small sample with no comparison group. CONCLUSIONS: A novel decision aid for surgical patients with ulcerative colitis appears to be effective and acceptable in patients and surgeons from diverse clinical settings. Patients who have not yet initiated surgical treatment seem to benefit most. Future studies to validate the knowledge questionnaire and test the decision aid in a randomized fashion are warranted.

Measuring cognitive load during procedural skills training with colonoscopy as an exemplar.

OBJECTIVES: Few studies have investigated cognitive factors affecting learning of procedural skills in medical education. Cognitive load theory, which focuses on working memory, is highly relevant, but methods for measuring cognitive load during procedural training are not well understood. Using colonoscopy as an exemplar, we used cognitive load theory to develop a self-report instrument to measure three types of cognitive load (intrinsic, extraneous and germane load) and to provide evidence for instrument validity. METHODS: We developed the instrument (the Cognitive Load Inventory for Colonoscopy [CLIC]) using a multi-step process. It included 19 items measuring three types of cognitive load, three global rating items and demographics. We then conducted a cross-sectional survey that was administered electronically to 1061 gastroenterology trainees in the USA. Participants completed the CLIC following a colonoscopy. The two study phases (exploratory and confirmatory) each lasted for 10 weeks during the 2014-2015 academic year. Exploratory factor analysis determined the most parsimonious factor structure; confirmatory factor analysis assessed model fit. Composite measures of intrinsic, extraneous and germane load were compared across years of training and with global rating items. RESULTS: A total of 477 (45.0%) invitees participated (116 in the exploratory study and 361 in the confirmatory study) in 154 (95.1%) training programmes. Demographics were similar to national data from the USA. The most parsimonious factor structure included three factors reflecting the three types of cognitive load. Confirmatory factor analysis verified that a three-factor model was the best fit. Intrinsic, extraneous and germane load items had high internal consistency (Cronbach's alpha 0.90, 0.87 and 0.96, respectively) and correlated as expected with year in training and global assessment of cognitive load. CONCLUSIONS: The CLIC measures three types of cognitive load during colonoscopy training. Evidence of validity is provided. Although CLIC items relate to colonoscopy, the development process we detail can be used to adapt the instrument for use in other learning settings in medical education.

Minding the Gaps: Assessing Communication Outcomes of Electronic Preconsultation Exchange.

BACKGROUND: Effective communication between referring and specialty providers is key to optimizing patient safety. Communication was assessed in an electronic referral system by review of referrals to a public urban health care system's gastroenterology clinic that were not scheduled for appointments. METHODS: All electronic referrals to a publicly funded, urban health care system's adult gastroenterology clinic from November 1, 2009, to November 30, 2010, were reviewed that did not result in scheduling of appointments. An assessment was made of whether in-person visits were unnecessary by preconsultation exchange or whether the referrals remained unscheduled for other reasons. For the latter group, reasons why the referrals remained unscheduled were examined, and medical records were reviewed for actual patient harm when sufficient information was present in the chart or for potential harm when no further information about the referral complaint was available. RESULTS: Eighty-six (32%) of 266 not-scheduled referrals were resolved via preconsultation exchange. For another 96 (36%), patients were not ultimately considered to require appointments or were scheduled via other routes. Nine patients received unplanned care while awaiting scheduling decisions, 5 of whom had harm that was related to referral complaints, although scheduling of appointments may not have avoided this harm. Of 75 patients for whom further information was not available about the referral complaints, most were not seen back in primary care, and 55 (73%) had potential for major harm. CONCLUSION: Few adverse outcomes in electronic referrals not scheduled for in-person gastroenterology visits were found, and none were clearly due to communication lapses in the referral process. Contributors to the potential for harm in referrals that were unintentionally left unscheduled included discontinuity of care and lack of patient or provider follow-up.