Impact of study design on adenoma detection in the evaluation of artificial intelligence-aided colonoscopy: a systematic review and meta-analysis.

BACKGROUND AND AIMS: Randomized controlled trials (RCTs) have reported that artificial intelligence (AI) improves endoscopic polyp detection. Different methodologies-namely, parallel and tandem designs-have been used to evaluate the efficacy of AI-assisted colonoscopy in RCTs. Systematic reviews and meta-analyses have reported a pooled effect that includes both study designs. However, it is unclear whether there are inconsistencies in the reported results of these 2 designs. Here, we aimed to determine whether study characteristics moderate between-trial differences in outcomes when evaluating the effectiveness of AI-assisted polyp detection. METHODS: A systematic search of Ovid MEDLINE, Embase, Cochrane Central, Web of Science, and IEEE Xplore was performed through March 1, 2023, for RCTs comparing AI-assisted colonoscopy with routine high-definition colonoscopy in polyp detection. The primary outcome of interest was the impact of study type on the adenoma detection rate (ADR). Secondary outcomes included the impact of the study type on adenomas per colonoscopy and withdrawal time, as well as the impact of geographic location, AI system, and endoscopist experience on ADR. Pooled event analysis was performed using a random-effects model. RESULTS: Twenty-four RCTs involving 17,413 colonoscopies (AI assisted: 8680; non-AI assisted: 8733) were included. AI-assisted colonoscopy improved overall ADR (risk ratio [RR], 1.24; 95% confidence interval [CI], 1.17-1.31; I2 = 53%; P < .001). Tandem studies collectively demonstrated improved ADR in AI-aided colonoscopies (RR, 1.18; 95% CI, 1.08-1.30; I2 = 0%; P < .001), as did parallel studies (RR, 1.26; 95% CI, 1.17-1.35; I2 = 62%; P < .001), with no statistical subgroup difference between study design. Both tandem and parallel study designs revealed improvement in adenomas per colonoscopy in AI-aided colonoscopies, but this improvement was more marked among tandem studies (P < .001). AI assistance significantly increased withdrawal times for parallel (P = .002), but not tandem, studies. ADR improvement was more marked among studies conducted in Asia compared to Europe and North America in a subgroup analysis (P = .007). Type of AI system used or endoscopist experience did not affect overall improvement in ADR. CONCLUSIONS: Either parallel or tandem study design can capture the improvement in ADR resulting from the use of AI-assisted polyp detection systems. Tandem studies powered to detect differences in endoscopic performance through paired comparison may be a resource-efficient method of evaluating new AI-assisted technologies.

Structural basis for SARS-CoV-2 neutralizing antibodies with novel binding epitopes.

The ongoing Coronavirus Disease 2019 (COVID-19) pandemic caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) threatens global public health and economy unprecedentedly, requiring accelerating development of prophylactic and therapeutic interventions. Molecular understanding of neutralizing antibodies (NAbs) would greatly help advance the development of monoclonal antibody (mAb) therapy, as well as the design of next generation recombinant vaccines. Here, we applied H2L2 transgenic mice encoding the human immunoglobulin variable regions, together with a state-of-the-art antibody discovery platform to immunize and isolate NAbs. From a large panel of isolated antibodies, 25 antibodies showed potent neutralizing activities at sub-nanomolar levels by engaging the spike receptor-binding domain (RBD). Importantly, one human NAb, termed PR1077, from the H2L2 platform and 2 humanized NAb, including PR953 and PR961, were further characterized and subjected for subsequent structural analysis. High-resolution X-ray crystallography structures unveiled novel epitopes on the receptor-binding motif (RBM) for PR1077 and PR953, which directly compete with human angiotensin-converting enzyme 2 (hACE2) for binding, and a novel non-blocking epitope on the neighboring site near RBM for PR961. Moreover, we further tested the antiviral efficiency of PR1077 in the Ad5-hACE2 transduction mouse model of COVID-19. A single injection provided potent protection against SARS-CoV-2 infection in either prophylactic or treatment groups. Taken together, these results shed light on the development of mAb-related therapeutic interventions for COVID-19.

Enhancing Self-Management of Percutaneous Endoscopic Gastrostomy Tubes Through the Implementation of a Standardized Education and Assessment Pathway: A Quality Improvement Initiative.

Intraduodenal infusion of levodopa-carbidopa intestinal gel by percutaneous endoscopic gastrostomy tube with jejunal extension is a treatment option to reduce motor and nonmotor complications in patients with advanced Parkinson's disease when oral therapy no longer provides sufficient benefit. Medication management is of central focus; however, there was no standardized patient education on stoma-site care and tube maintenance, leading to the development of stoma-site complications. As a quality improvement (QI) initiative, a standardized education and assessment pathway was developed and implemented in an urban academic outpatient clinic to enhance patient self-management and reduce stoma-site complications. A retrospective chart review was conducted to establish baseline incidence of cutaneous stoma-site complications. QI interventions were implemented using a rapid-cycle improvement model. Routine stoma assessments by a nurse who specializes in wound, ostomy, and continence care were implemented at set points, and patient education on PEG tube care and maintenance was reinforced at each session. Results demonstrated a significant reduction in moderate-to-severe tube and stoma-site-related complication. Implementation of a similar standardized education and assessment pathway in patients with percutaneous endoscopic gastrostomy tubes may lead to a decrease in stoma-site-related complications and overall better patient self-management.

Development and prospective validation of a scoring system for the Basic Endoscopic Skills Training (BEST) box.

AIMS: The increased use of endoscopy as a minimally invasive therapeutic technique has created a great demand for endoscopic training. The Basic Endoscopic Skills Training (BEST) box provides a low-cost solution by adapting the Fundamentals of Laparoscopic Surgery (FLS) box for flexible endoscopic simulation. The BEST box consists of six endoscopic tasks with a 5-min time limit per task. This study aims to develop a scoring system for objective evaluation of user performance. METHODS: A total of 165 participants were tested on the BEST box. Participants were divided into two groups: retrospective analysis (n = 100) and prospective analysis (n = 65). From the retrospective group, 55 individuals were also scored on the Global Assessment of Gastrointestinal Endoscopic Skills-Upper Endoscopy (GAGES-UE). Linear regression between user performance on BEST box and GAGES-UE was performed to develop the scoring system. Receiver Operating Characteristic curve was used to determine a threshold score to help users appreciate their endoscopic expertise. Prospective scoring of 65 individuals was then performed using the formula developed (20 experts and 45 trainees). RESULTS: The minimum and maximum possible scores are 30 and 110, respectively. Retrospective analysis showed that the scoring system was able to distinguish between experts and trainees (p < 0.001), correlated with GAGES-UE (p < 0.001), and had a reliability constant of r = 0.765 (p < 0.001). On prospective testing using the scoring system the expert group received a final average score of 92, whereas the average score for the trainee group was 61 (p < 0.001). CONCLUSIONS: The developed BEST box scoring system correlates with the experience level of the test taker as well as with the GAGES-UE scoring system. The results of this study add further evidence to the validity of the BEST box as an effective, low-cost endoscopic simulator with the scores used by trainees to track their performance level overtime.

Utilization of the 2017 diagnostic criteria for hEDS by the Toronto GoodHope Ehlers-Danlos syndrome clinic: A retrospective review.

The new 2017 diagnostic criteria for hypermobile Ehlers-Danlos Syndrome (hEDS) provide a framework for diagnosing hEDS but are more stringent than the previous Villefranche criteria. Our clinical experience at the GoodHope EDS clinic was that the 2017 criteria left many highly symptomatic patients without a diagnosis of hEDS. We conducted a retrospective cohort study to confirm our clinic experience and assess the accuracy of the 2017 diagnostic criteria for hEDS in patients who had a previous hEDS diagnosis based on the Villefranche criteria. Our study found that 15% (n = 20 of 131) of patients with a prior diagnosis of hEDS met the 2017 diagnostic criteria, and many of the traits used to distinguish hEDS were not significantly more frequent in patients who met 2017 criteria versus those who did not. In both groups objective systemic manifestations were found less frequently than subjective systemic manifestations. Beighton score (BS) as assessed by primary care practitioner was found to be higher than assessment by EDS practitioner in 81% (n = 74 of 91) of cases. Generalized joint hypermobility was confirmed in only 46% (n = 51 of 111) of patients who had a previous diagnosis of hEDS. Higher BS did not correlate with increased number of systemic manifestations in our cohort. Common comorbidities of hEDS were found with similar frequency in those who met 2017 criteria and those who did not. Based on our cohort, the 2017 hEDS diagnostic criteria require refinement to improve its diagnostic accuracy.

In-Vivo and Ex-Vivo Measurements of Blood Glucose Using Whispering Gallery Modes.

The permittivity of blood glucose is not a strong function of its concentration in microwave or millimeter-wave frequencies. Measuring glucose concentrations remains a challenge, particularly in the presence of interference caused by the ambient leaky waves. In this paper, however, we demonstrate that a near-linear correlation between the glucose concentration and the blood permittivity was noticeably observed at a whispering gallery mode resonance. METHOD: the proposed sensor was a vacuum suction aspirator partially wounded with a turn of the Goubau line. This arrangement enabled a fixed cylindrical volume of a skin tissue bump or glucose/water solution to be formed and used as a whispering gallery resonator for in-vivo and ex-vivo measurements. RESULTS: in the in-vivo study, a near-linear correlation between the glucose levels and the S21 parameters was noticeably observed at the fundamental whispering gallery resonance (i.e., at 2.18 GHz). In the ex-vivo study, a similar correlation was observed between the concentration of a glucose/water solution and the S21 parameters 56.6 GHz. CONCLUSION: the results of both investigations were consistent not only with the invasive measurements using the Accu-checkTM, but also with the conclusion drawn by some other research groups who have successfully measured blood glucose concentrations at millimeter-wave frequencies.

Efficacy and Safety of Eluxadoline in Patients With Irritable Bowel Syndrome With Diarrhea Who Report Inadequate Symptom Control With Loperamide: RELIEF Phase 4 Study.

OBJECTIVES: Irritable bowel syndrome with diarrhea (IBS-D) is a functional gastrointestinal disorder with limited effective treatment options. We evaluated the efficacy and safety of eluxadoline in patients with IBS-D who reported inadequate symptom control with prior loperamide. METHODS: Three hundred forty-six adults with IBS-D (Rome III criteria) were randomly assigned to placebo or eluxadoline 100 mg twice daily for 12 weeks. Patients recorded daily IBS-D symptoms, including worst abdominal pain (WAP) and stool consistency (through Bristol Stool Scale). The primary endpoint was proportion of composite responders, defined as patients who met daily composite response criteria (≥40% WAP improvement and <5 Bristol Stool Scale score) for at least 50% of treatment days, and recorded ≥60 days of diary entries over the 12-week period. RESULTS: Over 12 weeks, a significantly greater proportion of eluxadoline patients achieved the primary composite responder endpoint compared to placebo (22.7% vs 10.3%, P = 0.002), and component endpoints of improvements in stool consistency (27.9% vs 16.7%, P = 0.01) and WAP (43.6% vs 31.0%, P = 0.02). Additionally, a greater proportion of eluxadoline patients met the composite responder endpoint assessed at monthly intervals compared to placebo (weeks 1-4: 14.0% vs 6.9%, P = 0.03; weeks 5-8: 26.7% vs 14.9%, P = 0.006; weeks 9-12: 30.8% vs 16.7%, P = 0.002). Rates of adverse events were comparable in both groups (37.4% vs 35.3%); no treatment-related serious adverse event, cases of sphincter of Oddi spasm, or pancreatitis were reported. DISCUSSION: Eluxadoline appears safe and effective for treating IBS-D symptoms in patients with an intact gallbladder reporting inadequate relief with prior loperamide use.

Adaptation of the fundamentals of laparoscopic surgery box for endoscopic simulation: performance evaluation of the first 100 participants.

BACKGROUND: The paucity of readily accessible, cost-effective models for the simulation, practice, and evaluation of endoscopic skills present an ongoing barrier for resident training. We have previously described a system for conversion of the Fundamentals of Laparoscopic Surgery box (FLS) for flexible endoscopic simulation. Six endoscopic tasks focusing on scope manipulation, and other clinically relevant endoscopic skills are performed within a 5-min time limit per task. This study describes our experience and validation results with the first 100 participants. METHODS: A total of 100 participants were evaluated on the simulator. Thirty individuals were classified as experts (having done over 200 endoscopic procedures), and 70 were classified as trainees (39 individuals reported having no prior endoscopy experience). Of the 100 participants, 55 individuals were retested on the simulator within a period of 4 months. These 55 individuals were also evaluated using the "Global Assessment of Gastrointestinal Endoscopic Skills" (GAGES). T-tests and Pearson correlations were used where appropriate, values less than 0.05 were considered significant. RESULTS: Experts completed all six tasks significantly faster than trainees. For the 55 participants who were retested on the simulator, all tasks demonstrated evidence of test-retest reliability for both experts and trainees who did not practice in between tests. Moderate correlations between lower completion times and higher GAGES scores were observed for all tasks except the clipping task. CONCLUSIONS: The results from the first 100 participants provide evidence for the simulator's validity. Based on task completion times, we found that experts perform significantly better than trainees. Additionally, preliminary data demonstrate evidence of test-retest reliability, as well as GAGES score correlation. Additional studies to determine and validate a scoring system for this simulator are ongoing.

Realization of Low Profile Leaky Wave Antennas Using the Bending Technique for Frequency Scanning and Sensor Applications.

This paper proposes an efficient transmission line modulation by using the bending technique to realize low profile leaky wave antennas in the Ku-band for frequency scanning and sensor applications. The paper focuses mainly on the bending effects of the transmission line in terms of the sharpness of edges. The right-hand/left-hand transmission line can be designed in the form of zig-zag pattern with sharp corners and only the right-hand transmission line in the form of sinusoidal patterns with smooth corners. In this presentation, we demonstrate that transmission lines of this kind can be used to realize highly efficient leaky wave antennas with broadband impedance matching and high gain characteristics in the Ku-band. Dispersion analysis and ladder network analysis have been performed for investigating the performance of the proposed designs. The sharpness of the bends periodically distributed along the body of the antenna has been used to our advantage for frequency scanning in the left-hand and right-hand quadrants at different frequencies. The proposed bending technique has been proven to be instrumental in achieving the desired characteristics of low profile leaky wave antennas.

Feasibility of adapting the fundamentals of laparoscopic surgery trainer box to endoscopic skills training tool.

BACKGROUND: The fundamentals of laparoscopic surgery (FLS) training box is a validated tool, already accessible to surgical trainees to hone their laparoscopic skills. We aim to investigate the feasibility of adapting the FLS box for the practice and assessment of endoscopic skills. This would allow for a highly available, reusable, low-cost, mechanical trainer. METHODS: The design and development process was based on a user-centered design, which is a combination of the design thinking method and cognitive task analysis. The process comprises four phases: empathy, cognitive, prototyping/adaptation, and end user testing. The underlying idea was to utilize as many of the existing components of FLS training to maintain simplicity and cost effectiveness while allowing for the practice of clinically relevant endoscopic skills. A sample size of 18 participants was calculated to be sufficient to detect performance differences between experts and trainees using a two tailed t test with alpha set at 0.05, standard deviation of 5.5, and a power of 80%. RESULTS: Adaptation to the FLS box included two fundamental attachments: a front panel with an insertion point for an endoscope and a shaft which provides additional support and limits movement of the scope. The panel also allows for mounting of retroflexion tasks. Six endoscopic tasks inspired by FLS were designed (two of which utilize existing FLS components). Pilot testing with 38 participants showed high user's satisfaction and demonstrated that the trainer was robust and reliable. Task performance times was able to discriminate between trainees and experts for all six tasks. CONCLUSIONS: A mechanical, reusable, low-cost adaptation of the FLS training box for endoscopic skills is feasible and has high user satisfaction. Preliminary testing shows that the simulator is able to discriminate between trainees and experts. Following further validation, this adaptation may act as a supplement to the FES program.

Safety and efficacy of POEM for treatment of achalasia: a systematic review of the literature.

INTRODUCTION: Peroral endoscopic myotomy (POEM) is a novel intervention for the treatment of achalasia, which combines the advantages of endoscopic access and myotomy. The purpose of this study was to perform a systematic review of the literature to evaluate the efficacy and safety of POEM. METHODS: The systematic review was conducted following the PRISMA guidelines. Evidence-Based Medicine Reviews, Cochrane Central Register of Controlled Trials, Ovid MEDLINE (R) including in-process and non-indexed citations were searched for POEM studies using the keywords: esophageal achalasia, POEM, endoscopy, natural orifice surgery, laparoscopic Heller myotomy (LHM), and related terms. Eckardt score, lower esophageal sphincter (LES) pressure, and reported complications were the main outcomes. Two authors reviewed the search result independently. A third reviewer resolved all disagreements. Data abstraction was pilot-tested and approved by all authors. Data were examined for clinical, methodological, and statistical heterogeneity with the aim of determining whether evidence synthesis using meta- analysis was possible. RESULTS: The search strategy retrieved 2894 citations. After removing duplicates and applying the exclusion criteria, 54 studies were selected for full-text review of which a total of 19 studies were considered eligible for further analysis. There were 10 retrospective and 9 prospective studies, including 1299 POEM procedures. No randomized control trial (RCT) was identified. Overall, the pre- and post-POEM Eckardt scores and LES pressure were significantly different. The most frequently reported complications were mucosal perforation, subcutaneous emphysema, pneumoperitoneum, pneumothorax, pneumomediastinum, pleural effusion, and pneumonia. The median follow-up was 13 months (range 3-24). CONCLUSION: POEM is a safe and effective alternative for the treatment of achalasia. However, only short-term follow-up data compared with LHM are available. RCTs and long-term follow-up studies are needed to establish the efficacy and safety of POEM in the management of patients with achalasia.

The effect of prophylactic percutaneous endoscopic gastrostomy (PEG) tube placement on swallowing and swallow-related outcomes in patients undergoing radiotherapy for head and neck cancer: a systematic review.

Patients undergoing radiotherapy for head and neck cancer (HNC) often experience malnutrition and dehydration during treatment. As a result, some centres place PEG tubes prophylactically (pPEG) to prevent these negative consequences. However, recent research has suggested that pPEG use may negatively affect swallowing physiology, function and/or quality of life, especially in the long term. The purpose of this study was to systematically review the literature on pPEG use in HNC patients undergoing radiotherapy and to determine its impact on swallowing-related outcomes. The following electronic databases were searched for all relevant primary research published through February 24, 2014: AMED, CINAHL, the Cochrane Library, Embase, Healthstar, Medline, and PsycINFO. Main search terms included HNC, radiotherapy, deglutition disorders, feeding tube(s), and prophylactic or elective. References for all accepted papers were hand searched to identify additional relevant research. Methodological quality was assessed using Cochrane's Risk of Bias. At all levels, two blinded raters provided judgments. Discrepancies were resolved by consensus. The search retrieved 181 unique citations. Twenty studies met our inclusion criteria. Quality assessment revealed that all studies were at risk for bias due to non-randomized sampling and unreported or inadequate blinding. Ten studies demonstrated selection bias with significant baseline differences between pPEG patients and controls. Results regarding the frequency and severity of dysphagia and swallowing-related outcomes were varied and inconclusive. The impact of pPEG use on swallowing and swallowing-related outcomes remains unclear. Well-controlled, randomized trials are needed to determine if pPEG places patients at greater risk for developing long-term dysphagia.

Alimentary, my dear Watson? The challenges of enteric α-synuclein as a Parkinson's disease biomarker.

An accurate early diagnostic test for Parkinson's disease (PD) is a critical unmet need. Recently, independent groups using different histological techniques have reported that the presence of alpha-synuclein (α-syn) in colonic biopsy tissue is able to distinguish living patients with PD from those without the disease. In addition, a further study has suggested that the presence of α-syn in colonic biopsy tissue may be evident in early or even prodromal PD. However, several questions remain regarding the translation of these findings into using the assessment of α-syn deposition in the enteric nervous system as a diagnostic biomarker for prodromal PD. Here we address critical issues related to the location and quantification of enteric α-syn, detection of α-syn with currently available histological techniques, timing of detection of α-syn deposition, and, most crucially, whether enteric α-syn can distinguish those with PD from both healthy individuals and individuals with other related diseases. We conclude that, although enteric α-syn is a very exciting prospect, further studies will be vital to determine whether enteric α-syn deposition has the potential to be the biomarker for prodromal PD that the field so desperately seeks.

Validation of a mathematical model for ultrasound assessment of gastric volume by gastroscopic examination.

INTRODUCTION: Pulmonary aspiration of gastric contents is a serious perioperative complication. Previous models of ultrasound gastric volume assessment are preliminary and have not been validated by an external "gold standard." In the present study we propose a more accurate model based on prospective data obtained from 108 patients undergoing bedside gastric sonography and upper gastrointestinal endoscopy (UGE). METHODS: Patients undergoing elective UGE were randomized to ingest one of 6 predetermined volumes of apple juice after an 8-hour fasting period. A cross-sectional area of the antrum in the right lateral decubitus position (Right lat CSA) was measured by a blinded sonographer following a standardized scanning protocol. Gastric fluid was subsequently suctioned under gastroscopic vision during UGE performed by a blinded gastroenterologist and measured to the nearest milliliter. RESULTS: Data from 108 patients suggest that a previously reported model tends to overestimate gastric volume particularly at low volume states. A new best fit mathematical model to predict gastric fluid volume based on measurements of Right lat CSA is presented. This new model built on a more accurate gold standard can be used to estimate gastric volumes from 0 to 500 mL, in nonpregnant adults with body mass index<40 kg/m2. CONCLUSIONS: We report a new prediction model to assess gastric fluid volume using standard 2-dimentional bedside ultrasound that has several advantages over previously reported models.

Oesophageal stasis is a risk factor for chronic lung allograft dysfunction and allograft failure in lung transplant recipients.

Background: Morbidity and mortality in lung transplant recipients are often triggered by recurrent aspiration events, potentiated by oesophageal and gastric disorders. Previous small studies have shown conflicting associations between oesophageal function and the development of chronic lung allograft dysfunction (CLAD). Herein, we sought to investigate the relationship between oesophageal motility disorders and long-term outcomes in a large retrospective cohort of lung transplant recipients. Methods: All lung transplant recipients at the Toronto Lung Transplant Program from 2012 to 2018 with available oesophageal manometry testing within the first 7 months post-transplant were included in this study. Patients were categorised according to the Chicago Classification of oesophageal disorders (v3.0). Associations between oesophageal motility disorders with the development of CLAD and allograft failure (defined as death or re-transplantation) were assessed. Results: Of 487 patients, 57 (12%) had oesophagogastric junction outflow obstruction (OGJOO) and 47 (10%) had a disorder of peristalsis (eight major, 39 minor). In a multivariable analysis, OGJOO was associated with an increased risk of CLAD (HR 1.71, 95% CI 1.15-2.55, p=0.008) and allograft failure (HR 1.69, 95% CI 1.13-2.53, p=0.01). Major disorders of peristalsis were associated with an increased risk of CLAD (HR 1.55, 95% CI 1.01-2.37, p=0.04) and allograft failure (HR 3.33, 95% CI 1.53-7.25, p=0.002). Minor disorders of peristalsis were not significantly associated with CLAD or allograft failure. Conclusion: Lung transplant recipients with oesophageal stasis characterised by OGJOO or major disorders of peristalsis were at an increased risk of adverse long-term outcomes. These findings will help with risk stratification of lung transplant recipients and personalisation of treatment for aspiration prevention.

Variable or Fixed? Exploring Entrustment Decision Making in Workplace- and Simulation-Based Assessments.

PURPOSE: Many models of competency-based medical education (CBME) emphasize assessing entrustable professional activities (EPAs). Despite the centrality of EPAs, researchers have not compared rater entrustment decisions for the same EPA across workplace- and simulation-based assessments. This study aimed to explore rater entrustment decision making across these 2 assessment settings. METHOD: An interview-based study using a constructivist grounded theory approach was conducted. Gastroenterology faculty at the University of Toronto and the University of Calgary completed EPA assessments of trainees' endoscopic polypectomy performance in both workplace and simulation settings between November 2019 and January 2021. After each assessment, raters were interviewed to explore how and why they made entrustment decisions within and across settings. Transcribed interview data were coded iteratively using constant comparison to generate themes. RESULTS: Analysis of 20 interviews with 10 raters found that participants (1) held multiple meanings of entrustment and expressed variability in how they justified their entrustment decisions and scoring, (2) held personal caveats for making entrustment decisions "comfortably" (i.e., authenticity, task-related variability, opportunity to assess trainee responses to adverse events, and the opportunity to observe multiple performances over time), (3) experienced cognitive tensions between formative and summative purposes when assessing EPAs, and (4) experienced relative freedom when using simulation to formatively assess EPAs but constraint when using only simulation-based assessments for entrustment decision making. CONCLUSIONS: Participants spoke about and defined entrustment variably, which appeared to produce variability in how they judged entrustment across participants and within and across assessment settings. These rater idiosyncrasies suggest that programs implementing CBME must consider how such variability affects the aggregation of EPA assessments, especially those collected in different settings. Program leaders might also consider how to fulfill raters' criteria for comfortably making entrustment decisions by ensuring clear definitions and purposes when designing and integrating workplace- and simulation-based assessments.