Ensuring best practice in genomics education: A theory- and empirically informed evaluation framework.

Implementation of genomic medicine into healthcare requires a workforce educated through effective educational approaches. However, ascertaining the impact of genomics education activities or resources is limited by a lack of evaluation and inconsistent descriptions in the literature. We aim to support those developing genomics education to consider how best to capture evaluation data that demonstrate program outcomes and effectiveness within scope. Here, we present an evaluation framework that is adaptable to multiple settings for use by genomics educators with or without education or evaluation backgrounds. The framework was developed as part of a broader program supporting genomic research translation coordinated by the Australian Genomics consortium. We detail our mixed-methods approach involving an expert workshop, literature review and iterative expert input to reach consensus and synthesis of a new evaluation framework for genomics education. The resulting theory-informed and evidence-based framework encompasses evaluation across all stages of education program development, implementation and reporting, and acknowledges the critical role of stakeholders and the effects of external influences.

Ensuring best practice in genomics education: A scoping review of genomics education needs assessments and evaluations.

A health workforce capable of implementing genomic medicine requires effective genomics education. Genomics education interventions developed for health professions over the last two decades, and their impact, are variably described in the literature. To inform an evaluation framework for genomics education, we undertook an exploratory scoping review of published needs assessments for, and/or evaluations of, genomics education interventions for health professionals from 2000 to 2023. We retrieved and screened 4,659 records across the two searches with 363 being selected for full-text review and consideration by an interdisciplinary working group. 104 articles were selected for inclusion in the review-60 needs assessments, 52 genomics education evaluations, and eight describing both. Included articles spanned all years and described education interventions in over 30 countries. Target audiences included medical specialists, nurses/midwives, and/or allied health professionals. Evaluation questions, outcomes, and measures were extracted, categorized, and tabulated to iteratively compare measures across stages of genomics education evaluation: planning (pre-implementation), development and delivery (implementation), and impact (immediate, intermediate, or long-term outcomes). They are presented here along with descriptions of study designs. We document the wide variability in evaluation approaches and terminology used to define measures and note that few articles considered downstream (long-term) outcomes of genomics education interventions. Alongside the evaluation framework for genomics education, results from this scoping review form part of a toolkit to help educators to undertake rigorous genomics evaluation that is fit for purpose and can contribute to the growing evidence base of the contribution of genomics education in implementation strategies for genomic medicine.

Analysis of the Infectious Diseases Fellowship Program Directors Postmatch 2023 Survey.

The 2023 United States infectious diseases (ID) fellowship match resulted in a large percentage of programs with unfilled positions. A survey was sent to ID program directors nationwide to better understand their perceptions on the match. Program directors perceived geography, a small applicant pool, and low specialty pay as contributing factors to the match results. Developing specialized fellowship tracks, increasing funding for the ID trainee pipeline, and national advocacy for higher compensation were identified as areas to focus on to increase the applicant pool. Areas of controversy, such as decreasing the number or size of fellowship programs, require further discussion.

The Leaders in Epidemiology, Antimicrobial Stewardship, and Public Health (LEAP) Fellowship, a Novel Training Program in Public Health for Infectious Diseases Physicians.

The severe acute respiratory syndrome coronavirus 2 pandemic demonstrated a critical need for partnerships between practicing infectious diseases (ID) physicians and public health departments. The soon-to-launch combined ID and Epidemic Intelligence Service fellowship can only address a fraction of this need, and otherwise US ID training lacks development pathways for physicians aiming to make careers working with public health departments. The Leaders in Epidemiology, Antimicrobial Stewardship, and Public Health (LEAP) fellowship is a model compatible with the current training paradigm with a proven track record of developing careers of long-term collaboration. Established in 2017 by the ID Society of America, Society for Healthcare Epidemiology of America, Pediatric ID Society, and supported by the Centers for Disease Control and Prevention, LEAP is a single-year in-place, structured training for senior trainees and early career ID physicians. In this viewpoint, we describe the LEAP fellowship, its outcomes, and how it could be adapted into ID training.

Optimising the diagnostic accuracy of First post-contrAst SubtracTed breast MRI (FAST MRI) through interpretation-training: a multicentre e-learning study, mapping the learning curve of NHS Breast Screening Programme (NHSBSP) mammogram readers using an enriched dataset.

BACKGROUND: Abbreviated breast MRI (FAST MRI) is being introduced into clinical practice to screen women with mammographically dense breasts or with a personal history of breast cancer. This study aimed to optimise diagnostic accuracy through the adaptation of interpretation-training. METHODS: A FAST MRI interpretation-training programme (short presentations and guided hands-on workstation teaching) was adapted to provide additional training during the assessment task (interpretation of an enriched dataset of 125 FAST MRI scans) by giving readers feedback about the true outcome of each scan immediately after each scan was interpreted (formative assessment). Reader interaction with the FAST MRI scans used developed software (RiViewer) that recorded reader opinions and reading times for each scan. The training programme was additionally adapted for remote e-learning delivery. STUDY DESIGN: Prospective, blinded interpretation of an enriched dataset by multiple readers. RESULTS: 43 mammogram readers completed the training, 22 who interpreted breast MRI in their clinical role (Group 1) and 21 who did not (Group 2). Overall sensitivity was 83% (95%CI 81-84%; 1994/2408), specificity 94% (95%CI 93-94%; 7806/8338), readers' agreement with the true outcome kappa = 0.75 (95%CI 0.74-0.77) and diagnostic odds ratio = 70.67 (95%CI 61.59-81.09). Group 1 readers showed similar sensitivity (84%) to Group 2 (82% p = 0.14), but slightly higher specificity (94% v. 93%, p = 0.001). Concordance with the ground truth increased significantly with the number of FAST MRI scans read through the formative assessment task (p = 0.002) but by differing amounts depending on whether or not a reader had previously attended FAST MRI training (interaction p = 0.02). Concordance with the ground truth was significantly associated with reading batch size (p = 0.02), tending to worsen when more than 50 scans were read per batch. Group 1 took a median of 56 seconds (range 8-47,466) to interpret each FAST MRI scan compared with 78 (14-22,830, p < 0.0001) for Group 2. CONCLUSIONS: Provision of immediate feedback to mammogram readers during the assessment test set reading task increased specificity for FAST MRI interpretation and achieved high diagnostic accuracy. Optimal reading-batch size for FAST MRI was 50 reads per batch. Trial registration (25/09/2019): ISRCTN16624917.

Randomized controlled trial demonstrates novel tools to assess patient outcomes of Indigenous cultural safety training.

BACKGROUND: Health care routinely fails Indigenous peoples and anti-Indigenous racism is common in clinical encounters. Clinical training programs aimed to enhance Indigenous cultural safety (ICS) rely on learner reported impact assessment even though clinician self-assessment is poorly correlated with observational or patient outcome reporting. We aimed to compare the clinical impacts of intensive and brief ICS training to control, and to assess the feasibility of ICS training evaluation tools, including unannounced Indigenous standardized patient (UISP) visits. METHOD: Using a prospective parallel group three-arm randomized controlled trial design and masked standardized patients, we compared the clinical impacts of the intensive interactive, professionally facilitated, 8- to10-h Sanyas ICS training; a brief 1-h anti-bias training adapted to address anti-Indigenous bias; and control continuing medical education time-attention matched to the intensive training. Participants included 58 non-Indigenous staff physicians, resident physicians and nurse practitioners from family practice clinics, and one emergency department across four teaching hospitals in Toronto, Canada. Main outcome measures were the quality of care provided during UISP visits including adjusted odds that clinician would be recommended by the UISP to a friend or family member; mean item scores on patient experience of care measure; and clinical practice guideline adherence for NSAID renewal and pain assessment. RESULTS: Clinicians in the intensive or brief ICS groups had higher adjusted odds of being highly recommended to friends and family by standardized patients (OR 6.88, 95% CI 1.17 to 40.45 and OR 7.78, 95% CI 1.05 to 58.03, respectively). Adjusted mean item patient experience scores were 46% (95% CI 12% to 80%) and 40% (95% CI 2% to 78%) higher for clinicians enrolled in the intensive and brief training programs, respectively, compared to control. Small sample size precluded detection of training impacts on clinical practice guideline adherence; 100% of UISP visits were undetected by participating clinicians. CONCLUSIONS: Patient-oriented evaluation design and tools including UISPs were demonstrated as feasible and effective. Results show potential impact of cultural safety training on patient recommendation of clinician and improved patient experience. A larger trial to further ascertain impact on clinical practice is needed. TRIAL REGISTRATION: Clinicaltrials.org NCT05890144. Retrospectively registered on June 5, 2023.

Mind the implementation gap: a systems analysis of the NHS Long Term Workforce Plan to increase the number of doctors trained in the UK raises many questions.

BACKGROUND: The National Health Service (NHS) in England is facing a workforce crisis. A new Long Term Workforce Plan (LTWP) seeks to address this, setting out ambitious proposals to expand and reform domestic medical education and training in England. However, there are concerns about their feasibility. SOURCES OF DATA: In September 2023, over 60 individuals representing medical education and training in the UK participated in an exercise run by UK Medical Schools Council by using systems theory to identify risks. AREAS OF AGREEMENT: The UK does need more 'home grown' doctors, but the LTWP has important gaps, including lack of attention to postgraduate training, absence of reference to the need for more educators and capital investment and risk of inadequate clinical placement capacity, particularly in primary care settings. AREAS OF CONTROVERSY: There are unresolved differences in the understanding of a proposed medical apprenticeship model and no scheme has, as yet, been approved by the General Medical Council. Participants were unable to determine who the beneficiaries of this scheme will be (apart from the apprentices themselves). GROWING POINTS: While the LTWP represents a welcome, although overdue, commitment to address the NHS workforce crisis, we identified significant gaps that must be resolved. AREAS TIMELY FOR DEVELOPING RESEARCH: First, the development of the LTWP provides a case study that adds to literature on policymaking in the UK. Second, while we only examined the expansion of medical training, the method could be applied to other parts of the LTWP. Third, a prospective evaluation of its implementation is necessary.

Deliberate Practice as an Effective Method for Reducing Diagnostic Error in Identifying Burn and Bruise Injuries Suspicious for an Abusive Injury.

OBJECTIVES: To examine the effectiveness of an education intervention for reducing physician diagnostic error in identifying pediatric burn and bruise injuries suspicious for abuse, and to determine case-specific variables associated with an increased risk of diagnostic error. STUDY DESIGN: This was a multicenter, prospective, cross-sectional study. A convenience sample of pediatricians and other front-line physicians who treat acutely injured children in the United States and Canada were eligible for participation. Using a web-based education and assessment platform, physicians deliberately practiced with a spectrum of 300 pediatric burn and bruise injury image-based cases. Participants were asked if there was a suspicion for abuse present or absent, were given corrective feedback after every case, and received summative diagnostic performance overall (accuracy), suspicion for abuse present (sensitivity), and absent (specificity). RESULT: Of the 93/137 (67.9%) physicians who completed all 300 cases, there was a significant reduction in diagnostic error (initial 16.7%, final 1.6%; delta -15.1%; 95% CI 13.5, 16.7), sensitivity error (initial 11.9%, final 0.7%; delta -11.2%; 95% CI 9.8, 12.5), and specificity error (initial 23.3%, final 6.6%; delta -16.7%; 95% CI 14.8, 18.6). Based on 35,627 case interpretations, variables associated with diagnostic error included patient age, sex, skin color, mechanism of injury, and size and pattern of injury. CONCLUSION: The education intervention substantially reduced diagnostic error in differentiating the presence versus absence of a suspicion for abuse in children with burn and bruise injuries. Several case-based variables were associated with diagnostic error, and these data can be used to close specific skill gaps in this clinical domain.

One Step Closer to Safer: Counseling Outcomes from American Academy of Pediatrics Firearm Safe Storage Education Training.

OBJECTIVE: To assess pre and postself-reported counseling outcomes for Safer: Storing Firearms Prevents Harm, an American Academy of Pediatrics universal firearm safe storage counseling training for pediatric clinicians providing health maintenance in outpatient settings. STUDY DESIGN: Safer was developed by a national multidisciplinary committee of firearm injury prevention experts with input from firearm-owning families and launched in June 2021. Pediatric clinicians completed baseline and 1-month posttraining surveys after signing up for the Pedialink course from February through June 2022. Primary outcomes included self-reported measures of counseling self-efficacy and frequency. Wilcoxon matched-pairs signed-rank tests compared outcome distributions at baseline and follow-up. Two adjusted, multilevel mixed-effects regression models were conducted. RESULTS: Of 230 clinicians who completed baseline surveys, 146 (64%) completed 1-month postsurveys. Regional representation included Southeast = 67 (46%), Northeast = 24 (16%), Midwest = 21 (14%), Pacific = 15 (10%), Southwest = 11 (8%), and Rocky Mountain = 8 (5%). At follow-up, there was significant improvement in both the distribution of self-efficacy (median [first Quartile-third Quartile = 50 [20-70] at baseline and 80 [60-85] at follow-up; P < .001) and self-reported counseling frequency (median [first Quartile-third Quartile] = 10 [0-50] at baseline and 50 [10-80] at follow-up; P < .001). Adjusted regression model results suggested that self-efficacy significantly improved from baseline to follow-up (time coefficient 25.3; 95% CI = [21.0, 29.5]; P < .001) as did counseling frequency (time coefficient 13.6; 95% CI = [9.2, 18.0]; P < .001). CONCLUSIONS: Significant improvement in self-reported counseling self-efficacy and frequency was demonstrated 1 month following Safer training.

Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study.

OBJECTIVES: Musculoskeletal ultrasound (MSUS) is increasingly used by rheumatologists in daily clinical practice. However, MSUS is only valuable in trained hands, and assessment of trainee competences is therefore essential before independent practice. Thus, this study aimed to establish validity evidence for the EULAR and the Objective Structured Assessment of Ultrasound Skills (OSAUS) tools used for assessing MSUS competences. METHODS: Thirty physicians with different levels of MSUS experience (novices, intermediates, and experienced) performed four MSUS examinations of different joint areas on the same rheumatoid arthritis patient. All examinations were video recorded (n = 120), anonymized, and subsequently assessed in random order by two blinded raters using first the OSAUS assessment tool followed by the EULAR tool 1 month after. RESULTS: The inter-rater reliability between the two raters was high for both the OSAUS and EULAR tools, with a Pearson correlation coefficient (PCC) of 0.807 and 0.848, respectively. Both tools demonstrated excellent inter-case reliability, with a Cronbach's alpha of 0.970 for OSAUS and 0.964 for EULAR. Furthermore, there was a strong linear correlation between the OSAUS and the EULAR performance scores and the participants' experience levels (R2 = 0.897 and R2 = 0.868, respectively) and a significant discrimination between different MSUS experience levels (P < 0.001 for both). CONCLUSIONS: MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS. TRIAL REGISTRATION: ClinicalTrials.gov, http://clinicaltrials.gov, NCT05256355.

A prospective survey on therapeutic inertia in psoriatic arthritis (OPTI'PsA).

OBJECTIVES: Clinical inertia, or therapeutic inertia (TI), is the medical behaviour of not initiating or intensifying treatment when recommended by clinical recommendations. To our knowledge, our survey is the first to assess TI around psoriatic arthritis (PsA). METHODS: Eight hundred and twenty-five French rheumatologists were contacted via email between January and March 2021 and invited to complete an online questionnaire consisting of seven clinical vignettes: five cases ('oligoarthritis', 'enthesitis', 'polyarthritis', 'neoplastic history', 'cardiovascular risk') requiring treatment OPTImization, and two 'control' cases (distal interphalangeal arthritis, atypical axial involvement) not requiring any change of treatment-according to the most recent PsA recommendations. Rheumatologists were also questioned about their routine practice, continuing medical education and perception of PsA. RESULTS: One hundred and one rheumatologists completed this OPTI'PsA survey. Almost half the respondents (47%) demonstrated TI on at least one of the five vignettes that warranted treatment optimization. The complex profiles inducing the most TI were 'oligoarthritis' and 'enthesitis' with 20% and 19% of respondents not modifying treatment, respectively. Conversely, clinical profiles for which there was the least uncertainty ('polyarthritis in relapse', 'neoplastic history' and 'cardiovascular risk') generated less TI with 11%, 8% and 6% of respondents, respectively, choosing not to change the current treatment. CONCLUSION: The rate of TI we observed for PsA is similar to published data for other chronic diseases such as diabetes, hypertension, gout or multiple sclerosis. Our study is the first to show marked clinical inertia in PsA, and further research is warranted to ascertain the reasons behind this inertia.

Development and validation of a new tool for assessment of trainees' interventional musculoskeletal ultrasound skills.

OBJECTIVES: Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. METHODS: An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills (AIMUS) tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber fantom, simulating real patient cases. All performances were video recorded, anonymized, and assessed in random order by two blinded raters using the AIMUS tool. RESULTS: Sixty-five physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach's alpha of 0.96. The inter-case reliability was good with a Pearson's correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (p< 0.001). CONCLUSIONS: We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programs, provide structured feedback to trainees in daily clinical practice, and ensure end-of-training competence.

A Systematic Review of Ophthalmology Education in Medical Schools: The Global Decline.

TOPIC: This systematic review examined geographical and temporal trends in medical school ophthalmology education in relationship to course and student outcomes. CLINICAL RELEVANCE: Evidence suggesting a decline in ophthalmology teaching in medical schools is increasing, raising concern for the adequacy of eye knowledge across the rest of the medical profession. METHODS: Systematic review of Embase and SCOPUS, with inclusion of studies containing data on medical school ophthalmic course length; 1 or more outcome measures on student ophthalmology knowledge, skills, self-evaluation of knowledge or skills, or student course appraisal; or both. The systematic review was registered prospectively on the International Prospective Register of Systematic Reviews (identifier, CRD42022323865). Results were aggregated with outcome subgroup analysis and description in relationship to geographical and temporal trends. Descriptive statistics, including nonparametric correlations, were used to analyze data and trends. RESULTS: Systematic review yielded 4596 publication titles, of which 52 were included in the analysis, with data from 19 countries. Average course length ranged from 12.5 to 208.7 hours, with significant continental disparity among mean course lengths. Africa reported the longest average course length at 103.3 hours, and North America reported the shortest at 36.4 hours. On average, course lengths have been declining over the last 2 decades, from an average overall course length of 92.9 hours in the 2000s to 52.9 hours in the 2020s. Mean student self-evaluation of skills was 51.3%, and mean student self-evaluation of knowledge was 55.4%. Objective mean assessment mark of skills was 57.5% and that of knowledge was 71.7%, compared with an average pass mark of 66.7%. On average, 26.4% of students felt confident in their ophthalmology knowledge and 34.5% felt confident in their skills. DISCUSSION: Most evidence describes declining length of courses devoted to ophthalmology in the last 20 years, significant student dissatisfaction with courses and content, and suboptimal knowledge and confidence. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Training pathologists to assess stromal tumour-infiltrating lymphocytes in breast cancer synergises efforts in clinical care and scientific research.

A growing body of research supports stromal tumour-infiltrating lymphocyte (TIL) density in breast cancer to be a robust prognostic and predicive biomarker. The gold standard for stromal TIL density quantitation in breast cancer is pathologist visual assessment using haematoxylin and eosin-stained slides. Artificial intelligence/machine-learning algorithms are in development to automate the stromal TIL scoring process, and must be validated against a reference standard such as pathologist visual assessment. Visual TIL assessment may suffer from significant interobserver variability. To improve interobserver agreement, regulatory science experts at the US Food and Drug Administration partnered with academic pathologists internationally to create a freely available online continuing medical education (CME) course to train pathologists in assessing breast cancer stromal TILs using an interactive format with expert commentary. Here we describe and provide a user guide to this CME course, whose content was designed to improve pathologist accuracy in scoring breast cancer TILs. We also suggest subsequent steps to translate knowledge into clinical practice with proficiency testing.

Knowledge and competences in hematological malignancies amongst radiation oncology residents in Germany-results from a national survey.

INTRODUCTION: Radiation oncology is a pivotal modality in the treatment of hematologic malignancies. To enable state-of-the-art patient care, structured education during residency is essential. However, given the lack of detailed data, the scope of educational opportunities available to trainees remains elusive. This prompted our group to perform a national survey amongst radiation oncology residents in Germany assessing the status quo of competences in the treatment of lymphoma and leukemia patients. Furthermore, areas of potential improvement were identified to further the goal of competence-based education for residents. METHODS: A survey-based analysis was conducted to assess the knowledge and competence of radiation oncology residents in Germany regarding hematological malignancies. A decisive questionnaire covering demographics, self-assessment of competences, and areas for improvement was developed in adaption of a survey by the Association of Residents in Radiation Oncology and distributed amongst 1439 members of the German Society of Radiation Oncology. Responses were collected anonymously via an online survey tool and analyzed using descriptive statistics and chi-square tests. RESULTS: A total of 59 complete and 22 partial responses were collected, yielding a 5.6% response rate. Participants' competence varied, with notable experience gaps in pediatric cases, proton therapy, and large-field techniques like total-skin irradiation or pediatric total body irradiation. While participants felt confident in treatment planning and patient counseling, they showed deficiencies in the definition of the planning target volume for modern involved site radiotherapy. Resources for education included national and international guidelines, scientific reviews, and textbooks. Board-certified radiation oncologists and physicians from specialized lymphoma centers demonstrated higher overall competence levels. CONCLUSION: This survey highlights the diversity of resident education regarding hematological malignancies in German radiation oncology programs. Knowledge gaps exist in key areas, including pediatric cases and specialized techniques. Competence-based education, interactive teaching formats, and rotations to specialized centers are potential strategies to address these gaps. The study contributes to the understanding of the federal educational landscape, underscoring the need for standardized and comprehensive training to ensure optimal patient care in hematological malignancies within the context of radiation oncology. Further research and collaborations are warranted to enhance training and expertise in this critical domain.

Successful implementation of online educational lectures of the German Society for Radiation Oncology (DEGRO).

PURPOSE: Modern digital teaching formats have become increasingly important in recent years, in part due to the COVID-19 pandemic. In January 2021, an online-based webinar series was established by the German Society for Radiation Oncology (DEGRO) and the young DEGRO (yDEGRO) working group. In the monthly 120-minute courses, selected lecturers teach curricular content as preparation for the board certification exam for radiation oncology. METHODS: The evaluation of the 24 courses between 01.2021 and 12.2022 was performed using a standardized questionnaire with 21 items (recording epidemiological characteristics of the participants, didactic quality, content quality). A Likert scale (1-4) was used in combination with binary and open-ended questions. RESULTS: A combined total of 4200 individuals (1952 in 2021 and 2248 in 2022) registered for the courses, and out of those, 934 participants (455 in 2021 and 479 in 2022) later provided evaluations for the respective courses (36% residents, 35% specialists, 21% medical technicians for radiology [MTR], 8% medical physics experts [MPE]). After 2 years, 74% of the DEGRO Academy curriculum topics were covered by the monthly webinars. The overall rating by participants was positive (mean 2021: 1.33 and 2022: 1.25) and exceeded the curriculum offered at each site for 70% of participants. Case-based learning was identified as a particularly well-rated method. CONCLUSION: The DEGRO webinar expands the digital teaching opportunities in radiation oncology. The consistently high number of participants confirms the need for high-quality teaching and underlines the advantages of e­learning methods. Optimization opportunities were identified through reevaluation of feedback from course participants. In its design as a teaching format for a multiprofessional audience, the webinar series could be used as a practice model of online teaching for other disciplines.

A Qualitative Study of Drivers for Use of the Primary Care Exception Among Internal Medicine Teaching Faculty.

BACKGROUND: The Primary Care Exception (PCE) is a billing rule from the Centers for Medicare and Medicaid Services (CMS) that allows supervising physicians to bill for ambulatory care provided by a resident without their direct supervision. There has been increased focus on entrustment as a method to assess readiness for unsupervised practice. OBJECTIVE: To understand the factors influencing attending physicians' use of the PCE in ambulatory settings and identify common themes defining what motivates faculty preceptors to use the PCE. APPROACH: This was a qualitative exploratory study. Participants were interviewed one-on-one using a semi-structured template informed by the entrustment literature. Analysis was conducted using a thematically framed, grounded theory-based approach to identify major themes and subthemes. PARTICIPANTS: Twenty-seven internal medicine teaching faculty took part in a multi-institutional study representing four residency training programs across two academic medical centers in Connecticut. KEY RESULTS: Four predominant categories of themes influencing PCE use were identified: (1) clinical environment factors, (2) attending attitudes, (3) resident characteristics, and (4) patient attributes. An attending's "internal rules" drawn from prior experiences served as a significant driver of PCE non-use regardless of the trainee, patient, or clinical context. A common conflict existed between using the PCE to promote resident autonomy versus waiving the PCE to promote safety. CONCLUSIONS: The PCE can serve as a tool to support resident autonomy, confidence, and overall clinical efficiency. Choice of PCE use by attendings involved complex internal decision-making schema balancing internal, patient, resident, and environmental-related factors. The lack of standardized processes in competency evaluation may increase susceptibility to biases, which could be mitigated by applying standardized modes of assessment that encompass shared principles.

Improving Assessment and Learning Environments for Graduate Medical Trainees to Advance Healthcare Language Equity.

Language-appropriate care is critical for equitable, high-quality health care, but educational standards to assure graduate medical trainees are prepared to give such care are lacking. Detailed guidance for graduate medical education is provided by the Accreditation Council for Graduate Medical Education through the following: (1) an assessment framework for competencies, subcompetencies, and milestones for trainees and (2) the Clinical Learning Environment Review (CLER) Pathways for assessment of trainees' learning environments. These tools do not include a robust framework to evaluate trainees' abilities to offer language-appropriate care. They also do not address the learning environment's potential to support such care. A multidisciplinary group of linguistic, medical, and educational experts drafted a new subcompetency with milestones and an expanded CLER Pathway to highlight the importance of equitable care for patients who prefer languages other than English. These resources offer residency and fellowship programs tools to guide assessment, curriculum development, and learning-environment improvements related to language-appropriate care. Recognizing that programs have unique needs and resources, we propose a range of initial actions to address language equity. A focus on language diversity in the learning environment can have a broad and lasting impact on care quality, patient safety, and health equity.

Gender Differences in Work-Based Assessment Scores and Narrative Comments After Direct Observation.

BACKGROUND: While some prior studies of work-based assessment (WBA) numeric ratings have not shown gender differences, they have been unable to account for the true performance of the resident or explore narrative differences by gender. OBJECTIVE: To explore gender differences in WBA ratings as well as narrative comments (when scripted performance was known). DESIGN: Secondary analysis of WBAs obtained from a randomized controlled trial of a longitudinal rater training intervention in 2018-2019. Participating faculty (n = 77) observed standardized resident-patient encounters and subsequently completed rater assessment forms (RAFs). SUBJECTS: Participating faculty in longitudinal rater training. MAIN MEASURES: Gender differences in mean entrustment ratings (4-point scale) were assessed with multivariable regression (adjusted for scripted performance, rater and resident demographics, and the interaction between study arm and time period [pre- versus post-intervention]). Using pre-specified natural language processing categories (masculine, feminine, agentic, and communal words), multivariable linear regression was used to determine associations of word use in the narrative comments with resident gender, race, and skill level, faculty demographics, and interaction between the study arm and the time period (pre- versus post-intervention). KEY RESULTS: Across 1527 RAFs, there were significant differences in entrustment ratings between women and men standardized residents (2.29 versus 2.54, respectively, p < 0.001) after correction for resident skill level. As compared to men, feminine terms were more common for comments of what the resident did poorly among women residents (ß 0.45, CI 0.12-0.78, p 0.01). This persisted despite adjusting for the faculty's entrustment ratings. There were no other significant linguistic differences by gender. CONCLUSIONS: Contrasting prior studies, we found entrustment rating differences in a simulated WBA which persisted after adjusting for the resident's scripted performance. There were also linguistic differences by gender after adjusting for entrustment ratings, with feminine terms being used more frequently in comments about women in some, but not all narrative comments.

Building Climate Change into Medical Education: A Society of General Internal Medicine Position Statement.

Building expertise in climate and planetary health among healthcare professionals cannot come with greater urgency as the threats from climate change become increasingly apparent. Current and future healthcare professionals-particularly internists-will increasingly need to understand the interconnectedness of natural systems and human health to better serve their patients longitudinally. Despite this, few national medical societies and accreditation bodies espouse frameworks for climate change and planetary health-related education at the undergraduate (UME), graduate (GME), and continuing (CME) medical education level. As a community of medical educators with an enduring interest in climate change and planetary health, the Society of General Internal Medicine (SGIM) recognizes the need to explicitly define structured educational opportunities and core competencies in both UME and GME as well as pathways for faculty development. In this position statement, we build from the related SGIM Climate and Health position statement, and review and synthesize existing position statements made by US-based medical societies and accreditation bodies that focus on climate change and planetary health-related medical education, identify gaps using Bloom's Hierarchy, and provide recommendations on behalf of SGIM regarding the development of climate and planetary health curricula development. Identified gaps include (1) limited systematic approach to climate and planetary health medical education at all levels; (2) minimal emphasis on learner-driven approaches; (3) limited focus on physician and learner well-being; and (4) limited role for health equity and climate justice. Recommendations include a call to relevant accreditation bodies to explicitly include climate change and planetary health as a competency, extend the structural competency framework to climate change and planetary health to build climate justice, proactively include learners in curricular development and teaching, and ensure resources and support to design and implement climate and planetary health-focused education that includes well-being and resiliency.