Potential clinical utility of 68Ga-DOTATATE PET/CT for detection and response assessment in cardiac sarcoidosis.

BACKGROUND: Somatostatin receptor is expressed in sarcoid granulomas, and preliminary clinical studies have shown that myocardial sarcoidosis can be identified on somatostatin receptor-targeted PET. We examined the potential clinical use of 68Ga-DOTATATE PET/CT for diagnosis and response assessment in cardiac sarcoidosis compared to 18F-FDG PET/CT. METHODS: Eleven cardiac sarcoidosis patients with 18F-FDG PET/CT were prospectively enrolled for cardiac 68Ga-DOTATATE PET/CT. The two PET/CT studies were interpreted independently and were compared for patient-level and segment-level concordance, as well as for the degree of radiotracer uptake. Follow-up 68Ga-DOTATATE PET/CT was performed in eight patients. RESULTS: Patient-level concordance was 91%: ten patients had multifocal DOTATATE uptake (active cardiac sarcoidosis) and one patient showed diffuse DOTATATE uptake. Segment-level agreement was 77.1% (Kappa 0.53 ± 0.07). The SUVmax-to-blood pool ratio was lower on 68Ga-DOTATATE PET/CT (3.2 ± 0.6 vs. 4.9 ± 1.5, P = 0.006 on paired t test). Follow-up 68Ga-DOTATATE PET/CT showed one case of complete response and one case of partial response, while 18F-FDG PET/CT showed four cases of response, including three with complete response. CONCLUSION: Compared to 18F-FDG PET/CT, 68Ga-DOTATATE PET/CT can identify active cardiac sarcoidosis with high patient-level concordance, but with moderate segment-level concordance, low signal-to-background ratio, and underestimation of treatment response.

The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

BACKGROUND: Despite similar performance metrics, women medical trainees routinely self-assess their own skills lower than men. The phenomenon of a "confidence gap" between genders, where women report lower self-confidence independent of actual ability or competency, may have an important interaction with gender differences in assessment. Identifying whether there are gender-based differences in how confidence is mentioned in written evaluations is a necessary step to understand the interaction between evaluation and the gender-based confidence gap. OBJECTIVE: To analyze faculty evaluations of internal medicine (IM) residents for gender-based patterns in the use of iterations of "confidence." DESIGN: We performed a retrospective cohort study of all inpatient faculty evaluations of University of Pennsylvania IM residents from 2018 to 2021. We performed n-gram text-mining to identify evaluations containing the terms "confident," "confidence," or "confidently." We performed univariable and multivariable logistic regression to determine the association between resident gender and references to confidence (including comments reflecting too little confidence), adjusting for faculty gender, post-graduate year (PGY), numeric rating, and service. SUBJECTS: University of Pennsylvania IM residents from 2018 to 2021. KEY RESULTS: There were 5416 evaluations of IM residents (165 women [51%], 156 men [49%]) submitted by 356 faculty members (149 women [51%]), of which 7.1 % (n=356) contained references to confidence. There was a significant positive association between the mention of confidence and women resident gender (OR 1.54, CI 1.23-1.92; p<0.001), which persisted after adjustment for faculty gender, numeric rating, and PGY level. Eighty evaluations of the cohort explicitly mentioned the resident having "too little confidence," which was also associated with women resident gender (OR 1.66, CI 1.05-2.62; p=0.031). CONCLUSION: Narrative evaluations of women residents were more likely to contain references to confidence, after adjustment for numerical score, PGY level, and faculty gender, which may perpetuate the gender-based confidence gap, introduce bias, and ultimately impact professional identity development.

Natural Language Processing of Learners' Evaluations of Attendings to Identify Professionalism Lapses.

Unprofessional faculty behaviors negatively impact the well-being of trainees yet are infrequently reported through established reporting systems. Manual review of narrative faculty evaluations provides an additional avenue for identifying unprofessional behavior but is time- and resource-intensive, and therefore of limited value for identifying and remediating faculty with professionalism concerns. Natural language processing (NLP) techniques may provide a mechanism for streamlining manual review processes to identify faculty professionalism lapses. In this retrospective cohort study of 15,432 narrative evaluations of medical faculty by medical trainees, we identified professionalism lapses using automated analysis of the text of faculty evaluations. We used multiple NLP approaches to develop and validate several classification models, which were evaluated primarily based on the positive predictive value (PPV) and secondarily by their calibration. A NLP-model using sentiment analysis (quantifying subjectivity of the text) in combination with key words (using the ensemble technique) had the best performance overall with a PPV of 49% (CI 38%-59%). These findings highlight how NLP can be used to screen narrative evaluations of faculty to identify unprofessional faculty behaviors. Incorporation of NLP into faculty review workflows enables a more focused manual review of comments, providing a supplemental mechanism to identify faculty professionalism lapses.

Education for Tobacco Use Disorder Treatment: Current State, Evidence, and Unmet Needs.

Background: Tobacco use is undertreated in the medical setting. One driver may be inadequate tobacco use disorder treatment (TUDT) training for clinicians in specialties treating tobacco-dependent patients. Objective: We sought to evaluate the current state of TUDT training for diverse professionals and how these skills are assessed in credentialing exams. Methods: We performed a focused review of current educational practices, evidence-based strategies, and accreditation exam contents focused on TUDT. Results: Among medical students, participants in reviewed studies reported anywhere from 45 minutes to 3 hours of TUDT training throughout their 4-year programs, most often in the form of didactic sessions. Similarly, little TUDT training was reported at the post-graduate (residency, fellowship, continuing medical education) levels, and reported training was typically delivered as time-based (expected hours of instruction) rather than competency-based (demonstration of mastery) learning. Multiple studies evaluated effective TUDT curricula at varied stages of training. More effective curricula incorporated longitudinal sessions and active learning, such as standardized patient encounters or proctored patient visits. Knowledge of TUDT is minimally evaluated on certification exams. For example, the American Board of Internal Medicine blueprint lists TUDT as <2% of one subtopic on both the internal medicine and pulmonary exams. Conclusion: TUDT training for most clinicians is minimal, does not assess competency, and is minimally evaluated on certification exams. Effective, evidence-based TUDT training incorporating active learning should be integrated into medical education at all levels, with attention paid to inclusion on subsequent certifying exams.

Diagnostic Reasoning of Resident Physicians in the Age of Clinical Pathways.

Background: Development of skills in diagnostic reasoning is paramount to the transition from novice to expert clinicians. Efforts to standardize approaches to diagnosis and treatment using clinical pathways are increasingly common. The effects of implementing pathways into systems of care during diagnostic education and practice among pediatric residents are not well described. Objective: To characterize pediatric residents' perceptions of the tradeoffs between clinical pathway use and diagnostic reasoning. Methods: We conducted a qualitative study from May to December 2019. Senior pediatric residents from a high-volume general pediatric inpatient service at an academic hospital participated in semi-structured interviews. We utilized a basic interpretive qualitative approach informed by a dual process diagnostic reasoning framework. Results: Nine residents recruited via email were interviewed. Residents reported using pathways when admitting patients and during teaching rounds. All residents described using pathways primarily as management tools for patients with a predetermined diagnosis, rather than as aids in formulating a diagnosis. As such, pathways primed residents to circumvent crucial steps of deliberate diagnostic reasoning. However, residents relied on bedside assessment to identify when patients are "not quite fitting the mold" of the current pathway diagnosis, facilitating recalibration of the diagnostic process. Conclusions: This study identifies important educational implications at the intersection of residents' cognitive diagnostic processes and use of clinical pathways. We highlight potential challenges clinical pathways pose for skill development in diagnostic reasoning by pediatric residents. We suggest opportunities for educators to leverage clinical pathways as a framework for development of these skills.

Comparative Evaluation of Choose Your Own Adventure and Traditional Linear Case Formats in Radiology Small Group Teaching.

RATIONALE AND OBJECTIVES: We aim to compare Choose Your Own Adventure (CYOA) presentation format with linear case format as educational methods for teaching a radiology small group session to medical students. MATERIALS AND METHODS: A radiology small group session was held for preclinical second-year medical students in the pulmonary course, whereby eight classrooms of students and eight radiology facilitators were each randomized to do either the linear case format or the nonlinear CYOA presentation format. All students in attendance were administered a survey at the end of the session, which assessed students' perceptions using five-point Likert-type questions. The survey also contained a four-question knowledge quiz on chest radiology. The facilitators were administered a qualitative survey as well. Between-group analyses were performed using Student's t-test. RESULTS: Of the 144 students who attended the small group sessions, 143 students completed the survey (99.3%). The CYOA format group reported significantly greater engagement in the cases (4.5 ± 0.7 vs. 3.8 ± 0.7, p < 0.001), satisfaction with the format (4.6 ± 0.6 vs. 3.7 ± 0.9, p < 0.001), and enhancement of clinical decision making skills (4.5 ± 0.6 vs. 3.5 ± 0.9, p < 0.001). The linear format group reported a greater role for the facilitator to add value (4.6 ± 0.5 vs. 4.3 ± 1.1, p = 0.033). There was no significant difference between groups in performance on the knowledge quiz. CONCLUSION: Medical students reported higher satisfaction, engagement, and enhanced clinical decision making skills with the CYOA presentation method compared to linear case format for radiology small group learning.

Effect of Immunosuppressive Therapy and Biopsy Status in Monitoring Therapy Response in Suspected Cardiac Sarcoidosis.

BACKGROUND: Patients with suspected cardiac sarcoidosis frequently undergo fluorodeoxyglucose (FDG)-positron emission tomography (PET)/computed tomography (CT) imaging to assess disease activity at baseline and after treatment initiation. OBJECTIVES: This study investigated the effect of immunosuppressive therapy and biopsy status to achieve complete treatment response (CTR), partial treatment response (PTR), or no response (NR) on myocardial FDG-PET/CT. METHODS: This study analyzed 83 patients with suspected cardiac sarcoidosis (aged 53 ± 1.8 years, 71% were male, 69% were White, 61% had a history of biopsy-confirmed sarcoidosis) who were treatment naive, had evidence of myocardial FDG at baseline, and underwent repeat PET imaging after treatment initiation. CTR was graded visually, and PTR/NR were measured both visually and quantitatively using the total glycolytic activity. Patients were also evaluated for the occurrence of death, sustained ventricular arrhythmias, and heart failure admissions. RESULTS: Overall, 59 patients (71%) achieved CTR/PTR (30%/41%) at follow-up scan (P = 0.04). Total glycolytic activity and visual estimate of PTR/NR had excellent agreement (κ = 0.86 [95% CI: 0.72-0.99]; P < 0.0001). In patients receiving prednisone only, the highest rates of CTR/PTR were observed in patients initiated on moderate or high dose (P < 0.01). In a regression model, moderate prednisone start dose (P = 0.03) was more strongly associated with achieving CTR/PTR than was high prednisone start dose. However, the latter patients were tapered faster between start dose and follow-up scan (P < 0.01). After a median follow-up of 4.7 (IQR: 3.1-7.8) years, patients who were biopsy-proven (vs non-biopsy-proven; P = 0.029) and with preserved left ventricular function (P = 002) were less likely to experience major adverse cardiac events. Outcomes based on treatment response status (CTR vs PTR vs NR; P = 0.23) were not significantly different. CONCLUSIONS: Among patients with suspected sarcoidosis and evidence of myocardial inflammation, treatment response by serial FDG-PET was variable, but a favorable response was more common when using moderate-to-high intensity prednisone dose. Biopsy-proven individuals and those with preserved systolic function were less likely to experience adverse outcomes during follow-up.

Development and Implementation of a Novel Learner-driven Precepting Model for Pulmonary Fellowship.

Background: Ambulatory education is currently underemphasized in pulmonary and critical care medicine (PCCM) fellowship training. Existing clinic precepting models, originally developed for students and residents, do not meet the unique needs of fellow-level trainees. Objective: We aimed to develop and implement a novel fellow-led precepting model to improve ambulatory education for PCCM trainees. Methods: We performed a mixed-methods needs assessment, including surveys, focus groups, and direct observations, to explore perceptions of ambulatory training, define current precepting practices, and identify target areas for improvement. On the basis of these findings, we developed, implemented, and evaluated a novel model for PCCM outpatient precepting. Results: A targeted needs assessment identified that current precepting practices did not meet fellows' needs for graduated autonomy, development of assessment and management skills, and self-directed learning. We developed and implemented a novel, learner-driven precepting model (Set the Stage, Tell the Story, Educational Goals, Preliminary Plan, Uncertainties, Plan Recap [STEP-UP]), designed to prioritize clinical reasoning skills and self-identification of learning goals. Implementation of the STEP-UP model improved perceptions of overall outpatient training and precepting. However, we faced several barriers to uptake of the new model, including increased cognitive burden of integrating a new process. Conclusion: A robust assessment of ambulatory education at a single PCCM fellowship program identified a need to align precepting processes with the unique goals of advanced trainees. We developed a learner-driven precepting model focused on development of clinical reasoning skills and self-directed educational objectives. Additional study is warranted to refine, adapt, and test the model in different setting.

Assessment of Gender-based Qualitative Differences within Trainee Evaluations of Faculty.

Rationale: Recent studies of trainee evaluations of medical faculty have demonstrated subtle gender-based word choice differences. However, it is not known if this manifests in major contextual differences in written comments.Objectives: To characterize qualitative differences in narrative evaluations of female and male pulmonary and critical care medicine faculty.Methods: We performed a single-center, retrospective cohort analysis of trainee narrative evaluations of pulmonary and critical care medicine faculty at the Hospital of the University of Pennsylvania, written from 2015 to 2016. Directive and summative content analysis was performed by four raters. Major contextual themes were identified using constant comparative techniques. Thematic differences based on faculty gender were identified, with statistical significance determined using χ2 analysis (P < 0.05). Effect sizes were calculated using Cramér's V.Results: A total of 1,216 total narrative evaluations were analyzed, representing 62 faculty members (17 women and 45 men), with analysis continued for the full cohort beyond achieving saturation of themes. Five overarching themes emerged: teaching skills, clinical skills, supervision, interpersonal and communication skills, and leadership skills. Within subthemes, we found no significant gender differences in reference to general teaching skills, learning environment, enthusiasm for teaching, or interpersonal concern. We identified subtheme differences between male and female faculty evaluations in regard to mentions of learner autonomy, clinical learning environment, humor, and motivating the trainee for patient care. Although the mention of constructive criticisms did not differ between genders, constructive criticisms of female faculty were more likely to mention demeanor (P = 0.06).Conclusions: Our data suggest minimal thematic differences in trainee narrative evaluations of male and female pulmonary and critical care medicine faculty. However, we noted several subtheme contextual differences between male and female faculty, which warrants further investigation.

Assessment of Gender-Based Linguistic Differences in Physician Trainee Evaluations of Medical Faculty Using Automated Text Mining.

Importance: Women are underrepresented at higher ranks in academic medicine. However, the factors contributing to this disparity have not been fully elucidated. Implicit bias and unconscious mental attitudes toward a person or group may be factors. Although academic medical centers use physician trainee evaluations of faculty to inform promotion decisions, little is known about gender bias in these evaluations. To date, no studies have examined narrative evaluations of medical faculty by physician trainees for differences based on gender. Objective: To characterize gender-associated linguistic differences in narrative evaluations of medical faculty written by physician trainees. Design, Setting, and Participants: This retrospective cohort study included all faculty teaching evaluations completed for the department of medicine faculty by medical students, residents, and fellows at a large academic center in Pennsylvania from July 1, 2015, through June 30, 2016. Data analysis was performed from June 1, 2018, through July 31, 2018. Main Outcomes and Measures: Word use in faculty evaluations was quantified using automated text mining by converting free-text comments into unique 1- and 2-word phrases. Mixed-effects logistic regression analysis was performed to assess associations of faculty gender with frequencies of specific words and phrases present in a physician trainee evaluation. Results: A total of 7326 unique evaluations were collected for 521 faculty (325 men [62.4%] and 196 women [37.6%]). The individual words art (odds ratio [OR], 7.78; 95% CI, 1.01-59.89), trials (OR, 4.43; 95% CI, 1.34-14.69), master (OR, 4.24; 95% CI, 1.69-10.63), and humor (OR, 2.32; 95% CI, 1.44-3.73) were significantly associated with evaluations of male faculty, whereas the words empathetic (OR, 4.34; 95% CI, 1.56-12.07), delight (OR, 4.26; 95% CI, 1.35-13.40), and warm (OR, 3.45; 95% CI, 1.83-6.49) were significantly associated with evaluations of female faculty. Two-word phrases associated with male faculty evaluations included run rounds (OR, 7.78; 95% CI, 1.01-59.84), big picture (OR, 7.15; 95% CI, 1.68-30.42), and master clinician (OR, 4.02; 95% CI, 1.21-13.36), whereas evaluations of female faculty were more likely to be associated with model physician (OR, 7.75; 95% CI, 1.70-35.39), just right (OR, 6.97; 95% CI, 1.51-32.30), and attention (to) detail (OR, 4.26; 95% CI, 1.36-13.40). Conclusions and Relevance: The data showed quantifiable linguistic differences between free-text comments about male and female faculty in physician trainee evaluations. Further evaluation of these differences, particularly in association with ongoing gender disparities in faculty promotion and retention, may be warranted.