American Board of Internal Medicine Nephrology Procedure Requirements for Initial Certification: Time for a Change and Pursuing Consensus in the Nephrology Community.

In 1988, the American Board of Internal Medicine (ABIM) defined essential procedural skills in nephrology, and candidates for ABIM certification were required to present evidence of possessing the skills necessary for placement of temporary dialysis vascular access, hemodialysis, peritoneal dialysis, and percutaneous renal biopsy. In 1996, continuous renal replacement therapy was added to the list of nephrology requirements. These procedure requirements have not been modified since 1996 while the practice of nephrology has changed dramatically. In March 2021, the ABIM Nephrology Board embarked on a policy journey to revise the procedure requirements for nephrology certification. With the guidance of nephrology diplomates, training program directors, professional and patient organizations, and other stakeholders, the ABIM Nephrology Board revised the procedure requirements to reflect current practice and national priorities. The approved changes include the Opportunity to Train standard for placement of temporary dialysis catheters, percutaneous kidney biopsies, and home hemodialysis which better reflects the current state of training in most training programs, and the new requirements for home dialysis therapies training will align with the national priority to address the underuse of home dialysis therapies. This perspective details the ABIM process for considering changes to the certification procedure requirements and how ABIM collaborated with the larger nephrology community in considering revisions and additions to these requirements.

Associations of Internal Medicine Residency Milestone Ratings and Certification Examination Scores With Patient Outcomes.

Importance: Despite its importance to medical education and competency assessment for internal medicine trainees, evidence about the relationship between physicians' milestone residency ratings or the American Board of Internal Medicine's initial certification examination and their hospitalized patients' outcomes is sparse. Objective: To examine the association between physicians' milestone ratings and certification examination scores and hospital outcomes for their patients. Design, Setting, and Participants: Retrospective cohort analyses of 6898 hospitalists completing training in 2016 to 2018 and caring for Medicare fee-for-service beneficiaries during hospitalizations in 2017 to 2019 at US hospitals. Main Outcomes and Measures: Primary outcome measures included 7-day mortality and readmission rates. Thirty-day mortality and readmission rates, length of stay, and subspecialist consultation frequency were also assessed. Analyses accounted for hospital fixed effects and adjusted for patient characteristics, physician years of experience, and year. Exposures: Certification examination score quartile and milestone ratings, including an overall core competency rating measure equaling the mean of the end of residency milestone subcompetency ratings categorized as low, medium, or high, and a knowledge core competency measure categorized similarly. Results: Among 455 120 hospitalizations, median patient age was 79 years (IQR, 73-86 years), 56.5% of patients were female, 1.9% were Asian, 9.8% were Black, 4.6% were Hispanic, and 81.9% were White. The 7-day mortality and readmission rates were 3.5% (95% CI, 3.4%-3.6%) and 5.6% (95% CI, 5.5%-5.6%), respectively, and were 8.8% (95% CI, 8.7%-8.9%) and 16.6% (95% CI, 16.5%-16.7%) for mortality and readmission at 30 days. Mean length of stay and number of specialty consultations were 3.6 days (95% CI, 3.6-3.6 days) and 1.01 (95% CI, 1.00-1.03), respectively. A high vs low overall or knowledge milestone core competency rating was associated with none of the outcome measures assessed. For example, a high vs low overall core competency rating was associated with a nonsignificant 2.7% increase in 7-day mortality rates (95% CI, -5.2% to 10.6%; P = .51). In contrast, top vs bottom examination score quartile was associated with a significant 8.0% reduction in 7-day mortality rates (95% CI, -13.0% to -3.1%; P = .002) and a 9.3% reduction in 7-day readmission rates (95% CI, -13.0% to -5.7%; P < .001). For 30-day mortality, this association was -3.5% (95% CI, -6.7% to -0.4%; P = .03). Top vs bottom examination score quartile was associated with 2.4% more consultations (95% CI, 0.8%-3.9%; P < .003) but was not associated with length of stay or 30-day readmission rates. Conclusions and Relevance: Among newly trained hospitalists, certification examination score, but not residency milestone ratings, was associated with improved outcomes among hospitalized Medicare beneficiaries.

Analysis of Performance Trends from 2010-2019 on the American Board of Internal Medicine Nephrology Certifying Exam.

BACKGROUND: The pass rate on the American Board of Internal Medicine (ABIM) nephrology certifying exam has declined and is among the lowest of all internal medicine (IM) subspecialties. In recent years, there have also been fewer applicants for the nephrology fellowship match. METHODS: This retrospective observational study assessed how changes between 2010 and 2019 in characteristics of 4094 graduates of US ACGME-accredited nephrology fellowship programs taking the ABIM nephrology certifying exam for the first time, and how characteristics of their fellowship programs were associated with exam performance. The primary outcome measure was performance on the nephrology certifying exam. Fellowship program pass rates over the decade were also studied. RESULTS: Lower IM certifying exam score, older age, female sex, international medical graduate (IMG) status, and having trained at a smaller nephrology fellowship program were associated with poorer nephrology certifying exam performance. The mean IM certifying exam percentile score among those who subsequently took the nephrology certifying exam decreased from 56.7 (SD, 27.9) to 46.1 (SD, 28.7) from 2010 to 2019. When examining individuals with comparable IM certifying exam performance, IMGs performed less well than United States medical graduates (USMGs) on the nephrology certifying exam. In 2019, only 57% of nephrology fellowship programs had aggregate 3-year certifying exam pass rates ≥80% among their graduates. CONCLUSIONS: Changes in IM certifying exam performance, certain trainee demographics, and poorer performance among those from smaller fellowship programs explain much of the decline in nephrology certifying exam performance. IM certifying exam performance was the dominant determinant.

Where Do International Medical Graduates Matriculate for Internal Medicine Training? A National Longitudinal Study.

INTRODUCTION: In 2020, roughly 25% of applicants who matched into internal medicine (IM) residencies were international medical graduates (IMGs). We examine 12-year trends in distribution of IMGs among IM training programs and explore differences in program perceptions towards IMG recruitment. METHODS: Since 2007, Association of Program Directors in Internal Medicine Annual Surveys have collected data about trainees by medical school graduate type. Sixteen additional questions regarding perceptions of IMGs were included in the 2017 spring survey. RESULTS: The 2017 survey response rate was 63.3% (236/373) and ranged from 61.9 to 70.2% for the 2007-2019 Annual Surveys. During that 12-year period, 55-70% of community programs' and 22-30% of university programs' PGY1 positions were filled by IMGs. In 2017, 45% of community programs' and 15% of university programs' interview and ranking positions were allocated to IMGs. Departmental pressure (university 45.6% [95% CI 43.7-47.5]; community 28.2% [95% CI 26.6-29.7]; p = 0.007), institutional priority (university 64.0% [95% CI 62.1-66.0]; community 41% [95% CI 36.9-44.6]; p = 0.001), and reputational concerns (university 52.8% [95% CI 50.0-55.6]; community 38.5% [95% CI 36.0-40.9]; p = 0.045) were cited as factors influencing recruitment of IMGs. CONCLUSION: Our study was limited to exploring program factors in residency recruitment and did not assess applicant preferences. There is a large, longstanding difference in the recruitment of IMGs to US community-based and university residencies, beginning during the interview and ranking process. Further research in disparities in IMG recruitment is needed, including exploring pressures, preferences, and potential biases associated with the recruitment of IMGs.

The American Board of Internal Medicine Maintenance of Certification Examination and State Medical Board Disciplinary Actions: a Population Cohort Study.

BACKGROUND: Some have questioned whether successful performance in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program is meaningful. The association of the ABIM Internal Medicine (IM) MOC examination with state medical board disciplinary actions is unknown. OBJECTIVE: To assess risk of disciplinary actions among general internists who did and did not pass the MOC examination within 10 years of initial certification. DESIGN: Historical population cohort study. PARTICIPANTS: The population of internists certified in internal medicine, but not a subspecialty, from 1990 through 2003 (n = 47,971). INTERVENTION: ABIM IM MOC examination. SETTING: General internal medicine in the USA. MAIN MEASURES: The primary outcome measure was time to disciplinary action assessed in association with whether the physician passed the ABIM IM MOC examination within 10 years of initial certification, adjusted for training, certification, demographic, and regulatory variables including state medical board Continuing Medical Education (CME) requirements. KEY RESULTS: The risk for discipline among physicians who did not pass the IM MOC examination within the 10 year requirement window was more than double than that of those who did pass the examination (adjusted HR 2.09; 95% CI, 1.83 to 2.39). Disciplinary actions did not vary by state CME requirements (adjusted HR 1.02; 95% CI, 0.94 to 1.16), but declined with increasing MOC examination scores (Kendall's tau-b coefficient = - 0.98 for trend, p < 0.001). Among disciplined physicians, actions were less severe among those passing the IM MOC examination within the 10-year requirement window than among those who did not pass the examination. CONCLUSIONS: Passing a periodic assessment of medical knowledge is associated with decreased state medical board disciplinary actions, an important quality outcome of relevance to patients and the profession.

Networking Matters: A Social Network Analysis of the Association of Program Directors of Internal Medicine.

Theory: Networking has positive effects on career development; however, personal characteristics of group members such as gender or diversity may foster or hinder member connectedness. Social network analysis explores interrelationships between people in groups by measuring the strength of connection between all possible pairs in a given network. Social network analysis has rarely been used to examine network connections among members in an academic medical society. This study seeks to ascertain the strength of connection between program directors in the Association of Program Directors in Internal Medicine (APDIM) and its Education Innovations Project subgroup and to examine possible associations between connectedness and characteristics of program directors and programs. Hypotheses: We hypothesize that connectedness will be measurable within a large academic medical society and will vary significantly for program directors with certain measurable characteristics (e.g., age, gender, rank, location, burnout levels, desire to resign). Method: APDIM program directors described levels of connectedness to one another on the 2012 APDIM survey. Using social network analysis, we ascertained program director connectedness by measuring out-degree centrality, in-degree centrality, and eigenvector centrality, all common measures of connectedness. Results: Higher centrality was associated with completion of the APDIM survey, being in a university-based program, Educational Innovations Project participation, and higher academic rank. Centrality did not vary by gender; international medical graduate status; previous chief resident status; program region; or levels of reported program director burnout, callousness, or desire to resign. Conclusions: In this social network analysis of program directors within a large academic medical society, we found that connectedness was related to higher academic rank and certain program characteristics but not to other program director characteristics like gender or international medical graduate status. Further research is needed to optimize our understanding of connection in organizations such as these and to determine which strategies promote valuable connections.

Impact of Pregnancy and Gender on Internal Medicine Resident Evaluations: A Retrospective Cohort Study.

BACKGROUND: Pregnancy and its impact on graduate medical training are not well understood. OBJECTIVE: To examine the effect of gender and pregnancy for Internal Medicine (IM) residents on evaluations by peers and faculty. DESIGN: This was a retrospective cohort study. SUBJECTS: All IM residents in training from July 1, 2004-June 30, 2014, were included. Female residents who experienced pregnancy and male residents whose partners experienced pregnancy during training were identified using an existing administrative database. MAIN MEASURES: Mean evaluation scores by faculty and peers were compared relative to pregnancy (before, during, and after), accounting for the gender of both the evaluator and resident in addition to other available demographic covariates. Potential associations were assessed using mixed linear models. KEY RESULTS: Of 566 residents, 117 (20.7%) experienced pregnancy during IM residency training. Pregnancy was more common in partners of male residents (24.7%) than female residents (13.2%) (p = 0.002). In the post-partum period, female residents had lower peer evaluation scores on average than their male counterparts (p = 0.0099). CONCLUSIONS: A large number of residents experience pregnancy during residency. Mean peer evaluation scores were lower after pregnancy for female residents. Further study is needed to fully understand the mechanisms behind these findings, develop ways to optimize training throughout pregnancy, and explore any unconscious biases that may exist.

The Internal Medicine Reporting Milestones: Cross-sectional Description of Initial Implementation in U.S. Residency Programs.

BACKGROUND: High-quality assessment of resident performance is needed to guide individual residents' development and ensure their preparedness to provide patient care. To facilitate this aim, reporting milestones are now required across all internal medicine (IM) residency programs. OBJECTIVE: To describe initial milestone ratings for the population of IM residents by IM residency programs. DESIGN: Cross-sectional study. SETTING: IM residency programs. PARTICIPANTS: All IM residents whose residency program directors submitted milestone data at the end of the 2013-2014 academic year. MEASUREMENTS: Ratings addressed 6 competencies and 22 subcompetencies. A rating of "not assessable" indicated insufficient information to evaluate the given subcompetency. Descriptive statistics were calculated to describe ratings across competencies and training years. RESULTS: Data were available for all 21 774 U.S. IM residents from all 383 programs. Overall, 2889 residents (1621 in postgraduate year 1 [PGY-1], 902 in PGY-2, and 366 in PGY-3) had at least 1 subcompetency rated as not assessable. Summaries of average ratings by competency and training year showed higher ratings for PGY-3 residents in all competencies. Overall ratings for each of the 6 individual competencies showed that fewer than 1% of third-year residents were rated as "unsatisfactory" or "conditional on improvement." However, when subcompetency milestone ratings were used, 861 residents (12.8%) who successfully completed training had at least 1 competency with all corresponding subcompetencies graded below the threshold of "readiness for unsupervised practice." LIMITATION: Data were derived from a point in time in the first reporting period in which milestones were used. CONCLUSION: The initial milestone-based evaluations of IM residents nationally suggest that documenting developmental progression of competency is possible over training years. Subcompetencies may identify areas in which residents might benefit from additional feedback and experience. Future work is needed to explore how milestones are used to support residents' development and enhance residency curricula. PRIMARY FUNDING SOURCE: None.

Correlations Between Ratings on the Resident Annual Evaluation Summary and the Internal Medicine Milestones and Association With ABIM Certification Examination Scores Among US Internal Medicine Residents, 2013-2014.

Importance: US internal medicine residency programs are now required to rate residents using milestones. Evidence of validity of milestone ratings is needed. Objective: To compare ratings of internal medicine residents using the pre-2015 resident annual evaluation summary (RAES), a nondevelopmental rating scale, with developmental milestone ratings. Design, Setting, and Participants: Cross-sectional study of US internal medicine residency programs in the 2013-2014 academic year, including 21 284 internal medicine residents (7048 postgraduate-year 1 [PGY-1], 7233 PGY-2, and 7003 PGY-3). Exposures: Program director ratings on the RAES and milestone ratings. Main Outcomes and Measures: Correlations of RAES and milestone ratings by training year; correlations of medical knowledge ratings with American Board of Internal Medicine (ABIM) certification examination scores; rating of unprofessional behavior using the 2 systems. Results: Corresponding RAES ratings and milestone ratings showed progressively higher correlations across training years, ranging among competencies from 0.31 (95% CI, 0.29 to 0.33) to 0.35 (95% CI, 0.33 to 0.37) for PGY-1 residents to 0.43 (95% CI, 0.41 to 0.45) to 0.52 (95% CI, 0.50 to 0.54) for PGY-3 residents (all P values <.05). Linear regression showed ratings differed more between PGY-1 and PGY-3 years using milestone ratings than the RAES (all P values <.001). Of the 6260 residents who attempted the certification examination, the 618 who failed had lower ratings using both systems for medical knowledge than did those who passed (RAES difference, -0.9; 95% CI, -1.0 to -0.8; P < .001; milestone medical knowledge 1 difference, -0.3; 95% CI, -0.3 to -0.3; P < .001; and medical knowledge 2 difference, -0.2; 95% CI, -0.3 to -0.2; P < .001). Of the 26 PGY-3 residents with milestone ratings indicating deficiencies on either of the 2 medical knowledge subcompetencies, 12 failed the certification examination. Correlation of RAES ratings for professionalism with residents' lowest professionalism milestone ratings was 0.44 (95% CI, 0.43 to 0.45; P < .001). Conclusions and Relevance: Among US internal medicine residents in the 2013-2014 academic year, milestone-based ratings correlated with RAES ratings but with a greater difference across training years. Both rating systems for medical knowledge correlated with ABIM certification examination scores. Milestone ratings may better detect problems with professionalism. These preliminary findings may inform establishment of the validity of milestone-based assessment.

Teamwork assessment in internal medicine: a systematic review of validity evidence and outcomes.

OBJECTIVE: Valid teamwork assessment is imperative to determine physician competency and optimize patient outcomes. We systematically reviewed published instruments assessing teamwork in undergraduate, graduate, and continuing medical education in general internal medicine and all medical subspecialties. DATA SOURCES: We searched MEDLINE, MEDLINE In-process, CINAHL and PsycINFO from January 1979 through October 2012, references of included articles, and abstracts from four professional meetings. Two content experts were queried for additional studies. STUDY ELIGIBILITY: Included studies described quantitative tools measuring teamwork among medical students, residents, fellows, and practicing physicians on single or multi-professional (interprofessional) teams. STUDY APPRAISAL AND SYNTHESIS METHODS: Instrument validity and study quality were extracted using established frameworks with existing validity evidence. Two authors independently abstracted 30 % of articles and agreement was calculated. RESULTS: Of 12,922 citations, 178 articles describing 73 unique teamwork assessment tools met inclusion criteria. Interrater agreement was intraclass correlation coefficient 0.73 (95 % CI 0.63-0.81). Studies involved practicing physicians (142, 80 %), residents/fellows (70, 39 %), and medical students (11, 6 %). The majority (152, 85 %) assessed interprofessional teams. Studies were conducted in inpatient (77, 43 %), outpatient (42, 24 %), simulation (37, 21 %), and classroom (13, 7 %) settings. Validity evidence for the 73 tools included content (54, 74 %), internal structure (51, 70 %), relationships to other variables (25, 34 %), and response process (12, 16 %). Attitudes and opinions were the most frequently assessed outcomes. Relationships between teamwork scores and patient outcomes were directly examined for 13 (18 %) of tools. Scores from the Safety Attitudes Questionnaire and Team Climate Inventory have substantial validity evidence and have been associated with improved patient outcomes. LIMITATIONS: Review is limited to quantitative assessments of teamwork in internal medicine. CONCLUSIONS: There is strong validity evidence for several published tools assessing teamwork in internal medicine. However, few teamwork assessments have been directly linked to patient outcomes.

Ultrasound for internal medicine physicians: the future of the physical examination.

OBJECTIVES: With the advent of compact ultrasound (US) devices, it is easier for physicians to enhance their physical examinations through the use of US. However, although this new tool is widely available, few internal medicine physicians have US training. This study sought to understand physicians' baseline knowledge and skill, provide education in US principles, and demonstrate that proper use of compact US devices is a skill that can be quickly learned. METHODS: Training was performed at the Mayo Clinic in June 2010 and June 2011. The participants consisted of internal medicine residents. The workshop included didactics and hands-on US experiences with human and cadaver models in a simulation center. Pretests and posttests of residents' knowledge, attitudes, and skills with US were completed. We reassessed the 2010 group in the spring of 2012 with a long-term retention survey for knowledge and confidence in viewing images. RESULTS: A total of 136 interns completed the workshop. Thirty-nine residents completed the long-term retention survey. Posttest assessments showed a statistically significant improvement in the knowledge of US imaging, confidence in identifying structures, image identification, and image acquisition (P < .0001). In the long-term retention study, knowledge of US imaging and confidence in identifying structures did decline. CONCLUSIONS: This educational intervention resulted in improvement in US knowledge and image acquisition. However, the knowledge diminished over time, suggesting that further education is needed if US is to become an important component of internal medicine training and practice.

Burnout and distress among internal medicine program directors: results of a national survey.

BACKGROUND: Physician burnout and distress has been described in national studies of practicing physicians, internal medicine (IM) residents, IM clerkship directors, and medical school deans. However, no comparable national data exist for IM residency program directors. OBJECTIVE: To assess burnout and distress among IM residency program directors, and to evaluate relationships of distress with personal and program characteristics and perceptions regarding implementation and consequences of Accreditation Council for Graduate Medical Education (ACGME) regulations. DESIGN AND PARTICIPANTS: The 2010 Association of Program Directors in Internal Medicine (APDIM) Annual Survey, developed by the APDIM Survey Committee, was sent in August 2010 to the 377 program directors with APDIM membership, representing 99.0 % of the 381 United States categorical IM residency programs. MAIN MEASURES: The 2010 APDIM Annual Survey included validated items on well-being and distress, including questions addressing quality of life, satisfaction with work-life balance, and burnout. Questions addressing personal and program characteristics and perceptions regarding implementation and consequences of ACGME regulations were also included. KEY RESULTS: Of 377 eligible program directors, 282 (74.8 %) completed surveys. Among respondents, 12.4 % and 28.8 % rated their quality of life and satisfaction with work-life balance negatively, respectively. Also, 27.0 % reported emotional exhaustion, 10.4 % reported depersonalization, and 28.7 % reported overall burnout. These rates were lower than those reported previously in national studies of medical students, IM residents, practicing physicians, IM clerkship directors, and medical school deans. Aspects of distress were more common among younger program directors, women, and those reporting greater weekly work hours. Work-home conflicts were common and associated with all domains of distress, especially if not resolved in a manner effectively balancing work and home responsibilities. Associations with program characteristics such as program size and American Board of Internal Medicine (ABIM) pass rates were not found apart from higher rates of depersonalization among directors of community-based programs (23.5 % vs. 8.6 %, p = 0.01). We did not observe any consistent associations between distress and perceptions of implementation and consequences of program regulations. CONCLUSIONS: The well-being of IM program directors across domains, including quality of life, satisfaction with work-life balance, and burnout, appears generally superior to that of medical trainees, practicing physicians, and other medical educators nationally. Additionally, it is reassuring that program directors' perceptions of their ability to respond to current regulatory requirements are not adversely associated with distress. However, the increased distress levels among younger program directors, women, and those at community-based training programs reported in this study are important concerns worthy of further study.

Association of volume of patient encounters with residents' in-training examination performance.

BACKGROUND: Patient care and medical knowledge are Accreditation Council for Graduate Medical Education (ACGME) core competencies. The correlation between amount of patient contact and knowledge acquisition is not known. OBJECTIVE: To determine if a correlation exists between the number of patient encounters and in-training exam (ITE) scores in internal medicine (IM) and pediatric residents at a large academic medical center. DESIGN: Retrospective cohort study PARTICIPANTS: Resident physicians at Mayo Clinic from July 2006 to June 2010 in IM (318 resident-years) and pediatrics (66 resident-years). METHODS: We tabulated patient encounters through review of clinical notes in an electronic medical record during post graduate year (PGY)-1 and PGY-2. Using linear regression models, we investigated associations between ITE score and number of notes during the previous PGY, adjusted for previous ITE score, gender, medical school origin, and conference attendance. KEY RESULTS: For IM, PGY-2 admission and consult encounters in the hospital and specialty clinics had a positive linear association with ITE-3 % score (ß = 0.02; p = 0.004). For IM, PGY-1 conference attendance is positively associated with PGY-2 ITE performance. We did not detect a correlation between PGY-1 patient encounters and subsequent ITE scores for IM or pediatric residents. No association was found between IM PGY-2 ITE score and inpatient, outpatient, or total encounters in the first year of training. Resident continuity clinic and total encounters were not associated with change in PGY-3 ITE score. CONCLUSIONS: We identified a positive association between hospital and subspecialty encounters during the second year of IM training and subsequent ITE score, such that each additional 50 encounters were associated with an increase of 1 % correct in PGY-3 ITE score after controlling for previous ITE performance and continuity clinic encounters. We did not find a correlation for volume of encounters and medical knowledge for IM PGY-1 residents or the pediatric cohort.

An evaluation of internal medicine residency continuity clinic redesign to a 50/50 outpatient-inpatient model.

BACKGROUND: There have been recent calls for improved internal medicine outpatient training, yet assessment of clinical and educational variables within existing models is lacking. OBJECTIVE: To assess the impact of clinic redesign from a traditional weekly clinic model to a 50/50 outpatient-inpatient model on clinical and educational outcomes. DESIGN: Pre-intervention and post-intervention study intervals, comparing the 2009-2010 and 2010-2011 academic years. PARTICIPANTS: Ninety-six residents in a Primary Care Internal Medicine site of a large academic internal medicine residency program who provide care for > 13,000 patients. INTERVENTION: Continuity clinic redesign from a traditional weekly clinic model to a 50/50 model characterized by 50 % outpatient and 50 % inpatient experiences scheduled in alternating 1 month blocks, with twice weekly continuity clinic during outpatient months and no clinic during inpatient months. MAIN MEASURES: 1) Clinical outcomes (panel size, patient visits, adherence with chronic disease and preventive service guidelines, continuity of care, patient satisfaction, and perceived safety/teamwork in clinic); 2) Educational outcomes (attendance at teaching conference, resident and faculty satisfaction, faculty assessment of resident clinic performance, and residents' perceived preparedness for outpatient management). RESULTS: Redesign was associated with increased mean panel size (120 vs. 137.6; p ≤ 0.001), decreased continuity of care (63 % vs. 48 % from provider perspective; 61 % vs. 51 % from patient perspective; p ≤ 0.001 for both; team continuity was preserved), decreased missed appointments (12.5 % vs. 10.9 %; p ≤ 0.01), improved perceived safety and teamwork (3.6 vs. 4.1 on 5-point scale; p ≤ 0.001), improved mean teaching conference attendance (57.1 vs. 64.4; p ≤ 0.001), improved resident clinic performance (3.6 vs. 3.9 on 5-point scale; p ≤ 0.001), and little change in other outcomes. CONCLUSION: Although this model requires further study in other settings, these results suggest that a 50/50 model may allow residents to manage more patients while enhancing the climate of teamwork and safety in the continuity clinic, compared to traditional models. Future work should explore ways to preserve continuity of care within this model.

The effects of gender and age on evaluation of trainees and faculty in gastroenterology.

OBJECTIVES: We studied whether differences exist in evaluation scores of faculty and trainees in gastroenterology (GI) based on the gender of the evaluator or evaluatee, or the evaluator-evaluatee gender pairing. METHODS: We examined evaluations of faculty and trainees (GI fellows and internal medicine residents rotating on GI services), using mixed linear models to assess effects of the four possible evaluator-evaluatee gender pairings. Potential confounding variables were adjusted for, and random effects were used to account for repeated assessments. RESULTS: For internal medicine (IM) residents, no difference in evaluation scores based on gender was found. Resident age was negatively associated with performance rating, while percentage correct on the in-training examination (ITE) was positively associated. For GI fellows, the interaction between evaluator and evaluatee gender was significant. Fellow age and international medical graduate (IMG) status were negatively associated with performance rating, while ITE percentage correct was positively associated. For faculty, no difference was found in evaluation scores by IM residents based on the gender of the evaluated faculty or the evaluating resident, although the interaction between the evaluator and the evaluatee gender was significant. Gender had a significant marginal effect on faculty scores by GI fellows, with female faculty receiving lower scores. The interaction between evaluator and evaluatee gender was also significant for evaluations by fellows. Faculty age was negatively associated with performance rating. DISCUSSION: Gender, age, and ITE performance are associated with evaluation scores of GI trainees and faculty at our institution. The interaction of evaluator and evaluatee gender appears to play a more critical role in evaluation scoring than the gender of the evaluatee or evaluator in isolation.

Relationship of electronic medical knowledge resource use and practice characteristics with Internal Medicine Maintenance of Certification Examination scores.

BACKGROUND: Maintenance of certification examination performance is associated with quality of care. We aimed to examine relationships between electronic medical knowledge resource use, practice characteristics and examination scores among physicians recertifying in internal medicine. METHODS: We conducted a cross-sectional study of 3,958 United States physicians who took the Internal Medicine Maintenance of Certification Examination (IM-MOCE) between January 1, 2006 and December 31, 2008, and who held individual licenses to one or both of two large electronic knowledge resource programs. We examined associations between physicians' IM-MOCE scores and their days of electronic resource use, practice type (private practice, residency teaching clinic, inpatient, nursing home), practice model (single or multi-specialty), sex, age, and medical school location. RESULTS: In the 365 days prior to the IM-MOCE, physicians used electronic resources on a mean (SD, range) of 20.3 (36.5, 0-265) days. In multivariate analyses, the number of days of resource use was independently associated with increased IM-MOCE scores (0.07-point increase per day of use, p = 0.02). Increased age was associated with decreased IM-MOCE scores (1.8-point decrease per year of age, p < 0.001). Relative to physicians working in private practice settings, physicians working in residency teaching clinics and hospital inpatient practices had higher IM-MOCE scores by 29.1 and 20.0 points, respectively (both p < 0.001). CONCLUSIONS: Frequent use of electronic resources was associated with modestly enhanced IM-MOCE performance. Physicians involved in residency education clinics and hospital inpatient practices had higher IM-MOCE scores than physicians working in private practice settings.

Extended evaluation of a longitudinal medical school evidence-based medicine curriculum.

BACKGROUND: Evidence-based medicine (EBM) is an important element of medical education. However, limited information is available on effective curricula. OBJECTIVE: To evaluate a longitudinal medical school EBM curriculum using validated instruments. DESIGN, PARTICIPANTS, MEASUREMENTS: We evaluated EBM attitudes and knowledge of medical students as they progressed through an EBM curriculum. The first component of the curriculum was an EBM "short course" with didactic and small-group sessions occurring at the end of the second year. The second component integrated EBM assignments with third-year clinical rotations. The 15-point Berlin Questionnaire was administered before the course in 2006 and 2007, after the short course, and at the end of the third year. The 212-point Fresno Test was administered before the course in 2007 and 2008, after the short course, and at the end of the third year. Self-reported knowledge and attitudes were also assessed in all three classes of medical students. RESULTS: EBM knowledge scores on the 15-point Berlin Questionnaire increased from baseline by 3.0 points (20.0%) at the end of the second year portion of the course (p < 001) and by 3.4 points (22.7%) at the end of the third year (p < 001). EBM knowledge scores on the 212-point Fresno Test increased from baseline by 39.7 points (18.7%) at the end of the second year portion of the course (p < 001) and by 54.6 points (25.8%) at the end of the third year (p < 001). On a 5-point scale, self-rated EBM knowledge increased from baseline by 1.0 and 1.4 points, respectively (both p < 001). EBM was felt to be of high importance for medical education and clinical practice at all time points, with increases noted after both components of the curriculum. CONCLUSIONS: A longitudinal medical school EBM was associated with markedly increased EBM knowledge on two validated instruments. Both components of the curriculum were associated with gains in knowledge. The curriculum was also associated with increased perceptions of the importance of EBM for medical education and clinical practice.