Clinical competence, communication ability and adherence to choosing wisely recommendations for lipid reducing drug use in older adults.

BACKGROUND: Although lipid-lowering drugs are not recommended for primary prevention in patients 75+, prevalence of use is high and there is unexplained variation in prescribing between physicians. The objective of this study was to determine if physician communication ability and clinical competence are associated with prescribing lipid-lowering drugs for primary and secondary prevention. METHODS: We used a cohort of 4,501 international medical graduates, 161,214 U.S. Medicare patients with hyperlipidemia (primary prevention) and 49,780 patients with a history of cardiovascular disease (secondary prevention) not treated with lipid-lowering therapy who were seen by study physicians in ambulatory care. Clinical competence and communication ability were measured by the ECFMG clinical assessment examination. Physician citizenship, age, gender, specialty and patient characteristics were also measured. The outcome was an incident prescription of lipid-lowering drug, evaluated using multivariable GEE logistic regression models for primary and secondary prevention for patients 75+ and 65-74. RESULTS: Patients 75+ were less likely than those 65-74 to receive lipid-lowering drugs for primary (OR 0.62, 95% CI 0.59-0.66) and secondary (OR 0.70, 95% CI 0.63-0.78) prevention. For every 20% increase in clinical competence score, the odds of prescribing therapy for primary prevention to patients 75+ increased by 24% (95% CI 1.02-1.5). Communication ability had the opposite effect, reducing the odds of prescribing for primary prevention by 11% per 20% score increase (95% CI 0.8-0.99) for both age groups. Physicians who were citizens of countries with higher proportions of Hispanic (South/Central America) or Asian (Asia/Oceania) people were more likely to prescribe treatment for primary prevention, and internal medicine specialists were more likely to treat for secondary prevention than primary care physicians. CONCLUSION: Clinical competence, communication ability and physician citizenship are associated with lipid-lowering drug prescribing for primary prevention in patients aged 75+.

Do clinical and communication skills scores on credentialing exams predict potentially inappropriate antibiotic prescribing?

BACKGROUND: There is considerable variation among physicians in inappropriate antibiotic prescribing, which is hypothesized to be attributable to diagnostic uncertainty and ineffective communication. The objective of this study was to evaluate whether clinical and communication skills are associated with antibiotic prescribing for upper respiratory infections and sinusitis. METHODS: A cohort study of 2,526 international medical graduates and 48,394 U.S. Medicare patients diagnosed by study physicians with an upper respiratory infection or sinusitis between July 2014 and November 2015 was conducted. Clinical and communication skills were measured by scores achieved on the Clinical Skills Assessment examination administered by the Educational Commission for Foreign Medical Graduates (ECFMG) as a requirement for entry into U.S residency programs. Medicare Part D data were used to determine whether patients were dispensed an antibiotic following an outpatient evaluation and management visit with the study physician. Physician age, sex, specialty and practice region were retrieved from the ECFMG databased and American Medical Association (AMA) Masterfile. Multivariate GEE logistic regression was used to evaluate the association between clinical and communication skills and antibiotic prescribing, adjusting for other physician and patient characteristics. RESULTS: Physicians prescribed an antibiotic in 71.1% of encounters in which a patient was diagnosed with sinusitis, and 50.5% of encounters for upper respiratory infections. Better interpersonal skills scores were associated with a significant reduction in the odds of antibiotic prescribing (OR per score decile 0.93, 95% CI 0.87-0.99), while greater proficiency in clinical skills and English proficiency were not. Female physicians, those practicing internal medicine compared to family medicine, those with citizenship from the US compared to all other countries, and those practicing in southern of the US were also more likely to prescribe potentially unnecessary antibiotics. CONCLUSIONS: Based on this study, physicians with better interpersonal skills are less likely to prescribe antibiotics for acute sinusitis and upper respiratory infections. Future research should examine whether tailored interpersonal skills training to help physicians manage patient expectations for antibiotics could reduce unnecessary antibiotic prescribing.

Making the grade: licensing examination performance by medical school accreditation status.

BACKGROUND: Accreditation systems strive to ensure the quality of undergraduate (basic) medical education and encourage ongoing improvements. Despite increasing global emphasis on quality assurance activities, there is limited research linking accreditation of medical education to improved student and graduate outcomes. The purpose of this study is to compare the United States Medical Licensing Examination® (USMLE®) performance of students and graduates who attended international medical schools accredited by an agency recognized by the World Federation of Medical Education (WFME) to individuals who attended schools that did not meet this criterion. METHODS: During the 2018-2020 study period, 39,650 individuals seeking Educational Commission for Foreign Medical Graduates® (ECFMG®) certification took one or more USMLE examinations. We cross-tabulated USMLE performance (first-attempt pass/fail result) and medical school accreditation status. RESULTS: Individuals seeking ECFMG certification who attended international medical schools accredited by an agency recognized by WFME had higher or comparable USMLE first-attempt pass rates compared to individuals who attended medical schools that did not meet this criterion. CONCLUSIONS: Implementing and maintaining meaningful accreditation systems requires substantial resources. These results provide important positive evidence that external evaluation of educational programs is associated, on average, with better educational outcomes, including in the domains of basic science, clinical knowledge, and clinical skills performance.

Comparison of Bedside and Video-Based Capillary Refill Time Assessment in Children.

OBJECTIVES: Capillary refill time (CRT) to assess peripheral perfusion in children with suspected shock may be subject to poor reproducibility. Our objectives were to compare video-based and bedside CRT assessment using a standardized protocol and evaluate interrater and intrarater consistency of video-based CRT (VB-CRT) assessment. We hypothesized that measurement errors associated with raters would be low for both standardized bedside CRT and VB-CRT as well as VB-CRT across raters. METHODS: Ninety-nine children (aged 1-12 y) had 5 consecutive bedside CRT assessments by an experienced critical care clinician following a standardized protocol. Each CRT assessment was video recorded on a black background. Thirty video clips (10 with bedside CRT < 1 s, 10 with CRT 1-2 s, and 10 with CRT > 2 s) were randomly selected and presented to 10 clinicians twice in randomized order. They were instructed to push a button when they visualized release of compression and completion of a capillary refill. The correlation and absolute difference between bedside and VB-CRT were assessed. Consistency across raters and within each rater was analyzed using the intraclass correlation coefficient (ICC). A Generalizability study was performed to evaluate sources of variation. RESULTS: We found moderate agreement between bedside and VB-CRT observations (r = 0.65; P < 0.001). The VB-CRT values were shorter by 0.17 s (95% confidence interval, 0.09-0.25; P < 0.001) on average compared with bedside CRT. There was moderate agreement in VB-CRT across raters (ICC = 0.61). Consistency of repeated VB-CRT within each rater was moderate (ICC = 0.71). Generalizability study revealed the source of largest variance was from individual patient video clips (57%), followed by interaction of the VB-CRT reviewer and patient video clip (10.7%). CONCLUSIONS: Bedside and VB-CRT observations showed moderate consistency. Using video-based assessment, moderate consistency was also observed across raters and within each rater. Further investigation to standardize and automate CRT measurement is warranted.

International Medical Graduates in the United States Psychiatry Workforce.

OBJECTIVE: This study describes the supply, distribution, and characteristics of international medical graduate (IMG) psychiatrists who provide services in the USA. METHODS: Cross-sectional study design, using descriptive statistics based on combined data from the American Medical Association (2020 Physician Masterfile) and the Educational Commission for Foreign Medical Graduates. RESULTS: International medical graduates continue to make significant contributions to the US physician workforce. As a group, they represent 29% of active psychiatrists in the USA, compared to 23% in all other medical specialties. Many IMG psychiatrists were US citizens who obtained their medical degrees outside the USA or Canada, often in the Caribbean. In some states (i.e., Florida, New Jersey), over 40% of active psychiatrists are IMGs. Over 30% of IMG psychiatrists graduated from medical schools in India and Pakistan. CONCLUSIONS: This study provides an overview of the psychiatric workforce in the USA, quantifying the specific contribution of IMGs. Several factors, including immigration policies, continued expansion of US medical schools, and the number of available residency positions, could impact the flow of IMGs to the US. Longitudinal studies are needed to better understand the implications for workforce composition and distribution, and their potential impact on the care of psychiatric patients.

Competence in Decision Making: Setting Performance Standards for Critical Care.

BACKGROUND: Health care professionals must be able to make frequent and timely decisions that can alter the illness trajectory of intensive care patients. A competence standard for this ability is difficult to establish yet assuring practitioners can make appropriate judgments is an important step in advancing patient safety. We hypothesized that simulation can be used effectively to assess decision-making competence. To test our hypothesis, we used a "standard-setting" method to derive cut scores (standards) for 16 simulated ICU scenarios targeted at decision-making skills and applied them to a cohort of critical care trainees. METHODS: Panelists (critical care experts) reviewed digital audio-video performances of critical care trainees managing simulated critical care scenarios. Based on their collectively agreed-upon definition of "readiness" to make decisions in an ICU setting, each panelist made an independent judgment (ready, not ready) for a large number of recorded performances. The association between the panelists' judgments and the assessment scores was used to derive scenario-specific performance standards. RESULTS: For all 16 scenarios, the aggregate panelists' ratings (ready/not ready for independent decision making) were positively associated with the performance scores, permitting derivation of performance standards for each scenario. CONCLUSIONS: Minimum competence standards for high-stakes decision making can be established through standard-setting techniques. We effectively identified "front-line" providers who are, or are not, ready to make independent decisions in an ICU setting. Our approach may be used to assure stakeholders that clinicians are competent to make appropriate judgments. Further work is needed to determine whether our approach is effective in simulation-based assessments in other domains.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific.

INTRODUCTION: Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established. METHODS: Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters. RESULTS: The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability. CONCLUSIONS: The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

What we measure and what we should measure in medical education.

CONTEXT: As the practice of medicine evolves, the knowledge, skills and attitudes required to provide patient care will continue to change. These competency-based changes will necessitate the restructuring of assessment systems. High-quality assessment programmes are needed to fulfil health professions education's contract with society. OBJECTIVES: We discuss several issues that are important to consider when developing assessments in health professions education. We organise the discussion along the continuum of medical education, outlining the tension between what has been deemed important to measure and what should be measured. We also attempt to alleviate some of the apprehension associated with measuring evolving competencies by discussing how emerging technologies, including simulation and artificial intelligence, can play a role. METHODS: We focus our thoughts on the assessment of competencies that, at least historically, have been difficult to measure. We highlight several assessment challenges, discuss some of the important issues concerning the validity of assessment scores, and argue that medical educators must do a better job of justifying their use of specific assessment strategies. DISCUSSION: As in most professions, there are clear tensions in medicine in relation to what should be assessed, who should be responsible for administering assessment content, and how much evidence should be gathered to support the evaluation process. Although there have been advances in assessment practices, there is still room for improvement. From the student's, resident's and practising physician's perspectives, assessments need to be relevant. Knowledge is certainly required, but there are other qualities and attributes that are important, and perhaps far more important. Research efforts spent now on delineating what makes a good physician, and on aligning new and upcoming assessment tools with the relevant competencies, will ensure that assessment practices, whether aimed at establishing competence or at fostering learning, are effective with respect to their primary goal: to produce qualified physicians.

Considerations that will determine if competency-based assessment is a sustainable innovation.

Educational assessment for the health professions has seen a major attempt to introduce competency based frameworks. As high level policy developments, the changes were intended to improve outcomes by supporting learning and skills development. However, we argue that previous experiences with major innovations in assessment offer an important road map for developing and refining assessment innovations, including careful piloting and analyses of their measurement qualities and impacts. Based on the literature, numerous assessment workshops, personal interactions with potential users, and our 40 years of experience in implementing assessment change, we lament the lack of a coordinated approach to clarify and improve measurement qualities and functionality of competency based assessment (CBA). To address this worrisome situation, we offer two roadmaps to guide CBA's further development. Initially, reframe and address CBA as a measurement development opportunity. Secondly, using a roadmap adapted from the management literature on sustainable innovation, the medical assessment community needs to initiate an integrated plan to implement CBA as a sustainable innovation within existing educational programs and self-regulatory enterprises. Further examples of down-stream opportunities to refocus CBA at the implementation level within faculties and within the regulatory framework of the profession are offered. In closing, we challenge the broader assessment community in medicine to step forward and own the challenge and opportunities to reframe CBA as an innovation to improve the quality of the clinical educational experience. The goal is to optimize assessment in health education and ultimately improve the public's health.

Supply, distribution and characteristics of international medical graduates in family medicine in the United States: a cross-sectional study.

BACKGROUND: To describe the supply, distribution, and characteristics of international medical graduates (IMGs) in family medicine who provide patient care in the U.S. METHODS: A cross-sectional study design, using descriptive statistics on combined data from the Educational Commission for Foreign Medical Graduates and the American Medical Association, including medical school attended, country of medical school, and citizenship when entering medical school. RESULTS: In total, 118,817 physicians in family medicine were identified, with IMGs representing 23.8% (n = 28,227) of the U.S. patient care workforce. Of all 9579 residents in family medicine, 36.0% (n = 3452) are IMGS. In total, 35.9% of IMGs attended medical school in the Caribbean (n = 10,136); 19.9% in South-Central Asia (n = 5607) and 9.1% in South-Eastern Asia (n = 2565). The most common countries of medical school training were Dominica, Mexico, and Sint Maarten. Of all IMGs in family medicine who attended medical school in the Caribbean, 74.5% were U.S. citizens. In total, 40.5% of all IMGs in family medicine held U.S. citizenship at entry to medical school. IMGs comprise almost 40% of the family medicine workforce in Florida, New Jersey and New York. CONCLUSIONS: IMGs play an important role in the U.S. family medicine workforce. Many IMGs are U.S. citizens who studied abroad and then returned to the U.S. for graduate training. Given the shortage of family physicians, and the large number of IMGs in graduate training programs, IMGs will continue to play a role in the U.S. physician workforce for some time to come. Many factors, including the supply of residency training positions, could eventually restrict the number of IMGs entering the U.S., including those contributing to family practice.

Simulation-Based Assessment of Critical Care "Front-Line" Providers.

OBJECTIVES: Develop a standardized simulation method to assess clinical skills of ICU providers. DESIGN: Simulation assessment. SETTING: Simulation laboratory. SUBJECTS: Residents, Critical Care Medicine fellows, acute care nurse practitioner students. INTERVENTIONS: Performance scoring in scenarios from multiple Critical Care Medicine competency domains. MEASUREMENTS AND MAIN RESULTS: Three-hundred eighty-four performances by 48 participants were scored using checklists (% correct) and holistic "global" ratings (1 [unprepared] to 9 [expert]). One-hundred eighty were scored by two raters. Mean checklist and global scores (± SD) ranged from 65.0% (± 16.3%) to 84.5% (± 17.3%) and 4.7 (± 1.4) to 7.2 (± 1.2). Checklist and global scores for Critical Care Medicine fellows and senior acute care nurse practitioner students (Experienced group, n = 26) were significantly higher than those for the Novice acute care nurse practitioner students (Novice group, n = 14) (75.6% ± 15.6% vs 68.8% ± 21.0% and 6.1 ± 1.6 vs 5.4 ± 1.5, respectively; p < 0.05). Residents (Intermediate group, n = 8) scored between the two (75.4% ± 18.3% and 5.7 ± 1.7). 38.5% of the Experienced group scored in the top quartile for mean global score, compared with 12.5% of the Intermediate and 7.1% of the Novice groups. Conversely, 50% of the Novice group scored in the lower quartile (< 5.3), compared with 37.5% of the Intermediate and 11.5% of the Experienced groups. Psychometric analyses yielded discrimination values greater than 0.3 for most scenarios and reliability for the eight-scenario assessments of 0.51 and 0.60, with interrater reliability of 0.71 and 0.75, for checklist and global scoring, respectively. CONCLUSIONS: The simulation assessments yielded reasonably reliable measures of Critical Care Medicine decision-making skills. Despite a wide range of performance, those with more ICU training and experience performed better, providing evidence to support the validity of the scores. Simulation-based assessments may ultimately prove useful to determine readiness to assume decision-making roles in the ICU.

Simulation-based Assessment to Reliably Identify Key Resident Performance Attributes.

BACKGROUND: Obtaining reliable and valid information on resident performance is critical to patient safety and training program improvement. The goals were to characterize important anesthesia resident performance gaps that are not typically evaluated, and to further validate scores from a multiscenario simulation-based assessment. METHODS: Seven high-fidelity scenarios reflecting core anesthesiology skills were administered to 51 first-year residents (CA-1s) and 16 third-year residents (CA-3s) from three residency programs. Twenty trained attending anesthesiologists rated resident performances using a seven-point behaviorally anchored rating scale for five domains: (1) formulate a clear plan, (2) modify the plan under changing conditions, (3) communicate effectively, (4) identify performance improvement opportunities, and (5) recognize limits. A second rater assessed 10% of encounters. Scores and variances for each domain, each scenario, and the total were compared. Low domain ratings (1, 2) were examined in detail. RESULTS: Interrater agreement was 0.76; reliability of the seven-scenario assessment was r = 0.70. CA-3s had a significantly higher average total score (4.9 ± 1.1 vs. 4.6 ± 1.1, P = 0.01, effect size = 0.33). CA-3s significantly outscored CA-1s for five of seven scenarios and domains 1, 2, and 3. CA-1s had a significantly higher proportion of worrisome ratings than CA-3s (chi-square = 24.1, P < 0.01, effect size = 1.50). Ninety-eight percent of residents rated the simulations more educational than an average day in the operating room. CONCLUSIONS: Sensitivity of the assessment to CA-1 versus CA-3 performance differences for most scenarios and domains supports validity. No differences, by experience level, were detected for two domains associated with reflective practice. Smaller score variances for CA-3s likely reflect a training effect; however, worrisome performance scores for both CA-1s and CA-3s suggest room for improvement.

Rescuing the Clinical Breast Examination: Advances in Classifying Technique and Assessing Physician Competency.

OBJECTIVE: Develop new performance evaluation standards for the clinical breast examination (CBE). SUMMARY BACKGROUND DATA: There are several, technical aspects of a proper CBE. Our recent work discovered a significant, linear relationship between palpation force and CBE accuracy. This article investigates the relationship between other technical aspects of the CBE and accuracy. METHODS: This performance assessment study involved data collection from physicians (n = 553) attending 3 different clinical meetings between 2013 and 2014: American Society of Breast Surgeons, American Academy of Family Physicians, and American College of Obstetricians and Gynecologists. Four, previously validated, sensor-enabled breast models were used for clinical skills assessment. Models A and B had solitary, superficial, 2 cm and 1 cm soft masses, respectively. Models C and D had solitary, deep, 2 cm hard and moderately firm masses, respectively. Finger movements (search technique) from 1137 CBE video recordings were independently classified by 2 observers. Final classifications were compared with CBE accuracy. RESULTS: Accuracy rates were model A = 99.6%, model B = 89.7%, model C = 75%, and model D = 60%. Final classification categories for search technique included rubbing movement, vertical movement, piano fingers, and other. Interrater reliability was (k = 0.79). Rubbing movement was 4 times more likely to yield an accurate assessment (odds ratio 3.81, P < 0.001) compared with vertical movement and piano fingers. Piano fingers had the highest failure rate (36.5%). Regression analysis of search pattern, search technique, palpation force, examination time, and 6 demographic variables, revealed that search technique independently and significantly affected CBE accuracy (P < 0.001). CONCLUSIONS: Our results support measurement and classification of CBE techniques and provide the foundation for a new paradigm in teaching and assessing hands-on clinical skills. The newly described piano fingers palpation technique was noted to have unusually high failure rates. Medical educators should be aware of the potential differences in effectiveness for various CBE techniques.

The Simulation-Based Assessment of Pediatric Rapid Response Teams.

OBJECTIVE: To create scenarios of simulated decompensating pediatric patients to train pediatric rapid response teams (RRTs) and to determine whether the scenario scores provide a valid assessment of RRT performance with the hypothesis that RRTs led by intensivists-in-training would be better prepared to manage the scenarios than teams led by nurse practitioners. STUDY DESIGN: A set of 10 simulated scenarios was designed for the training and assessment of pediatric RRTs. Pediatric RRTs, comprising a pediatric intensive care unit (PICU) registered nurse and respiratory therapist, led by a PICU intensivist-in-training or a pediatric nurse practitioner, managed 7 simulated acutely decompensating patients. Two raters evaluated the scenario performances and psychometric analyses of the scenarios were performed. RESULTS: The teams readily managed scenarios such as supraventricular tachycardia and opioid overdose but had difficulty with more complicated scenarios such as aortic coarctation or head injury. The management of any particular scenario was reasonably predictive of overall team performance. The teams led by the PICU intensivists-in-training outperformed the teams led by the pediatric nurse practitioners. CONCLUSIONS: Simulation provides a method for RRTs to develop decision-making skills in managing decompensating pediatric patients. The multiple scenario assessment provided a moderately reliable team score. The greater scores achieved by PICU intensivist-in-training-led teams provides some evidence to support the validity of the assessment.

Simulation-based Assessment of the Management of Critical Events by Board-certified Anesthesiologists.

BACKGROUND: We sought to determine whether mannequin-based simulation can reliably characterize how board-certified anesthesiologists manage simulated medical emergencies. Our primary focus was to identify gaps in performance and to establish psychometric properties of the assessment methods. METHODS: A total of 263 consenting board-certified anesthesiologists participating in existing simulation-based maintenance of certification courses at one of eight simulation centers were video recorded performing simulated emergency scenarios. Each participated in two 20-min, standardized, high-fidelity simulated medical crisis scenarios, once each as primary anesthesiologist and first responder. Via a Delphi technique, an independent panel of expert anesthesiologists identified critical performance elements for each scenario. Trained, blinded anesthesiologists rated video recordings using standardized rating tools. Measures included the percentage of critical performance elements observed and holistic (one to nine ordinal scale) ratings of participant's technical and nontechnical performance. Raters also judged whether the performance was at a level expected of a board-certified anesthesiologist. RESULTS: Rater reliability for most measures was good. In 284 simulated emergencies, participants were rated as successfully completing 81% (interquartile range, 75 to 90%) of the critical performance elements. The median rating of both technical and nontechnical holistic performance was five, distributed across the nine-point scale. Approximately one-quarter of participants received low holistic ratings (i.e., three or less). Higher-rated performances were associated with younger age but not with previous simulation experience or other individual characteristics. Calling for help was associated with better individual and team performance. CONCLUSIONS: Standardized simulation-based assessment identified performance gaps informing opportunities for improvement. If a substantial proportion of experienced anesthesiologists struggle with managing medical emergencies, continuing medical education activities should be reevaluated.

A comparison of physician emigration from Africa to the United States of America between 2005 and 2015.

BACKGROUND: Migration of health professionals has been a cause for global concern, in particular migration from African countries with a high disease burden and already fragile health systems. An estimated one fifth of African-born physicians are working in high-income countries. Lack of good data makes it difficult to determine what constitutes "African" physicians, as most studies do not distinguish between their country of citizenship and country of training. Thus, the real extent of migration from African countries to the United States (US) remains unclear. This paper quantifies where African migrant physicians come from, where they were educated, and how these trends have changed over time. METHODS: We combined data from the Educational Commission for Foreign Medical Graduates with the 2005 and 2015 American Medical Association Physician Masterfiles. Using a repeated cross-sectional study design, we reviewed the available data, including medical school attended, country of medical school, and citizenship when entering medical school. RESULTS: The outflow of African-educated physicians to the US has increased over the past 10 years, from 10 684 in 2005 to 13 584 in 2015 (27.1% increase). This represents 5.9% of all international medical graduates in the US workforce in 2015. The number of African-educated physicians who graduated from medical schools in sub-Saharan countries was 2014 in 2005 and 8150 in 2015 (304.6% increase). We found four distinct categorizations of African-trained physicians migrating to the US: (1) citizens from an African country who attended medical school in their own country (86.2%, n = 11,697); (2) citizens from an African country who attended medical school in another African country (2.3%, n = 317); (3) US citizens who attended medical school in an African country (4.0%, n = 537); (4) citizens from a country outside Africa, and other than the United States, who attended medical school in an African country (7.5%, n = 1013). Overall, six schools in Africa provided half of all African-educated physicians. CONCLUSIONS: The number of African-educated physicians in the US has increased over the past 10 years. We have distinguished four migration patterns, based on citizenship and country of medical school. The majority of African graduates come to the US from relatively few countries, and from a limited number of medical schools. A proportion are not citizens of the country where they attended medical school, highlighting the internationalization of medical education.

Patients of doctors further from medical school graduation have poorer outcomes.

CONTEXT: There is an apparent contradiction between the findings of studies indicating that patient outcomes are better when physicians have a greater volume of practice and those that find outcomes to be worse with increased time since training, which implies greater volume. OBJECTIVES: This study was designed to estimate the adjusted relationships between physicians' characteristics, including recent practice volume and time since medical school graduation, and patient outcomes. METHODS: This is a retrospective observational study based on all Pennsylvania hospitalisations over 7 years for acute myocardial infarction, congestive heart failure, gastrointestinal haemorrhage, hip fracture and pneumonia. It refers to 694 020 hospitalisations in 184 hospitals attended by 5280 internists and family physicians. Patient severity of illness at admission and in-hospital mortality, hospital location and volume, and the physician's recent practice volume, time since medical school graduation, board certification, and citizenship or medical school location were analysed. RESULTS: After adjustment, recent practice volume did not have a statistically significant association with in-hospital mortality for all of the conditions combined. By contrast, each decade since graduation from medical school was associated with a 4.5% increase in relative risk for patient mortality. CONCLUSIONS: Recent practice volume does not mitigate the increase in patient mortality associated with physicians' time since medical school graduation. These findings underscore the need to finds ways to support and encourage learning.

Comparison study of judged clinical skills competence from standard setting ratings generated under different administration conditions.

When the safety of the public is at stake, it is particularly relevant for licensing and credentialing exam agencies to use defensible standard setting methods to categorize candidates into competence categories (e.g., pass/fail). The aim of this study was to gather evidence to support change to the Comprehensive Osteopathic Medical Licensing-USA Level 2-Performance Evaluation standard setting design and administrative process. Twenty-two video recordings of candidates assessed for clinical competence were randomly selected from the 2014-2015 Humanistic domain test score distribution ranging from the highest to lowest quintile of performance. Nineteen panelists convened at the same site to receive training and practice prior to generating judgments of qualified or not qualified performance to each of the twenty videos. At the end of training, one panel remained onsite to complete their judgments and the second panel was released and given 1 week to observe the same twenty videos and complete their judgments offsite. The two one-sided test procedure established equivalence between panel group means at the 0.05 confidence level, controlling for rater errors within each panel group. From a practical cost-effective and administrative resource perspective, results from this study suggest it is possible to diverge from typical panel groups, who are sequestered the entire time onsite, to larger numbers of panelists who can make their judgments offsite with little impact on judged samples of qualified performance. Standard setting designs having panelists train together and then allowing those to provide judgments yields equivalent ratings and, ultimately, similar cut scores.

Effect of a simulation-based workshop on breaking bad news for anesthesiology residents: an intervention study.

BACKGROUND: Breaking bad news (BBN) to patients and their relatives is a complex and stressful task. The ideal structure, training methods and assessment instruments best used to teach and assess BBN for anesthesiology residents remain unclear. The purpose of this study is to evaluate the effectiveness of an education intervention for BBN based on immersive experiences with a high fidelity simulator and role-play with standardized patients (SPs). A secondary purpose is to gather validity evidence to support the use of a GRIEV_ING instrument to assess BBN skills. METHODS: The communication skills for BBN of 16 residents were assessed via videotaped SP encounters at baseline and immediately post-intervention. Residents' perceptions about their ability and comfort for BBN were collected using pre and post workshop surveys. RESULTS: Posttest scores were significantly higher than the pretest scores for the GRIEV_ING checklist, as well as on the communication global rating. The GRIEV_ING checklist had acceptable inter-rater and internal-consistency reliabilities. Performance was not related to years of training, or previous BBN experience. CONCLUSION: Anesthesiology residents' communication skills when BBN in relation to a critical incident may be improved with educational interventions based on immersive experiences with a high fidelity simulator and role-play with SPs.

A longitudinal study of the characteristics and performances of medical students and graduates from the Arab countries.

BACKGROUND: While international physician migration has been studied extensively, more focused and regional explorations are not commonplace. In many Arab countries, medical education is conducted in English and students/graduates seek postgraduate opportunities in other countries such as the United States (US). Eligibility for residency training in the US requires certification by the Educational Commission for Foreign Medical Graduates (ECFMG). This study investigates ECFMG application trends, examination performance, and US physician practice data to quantify the abilities and examine the career pathways of Arab-trained physicians. METHODS: Medical students and graduates from 15 Arab countries where English is the language of medical school instruction were studied. The performances (1(st) attempt pass rates) of individuals on the United States Medical Licensing Examination Step 1, Step 2CK (clinical knowledge), and and a combination of Step 2CS (clinical skills) and ECFMG CSA (clinical skills assessment) were tallied and contrasted by country. Based on physician practice data, the contribution of Arab-trained physicians to the US healthcare workforce was explored. Descriptive statistics (means, frequencies) were used to summarize the collected data. RESULTS: Between 1998 and 2012, there has been an increase in the number of Arab trained students/graduates seeking ECFMG certification. Examination performance varied considerably across countries, suggesting differences in the quality of medical education programs in the Eastern Mediterranean Region. Based on current US practice data, physicians from some Arab countries who seek postgraduate opportunities in the US are less likely to stay in the US following specialty training. CONCLUSION: Countries, or regions, with concerns about physician migration, physican performance, or the pedagogical quality of their training programs should conduct longitudinal research studies to help inform medical education policies.