A validity study of COMLEX-USA Level 3 with the new test design.

CONTEXT: The National Board of Osteopathic Medical Examiners (NBOME) administers the Comprehensive Osteopathic Medical Licensing Examination of the United States (COMLEX-USA), a three-level examination designed for licensure for the practice of osteopathic medicine. The examination design for COMLEX-USA Level 3 (L3) was changed in September 2018 to a two-day computer-based examination with two components: a multiple-choice question (MCQ) component with single best answer and a clinical decision-making (CDM) case component with extended multiple-choice (EMC) and short answer (SA) questions. Continued validation of the L3 examination, especially with the new design, is essential for the appropriate interpretation and use of the test scores. OBJECTIVES: The purpose of this study is to gather evidence to support the validity of the L3 examination scores under the new design utilizing sources of evidence based on Kane's validity framework. METHODS: Kane's validity framework contains four components of evidence to support the validity argument: Scoring, Generalization, Extrapolation, and Implication/Decision. In this study, we gathered data from various sources and conducted analyses to provide evidence that the L3 examination is validly measuring what it is supposed to measure. These include reviewing content coverage of the L3 examination, documenting scoring and reporting processes, estimating the reliability and decision accuracy/consistency of the scores, quantifying associations between the scores from the MCQ and CDM components and between scores from different competency domains of the L3 examination, exploring the relationships between L3 scores and scores from a performance-based assessment that measures related constructs, performing subgroup comparisons, and describing and justifying the criterion-referenced standard setting process. The analysis data contains first-attempt test scores for 8,366 candidates who took the L3 examination between September 2018 and December 2019. The performance-based assessment utilized as a criterion measure in this study is COMLEX-USA Level 2 Performance Evaluation (L2-PE). RESULTS: All assessment forms were built through the automated test assembly (ATA) procedure to maximize parallelism in terms of content coverage and statistical properties across the forms. Scoring and reporting follows industry-standard quality-control procedures. The inter-rater reliability of SA rating, decision accuracy, and decision consistency for pass/fail classifications are all very high. There is a statistically significant positive association between the MCQ and the CDM components of the L3 examination. The patterns of associations, both within the L3 subscores and with L2-PE domain scores, fit with what is being measured. The subgroup comparisons by gender, race, and first language showed expected small differences in mean scores between the subgroups within each category and yielded findings that are consistent with those described in the literature. The L3 pass/fail standard was established through implementation of a defensible criterion-referenced procedure. CONCLUSIONS: This study provides some additional validity evidence for the L3 examination based on Kane's validity framework. The validity of any measurement must be established through ongoing evaluation of the related evidence. The NBOME will continue to collect evidence to support validity arguments for the COMLEX-USA examination series.

Comparison of Bedside and Video-Based Capillary Refill Time Assessment in Children.

OBJECTIVES: Capillary refill time (CRT) to assess peripheral perfusion in children with suspected shock may be subject to poor reproducibility. Our objectives were to compare video-based and bedside CRT assessment using a standardized protocol and evaluate interrater and intrarater consistency of video-based CRT (VB-CRT) assessment. We hypothesized that measurement errors associated with raters would be low for both standardized bedside CRT and VB-CRT as well as VB-CRT across raters. METHODS: Ninety-nine children (aged 1-12 y) had 5 consecutive bedside CRT assessments by an experienced critical care clinician following a standardized protocol. Each CRT assessment was video recorded on a black background. Thirty video clips (10 with bedside CRT < 1 s, 10 with CRT 1-2 s, and 10 with CRT > 2 s) were randomly selected and presented to 10 clinicians twice in randomized order. They were instructed to push a button when they visualized release of compression and completion of a capillary refill. The correlation and absolute difference between bedside and VB-CRT were assessed. Consistency across raters and within each rater was analyzed using the intraclass correlation coefficient (ICC). A Generalizability study was performed to evaluate sources of variation. RESULTS: We found moderate agreement between bedside and VB-CRT observations (r = 0.65; P < 0.001). The VB-CRT values were shorter by 0.17 s (95% confidence interval, 0.09-0.25; P < 0.001) on average compared with bedside CRT. There was moderate agreement in VB-CRT across raters (ICC = 0.61). Consistency of repeated VB-CRT within each rater was moderate (ICC = 0.71). Generalizability study revealed the source of largest variance was from individual patient video clips (57%), followed by interaction of the VB-CRT reviewer and patient video clip (10.7%). CONCLUSIONS: Bedside and VB-CRT observations showed moderate consistency. Using video-based assessment, moderate consistency was also observed across raters and within each rater. Further investigation to standardize and automate CRT measurement is warranted.

International Medical Graduates in the United States Psychiatry Workforce.

OBJECTIVE: This study describes the supply, distribution, and characteristics of international medical graduate (IMG) psychiatrists who provide services in the USA. METHODS: Cross-sectional study design, using descriptive statistics based on combined data from the American Medical Association (2020 Physician Masterfile) and the Educational Commission for Foreign Medical Graduates. RESULTS: International medical graduates continue to make significant contributions to the US physician workforce. As a group, they represent 29% of active psychiatrists in the USA, compared to 23% in all other medical specialties. Many IMG psychiatrists were US citizens who obtained their medical degrees outside the USA or Canada, often in the Caribbean. In some states (i.e., Florida, New Jersey), over 40% of active psychiatrists are IMGs. Over 30% of IMG psychiatrists graduated from medical schools in India and Pakistan. CONCLUSIONS: This study provides an overview of the psychiatric workforce in the USA, quantifying the specific contribution of IMGs. Several factors, including immigration policies, continued expansion of US medical schools, and the number of available residency positions, could impact the flow of IMGs to the US. Longitudinal studies are needed to better understand the implications for workforce composition and distribution, and their potential impact on the care of psychiatric patients.

Making the grade: licensing examination performance by medical school accreditation status.

BACKGROUND: Accreditation systems strive to ensure the quality of undergraduate (basic) medical education and encourage ongoing improvements. Despite increasing global emphasis on quality assurance activities, there is limited research linking accreditation of medical education to improved student and graduate outcomes. The purpose of this study is to compare the United States Medical Licensing Examination® (USMLE®) performance of students and graduates who attended international medical schools accredited by an agency recognized by the World Federation of Medical Education (WFME) to individuals who attended schools that did not meet this criterion. METHODS: During the 2018-2020 study period, 39,650 individuals seeking Educational Commission for Foreign Medical Graduates® (ECFMG®) certification took one or more USMLE examinations. We cross-tabulated USMLE performance (first-attempt pass/fail result) and medical school accreditation status. RESULTS: Individuals seeking ECFMG certification who attended international medical schools accredited by an agency recognized by WFME had higher or comparable USMLE first-attempt pass rates compared to individuals who attended medical schools that did not meet this criterion. CONCLUSIONS: Implementing and maintaining meaningful accreditation systems requires substantial resources. These results provide important positive evidence that external evaluation of educational programs is associated, on average, with better educational outcomes, including in the domains of basic science, clinical knowledge, and clinical skills performance.

A Pilot Study of the Generalizability of Preclinical Entrustment Assessments in Undergraduate Medical Education.

PURPOSE: The reproducibility and consistency of assessments of entrustable professional activities (EPAs) in undergraduate medical education (UME) have been identified as potential areas of concern. EPAs were designed to facilitate workplace-based assessments by faculty with a shared mental model of a task who could observe a trainee complete the task multiple times. In UME, trainees are frequently assessed outside the workplace by faculty who only observe a task once. METHOD: In November 2019, the authors conducted a generalizability study (G-study) to examine the impact of student, faculty, case, and faculty familiarity with the student on the reliability of 162 entrustment assessments completed in a preclerkship environment. Three faculty were recruited to evaluate 18 students completing 3 standardized patient (SP) cases. Faculty familiarity with each student was determined. Decision studies were also completed. Secondary analysis of the relationship between student performance and entrustment (scoring inference) compared average SP checklist scores and entrustment scores. RESULTS: G-study analysis revealed that entrustment assessments struggled to achieve moderate reliability. The student accounted for 30.1% of the variance in entrustment scores with minimal influence from faculty and case, while the relationship between student and faculty accounted for 26.1% of the variance. G-study analysis also revealed a difference in generalizability between assessments by unfamiliar (φ = 0.75) and familiar (φ = 0.27) faculty. Subanalyses showed that entrustment assessments by familiar faculty were moderately correlated to average SP checklist scores (r = 0.44, P < .001), while those by unfamiliar faculty were weakly correlated (r = 0.16, P = .13). CONCLUSIONS: While faculty and case had a limited impact on the generalizability of entrustment assessments made outside the workplace in UME, faculty who were familiar with a student's ability had a notable impact on generalizability and potentially on the scoring validity of entrustment assessments, which warrants further study.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific.

INTRODUCTION: Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established. METHODS: Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters. RESULTS: The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability. CONCLUSIONS: The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

Medical School Accreditation Factors Associated With Certification by the Educational Commission for Foreign Medical Graduates (ECFMG): A 10-Year International Study.

PURPOSE: In 2024, international medical graduates seeking Educational Commission for Foreign Medical Graduates (ECFMG) certification will be required to graduate from an accredited medical school. This study's goal was to examine relationships between medical school accreditation variables and ECFMG certification for a global sample. METHOD: Using ECFMG databases, the authors created a 10-year cohort (January 1, 2007-December 31, 2016) of certification applicants, defined as individuals who had attempted at least 2 examinations required for certification. The authors aggregated applicant data at the school level, excluding schools with < 80 applicants. School accreditation statuses were based on agency websites. School region, age, and time of first accreditation were included. Analyses included descriptive and bivariate statistics and multiple linear regressions adjusting for school start year and year of first accreditation. RESULTS: The cohort included 128,046 applicants from 1,973 medical schools across 162 countries. After excluding low-volume schools, 318 schools across 81 countries remained. These provided 99,598 applicants and 77,919 certificate holders, three-quarters of whom came from the Caribbean, South-Central Asia, and West Asia regions. Two hundred and fifty (78.6%) schools were accredited; 68 (21.4%) were not. Most ECFMG applicants (n = 84,776, 85.1%) and certificate holders (n = 68,444, 87.8%) attended accredited medical schools. Accredited schools had higher rates of ECFMG certification among graduates than nonaccredited schools in comparisons that included all schools (75.0% [standard deviation (SD) = 10.6%] vs 68.3% (SD = 15.9%), P < .001), and for countries that had both accredited and nonaccredited schools (73.9% [SD = 11.4%] vs 67.3% [SD = 16.8%], P = .023). After adjusting for age of school, longer duration of accreditation was associated with higher certification rates (P < .001). CONCLUSIONS: Accreditation had a positive association with ECFMG certification rates. Future studies should investigate how accreditation processes might account for higher certification rates.

Competence in Decision Making: Setting Performance Standards for Critical Care.

BACKGROUND: Health care professionals must be able to make frequent and timely decisions that can alter the illness trajectory of intensive care patients. A competence standard for this ability is difficult to establish yet assuring practitioners can make appropriate judgments is an important step in advancing patient safety. We hypothesized that simulation can be used effectively to assess decision-making competence. To test our hypothesis, we used a "standard-setting" method to derive cut scores (standards) for 16 simulated ICU scenarios targeted at decision-making skills and applied them to a cohort of critical care trainees. METHODS: Panelists (critical care experts) reviewed digital audio-video performances of critical care trainees managing simulated critical care scenarios. Based on their collectively agreed-upon definition of "readiness" to make decisions in an ICU setting, each panelist made an independent judgment (ready, not ready) for a large number of recorded performances. The association between the panelists' judgments and the assessment scores was used to derive scenario-specific performance standards. RESULTS: For all 16 scenarios, the aggregate panelists' ratings (ready/not ready for independent decision making) were positively associated with the performance scores, permitting derivation of performance standards for each scenario. CONCLUSIONS: Minimum competence standards for high-stakes decision making can be established through standard-setting techniques. We effectively identified "front-line" providers who are, or are not, ready to make independent decisions in an ICU setting. Our approach may be used to assure stakeholders that clinicians are competent to make appropriate judgments. Further work is needed to determine whether our approach is effective in simulation-based assessments in other domains.

International Medical Graduates in the Pediatric Workforce in the United States.

BACKGROUND AND OBJECTIVES: To describe the supply, distribution, and characteristics of international medical graduates (IMGs) in pediatrics who provide patient care in the United States. METHODS: Cross-sectional study, combining data from the 2019 Physician Masterfile of the American Medical Association and the Educational Commission for Foreign Medical Graduates database. RESULTS: In total, 92 806 pediatric physicians were identified, comprising 9.4% of the entire US physician workforce. Over half are general pediatricians. IMGs account for 23.2% of all general pediatricians and pediatric subspecialists. Of all IMGs in pediatrics, 22.1% or 4775 are US citizens who obtained their medical degree outside the United States or Canada, and 15.4% (3246) attended medical school in the Caribbean. Fifteen non-US medical schools account for 29.9% of IMGs currently in active practice in pediatrics in the United States. IMGs are less likely to work in group practice or hospital-based practice and are more likely to be employed in solo practice (compared with US medical school graduates). CONCLUSIONS: With this study, we provide an overview of the pediatric workforce, quantifying the contribution of IMGs. Many IMGs are US citizens who attend medical school abroad and return to the United States for postgraduate training. Several factors, including the number of residency training positions, could affect future numbers of IMGs entering the United States. Longitudinal studies are needed to better understand the implications that workforce composition and distribution may have for the care of pediatric patients.

Canadians studying medicine abroad and their journey to secure postgraduate training in Canada or the United States.

BACKGROUND: From national and international workforce perspectives, Canadians studying medicine abroad (CSAs) are a growing provider group. Some were born in Canada whereas others immigrated as children. They study medicine in various countries, often attempting both American and Canadian medical licensure pathways. METHODS: Using data from the Educational Commission for Foreign Medical Graduates (ECFMG) and the Medical Council of Canada (MCC), we looked at CSAs who attempted to secure residency positions in both Canada and the United States. We detailed the CSAs' countries of birth and medical education. We tracked these individuals through their postgraduate education programs to enumerate their success rate and categorize the geographic locations of their training. RESULTS: The majority of CSAs study medicine in one of 10 countries. The remainder are disbursed across 88 other countries. Most CSAs were born in Canada (62%). Approximately 1/3 of CSA from the 2004-2016 cohort had no record of entering a residency program in Canada or the United States (U.S.). Recently graduated CSAs were most likely to secure residency training in Ontario and New York. CONCLUSION: Many CSAs attempt to secure residency training in both Canada and the U.S. Quantifying success rates may be helpful for Canadians thinking about studying medicine abroad. Understanding the educational pathways of CSAs will be useful for physician labour workforce planning.

CONTEXTE: Selon une perspective nationale et internationale des effectifs, les Canadiens qui étudient la médecine à l'étranger (CEE) représentent un groupe en croissance. Certains sont nés au Canada, alors que d'autres ont immigré durant leur enfance. Ils étudient la médecine dans divers pays, essayant souvent parallèlement d'obtenir un permis américain et canadien pour exercer la médecine. MÉTHODES: À l'aide de données de l'Educational Commission for Foreign Medical Graduates (ECFMG) et du Conseil médical du Canada (CMC), nous avons examiné les CEE qui avaient tenté d'obtenir des postes de résidence à la fois au Canada et aux États-Unis. Nous avons extrait des données quant au pays de naissance et à la formation médicale de ces CEE. Nous avons suivi ces personnes dans leurs processus de demande d'admission à des programmes de formation postdoctorale pour rapporter leur taux de succès et catégoriser les emplacements géographiques de leur formation. RÉSULTATS: Nous avons identifié 10 pays d'où provenaient la plupart de ces CEE. Les autres CEE provenaient de 88 autres pays. La plupart de ces CEE sont nées au Canada (62 %). Environ 1/3 des CEE de la cohorte de 2004 à 2016 ne possède pas de dossier d'inscription à un programme de résidence au Canada ou aux États-Unis. Les CEE récemment diplômés étaient les plus susceptibles de suivre une formation en résidence en Ontario et dans l'État de New York. CONCLUSION: De nombreux CEE ont tenté d'obtenir un poste de résidence au Canada et aux États-Unis. Quantifier les taux de succès pourrait se révéler utile pour les Canadiens qui pensent à étudier la médecine à l'étranger. Comprendre les parcours éducatifs des CEE sera utile à la planification des effectifs médicaux.

Prevalence of International Medical Graduates From Muslim-Majority Nations in the US Physician Workforce From 2009 to 2019.

Importance: Historically, the US physician workforce has included a large number of international medical graduates (IMGs). Recent US immigration policies may affect the inflow of IMGs, particularly those who are citizens of Muslim-majority nations. Objectives: To provide an overview of the characteristics of IMGs from Muslim-majority nations, including their contributions to the US physician workforce, and to describe trends in the number of applications for certification to the Educational Commission for Foreign Medical Graduates between 2019 and 2018, both overall and for citizens of Muslim-majority nations. Design, Setting, and Participants: This cross-sectional study, which included 1 065 606 US physicians listed in the 2019 American Medical Association Physician Masterfile and 156 017 applicants to the Educational Commission for Foreign Medical Graduates certification process between 2009 and 2018, used a repeated cross-sectional study design to review the available data, including country of medical school attended, citizenship when entering medical school, and career information, such as present employment, specialty, and type of practice. Exposures: Country of citizenship when entering medical school. Main Outcomes and Measures: Physician counts and demographic information from the 2019 American Medical Association Physician Masterfile and applicant data from the Educational Commission for Foreign Medical Graduates from 2009 to 2018. Results: Of 1 065 606 physicians in the American Medical Association Physician Masterfile, 263 029 (24.7%) were IMGs, of whom 48 354 were citizens of Muslim-majority countries at time of entry to medical school, representing 18.4% of all IMGs. Overall, 1 in 22 physicians in the US was an IMG from a Muslim-majority nation, representing 4.5% of the total US physician workforce. More than half of IMGs from Muslim-majority nations (24 491 [50.6%]) come from 3 countries: Pakistan (14 352 [29.7%]), Iran (5288 [10.9%]), and Egypt (4851 [10.0%]). The most prevalent specialties include internal medicine (10 934 [23.6%]), family medicine (3430 [7.5%]), pediatrics (2767 [5.9%]), and psychiatry (2251 [4.8%]), with 18 229 (38.1%) practicing in primary care specialties. The number of applicants for Educational Commission for Foreign Medical Graduates certification from Muslim-majority countries increased from 2009 (3227 applicants) to 2015 (4244 applicants), then decreased by 2.1% in 2016 to 4254 applicants, 4.3% in 2017 to 4073 applicants, and 11.5% in 2018 to 3604 applicants. Much of this decrease could be attributed to fewer citizens from Pakistan (1042 applicants in 2015 to 919 applicants in 2018), Egypt (493 applicants in 2015 to 309 applicants in 2018), Iran (281 applicants in 2015 to 182 applicants in 2018), and Saudi Arabia (337 applicants in 2015 to 163 applicants in 2018) applying for certification. Conclusions and Relevance: Based on the findings of this study, the number of ECFMG applicants from Muslim-majority countries decreased from 2015 to 2018. The US physician workforce will continue to rely on IMGs for some time to come. To the extent that citizens from some countries no longer seek residency positions in the US, gaps in the physician workforce could widen.

Reporting a Pass/Fail Outcome for USMLE Step 1: Consequences and Challenges for International Medical Graduates.

After extensive stakeholder discussion, the Federation of State Medical Boards and the National Board of Medical Examiners announced in February 2020 that United States Medical Licensing Examination Step 1 will transition to a pass/fail exam. Program directors have historically used Step 1 scores in deciding which residency applicants to interview. The lack of numerical scores will force changes to the residency selection process, which could have both positive and negative consequences for international medical graduates (IMGs). In this Invited Commentary, the authors discuss how some of the issues associated with the transition to Step 1 pass/fail are likely to impact IMGs. The authors also provide insights into how this and other policy changes could help spur the medical education community to improve the process by which medical school graduates transition to graduate medical education.

Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification.

PURPOSE: Family medicine residency programs can be cited for low pass or take rates on the American Board of Family Medicine (ABFM) certification examination, and the relationships among standardized medical education assessments and performance on board certification examinations and eventual board certification have not been comprehensively studied. The objective of this study was to evaluate the associations of all required standardized examinations in medical education with ABFM certification examination scores and eventual ABFM certification. METHOD: All graduates of U.S. MD-granting family medicine residency programs from 2008 to 2012 were included. Data on ABFM certification examination score, ABFM certification status (as of December 31, 2014), Medical College Admission Test (MCAT) section scores, undergraduate grade point average, all United States Medical Licensing Examination (USMLE) Step scores, and all ABFM in-training examination scores were linked. Nested logistic and linear regression models, controlling for clustering by residency program, determined associations between assessments and both certification examination scores and board certification status. As many international medical graduates (IMGs) do not take the MCAT, separate models for U.S. medical graduates (USMG) and IMGs were run. RESULTS: The study sample was 15,902 family medicine graduates, of whom 92.1% (14,648/15,902) obtained board certification. In models for both IMGs and USMGs, the addition of more recent assessments weakened the associations of earlier assessments. USMLE Step 2 Clinical Knowledge was predictive of certification examination scores and certification status in all models in which it was included. CONCLUSIONS: For family medicine residents, more recent assessments generally have stronger associations with board certification score and status than earlier assessments. Solely using medical school admissions (grade point average and MCAT) and licensure (USMLE) scores for resident selection may not adequately predict ultimate board certification.

Specialty Board Certification Rate as an Outcome Metric for GME Training Institutions: A Relationship With Quality of Care.

Educational outcome measures, known to be associated with the quality of care, are needed to support improvements in graduate medical education (GME). This retrospective observational study sought to determine whether there was a relationship between the specialty board certification rates of GME training institutions and the quality of care delivered by their graduates. It is based on 7 years of hospitalizations in Pennsylvania (N = 354,767) with diagnoses of acute myocardial infarction, congestive heart failure, gastrointestinal hemorrhage, or pneumonia. The 2,265 attending physicians were self-identified internists, and they completed their training in 59 institutions. The percentage of board-certified physicians from each training institution, excluding the physician herself or himself, was calculated and an indicator of whether it exceeded 80% was created. This was analyzed against inhospital mortality and length of stay, adjusted for patient/physician/hospital characteristics. There were significantly lower odds of mortality (adjusted Odd's ratio [OR] = .92, 95% CI [0.86, 0.98]) and log length of stay (adjusted OR = .98, 95% CI [.94, .99]) when the attending physician trained in a residency program with an 80% or greater certification rate. The results suggest that specialty certification rates may be a useful educational outcome for residency training programs.

Supply, distribution and characteristics of international medical graduates in family medicine in the United States: a cross-sectional study.

BACKGROUND: To describe the supply, distribution, and characteristics of international medical graduates (IMGs) in family medicine who provide patient care in the U.S. METHODS: A cross-sectional study design, using descriptive statistics on combined data from the Educational Commission for Foreign Medical Graduates and the American Medical Association, including medical school attended, country of medical school, and citizenship when entering medical school. RESULTS: In total, 118,817 physicians in family medicine were identified, with IMGs representing 23.8% (n = 28,227) of the U.S. patient care workforce. Of all 9579 residents in family medicine, 36.0% (n = 3452) are IMGS. In total, 35.9% of IMGs attended medical school in the Caribbean (n = 10,136); 19.9% in South-Central Asia (n = 5607) and 9.1% in South-Eastern Asia (n = 2565). The most common countries of medical school training were Dominica, Mexico, and Sint Maarten. Of all IMGs in family medicine who attended medical school in the Caribbean, 74.5% were U.S. citizens. In total, 40.5% of all IMGs in family medicine held U.S. citizenship at entry to medical school. IMGs comprise almost 40% of the family medicine workforce in Florida, New Jersey and New York. CONCLUSIONS: IMGs play an important role in the U.S. family medicine workforce. Many IMGs are U.S. citizens who studied abroad and then returned to the U.S. for graduate training. Given the shortage of family physicians, and the large number of IMGs in graduate training programs, IMGs will continue to play a role in the U.S. physician workforce for some time to come. Many factors, including the supply of residency training positions, could eventually restrict the number of IMGs entering the U.S., including those contributing to family practice.

Specialty Choices, Practice Characteristics, and Long-term Outcomes of Two Cohorts of USUHS Medical School Graduates Compared with National Data.

Introduction: The education of health professionals and the assessment of their long-term goals are essential. Additionally, in the military health system (MHS), such programs also have the goals of improving readiness, providing high-quality care and meeting the needs and challenges of the MHS. The Uniformed Services University F. Edward Hebert School of Medicine (USUHS) has existed for over 40 years and the assessment of the longer term outcomes of its medical school graduates is an important endeavor. The purpose of this study is to describe the relationship of USUHS on the care in the MHS by reporting specialty choices, practice characteristics and locations of two consecutive cohorts of USUHS graduates and to compare these cohort findings with national data. Two cohorts were chosen as the first cohort has reached retirement and we sought to describe the impact of our graduates following their military service commitment. Materials and Methods: We performed a retrospective analysis of our graduates (1980-2009) using data obtained from the American Medical Association Physician Masterfile in two 15-year cohorts. USU graduate data are described and compared with national allopathic medical school data in order to explore USUHS graduates' practice characteristics and how these contrast with national data. Results: Family medicine was the most commonly identified primary care specialty across both USUHS cohorts. Other primary care specialties such as Internal Medicine and Pediatrics became more popular among USUHS graduates over time. There were a lower percentage of inactive USUHS graduates from the 1980-1994 cohorts than the U.S. national sample (3.23% vs. 3.98%). The proportion of USUHS graduates working in an office-based practice increased from 34.8% (1980-1994) to 43.6% (1995-2009) yet still was lower than U.S. national data (1980-1994: 73.5%; 1995-2009: 73.8%). The type of practice in which the majority of USUHS and national graduates were involved was direct patient care (over 70% of the population). Practice locations for medical school graduates included all 50 states. Furthermore, though several states such as Mississippi, Nevada, South Carolina, and Utah were among the top 20 practice locations among USUHS graduates, they did not appear among the top 20 practicing states for U.S. graduates. Conclusions: USUHS can play a major role by training health care professionals needed to meet the large health care strategic goals of a transforming military health system. A high percentage of USUHS graduates had significant changes in practice characteristics over time, are staying in practice for longer time compared with U.S. graduates, and practice in all 50 states including those that are underserved.