ABSTRACT
OBJECTIVE: The goals of this study were (1) to assess if examiner ratings in the American Board of Surgery (ABS) General Surgery Cetifying Exam (CE) are biased based on the gender, race, and ethnicity of the candidate or the examiners, and (2) if the format of delivering of the exams, in-person or virtual, affects how examiners rate candidates. DESIGN: We included every candidate-examiner combination for first time takers of the general surgery oral exam. Total scores and pass/fail outcomes based on the 4 scores given by examiners to candidates were analyzed using multilevel models, with candidates as random effects. Explanatory variables included the gender, race, and ethnicity of candidates and examiners, and the format of the exam (in-person or virtual). Candidates' first attempt scores on the ABS General Surgery Qualifying Exam (QE) were also included in the models to control for the baseline knowledge of the candidate. Three sets of models were evaluated for each demographic variable (gender, race, ethnicity) due to missingness in data. p-values and coefficients of determination R2 were used to quantify the statistical and practical significance of the model coefficients (an existent relationship between the explored variables on CE scores was considered statistically and practically significant if the p-value was lower than 0.01 and R2 higher than 1%). PARTICIPANTS: All first-time takers of the American Board of Surgery General Surgery Certifying Exam from 2016 to 2022 that had demographic data, and the examiners that participated in those exams. RESULTS: The number of candidates/examiners for the 3 sets of models was 8665/514 (gender), 5906/465 (race), and 4678/295 (ethnicity). The demographic variables, format of the exam, or their interactions were not found to significantly relate to examiner-candidate ratings or pass/fail outcomes. The only variable that was significantly related to CE scores was candidates' QE scores, which was added to the models as a measure of candidates' initial knowledge; this held for all models for total scores (F[1,8659]â¯=â¯1069.89, p-value < 0.01, R2â¯=â¯5% [gender models], F(1,5696.3)â¯=â¯589.13, p-value < 0.01, R2â¯=â¯5% [race models], F(1,4459.5)â¯=â¯278.33, p-value < 0.01, R2â¯=â¯5% [ethnicity models]), and pass/fail outcomes (CIâ¯=â¯1.61-1.73, p-value < 0.01, R2â¯=â¯3% [gender models], CIâ¯=â¯1.67-1.85, p-value < 0.01, R2â¯=â¯3% [race models], CIâ¯=â¯2.17-2.90, p-value < 0.01, R2â¯=â¯3% [ethnicity models]). CONCLUSIONS: This study shows that there is not a relationship between candidate and examiner gender, race, or ethnicity, and exam outcomes based on statistical models looking at examiner-candidate ratings and pass/fail outcomes. In addition, the delivery of the certifying exam in a virtual format appears to have no statistical impact on outcomes compared to in-person delivery. This suggests that the ABS is performing well in both demographic bias and virtual space.
Subject(s)
Certification , General Surgery , Humans , United States , Specialty Boards , Educational Measurement , Ethnicity , General Surgery/education , Clinical CompetenceABSTRACT
OBJECTIVE: Historically, the American Board of Surgery required surgeons to pass the qualifying examination (QE) before taking the certifying examination (CE). However, in the 2020-2021 academic year, with mitigating circumstances related to COVID-19, the ABS removed this sequencing requirement to facilitate the certification process for those candidates who were negatively impacted by a QE delivery failure. This decoupling of the traditional order of exam delivery has provided a natural comparator to the traditional route and an analysis of the impact of examination sequencing on candidate performance. METHODS: All candidates who applied for the canceled July 2020 QE were allowed to take the CE before passing the QE. The sample was then reduced to include only first-time candidates to ensure comparable groups for performance outcomes. Logistic regression was used to analyze the relationship between the order of taking the QE and the CE, controlling for other examination performance, international medical graduate status, and gender. RESULTS: Only first-time candidates who took both examinations were compared (n=947). Examination sequence was not a significant predictor of QE pass/fail outcomes, OR=0.54; 95% CI, 0.19-1.61, P =0.26. However, examination sequence was a significant predictor of CE pass/fail outcomes, OR=2.54; 95% CI, 1.46-4.68, P =0.002. CONCLUSIONS: This important study suggests that preparation for the QE increases the probability of passing the CE and provides evidence that knowledge may be foundational for clinical judgment. The ABS will consider these findings for examination sequencing moving forward.
Subject(s)
General Surgery , Internship and Residency , Surgeons , United States , Humans , Specialty Boards , Educational Measurement , Certification , Logistic Models , General Surgery/education , Clinical CompetenceABSTRACT
BACKGROUND: The three-item occupational violence (OV) risk assessment tool was developed and validated for use in emergency departments (EDs). It prompts review of each patient's aggression history, behaviours, and clinical presentation. However, confidence around representativeness and generalisability are needed before widescale adoption; hence we measured the inter-rater reliability of the tool among a large group of emergency nurses. METHODS: A cross-sectional study was conducted between Sep 2021 and Jan 2022. Nurses were directed to a website that hosted an e-learning module about the tool. They were asked to apply the tool to two video scenarios of typical patient presentations. Demographic data, including years of emergency experience, were collected to contextualise their responses. Gwet's Agreement Coefficients (AC1) were calculated to determine inter-rater reliability. RESULTS: There were 135 participants: typically female, under the age of 40 years, with more than 3 years of emergency nursing experience. Overall, there was excellent inter-rater agreement (AC1 =0.752, p = 0.001). This was consistent when years of ED experience was stratified: 0-2 years, AC1 = 0.764, p = 0.002; 3-5 years, AC1 = 0.826, p = 0.001; 6-10 years, AC1 = 0.751, p < 0.001; 11-15 years, AC1 = 0.659, p = 0.004; ≥ 16 years, AC1 = 0.799, p < 0.001. CONCLUSION: The three-item OV risk assessment tool has excellent inter-rater reliability across a large sample of emergency nurses.
Subject(s)
Emergency Nursing , Emergency Service, Hospital , Humans , Female , Adult , Reproducibility of Results , Cross-Sectional Studies , ViolenceABSTRACT
OBJECTIVE: To compare the operative experience of general surgery residents and practicing general surgeons. SUMMARY OF BACKGROUND DATA: The scope of general surgery has evolved, yet it remains unknown whether residents are being exposed to the right mix of operations during residency. METHODS: A retrospective review of operative case logs submitted to the American Board of Surgery by US general surgery graduates and practicing general surgeons from 2013 to 2017 was performed. The operative experience of both cohorts was calculated as a proportion of total experience and ranked by frequency. The proportional experience between cohorts was analyzed using factorial analysis of variance. RESULTS: During the 5-year period, 5482 graduates applied for initial American Board of Surgery certification, and 4152 diplomates applied for recertification. Among all operative domains, the graduate experience was similar to that of diplomates in 6 of 12 areas (abdomen, alimentary tract, endoscopy, endocrine, other, skin/soft tissue; all P > 0.05). Residents have a greater experience in subspecialty areas (pediatric, thoracic, trauma, vascular, and plastic) at the expense of fewer breast procedures (all P < 0.05). The 30 operations most commonly performed by graduates comprised 67% of their total operative experience. Among these, residents performed 25 cases ≥10 times, 14 cases ≥20 times, and 7 cases ≥40 times. CONCLUSIONS: The operative experience of graduating US general surgery residents is largely similar to that of practicing general surgeons, particularly for core general surgery domains. These data offer reassurance that surgical training in the modern era appropriately exposes residents to the operations they may perform in practice.
Subject(s)
General Surgery , Internship and Residency , Surgeons , United States , Humans , Child , Clinical Competence , Certification , Retrospective Studies , General Surgery/education , Education, Medical, GraduateABSTRACT
OBJECTIVE: To measure associations between surgeons' examination performance and obtaining American Board of Surgery certification with the likelihood of having medical malpractice payments. BACKGROUND: Further research is needed to establish a broader understanding of the association of board certification and patient and practice outcomes. METHODS: Retrospective analysis using propensity score-matched surgeons who attempted to obtain American Board of Surgery certification. Surgeons who completed residency between 2000 and 2019 (n=910) and attempted to become certified were categorized as certified or failing to obtain certification. In addition, groups were categorized as either passing or failing their first attempt on the qualifying and certifying examinations. Malpractice payment reports were dichotomized for surgeons who either had a payment report or not. RESULTS: The hazard rate (HR) of malpractice payment reports was significantly greater for surgeons who attempted and failed to obtain certification [HR=1.87; 95% confidence interval (CI), 1.28-2.74] than for surgeons who were certified. Moreover, surgeons who failed either the qualifying (HR=1.64; 95% CI, 1.14-2.37) or certifying examination (HR=1.72; 95% CI, 1.14-2.60) had significantly higher malpractice payment HRs than those who passed the examinations on their first attempt. CONCLUSIONS: Failing to obtain board certification was associated with a higher rate of medical malpractice payments. In addition, failing examinations in the certification examination process on the first attempt was also associated with higher rates of medical malpractice payments. This study provides further evidence that board certification is linked to potential indicators for patient outcomes and practice quality.
Subject(s)
General Surgery , Internship and Residency , Malpractice , Surgeons , Certification , General Surgery/education , Humans , Retrospective Studies , United StatesABSTRACT
OBJECTIVE: Vascular surgery trainees participate in the vascular surgery in-training examination (VSITE) during each year of their training. Although the VSITE was developed as a low-stakes, formative examination, performance on that examination might correlate with the pass rates for the Vascular Surgery Board written qualifying examination (VQE) and oral certifying examination (VCE) and might, therefore, guide both trainees and program directors. The present study was designed to examine the ability of the VSITE to predict trainees' performance on the VQE and VCE. METHODS: All first-time candidates of the Vascular Surgery Board VQE and VCE were analyzed from 2016 to 2020, including those from both the integrated and independent training pathways. VSITE scores from the final year of training were associated with the VQE scores and the probability of passing the VQE and VCE both. Linear and logistic regression models were used to determine the ability of VSITE results to predict the VQE scores and the probability of passing each board examination. RESULTS: VSITE scores available for the 559 candidates (69.3% male; 30.7% female) who had completed the VQE and 369 candidates (66.7% male; 33.3% female) who had completed both the VQE and the VCE. The linear regression model results for the final year of training showed that the VSITE scores explained 34% of the variance in the VQE scores (29% for the integrated and 37% for the independent trainees). Logistic regression demonstrated that the final year VSITE scores were a significant predictor of passing the VQE for both integrated and independent trainees (P < .001). A VSITE score of 500 during the final year of training predicted a VQE passing probability of >90% for each group of candidates. The probability of passing the VQE decreased to 73% for candidates from integrated programs, 61% for candidates from independent programs, and 64% for the whole cohort when the score was 400. The VSITE scores were a significant predictor of passing the VCE only for the candidates from independent programs (odds ratio, 1.01; 95% confidence interval, 1.00-1.02; P < .01), for whom a VSITE score of 400 correlated with an 82% probability of passing the VCE. CONCLUSIONS: VSITE performance is predictive of passing the VQE for trainees from both integrated and independent training paradigms. Vascular surgery trainees and training programs should optimize their preparation and educational efforts to maximize performance on the VSITE during their final year of training to improve the likelihood of passing the VQE. Further analysis of the predictive value of VSITE scores during the earlier years of training might allow the board certification examinations to be administered earlier in the final year of training.
Subject(s)
General Surgery , Internship and Residency , Male , Female , Humans , United States , Educational Measurement/methods , Clinical Competence , Certification , Vascular Surgical Procedures/education , General Surgery/educationABSTRACT
The rising global HIV-1 burden urgently requires vaccines capable of providing heterologous protection. Here, we developed a clade C HIV-1 vaccine consisting of priming with modified vaccinia Ankara (MVA) and boosting with cyclically permuted trimeric gp120 (CycP-gp120) protein, delivered either orally using a needle-free injector or through parenteral injection. We tested protective efficacy of the vaccine against intrarectal challenges with a pathogenic heterologous clade C SHIV infection in rhesus macaques. Both routes of vaccination induced a strong envelope-specific IgG in serum and rectal secretions directed against V1V2 scaffolds from a global panel of viruses with polyfunctional activities. Envelope-specific IgG showed lower fucosylation compared with total IgG at baseline, and most of the vaccine-induced proliferating blood CD4+ T cells did not express CCR5 and α4ß7, markers associated with HIV target cells. After SHIV challenge, both routes of vaccination conferred significant and equivalent protection, with 40% of animals remaining uninfected at the end of six weekly repeated challenges with an estimated efficacy of 68% per exposure. Induction of envelope-specific IgG correlated positively with G1FB glycosylation, and G2S2F glycosylation correlated negatively with protection. Vaccine-induced TNF-α+ IFN-γ+ CD8+ T cells and TNF-α+ CD4+ T cells expressing low levels of CCR5 in the rectum at prechallenge were associated with decreased risk of SHIV acquisition. These results demonstrate that the clade C MVA/CycP-gp120 vaccine provides heterologous protection against a tier2 SHIV rectal challenge by inducing a polyfunctional antibody response with distinct Fc glycosylation profile, as well as cytotoxic CD8 T cell response and CCR5-negative T helper response in the rectum.
Subject(s)
AIDS Vaccines , HIV-1 , Simian Immunodeficiency Virus , Animals , CD8-Positive T-Lymphocytes , Glycosylation , Immunoglobulin G , Macaca mulatta , T-Lymphocytes, Helper-Inducer , Tumor Necrosis Factor-alpha , Vaccinia virusABSTRACT
OBJECTIVE: The onset of the COVID-19 (coronavirus disease 2019) pandemic mandated postponement of the in-person Vascular Surgery Board 2020 certifying examination (CE). Vascular surgery virtual CEs (VVCEs) were developed for the scheduled 2020 CEs (rescheduled to January 2021) and 2021 CEs (rescheduled to July 2021) to avoid postponing the certification testing. In the present study, we have reported the development, implementation, and outcomes of the first two VVCEs. METHODS: The VVCE was similar to the in-person format (three 30-minutes sessions, two examiners, four questions) but required a proctor and a host. In contrast to the general surgery VCEs, the VVCE also incorporated images. The candidates and examiners were instructed on the format, and technology checks were performed before the VVCE. The candidates were given the opportunity to invalidate their examination for technology-related reasons immediately after the examination. Postexamination surveys were administered to all the participants. RESULTS: The VVCEs were completed by 356 of 357 candidates (99.7%). The pass rates for the January 2021 and July 2021 examinations were 97.6% (first time, 99.4%; retake, 70%) and 94.7% (first time, 94.6%; retake, 100%), respectively. The pass rates were not significantly different from the 2019 in-person CE (χ2 = 2.30; P = .13; and χ2 = 0.01; P = .91, for the January 2021 and July 2021 examinations, respectively). None of the candidates had invalidated their examination. The candidates (162 of 356; 46%), examiners (64 of 118; 54%), proctors (25 of 27; 93%), and hosts (8 of 9; 89%) completing the survey were very satisfied with the examination (Likert score 4 or 5: candidates, 92.6%; noncandidates, 96.9%) and found the technology domains (Zoom, audio, video, viewing images) to be very good (Likert score 4 or 5), with candidate and other responder scores of 73% to 84% and >94%, respectively. Significantly more of the candidates had favored a future VVCE compared with the examiners (87% vs 32%; χ2 = 67.1; P < .001). The free text responses from all responders had commented favorably on the organization and implementation of the examination. However, some candidates had expressed concerns about image sizes, and some examiners had expressed concern about the time constraints for the question format. The candidates appreciated the convenience of an at-home examination, especially the avoidance of travel costs. CONCLUSIONS: The two Vascular Surgery Board VCEs were shown to be psychometrically sound and were overwhelmingly successful, demonstrating that image-based virtual examinations are feasible and could become the standard for the future.
Subject(s)
COVID-19 , Humans , COVID-19/epidemiology , Certification , Vascular Surgical Procedures , Surveys and QuestionnairesABSTRACT
BACKGROUND: The demographics and operative experience of general surgeons certified by the American Board of Surgery were last examined a decade ago. This study examines the contemporary workforce and scope of practice of general surgeons. STUDY DESIGN: Applications of diplomates seeking American Board of Surgery recertification from 2013 to 2017 were reviewed. Demographic data and case logs from the year before submission were analyzed. Total operative volume was examined, as were total volumes for 13 operative domains and 11 abdominal and alimentary tract subdomains. RESULTS: There were 4,735 general surgeons certified by the American Board of Surgery with a mean ± SD age of 53 ± 8 years and included 19% women and 14% international graduates. Regions of practice were 22% Northeast, 31% Southeast, 20% Midwest, 20% West, and 7% Southwest. Practice settings were 86% urban, 9% large rural, 4% small rural, and 1% isolated. Forty-one percent were 10 years, 35% were 20 years, and 24% were 30 years since initial certification. On average, general surgeons performed 417 ± 338 procedures per year, with abdominal, alimentary tract, and endoscopy being the most common. On multivariable analysis, male sex and being midcareer or late career were positively associated with being a high-volume (top quartile) surgeon, whereas age and practicing in either the Northeast or West demonstrated a negative association. CONCLUSIONS: The demographics of general surgeons have remained stable over time, except for an increased proportion of female surgeons. The overall operative experience is similar to years past but is widely variable between surgeons. Periodic analysis of these data is important for education and certification purposes.
Subject(s)
General Surgery , Surgeons , Certification , Female , General Surgery/education , Humans , Male , Middle Aged , Rural Population , United StatesABSTRACT
OBJECTIVE: To examine the alignment between graduating surgical trainee operative performance and a prior survey of surgical program director expectations. BACKGROUND: Surgical trainee operative training is expected to prepare residents to independently perform clinically important surgical procedures. METHODS: We conducted a cross-sectional observational study of US general surgery residents' rated operative performance for Core general surgery procedures. Residents' expected performance on those procedures at the time of graduation was compared to the current list of Core general surgery procedures ranked by their importance for clinical practice, as assessed via a previous national survey of general surgery program directors. We also examined the frequency of individual procedures logged by residents over the course of their training. RESULTS: Operative performance ratings for 29,885 procedures performed by 1861 surgical residents in 54 general surgery programs were analyzed. For each Core general surgery procedure, adjusted mean probability of a graduating resident being deemed practice-ready ranged from 0.59 to 0.99 (mean 0.90, standard deviation 0.08). There was weak correlation between the readiness of trainees to independently perform a procedure at the time of graduation and that procedure's historical importance to clinical practice ( p = 0.22, 95% confidence interval 0.01-0.41, P = 0.06). Residents also continue to have limited opportunities to learn many procedures that are important for clinical practice. CONCLUSION: The operative performance of graduating general surgery residents may not be well aligned with surgical program director expectations.
Subject(s)
General Surgery , Internship and Residency , Humans , Clinical Competence , Cross-Sectional Studies , Motivation , Surveys and Questionnaires , General Surgery/education , Education, Medical, GraduateABSTRACT
Monoclonal antibodies with neutralizing activity against SARS-CoV-2 have demonstrated clinical benefits in cases of mild-to-moderate SARS-CoV-2 infection, substantially reducing the risk for hospitalization and severe disease1-4. Treatment generally requires the administration of high doses of these monoclonal antibodies and has limited efficacy in preventing disease complications or mortality among hospitalized patients with COVID-195. Here we report the development and evaluation of anti-SARS-CoV-2 monoclonal antibodies with optimized Fc domains that show superior potency for prevention or treatment of COVID-19. Using several animal disease models of COVID-196,7, we demonstrate that selective engagement of activating Fcγ receptors results in improved efficacy in both preventing and treating disease-induced weight loss and mortality, significantly reducing the dose required to confer full protection against SARS-CoV-2 challenge and for treatment of pre-infected animals. Our results highlight the importance of Fcγ receptor pathways in driving antibody-mediated antiviral immunity and exclude the possibility of pathogenic or disease-enhancing effects of Fcγ receptor engagement of anti-SARS-CoV-2 antibodies upon infection. These findings have important implications for the development of Fc-engineered monoclonal antibodies with optimal Fc-effector function and improved clinical efficacy against COVID-19 disease.
Subject(s)
Antibodies, Monoclonal/therapeutic use , COVID-19 Drug Treatment , COVID-19/immunology , Immunoglobulin Fc Fragments/immunology , Immunoglobulin Fc Fragments/therapeutic use , SARS-CoV-2/drug effects , SARS-CoV-2/immunology , Animals , Antibodies, Monoclonal/chemistry , Antibodies, Monoclonal/immunology , Antibodies, Monoclonal/pharmacology , Antibodies, Neutralizing/chemistry , Antibodies, Neutralizing/immunology , Antibodies, Neutralizing/pharmacology , Antibodies, Neutralizing/therapeutic use , Cricetinae , Disease Models, Animal , Female , Humans , Immunoglobulin Fc Fragments/chemistry , Immunoglobulin Fc Fragments/pharmacology , Immunoglobulin G/chemistry , Immunoglobulin G/immunology , Male , Mice , Pre-Exposure Prophylaxis , Receptors, IgG/chemistry , Receptors, IgG/immunology , Treatment OutcomeABSTRACT
BACKGROUND: Rapid response systems aim to achieve a timely response to the deteriorating patient; however, the existing literature varies on whether timing of escalation directly affects patient outcomes. Prior studies have been limited to using 'decision to admit' to critical care, or arrival in the emergency department as 'time zero', rather than the onset of physiological deterioration. The aim of this study is to establish if duration of abnormal physiology prior to critical care admission ['Score to Door' (STD) time] impacts on patient outcomes. METHODS: A retrospective cross-sectional analysis of data from pooled electronic medical records from a multi-site academic hospital was performed. All unplanned adult admissions to critical care from the ward with persistent physiological derangement [defined as sustained high National Early Warning Score (NEWS) > / = 7 that did not decrease below 5] were eligible for inclusion. The primary outcome was critical care mortality. Secondary outcomes were length of critical care admission and hospital mortality. The impact of STD time was adjusted for patient factors (demographics, sickness severity, frailty, and co-morbidity) and logistic factors (timing of high NEWS, and out of hours status) utilising logistic and linear regression models. RESULTS: Six hundred and thirty-two patients were included over the 4-year study period, 16.3% died in critical care. STD time demonstrated a small but significant association with critical care mortality [adjusted odds ratio of 1.02 (95% CI 1.0-1.04, p = 0.01)]. It was also associated with hospital mortality (adjusted OR 1.02, 95% CI 1.0-1.04, p = 0.026), and critical care length of stay. Each hour from onset of physiological derangement increased critical care length of stay by 1.2%. STD time was influenced by the initial NEWS, but not by logistic factors such as out-of-hours status, or pre-existing patient factors such as co-morbidity or frailty. CONCLUSION: In a strictly defined population of high NEWS patients, the time from onset of sustained physiological derangement to critical care admission was associated with increased critical care and hospital mortality. If corroborated in further studies, this cohort definition could be utilised alongside the 'Score to Door' concept as a clinical indicator within rapid response systems.
Subject(s)
Clinical Deterioration , Hospital Administration/statistics & numerical data , Mortality/trends , Time-to-Treatment/standards , Aged , Cross-Sectional Studies , Female , Hospital Administration/standards , Humans , Intensive Care Units/organization & administration , Intensive Care Units/statistics & numerical data , Length of Stay/statistics & numerical data , Male , Middle Aged , Organ Dysfunction Scores , Regression Analysis , Retrospective Studies , Risk Assessment/methods , Risk Assessment/standards , Risk Assessment/statistics & numerical data , Time-to-Treatment/statistics & numerical dataABSTRACT
Monoclonal antibodies (mAbs) with neutralizing activity against SARS-CoV-2 have demonstrated clinical benefit in cases of mild to moderate SARS-CoV-2 infection, substantially reducing the risk for hospitalization and severe disease1-4. Treatment generally requires the administration of high doses of these mAbs with limited efficacy in preventing disease complications or mortality among hospitalized COVID-19 patients5. Here we report the development and evaluation of Fc-optimized anti-SARS-CoV-2 mAbs with superior potency to prevent or treat COVID-19 disease. In several animal models of COVID-19 disease6,7, we demonstrate that selective engagement of activating FcγRs results in improved efficacy in both preventing and treating disease-induced weight loss and mortality, significantly reducing the dose required to confer full protection upon SARS-CoV-2 challenge and treatment of pre-infected animals. Our results highlight the importance of FcγR pathways in driving antibody-mediated antiviral immunity, while excluding any pathogenic or disease-enhancing effects of FcγR engagement of anti-SARS-CoV-2 antibodies upon infection. These findings have important implications for the development of Fc-engineered mAbs with optimal Fc effector function and improved clinical efficacy against COVID-19 disease.
ABSTRACT
OBJECTIVE: To Study the Outcomes of the First Virtual General Surgery Certifying Exam of the American Board of Surgery. SUMMARY OF BACKGROUND DATA: The ABS General Surgery CE is normally an in-person oral examination. Due to the COVID-19 outbreak, the ABS was required to reschedule these. After 2 small pilots, the CE's October administration represented the first large-scale remote virtual exam. The purpose of this report is to compare the outcomes of this virtual and the previous in-person CEs. METHODS: CE candidates were asked to provide feedback on their experience via a survey. The passing rate was compared to the 1025 candidates who took the 2019-2020 in-person CEs. RESULTS: Of the 308 candidates who registered for the virtual CE, 306 completed the exam (99.4%) and 188 completed the survey (61.4%). The majority had a very positive experience. They rated the virtual CE as very good/excellent in security (90%), ease of exam platform (77%), audio quality (71%), video quality (69%), and overall satisfaction (86%). Notably, when asked their preference, 78% preferred the virtual exam. There were no differences in the passing rates between the virtual or in-person exams. CONCLUSIONS: The first virtual CE by the ABS was completed using available internet technology. There was high satisfaction, with the majority preferring the virtual platform. Compared to past in-person CEs, there was no difference in outcomes as measured by passing rates. These data suggest that expansion of the virtual CE may be desirable.
Subject(s)
Certification/methods , General Surgery , Online Systems , Specialty Boards , Surveys and Questionnaires , United StatesABSTRACT
OBJECTIVE: To determine if initial American Board of Surgery certification in general surgery is associated with better risk-adjusted patient outcomes for Medicare patients undergoing partial colectomy by an early career surgeon. BACKGROUND: Board certification is a voluntary commitment to professionalism, continued learning, and delivery of high-quality patient care. Not all surgeons are certified, and some have questioned the value of certification due to limited evidence that board-certified surgeons have better patient outcomes. In response, we examined the outcomes of certified versus noncertified early career general surgeons. METHODS: We identified Medicare patients who underwent a partial colectomy between 2008 and 2016 and were operated on by a non-subspecialty trained surgeon within their first 5 years of practice. Surgeon certification status was determined using the American Board of Surgery data. Generalized linear mixed models were used to control for patient-, procedure-, and hospital-level effects. Primary outcomes were the occurrence of severe complications and occurrence of death within 30 days. RESULTS: We identified 69,325 patients who underwent a partial colectomy by an early career general surgeon. The adjusted rate of severe complications after partial colectomy by certified (n = 4239) versus noncertified (n = 191) early-career general surgeons was 9.1% versus 10.7% (odds ratio 0.83, P = 0.03). Adjusted mortality rate for certified versus noncertified early-career general surgeons was 4.9% versus 6.1% (odds ratio 0.79, P = 0.01). CONCLUSION: Patients undergoing partial colectomy by an early career general surgeon have decreased odds of severe complications and death when their surgeon is board certified.
Subject(s)
Certification , Clinical Competence/standards , Colectomy/standards , General Surgery/standards , Outcome and Process Assessment, Health Care , Surgeons/standards , Aged , Colectomy/mortality , Female , Humans , Male , Medicare , Postoperative Complications/epidemiology , Specialty Boards , United States/epidemiologyABSTRACT
OBJECTIVE: Surgical trainees are subject to pressure from variety of stakeholders to secure board certification from the American Board of Surgery (ABS). To meet these expectations, trainees must pass a written qualifying exam (QE) and an oral certifying exam (CE) within 7 years of completing general surgery residency. Board certification outcomes for candidates who fail either the QE or CE examination are not well characterized, but this information could help candidates, policymakers, and other stakeholders make informed decisions about how to respond to examination failure. METHODS: We retrospectively examined ABS records for all surgeons who completed general surgery residency from 2000 to 2013 and attempted general surgery board certification. RESULTS: Among 14,483 surgeons who attempted general surgery certification, 13,566 (94%) passed both the QE and CE within the 7-year certification window. Of those who did ultimately obtain certification, 97% passed the QE within 2 attempts and 97% passed the CE within 2 attempts. For those who failed either the QE or the CE twice, 67% ultimately obtained certification. CONCLUSIONS: Most surgeons who obtained ABS general surgery board certification did so within 2 attempts at each board examination. Candidates who fail either examination twice are less likely to achieve board certification.
Subject(s)
General Surgery , Internship and Residency , Surgeons , Certification , Educational Measurement , General Surgery/education , Humans , Retrospective Studies , Specialty Boards , United StatesABSTRACT
Importance: Board certification is used as a marker of surgeon quality and professionalism. Although some research has linked certification in surgery to outcomes, more research is needed. Objective: To measure associations between surgeons obtaining American Board of Surgery (ABS) certification and examination performance with receiving future severe disciplinary actions against their medical licenses. Design, Setting, and Participants: Retrospective analysis of severe license action rates for surgeons who attempted ABS certification based on certification status and examination performance. Surgeons who attempted to become certified were classified as certified or failing to obtain certification. Additionally, groups were further categorized based on whether the surgeon had to repeat examinations and whether they ultimately passed. The study included surgeons who initially attempted certification between 1976 and 2017 (n = 44â¯290). Severe license actions from 1976 to 2018 were obtained from the Federation of State Medical Boards, and certification data were obtained from the ABS database. Data were analyzed between 1978 and 2008. Main Outcomes and Measures: Severe license action rates were analyzed across certified surgeons and those failing to obtain certification, as well as across examination performance groups. Results: The final dataset included 36â¯197 men (81.7%) and 8093 women (18.3%). The incidence of severe license actions was significantly greater for surgeons who attempted and failed to obtain certification (incidence rate per 1000 person-years = 2.49; 95% CI, 2.13-2.85) than surgeons who were certified (incidence rate per 1000 person years = 0.77; 95% CI, 0.71-0.83). Adjusting for sex and international medical graduate status, the risk of receiving a severe license action across time was also significantly greater for surgeons who failed to obtain certification. Surgeons who progressed further in the certification examination sequence and had fewer repeated examinations had a lower incidence and less risk over time of receiving severe license actions. Conclusions and Relevance: Obtaining board certification was associated with a lower rate of receiving severe license actions from a state medical board. Passing examinations in the certification examination process on the first attempt was also associated with lower severe license action rates. This study provides supporting evidence that board certification is 1 marker of surgeon quality and professionalism.