RESUMEN
OBJECTIVE: To determine the relationship between, and predictive utility of, milestone ratings and subsequent American Board of Surgery (ABS) vascular surgery in-training examination (VSITE), vascular qualifying examination (VQE), and vascular certifying examination (VCE) performance in a national cohort of vascular surgery trainees. BACKGROUND: Specialty board certification is an important indicator of physician competence. However, predicting future board certification examination performance during training continues to be challenging. METHODS: This is a national longitudinal cohort study examining relational and predictive associations between Accreditation Council for Graduate Medical Education (ACGME) Milestone ratings and performance on VSITE, VQE, and VCE for all vascular surgery trainees from 2015 to 2021. Predictive associations between milestone ratings and VSITE were conducted using cross-classified random-effects regression. Cross-classified random-effects logistic regression was used to identify predictive associations between milestone ratings and VQE and VCE. RESULTS: Milestone ratings were obtained for all residents and fellows(n=1,118) from 164 programs during the study period (from July 2015 to June 2021), including 145,959 total trainee assessments. Medical knowledge (MK) and patient care (PC) milestone ratings were strongly predictive of VSITE performance across all postgraduate years (PGYs) of training, with MK ratings demonstrating a slightly stronger predictive association overall (MK coefficient 17.26 to 35.76, ß = 0.15 to 0.23). All core competency ratings were predictive of VSITE performance in PGYs 4 and 5. PGY 5 MK was highly predictive of VQE performance [OR 4.73, (95% CI, 3.87-5.78), P <0.001]. PC subcompetencies were also highly predictive of VQE performance in the final year of training [OR 4.14, (95% CI, 3.17-5.41), P <0.001]. All other competencies were also significantly predictive of first-attempt VQE pass with ORs of 1.53 and higher. PGY 4 ICS ratings [OR 4.0, (95% CI, 3.06-5.21), P <0.001] emerged as the strongest predictor of VCE first-attempt pass. Again, all subcompetency ratings remained significant predictors of first-attempt pass on CE with ORs of 1.48 and higher. CONCLUSIONS: ACGME Milestone ratings are highly predictive of future VSITE performance, and first-attempt pass achievement on VQE and VCE in a national cohort of surgical trainees.
Asunto(s)
Internado y Residencia , Humanos , Estados Unidos , Estudios Longitudinales , Evaluación Educacional , Competencia Clínica , Educación de Postgrado en Medicina , AcreditaciónRESUMEN
INTRODUCTION: To analyze the cancer burden in the United States, researchers are relying on the Surveillance, Epidemiology, and End Results (SEER) Program. Our objective was to analyze differences in cancer outcome between Commission on Cancer (CoC)-accredited and non-accredited facilities. METHODS: The SEER database was queried for diagnosis years 2018 and 2019. Only analytic cases were included. Observed survival was calculated using the Kaplan-Meier method for all cancer sites, stratified by accreditation status. Univariate analyses were performed to quantify differences in survival between cancer cases in CoC-accredited and non-CoC-accredited facilities. Cancers of interest were chosen based on statistical significance (p < 0.01) and clinical significance (> 25% difference in end survival). Multivariate analyses were conducted on cancers of interest. RESULTS: Overall, there were 602,185 cases from CoC-accredited facilities and 198,492 from non-CoC-accredited facilities. 5 of 59 solid organ cancers showed statistically and clinically significant reductions in survival in non-accredited facilities (lung and bronchus: 27.9%; liver: 41.1%; esophagus: 30.4%; pancreas: 32.7%; intrahepatic bile duct: 39.4%). Multivariate analysis on these 5 cancers was performed. CoC accreditation was a statistically significant variable decreasing the hazard in all 5 cancers (hazard ratio 0.86-0.91; all p-values <0.005). All these cancers demand resource-intensive treatment. CONCLUSION: Accreditation has a significant impact on survival in 5/59 solid organ cancers. Although accredited facilities may be better apt to handle these cancer cases, the survival in most cancers is not significantly affected by accreditation. However, examining longer-term endpoints elucidate further nuances. Herein, CoC accreditation was found to be an independent variable impacting 2-year survival for a minority of cancers.
Asunto(s)
Neoplasias , Humanos , Estados Unidos/epidemiología , Neoplasias/epidemiología , Neoplasias/terapia , Acreditación , Programa de VERFRESUMEN
BACKGROUND: The technical aspects of cancer surgery have a significant impact on patient outcomes. To monitor surgical quality, in 2020, the Commission on Cancer (CoC) revised its accreditation standards for cancer surgery and introduced the synoptic operative reports (SORs). The standardization of SORs holds promise, but successful implementation requires strategies to address key implementation barriers. This study aimed to identify the barriers and facilitators to implementing breast SOR within diverse CoC-accredited programs. METHODS: In-depth semi-structured interviews were conducted with 31 health care professionals across diverse CoC-accredited sites. The study used two comprehensive implementation frameworks to guide data collection and analysis. RESULTS: Successful SOR implementation was impeded by disrupted workflows, surgeon resistance to change, low prioritization of resources, and poor flow of information despite CoC's positive reputation. Participants often lacked understanding of the requirements and timeline for breast SOR and were heavily influenced by prior experiences with templates and SOR champion relationships. The perceived lack of monetary benefits (to obtaining CoC accreditation) together with the significant information technology (IT) resource requirements tempered some of the enthusiasm. Additionally, resource constraints and the redirection of personnel during the COVID-19 pandemic were noted as hurdles. CONCLUSIONS: Surgeon behavior and workflow change, IT and personnel resources, and communication and networking strategies influenced SOR implementation. During early implementation and the implementation planning phase, the primary focus was on achieving buy-in and initiating successful roll-out rather than effective use or sustainment. These findings have implications for enhancing standardization of surgical cancer care and guidance of future strategies to optimize implementation of CoC accreditation standards.
Asunto(s)
Acreditación , Neoplasias de la Mama , Humanos , Neoplasias de la Mama/cirugía , Femenino , COVID-19/epidemiología , Flujo de Trabajo , Oncología Quirúrgica/normas , SARS-CoV-2 , Cirujanos/normasRESUMEN
Cell and gene therapy poses evolving challenges. The current article summarizes the discussions held by European Regional Committee of the International Society for Cell & Gene Therapy and the European Society for Blood and Marrow Transplantation (EBMT) on the current challenges in this field, focusing on the European setting. This article emphasizes the imperative assessment of real-world cell and gene therapy activity, advocating for expanded registries beyond hematopoietic transplantation and chimeric antigen receptor-T-cell therapy. Accreditation's role in ensuring standardized procedures, as exemplified by JACIE (The Joint Accreditation Committee of ISCT-Europe and EBMT), is crucial for safety. Access to commercial products and reimbursement variations among countries underscore the need for uniform access to advanced therapy medical products (ATMPs). Academic product development and point-of-care manufacturing face barriers to patient access. Hospital Exemption's potential, demonstrated by some initial experiences, may increase patient accessibility in individual situations. Regulatory challenges, including the ongoing European ATMPs legislation review, necessitate standardized criteria for Hospital Exemption and mandatory reporting within registries. Efforts to combat unproven therapies and fraud involve collaboration between scientific societies, regulatory bodies and patient groups. Finally, is important to highlight the vital role of education and workforce development in meeting the escalating demand for specialized professionals in the ATMP field. Collaboration among scientific societies, academic institutions, industry, regulatory bodies and patient groups is crucial for overcoming all these challenges to increase gene and cell therapy activity in Europe.
Asunto(s)
Tratamiento Basado en Trasplante de Células y Tejidos , Terapia Genética , Humanos , Terapia Genética/métodos , Europa (Continente) , Tratamiento Basado en Trasplante de Células y Tejidos/métodos , Sistema de Registros , Sociedades Médicas , Acreditación/métodosRESUMEN
BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME) requires faculty to pursue annual development to enhance their teaching skills. Few studies exist on how to identify and improve the quality of teaching provided by faculty educators. Understanding the correlation between numeric scores assigned to faculty educators and their tangible, practical teaching skills would be beneficial. OBJECTIVE: This study aimed to identify and describe qualities that differentiate numerically highly rated and low-rated physician educators. DESIGN: This observational mixed-methods study evaluated attending physician educators between July 1, 2015, and June 30, 2021. Quantitative analysis involved descriptive statistics, normalization of scores, and stratification of faculty into tertiles based on a summary score. We compared the highest and lowest tertiles during qualitative analyses of residents' comments. PARTICIPANTS: Twenty-five attending physicians and 111 residents in an internal medicine residency program. MAIN MEASURES: Resident evaluations of faculty educators, including 724 individual assessments of faculty educators on 15 variables related to the ACGME core competencies. KEY RESULTS: Quantitative analyses revealed variation in attending physician educators' performance across the ACGME core competencies. The highest-rated teaching qualities were interpersonal and communication skills, medical knowledge, and professionalism, while the lowest-rated teaching quality was systems-based practice. Qualitative analyses identified themes distinguishing high-quality from low-quality attending physician educators, such as balancing autonomy and supervision, role modeling, engagement, availability, compassion, and excellent teaching. CONCLUSIONS: This study provides insights into areas where attending physicians' educational strategies can be improved, emphasizing the importance of role modeling and effective communication. Ongoing efforts are needed to enhance the quality of faculty educators and resident education in internal medicine residency programs.
Asunto(s)
Internado y Residencia , Humanos , Educación de Postgrado en Medicina , Competencia Clínica , Docentes Médicos , AcreditaciónRESUMEN
Language-appropriate care is critical for equitable, high-quality health care, but educational standards to assure graduate medical trainees are prepared to give such care are lacking. Detailed guidance for graduate medical education is provided by the Accreditation Council for Graduate Medical Education through the following: (1) an assessment framework for competencies, subcompetencies, and milestones for trainees and (2) the Clinical Learning Environment Review (CLER) Pathways for assessment of trainees' learning environments. These tools do not include a robust framework to evaluate trainees' abilities to offer language-appropriate care. They also do not address the learning environment's potential to support such care. A multidisciplinary group of linguistic, medical, and educational experts drafted a new subcompetency with milestones and an expanded CLER Pathway to highlight the importance of equitable care for patients who prefer languages other than English. These resources offer residency and fellowship programs tools to guide assessment, curriculum development, and learning-environment improvements related to language-appropriate care. Recognizing that programs have unique needs and resources, we propose a range of initial actions to address language equity. A focus on language diversity in the learning environment can have a broad and lasting impact on care quality, patient safety, and health equity.
Asunto(s)
Curriculum , Internado y Residencia , Humanos , Educación de Postgrado en Medicina , Acreditación , Atención a la Salud , Lenguaje , Competencia ClínicaRESUMEN
BACKGROUND: Substance use disorders (SUDs) are prevalent in the USA yet remain dramatically undertreated. To address this care gap, the Accreditation Council for Graduate Medical Education (ACGME) approved revisions to the Program Requirements for Graduate Medical Education (GME) in Internal Medicine, effective July 1, 2022, requiring addiction medicine training for all internal medicine (IM) residents. The Veterans Health Administration (VHA) is a clinical training site for many academic institutions that sponsor IM residencies. This focus group project evaluated VHA IM residency site directors' perspectives about providing addiction medical education within VHA IM training sites. OBJECTIVE: To better understand the current state, barriers to, and facilitators of IM resident addiction medicine training at VHA sites. DESIGN: This was a qualitative evaluation based on semi-structured video-based focus groups. PARTICIPANTS: Participants were VHA IM site directors based at a VHA hospital or clinic throughout the USA. APPROACH: Focus groups were conducted using a semi-structured group interview guide. Two investigators coded each focus group independently, then met to create a final adjudicated coding scheme. Thematic analysis was used to identify key themes. KEY RESULTS: Forty-three participants from 38 VHA sites participated in four focus groups (average size: 11 participants). Six themes were identified within four pre-defined categories. Current state of training: most VHA sites offered no formal training in addiction medicine for IM residents. Barriers: addiction experts are often located outside of IM settings, and ACGME requirements were non-specific. Facilitators: clinical champions help support addiction training. Desired next steps: participants desired incentives to train or hire local champions and a pre-packaged didactic curriculum. CONCLUSIONS: Developing competent clinical champions and leveraging VHA addiction specialists from non-IM settings would create more addiction training opportunities for IM trainees at VHA sites. These insights can likely be applied to IM training at non-VHA sites.
Asunto(s)
Medicina de las Adicciones , Educación de Postgrado en Medicina , Medicina Interna , Internado y Residencia , United States Department of Veterans Affairs , Humanos , Estados Unidos , Medicina Interna/educación , Internado y Residencia/normas , Medicina de las Adicciones/educación , Trastornos Relacionados con Sustancias/terapia , Investigación Cualitativa , Grupos Focales , Acreditación , Masculino , FemeninoRESUMEN
PURPOSE OF REVIEW: This review holds significant relevance and is timely; as of June 2022, the United States Accreditation Council of Graduate Medical Education (ACGME) formally recognized interventional pulmonary medicine as a novel subspecialty with a unique fellowship training program pathway beyond Pulmonary and Critical Care Medicine. This recognition stands as a culmination of extensive efforts spanning decades, aimed at establishing a specialized training program for interventional pulmonary medicine beyond traditional Pulmonary and Critical Care Fellowship in the United States. Globally, there are apprenticeship models in non-US programs with ongoing efforts to further standardize training in interventional pulmonary medicine. It underscores the progressive evolution and innovative nature inherent to this subspecialty, signifying a distinctive leap forward in medical education and practice, which calls for further inventive development of training tools and standardized educational delivery. RECENT FINDINGS: Newly discovered insights from the recent literature review will highlight methodologies of procedural education and innovative training approaches. These findings will underscore the significance of standardized curriculum development within the field as well as ongoing challenges. SUMMARY: Identifying and addressing future challenges in integrating new technologies into clinical education and broadening the educational scope of trainees in this newly recognized subspecialty is crucial for enhancing competency. The implications of moving toward a more standardized process, creating new clinical pathways with research, and adopting emerging minimally invasive technologies aim to impact patient outcomes in both nonmalignant and malignant thoracic diseases. This progressive shift is redefining the specialty, moving beyond specific procedures, and pivoting towards a more distinct educational pathway. Such a transformation will lead to more diverse, comprehensive, and evidence-based driven patient care delivery.
Asunto(s)
Neumología , Humanos , Estados Unidos , Neumología/educación , Competencia Clínica , Acreditación , Educación de Postgrado en Medicina , BecasRESUMEN
INTRODUCTION: The Enneagram is an ancient personality typing system developed to improve self-knowledge. Broken down into nine personality types, each is driven by a core motivating factor. Other personality assessments have been used to study the personality profile of surgeons. The purpose of this study is to evaluate the variability in Enneagram type among a single institution's general surgery residents. METHODS: All categorical general surgery residents at a single institution completed an online Enneagram assessment as part of a wellness initiative. Accreditation Council for Graduate Medical Education milestone levels for professionalism (PRO) and interpersonal and communication skills were collected for each resident's intern year. Milestone levels were compared between the nine Enneagram types. RESULTS: All nine Enneagram types were represented among surveyed residents. The most frequent Enneagram type was type 3 (20.69%). There was no significant difference between PRO (P = 0.322) and interpersonal and communication skills (P = 0.645) scores among residents distributed by Enneagram type. CONCLUSIONS: Regardless of core Enneagram type, general surgery residents in this study all achieved appropriate Accreditation Council for Graduate Medical Education milestone levels for entry level of training. The Enneagram can provide self-awareness and understanding of resident differences but does not impact initial assessment of competency in PRO and interpersonal communication skills.
Asunto(s)
Internado y Residencia , Competencia Clínica , Educación de Postgrado en Medicina , Educación Basada en Competencias , AcreditaciónRESUMEN
INTRODUCTION: Research productivity is an important part of required Accreditation Council for Graduate Medical Education scholarship during residency training and critical to trainees who intend to pursue careers in academia. This study aims to determine plastic surgery residents' experiences with and attitudes toward research. METHODS: Accredited independent (52) and integrated (86) plastic surgery program websites were manually searched for currently active residents' names and email addresses. Identified residents were emailed a survey consisting of 25 questions through Research Electronic Data Capture. RESULTS: A total of 45 plastic surgery residents responded to the survey request (14.6% response rate). Respondents were 57% female and 43% male, with an average age of 30.7 y. At the time of survey participation, 95% of surgery residents were involved in research endeavors, voluntarily or as part of their residency training. Of the respondents, 13 (32%) previously participated in a research fellowship compared to 28 (68%) respondents who did not. Interestingly, respondents who completed fellowships were 2.84 times (95% confidence interval: 0.52-15.38, P = 0.2269) more likely to intend continuing research endeavors after residency. Participants were most in agreement with statements suggesting their research fellowship benefitted their application in the plastic surgery match process (4 [interquartile range (IQR): 4, 4]), improved their ability to conduct research (4 [IQR: 4, 4]), and helped to better understand medical literature (4 [IQR: 3, 4]). CONCLUSIONS: Plastic surgery programs' robust research emphasis has a favorable translation into residents' self-perceived understanding of medical literature and clinical knowledge.
Asunto(s)
Internado y Residencia , Cirugía Plástica , Masculino , Humanos , Femenino , Adulto , Becas , Cirugía Plástica/educación , Educación de Postgrado en Medicina , AcreditaciónRESUMEN
The American Board of Emergency Medicine gathers extensive background information on Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs as well as the residents and fellows training in those programs. We present the 2024 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.
Asunto(s)
Medicina de Emergencia , Becas , Internado y Residencia , Medicina de Emergencia/educación , Estados Unidos , Humanos , Acreditación , Educación de Postgrado en MedicinaRESUMEN
INTRODUCTION: Endoscopy is a major part of surgical training. Accreditation Council for Graduate Medical Education (ACGME) has set standards regarding the minimum volume of endoscopy cases required for graduation. However, there is paucity of high-quality data on the number of cases that most surgical graduates perform. METHODS: We conducted a retrospective analysis of operative case logs of all general surgery residents graduating from ACGME-accredited programs from 2010 to 2023. Data on mean number of endoscopy cases, including mean in each subcategory, were retrieved. Mann-Kendall trend test was used to investigate trends in endoscopy experience. RESULTS: Between 2010 and 2023, the mean overall endoscopy procedures per resident remained stable, with 129.5 in 2010 and 132.1 in 2023 (t = 0.429; p-value = 0.037). The majority of these cases were performed as surgeon junior (76.6% in 2010; 80.9% in 2023), while the remaining cases were logged as surgeon chief. The most substantial contribution to the overall volume was from flexible colonoscopy (mean: 64.1 in 2010 and 67.2 in 2023). The volume for colonoscopy remained fairly stable (t = 0.429; p-value = 0.036). This was followed by esophagogastroduodenoscopy (mean: 35.3 in 2010 and 35.5 in 2023), which saw a significant increase in volume (t = 0.890; p-value ≤ 0.001). There was a significant increase in the number of overall upper endoscopic procedures (t = 0.791; p-value ≤ 0.001), while lower endoscopic procedures did not change significantly (t = 0.319; p-value = 0.125). The procedural volume for endoscopic retrograde cholangiography, sigmoidoscopy, cystoscopy/ureteroscopy, laryngoscopy, and bronchoscopy decreased significantly (p-value < 0.05 for all). CONCLUSION: The overall endoscopy volume for general surgery residents has largely remained stable, with a minor increase in esophagogastroduodenoscopy and no change in colonoscopy. Future research should investigate whether simulation-based exercises can bridge the gap between procedural volume and learning curve requirements for endoscopy.
Asunto(s)
Cirugía General , Internado y Residencia , Laparoscopía , Cirujanos , Humanos , Estados Unidos , Estudios Retrospectivos , Educación de Postgrado en Medicina , Endoscopía Gastrointestinal , Competencia Clínica , Cirugía General/educación , Acreditación , Carga de TrabajoRESUMEN
BACKGROUND: Groin hernia repair is one of the most commonly performed surgical procedures and is often performed by surgical interns and junior residents. While traditionally performed open, minimally invasive (MIS) groin hernia repair has become an increasingly popular approach. The purpose of this study was to determine the trends in MIS and open inguinal and femoral hernia repair in general surgery residency training over the past two decades. METHODS: Accreditation Council for Graduate Medical Education (ACGME) national case log data of general surgery residents from 1999 through 2022 were reviewed. We collected means and standard deviations of open and MIS inguinal and femoral hernia repairs. Linear regression and ANOVA were used to identify trends in the average annual number of open and MIS hernia repairs logged by residents. Cases were distinguished between level of resident trainees: surgeon-chief (SC) and surgeon-junior (SJ). RESULTS: From July 1999 to June 2022, the average annual MIS inguinal and femoral hernia repairs logged by general surgery residents significantly increased, from 7.6 to 47.9 cases (p < 0.001), and the average annual open inguinal and femoral hernia repairs logged by general surgery residents significantly decreased, from 51.9 to 39.7 cases (p < 0.001). SJ resident results were consistent with this overall trend. For SC residents, the volume of both MIS and open hernia repairs significantly increased (p < 0.001). CONCLUSIONS: ACGME case log data indicates a trend of general surgery residents logging overall fewer numbers of open inguinal and femoral hernia repairs, and a larger proportion of open repairs by chief residents. This trend warrants attention and further study as it may represent a skill or knowledge gap with significant impact of surgical training.
Asunto(s)
Hernia Inguinal , Herniorrafia , Internado y Residencia , Humanos , Hernia Inguinal/cirugía , Herniorrafia/educación , Herniorrafia/tendencias , Herniorrafia/estadística & datos numéricos , Herniorrafia/métodos , Internado y Residencia/tendencias , Procedimientos Quirúrgicos Mínimamente Invasivos/educación , Procedimientos Quirúrgicos Mínimamente Invasivos/estadística & datos numéricos , Procedimientos Quirúrgicos Mínimamente Invasivos/tendencias , Cirugía General/educación , Cirugía General/tendencias , Acreditación , Educación de Postgrado en Medicina/tendencias , Educación de Postgrado en Medicina/métodos , Competencia Clínica , Laparoscopía/educación , Laparoscopía/tendencias , Laparoscopía/estadística & datos numéricos , Estados Unidos , Estudios RetrospectivosRESUMEN
Formal training in the subspecialty of pediatric anesthesiology began >60 years ago. Over the years, the duration and clinical work has varied, but what has stayed constant is a mission to develop clinically competent and professionally responsible pediatric anesthesiologists. Since accreditation in 1997, there has been additional guidance by the Accreditation Council on Graduate Medical Education (ACGME) and greater accountability to the public that we, indeed, are producing competent and professional pediatric anesthesiologists. This has been influenced by the slow evolution from time-based educational curriculum to a competency-based paradigm. As with all ACGME-accredited specialties, education leaders in pediatric anesthesiology first convened in 2014 to design specialty-specific developmental trajectories within the framework of the 6 core competencies, known as milestones, on which fellows were to be tracked during the 1-year fellowship. With 5 years of implementation, and substantial data and feedback, it has become clear that an iterative improvement was necessary to mirror the evolution of the profession. It was evident that the community required brevity and clarity in the next version of the milestones and required additional resources for assessment and faculty development. We describe here the methodology and considerations of our working group, guided by ACGME, in the rewriting of the milestones. We also provide suggestions for implementation and collaboration to support the education and assessment of pediatric anesthesiology fellows across the country.
Asunto(s)
Anestesiología , Internado y Residencia , Humanos , Niño , Anestesiología/educación , Educación de Postgrado en Medicina , Curriculum , Anestesiólogos , Retroalimentación , Competencia Clínica , AcreditaciónRESUMEN
BACKGROUND: In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS: Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS: New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS: A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.
Asunto(s)
Anestesiología , Internado y Residencia , Estados Unidos , Anestesiología/educación , Educación de Postgrado en Medicina , Evaluación Educacional/métodos , Competencia Clínica , AcreditaciónRESUMEN
BACKGROUND: Global medical education is gradually moving toward more comprehensive implementations of a competency-based education (CBE) model. Elimination of standard time-based training and adoption of time-variable training (competency-based time-variable training [CB-TVT]) is one of the final stages of implementation of CBE. While CB-TVT has been implemented in some programs outside the United States, residency programs in the United States are still exploring this approach to training. The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) are encouraging member boards and residency review committees to consider innovative ways programs could implement CB-TVT. The goals of this study were to (1) identify potential problems with the implementation of CB-TVT in anesthesiology residency training, (2) rank the importance of the problems and the perceived difficulty of solving them, and (3) develop proposed solutions to the identified problems. METHODS: Study participants were recruited from key stakeholder groups in anesthesiology education, including current or former program directors, department chairs, residents, fellows, American Board of Anesthesiology (ABA) board members, ACGME residency review committee members or ACGME leaders, designated institutional officials, residency program coordinators, clinical operations directors, and leaders of large anesthesiology community practice groups. This study was conducted in 2 phases. In phase 1, survey questionnaires were iteratively distributed to participants to identify problems with the implementation of CB-TVT. Participants were also asked to rank the perceived importance and difficulty of each problem and to identify relevant stakeholder groups that would be responsible for solving each problem. In phase 2, surveys focused on identifying potential solutions for problems identified in phase 1. RESULTS: A total of 36 stakeholders identified 39 potential problems, grouped into 7 major categories, with the implementation of CB-TVT in anesthesiology residency training. Of the 39 problems, 19 (48.7%) were marked as important or very important on a 5-point scale and 12 of 19 (63.2%) of the important problems were marked as difficult or very difficult to solve on a 5-point scale. Stakeholders proposed 165 total solutions to the identified problems. CONCLUSIONS: CB-TVT is a promising educational model for anesthesiology residency, which potentially results in learner flexibility, individualization of curricula, and utilization of competencies to determine learner advancement. Because of the potential problems with the implementation of CB-TVT, it is important for future pilot implementations of CB-TVT to document realized problems, efficacy of solutions, and effects on educational outcomes to justify the burden of implementing CB-TVT.
Asunto(s)
Anestesiología , Internado y Residencia , Humanos , Estados Unidos , Anestesiología/educación , Educación de Postgrado en Medicina , Curriculum , Competencia Clínica , AcreditaciónRESUMEN
OBJECTIVES: Hospitals' accreditation process is carried out to enhance the quality of hospitals' care and patient safety practices as well. The current study aimed to investigate the influence of hospitals' accreditation on patient safety culture as perceived by Jordanian hospitals among nurses. METHODS: A descriptive cross-sectional correlational survey was used for the current study, where the data were obtained from 395 nurses by convenient sampling technique who were working in 3 accredited hospitals with 254 nurses, and 3 non-accredited hospitals with 141 nurses, with a response rate of 89%. RESULTS: The overall patient safety culture was (71.9%). Moreover, the results of the current study revealed that there were no statistically significant differences between the perceptions of nurses in accredited and non-accredited hospitals in terms of perceptions of patient safety culture. CONCLUSION: The current study will add new knowledge about nurses' perceptions of patient safety culture in both accredited and non-accredited hospitals in Jordan which in turn will provide valid evidence to healthcare stakeholders if the accreditation status positively affects the nurses' perceptions of patient safety culture or not. Continuous evaluation of the accreditation application needs to be carried out to improve healthcare services as well as quality and patient safety.
Asunto(s)
Acreditación , Actitud del Personal de Salud , Hospitales , Personal de Enfermería en Hospital , Cultura Organizacional , Seguridad del Paciente , Humanos , Jordania , Estudios Transversales , Personal de Enfermería en Hospital/psicología , Adulto , Femenino , Hospitales/normas , Masculino , Encuestas y Cuestionarios , Calidad de la Atención de Salud , Administración de la Seguridad , PercepciónRESUMEN
INTRODUCTION: Although programme evaluation is increasingly routinised across the academic health sciences, there is scant research on the factors that shape the scope and quality of evaluation work in health professions education. Our research addresses this gap, by studying how the context in which evaluation is practised influences the type of evaluation that can be conducted. Focusing on the context of accreditation, we critically examine the types of paradoxical tensions that surface as evaluation-leads consider evaluation ideals or best practices in relation to contextual demands associated with accreditation seeking. METHODS: Our methods were qualitative and situated within a critical realist paradigm. Study participants were 29 individuals with roles requiring responsibility and oversight on evaluation work. They worked across 4 regions, within 26 academic health science institutions. Data were collected using semi-structured interviews and analysed using framework and matrix analyses. RESULTS: We identified three overarching themes: (i) absence of collective coherence about evaluation practice, (ii) disempowerment of expertise and (iii) tensions as routine practice. Examples of these latter tensions in evaluation work included (i) resourcing accreditation versus resourcing robust evaluation strategy (performing paradox), (ii) evaluation designs to secure accreditation versus design to spur renewal and transformation (performing-learning paradox) and (iii) public dissemination of evaluation findings versus restricted or selective access (publicising paradox). Sub-themes and illustrative data are presented. DISCUSSION: Our study demonstrates how the high-stakes context of accreditation seeking surfaces tensions that can risk the quality and credibility of evaluation practices. To mitigate these risks, those who commission or execute evaluation work must be able to identify and reconcile these tensions. We propose strategies that may help optimise the quality of evaluation work alongside accreditation-seeking efforts. Critically, our research highlights the limitations of continually positioning evaluation purely as a method versus as a socio-technical practice that is highly vulnerable to contextual influences.
Asunto(s)
Acreditación , Aprendizaje , Humanos , Evaluación de Programas y Proyectos de SaludRESUMEN
BACKGROUND: Although the accreditation approach is widely used to ensure the quality of medical education in many countries, there is scant empirical evidence on whether and how it improves actual medical school performance. We focused on conditions in China, which introduced an accreditation system during the 2010s. Specifically, we examined the relationship between first-round accreditation and actual performance based on the results of medical licensing examinations. Referring to organisation theory, we hypothesised that the impacts of accreditation would depend on existing performance gaps. METHOD: In 2022, we analysed panel data from 105 Chinese medical schools during accreditation (2012 to 2021) and pass rates on medical licensing examinations (2011 to 2019), as matched into 834 school-year records in a window of years before and after accreditation. We employed fixed-effects regression models with a comparison group to exclude factors that may have confounded the impacts of accreditation time. We also demonstrated the heterogeneous effects of accreditation by tier and performance gap of medical schools. RESULTS: The conservative estimates showed a substantial cumulative improvement (over 15 percentage points) in pass rates during the years before accreditation, with no clear trend indicating performance drops in the years after accreditation. Lower-tiered medical schools gained greater benefits from accreditation. Medical schools with a larger prior performance gap achieved a greater percentage point increase in pass rates with the passage of time in pre-accreditation years. CONCLUSIONS: This is the first empirical study to investigate whether accreditation has bridged performance gaps among medical schools. The results support the value of accreditation in China, a country that recently established the system, and might work as a substitute for missing information on early accreditation history in countries with long-established accreditation systems. We encourage more studies in countries that have recently introduced accreditation systems.
Asunto(s)
Educación Médica , Facultades de Medicina , Humanos , Acreditación , Concesión de Licencias , ChinaRESUMEN
BACKGROUND: Fellowship directors (FDs) play a key role in shaping Mohs micrographic surgery (MMS). Studies characterizing director trends are lacking and may provide a framework for improving gender diversity. OBJECTIVE: To explore characteristics of FDs and trends in gender of both fellows and FDs over time. MATERIALS AND METHODS: The authors compiled a comprehensive list of FDs and fellows for all Accreditation Council for Graduate Medical Education-accredited Micrographic Surgery & Dermatologic Oncology programs from 1996 to 2023. Publicly available data from various internet sources from February 1, 2023 to May 30, 2023 were used to assess characteristics of MMS FDs. RESULTS: The percentage of female FDs increased from 6% to 25% from 1996 to 2023. Female directors were more likely to select female fellows than male directors ( p = .0002) and had fewer years between fellowship completion and FD appointment (9.1 ± 4.7 years) compared with male directors (13.6 ± 8.8 years; p = .036). H-index, program type, and academic rank were similar between male and female directors. CONCLUSION: Although gender parity among MMS trainees has been achieved, discrepancies remain in the gender composition of FDs. Further studies are required to determine why women are underrepresented as FDs.