RE-AIM evaluation of accreditation process in Turkey.

BACKGROUND: Effects of accreditation on various areas of medical education were studied in literature. However, data about comprehensive evaluation of accreditation activities is limited. This paper aims to present how an accreditation agency self-evaluates its own accreditation activities. METHODS: Association for Evaluation and Accreditation of Medical Education Programs (TEPDAD) is an accreditation agency in Turkey. RE-AIM evaluation framework was used to evaluate TEPDAD's activities. The accreditation processes were evaluated through indicators set for each of five RE-AIM evaluation framework dimensions (reach, effectiveness, adoption, implementation and maintenance). Data for evaluation for each dimension were gathered from the documents available in TEPDAD website and archives. Qualitative and quantitative analysis methods were used when necessary to investigate the degree of achievement for each indicator. RESULTS: Seventy-five (83%) of 90 medical schools meeting the application criteria are registered in the accreditation system. Effectiveness analyses revealed that medical education programs improved in eight areas (education program, student representation, documentation, assessment, infrastructure/facilities, faculty development, educational management). Accreditation processes were well adopted by medical schools and TEPDAD volunteers. The number of medical education programs registered in the accreditation system has gradually increased over years. For the accreditation implementation process, medical schools and TEPDAD evaluators provided positive feedback. Medical schools and TEPDAD invested efforts to maintain the accreditation process over time and changing conditions. All of the previously accredited schools have applied for reaccreditation for the second or third cycles to maintain their status. TEPDAD has maintained its recognition status by national and international authorities by several times. The accreditation standards have been continuously reviewed and renewed when necessary. The organizational structure of TEPDAD has been changed in time considering feedback and past experiences. TEPDAD also arranges meetings to promote and maintain its activities. CONCLUSIONS: TEPDAD has achieved significant success in terms of reaching majority of the Turkish medical schools, leading to prominent developments in medical education programs without any significant problems related to process, procedures and maintenance. There are still areas of improvement for TEPDAD such as reaching all targeted schools and guiding medical schools to improve quality in diverse elements of medical education programs.

Recommendations to address and research systemic bias in assessment: perspectives from directors of research in medical education.

INTRODUCTION: Addressing systemic bias in medical school assessment is an urgent task for medical education. This paper outlines recommendations on topic areas for further research on systemic bias, developed from a workshop discussion at the 2023 annual meeting of the Society of Directors of Research in Medical Education. MATERIALS AND METHODS: During the workshop, directors engaged in small-group discussions on guidelines to address bias in assessment practices following a proposed categorization of 'Do's,' 'Don'ts,' and 'Don't knows' and listed their insights using anonymous sticky notes, which were shared and discussed with the larger group of participants. The authors performed a content analysis of the notes through deductive and inductive coding. We reviewed and discussed our analysis to reach consensus. RESULTS: The workshop included 31 participants from 28 institutions across the US and Canada, generating 51 unique notes. Participants identified 23 research areas in need of further study. The inductive analysis of proposed research areas revealed four main topics: 1) The role of interventions, including pre-medical academic interventions, medical-education interventions, assessment approaches, and wellness interventions; 2) Professional development, including the definition and assessment of professionalism and professional identity formation; 3) Context, including patient care and systemic influences; and 4) Research approaches. DISCUSSION: While limited to data from a single workshop, the results offered perspectives about areas for further research shared by a group of directors of medical education research units from diverse backgrounds. The workshop produced valuable insights into the need for more evidence-based interventions that promote more equitable assessment practices grounded in real-world situations and that attenuate the effects of bias.

[The programs of additional legal education as necessary element of system of training of students of medical university].

The actual trends in training of health care professionals set before medical university task of actualization and diversification of training programs targeted to formation both professional and universal competencies to contribute to variable combination of different skills and habits in implementation of medical activities. The increasing needs of labor market in specialists capable to meet actual realities and associated with transformational transition from narrow specialization to different specific skills, inevitably results into increasing of importance for additional education programs as an element of continuing The following key features of various proposals for additional professional education programs were singled out. The major task of forming proposal of additional programs is seen by university through prism of possible increasing of income. And main contingent of students is formed by specialists improve their qualifications. The specificity of medical university is specialists training to implement medical practice. In this regard, additional law training programs are targeted to exclusively at persons mastering basic educational program for the first time. The competencies implemented are focused at extending and specifying training considering legal maintenance or new trends. Besides, applying value-based approach to formation of educational trajectory of student, university translates primary importance of autonomy of will of student choosing additional educational programs. Thus, learning program of additional education is carried out using basic training in law and considering necessary and sufficient factual component that meets the needs of modern labor market, permitting strengthen and expand available competencies for future professional activity of medical worker. The article analyzed results of studies of pedagogues and psychologists, specialists of philosophical direction, professional lecturers, and sociological studies. The methods applied were analysis and synthesis, formalization, generalization, document analysis. The main methods of data analysis were substantive (hermeneutical) analysis and discourse analysis.

What are the perceptions of faculty and academic leaders regarding the impact of accreditation on the continuous quality improvement process of undergraduate medical education programs at Caribbean medical schools?

BACKGROUND: Accreditation and regulation are meant for quality assurance in higher education. However, there is no guarantee that accreditation ensures quality improvement. The accreditation for Caribbean medical schools varies from island to island, and it could be mandatory or voluntary, depending on local government requirements. Caribbean medical schools recently attained accreditation status to meet the Educational Commission for Foreign Medical Graduates (ECFMG) requirements by 2024. Literature suggests that accreditation impacts ECFMG certification rates and medical schools' educational processes. However, no such study has examined accreditation's impact on continuous quality improvement (CQI) in medical schools. This study aims to gather the perceptions and experiences of faculty members and academic leaders regarding the impact of accreditation on CQI across Caribbean medical schools. METHODS: This qualitative phenomenological study inquiries about the perceptions and experiences of faculty and academic leaders regarding accreditation's impact on CQI. Purposive and snowball sampling techniques were used. Participants were interviewed using a semi-structured interview method. Fifteen participants were interviewed across ten Caribbean medical schools representing accredited medical schools, accreditation denied medical schools, and schools that never applied for accreditation. Interviews were audio recorded, and thematic data analysis was conducted. RESULTS: Thematic analysis yielded six themes, including accreditation and CQI, CQI irrespective of accreditation, faculty engagement and faculty empowerment in the CQI process, collecting and sharing data, ECFMG 2024 requirements, and organizational structure of CQI. CONCLUSIONS: There is ongoing quality improvement at Caribbean medical schools, as perceived by faculty members and academic leaders. However, most of the change process is happening because of accreditation, and the quality improvement is due to external push such as accreditation rather than internal motivation. It is recommended that Caribbean medical schools promote internal quality improvement irrespective of accreditation and embrace the culture of CQI.

Reliability across content areas in progress tests assessing medical knowledge: a Brazilian cross-sectional study with implications for medical education assessments.

BACKGROUND: Brazilian medical schools equitably divide their medical education assessments into five content areas: internal medicine, surgery, pediatrics, obstetrics and gynecology, and public health. However, this division does not follow international patterns and may threaten the examinations' reliability and validity. OBJECTIVE: To assess the reliability indices of the content areas of serial, cross-institutional progress test examinations. DESIGN AND SETTINGS: This was an analytical, observational, and cross-sectional study conducted at nine public medical schools (mainly from the state of São Paulo) with progress test examinations conducted between 2017 and 2023. METHODS: The examinations covered the areas of basic sciences, internal medicine, surgery, pediatrics, obstetrics and gynecology, and public health. We calculated reliability indices using Cronbach's α, which indicates the internal consistency of a test. We used simple linear regressions to analyze temporal trends. RESULTS: The results showed that the Cronbach's α for basic sciences and internal medicine presented lower values, whereas gynecology, obstetrics, and public health presented higher values. After changes in the number of items and the exclusion of basic sciences as a separate content area, internal medicine ranked highest in 2023. Individually, all content areas except pediatrics remained stable over time. CONCLUSIONS: Maintaining an equitable division in assessment content may lead to suboptimal results in terms of assessment reliability, especially for internal medicine. Therefore, content sampling of medical knowledge for general assessments should be reappraised.

Accreditation of medical education in Brazil: an evaluation of seventy-six medical schools.

BACKGROUND: We present the first results of the Accreditation System of Medical Schools (Sistema de Acreditação de Escolas Médicas - SAEME) in Brazil. METHODS: We evaluated the results of the accreditation of medical schools from 2015 to 2023. The self-evaluation form of the SAEME is specific for medical education programs and has eighty domains, which results in final decisions that are sufficient or insufficient for each domain. We evaluated the results of the first seventy-six medical schools evaluated by the SAEME. RESULTS: Fifty-five medical schools (72.4%) were accredited, and 21 (27.6%) were not. Seventy-two (94.7%) medical schools were considered sufficient in social accountability, 93.4% in integration with the family health program, 75.0% in faculty development programs and 78.9% in environmental sustainability. There was an emphasis on SAEME in student well-being, with seventeen domains in this area, and 71.7% of these domains were sufficient. The areas with the lowest levels of sufficiency were interprofessional education, mentoring programs, student assessment and weekly distribution of educational activities. CONCLUSION: Medical schools in Brazil are strongly committed to social accountability, integration with the national health system, environmental sustainability and student well-being programs. SAEME is moving from episodic evaluations of medical schools to continuous quality improvement policies.

From admissions to licensure: education data associations from a multi-centre undergraduate medical education collaboration.

This paper reports the findings of a Canada based multi-institutional study designed to investigate the relationships between admissions criteria, in-program assessments, and performance on licensing exams. The study's objective is to provide valuable insights for improving educational practices across different institutions. Data were gathered from six medical schools: McMaster University, the Northern Ontario School of Medicine University, Queen's University, University of Ottawa, University of Toronto, and Western University. The dataset includes graduates who undertook the Medical Council of Canada Qualifying Examination Part 1 (MCCQE1) between 2015 and 2017. The data were categorized into five distinct sections: demographic information as well as four matrices: admissions, course performance, objective structured clinical examination (OSCE), and clerkship performance. Common and unique variables were identified through an extensive consensus-building process. Hierarchical linear regression and a manual stepwise variable selection approach were used for analysis. Analyses were performed on data set encompassing graduates of all six medical schools as well as on individual data sets from each school. For the combined data set the final model estimated 32% of the variance in performance on licensing exams, highlighting variables such as Age at Admission, Sex, Biomedical Knowledge, the first post-clerkship OSCE, and a clerkship theta score. Individual school analysis explained 41-60% of the variance in MCCQE1 outcomes, with comparable variables to the analysis from of the combined data set identified as significant independent variables. Therefore, strongly emphasising the need for variety of high-quality assessment on the educational continuum. This study underscores the importance of sharing data to enable educational insights. This study also had its challenges when it came to the access and aggregation of data. As such we advocate for the establishment of a common framework for multi-institutional educational research, facilitating studies and evaluations across diverse institutions. This study demonstrates the scientific potential of collaborative data analysis in enhancing educational outcomes. It offers a deeper understanding of the factors influencing performance on licensure exams and emphasizes the need for addressing data gaps to advance multi-institutional research for educational improvements.

Prevalence and quality of medical Spanish education in US osteopathic medical schools: a national survey.

CONTEXT: Spanish is the language in the United States with the greatest language-concordant physician deficit. Allopathic medical Spanish programs have proliferated, but the national prevalence of medical Spanish education at osteopathic medical schools has never been evaluated. OBJECTIVES: The objectives of this study are to describe the medical Spanish educational landscape at US osteopathic schools and evaluate program adherence to previously established basic standards. METHODS: Between March and October 2022, surveys were sent to all 44 member schools of the American Association of Colleges of Osteopathic Medicine (AACOM). For nonrespondents, data were obtained from publicly available websites. Primary surveys were sent to deans or diversity, equity, and inclusion officers at each osteopathic school to determine whether medical Spanish was offered and to identify a medical Spanish leader. Medical Spanish leaders received the secondary survey. The main measures of this study were the prevalence of medical Spanish programs at osteopathic schools and the extent to which existing programs met each of the four basic standards: having a faculty educator, providing a curricular structure, assessing learner skills, and awarding institutional course credit. RESULTS: We gathered medical Spanish information from 90.9 % (40/44) of osteopathic schools. Overall, 88.6 % (39/44) offered medical Spanish, of which 66.7 % (26/39) had formal curricula, 43.6 % (17/39) had faculty educators, 17.9 % (7/39) assessed learner skills, and 28.2 % (11/39) provided course credit. Only 12.8 % (5/39) of osteopathic schools with medical Spanish programs met all basic standards. Urban/suburban schools were likelier to offer medical Spanish than rural schools (p=0.020). Osteopathic schools in states with the highest Spanish-speaking populations were more likely to offer student-run initiatives (p=0.027). CONCLUSIONS: Most osteopathic schools provide medical Spanish education, but work is needed to improve consistency, quality, and sustainability. Future research should focus on osteopathic student language proficiency assessment, improve medical Spanish accessibility for students at rural programs, and explore the unique content areas of osteopathic medical Spanish education.

Defining Medical AI Competencies for Medical School Graduates: Outcomes of a Delphi Survey and Medical Student/Educator Questionnaire of South Korean Medical Schools.

PURPOSE: Given the increasing significance and potential impact of artificial intelligence (AI) technology on health care delivery, there is an increasing demand to integrate AI into medical school curricula. This study aimed to define medical AI competencies and identify the essential competencies for medical graduates in South Korea. METHOD: An initial Delphi survey conducted in 2022 involving 4 groups of medical AI experts (n = 28) yielded 42 competency items. Subsequently, an online questionnaire survey was carried out with 1,955 participants (1,174 students and 781 professors) from medical schools across South Korea, utilizing the list of 42 competencies developed from the first Delphi round. A subsequent Delphi survey was conducted with 33 medical educators from 21 medical schools to differentiate the essential AI competencies from the optional ones. RESULTS: The study identified 6 domains encompassing 36 AI competencies essential for medical graduates: (1) understanding digital health and changes driven by AI; (2) fundamental knowledge and skills in medical AI; (3) ethics and legal aspects in the use of medical AI; (4) medical AI application in clinical practice; (5) processing, analyzing, and evaluating medical data; and (6) research and development of medical AI, as well as subcompetencies within each domain. While numerous competencies within the first 4 domains were deemed essential, a higher percentage of experts indicated responses in the last 2 domains, data science and medical AI research and development, were optional. CONCLUSIONS: This medical AI framework of 6 competencies and their subcompetencies for medical graduates exhibits promising potential for guiding the integration of AI into medical curricula. Further studies conducted in diverse contexts and countries are necessary to validate and confirm the applicability of these findings. Additional research is imperative for developing specific and feasible educational models to integrate these proposed competencies into pre-existing curricula.

MD-Granting Medical Schools in the US, 2022-2023.

This Appendix presents data derived from the 2022-2023 Liaison Committee on Medical Education Annual Medical School Questionnaire-Part II.

Medical School Rankings-Bad for the Health of the Profession and the Public.

This Viewpoint discusses the limitations of medical school ranking in attracting a diverse student population and urges administrators to holistically communicate their mission, goals, and learning environment as an alternative strategy.

Assessment and Evaluation in Social Determinants of Health Education: a National Survey of US Medical Schools and Physician Assistant Programs.

BACKGROUND: Social determinants of health (SDOH) curricular content in medical schools and physician assistant programs are increasing. However, there is little understanding of current practice in SDOH learner assessment and program evaluation, or what the best practices are. OBJECTIVE: Our study aim was to describe the current landscape of assessment and evaluation at US medical schools and physician assistant programs as a first step in developing best practices in SDOH education. DESIGN: We conducted a national survey of SDOH educators from July to December 2020. The 55-item online survey covered learner assessment methods, program evaluation, faculty training, and barriers to effective assessment and evaluation. Results were analyzed using descriptive statistics. PARTICIPANTS: One hundred six SDOH educators representing 26% of medical schools and 23% of PA programs in the USA completed the survey. KEY RESULTS: Most programs reported using a variety of SDOH learner assessment methods. Faculty and self were the most common assessors of learners' SDOH knowledge, attitudes, and skills. Common barriers to effective learner assessment were lack of agreement on "SDOH competency" and lack of faculty training in assessment. Programs reported using evaluation results to refine curricular content, identify the need for new content, and improve assessment strategies. CONCLUSIONS: We identified a heterogeneity of SDOH assessment and evaluation practices among programs, as well as gaps and barriers in their educational practices. Specific guidance from accrediting bodies and professional organizations and agreement on SDOH competency as well as providing faculty with time, resources, and training will improve assessment and evaluation practice and ensure SDOH education is effective for students, patients, and communities.

Adapting the Admissions Interview During COVID-19: A Comparison of In-Person and Video-Based Interview Validity Evidence.

COVID-19 physical distancing limited many medical schools' abilities to conduct in-person interviews for the 2020 admissions cycle. The University of Toronto (U of T) Temerty Faculty of Medicine was already in the midst of its interview process, with two-thirds of applicants having completed the in-person modified personal interview (MPI). As the university and surrounding region were shut down, the shift was made in the middle of the application cycle to a semisynchronous video-based MPI interview (vMPI) approach. U of T undertook the development, deployment, and evaluation of the 2 approaches mid-admissions cycle. Existing resources and tools were used to create a tailored interview process with the assistance of applicants. The vMPI was similar in content and process to the MPI: a 4-station interview with each station mapped to attributes relevant to medical school success. Instead of live interviews, applicants recorded 5-minute responses to questions for each station using their own hardware. These responses were later assessed by raters asynchronously. Out of 627 applicants, 232 applicants completed the vMPI. Validity evidence was generated for the vMPI and compared with the MPI on the internal structure, relationship to other variables, and consequential validity, including applicant and interviewer acceptability. Overall, the vMPI demonstrated similar reliability and factor structure to the MPI. As with the MPI, applicant performance was predicted by nonacademic screening tools but not academic measures. Applicants' acceptance of the vMPI was positive. Most interviewers found the vMPI to be acceptable and reported confidence in their ratings. Continuing physical distancing concerns will require multiple options for admissions committees to select medical students. The vMPI is an example of a customized approach that schools can implement and may have advantages for selection beyond the COVID-19 pandemic. Future evaluation will examine additional validity evidence for the tool.

Undergraduate medical education in Nigeria: current standard and the need for advancement.

The post-independence era in Nigeria ushered in an array of fundamental structuring and development in all sectors of the Nigerian economy including medical education and training. This era saw the establishment of medical schools across the country which mirrored the medical curriculum of British universities. This paper dives into the general structure of undergraduate medical education in Nigeria, its historical background and how it compares with neighboring and distant countries. Since the undergraduate medical education curriculum has not seen significant modifications since conception, this paper presents the challenges of the existent structure to include biased admission process, emphasis on irrelevant pre-medical courses, paucity of of technologically-advanced teaching and learning aids, increased workloads of lecturers amongst others. Importantly, solutions and recommendations are prescribed in this paper, which if considered, may improve undergraduate medical training in Nigeria, and ultimately improve the standard of healthcare service provision in the country.

Downstream funding success of early career researchers for resubmitted versus new applications: A matched cohort.

BACKGROUND: Early career researchers face a hypercompetitive funding environment. To help identify effective intervention strategies for early career researchers, we examined whether first-time NIH R01 applicants who resubmitted their original, unfunded R01 application were more successful at obtaining any R01 funding within 3 and 5 years than original, unfunded applicants who submitted new NIH applications, and we examined whether underrepresented minority (URM) applicants differentially benefited from resubmission. Our observational study is consistent with an NIH working group's recommendations to develop interventions to encourage resubmission. METHODS AND FINDINGS: First-time applicants with US medical school academic faculty appointments who submitted an unfunded R01 application between 2000-2014 yielded 4,789 discussed and 7,019 not discussed applications. We then created comparable groups of first-time R01 applicants (resubmitted original R01 application or submitted new NIH applications) using optimal full matching that included applicant and application characteristics. Primary and subgroup analyses used generalized mixed models with obtaining any NIH R01 funding within 3 and 5 years as the two outcomes. A gamma sensitivity analysis was performed. URM applicants represented 11% and 12% of discussed and not discussed applications, respectively. First-time R01 applicants resubmitting their original, unfunded R01 application were more successful obtaining R01 funding within 3 and 5 years than applicants submitting new applications-for both discussed and not discussed applications: discussed within 3 years (OR 4.17 [95 CI 3.53, 4.93]) and 5 years (3.33 [2.82-3.92]); and not discussed within 3 years (2.81 [2.52, 3.13]) and 5 years (2.47 [2.22-2.74]). URM applicants additionally benefited within 5 years for not discussed applications. CONCLUSIONS: Encouraging early career researchers applying as faculty at a school of medicine to resubmit R01 applications is a promising potential modifiable factor and intervention strategy. First-time R01 applicants who resubmitted their original, unfunded R01 application had log-odds of obtaining downstream R01 funding within 3 and 5 years 2-4 times higher than applicants who did not resubmit their original application and submitted new NIH applications instead. Findings held for both discussed and not discussed applications.

Academic Medicine Faculty Perceptions of Work-Life Balance Before and Since the COVID-19 Pandemic.

Importance: How the COVID-19 pandemic has affected academic medicine faculty's work-life balance is unknown. Objective: To assess the association of perceived work-life conflict with academic medicine faculty intention to leave, reducing employment to part time, or declining leadership opportunities before and since the COVID-19 pandemic. Design, Settings, and Participants: An anonymous online survey of medical, graduate, and health professions school faculty was conducted at a single large, urban academic medical center between September 1 and September 25, 2020. Main Outcomes and Measures: Self-assessed intention to leave, reducing employment to part time, or turning down leadership opportunities because of work-life conflict before and since the COVID-19 pandemic. Results: Of the 1186 of 3088 (38%) of faculty members who answered the survey, 649 (55%) were women and 682 (58%) were White individuals. Respondents were representative of the overall faculty demographic characteristics except for an overrepresentation of female faculty respondents and underrepresentation of Asian faculty respondents compared with all faculty (female faculty: 649 [55%] vs 1368 [44%]; Asian faculty: 259 [22%] vs 963 [31%]). After the start of the COVID-19 pandemic, faculty were more likely to consider leaving or reducing employment to part time compared with before the pandemic (leaving: 225 [23%] vs 133 [14%]; P < .001; reduce hours: 281 [29%] vs 206 [22%]; P < .001). Women were more likely than men to reduce employment to part time before the COVID-19 pandemic (153 [28%] vs 44 [12%]; P < .001) and to consider both leaving or reducing employment to part time since the COVID-19 pandemic (leaving: 154 [28%] vs 56 [15%]; P < .001; reduce employment: 215 [40%] vs 49 [13%]; P < .001). Faculty with children were more likely to consider leaving and reducing employment since the COVID-19 pandemic compared with before the pandemic (leaving: 159 [29%] vs 93 [17%]; P < .001; reduce employment: 213 [40%] vs 130 [24%]; P < .001). Women with children compared with women without children were also more likely to consider leaving since the COVID-19 pandemic than before (113 [35%] vs 39 [17%]; P < .001). Working parent faculty and women were more likely to decline leadership opportunities both before (faculty with children vs without children: 297 [32%] vs 84 [9%]; P < .001; women vs men: 206 [29%] vs 47 [13%]; P < .001) and since the COVID-19 pandemic (faculty with children vs faculty without children: 316 [34%] vs 93 [10 %]; P < .001; women vs men: 148 [28%] vs 51 [14%]; P < .001). Conclusions and Relevance: In this survey study, the perceived stressors associated with work-life integration were higher in women than men, were highest in women with children, and have been exacerbated by the COVID-19 pandemic. The association of both gender and parenting with increased perceived work-life stress may disproportionately decrease the long-term retention and promotion of junior and midcareer women faculty.