Evaluating competency-based medical education: a systematized review of current practices.

BACKGROUND: Few published articles provide a comprehensive overview of the available evidence on the topic of evaluating competency-based medical education (CBME) curricula. The purpose of this review is therefore to synthesize the available evidence on the evaluation practices for competency-based curricula employed in schools and programs for undergraduate and postgraduate health professionals. METHOD: This systematized review was conducted following the systematic reviews approach with minor modifications to synthesize the findings of published studies that examined the evaluation of CBME undergraduate and postgraduate programs for health professionals. RESULTS: Thirty-eight articles met the inclusion criteria and reported evaluation practices in CBME curricula from various countries and regions worldwide, such as Canada, China, Turkey, and West Africa. 57% of the evaluated programs were at the postgraduate level, and 71% were in the field of medicine. The results revealed variation in reporting evaluation practices, with numerous studies failing to clarify evaluations' objectives, approaches, tools, and standards as well as how evaluations were reported and communicated. It was noted that questionnaires were the primary tool employed for evaluating programs, often combined with interviews or focus groups. Furthermore, the utilized evaluation standards considered the well-known competencies framework, specialized association guidelines, and accreditation criteria. CONCLUSION: This review calls attention to the importance of ensuring that reports of evaluation experiences include certain essential elements of evaluation to better inform theory and practice.

Gender differences in learning and study strategies impact medical students' preclinical and USMLE step 1 examination performance.

BACKGROUND: Evaluation of students' learning strategies can enhance academic support. Few studies have investigated differences in learning strategies between male and female students as well as their impact on United States Medical Licensing Examination® (USMLE) Step 1 and preclinical performance. METHODS: The Learning and Study Strategies Inventory (LASSI) was administered to the classes of 2019-2024 (female (n = 350) and male (n = 262)). Students' performance on preclinical first-year (M1) courses, preclinical second-year (M2) courses, and USMLE Step 1 was recorded. An independent t-test evaluated differences between females and males on each LASSI scale. A Pearson product moment correlation determined which LASSI scales correlated with preclinical performance and USMLE Step 1 examinations. RESULTS: Of the 10 LASSI scales, Anxiety, Attention, Information Processing, Selecting Main Idea, Test Strategies and Using Academic Resources showed significant differences between genders. Females reported higher levels of Anxiety (p < 0.001), which significantly influenced their performance. While males and females scored similarly in Concentration, Motivation, and Time Management, these scales were significant predictors of performance variation in females. Test Strategies was the largest contributor to performance variation for all students, regardless of gender. CONCLUSION: Gender differences in learning influence performance on STEP1. Consideration of this study's results will allow for targeted interventions for academic success.

Designing an evaluation tool for evaluating training programs of medical students in clinical skill training center from consumers' perspective.

INTRODUCTION: The Clinical Skill Training Center (CSTC) is the first environment where third year medical students learn clinical skills after passing basic science. Consumer- based evaluation is one of the ways to improve this center with the consumer. This study was conducted with the aim of preparing a consumer-oriented evaluation tool for CSTC among medical students. METHOD: The study was mixed method. The first phase was qualitative and for providing an evaluation tool. The second phase was for evaluating the tool. At the first phase, after literature review in the Divergent phase, a complete list of problems in the field of CSTC in medicine schools was prepared. In the convergent step, the prepared list was compared with the standards of clinical education and values of scriven. In the second phase it was evaluated by the scientific and authority committee. Validity has been measured by determining CVR and CVI: Index. The face and content validity of the tool was obtained through the approval of a group of specialists. RESULTS: The findings of the research were in the form of 4 questionnaires: clinical instructors, pre-clinical medical students, and interns. All items were designed as a 5-point Likert. The main areas of evaluation included the objectives and content of training courses, implementation of operations, facilities and equipment, and the environment and indoor space. In order to examine the long-term effects, a special evaluation form was designed for intern. CONCLUSION: The tool for consumer evaluation was designed with good reliability and trustworthiness and suitable for use in the CSTC, and its use can improve the effectiveness of clinical education activities.

Position statement of the GMA committee "teaching evaluation".

The evaluation of teaching can be an essential driver for curriculum development. Instruments for teaching evaluation are not only used for the purpose of quality assurance but also in the context of medical education research. Therefore, they must meet the common requirements for reliability and validity. This position paper from the GMA Teaching Evaluation Committee discusses strategic and methodological aspects of evaluation in the context of undergraduate medical education and related courses; and formulates recommendations for the further development of evaluation. First, a four-step approach to the design and implementation of evaluations is presented, then methodological and practical aspects are discussed in more detail. The focus here is on target and confounding variables, survey instruments as well as aspects of implementation and data protection. Finally, possible consequences from evaluation data for the four dimensions of teaching quality (structural and procedural aspects, teachers and outcomes) are discussed.

Scientific competence during medical education - insights from a cross-sectional study at a German Medical School.

BACKGROUND: Medical knowledge regarding the pathophysiology, diagnosis and treatment of diseases is constantly evolving. To effectively incorporate these findings into professional practice, it is crucial that scientific competencies are a central component of medical education. This study seeks to analyse the current state of scientific education and students' desires for integration into the curriculum. METHODS: From October to December 2022, a survey was distributed at the Medical Faculty Dresden to all medical students from the 1st to 5th academic year (AY). The survey investigates current expectations of applying scientific competencies later in professional life, and the students were asked to self-assess various scientific skills and in relation to the National Competence Based Catalogue of Learning Objectives for Undergraduate Medical Education. The self-assessments were objectified through a competence test with ten multiple-choice questions. The desire for curricular teaching was inquired. RESULTS: 860 students completed the survey. This corresponds to a response rate of 64%. In the 5th AY, approximately 80% of the participants stated that they expected to work with scientific literature on a daily to monthly basis in future professional life and to communicate corresponding scientific findings to patients. Only 30-40% of the 5th AY rate their scientific competencies as sufficient to do this appropriately. This corresponds with the self-assessed competencies that only slightly increased over the 5 AYs from 14.1 ± 11.7 to 21.3 ± 13.8 points (max. 52) and is also reflected in the competence test (1st AY 3.6 ± 1.75 vs. 5th AY 5.5 ± 1.68, max. 10 points). Half of the students in the 4th and 5th AYs were dissatisfied with the current teaching of scientific skills. The majority preferred the implementation of a science curriculum (56%), preferably as seminars dealing with topics such as literature research, analysis, and science communication. CONCLUSIONS: The results show discrepancies between expectations of using scientific knowledge in everyday professional life, self-rated and objectively recorded competencies, and the current state of curricular teaching of scientific competencies. There is a strong need for adequate practical training, particularly in critical analyses of scientific literature, which enables the communication of scientific knowledge to patients.

Sexual and gender minority content in undergraduate medical education in the United States and Canada: current state and changes since 2011.

PURPOSE: To characterize current lesbian, gay, bisexual, transgender, queer, and intersex (LGBTQI +) health-related undergraduate medical education (UME) curricular content and associated changes since a 2011 study and to determine the frequency and extent of institutional instruction in 17 LGBTQI + health-related topics, strategies for increasing LGBTQI + health-related content, and faculty development opportunities. METHOD: Deans of medical education (or equivalent) at 214 allopathic or osteopathic medical schools in Canada and the United States were invited to complete a 36-question, Web-based questionnaire between June 2021 and September 2022. The main outcome measured was reported hours of LGBTQI + health-related curricular content. RESULTS: Of 214 schools, 100 (46.7%) responded, of which 85 (85.0%) fully completed the questionnaire. Compared to 5 median hours dedicated to LGBTQI + health-related in a 2011 study, the 2022 median reported time was 11 h (interquartile range [IQR], 6-16 h, p < 0.0001). Two UME institutions (2.4%; 95% CI, 0.0%-5.8%) reported 0 h during the pre-clerkship phase; 21 institutions (24.7%; CI, 15.5%-33.9%) reported 0 h during the clerkship phase; and 1 institution (1.2%; CI, 0%-3.5%) reported 0 h across the curriculum. Median US allopathic clerkship hours were significantly different from US osteopathic clerkship hours (4 h [IQR, 1-6 h] versus 0 h [IQR, 0-0 h]; p = 0.01). Suggested strategies to increase content included more curricular material focusing on LGBTQI + health and health disparities at 55 schools (64.7%; CI, 54.6%-74.9%), more faculty willing and able to teach LGBTQI + -related content at 49 schools (57.7%; CI, 47.1%-68.2%), and more evidence-based research on LGBTQI + health and health disparities at 24 schools (28.2%; CI, 18.7%-37.8%). CONCLUSION: Compared to a 2011 study, the median reported time dedicated to LGBTQI + health-related topics in 2022 increased across US and Canadian UME institutions, but the breadth, efficacy, or quality of instruction continued to vary substantially. Despite the increased hours, this still falls short of the number of hours based on recommended LGBTQI + health competencies from the Association of American Medical Colleges. While most deans of medical education reported their institutions' coverage of LGBTQI + health as 'fair,' 'good,' or 'very good,' there continues to be a call from UME leadership to increase curricular content. This requires dedicated training for faculty and students.

MD-Granting Medical Schools in the US, 2022-2023.

This Appendix presents data derived from the 2022-2023 Liaison Committee on Medical Education Annual Medical School Questionnaire-Part II.

341º Reunião Ordinária do Conselho Nacional de Saúde - 13 abr. 2023

Challenges and Facilitators of Using Smartphones in Educational Activities: Medical and Nursing Students' Perspective.

BACKGROUND: Todays, smartphone technologies and applications are used in the medical and nursing fields. Medical and nursing students are among the groups in which the use of these tools is observed. OBJECTIVES: To investigate their views on the barriers and facilitators of the use of these technologies. METHODS: Four hundred people (200 people from each group) were invited randomly. A questionnaire was used to collect data. To collect data, hospitals were referred and the questionnaires were provided to students and after completion, they were collected. Data analysis was performed using SPSS software and descriptive and inferential statistics. RESULTS: The most important barriers from the students' view included internet problems in the university or hospital, lack of technical support for this technology in the hospital or university, the quality of existing applications, lack of appropriate Apps in the local language, non-introduction of appropriate Apps and not knowing the right Apps. The most important facilitators were the appropriate support services in the university or hospital, placing the appropriate Apps on the department or university website, designing native Apps with the participation of experts, and introducing the appropriate Apps by professors or universities. CONCLUSION: The use of Apps is increasing among medical and nursing students. In this regard, attention to the existing barriers and their elimination and strengthening the facilitators, and providing the necessary technical and educational infrastructure to facilitate the useful applications should be considered by decision-makers.

Barriers and facilitators for implementation of a national recommended specialty core-curriculum across UK medical schools: a cross-sectional study using an online questionnaire.

OBJECTIVES: The National Health Service (NHS) Long-Term plan published in 2019 set out healthcare reforms to meet the healthcare demands of UK. Undergraduate specialty core-curricula like dermatology aligns well to the training needs of the future workforce but lacks representation, consistency and implementation. This study explores the barriers and facilitators influencing the implementation of a specialty-specific (dermatology) national core-curriculum across UK medical schools. DESIGN: A constructivist approach was used to develop an online questionnaire and data collected using mixed methodology. PARTICIPANTS: Undergraduate dermatology teaching leads across all UK medical schools. RESULTS: 30 out of 42 UK medical schools responded to the survey (71%). 16 out of 30 (53%) responders were unaware of the planned Medical Licensing Assessments (MLA) for all UK graduates in 2024-2025; 43% were unaware if dermatology was mapped to national standards; 50% were unsure if the dermatology was blueprinted on school curricula. Barriers to implementation included competing NHS service commitments, the specialty not seen as a priority and difficulty influencing curricula changes at school level. Facilitators included workforce planning and transparency in funding to support leadership in undergraduate education. Domains identified for curriculum implementation were: (1) awareness of the role of General Medical Council and the MLA, (2) medical education training for teaching leads, (3) lack of recognition and resources for leadership, (4) skills development to map, blueprint and assess specialty core-components, (5) medical school and specialty engagement. CONCLUSIONS: This study identifies the potential barriers and facilitators to specialty specific core-curricular implementation across UK medical schools. Lack of standardised training in medical education, time and resources undermine the role of specialty teaching leads as medical educators. Medical school engagement with specialties with mutual support would aid the forthcoming educational reforms.

Vascular Surgery Curriculum for Medical Students: A National Targeted Needs Assessment.

BACKGROUND: At present, neither the American College of Surgeons (ACS) nor the Society for Vascular Surgery (SVS) provides curriculum recommendations for medical students rotating on a vascular surgery service. We sent a targeted needs assessment to vascular surgeons across the country in order to investigate the need for a structured curriculum for medical students participating in a vascular surgery rotation during their clinical clerkships. METHODS: The survey was developed with input from medical students, vascular surgeons, and medical educators. Respondents were identified from the Fellowship and Residency Electronic Interactive Database (FREIDA). The needs assessment was sent to program directors of vascular residencies and fellowships and to other vascular surgery educators. The survey collected data regarding the existing vascular surgery curriculum at the respondent's institution, the need for a standardized curriculum, desired experiences for medical students, and important vascular topics for medical students to cover while on rotation. RESULTS: Responses were obtained from 50 of the 146 surveyed individuals (response rate = 34.2%). 48 respondents (96%) worked in an academic hospital or academic affiliated hospital. With regard to the existing vascular surgery curriculum, only 28 respondents (61%) indicated that they had a curriculum approved by the surgery clerkship director. 37 respondents (77.1%) said there were at least goals and objectives for students on the vascular surgery service, and 29 respondents (60.4%) indicated that there was dedicated time for didactic sessions. Only 17 respondents (35.4%) indicated students gave a case presentation on the service. 29 respondents (63%) agreed or strongly agreed that there should be a standardized vascular curriculum for medical students. When asked to rank 9 topics from most important to least important for students to learn, respondents ranked peripheral arterial disease, aortic disease, and carotid disease highest. Simulation experience was most frequently indicated as a desired addition to the curriculum, and only 16 respondents (33.3%) reported opportunities for vascular surgery specific simulation experiences. CONCLUSIONS: This study identified the lack of an existing structured curriculum for medical students, the desire for a standardized curriculum, and key topics and experiences that are felt to be important for students to cover.  With this information in hand, vascular educators have the potential to enhance the learning experience of medical students rotating through the service by developing a standardized curriculum.

An Innovative Approach for Integrating Mandatory, Longitudinal Spirituality Training Into the Medical School Curriculum.

PROBLEM: Most Americans indicate they are religious and/or spiritual and wish to have their beliefs taken into account when engaging with health care providers, yet gaps in medical education and health care practice remain. To underscore the importance of spirituality as a significant social determinant of health, a team at the Icahn School of Medicine at Mount Sinai in New York developed mandatory spirituality and health training for students integrated into all 4 years of the undergraduate medical education curriculum. APPROACH: From 2014 to 2020, a small group of faculty took an innovative approach, launching the initiative and expanding the team by engaging interprofessional faculty and staff from across the institution. The team used an iterative process to integrate 4 distinct modules into 4 existing courses, spanning the 4 years of medical school. OUTCOMES: The majority of students found that the spirituality and health curriculum was valuable to training and professional development. They appreciated the importance of patients' spiritual needs, valued learning about the role chaplains play in patient care and how to initiate a consult, and indicated they intended to integrate spiritual history taking in their patient care. With respect to process, 3 key factors-establishing an interprofessional team, working through an iterative process, and integrating the curriculum into existing courses-were critical to designing and implementing the modules. NEXT STEPS: The team aims to expand and improve the curriculum by linking learning to specific standardized competencies as well as developing more specific performance assessments to demonstrate achievement of competencies. Professional development efforts will be enhanced so faculty can better model and reinforce the integration of spirituality into health care practices and expand the curriculum on spirituality and health into graduate medical education.

Accelerated 3-Year MD Pathway Programs: Graduates' Perspectives on Education Quality, the Learning Environment, Residency Readiness, Debt, Burnout, and Career Plans.

PURPOSE: To compare perception of accelerated and traditional medical students, with respect to satisfaction with education quality, and the learning environment, residency readiness, burnout, debt, and career plans. METHOD: Customized 2017 and 2018 Medical School Graduation Questionnaires (GQs) were analyzed using independent samples t tests for means and chi-square tests for percentages, comparing responses of accelerated MD program graduates (accelerated pathway [AP] students) from 9 schools with those of non-AP graduates from the same 9 schools and non-AP graduates from all surveyed schools. RESULTS: GQ completion rates for the 90 AP students, 2,573 non-AP students from AP schools, and 38,116 non-AP students from all schools in 2017 and 2018 were 74.4%, 82.3%, and 83.3%, respectively. AP students were as satisfied with the quality of their education and felt as prepared for residency as non-AP students. AP students reported a more positive learning climate than non-AP students from AP schools and from all schools as measured by the student-faculty interaction (15.9 vs 14.4 and 14.3, respectively; P < .001 for both pairwise comparisons) and emotional climate (10.7 vs 9.6 and 9.6, respectively; P = .004 and .003, respectively) scales. AP students had less debt than non-AP students (P < .001), and more planned to care for underserved populations and practice family medicine than non-AP students from AP schools (55.7% vs 33.9% and 37.7% vs 9.4%; P = .002 and < .001, respectively). Family expectations were a more common influence on career plans for AP students than for non-AP students from AP schools and from all schools (26.2% vs 11.3% and 11.7%, respectively; P < .001 for both pairwise comparisons). CONCLUSIONS: These findings support accelerated programs as a potentially important intervention to address workforce shortages and rising student debt without negative impacts on student perception of burnout, education quality, or residency preparedness.

Undergraduate medical education in Nigeria: current standard and the need for advancement.

The post-independence era in Nigeria ushered in an array of fundamental structuring and development in all sectors of the Nigerian economy including medical education and training. This era saw the establishment of medical schools across the country which mirrored the medical curriculum of British universities. This paper dives into the general structure of undergraduate medical education in Nigeria, its historical background and how it compares with neighboring and distant countries. Since the undergraduate medical education curriculum has not seen significant modifications since conception, this paper presents the challenges of the existent structure to include biased admission process, emphasis on irrelevant pre-medical courses, paucity of of technologically-advanced teaching and learning aids, increased workloads of lecturers amongst others. Importantly, solutions and recommendations are prescribed in this paper, which if considered, may improve undergraduate medical training in Nigeria, and ultimately improve the standard of healthcare service provision in the country.

Knowledge on Infection Prevention and Control and associated factors among undergraduate health professional students at Makerere University College of Health Sciences, Uganda.

INTRODUCTION: To practice adequate Infection Prevention and Control (IPC) measures, health professional students need to have adequate knowledge of IPC. In this study, we assessed the knowledge of health professional students at Makerere University College of Health Sciences on Infection Prevention and Control. METHODS: We conducted a cross-sectional online survey among health professional students studying at Makerere University College of Health Sciences located in Kampala, Uganda. An adapted questionnaire was used to measure knowledge on Infection Prevention and Control among students. RESULTS: A total of 202 health professional students were included in the study. The mean age was 24.43 years. Majority were male 63.37% (n = 128), from the school of medicine 70.79% (n = 143) and used one source of information for IPC 49.50% (n = 100). Being in year three (Adjusted coefficient, 6.08; 95% CI, 2.04-10.13; p-value = 0.003), year four (Adjusted coefficient, 10.87; 95% CI, 6.91-14.84; p < 0.001) and year five (Adjusted coefficient, 8.61; 95% CI, 4.45-12.78; p < 0.001) were associated with a higher mean in total percentage score of knowledge on IPC compared to being in year one. CONCLUSION: IPC knowledge was good among health professional students in Makerere University although more emphasis is needed to improve on their IPC knowledge in various sections like hand hygiene. Infection Prevention and Control courses can be taught to these students starting from their first year of university education.

Medical Student Selection.

Medical school admissions committees are tasked with fulfilling the values of their institutions through careful recruitment. Making accurate predictions regarding the enrollment behavior of admitted students is critical to intentionally formulating class composition and impacts long-term physician representation.