A program evaluation of the new choices workforce development program: An appreciative inquiry approach.

A significant amount of money ($1.76B annually in the United States) is spent on workforce development programs, while there is limited research on the effectiveness of workforce development programs in meeting their program objectives and assisting program participants in attaining employment. This study evaluated the New Choices Program, a workforce development program offered by PA Women Work, to help its clients obtain employment and overcome personal and professional barriers. The program has historically been offered in a 30-hour in person format but was forced to be modified to a 10-hour virtual program when the COVID-19 pandemic restrictions began. This program evaluation included a comparative analysis of the perceptions of participants in the 30-hour in person program and the 10-hour virtual program. It was found that participants in both the 30-hour in person program and 10-hour virtual program perceived the program positively, experienced an increase in self-confidence and belonging, which led to either obtaining employment or being better prepared for the job search process. The data will help inform the New Choices program stakeholders on programmatic improvements and how best to structure the program in the post-pandemic employment world.

A virtual assistant for primary care's food and nutrition surveillance system: Development and validation study in Brazil.

OBJECTIVE: The study aimed to develop and validate a conversational agent (chatbot) designed to support Food and Nutrition Surveillance (FNS) practices in primary health care settings. METHODS: This mixed-methods research was conducted in three stages. Initially, the study identified barriers and challenges in FNS practices through a literature review and feedback from 655 health professionals and FNS experts across Brazil. Following this, a participatory design approach was employed to develop and validate the chatbot's content. The final stage involved evaluating the chatbot's user experience with FNS experts. RESULTS: The chatbot could accurately understand and respond to 60 different intents or keywords related to FNS. Themes such as training, guidance, and access emerged as crucial for guiding FNS initiatives and addressing implementation challenges, primarily related to human resources. The chatbot achieved a Global Content Validation Index of 0.88. CONCLUSION: The developed chatbot represents a significant advancement in supporting FNS practices within primary health care. PRACTICE IMPLICATION: By providing an innovative, interactive, educational tool that is both accessible and reliable, this digital assistant has the potential to facilitate the operationalization of FNS practices, addressing the critical need for effective training and counseling in developing countries.

Description of a longitudinal interprofessional education plan and outcomes from an inaugural student cohort.

OBJECTIVE: To describe a longitudinal interprofessional education (IPE) plan at one School of Pharmacy (SOP) including inaugural student cohort outcomes. METHODS: Standards 2016 prompted the creation of an IPE task force at the University of Wisconsin-Madison SOP to develop and implement an IPE plan consisting of outcome-based goals, a deliberate design, and a formalized assessment strategy-an approach that inspired national consensus guidance from the Health Professions Accreditors Collaborative. Beginning with the 2022 graduating class, required interprofessional learning activities were embedded longitudinally across a four-year Doctor of Pharmacy (PharmD) program and included classroom-, simulation-, and clinical-based IPE activities. Student learning outcomes, focused on attitudes, skills, and behaviors, were assessed longitudinally using three self-reported, validated measures allowing for pre/post comparisons-Student Perceptions of Interprofessional Clinical Education-Revised, Version 2 (SPICE-R2), Interprofessional Education Collaborative Competency Self-Assessment Tool, Version 3 (IPEC-3), and Interprofessional Collaborative Competencies Attainment Survey-Revised (ICCAS-R)-coupled with the Individual Teamwork Observation and Feedback Tool (iTOFT). RESULTS: Endpoint SPICE-R2 and IPEC-3 average scores were in the agree to strongly agree range with statistically significant pre/post change in 80% (4/5) of sub-scales. Students' attainment and demonstration of positive teamwork behaviors were evidenced by statistically significant pre/post change in advanced pharmacy practice experience (APPE) student ICCAS-R scores and universal satisfactory ratings of APPE students on the iTOFT. CONCLUSION: A developmentally progressive, longitudinal IPE plan was implemented into a four-year PharmD program. Inaugural student cohort assessment results documented students were prepared for interprofessional practice upon graduation.

Evaluation of a basic-clinical integrated pharmacology case-based learning program from a student perspective using the CIPP model.

Purpose: This study aimed to systematically evaluate the effectiveness of case-based learning (CBL) within a basic-clinical integrated educational program using the Context, Input, Process, and Product (CIPP) evaluation model. Methods: The CBL program was integrated into the Pharmacology-Clinical Case Practice component of the pharmacology course, a mandatory course for first-year medical students. To evaluate the program, a CIPP model-based questionnaire was developed, assessing needs, goals, resources, educational management, and outcomes. To ensure the reliability and validity of the variables, factor analysis was performed, reducing an initial set of 28 items to 18 final observation variables distributed across four factors. The survey, designed to measure learner satisfaction, was administered to 37 students who participated in the Pharmacology-Clinical Case Practice course during the first semester of 2022. Results: Participants rated their satisfaction with the CBL program based on the CIPP model (on a 5-point scale), giving an average score of 4.17. This suggests that learners who followed the CBL program combining basic and clinical components generally found the program operationally effective with positive outcomes. Conclusion: The teaching model and evaluation model applied in this study can be utilized in various majors when operating CBL classes that link basic and clinical education in medical schools in the future.

Not From Around Here: Evaluation of In-Person Interviews in an Urban General Surgery Residency Program.

OBJECTIVE: This study used a program evaluation approach to investigate the perceptions of utilizing in-person applicant interviews for a general surgery residency program. DESIGN: The study utilized de-identified data routinely collected during the residency program applicant interviews in the General Surgery Residency Program during the fall of 2023. Applicant and faculty/resident exit interview questionnaires were developed to evaluate perceptions of in-person interviewing; the questions were informed by domains for considering the appropriateness and feasibility of continuing in-person interviews as identified by the institution's Graduate Medical Education Committee. Applicants completed the survey at the end of their interview day; faculty and resident interviewers completed the survey following the applicant rank meeting. SETTING: The Sponsoring Institution approved a pilot transition from virtual to in-person interviews for the General Surgery Residency Program 2023 recruitment cycle. Surveys were completed electronically. PARTICIPANTS: Sixty-four applicants were interviewed and requested to complete the exit survey. The survey was completed by 55 (Response rate = 86%) program applicants and eight (Response rate = 100%) faculty and residents in the program. RESULTS: 49.1% of applicants indicated a preference for in-person interviews, 40.0% of applicants indicated a preference to choose and only 10.9% indicated a preference for virtual interviews. Applicants from out-of-state had a significantly higher preference for in-person interviews than those from in-state. Applicants and faculty interviewers perceived in-person interviews to provide a strong assessment of applicants. Applicants from out-of-state had a significantly higher confidence in their ability to demonstrate their strength and assess fit than those from in-state. CONCLUSIONS: While most applicants and faculty interviewers were generally comfortable with an in-person interviewing format, applicants from out-of-state had a particularly high preference for and perception of in-person interviews. General surgery residency programs and sponsoring institutions would benefit from the development of a comprehensive program evaluation strategies for their residency program interviews to make evidence-informed decisions about how best to structure interviews for their programs.

A Pilot Feasibility Study of Delivering a Quit & Win Tobacco-Free Contest in Community Mental Health Programs.

OBJECTIVE: Quit & Win contests are a community-based tobacco cessation strategy that has demonstrated success in supporting tobacco cessation efforts in the general population. However, such contests have not been implemented and evaluated among people living with mental illnesses (MIs). This pilot study aimed to evaluate the feasibility of implementing Quit & Win contests in terms of program delivery, engagement, and cessation outcomes among people with MIs. METHODS: A single-group posttest design to evaluate the feasibility of Quit & Win contests conducted at three community mental health programs. RESULTS: Flyers introducing the contest were posted at study sites 2 weeks prior to recruitment. Recruitment occurred on 2 days over a 2-week period. Eligible participants received a pamphlet with information about tobacco treatment resources. At the follow-up, postsurveys and expired CO levels were obtained. Participants (N = 28) were mostly male, Non-Hispanic White, with a high school or higher education, unemployed, and 46.4% had a primary substance use disorder diagnosis. Among those who engaged in the program, seven (25.0%) returned for the follow-up, of which three (42.9%) successfully stopped cigarette use. Four (57.1%) described using nicotine replacement therapy in their attempt to stop using cigarettes. Challenges to cessation included difficulty finding available tobacco treatment programs, limited access to treatment medications, and experiencing nicotine withdrawal symptoms. CONCLUSIONS: Our findings suggest the feasibility of Quit & Win interventions in community mental health settings. Further efforts are required to enhance recruitment, engagement, and retention, and to support access to community-based tobacco treatment resources.

An Evaluation of the First Clinical Posting in Psychiatry of the Competency-Based Medical Education (CBME) Curriculum for Undergraduate Medical Students in India.

Background: The new competency-based medical education (CBME) curriculum presents an opportunity to address the many deficiencies in undergraduate (UG) psychiatry education in India. There are no published reports of such evaluations of psychiatry teaching programs based on the new CBME curriculum. Methods: We performed a cross-sectional evaluation of the first clinical posting in psychiatry of the new CBME curriculum using the following metrics: clinical skills, knowledge, attitudes towards psychiatry, self-efficacy in performing the specific learning objectives (SLOs), and satisfaction with specific teaching-learning and assessment methods implemented. Results: The mean knowledge score after the posting was significantly higher compared to the mean knowledge score at baseline (7.79 vs 5.45, p<0.001). The mean clinical skills score after the posting was 13.77 (0-20 range). Improvement was noted in the mean scores on all three sub-scales of the attitudes toward psychiatry scale. However, the improvement in scores was statistically significant only on the 'Stigma of Psychiatry' sub-scale. The mean scores on the items of the self-efficacy scale were between 63.41 and 77.73 (0-100 range). The mean scores on all items of the satisfaction scale were between 4 (somewhat satisfied) and 5 (very satisfied). Conclusion: We have described an evaluation of the first clinical posting in psychiatry of the new CBME curriculum. The posting was effective in imparting knowledge and clinical skills and potentially bringing about favorable changes in the attitudes toward psychiatry among UG medical students. The students also perceived confidence in performing the SLOs and were satisfied with the teaching-learning methods and assessment methods implemented.

Dealing with imperfect randomization: Inference for the highscope perry preschool program.

This paper considers the problem of making inferences about the effects of a program on multiple outcomes when the assignment of treatment status is imperfectly randomized. By imperfect randomization we mean that treatment status is reassigned after an initial randomization on the basis of characteristics that may be observed or unobserved by the analyst. We develop a partial identification approach to this problem that makes use of information limiting the extent to which randomization is imperfect to show that it is still possible to make nontrivial inferences about the effects of the program in such settings. We consider a family of null hypotheses in which each null hypothesis specifies that the program has no effect on one of several outcomes of interest. Under weak assumptions, we construct a procedure for testing this family of null hypotheses in a way that controls the familywise error rate - the probability of even one false rejection - in finite samples. We develop our methodology in the context of a reanalysis of the HighScope Perry Preschool program. We find statistically significant effects of the program on a number of different outcomes of interest, including outcomes related to criminal activity for males and females, even after accounting for the imperfectness of the randomization and the multiplicity of null hypotheses.

Embedding a Parenting Skills Program in Public PreK: Outcomes of a Quasi-experimental Mixed Methods Study.

This sequential mixed methods study evaluated the impact of the Chicago Parent Program (CPP) in 12 Baltimore Title I PreK programs on parent engagement and student outcomes from kindergarten through 2nd grade. Phase 1 (quasi-experiment; N = 11,996) compared PreK students whose parents enrolled in CPP with those whose parents did not enroll in CPP on measures of kindergarten readiness, chronic absenteeism, suspensions/expulsions, and grade retention. Phase 2 (qualitative; n = 20) explored the perceptions of school-based staff, principals, and district and community leaders on CPP's impact on parents, students, and parent engagement, and why they sought to continue CPP in the schools. Research Findings: No effects on student outcomes were found using administrative data. However, all of those interviewed described observed improvements in parent and student behavior and parent engagement and all schools have continued implementing CPP. Practice or Policy: Qualitative results highlight the importance of stakeholder perspectives and the limitations of administrative data for evaluating brief interventions serving families with complex needs.

Curriculum and program evaluation in medical education: a short systematic literature review.

Medical education is constantly evolving worldwide and facing various challenges. To cope with these, continuous and fruitful evaluation of an educational program is the need of the day. This study aims to know the purpose of evaluation, various theories related to program evaluation, and different models of curriculum and program evaluation. This will help educationists evaluate their programs fruitfully and effectively according to their needs and objectives. Different search engines including Medline's PubMed interface, Google Scholar, and Cochrane Review databases using keywords, curriculum evaluation, evaluation models, and evaluation strategies in education, were searched without any date restrictions, and 20 full-text articles were selected for review and data extraction. While reviewing the literature it was found that most of the modern educational program and curriculum evaluation models are based on the reductionist, system, and complexity theories of evaluation. The experimental/quasi-experimental model is based majorly on the linear approach and reductionism, but its drawback is that it is impractical for the whole curriculum and sometimes ethically unfavorable. Kirkpatrick's model, Philips' model, the CIPP model, and the logic model are based on the system and complexity theory and are more practical in medical education. Each of these models has its advantages and limitations. In this review, the authors discussed the important distinctive features of these evaluation theories and models and their applicability and usefulness in evaluating different programs and curricula.

Developing an initial explanatory theory for Partnering for Change using realist evaluation.

INTRODUCTION: Partnering for Change (P4C) is an innovative practice model for school-based occupational therapy developed in Canada and informed by a program of research spanning nearly two decades. National and international interest in P4C necessitated development of an explanatory theory to guide implementation in varied contexts. The purpose of this study is to document the process of theory development and to provide an overview of the initial P4C explanatory theory. METHODS: Realist evaluation was used to construct an initial explanatory theory of P4C drawing on P4C developers' conceptualisations of the model, document analysis, and analysis of transcripts from interviews and focus groups. CONSUMER AND COMMUNITY INVOLVEMENT: No consumers were involved in the study design or analysis. FINDINGS: Four sets of premises expressed as context-mechanism-outcome configurations (CMOCs) comprise the initial explanatory theory of P4C. An abstracted summary of these four sets along with contexts, mechanisms, and outcomes central to the P4C initial explanatory theory is presented. An exemplar CMOC is shared to illustrate how theoretical premises are developed and expressed using realist evaluation. CONCLUSION: This study advances knowledge regarding the hypothesised core elements of P4C and provides an example of using realist evaluation to advance knowledge in occupational therapy. Preliminary implications for clinical practice are discussed. PLAIN LANGUAGE SUMMARY: Partnering for Change (P4C) is a way of providing occupational therapy services in schools that helps all children to learn and participate successfully. P4C was created in Ontario, Canada, and has been researched for almost 20 years. People in different parts of Canada and other countries are interested in trying P4C. As the researchers who created P4C, we think there is a need to explain how it works so it can be used in different places. This study explains how we created a theory to describe P4C. To develop this theory, we used a method called realist evaluation that would help us explain how, why, and in what situations P4C works best. To do this, we analysed documents and transcripts of interviews and focus groups. Our findings are organised into four main ideas, each explained in terms of contexts (the situations), mechanisms (how and why P4C works), and outcomes (the impacts of P4C). One detailed example is given to show how these ideas were formed and work together. In conclusion, our study helps us understand the key parts of P4C and shows how realist evaluation can be used to improve knowledge in occupational therapy. The study also suggests some early ideas on how P4C can be used in practice.

Relevance and quality of the Gipuzkoan extracurricular youth sports program: an evaluation from a positive youth development perspective.

Physical activity and sport (PAS) programmes are an important part of organized extracurricular activities for children and young people. They appear as potentially inclusive environments where students could be provided with holistic development based on active and healthy lifestyles. The aim of this study was to evaluate and describe the Gipuzkoa School Sport Programme (GSSP) from the positive youth development (PYD). The research was carried out based on CPAR (Critical Participatory Action-Research) methodology: a "CPAR group" was created -including researchers and policymakers- to carry out the evaluation of the GSSP in which we analyzed (a) the social environment or PYD climate and (b) life skills. The evaluation and description of the GSSP confirmed that it meets most requirements for providing positive development contexts and opportunities for PYD. The choice of prioritizing multisport and deliberate play and putting early specialization aside seem key conditions to ensure PYD-promoting environments. This work could serve as a referent for decision-makers in organizations dedicated to designing, developing, implementing, and evaluating PYD-focused extracurricular youth sport programmes.

A new performance evaluation indicator for the LEE Jong-wook Fellowship Program of Korea Foundation for International Healthcare to better assess its long-term educational impacts: a Delphi study.

PURPOSE: The Dr. LEE Jong-wook Fellowship Program, established by the Korea Foundation for International Healthcare (KOFIH), aims to strengthen healthcare capacity in partner countries. The aim of the study was to develop new performance evaluation indicators for the program to better assess long-term educational impact across various courses and professional roles. METHODS: A 3-stage process was employed. First, a literature review of established evaluation models (Kirkpatrick's 4 levels, CIPP model, OECD DAC criteria) was conducted to devise evaluation criteria. Second, these criteria were validated via a 2-round Delphi survey with 18 experts in training projects from May 2021 to June 2021. Third, the relative importance of the evaluation criteria was determined using the analytic hierarchy process (AHP), calculating weights and ensuring consistency through the consistency index (CI) and consistency ratio (CR), with CR values below 0.1 indicating acceptable consistency. RESULTS: The literature review led to a combined evaluation model, resulting in 4 evaluation areas, 20 items, and 92 indicators. The Delphi surveys confirmed the validity of these indicators, with content validity ratio values exceeding 0.444. The AHP analysis assigned weights to each indicator, and CR values below 0.1 indicated consistency. The final set of evaluation indicators was confirmed through a workshop with KFIH and adopted as the new evaluation tool. CONCLUSION: The developed evaluation framework provides a comprehensive tool for assessing the long-term outcomes of the Dr. LEE Jong-wook Fellowship Program. It enhances evaluation capabilities and supports improvements in the training program's effectiveness and international healthcare collaboration.

The directors of resident support program: a program evaluation of a resident well-being and support innovation.

BACKGROUND: Medical training can be a challenging time for residents both professionally and personally. Resident support programs must be able to address a range of potential experiences, be accessible and easy to navigate, and consider the unique context of residency. Rigorous evaluation of resident support programs is needed to determine whether these programs are meeting these goals. METHODS: The Directors of Resident Support (DRS) program, launched in January 2021 at the Cumming School of Medicine at the University of Calgary, is a near-peer support model consisting of three faculty physicians, trained in peer support, who receive contacts from residents needing support for any issue. DRS physicians provide empathetic listening, referral to existing resources, and peer support for residents. A multisource evaluation of the DRS program, including field notes, data collection forms, and surveys, was guided by the Donabedian framework. RESULTS: There were 62 total contacts in the 2-year evaluation period which required a median 2 h to address (range 5 min to more than 40 h). The most common topic for contact was to discuss feedback or evaluation (n = 10, 24.4%) and the most common response was listening and support (n = 29, 70.7%). Residents also contacted DRS to discuss experiences of racism, physical assault, sexual harassment, and mental health crises. Residents (n = 13) rated a median score of 74 out of possible 100 for usefulness (interquartile range [IQR] 1-100, with higher scores suggesting greater usefulness). Free text survey responses suggested that residents felt validated by contact with the program though some residents felt that additional follow-up would have been helpful. CONCLUSION: The DRS program has been well-utilized by residents for a variety of issues. Postgraduate Medical Education offices seeking to create resident support programs may anticipate that about 3% of residents may use a similar program per year and that the typical interaction would last 2 h, with a wide range. Feedback suggested that similar programs should have a formal process for follow-up with residents to ensure their concern was addressed and that resident supporters should have diverse lived experiences.

Effectiveness of a Bullying Intervention (Be-Prox) in Norwegian Early Childhood and Education Care Centers: Protocol for a Cluster Randomized Controlled Trial.

BACKGROUND: A new and growing body of research has studied bullying among children in early childhood education and care centers (ECECs). The Bernese Program (Be-Prox) is designed to systematically prevent and handle bullying between children in Swiss ECECs. However, the effectiveness of the Be-Prox intervention has not yet been explored in a Norwegian ECEC setting. OBJECTIVE: This study aims to evaluate the effectiveness of Be-Prox in preventing and handling bullying among peers in Norwegian ECECs. METHODS: ECECs from 2 Norwegian municipalities were invited to participate in a cluster randomized controlled trial (RCT) to evaluate the effectiveness of the Be-Prox intervention on peer bullying in Norwegian ECECs. After baseline measures were taken, project ECECs were randomized to either an intervention or a control arm. The Be-Prox intervention was introduced to ECECs in the intervention arm through 6 modules over a 9-month period immediately after the randomization. ECECs in the control arm participated in the data collection and were offered the Be-Prox intervention the following year. The primary outcome of the effect evaluation is the mean sum of negative behavior between peers after the Be-Prox training is completed in the intervention arm. Secondary outcomes include child bystander behavior, teacher self-efficacy, and ECEC's authoritative climate. An extensive implementation and process evaluation, as well as cost-effectiveness analyses, will be conducted alongside the RCT. RESULTS: Baseline data collection was conducted in September 2023, and the postintervention data collection started in May 2024. At baseline, we collected data on 708 children and 413 personnel from 38 project ECECs in the 2 Norwegian municipalities. The results from the study will be available in late 2024 at the earliest. CONCLUSIONS: The proposed project includes a comprehensive evaluation of the effectiveness of Be-Prox in Norwegian ECECs directly targeting the prevention and handling of bullying, including implementation and cost-effectiveness evaluations. The results from the project have the potential to fill in identified knowledge gaps in the understanding of negative behavior and bullying between peers in ECECs, and how these may be prevented. If proven efficient, our ambition is to offer Be-Prox to Norwegian ECECs as an evidence-based practice to prevent and handle bullying among preschool children. TRIAL REGISTRATION: ClinicalTrials.gov NCT06040437; https://clinicaltrials.gov/study/NCT06040437. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/60626.

Analysing the behaviour change techniques in an effective food literacy program to inform future program design.

AIM: Food literacy programs aim to improve food related skills and knowledge and are selected Governments as a strategy to address dietary intakes at a community level. The purpose of this research is to identify behaviour change techniques in a food literacy program, which were assessed by the achievement of participant goals related to food literacy and dietary behaviour changes. METHODS: Consensus methods were applied to map behaviour change techniques to an adult food literacy program. A second phase investigation applied content analysis of participant process evaluation data (collected between 2016 and June 2021) to align target behaviours and behaviour change techniques. Chi-square and ANCOVA were used to assess the statistically significant demographic characteristics, food literacy, and dietary behaviour scores for participants who set goals and recorded changes. RESULTS: A total of 4697 program participants provided evaluation data from the 4-week food literacy program. Participants who set goals and made changes were statistically more likely to have higher food literacy factor scores (p < 0.001) and fruit serves (p = 0.004). Statistical analysis showed that participants were more likely to have set goals and recorded changes if they were female (p < 0.001), older (p < 0.001), higher education level (p < 0.001), had a higher socioeconomic status (p = 0.049), lived with children (p = 0.014), were born in Australia (p = 0.019), or did not identify as Indigenous (p < 0.001). The behaviour change technique mapping process identified nine techniques used weekly and a total of 22 techniques used over the entire 4 week program curriculum. CONCLUSIONS: This is the first Australian study to link the contribution of behaviour change techniques to food literacy and dietary behaviour change in an established effective food literacy program. Knowing the behaviour change techniques associated with effective programs will facilitate replication of effective interventions.

Development, dissemination and survey evaluation of layered education for healthcare professionals to support implementation of firearm injury and mortality prevention strategies in emergency care settings, New York, USA.

BACKGROUND: There is consensus on the need and ability to address firearm injury risk in healthcare settings; however, the lack of education for healthcare professionals hinders the implementation of evidence-based firearm injury and mortality prevention strategies. The objectives of this study are to develop, disseminate and evaluate education for team members to facilitate implementation in emergency departments METHOD: Two-tiered education was developed in partnership with stakeholders and disseminated to the healthcare team, covering evidence-based screening and interventions for firearm access and violence risk. The implementation, development and dissemination strategies followed the framework used for systemwide Screening, Brief Intervention and Referral to Treatment implementation for substance use. Team members who screened patients for firearm injury risk received screening education and team members meeting with patients who screened positive received intervention education. Participants completed surveys to evaluate the education and learning objectives. RESULTS: Across three emergency departments from March 2021 to May 2022, 267 team members completed screening education. Key takeaways reported by 173 participants were how to screen (24.9%), the 5L's of Firearm Safety (19.7%) and the prevalence of firearm injury (11.0%). Participants still had questions about workflow, resources and safety. 34 of 67 (50.7%) intervention education participants completed the postsurvey. 100% were confident they could screen, 79% were confident they could provide brief interventions and 88% were confident their site could implement firearm injury prevention strategies. CONCLUSION: Tiered education for firearm injury prevention screening and intervention achieved learning objectives and facilitated programme implementation. Education increased knowledge and confidence regarding firearm injury risk screening and its importance in healthcare settings.

Enhancing academic performance: a shadow curriculum approach for medical and dental student preparation in basic sciences and pre-internship comprehensive exams.

BACKGROUND: The shadow curriculum is an emerging concept in curriculum studies that has not yet garnered significant attention in medical education. It includes programs and activities outside formal education to improve students' academic performance in the formal educational system. OBJECTIVE: In this study, we designed and developed an online course based on the shadow curriculum and evaluated its effect on students' learning and academic performance. METHODS: This study represents a form of developmental research, with the study population comprising medical and dental students from universities of medical sciences in Iran. The course was conducted at the Smart University of Medical Sciences, following the ADDIE instructional design approach in three phases. The initial two phases involved designing and implementing the program according to the students' needs and requirements. In the third phase, we evaluated the program using the Kirkpatrick model. In the first level evaluation, the reaction of 70 students in the course was investigated. To assess the impact of the course, pre and post-tests were administered to 30 students. Finally, the effect of the course on students' success in the comprehensive exams for basic medical sciences, dentistry, and pre-internship was analyzed by examining the passing and failing statuses of 83 and 57 students who participated in the September 2023 and February 2024 exams. RESULTS: The results indicated that the students responded positively to the program. The analysis of pre-test and post-test scores showed a significant improvement in the students' academic performance across all the subjects presented in the course, including basic medical sciences, dentistry, and pre-internship (p < 0.01, p < 0.05). Overall, the descriptive analysis of the program's influence on the students' success in comprehensive exams in basic medical sciences, dentistry, and pre-internship showed that 70 out of 83 participating students passed the September 2023 comprehensive exams. Additionally, 51 out of 57 participants completed the comprehensive exams in February 2024. CONCLUSIONS: In an era where the shadow curriculum is reshaping learning and the educational landscape, the findings presented in this study indicate that this type of curriculum should be given special attention in the theoretical, research, and practical dimensions of the field of medical education.

Impact of a short-term pharmacy study abroad Program: student outcomes and program evaluation.

OBJECTIVE: This study examined the impact of a short-term study abroad program, focusing on program evaluation, attendee satisfaction, and acquired knowledge and skills. A questionnaire survey was conducted covering various aspects including demographics, program evaluation, and feedback. RESULTS: Results indicated higher female participation due to gender imbalances in pharmacy students in Egypt, with senior students recognizing the value of international experience. Attendee satisfaction was high, with positive feedback on accommodation, tours, and workshop materials. Field visits and workshops provided valuable experiential learning, with attendees suggesting extending the program's duration. The program equipped attendees with knowledge and skills relevant to pharmaceutical products and services, leading to improved competences and perceptions. The study concludes that such study abroad experiences profoundly impact personal growth and recommends integrating them into educational curricula for valuable experiences.

Program Evaluation of the radKIDS® Youth Personal Empowerment Safety Education Program.

Developing sound evidence of program effectiveness can be difficult for many programs initiated by schools and communities, and impedes many beneficial programs from broader dissemination. This paper shares results of an evaluation approach used with a bullying and victimization prevention program with elementary school children called the radKIDS® Personal Empowerment and Safety Education Program. The purpose of this study was to examine indicators of initial effectiveness of the radKIDS® program for elementary school child safety skill development and instructor training to reduce child victimization and associated trauma and empower healthy psychosocial child development. The study involved 330 active radKIDS® instructors surveyed during two separate two-week periods, resulting in 148 completed questionnaires (45%). Instructors rated their perceptions of what children effectively learned in radKIDS®, the effectiveness of instructor training, and on Social Emotional Learning (SEL) competencies addressed in the program. Evaluation findings confirmed the theoretical model of the program, and that the developmental safety domains impacting children in radKIDS® differs from those in other bullying prevention interventions focused on SEL and other competencies. Recommended areas of improvement for the program included making training less time consuming and more flexible in delivery, provide more practice opportunities and time on skill acquisition during training, and increase supervision and guidance during program implementation. Supplementary Information: The online version contains supplementary material available at 10.1007/s40653-024-00618-5.