Embedding assessment in a simulation skills training program for medical and midwifery students: A pre- and post-intervention evaluation.

BACKGROUND: Simulation-based programs are increasingly being used to teach obstetrics and gynaecology examinations, but it is difficult to establish student learning acquired through them. Assessment may test student learning but its role in learning itself is rarely recognised. We undertook this study to assess medical and midwifery student learning through a simulation program using a pre-test and post-test design and also to evaluate use of assessment as a method of learning. METHODS: The interprofessional simulation education program consisted of a brief pre-reading document, a lecture, a video demonstration and a hands-on workshop. Over a 24-month period, 405 medical and 104 midwifery students participated in the study and were assessed before and after the program. Numerical data were analysed using paired t-test and one-way analysis of variance. Students' perceptions of the role of assessment in learning were qualitatively analysed. RESULTS: The post-test scores were significantly higher than the pre-test (P < 0.001) with improvements in scores in both medical and midwifery groups. Students described the benefit of assessment on learning in preparation of the assessment, reinforcement of learning occurring during assessment and reflection on performance cementing previous learning as a post-assessment effect. CONCLUSION: Both medical and midwifery students demonstrated a significant improvement in their test scores and for most students the examination process itself was a positive learning experience.

Using contribution analysis to evaluate health professions and health sciences programs.

Introduction/background: Course evaluation in health education is a common practice yet few comprehensive evaluations of health education exist that measure the impact and outcomes these programs have on developing health graduate capabilities. Aim/objectives: To explore how curricula contribute to health graduate capabilities and what factors contribute to the development of these capabilities. Methods: Using contribution analysis evaluation, a six-step iterative process, key stakeholders in the six selected courses were engaged in an iterative theory-driven evaluation. The researchers collectively developed a postulated theory-of-change. Then evidence from existing relevant documents were extracted using documentary analysis. Collated findings were presented to academic staff, industry representatives and graduates, where additional data was sought through focus group discussions - one for each discipline. The focus group data were used to validate the theory-of-change. Data analysis was conducted iteratively, refining the theory of change from one course to the next. Results: The complexity in teaching and learning, contributed by human, organizational and curriculum factors was highlighted. Advances in knowledge, skills, attitudes and graduate capabilities are non-linear and integrated into curriculum. Work integrated learning significantly contributes to knowledge consolidation and forming professional identities for health professional courses. Workplace culture and educators' passion impact on the quality of teaching and learning yet are rarely considered as evidence of impact. Discussion: Capturing the episodic and contextual learning moments is important to describe success and for reflection for improvement. Evidence of impact of elements of courses on future graduate capabilities was limited with the focus of evaluation data on satisfaction. Conclusion: Contribution analysis has been a useful evaluation method to explore the complexity of the factors in learning and teaching that influence graduate capabilities in health-related courses.

Obstetric neonatal emergency simulation workshops in remote and regional South India: a qualitative evaluation.

BACKGROUND: Healthcare facilities in remote locations with poor access to a referral centre have a high likelihood of health workers needing to manage emergencies with limited support. Obstetric and neonatal clinical training opportunities to manage childbirth emergencies are scant in these locations, especially in low- and middle-income countries. OBJECTIVES: This study aimed to explore the factors, which influenced healthcare worker experience of attending birth emergencies in remote and regional areas of South India, and the perceived impact of attending the Obstetric and Neonatal Emergency Simulation (ONE-Sim) workshop on these factors. DESIGN: Qualitative descriptive study using pre- and post-workshop qualitative surveys. SETTINGS: Primary healthcare facilities in remote/regional settings in three states of South India. PARTICIPANTS: A total of 125 healthcare workers attended the workshops, with 85 participants completing the pre- and post-workshop surveys included in this study. Participants consisted of medical and nursing staff and other health professionals involved in care at childbirth. METHODS: ONE-Sim workshops (with a learner-centred approach) were conducted across three different locations for interprofessional teams caring for birthing women and their newborns, using simulation equipment and immersive scenarios. Thematic analysis was employed to the free-text responses obtained from the surveys consisting of open-ended questions. RESULTS: Participants identified their relationship with the patient, the support provided by other health professionals, identifying their gaps in knowledge and experience, and the scarcity of resources as factors that influenced their experience of birth emergencies. Following the workshops, participant learning centred on improving team and personal performance and approaching future emergencies with greater confidence. CONCLUSIONS: Challenges experienced by healthcare workers across sites in remote and regional South India were generally around patient experience, senior health professional support and resources. The technical and interpersonal skills introduced through the ONE-Sim workshop may help to address some of these factors in practice.

Introduction of an undergraduate interprofessional simulation based skills training program in obstetrics and gynaecology in India.

Interprofessional simulation based education (SBE) improves core clinical skills and team training in obstetrics and gynaecology. In this innovative study, the introduction of an undergraduate interprofessional SBE program for teaching obstetrics and gynaecology skills in India was evaluated. The study attempted to evaluate the feasibility and benefit of the interprofessional skills training workshop in obstetrics and gynaecology, which was introduced for medical and midwifery students in a secondary level hospital in India. The program focuses on improving "hands-on" clinical skills and can be explained by the "skills acquisition theory". Using a survey, participants rated relevance, pitch and confidence (on a 5-point Likert scale) and described the contextualisation and teaching of core clinical skills through the workshop using free-text. Descriptive analysis of quantitative Likert scale responses and thematic analysis of the free-text data was conducted and themes identified. Ninety-five medical and midwifery students attended the inaugural workshop, in a low-resource setting. The clinical experience in obstetrics and gynaecology across both groups was minimal, neither were they exposed to any prior SBE. Both health professional groups found the workshop useful, relevant and improved their confidence in performing vaginal examination and births. The key theme, which emerged from qualitative analysis, was "getting hands-on" experience. Other themes included learning by simulation without clinical time constraints, retaining the ability to make mistakes, bridging theory to practice, valuing interprofessional experience and ensuring equal learning opportunities for all participating professional groups. The advantages of interprofessional SBE, for medical and midwifery students, are reproducible in a low-resource setting, and may be be helpful for learning intimate clinical examination, obstetric procedures and team training.