Simulation-Based Training in Emergency Obstetric Care in Sub-Saharan and Central Africa: A Scoping Review.

Background: Every day approximately 810 women die from complications related to pregnancy and childbirth worldwide. Around two thirds of these deaths happen in sub-Saharan Africa. One of the strategies to decrease these numbers is improving the quality of care by emergency obstetric simulation-based training. The effectiveness of such training programs depends on the program's instructional design. Objective: This review gives an overview of studies about emergency obstetric simulation-based training and examines the applied instructional design of the training programs in sub-Saharan and Central Africa. Methods: We searched Medline, Embase and Cochrane Library from inception to May 2021. Peer-reviewed articles on emergency obstetric, postgraduate, simulation-based training in sub-Saharan and Central Africa were included. Outcome measures were categorized based on Kirkpatrick's levels of training evaluation. The instructional design was evaluated by using the ID-SIM questionnaire. Findings: In total, 47 studies met the inclusion criteria. Evaluation on Kirkpatrick level 1 showed positive reactions in 18 studies. Challenges and recommendations were considered. Results on knowledge, skills, and predictors for these results (Kirkpatrick level 2) were described in 29 studies. Retention as well as decay of knowledge and skills over time were presented. Results at Kirkpatrick level 3 were measured in 12 studies of which seven studies demonstrated improvements of skills on-the-job. Improvements of maternal and neonatal outcomes were described in fifteen studies and three studies reported on cost-estimations for training rollout (Kirkpatrick level 4). Instructional design items were heterogeneously applied and described. Conclusions: Results of 47 studies indicate evidence that simulation-based training in sub-Saharan and Central Africa can have a positive impact across all four levels of Kirkpatrick's training evaluation model. However, results were not consistent across all studies and the effects vary over time. A detailed description of instructional design features in future publications on simulation-based training will contribute to a deeper understanding of the underlying mechanisms that determine why certain training programs are more effective in improving maternal and neonatal healthcare outcomes than other.

Multi-professional simulation-based team training in obstetric emergencies for improving patient outcomes and trainees' performance.

BACKGROUND: Simulation-based obstetric team training focuses on building a system that will anticipate errors, improve patient outcomes and the performance of clinical care teams. Simulation-based obstetric team training has been proposed as a tool to improve the overall outcome of obstetric health care. OBJECTIVES: To assess the effects of simulation-based obstetric team training on patient outcomes, performance of obstetric care teams in practice and educational settings, and trainees' experience. SEARCH METHODS: The Cochrane Pregnancy and Childbirth Group's Trials Register, ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform (ICTRP) were searched (14 April 2020), together with references checking and hand searching the available proceedings of 2 international conferences. SELECTION CRITERIA: We included randomised controlled trials (RCTs) (including cluster-randomised trials) comparing simulation-based obstetric team training with no, or other type of training. DATA COLLECTION AND ANALYSIS: We used standard methodological procedures expected by Cochrane, to identify articles, assess methodological quality and extract data. Data from three cluster-randomised trials could be used to perform generic inverse variance meta-analyses. The meta-analyses were based on risk ratios (RRs) and mean differences (MDs) with 95% confidence intervals (CIs). We used the GRADE approach to rate the certainty of the evidence. We used Kirkpatrick's model of training evaluation to categorise the outcomes of interest; we chose Level 3 (behavioural change) and Level 4 (patient outcome) to categorise the primary outcomes. MAIN RESULTS: We included eight RCTs, six of which were cluster-randomised trials, involving more than 1000 training participants and more than 200,000 pregnancies/births. Four studies reported on outcome measures on Kirkpatrick level 4 (patient outcome), three studies on Kirkpatrick level 3 (performance in practice), two studies on Kitkpatrick level 2 (performance in educational settings), and none on Kirkpatrick level 1 (trainees' experience). The included studies were from Mexico, the Netherlands, the UK and the USA, all middle- and high-income countries. Kirkpatrick level 4 (patient outcome) Simulation-based obstetric team training may make little or no difference for composite outcomes of maternal and/or perinatal adverse events compared with no training (3 studies; n = 28,731, low-certainty evidence, data not pooled due to different composite outcome definitions). We are uncertain whether simulation-based obstetric team training affects maternal mortality compared with no training (2 studies; 79,246 women; very low-certainty evidence). However, it may reduce neonatal mortality (RR 0.70, 95% CI 0.48 to 1.01; 2 studies, 79,246 pregnancies/births, low-certainty evidence). Simulation-based obstetric team training may have little to no effect on low Apgar score compared with no training (RR 0.99, 95% 0.85 to 1.15; 2 studies; 115,171 infants; low-certainty evidence), but it probably reduces trauma after shoulder dystocia (RR 0.50, 95% CI 0.25 to 0.99; 1 study; moderate-certainty evidence) and probably slightly reduces the number of caesarean deliveries (RR 0.79, 95% CI 0.67 to 0.93; 1 study; n = 50,589; moderate-certainty evidence) Kirkpatrick level 3 (performance in practice) We found that simulation-based obstetric team training probably improves the performance of the obstetric teams in practice, compared with no training (3 studies; 2398 obstetric staff members, moderate-certainty evidence, data not pooled due to different outcome definitions). AUTHORS' CONCLUSIONS: Simulation-based obstetric team training may help to improve team performance of obstetric teams, and it might contribute to improvement of specific maternal and perinatal outcomes, compared with no training. However, high-certainty evidence is lacking due to serious risk of bias and imprecision, and the effect cannot be generalised for all outcomes. Future studies investigating simulation-based obstetric team training compared to training courses with a different instructional design should carefully consider how and when to measure outcomes. Particular attention should be paid to effect measurement at the level of patient outcome, taking into consideration the low incidence of adverse maternal and perinatal events.

The use of a stronger instructional design by implementing repetitive practice in simulation-based obstetric team training: trainees' satisfaction.

Objective: This study compares satisfaction levels from multiprofessional obstetric care teams about simulation-based obstetric team training courses with and without the instructional design feature repetitive practice. Methods: The present study is part of a multicentre cluster-randomised controlled trial (TOSTI trial) that investigated the effectiveness of a 1 day, multiprofessional, simulation-based obstetric team training. The initial training group received a training which was designed based on best practice. After 1 year, the control group received a training course in which the instructional design was changed by providing repetitive practice. All participants were asked to fill in a 29-item evaluation form with seven questions about baseline characteristics and 22 questions about training features. The questions about training features could be rated on a scale of 1 to 5. Finally, all participants were asked to rate the total training day on a scale of 1-10. Results: The best practice group consisted of 471 trainees and the repetitive practice group of 549, including gynaecologists, residents, midwives and nurses. The best practice group rated the total training day significantly higher than the repetitive practice group (mean 8.8, SD 0.6 and mean 8.7, SD 0.6; p<0.003, Cohen's d=0.19). Several training features were also scored higher in the best practice group. Conclusion: This study showed that obstetric healthcare professionals rated a simulation-based obstetric team training course, with and without repetition of scenarios, both high. The training without the repetitive elements gained higher scores for the total training dayand several, and several training features were scored higher. The difference between the mean scores and the effect sizes for the training features were small. This implies that repetitive practice can be integrated in simulation-based team training to optimise learning effects, with small effects on trainees satisfaction.

Comparison of the psychological and physiological effects on students of a video-assisted or text introduction to a simulated task.

Introduction: The use of different methods for introducing the scenario in simulation-based medical education has not been investigated before and may be a useful element to optimise the effectiveness of learning. The aim of this study was to compare an immersive video-assisted introduction to a minimal text-based one, with regard to emotional assessment of the situation. Methods: In this pilot study, 39 students participated in a medical simulated scenario. The students were randomly assigned to an experimental group (video-assisted introduction) or a control group (minimal textual introduction) and both were followed by performing surgery on LapSim (Surgical Science, Gothenburg, Sweden). The emotional assessment of the situation, cognitive appraisal, was defined as the ratio of the demands placed by an individual's environment (primary appraisal) to that person's resources to meet the demands (secondary appraisal). Secondary outcomes were anxiety (State-Trait Anxiety Inventory), physiological parameters (heart rate, heart rate variability, skin conductance, salivary cortisol), engagement (Game Engagement Questionnaire), motivation (Intrinsic Motivation Inventory) and performance (mean score in percentage calculated by LapSim of predefined levels). Results: Participants in the immersive video group (n=17) were overloaded in terms of their perceived demands (a ratio of 1.17, IQR 0.30) compared with those in the control group (a ratio of 1.00, IQR 0.42, n=22) (P=0.01). No significant differences were found between the groups in secondary outcomes. Both groups showed an increase of anxiety after the introduction method. In the experimental group, this score increased from 9.0 to 11.0, and in the textual group from 7.5 to 10.5, both P<0.01. Discussion: This study shows that the method of introducing a simulated scenario may influence the emotional assessment of the situation. It may be possible to make your simulation introduction too immersive or stimulating, which may interfere with learning. Further research will be necessary to investigate the impact and usefulness of these findings on learning in simulation-based medical education.

Assessment tool for the instructional design of simulation-based team training courses: the ID-SIM.

Introduction: To achieve an expert performance of care teams, adequate simulation-based team training courses with an effective instructional design are essential. As the importance of the instructional design becomes ever more clear, an objective assessment tool would be valuable for educators and researchers. Therefore, we aimed to develop an evidence-based and objective assessment tool for the evaluation of the instructional design of simulation-based team training courses. Methods: A validation study in which we developed an assessment tool containing an evidence-based questionnaire with Visual Analogue Scale (VAS) and a visual chart directly translating the results of the questionnaire. Psychometric properties of the assessment tool were tested using five descriptions of simulation-based team training courses. An expert-opinion-based ranking from poor to excellent was obtained. Ten independent raters assessed the five training courses twice, by using the developed questionnaire with an interval of 2 weeks. Validity and reliability analyses were performed by using the scores from the raters and comparing them with the expert's ranking. Usability was assessed by an 11-item survey. Results: A 42-item questionnaire, using VAS, and a propeller chart were developed. The correlation between the expert-opinion-based ranking and the evaluators' scores (Spearman correlation) was 0.95, and the variance due to subjectivity of raters was 3.5% (VTraining*Rater). The G-coefficient was 0.96. The inter-rater reliability (intraclass correlation coefficient (ICC)) was 0.91 (95% CI 0.77 to 0.99), and intra-rater reliability for the overall score (ICC) was ranging from 0.91 to 0.99. Conclusions: We developed an evidence-based and reliable assessment tool for the evaluation of the instructional design of a simulation-based team training: the ID-SIM. The ID-SIM is available as a free mobile application.

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability.

Risk factors of incomplete Apgar score and umbilical cord blood gas analysis: a retrospective observational study.

OBJECTIVE: To investigate whether incomplete umbilical cord blood gas (UCBG) analysis occurs more often than the incomplete reporting of the Apgar score, and risk factors associated with the incomplete values. METHODS: A total of 8824 infants born alive after 26 weeks' gestation between January 2009 and April 2013 were included. We extracted data on five-minute Apgar score, UCBG analysis, gestational age, mode of delivery, time of delivery and multiple pregnancy. Univariate and multivariable logistic regression analyses were performed. RESULTS: Five-minute Apgar score was incomplete in 15 cases (0.2%) and UCBG analysis in 1960 cases (22.2%), p < 0.05. Incomplete UCBG analysis was significantly more likely to occur in situations with Apgar score below seven (Odds ratio (OR) 1.68, 95% CI;1.29-2.19), gestational age between 26 to 27 6/7 and 28 to 31 6/7 weeks (OR 3.14, 95% CI; 2.13-4.62 and OR 1.91, 95% CI; 1.57-2.32), cesarean section (OR 1.31, 95% CI; 1.11-1.55), and multiple pregnancy (OR 2.02, 95% CI; 1.69-2.43). Deliveries during night time had a lower risk of incomplete UCBG analysis (OR 0.78, 95% CI; 0.69-0.88). CONCLUSIONS: Measuring five-minute Apgar score generated less incomplete data compared with UCBG analysis. The risk factors associated with incomplete UCBG analysis were noted. Study outcomes with UCBG analysis as neonatal assessment tool should be interpreted with caution.

The Effect of Multiprofessional Simulation-Based Obstetric Team Training on Patient-Reported Quality of Care: A Pilot Study.

INTRODUCTION: This study aimed to explore whether multiprofessional simulation-based obstetric team training improves patient-reported quality of care during pregnancy and childbirth. METHODS: Multiprofessional teams from a large obstetric collaborative network in the Netherlands were trained in teamwork skills using the principles of crew resource management. Patient-reported quality of care was measured with the validated Pregnancy and Childbirth Questionnaire (PCQ) at 6 weeks postpartum. Before the training, 76 postpartum women (sample I) completed the questionnaire 6 weeks postpartum. Three months after the training, another sample of 68 postpartum women (sample II) completed the questionnaire. RESULTS: In sample II (after the training), the mean (SD) score of 108.9 (10.9) on the PCQ questionnaire was significantly higher than the score of 103.5 (11.6) in sample I (before training) (t = 2.75, P = 0.007). The effect size of the increase in PCQ total score was 0.5. Moreover, the subscales "personal treatment during pregnancy" and "educational information" showed a significant increase after the team training (P < 0.001). Items with the largest increase in mean scores included communication between health care professionals, clear leadership, involvement in planning, and better provision of information. CONCLUSIONS: Despite the methodological restrictions of a pilot study, the preliminary results indicate that multiprofessional simulation-based obstetric team training seems to improve patient-reported quality of care. The possibility that this improvement relates to the training is supported by the fact that the items with the largest increase are about the principles of crew resource management, used in the training.

[Unannounced simulation of obstetric emergencies: safe for medical staff?]. / Onaangekondigde simulatie op de verloskamer: veilig voor de zorgverlener?

Management of obstetric emergencies is difficult to learn in real life due to the rarity of emergency events. Simulation-based medical education (SBME) has been shown to be a useful training method. A safe learning environment is a crucial condition for successful, applicable SBME. It is therefore essential to understand how SBME is perceived by healthcare professionals. A study by Sørensen et al. published recently in Postgraduate Medical Journal found that the number of staff members with positive perceptions increased after unannounced in situ simulation of obstetric emergencies. However, the number of staff who viewed the simulation as stressful also increased, especially among midwives. Although this study had some limitations, these results should be taken seriously. Randomised trials are warranted to explore the perceptions of healthcare professionals with regard to SBME.

The impact of transmural multiprofessional simulation-based obstetric team training on perinatal outcome and quality of care in the Netherlands.

BACKGROUND: Perinatal mortality and morbidity in the Netherlands is relatively high compared to other European countries. Our country has a unique system with an independent primary care providing care to low-risk pregnancies and a secondary/tertiary care responsible for high-risk pregnancies. About 65% of pregnant women in the Netherlands will be referred from primary to secondary care implicating multiple medical handovers. Dutch audits concluded that in the entire obstetric collaborative network process parameters could be improved. Studies have shown that obstetric team training improves perinatal outcome and that simulation-based obstetric team training implementing crew resource management (CRM) improves team performance. In addition, deliberate practice (DP) improves medical skills. The aim of this study is to analyse whether transmural multiprofessional simulation-based obstetric team training improves perinatal outcome. METHODS/DESIGN: The study will be implemented in the south-eastern part of the Netherlands with an annual delivery rate of over 9,000. In this area secondary care is provided by four hospitals. Each hospital with referring primary care practices will form a cluster (study group). Within each cluster, teams will be formed of different care providers representing the obstetric collaborative network. CRM and elements of DP will be implemented in the training. To analyse the quality of care as perceived by patients, the Pregnancy and Childbirth Questionnaire (PCQ) will be used. Furthermore, self-reported collaboration between care providers will be assessed. Team performance will be measured by the Clinical Teamwork Scale (CTS). We employ a stepped-wedge trial design with a sequential roll-out of the trainings for the different study groups.Primary outcome will be perinatal mortality and/or admission to a NICU. Secondary outcome will be team performance, quality of care as perceived by patients, and collaboration among care providers. CONCLUSION: The effect of transmural multiprofessional simulation-based obstetric team training on perinatal outcome has never been studied. We hypothesise that this training will improve perinatal outcome, team performance, and quality of care as perceived by patients and care providers. TRIAL REGISTRATION: The Netherlands National Trial Register, http://www.trialregister.nl/NTR4576, registered June 1, 2014.