The Effects of a Digital Game Simulator versus a Traditional Intervention on Paramedics' Neonatal Resuscitation Performance.

Neonatal resuscitation is a skill set that comprises procedures, assessment, decision-making, communication, and teamwork. It is used in an emergency situation in the delivery room with the aim of supporting newborn infants who are not able to begin breathing on their own. Thus, healthcare providers need to refresh their neonatal resuscitation skills periodically, according to the Neonatal Resuscitation Program, to ensure that they can react quickly and effectively in emergency situations. The RETAIN digital game simulator was designed to enable healthcare providers to practice their neonatal resuscitation skills. To evaluate the effectiveness of this game in a laboratory setting, a randomized control trial sampled 42 paramedics who completed a pre-test, were randomly assigned to watch a traditional lecture video on the neonatal resuscitation procedure or to play a novel digital game simulation on the same topic, and then completed a following test. A two-way mixed ANOVA revealed a statistically significant improvement in paramedics' neonatal resuscitation performance over time, which did not differ between conditions. Thus, digital games can provide an enjoyable alternative to traditional practices in refreshing neonatal resuscitation knowledge.

Using machine learning to predict UK and Japanese secondary students' life satisfaction in PISA 2018.

BACKGROUND: Life satisfaction is a key component of students' subjective well-being due to its impact on academic achievement and lifelong health. Although previous studies have investigated life satisfaction through different lenses, few of them employed machine learning (ML) approaches. OBJECTIVE: Using ML algorithms, the current study predicts secondary students' life satisfaction from individual-level variables. METHOD: Two supervised ML models, random forest (RF) and k-nearest neighbours (KNN), were developed based on the UK data and the Japan data in PISA 2018. RESULTS: Findings show that (1) both models yielded better performance on the UK data than on the Japanese data; (2) the RF model outperformed the KNN model in predicting students' life satisfaction; (3) meaning in life, student competition, teacher support, exposure to bullying and ICT resources at home and at school played important roles in predicting students' life satisfaction. CONCLUSIONS: Theoretically, this study highlights the multi-dimensional nature of life satisfaction and identifies several key predictors. Methodologically, this study is the first to use ML to explore the predictors of life satisfaction. Practically, it serves as a reference for improving secondary students' life satisfaction.

Predicting pre-service teachers' computational thinking skills using machine learning classifiers.

Computational thinking (CT) skills of pre-service teachers have been explored extensively, but the effectiveness of CT training has yielded mixed results in previous studies. Thus, it is necessary to identify patterns in the relationships between predictors of CT and CT skills to further support CT development. This study developed an online CT training environment as well as compared and contrasted the predictive capacity of four supervised machine learning algorithms in classifying the CT skills of pre-service teachers using log data and survey data. First, the results show that Decision Tree outperformed K-Nearest Neighbors, Logistic Regression, and Naive Bayes in predicting pre-service teachers' CT skills. Second, the participants' time spent on CT training, prior CT skills, and perceptions of difficulty regarding the learning content were the top three important predictors in this model.

Online engagement and performance on formative assessments mediate the relationship between attendance and course performance.

In traditional school-based learning, attendance was regarded as a proxy for engagement and key indicator for performance. However, few studies have explored the effect of in-class attendance in technology-enhanced courses that are increasingly provided by secondary institutions. This study collected n = 367 undergraduate students' log files from Moodle and applied learning analytics methods to measure their lecture attendance, online learning activities, and performance on online formative assessments. A baseline and an alternative structural equation models were used to investigate whether online learning engagement and formative assessment mediated the relationship between lecture attendance and course academic outcomes. Results show that lecture attendance does not have a direct effect on academic outcomes, but it promotes performance by leveraging online learning engagement and formative assessment performance. Findings contribute to understanding the impact of in-class attendance on course academic performance and the interplay of in-class and online-learning engagement factors in the context of technology-enhanced courses. This study recommends using a variety of educational technologies to pave multiple pathways to academic success. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41239-021-00307-5.

Health Care Providers' Performance, Mindset, and Attitudes Toward a Neonatal Resuscitation Computer-Based Simulator: Empirical Study.

BACKGROUND: Neonatal resuscitation involves a complex sequence of actions to establish an infant's cardiorespiratory function at birth. Many of these responses, which identify the best action sequence in each situation, are taught as part of the recurrent Neonatal Resuscitation Program training, but they have a low incidence in practice, which leaves health care providers (HCPs) less prepared to respond appropriately and efficiently when they do occur. Computer-based simulators are increasingly used to complement traditional training in medical education, especially in the COVID-19 pandemic era of mass transition to digital education. However, it is not known how learners' attitudes toward computer-based learning and assessment environments influence their performance. OBJECTIVE: This study explores the relation between HCPs' attitudes toward a computer-based simulator and their performance in the computer-based simulator, RETAIN (REsuscitation TrAINing), to uncover the predictors of performance in computer-based simulation environments for neonatal resuscitation. METHODS: Participants were 50 neonatal HCPs (45 females, 4 males, 1 not reported; 16 respiratory therapists, 33 registered nurses and nurse practitioners, and 1 physician) affiliated with a large university hospital. Participants completed a demographic presurvey before playing the game and an attitudinal postsurvey after completing the RETAIN game. Participants' survey responses were collected to measure attitudes toward the computer-based simulator, among other factors. Knowledge on neonatal resuscitation was assessed in each round of the game through increasingly difficult neonatal resuscitation scenarios. This study investigated the moderating role of mindset on the association between the perceived benefits of understanding the terminology used in the computer-based simulator, RETAIN, and their performance on the neonatal resuscitation tasks covered by RETAIN. RESULTS: The results revealed that mindset moderated the relation between participants' perceived terminology used in RETAIN and their actual performance in the game (F3,44=4.56, R2=0.24, adjusted R2=0.19; P=.007; estimate=-1.19, SE=0.38, t44=-3.12, 95% CI -1.96 to -0.42; P=.003). Specifically, participants who perceived the terminology useful also performed better but only when endorsing more of a growth mindset; they also performed worse when endorsing more of a fixed mindset. Most participants reported that they enjoyed playing the game. The more the HCPs agreed that the terminology in the tutorial and in the game was accessible, the better they performed in the game, but only when they reported endorsing a growth mindset exceeding the average mindset of all the participants (F3,44=6.31, R2=0.30, adjusted R2=0.25; P=.001; estimate=-1.21, SE=0.38, t44=-3.16, 95% CI -1.99 to -0.44; P=.003). CONCLUSIONS: Mindset moderates the strength of the relationship between HCPs' perception of the role that the terminology employed in a game simulator has on their performance and their actual performance in a computer-based simulator designed for neonatal resuscitation training. Implications of this research include the design and development of interactive learning environments that can support HCPs in performing better on neonatal resuscitation tasks.

Using the RETAIN Tabletop Simulator as a Summative Assessment Tool for Neonatal Resuscitation Healthcare Professionals: A Pilot Study.

Background: Frequent and objective summative assessment of neonatal healthcare providers is important to ensure high-quality care to patients during neonatal resuscitation. Currently, neonatal resuscitation providers are only individually assessed using an at-home online multiple-choice questionnaire. While simulation-based assessment is preferred, resource constraints limit its widespread uptake. An alternative approach to simulation-based summative assessment is needed. Simulation-based serious games may provide a solution. Objective: The aim of this study was to examine if individual performance on the RETAIN (REsuscitation TrAINing for healthcare professionals) tabletop simulator can be used as a summative assessment of neonatal resuscitation providers, regardless of their prior board game experience. Method: Neonatal healthcare providers were recruited from a tertiary perinatal center to complete a (1) demographic pre-survey, (2) neonatal resuscitation scenario using an open-answer written pre-test, (3) neonatal resuscitation scenario using the RETAIN tabletop simulator, and (4) post-survey measuring usage and attitudes toward board games. Multiple linear regression analyses using the Johnson-Neyman technique were conducted in R to probe the moderation effect of years of board game on the relationship between pre-test and game performance. Results: Twenty Neonatal Resuscitation Program-trained healthcare providers (nurses, nurse practitioners, respiratory therapists, and fellows) were recruited for this study (n = 19 females). Participants' mean (standard deviation) pre-test score was 8.35 (1.81) out of a total 16 possible points (52%) and a score of 18 (4.41) out of a total of 40 possible points (45%) using RETAIN. Overall board game experience was 22.5 (12.6) years. Finally, years of board game moderated significantly the relation between the pre-test and game performance (B = -0.13, SE = 0.05, beta = -0.48, t = -2.77, p < 0.05; 95% CI [-0.24, -0.03]). Thus, participants' performance on the two tests (written and simulator) was significantly positively associated, but only for those who reported fewer than 21.5 years of board game experience. Conclusion: This study reports the preliminary results of a pilot study, indicating that the RETAIN tabletop simulator could be used as a simulation-based summative assessment, an enjoyable, low-cost alternative to traditional assessment approaches. RETAIN offers a solution to the need for more frequent and continued assessment of neonatal resuscitation providers.

Unsupervised Machine Learning Algorithms Examine Healthcare Providers' Perceptions and Longitudinal Performance in a Digital Neonatal Resuscitation Simulator.

Background: Frequent simulation-based education is recommended to improve health outcomes during neonatal resuscitation but is often inaccessible due to time, resource, and personnel requirements. Digital simulation presents a potential alternative; however, its effectiveness and reception by healthcare professionals (HCPs) remains largely unexplored. Objectives: This study explores HCPs' attitudes toward a digital simulator, technology, and mindset to elucidate their effects on neonatal resuscitation performance in simulation-based assessments. Methods: The study was conducted from April to August 2019 with 2-month (June-October 2019) and 5-month (September 2019-January 2020) follow-up at a tertiary perinatal center in Edmonton, Canada. Of 300 available neonatal HCPs, 50 participated. Participants completed a demographic survey, a pretest, two practice scenarios using the RETAIN neonatal resuscitation digital simulation, a posttest, and an attitudinal survey (100% response rate). Participants repeated the posttest scenario in 2 months (86% response rate) and completed another posttest scenario using a low-fidelity, tabletop simulator (80% response rate) 5 months after the initial study intervention. Participants' survey responses were collected to measure attitudes toward digital simulation and technology. Knowledge was assessed at baseline (pretest), acquisition (posttest), retention (2-month posttest), and transfer (5-month posttest). Results: Fifty neonatal HCPs participated in this study (44 females and 6 males; 27 nurses, 3 nurse practitioners, 14 respiratory therapists, and 6 doctors). Most participants reported technology in medical education as useful and beneficial. Three attitudinal clusters were identified by a hierarchical clustering algorithm based on survey responses. Although participants exhibited diverse attitudinal paths, they all improved neonatal resuscitation performance after using the digital simulator and successfully transferred their knowledge to a new medium. Conclusions: Digital simulation improved HCPs' neonatal resuscitation performance. Medical education may benefit by incorporating technology during simulation training.

Simulation-Based Summative Assessment of Neonatal Resuscitation Providers Using the RETAIN Serious Board Game-A Pilot Study.

Background: Each year, 13-26 million newborn babies require help to breathe at birth. Healthcare professionals (HCPs) who provide neonatal resuscitative care must be frequently evaluated to maintain and improve the quality of healthcare delivered. While simulation-based competence assessment is preferred, resource constraints hinder uptake. We aimed to examine if the RETAIN simulation-based boardgame can be used to assess HCPs' neonatal resuscitation knowledge. Method: Twenty neonatal HCPs (19 females) from the Royal Alexandra Hospital (Edmonton, Canada) were recruited. First, they completed an open-answer written test of one neonatal resuscitation scenario. Then, they completed one neonatal resuscitation scenario of difficulty comparable to that of the open-answer written test, but this time using the RETAIN board game. In the RETAIN board game (https://playretain.com, RETAIN Labs Medical Inc, Edmonton, Canada), players perform simulated neonatal resuscitation scenarios based on real-life cases, using action cards, and equipment pieces. Sessions were video-recorded and scored using Neonatal Resuscitation Program 2015 guidelines. Data are reported as mean (standard deviation) for normally distributed continuous variables, and as median (interquartile range) for non-normal continuous variables. Results: Participants consisted of the following HCPs: 8 nurses, 4 respiratory therapists, 4 nurse practitioners, and 4 neonatal fellows with median (IQR) 10.5(3-17) years of clinical experience. Overall mean (SD) Open-answer test and Game Performance was 8.6(2.1) out of 16 possible points (53%) and 29(3.2) out of 40 possible points (74%), respectively. Out of the 10 actions shared between the open-answer test and game scenario, performance on the open-answer test was mean (SD) 7.2(1.3) (72%) and game performance was mean (SD) 8.8(1.4) (88%) (V = 17, p < 0.01). Conclusion: RETAIN may provide an enjoyable and standardized alternative toward summative assessment of neonatal resuscitation providers. RETAIN may be used to improve more frequent and ubiquitous uptake of simulation-based competence assessment in healthcare settings.

Mindset Moderates Healthcare Providers' Longitudinal Performance in a Digital Neonatal Resuscitation Simulator.

Background: Simulation education can benefit healthcare providers (HCPs) by providing opportunities to practice complex neonatal-resuscitation tasks in low-stake environments. To our knowledge, no study investigated the role of growth mindset on longitudinal performance on neonatal resuscitation before and after simulation-based training. Objectives: This study examines whether 1) the RETAIN digital/table-top simulators facilitate HCPs' neonatal resuscitation knowledge gain, retention, and transfer and 2) growth mindset moderates HCPs' longitudinal performance in neonatal resuscitation. Methods: Participants were n = 50 HCPs in a tertiary perinatal center in Edmonton, Canada. This longitudinal study was conducted in three stages including 1) a pretest and a mindset survey, immediately followed by a posttest using the RETAIN digital simulator from April to August 2019; 2) a 2-month delayed posttest using the same RETAIN neonatal resuscitation digital simulator from June to October 2019; and 3) a 5-month delayed posttest using the low-fidelity table-top neonatal resuscitation digital simulator from September 2019 to January 2020. Three General Linear Mixed Model (GLMM) repeated-measure analyses investigated HCPs' performance on neonatal resuscitation over time and the moderating effect of growth mindset on the association between test time points and task performance. Results: Compared with their pretest performance, HCPs effectively improved their neonatal resuscitation knowledge after the RETAIN digital simulation-based training on the immediate posttest (Est = 1.88, p < 0.05), retained their knowledge on the 2-month delayed posttest (Est = 1.36, p < 0.05), and transferred their knowledge to the table-top simulator after 5 months (Est = 2.01, p < 0.05). Although growth mindset did not moderate the performance gain from the pretest to the immediate posttest, it moderated the relationship between HCPs' pretest and long-term knowledge retention (i.e., the interaction effect of mindset and the 2-month posttest was significant: Est = 0.97, p < 0.05). The more they endorsed a growth mindset, the better the HCPs performed on the posttest, but only when they were tested after 2 months. Conclusions: Digital simulators for neonatal resuscitation training can effectively facilitate HCPs' knowledge gain, maintenance, and transfer. Besides, growth mindset shows a positive moderating effect on the longitudinal performance improvement in simulation-based training. Future research can be conducted to implement growth-mindset interventions promoting more effective delivery of technology-enhanced, simulation-based training and assessment.

Digital Simulation Improves, Maintains, and Helps Transfer Health-Care Providers' Neonatal Resuscitation Knowledge.

Purpose: To safely care for their newborn patients, health-care professionals (HCP) must undergo frequent training to improve and maintain neonatal resuscitation knowledge and skills. However, the current approach to neonatal resuscitation simulation training is time and resource-intensive, and often inaccessible. Digital neonatal resuscitation simulation may present a convenient alternative for more frequent training. Method: Fifty neonatal HCPs participated in the study (44 female; 27 nurses, 3 nurse practitioners, 14 respiratory therapists, 6 doctors). This study was conducted at a tertiary perinatal center in Edmonton, Canada from April-August 2019, with 2-month (June-October 2019) and 5-month (September 2019-January 2020) follow-up. Neonatal HCPs were recruited by volunteer sampling to complete a demographic survey, pre-test (baseline knowledge), two digital simulation scenarios (intervention), and post-test (knowledge acquisition). Two months later, participants repeated the post-test (knowledge retention). Five months after the initial intervention, participants completed a post-test using a table-top simulation (knowledge transfer). Longitudinal analyses were used to compare participants' performance over time. Results: Overall the proportion of correct performance increased: 21/50 (42%) passed the pre-test, 39/50 (78%) the post-test, 30/43 (70%) the 2-month post-test, and 32/40 (80%) the 5-month post-test. GLMM and GEE analyses revealed that performance on all post-tests was significantly better than the performance on the pre-test. Therefore, training with the RETAIN digital simulation effectively improves, maintains, and transfers HCPs' neonatal resuscitation knowledge. Conclusions: Digital simulation improved, maintained, and helped transfer HCPs' neonatal resuscitation knowledge over time. Digital simulation presents a promising approach for frequent neonatal resuscitation training, particularly for distance-learning applications.

Serious games, a game changer in teaching neonatal resuscitation? A review.

BACKGROUND: Neonatal healthcare professionals require frequent simulation-based education (SBE) to improve their cognitive, psychomotor and communication skills during neonatal resuscitation. However, current SBE approaches are resource-intensive and not routinely offered in all healthcare facilities. Serious games (board and computer based) may be effective and more accessible alternatives. OBJECTIVE: To review the current literature about serious games, and how these games might improve knowledge retention and skills in neonatal healthcare professionals. METHOD: Literature searches of PubMed, Google Scholar, Cochrane Central Register of Controlled Trials, CINAHL, Web of Science and EMBASE databases were performed to identify studies examining serious games in neonatology. All games, such as board games, tabletop games, video games, screen-based simulators, tabletop simulators and virtual reality games were included. RESULTS: Twelve serious games were included in this review (four board games, five video games and three virtual reality games). Overall, knowledge improvement was reported for the RETAIN (REsuscitationTrAINing for healthcare professionals) board game (10% increase in knowledge retention) and The Neonatology Game (4.15 points higher test score compared with control). Serious games are increasingly incorporated into Nursing and Medical School Curriculums to reinforce theoretical and practical learning. CONCLUSIONS: Serious games have the potential to improve healthcare professionals' knowledge, skills and adherence to the resuscitation algorithm and could enhance access to SBE in resource-intensive and resource-limited areas. Future research should examine important clinical outcomes in newborn infants.

Eye Tracking the Feedback Assigned to Undergraduate Students in a Digital Assessment Game.

High-quality feedback exerts a crucial influence on learning new skills and it is one of the most common psychological interventions. However, knowing how to deliver feedback effectively is challenging for educators in both traditional and online classroom environments. This study uses psychophysiological methodology to investigate attention allocation to different feedback valences (i.e., positive and negative feedback), as the eye tracker provides accurate information about individuals' locus of attention when they process feedback. We collected learning analytics via a behavioral assessment game and eye-movement measures via an eye tracker to infer undergraduate students' cognitive processing of feedback that is assigned to them after completing a task. The eye movements of n = 30 undergraduates at a university in Western Canada were tracked by the EyeLink 1000 Plus eye tracker while they played Posterlet, a digital game-based assessment. In Posterlet, students designed three posters and received critical (negative) or confirmatory (positive) feedback from virtual characters in the game after completing each poster. Analyses showed that, overall, students attended to critical feedback more than to confirmatory feedback, as measured by the time spent on feedback in total, per word, and per letter, and by the number of feedback fixations and revisits. However, there was no difference in dwell time between valences prior to any feedback revisits, suggesting that returning to read critical feedback more often than confirmatory feedback accounts for the overall dwell time difference between valences when feedback is assigned to students. The study summarizes the eye movement record on critical and confirmatory feedback, respectively. Implications of this research include enhancing our understanding of the differential temporal cognitive processing of feedback valences that may ultimately improve the delivery of feedback.

Feedback Valence Agency Moderates the Effect of Pre-service Teachers' Growth Mindset on the Relation Between Revising and Performance.

It is often assumed that having a choice in the learning process may benefit performance and learning. Concomitantly, it is believed that learning choices (e.g., seeking critical or confirmatory feedback) are due to mindset. However, the relation between choices and mindset is still a matter of debate: it is not known whether mindset interferes with the decision to seek critical feedback, the response to critical feedback, or both. This experiment investigates for the first time whether feedback valence agency moderates the effect of mindset on the relation between learning behaviors and learning outcomes. Participants were n = 120 pre-service teachers who were randomly assigned to one of two conditions, Choose (n = 68) and Assign (n = 52), and designed three posters in Posterlet, a game that assessed their learning behaviors (critical feedback and revising) and poster performance. Then, they completed a learning post-test that also included a mindset survey. Results reveal similar non-significant correlation patterns of mindset with learning behaviors and learning outcomes in both conditions. Feedback valence agency (i.e., condition) moderates the effect of growth mindset on the relation between revision and performance: students who choose to revise their posters more often (i.e., at least twice) perform significantly better when they endorse higher rather than lower levels of growth mindset but only when feedback valence is chosen rather than assigned. Theoretical implications indicate that feedback valence agency moderates the effect of growth mindset in driving how students respond to their own learning choices to improve their performance.

PROSPeCT: A Predictive Research Online System for Prostate Cancer Tasks.

PURPOSE: An online clinical information system, called Predictive Research Online System Prostate Cancer Tasks (PROSPeCT), was developed to enable users to query the Alberta Prostate Cancer Registry database hosted by the Alberta Prostate Cancer Research Initiative. To deliver high-quality patient treatment, prostate cancer clinicians and researchers require a user-friendly system that offers an easy and efficient way to obtain relevant and accurate information about patients from a robust and expanding database. METHODS: PROSPeCT was designed and implemented to make it easy for users to query the prostate cancer patient database by creating, saving, and reusing simple and complex definitions. We describe its intuitive nature by exemplifying the creation and use of a complex definition to identify a "high-risk" patient cohort. RESULTS: PROSPeCT was made to minimize user error and to maximize efficiency without requiring the user to have programming skills. Thus, it provides tools that allow both novice and expert users to easily identify patient cohorts, manage individual patient care, perform Kaplan Meier estimates, plot aggregate PSA views, compute PSA-doubling time, and visualize results. CONCLUSION: This report provides an overview of PROSPeCT, a system that helps clinicians to identify appropriate patient treatments and researchers to develop prostate cancer hypotheses, with the overarching goal of improving the quality of life of patients with prostate cancer. We have made available the code for the PROSPeCT implementation at https://github.com/max-uhlich/e-PROSPeCT .

RETAIN: A Board Game That Improves Neonatal Resuscitation Knowledge Retention.

Background: The current resuscitation guidelines recommend frequent simulation based medical education (SBME). However, the current SBME approach is expensive, time-intensive, and requires a specialized lab and trained instructors. Hence, it is not offered routinely at all hospitals. We designed the board game "RETAIN" to train healthcare providers (HCPs) in neonatal resuscitation in a cost-friendly and accessible way. Objectives: To examine if a board game-based training simulator improves knowledge retention in HCPs. Methods: "RETAIN" consists of a board using an image of a baby, visual objects, adjustable timer, monitors, and action cards. Neonatal HCPs at the Royal Alexandra Hospital were invited to participate. Participants completed a written pre-test (resuscitation of a 24-week infant), then played the board game (starting with a tutorial followed by free playing of three evidence-based neonatal resuscitation scenarios). Afterwards, a post-test with the same resuscitation scenario and an opinion survey was completed. The answers from the pre- and post-test were compared to assess HCPs' knowledge retention. Results: Thirty HCPs (four doctors, 12 nurses, and 14 respiratory therapist) participated in the study. Overall, we observed a 10% increase in knowledge retention between the pre- and post-test (49-59%, respectively). Temperature management showed the most knowledge gain between the pre- and post-test (14-46%, respectively). Placement of a hat (10-43%), plastic wrap (27-67%), and temperature probe (7-30%) improved between the pre- and post-test. Conclusion: Knowledge retention increased by 12% between pre- and post-test (49-61%, respectively). The improvement in performance and knowledge supports the use of board game simulations for clinical training.

Growth Mindset Moderates the Effect of the Neonatal Resuscitation Program on Performance in a Computer-Based Game Training Simulation.

This study examines for the first time the moderating role of growth mindset on the association between the time elapsed since participants' last refresher neonatal resuscitation program (NRP) course and their performance on neonatal resuscitation tasks in the RETAIN computer game training simulation. Participants were n = 50 health-care providers affiliated with a large university hospital. Results revealed that growth mindset moderated the relation between participants' task performance in the game and the time since their latest refresher NRP course. Specifically, participants who completed the course more recently (i.e., between 8 and 9 months before the current study) made significantly more mistakes in the game than the rest of the participants but only when they endorsed lower levels of growth mindset. Implications of this research include growth mindset interventions and increased screen time in simulation sessions that have the potential to help health-care providers achieve better performance on neonatal resuscitation clinical tasks.