Advanced Modular Manikin and Surgical Team Experience During a Trauma Simulation: Results of a Single-Blinded Randomized Trial.

BACKGROUND: Our aim was assess whether an integrated Advanced Modular Manikin (AMM) provides improved participant experience compared with use of peripheral simulators alone during a standardized trauma team scenario. Simulation-based team training has been shown to improve team performance. To address limitations of existing manikin simulators, the AMM platform was created that enables interconnectedness, interoperability, and integration of multiple simulators ("peripherals") into an adaptable, comprehensive training system. METHODS: A randomized single-blinded, crossover study with 2 conditions was used to assess learner experience differences when using the integrated AMM platform vs peripheral simulators. First responders, anesthesiologists, and surgeons rated their experience and workload with the conditions in a 3-scene standardized trauma scenario. Participant ratings were compared and focus groups conducted to obtain insight into participant experience. RESULTS: Fourteen teams (n = 42) participated. Team experience ratings were higher for the integrated AMM condition compared with peripherals (Cohen's d = .25, p = 0.016). Participant experience varied by background with surgeons and first responders rating their experience significantly higher compared with anesthesiologists (p < 0.001). Higher workload ratings were observed with the integrated AMM condition (Cohen's d = .35, p = 0.014) driven primarily by anesthesiologist ratings. Focus groups revealed that participants preferred the integrated AMM condition based on its increased realism, physiologic responsiveness, and feedback provided on their interventions. CONCLUSIONS: This first comprehensive evaluation suggests that integration with the AMM platform provides benefits over individual peripheral simulators and has the potential to expand simulation-based learning opportunities and enhance learner experience, especially for surgeons.

The Advanced Modular Manikin Open Source Platform for Healthcare Simulation.

INTRODUCTION: Current thinking in healthcare education stipulates a holistic approach with a focus on patient management, bringing together technical skills, decision-making, and team performance. In parallel, training opportunities with actual patients have diminished, and the number of different interventions to master has increased. Training on simulators has become broadly accepted; however, requirements for such training devices have outpaced the development of new simulators. The Department of Defense (DoD) targeted this gap with a development challenge. This article introduces the Advanced Modular Manikin (AMM) platform and describes the path followed to address the challenge. MATERIALS AND METHODS: Under Contract # W81XWH-14-C-0101, our interdisciplinary team of healthcare providers, educators, engineers, and scientists, together with partners in industry and the government collaborated to establish a set of comprehensive requirements and develop an overarching system architecture and specifications to meet healthcare simulation needs. In order to instantiate the architecture and investigate usability of the platform, a demonstration modular manikin was created that incorporated physical and digital peripherals. RESULTS: The system architecture and corresponding data models have been completed and published as open source. A developer's tool kit has been created, including instructional materials and required hardware and software for interested parties to develop AMM-compatible modules. A reference manikin was created based on the platform specifications and successfully supported a usability study that was performed by the American College of Surgeons, Education Division at the Naval Medical Center San Diego. CONCLUSIONS: The formal release of a functional modular, interoperable open-source healthcare simulation platform is complete. Next steps involve a strategy for maintaining the open standards and verification of AMM-compatibility for modules. Increasing awareness of this powerful tool and prioritization of module-development to address the wide range of healthcare education needs could lead to a renaissance in military and civilian healthcare simulation-based training.

An approach to value-based simulator selection: The creation and evaluation of the simulator value index tool.

BACKGROUND: Currently there is no reliable, standardized mechanism to support health care professionals during the evaluation of and procurement processes for simulators. A tool founded on best practices could facilitate simulator purchase processes. METHODS: In a 3-phase process, we identified top factors considered during the simulator purchase process through expert consensus (n = 127), created the Simulator Value Index (SVI) tool, evaluated targeted validity evidence, and evaluated the practical value of this SVI. A web-based survey was sent to simulation professionals. Participants (n = 79) used the SVI and provided feedback. We evaluated the practical value of 4 tool variations by calculating their sensitivity to predict a preferred simulator. RESULTS: Seventeen top factors were identified and ranked. The top 2 were technical stability/reliability of the simulator and customer service, with no practical differences in rank across institution or stakeholder role. Full SVI variations predicted successfully the preferred simulator with good (87%) sensitivity, whereas the sensitivity of variations in cost and customer service and cost and technical stability decreased (≤54%). The majority (73%) of participants agreed that the SVI was helpful at guiding simulator purchase decisions, and 88% agreed the SVI tool would help facilitate discussion with peers and leadership. CONCLUSION: Our findings indicate the SVI supports the process of simulator purchase using a standardized framework. Sensitivity of the tool improved when factors extend beyond traditionally targeted factors. We propose the tool will facilitate discussion amongst simulation professionals dealing with simulation, provide essential information for finance and procurement professionals, and improve the long-term value of simulation solutions. Limitations and application of the tool are discussed.

A New Design for Airway Management Training with Mixed Reality and High Fidelity Modeling.

Restoring airway function is a vital task in many medical scenarios. Although various simulation tools have been available for learning such skills, recent research indicated that fidelity in simulating airway management deserves further improvements. In this study, we designed and implemented a new prototype for practicing relevant tasks including laryngoscopy, intubation and cricothyrotomy. A large amount of anatomical details or landmarks were meticulously selected and reconstructed from medical scans, and 3D-printed or molded to the airway intervention model. This training model was augmented by virtually and physically presented interactive modules, which are interoperable with motion tracking and sensor data feedback. Implementation results showed that this design is a feasible approach to develop higher fidelity airway models that can be integrated with mixed reality interfaces.

Development and validation of a basic arthroscopy skills simulator.

PURPOSE: The purpose of our study was to develop a low-fidelity surgical simulator for basic arthroscopic skills training, with the goal of creating a pretrained novice ready with the basic skills necessary for all joint arthroscopic procedures. METHODS: A panel of education, arthroscopy, and simulation experts designed and evaluated a basic arthroscopic skills training and testing box. Task deconstruction was used to create 2 modules, which incorporate core skills common to all arthroscopic procedures. Core metrics measured were time to completion, number of trials to steady state, and number of errors. Face validity was evaluated using a questionnaire. Construct validity was examined by comparing 8 medical students with 8 expert orthopaedic surgeons. RESULTS: Surgeons were faster than students on both module 1 (P = .0013), simulating triangulation skills, and module 2 (P = .0190) simulating object manipulation skills. Surgeons demonstrated fewer errors (6.9 errors versus 28.1; P = .0073). All surgeons were able to demonstrate steady state (i.e., perform 2 trials that were within 10% of each other for time to completion and errors) on both modules within 3 trials on each module. Only 2 novices were able to demonstrate steady state on either module, and both did so within 3 trials. Furthermore, face validity of the skills trainer was shown by the expert arthroscopists. CONCLUSIONS: We describe a basic arthroscopy skills simulator that has face and construct validity. Our expert panel was able to design a simulator that differentiated between experienced arthroscopists and novices. CLINICAL RELEVANCE: Surgical simulation is an important part of efficient surgical education. This simulator shows good construct and face validity and provides a low-fidelity option for teaching the entry-level arthroscopist.

Training and simulation for patient safety.

BACKGROUND: Simulation-based medical education enables knowledge, skills and attitudes to be acquired for all healthcare professionals in a safe, educationally orientated and efficient manner. Procedure-based skills, communication, leadership and team working can be learnt, be measured and have the potential to be used as a mode of certification to become an independent practitioner. RESULTS: Simulation-based training initially began with life-like manikins and now encompasses an entire range of systems, from synthetic models through to high fidelity simulation suites. These models can also be used for training in new technologies, for the application of existing technologies to new environments and in prototype testing. The level of simulation must be appropriate to the learners' needs and can range from focused tuition to mass trauma scenarios. The development of simulation centres is a global phenomenon which should be encouraged, although the facilities should be used within appropriate curricula that are methodologically sound and cost-effective. DISCUSSION: A review of current techniques reveals that simulation can successfully promote the competencies of medical expert, communicator and collaborator. Further work is required to develop the exact role of simulation as a training mechanism for scholarly skills, professionalism, management and health advocacy.

A unified approach to validation, reliability, and education study design for surgical technical skills training.

OBJECTIVE: To present modern educational psychology theory and apply these concepts to validity and reliability of surgical skills training and assessment. DESIGN: In a series of cross-disciplinary meetings, we applied a unified approach of behavioral science principles and theory to medical technical skills education given the recent advances in the theories in the field of behavioral psychology and statistics. CONCLUSIONS: While validation of the individual simulation tools is important, it is only one piece of a multimodal curriculum that in and of itself deserves examination and study. We propose concurrent validation throughout the design of simulation-based curriculum rather than once it is complete. We embrace the concept that validity and curriculum development are interdependent, ongoing processes that are never truly complete. Individual predictive, construct, content, and face validity aspects should not be considered separately but as interdependent and complementary toward an end application. Such an approach could help guide our acceptance and appropriate application of these exciting new training and assessment tools for technical skills training in medicine.

Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures.

BACKGROUND: Minimally invasive surgery (MIS) has introduced a new and unique set of psychomotor skills for a surgeon to acquire and master. Although assessment technologies have been proposed, precise and objective psychomotor skills assessment of surgeons performing laparoscopic procedures has not been detailed. STUDY DESIGN: Two hundred ten surgeons attending the 2001 annual meeting of the American College of Surgeons in New Orleans who reported having completed more than 50 laparoscopic procedures participated. Subjects were required to complete one box-trainer laparoscopic cutting task and a similar virtual reality task. These tasks were specifically designed to test only psychomotor and not cognitive skills. Both tasks were completed twice. Performance of tasks was assessed and analyzed. Demographic and laparoscopic experience data were also collected. RESULTS: Complete data were available on 195 surgeons. In this group, surgeons performed the box-trainer task better with their dominant hand (p < 0.0001) and there was a strong and statistically significant correlation between trials (r = 0.47 - 0.64, p < 0.0001). After transforming raw data to z-scores (mean = 0 and SD = 1) it was shown that between 2% and 12% of surgeons performed more than two standard deviations from the mean. Some surgeons' performance was 20 standard deviations from the mean. Minimally Invasive Surgical Trainer Virtual Reality metrics demonstrated high measurement consistency as assessed by coefficient alpha (alpha = 0.849). CONCLUSIONS: Objective assessment of laparoscopic psychomotor skills is now possible. Surgeons who had performed more than 50 laparoscopic procedures showed considerable variability in their performance on a simple laparoscopic and virtual reality task. Approximately 10% of surgeons tested performed the task significantly worse than the group's average performance. Studies such as this may form the methodology for establishing criteria levels and performance objectives in objective assessment of the technical skills component of determining surgical competence.