Quantitative assessment and objective improvement of the accuracy of neurosurgical planning through digital patient-specific 3D models.

Objective: Neurosurgical patient-specific 3D models have been shown to facilitate learning, enhance planning skills and improve surgical results. However, there is limited data on the objective validation of these models. Here, we aim to investigate their potential for improving the accuracy of surgical planning process of the neurosurgery residents and their usage as a surgical planning skill assessment tool. Methods: A patient-specific 3D digital model of parasagittal meningioma case was constructed. Participants were invited to plan the incision and craniotomy first after the conventional planning session with MRI, and then with 3D model. A feedback survey was performed at the end of the session. Quantitative metrics were used to assess the performance of the participants in a double-blind fashion. Results: A total of 38 neurosurgical residents and interns participated in this study. For estimated tumor projection on scalp, percent tumor coverage increased (66.4 ± 26.2%-77.2 ± 17.4%, p = 0.026), excess coverage decreased (2,232 ± 1,322 mm2-1,662 ± 956 mm2, p = 0.019); and craniotomy margin deviation from acceptable the standard was reduced (57.3 ± 24.0 mm-47.2 ± 19.8 mm, p = 0.024) after training with 3D model. For linear skin incision, deviation from tumor epicenter significantly reduced from 16.3 ± 9.6 mm-8.3 ± 7.9 mm after training with 3D model only in residents (p = 0.02). The participants scored realism, performance, usefulness, and practicality of the digital 3D models very highly. Conclusion: This study provides evidence that patient-specific digital 3D models can be used as educational materials to objectively improve the surgical planning accuracy of neurosurgical residents and to quantitatively assess their surgical planning skills through various surgical scenarios.

Expectancy from, and acceptance of augmented reality in dental education programs: A structural equation model.

OBJECTIVE: Dental schools need hands-on training and feedback. Augmented reality (AR) and virtual reality (VR) technologies enable remote work and training. Education programs only partially integrated these technologies. For better technology integration, infrastructure readiness, prior-knowledge readiness, expectations, and learner attitudes toward AR and VR technologies must be understood together. Thus, this study creates a structural equation model to understand how these factors affect dental students' technology use. METHODS: A correlational survey was done. Four questionnaires were sent to 755 dental students from three schools. These participants were convenience-sampled. Surveys were developed using validity tests like explanatory and confirmatory factor analyses, Cronbach's ɑ, and composite reliability. Ten primary research hypotheses are tested with path analysis. RESULTS: A total of 81.22% responded to the survey (755 out of 930). Positive AR attitude, expectancy, and acceptance were endogenous variables. Positive attitudes toward AR were significantly influenced by two exogenous variables: infrastructure readiness (B = 0.359, ß = 0.386, L = 0.305, U = 0.457, p = 0.002) and prior-knowledge readiness (B = -0.056, ß = 0.306, L = 0.305, U = 0.457, p = 0.002). Expectancy from AR was affected by infrastructure, prior knowledge, and positive and negative AR attitudes. Infrastructure, prior-knowledge readiness, and positive attitude toward AR had positive effects on expectancy from AR (B = 0.201, ß = 0.204, L = 0.140, U = 0.267, p = 0.002). Negative attitude had a negative impact (B = -0.056, ß = -0.054, L = 0.091, U = 0.182, p = 0.002). Another exogenous variable was AR acceptance, which was affected by infrastructure, prior-knowledge preparation, positive attitudes, and expectancy. Significant differences were found in infrastructure, prior-knowledge readiness, positive attitude toward AR, and expectancy from AR (B = 0.041, ß = 0.046, L = 0.026, U = 0.086, p = 0.054). CONCLUSION: Infrastructure and prior-knowledge readiness for AR significantly affect positive AR attitudes. Together, these three criteria boost AR's potential. Infrastructure readiness, prior-knowledge readiness, positive attitudes toward AR, and AR expectations all increase AR adoption. The study provides insights that can help instructional system designers, developers, dental education institutions, and program developers better integrate these technologies into dental education programs. Integration can improve dental students' hands-on experience and program performance by providing training options anywhere and anytime.

A systematic review on classification and assessment of surgical skill levels for simulation-based training programs.

BACKGROUND: Nowadays, advances in medical informatics have made minimally invasive surgery (MIS) procedures the preferred choice. However, there are several problems with the education programs in terms of surgical skill acquisition. For instance, defining and objectively measuring surgical skill levels is a challenging process. Accordingly, the aim of this study is to conduct a literature review for an investigation of the current approaches for classifying the surgical skill levels and for identifying the skill training tools and measurement methods. MATERIALS AND METHODS: In this research, a search is conducted and a corpus is created. Exclusion and inclusion criteria are applied by limiting the number of articles based on surgical education, training approximations, hand movements, and endoscopic or laparoscopic operations. To satisfy these criteria, 57 articles are included in the corpus of this study. RESULTS: Currently used surgical skill assessment approaches have been summarized. Results show that various classification approaches for the surgical skill level definitions are being used. Besides, many studies are conducted by omitting particularly important skill levels in between. Additionally, some inconsistencies are also identified across the skill level classification studies. CONCLUSION: In order to improve the benefits of simulation-based training programs, a standardized interdisciplinary approach should be developed. For this reason, specific to each surgical procedure, the required skills should be identified. Additionally, appropriate measures for assessing these skills, which can be defined in simulation-based MIS training environments, should be refined. Finally, the skill levels gained during the developmental stages of these skills, with their threshold values referencing the identified measures, should be redefined in a standardized manner.

A user task design notation for improved software design.

System design is recognized as one of the most critical components of a software system that bridges system requirements and coding. System design also has a significant impact on testing and maintenance activities, and on further improvements during the lifespan of the software system. Software design should reflect all necessary components of the requirements in a clear and understandable manner by all stakeholders of the software system. To distinguish system elements, separation of concerns in software design is suggested. In this respect, identification of the user tasks, i.e., the tasks that need to be performed by the user, is not currently reflected explicitly in system design documents. Our main assumption in this study is that software quality can be improved significantly by clearly identifying the user tasks from those that need to be performed by the computer system itself. Additionally, what we propose has the potential to better reflect the user requirements and main objectives of the system on the software design and thereby to improve software quality. The main aim of this study is to introduce a novel notation for software developers in the frame of UML Activity Diagram (UML-AD) that enables designers to identify the user tasks and define them separately from the system tasks. For this purpose, an extension of UML-AD, named UML-ADE (UML-Activity Diagram Extended) was proposed. Afterwards, it was implemented in a serious game case for which the specification of user tasks is extremely important. Finally, its effectiveness was analyzed and compared to UML-AD experimentally with 72 participants. The defect detection performance of the participants on both diagrams with two real-life serious game scenarios was evaluated. Results show a higher level of understandability for those using UML-ADE, which in turn may indicate a better design and higher software quality. The results encourage researchers to develop specific design representations dedicated to task design to improve system quality and to conduct further evaluations of the impact of these design on each of the above mentioned potential benefits for the software systems.

Distinguishing Intermediate and Novice Surgeons by Eye Movements.

Surgical skill-level assessment is key to collecting the required feedback and adapting the educational programs accordingly. Currently, these assessments for the minimal invasive surgery programs are primarily based on subjective methods, and there is no consensus on skill level classifications. One of the most detailed of these classifications categorize skill levels as beginner, novice, intermediate, sub-expert, and expert. To properly integrate skill assessment into minimal invasive surgical education programs and provide skill-based training alternatives, it is necessary to classify the skill levels in as detailed a way as possible and identify the differences between all skill levels in an objective manner. Yet, despite the existence of very encouraging results in the literature, most of the studies have been conducted to better understand the differences between novice and expert surgical skill levels leaving out the other crucial skill levels between them. Additionally, there are very limited studies by considering the eye-movement behaviors of surgical residents. To this end, the present study attempted to distinguish novice- and intermediate-level surgical residents based on their eye movements. The eye-movement data was recorded from 23 volunteer surgical residents while they were performing four computer-based simulated surgical tasks under different hand conditions. The data was analyzed using logistic regression to estimate the skill levels of both groups. The best results of the estimation revealing a 91.3% recognition rate of predicting novice and intermediate surgical residents on one scenario were selected from four under the dominant hand condition. These results show that the eye-movements can be potentially used to identify surgeons with intermediate and novice skills. However, the results also indicate that the order in which the scenarios are provided, and the design of the scenario, the tasks, and their appropriateness with the skill levels of the participants are all critical factors to be considered in improving the estimation ratio, and hence require thorough assessment for future research.

The Effect of Training, Used-Hand, and Experience on Endoscopic Surgery Skills in an Educational Computer-Based Simulation Environment (ECE) for Endoneurosurgery Training.

Today, virtual simulation environments create alternative hands-on practice opportunities for surgical training. In order to increase the potential benefits of such environments, it is critical to understand the factors that influence them. This study was conducted to determine the effects of training, used-hand, and experience, as well as the interactions between these variables, on endoscopic surgery skills in an educational computer-based surgical simulation environment. A 2-hour computer-based endoneurosurgery simulation training module was developed for this study. Thirty-one novice- and intermediate-level resident surgeons from the departments of neurosurgery and ear, nose, and throat participated in this experimental study. The results suggest that a 2-hour training during a 2-month period through computer-based simulation environment improves the surgical skills of the residents in both-hand tasks, which is necessary for endoscopic surgical procedures but not in dominant hand tasks. Based on the results of this study, it can be concluded that computer-based simulation environments potentially improve surgical skills; however, the scenarios for such training modules need to consider especially the bimanual coordination of hands and should be regularly adapted to the individual skill levels and progresses.

Classification of Intermediate and Novice Surgeons' Skill Assessment Through Performance Metrics.

Background. Endoscopic surgeries have become an alternative for open procedures whenever possible. For such types of operations, surgeons are required to gain several skills, whose development needs hands-on practice. Accordingly, gaining these skills today is a challenge for surgical education programs. Despite the development of several technology-enhanced training environments, there are still problems to better integrate these technologies into educational programs. For an appropriate integration, it is critical to assess the skill levels and adapt the training content according to the trainees' requirements. In the literature, there exist several methods for assessing these skill levels. However, there are still problems in practice for objective and repetitive assessment. Methods. The present study aims to estimate the skill levels of participants in surgical training programs in an objective manner by collecting experimental data from residents in an endoscopic surgical simulation environment and gathering performance metrics. Results. It is shown that, by comparing the results of a number of classification algorithms for the best accuracy estimation and feature set, the "novice" and "intermediate" skill levels can be estimated with an accuracy of 86%. Conclusions. The outcomes help surgical educators and instructional system designers to better assess the skill levels of the trainees and guide them accordingly. In addition, objective assessments as highlighted in this study can be beneficial when designing technology-enhanced adaptive learning environments.

Are Left- and Right-Eye Pupil Sizes Always Equal?

Eye movements provide very critical information about the cognitive load and behaviors of human beings. Earlier studies report that under normal conditions, the left- and right-eye pupil sizes are equal. For this reason, most studies undertaking eye-movement analysis are conducted by only considering the pupil size of a single eye or taking the average size of both eye pupils. This study attempts to offer a better understanding concerning whether there are any differences between the left- and right-eye pupil sizes of the right-handed surgical residents while performing surgical tasks in a computer-based simulation environment under different conditions (left-hand, right-hand and both hands). According to the results, in many cases, the right-eye pupil sizes of the participants were larger than their left-eye pupil sizes while performing the tasks under right-hand and both hands conditions. However, no significant difference was found in relation to the tasks performed under left-hand condition in all scenarios. These results are very critical to shed further light on the cognitive load of the surgical residents by analyzing their left-eye and right-eye pupil sizes. Further research is required to investigate the effect of the difficulty level of each scenario, its appropriateness with the skill level of the participants, and handedness on the differences between the leftand right-eye pupil sizes.

Technology-enhanced surgical education: attitudes and perceptions of the endoscopic surgery community in Turkey.

The education programme of surgery has unique problems. In this study, first, a literature review is conducted to cover the studies found in the literature reporting on the problems of surgical education. Additionally, a survey study is conducted with 31 participants, who are either currently enrolled in endoscopic surgery education programmes in Turkey or are experts in the field. Supportively semistructured individual interviews are also conducted with five participants. These data are collected to better understand the instructional methods being used, their problems and the participants' preferred methods to be used. Additionally, the participants' attitudes are also investigated regarding the use of new technologies to enhance the current education programmes. The results indicate that, in Turkey, surgical education programmes are still mostly offered in traditional ways while other educational methods are used in an extremely limited manner. In general, the authors emphasise that more research needs to be conducted to better understand the characteristics of the medical students and develop standards for surgical education programmes, educational tools specific for related surgical domains and guidelines for the curriculum integration. The results of this study aimed to guide the instructional system designers for the endoscopic surgery education programmes.

Insights From Pupil Size to Mental Workload of Surgical Residents: Feasibility of an Educational Computer-Based Surgical Simulation Environment (ECE) Considering the Hand Condition.

The advantage of simulation environments is that they present various insights into real situations, where experimental research opportunities are very limited-for example, in endoscopic surgery. These operations require simultaneous use of both hands. For this reason, surgical residents need to develop several motor skills, such as eye-hand coordination and left-right hand coordination. While performing these tasks, the hand condition (dominant, nondominant, both hands) creates different degrees of mental workload, which can be assessed through mental physiological measures-namely, pupil size. Studies show that pupil size grows in direct proportion to mental workload. However, in the literature, there are very limited studies exploring this workload through the pupil sizes of the surgical residents under different hand conditions. Therefore, in this study, we present a computer-based simulation of a surgical task using eye-tracking technology to better understand the influence of the hand condition on the performance of skill-based surgical tasks in a computer-based simulated environment. The results show that under the both-hand condition, the pupil size of the surgical residents is larger than the one under the dominant and nondominant hand conditions. This indicates that when the computer-simulated surgical task is performed with both hands, it is considered more difficult than in the dominant and nondominant hand conditions. In conclusion, this study shows that pupil size measurements are sufficiently feasible to estimate the mental workload of the participants while performing surgical tasks. The results of this study can be used as a guide by instructional system designers of skill-based training programs.

Using Eye-Movement Events to Determine the Mental Workload of Surgical Residents.

These days, eye-tracking is one of the promising technologies used in different fields such as aviation, arts, sports, psychology and driving for several purposes. Even though it is being used for health purposes, studies involving eye-tracking are rare in the field of endo-neurosurgery. This study aims to use this technology to promote our understanding of the effect related to computer-based instructional materials on mental workload of endo-neurosurgery residents. Four computer-based simulation scenarios are developed based on skill development requirements of endo-neurosurgery residents. Two of them were designed as general models and the other two as simulated surgical models. During these surgery procedures, in real settings, surgical residents need to use their both hands simultaneously to control the endoscope and the operational tool in a coordinated fashion. Therefore, to shed light on the participants' behaviors, these scenarios are performed with dominant-hand, non-dominant hand and, finally with both-hands using haptic interfaces. Twenty-three residents volunteered in this study. Their eye-movements were recorded while performing the scenarios. According to the results of this study, when performing the simulated surgical models, an increase in the participants' mental workload was recorded when compared to the other scenarios. Accordingly, it can be concluded that the eye-movements of surgical residents can provide insights about the anticipated level of difficulty about the skill-based tasks. This information might be very critical to properly design and organize instructional materials for endo-neurosurgery, and also to better guide and evaluate the progress of trainees in computer simulation-based skill training environments.

Eye-Hand Coordination Patterns of Intermediate and Novice Surgeons in a Simulation-Based Endoscopic Surgery Training Environment.

Endoscopic surgery procedures require specific skills, such as eye-hand coordination to be developed. Current education programs are facing with problems to provide appropriate skill improvement and assessment methods in this field. This study aims to propose objec-tive metrics for hand-movement skills and assess eye-hand coordination. An experimental study is conducted with 15 surgical residents to test the newly proposed measures. Two computer-based both-handed endoscopic surgery practice scenarios are developed in a simulation environment to gather the participants' eye-gaze data with the help of an eye tracker as well as the related hand movement data through haptic interfaces. Additionally, participants' eye-hand coordination skills are analyzed. The results indicate higher correla-tions in the intermediates' eye-hand movements compared to the novices. An increase in intermediates' visual concentration leads to smoother hand movements. Similarly, the novices' hand movements are shown to remain at a standstill. After the first round of practice, all participants' eye-hand coordination skills are improved on the specific task targeted in this study. According to these results, it can be concluded that the proposed metrics can potentially provide some additional insights about trainees' eye-hand coordi-nation skills and help instructional system designers to better address training requirements.

Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

BACKGROUND: In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. METHODS: A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. RESULTS: The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.