Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People.

Normal-hearing people use sound as a cue to recognize various events that occur in their surrounding environment; however, this is not possible for deaf and hearing of hard (DHH) people, and in such a context they may not be able to freely detect their surrounding environment. Therefore, there is an opportunity to create a convenient device that can detect sounds occurring in daily life and present them visually instead of auditorily. Additionally, it is of great importance to appropriately evaluate how such a supporting device would change the lives of DHH people. The current study proposes an augmented-reality-based system for presenting household sounds to DHH people as visual information. We examined the effect of displaying both the icons indicating sounds classified by machine learning and a dynamic spectrogram indicating the real-time time-frequency characteristics of the environmental sounds. First, the issues that DHH people perceive as problems in their daily lives were investigated through a survey, suggesting that DHH people need to visualize their surrounding sound environment. Then, after the accuracy of the machine-learning-based classifier installed in the proposed system was validated, the subjective impression of how the proposed system increased the comfort of daily life was obtained through a field experiment in a real residence. The results confirmed that the comfort of daily life in household spaces can be improved by combining not only the classification results of machine learning but also the real-time display of spectrograms.

Correlation between MOVA3D, a Monocular Movement Analysis System, and Qualisys Track Manager (QTM) during Lower Limb Movements in Healthy Adults: A Preliminary Study.

New technologies based on virtual reality and augmented reality offer promising perspectives in an attempt to increase the assessment of human kinematics. The aim of this work was to develop a markerless 3D motion analysis capture system (MOVA3D) and to test it versus Qualisys Track Manager (QTM). A digital camera was used to capture the data, and proprietary software capable of automatically inferring the joint centers in 3D and performing the angular kinematic calculations of interest was developed for such analysis. In the experiment, 10 subjects (22 to 50 years old), 5 men and 5 women, with a body mass index between 18.5 and 29.9 kg/m2, performed squatting, hip flexion, and abduction movements, and both systems measured the hip abduction/adduction angle and hip flexion/extension, simultaneously. The mean value of the difference between the QTM system and the MOVA3D system for all frames for each joint angle was analyzed with Pearson's correlation coefficient (r). The MOVA3D system reached good (above 0.75) or excellent (above 0.90) correlations in 6 out of 8 variables. The average error remained below 12° in only 20 out of 24 variables analyzed. The MOVA3D system is therefore promising for use in telerehabilitation or other applications where this level of error is acceptable. Future studies should continue to validate the MOVA3D as updated versions of their software are developed.

Indoor Content Delivery Solution for a Museum Based on BLE Beacons.

The digital transformation advancement enables multiple areas to provide modern services to their users. Culture is one of the areas that can benefit from these advances, more specifically museums, by presenting many benefits and the most emergent technologies to the visitors. This paper presents an indoor location system and content delivery solution, based on Bluetooth Low Energy Beacons, that enable visitors to walk freely inside the museum and receive augmented reality content based on the acquired position, which is done using the Received Signal Strength Indicator (RSSI). The solution presented in this paper was created for the Foz Côa Museum in Portugal and was tested in the real environment. A detailed study was carried out to analyze the RSSI under four different scenarios, and detection tests were carried out that allowed us to measure the accuracy of the room identification, which is needed for proper content delivery. Of the 89 positions tested in the four scenarios, 70% of the received signals were correctly received throughout the entire duration of the tests, 20% were received in an intermittent way, 4% were never detected and 6% of unwanted beacons were detected. The signal detection is fundamental for the correct room identification, which was performed with 96% accuracy. Thus, we verified that this technology is suitable for the proposed solution.

Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning.

Currently, strawberry harvesting relies heavily on human labour and subjective assessments of ripeness, resulting in inconsistent post-harvest quality. Therefore, the aim of this work is to automate this process and provide a more accurate and efficient way of assessing ripeness. We explored a unique combination of YOLOv7 object detection and augmented reality technology to detect and visualise the ripeness of strawberries. Our results showed that the proposed YOLOv7 object detection model, which employed transfer learning, fine-tuning and multi-scale training, accurately identified the level of ripeness of each strawberry with an mAP of 0.89 and an F1 score of 0.92. The tiny models have an average detection time of 18 ms per frame at a resolution of 1280 × 720 using a high-performance computer, thereby enabling real-time detection in the field. Our findings distinctly establish the superior performance of YOLOv7 when compared to other cutting-edge methodologies. We also suggest using Microsoft HoloLens 2 to overlay predicted ripeness labels onto each strawberry in the real world, providing a visual representation of the ripeness level. Despite some challenges, this work highlights the potential of augmented reality to assist farmers in harvesting support, which could have significant implications for current agricultural practices.

Application effect of head-mounted mixed reality device combined with 3D printing model in neurosurgery ventricular and hematoma puncture training.

BACKGROUND: The purpose of this study was to explore the applicability of application effect of head-mounted mixed reality (MR) equipment combined with a three-dimensional (3D) printed model in neurosurgical ventricular and haematoma puncture training. METHODS: Digital Imaging and Communications in Medicine (DICOM) format image data of two patients with common neurosurgical diseases (hydrocephalus and basal ganglia haemorrhage) were imported into 3D Slicer software for 3D reconstruction, saved, and printed using 3D printing to produce a 1:1-sized head model with real person characteristics. The required model (brain ventricle, haematoma, puncture path, etc.) was constructed and imported into the head-mounted MR device, HoloLens, and a risk-free, visual, and repeatable system was designed for the training of junior physicians. A total of 16 junior physicians who studied under this specialty from September 2020 to March 2022 were selected as the research participants, and the applicability of the equipment and model during training was evaluated with assessment score sheets and questionnaires after training. RESULTS: According to results of the assessment and questionnaire, the doctors trained by this system are more familiar with the localization of the lateral anterior ventricle horn puncture and the common endoscopic surgery for basal ganglia haemorrhage, as well as more confident in the mastery of these two operations than the traditional training methods. CONCLUSIONS: The use of head-mounted MR equipment combined with 3D printing models can provide an ideal platform for the operation training of young doctors. Through holographic images created from the combination of virtual and real images, operators can be better immersed in the operation process and deepen their understanding of the operation and related anatomical structures. The 3D printed model can be repeatedly reproduced so that doctors can master the technology, learn from mistakes, better achieve the purpose of teaching and training, and improve the effect of training.

Accuracy of augmented reality with computed tomography-based navigation in total hip arthroplasty.

BACKGROUND: Augmented reality (AR) provides the surgeon with direct visualization of radiological images by overlaying them on the patient. This study aimed to evaluate the accuracy of cup placement using a computed tomography (CT)-based AR navigation system. METHODS: Sixty-five prospectively enrolled patients underwent primary cementless total hip arthroplasty (THA) in a supine position using this novel AR navigation system, and changes in pelvic flexion angle (PFA) were evaluated. Absolute navigation errors were defined as the absolute differences between angles in the intraoperative navigation record and those measured on postoperative CT. Factors affecting the absolute navigation error in cup alignment were determined. RESULTS: Mean absolute change in PFA between preoperative CT and reduction was 2.1° ± 1.6°. Mean absolute navigation errors were 2.5° ± 1.7° in radiographic inclination (RI) and 2.5° ± 2.2° in radiographic anteversion (RA). While no factors significantly affecting absolute navigation error were found for RI, absolute change in PFA between preoperative CT and reduction correlated significantly with the absolute navigation error for RA. CONCLUSION: This CT-based navigation system with AR enabled surgeons to place the cup more accurately than was possible by freehand placement during THA in a supine position.

Introduction of augmented reality to the remote wound care nursing consultation system.

OBJECTIVE: We implemented augmented reality (AR) in remote consultations for enhanced pressure injury (PI) care in homecare nursing and improved the efficiency of on-site technical education for homecare nurses. The study aimed to depict expert techniques using AR technology to improve PI healing time in a male patient. METHOD: We developed and implemented a new system that combines a transparent hand with an image and gives an output as a video image in the existing remote consultation software. The system was used to support remote care of PIs by nurses. RESULTS: We succeeded in superimposing the expert nurse's nonverbal hand gestures onto the patient's wound in real time. The visiting nurse's understanding of the system had improved and there was an improvement in the patient's PI healing. CONCLUSION: These results suggest that remote consultation using AR is effective to observe precise wound care demonstrations of the steps of the PI treatment and provide effective treatment.

Robotic arm training in neurorehabilitation enhanced by augmented reality - a usability and feasibility study.

BACKGROUND: Robotic therapy and serious gaming support motor learning in neurorehabilitation. Traditional monitor-based gaming outputs cannot adequately represent the third dimension, whereas virtual reality headsets lack the connection to the real world. The use of Augmented Reality (AR) techniques could potentially overcome these issues. The objective of this study was thus to evaluate the usability, feasibility and functionality of a novel arm rehabilitation device for neurorehabilitation (RobExReha system) based on a robotic arm (LBR iiwa, KUKA AG) and serious gaming using the AR headset HoloLens (Microsoft Inc.). METHODS: The RobExReha system was tested with eleven adult inpatients (mean age: 64.4 ± 11.2 years; diagnoses: 8 stroke, 2 spinal cord injury, 1 Guillain-Barré-Syndrome) who had paretic impairments in their upper limb. Five therapists administered and evaluated the system. Data was compared with a Reference Group (eleven inpatients; mean age: 64.3 ± 9.1 years; diagnoses: 10 stroke, 1 spinal cord injury) who trained with commercially available robotic therapy devices (ArmeoPower or ArmeoSpring, Hocoma AG). Patients used standardized questionnaires for evaluating usability and comfort (Quebec User Evaluation of Satisfaction with assistive technology [QUEST]), workload (Raw Task Load Index [RTLX]) and a questionnaire for rating visual perception of the gaming scenario. Therapists used the QUEST, the System Usability Scale and the short version of the User Experience Questionnaire. RESULTS: Therapy with the RobExReha system was safe and feasible for patients and therapists, with no serious adverse events being reported. Patients and therapists were generally satisfied with usability. The patients' usability ratings were significantly higher in the Reference Group for two items of the QUEST: reliability and ease of use. Workload (RTLX) ratings did not differ significantly between the groups. Nearly all patients using the RobExReha system perceived the gaming scenario in AR as functioning adequately despite eight patients having impairments in stereoscopic vision. The therapists valued the system's approach as interesting and inventive. CONCLUSIONS: We demonstrated the clinical feasibility of combining a novel robotic upper limb robot with an AR-serious game in a neurorehabilitation setting. To ensure high usability in future applications, a reliable and easy-to-use system that can be used for task-oriented training should be implemented. TRIAL REGISTRATION: Ethical approval was obtained and the trial was registered at the German Clinical Trials Register (DRKS00022136).

Usability evaluation of augmented reality visualizations on an optical see-through head-mounted display for assisting machine operations.

This study explores the effect of using different visual information overlays and guiding arrows on a machine operation task with an optical see-through head-mounted display (OST-HMD). Thirty-four participants were recruited in the experiment. The independent variables included visual information mode (text, animation, and mixed text and animation) and the use of guiding arrows (with and without arrows). In addition, gender difference was also an objective of this study. The task performance indicators were determined based on task completion time and error counts as well as subjective measures (system usability scale, NASA task load index, and immersion scale). This study used the mixed analysis of variance design to evaluate the main and interaction effects. The results showed that males performed better when using the mixed text and animation mode. Females performed better when using the text mode. In addition, using the mixed text and animation mode demonstrated the best outcome in system usability scale and NASA task load index. For the use of guiding arrows, the task completion time was reduced and the system usability scale, NASA task load index, and immersion scale showed positive effects.

Machine learning-based cognitive load prediction model for AR-HUD to improve OSH of professional drivers.

Motivation: Augmented reality head-up display (AR-HUD) interface design takes on critical significance in enhancing driving safety and user experience among professional drivers. However, optimizing the above-mentioned interfaces poses challenges, innovative methods are urgently required to enhance performance and reduce cognitive load. Description: A novel method was proposed, combining the IVPM method with a GA to optimize AR-HUD interfaces. Leveraging machine learning, the IVPM-GA method was adopted to predict cognitive load and iteratively optimize the interface design. Results: Experimental results confirmed the superiority of IVPM-GA over the conventional BP-GA method. Optimized AR-HUD interfaces using IVPM-GA significantly enhanced the driving performance, and user experience was enhanced since 80% of participants rated the IVPM-GA interface as visually comfortable and less distracting. Conclusion: In this study, an innovative method was presented to optimize AR-HUD interfaces by integrating IVPM with a GA. IVPM-GA effectively reduced cognitive load, enhanced driving performance, and improved user experience for professional drivers. The above-described findings stress the significance of using machine learning and optimization techniques in AR-HUD interface design, with the aim of enhancing driver safety and occupational health. The study confirmed the practical implications of machine learning optimization algorithms for designing AR-HUD interfaces with reduced cognitive load and improved occupational safety and health (OSH) for professional drivers.

Augmented Reality for Perioperative Anxiety in Patients Undergoing Surgery: A Randomized Clinical Trial.

Importance: Both augmented reality (AR) and virtual reality (VR) have had increasing applications in medicine, including medical training, psychology, physical medicine, rehabilitation, and surgical specialties, such as neurosurgery and orthopedic surgery. There are little data on AR's effect on patients' anxiety and experiences. Objective: To determine whether the use of an AR walkthrough effects patient perioperative anxiety. Design, Setting, and Participants: This randomized clinical trial was conducted at an outpatient surgery center in 2021 to 2022. All patients undergoing elective orthopedic surgery with the senior author were randomized to the treatment or control group. Analyses were conducted per protocol. Data analysis was performed in November 2022. Intervention: AR experience explaining to patients what to expect on their day of surgery and walking them through the surgery space. The control group received the standard educational packet. Main Outcomes and Measures: The main outcome was change in State-Trait Anxiety Inventory (STAI) from the screening survey to the preoperative survey. Results: A total of 140 patients were eligible, and 45 patients either declined or were excluded. Therefore, 95 patients (63 [66.3%] male; mean [SD] age, 38 [16] years) were recruited for the study and included in the final analysis; 46 patients received the AR intervention, and 49 patients received standard instructions. The AR group experienced a decrease in anxiety from the screening to preoperative survey (mean score change, -2.4 [95% CI, -4.6 to -0.3]), while the standard care group experienced an increase (mean score change, 2.6 [95% CI, 0.2 to 4.9]; P = .01). All patients postoperatively experienced a mean decrease in anxiety score compared with both the screening survey (mean change: AR, -5.4 [95% CI, -7.9 to -2.9]; standard care, -6.9 [95% CI, -11.5 to -2.2]; P = .32) and preoperative survey (mean change: AR, -8.0 [95% CI, -10.3 to -5.7]; standard care, -4.2 [95% CI, -8.6 to 0.2]; P = .19). Of 42 patients in the AR group who completed the postoperative follow-up survey, 30 (71.4%) agreed or strongly agreed that they enjoyed the experience, 29 (69.0%) agreed or strongly agreed that they would recommend the experience, and 28 (66.7%) agreed or strongly agreed that they would use the experience again. No differences were observed in postoperative pain levels or narcotic use. Conclusions and Relevance: In this randomized clinical trial, the use of AR decreased preoperative anxiety compared with traditional perioperative education and handouts, but there was no significant effect on postoperative anxiety, pain levels, or narcotic use. These findings suggest that AR may serve as an effective means of decreasing preoperative patient anxiety. Trial Registration: ClinicalTrials.gov Identifier: NCT04727697.

Using Stereoscopic Virtual Presentation for Clinical Anatomy Instruction and Procedural Training in Medical Education.

This chapter begins by exploring the current landscape of virtual and augmented reality technologies in a post-pandemic world and asserting the importance of virtual technologies that improve students' learning outcomes while also reducing costs. Next, the chapter describes clinical anatomy instruction concepts in medical education, including applied anatomy content knowledge, pedagogical anatomy content knowledge, and virtual stereoscopic visualization studies that exemplify these concept areas, respectively. The chapter then explores the concept of procedural training with a specific emphasis on virtual stereoscopic anatomy visualization studies that exemplify or have implications for procedural training in medical education. Subsequently, the chapter discusses the benefits and challenges as well as the potential future positive and negative implications of virtual stereoscopic visualizations in medical education before finally concluding with some pensive considerations for the present and future of anatomy education and training using virtual technologies.

Assessing the Effect of Augmented Reality on Procedural Outcomes During Ultrasound-Guided Vascular Access.

OBJECTIVE: Augmented reality devices are increasingly accepted in health care, though most applications involve education and pre-operative planning. A novel augmented reality ultrasound application, HoloUS, was developed for the Microsoft HoloLens 2 to project real-time ultrasound images directly into the user's field of view. In this work, we assessed the effect of using HoloUS on vascular access procedural outcomes. METHODS: A single-center user study was completed with participants with (N = 22) and without (N = 12) experience performing ultrasound-guided vascular access. Users completed a venipuncture and aspiration task a total of four times: three times on study day 1, and once on study day 2 between 2 and 4 weeks later. Users were randomized to use conventional ultrasound during either their first or second task and the HoloUS application at all other times. Task completion time, numbers of needle re-directions, head adjustments and needle visualization rates were recorded. RESULTS: For expert users, task completion time was significantly faster using HoloUS (11.5 s, interquartile range [IQR] = 6.5-23.5 s vs. 18.5 s, IQR = 11.0-36.5 s; p = 0.04). The number of head adjustments was significantly lower using the HoloUS app (1.0, IQR = 0.0-1.0 vs. 3.0, IQR = 1.0-5.0; p < 0.0001). No significant differences were identified in other measured outcomes. CONCLUSION: This is the first investigation of augmented reality-based ultrasound-guided vascular access using the second-generation HoloLens. It demonstrates equivalent procedural efficiency and accuracy, with favorable usability, ergonomics and user independence when compared with traditional ultrasound techniques.

Comparative analysis of two navigation techniques based on augmented reality technology for the orthodontic mini-implants placement.

To analyze and compare the accuracy and root contact prevalence, comparing a conventional freehand technique and two navigation techniques based on augmented reality technology for the orthodontic self-drilling mini-implants placement. Methods Two hundred and seven orthodontic self-drilling mini-implants were placed using either a conventional freehand technique (FHT) and two navigation techniques based on augmented reality technology (AR TOOTH and AR SCREWS). Accuracy across different dental sectors was also analyzed. CBCT and intraoral scans were taken both prior to and following orthodontic self-drilling mini-implants placement. The deviation angle and horizontal were then analyzed; these measurements were taken at the coronal entry point and apical endpoint between the planned and performed orthodontic self-drilling mini-implants. In addition, any complications resulting from mini-implant placement, such as spot perforations, were also analyzed across all dental sectors.Results The statistical analysis showed significant differences between study groups with regard to the coronal entry-point (p < 0.001), apical end-point(p < 0.001) and angular deviations (p < 0.001). Furthermore, statistically significant differences were shown between the orthodontic self-drilling mini-implants placement site at the coronal entry-point (p < 0.0001) and apical end-point (p < 0.001). Additionally, eight root perforations were observed in the FHT group, while there were no root perforations in the two navigation techniques based on augmented reality technology.Conclusions The navigation techniques based on augmented reality technology has an effect on the accuracy of orthodontic self-drilling mini-implants placement and results in fewer intraoperative complications, comparing to the conventional free-hand technique. The AR TOOTH augmented reality technique showed more accurate results between planned and placed orthodontic self-drilling mini-implants, comparing to the AR SCREWS and conventional free-hand techniques. The navigation techniques based on augmented reality technology showed fewer intraoperative complications, comparing to the conventional free-hand technique.

Bimanual Intravenous Needle Insertion Simulation Using Nonhomogeneous Haptic Device Integrated into Mixed Reality.

In this study, we developed a new haptic-mixed reality intravenous (HMR-IV) needle insertion simulation system, providing a bimanual haptic interface integrated into a mixed reality system with programmable variabilities considering real clinical environments. The system was designed for nursing students or healthcare professionals to practice IV needle insertion into a virtual arm with unlimited attempts under various changing insertion conditions (e.g., skin: color, texture, stiffness, friction; vein: size, shape, location depth, stiffness, friction). To achieve accurate hand-eye coordination under dynamic mixed reality scenarios, two different haptic devices (Dexmo and Geomagic Touch) and a standalone mixed reality system (HoloLens 2) were integrated and synchronized through multistep calibration for different coordinate systems (real world, virtual world, mixed reality world, haptic interface world, HoloLens camera). In addition, force-profile-based haptic rendering proposed in this study was able to successfully mimic the real tactile feeling of IV needle insertion. Further, a global hand-tracking method, combining two depth sensors (HoloLens and Leap Motion), was developed to accurately track a haptic glove and simulate grasping a virtual hand with force feedback. We conducted an evaluation study with 20 participants (9 experts and 11 novices) to measure the usability of the HMR-IV simulation system with user performance under various insertion conditions. The quantitative results from our own metric and qualitative results from the NASA Task Load Index demonstrate the usability of our system.

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment: A Pilot Randomized Crossover Trial.

Importance: Mixed-reality (MR) technology has the potential to enhance care delivery, but there remains a paucity of evidence for its efficacy and feasibility. Objective: To assess the efficacy and feasibility of MR technology to enhance emergency care delivery in a simulated environment. Design, Setting, and Participants: This pilot randomized crossover trial was conducted from September to November 2021 at a single center in a high-fidelity simulated environment with participants block randomized to standard care (SC) or MR-supported care (MR-SC) groups. Participants were 22 resident-grade physicians working in acute medical and surgical specialties prospectively recruited from a single UK Academic Health Sciences Centre. Data were analyzed from September to December 2022. Intervention: Participants resuscitated a simulated patient who was acutely unwell, including undertaking invasive procedures. Participants completed 2 scenarios and were randomly assigned to SC or MR-SC for the first scenario prior to crossover. The HoloLens 2 MR device provided interactive holographic content and bidirectional audiovisual communication with senior physicians in the MR-SC group. Main Outcomes and Measures: The primary outcome was error rate assessed via the Imperial College Error Capture (ICECAP) multidimensional error-capture tool. Secondary outcomes included teamwork (Observational Teamwork Assessment for Surgery [OTAS]; range, 0-6 and Teamwork Skills Assessment for Ward Care [T-SAW-C]; range, 1-5), scenario completion, stress and cognitive load (NASA Task Load Index [NASA-TLX; range 0-100]), and MR device user acceptability. Results: A total of 22 physicians (15 males [68.2%]; median [range] age, 28 [25-34] years) were recruited. MR technology significantly reduced the mean (SD) number of errors per scenario compared with SC (5.16 [3.34] vs 8.30 [3.09] errors; P = .003), with substantial reductions in procedural (0.79 [0.75] vs 1.52 [1.20] errors; P = .02), technical (1.95 [1.40] vs 3.65 [2.03] errors; P = .01), and safety (0.37 [0.96] vs 0.96 [0.85] errors; P = .04) domains. MR resulted in significantly greater scenario completion rates vs SC (22 scenarios [100%] vs 14 scenarios [63.6%]; P = .003). It also led to significant improvements in the overall quality of teamwork and interactions vs SC as measured by mean (SD) OTAS (25.41 [6.30] vs 16.33 [5.49]; P < .001) and T-SAW-C (27.35 [6.89] vs 18.37 [6.09]; P < .001) scores. As reported via mean (range) NASA-TLX score, there were significant reductions for MR-SC vs SC in participant temporal demands (38 [20-50] vs 46 [30-70]; P = .03) and significant improvements in self-reported task performance (50 [30-60] vs 39 [10-70]; P = .01). Overall, 19 participants (86.4%) reported that they were more confident in making clinical decisions and undertaking clinical procedures with MR support. Conclusions and Relevance: This study found that the use of MR technology reduced error, improved teamwork, and enhanced practitioner confidence when used to support the delivery of simulated emergency medical care. Trial Registration: ClinicalTrials.gov Identifier: NCT05870137.

Home-Based Rehabilitation of the Shoulder Using Auxiliary Systems and Artificial Intelligence: An Overview.

Advancements in modern medicine have bolstered the usage of home-based rehabilitation services for patients, particularly those recovering from diseases or conditions that necessitate a structured rehabilitation process. Understanding the technological factors that can influence the efficacy of home-based rehabilitation is crucial for optimizing patient outcomes. As technologies continue to evolve rapidly, it is imperative to document the current state of the art and elucidate the key features of the hardware and software employed in these rehabilitation systems. This narrative review aims to provide a summary of the modern technological trends and advancements in home-based shoulder rehabilitation scenarios. It specifically focuses on wearable devices, robots, exoskeletons, machine learning, virtual and augmented reality, and serious games. Through an in-depth analysis of existing literature and research, this review presents the state of the art in home-based rehabilitation systems, highlighting their strengths and limitations. Furthermore, this review proposes hypotheses and potential directions for future upgrades and enhancements in these technologies. By exploring the integration of these technologies into home-based rehabilitation, this review aims to shed light on the current landscape and offer insights into the future possibilities for improving patient outcomes and optimizing the effectiveness of home-based rehabilitation programs.

A Systematic Literature Review of Accessibility Evaluation Methods for Augmented Reality Applications.

Augmented reality is increasingly becoming significant in people's everyday life in different sectors. Particularly to users with disabilities, augmented reality can be an instructional tool and assistive technology, making it worth a vital tool for users with disabilities. For such an important tool, it is essential to understand how these applications are evaluated in order to improve their throughput and extend their accessibility. In that regard, a systematic literature review for peer-reviewed articles published between 2012 and 2022 was conducted to discover which methods, metrics, and tools/techniques researchers use during the accessibility evaluation of augmented reality applications. The PRISMA methodology allowed us to identify, screen, and include 60 articles from three databases. The finding shows that most researchers use task scenarios as the method, qualitative feedback as the metric, and questionnaire as a tool to collect data for accessibility evaluation. The conclusion and future studies are also discussed.

Familiarization with Mixed Reality for Individuals with Autism Spectrum Disorder: An Eye Tracking Study.

Mixed Reality (MR) technology is experiencing significant growth in the industrial and healthcare sectors. The headset HoloLens 2 displays virtual objects (in the form of holograms) in the user's environment in real-time. Individuals with Autism Spectrum Disorder (ASD) exhibit, according to the DSM-5, persistent deficits in communication and social interaction, as well as a different sensitivity compared to neurotypical (NT) individuals. This study aims to propose a method for familiarizing eleven individuals with severe ASD with the HoloLens 2 headset and the use of MR technology through a tutorial. The secondary objective is to obtain quantitative learning indicators in MR, such as execution speed and eye tracking (ET), by comparing individuals with ASD to neurotypical individuals. We observed that 81.81% of individuals with ASD successfully familiarized themselves with MR after several sessions. Furthermore, the visual activity of individuals with ASD did not differ from that of neurotypical individuals when they successfully familiarized themselves. This study thus offers new perspectives on skill acquisition indicators useful for supporting neurodevelopmental disorders. It contributes to a better understanding of the neural mechanisms underlying learning in MR for individuals with ASD.