Registration of preoperative temporal bone CT-scan to otoendoscopic video for augmented-reality based on convolutional neural networks.

PURPOSE: Patient-to-image registration is a preliminary step required in surgical navigation based on preoperative images. Human intervention and fiducial markers hamper this task as they are time-consuming and introduce potential errors. We aimed to develop a fully automatic 2D registration system for augmented reality in ear surgery. METHODS: CT-scans and corresponding oto-endoscopic videos were collected from 41 patients (58 ears) undergoing ear examination (vestibular schwannoma before surgery, profound hearing loss requiring cochlear implant, suspicion of perilymphatic fistula, contralateral ears in cases of unilateral chronic otitis media). Two to four images were selected from each case. For the training phase, data from patients (75% of the dataset) and 11 cadaveric specimens were used. Tympanic membranes and malleus handles were contoured on both video images and CT-scans by expert surgeons. The algorithm used a U-Net network for detecting the contours of the tympanic membrane and the malleus on both preoperative CT-scans and endoscopic video frames. Then, contours were processed and registered through an iterative closest point algorithm. Validation was performed on 4 cases and testing on 6 cases. Registration error was measured by overlaying both images and measuring the average and Hausdorff distances. RESULTS: The proposed registration method yielded a precision compatible with ear surgery with a 2D mean overlay error of 0.65 ± 0.60 mm for the incus and 0.48 ± 0.32 mm for the round window. The average Hausdorff distance for these 2 targets was 0.98 ± 0.60 mm and 0.78 ± 0.34 mm respectively. An outlier case with higher errors (2.3 mm and 1.5 mm average Hausdorff distance for incus and round window respectively) was observed in relation to a high discrepancy between the projection angle of the reconstructed CT-scan and the video image. The maximum duration for the overall process was 18 s. CONCLUSIONS: A fully automatic 2D registration method based on a convolutional neural network and applied to ear surgery was developed. The method did not rely on any external fiducial markers nor human intervention for landmark recognition. The method was fast and its precision was compatible with ear surgery.

Free-Field Hearing Test in Noise with Free Head Rotation for Evaluation of Monaural Hearing.

There is a discrepancy between the hearing test results in patients with single-sided deafness (SSD) and their reported outcome measures. This is probably due to the presence of two elements in everyday situations: noise and head movements. We developed a stereo-audiometric test in noise with free head movements to evaluate movements and auditory performance in monaural and binaural conditions in normal hearing volunteers with one occluded ear. Tests were performed in the binaural condition (BIN), with the left ear (LEO) or the right ear occluded (REO). The signal was emitted by one of the seven speakers, placed every 30° in a semicircle, and the noise (cocktail party) by all speakers. Subjects turned their head freely to obtain the most comfortable listening position, then repeated 10 sentences in this position. In monaural conditions, the sums of rotations (head rotations for an optimal hearing position in degrees, random signal azimuth, 1 to 15 signal ad lib signal presentations) were higher (LEO 255 ± 212°, REO 308 ± 208° versus BIN 74 ± 76, p < 0.001, ANOVA) than those in the BIN condition and the discrimination score (out of 10) was lower than that in the BIN condition (LEO 5 ± 1, REO 7 ± 1 versus BIN 8 ± 1, respectively p < 0.001 and p < 0.05 ANOVA). In the monaural condition, total rotation and discrimination in noise were negatively correlated with difficulty (Pearson r = -0.68, p < 0.01 and -0.51, p < 0.05, respectively). Subjects' behaviors were different in optimizing their hearing in noise via head rotation. The evaluation of head movements seems to be a significant parameter in predicting the difficulty of monaural hearing in noisy environments.

Image-to-Patient Registration in Computer-Assisted Surgery of Head and Neck: State-of-the-Art, Perspectives, and Challenges.

Today, image-guided systems play a significant role in improving the outcome of diagnostic and therapeutic interventions. They provide crucial anatomical information during the procedure to decrease the size and the extent of the approach, to reduce intraoperative complications, and to increase accuracy, repeatability, and safety. Image-to-patient registration is the first step in image-guided procedures. It establishes a correspondence between the patient's preoperative imaging and the intraoperative data. When it comes to the head-and-neck region, the presence of many sensitive structures such as the central nervous system or the neurosensory organs requires a millimetric precision. This review allows evaluating the characteristics and the performances of different registration methods in the head-and-neck region used in the operation room from the perspectives of accuracy, invasiveness, and processing times. Our work led to the conclusion that invasive marker-based methods are still considered as the gold standard of image-to-patient registration. The surface-based methods are recommended for faster procedures and applied on the surface tissues especially around the eyes. In the near future, computer vision technology is expected to enhance these systems by reducing human errors and cognitive load in the operating room.

Delay and Acceleration Threshold of Movement Perception in Patients Suffering from Vertigo or Dizziness.

BACKGROUND: The objective was to evaluate the delay and the acceleration threshold (AT) of movement perception in a population of patients suffering from dizziness and analyze the factors influencing these parameters. METHODS: This prospective study included 256 adult subjects: 16 control and 240 patients (5 acute unilateral vestibular loss, 13 compensated unilateral loss, 32 Meniere diseases, 48 persistent postural-perceptual dizziness (PPPD), 95 benign paroxysmal positional vertigo (BPPV), 10 central cases, 19 bilateral vestibulopathy, 14 vestibular migraine, and 4 age-related dizziness). Patients were evaluated for the sound-movement synchronicity perception (maximum delay between the bed oscillation peak and a beep perceived as synchronous, PST) and AT during a pendular movement on a swinging bed. RESULTS: We observed higher PST in women and in senior patients regardless of etiology. AT was higher in senior patients. AT was not influenced by etiology except in patients with bilateral vestibulopathy who had higher thresholds. AT was related to unipodal stance performance, past history of fall, and stop-walking-when-talking test. CONCLUSIONS: Delay and acceleration thresholds appear to be coherent with clinical findings and open insights on the exploration of symptoms that cannot be explained by routine otoneurological tests.

CochleRob: Parallel-Serial Robot to Position a Magnetic Actuator around a Patient's Head for Intracochlear Microrobot Navigation.

Our work introduces a new robotic solution named CochleRob, which is used for the administration of super-paramagnetic antiparticles as drug carriers into the human cochlea for the treatment of hearing loss caused by damaged cochlea. This novel robot architecture presents two key contributions. First, CochleRob has been designed to meet specifications pertaining to ear anatomy, including workspace, degrees of freedom, compactness, rigidity, and accuracy. The first objective was to develop a safer mathod to administer drugs to the cochlea without the need for catheter or CI insertion. Secondly, we aimed at developing and validating the mathemathical models, including forward, inverse, and dynamic models, to support the robot function. Our work provides a promising solution for drug administration into the inner ear.

Confrontation of endolymphatic hydrops diagnosis on 3-Tesla MRI to clinical and audiovestibular findings in Meniere's disease.

Objective: The aim of this study was to compare different MRI diagnostic criteria for endolymphatic hydrops (EH) and to investigate the relation between audiovestibular and MRI findings in Meniere's disease (MD). Materials and methods: Prospective cross-sectional cohort study in 2 referral centers included 76 patients with unilateral (n = 62) or bilateral (n = 14) MD. All patients underwent inner ear 3T-MRI 4 h (n = 52) or >24H (n = 24) following audiovestibular tests. T2-CISS and 3D-FLAIR images 4H after gadolinium were obtained. EH diagnosis was based on saccular morphology on coronal views (T2 and 3D-FLAIR), semi quantitative estimation of endolymphatic space enlargement, and saccule utricle ratio inversion (SURI) on 3D-FLAIR axial views. Results: SURI was the best criterion related to the disease side (43 SURI+ on symptomatic ears, n = 77, vs. 6 SURI+ on asymptomatic ears, n = 53, p < 0.0001, Chi-2). Same-day MRI revealed relation between EH, hearing loss and caloric weakness which could not be detected on delayed MRI: SURI was associated with a higher pure-tone average (43 ± 4.1 dB in SURI+ ears, n = 42 vs. 23 ± 2.6 SURI-, n = 62, p < 0.0001, unpaired t-test,), and a higher proportion of vestibular caloric weakness (23/46 SURI+ ears vs. 4/62 SURI-, p < 0.001, Chi-2). Among all criteria, SURI combined to caloric weakness was the best predictor of the affected side in a logistic regression model. Conclusion: SURI had the strongest relation to the side the disease and audio vestibular findings for unilateral, probable and definite meniere disease. A short delay between MRI and audio vestibular tests improved the coherence between the findings.

Effects of saccade delay, side of deficit, and training on detection of catch-up saccades during head-impulse test in virtual-reality-enhanced mannequin.

In this study, a training simulator for the examination of dizzy patients based on a virtual-reality-enhanced mannequin (VREM) was developed to evaluate the detection of catch-up saccades during head impulse test (HIT) and the effect of training in VREM. For novices (n = 35), 2 trials were conducted before and after a training session. Experts (n = 7) were submitted to an evaluation session. In each trial, a left or a right horizontal canal deficit with an overt catch-up saccade (delay between 110 and 320 ms) was randomly presented. Participants scored the difficulty in performing the maneuver, in recognizing the saccades, and the self-confidence in the diagnosis using a visual analogue scale (VAS). Saccade delay significantly influenced the performance. Training significantly improved the sensitivity in the residents (69.1% before to 97.9% after the training, p < 0.001, Fisher's exact test, n = 560 tests), surpassing experts' performances (p < 0.001, versus 87% in experts, Fisher's exact test). The specificity also increased to the expert level (78% before to 95% after the training, and 95% in experts, p < 0.001, Fisher's exact test). The VAS showed a decrease difficulty to execute the HIT, with an increase in the confidence after training. VREM improved the HIT execution performance and the confidence in novice practitioners.

Virtual-reality-enhanced mannequin to train emergency physicians to examine dizzy patients using the HINTS method.

Introduction: Acute vertigo is a frequent chief complaint in the emergency departments, and its efficient management requires thorough training. The HINTS protocol is a valid method to screen patients in the emergency room, but its application in routine is hindered by the lack of training. This study aimed to evaluate the training of emergency physicians for the HINTS method based on a mannequin-based virtual reality simulator (MBVRS). Methods: We conducted a monocenter, prospective, longitudinal, and randomized cohort study in an Emergency Department at a regional university hospital. We included 34 emergency physicians randomized into two equal groups matched by age and professional experience. The control group attended a theoretical lesson with video demonstrations and the test group received a simulation-based training in addition to the lecture. Results: We showed that the test group had a higher diagnosis performance for the HINTS method compared to the control group as evaluated by the simulator at 1 month (89% sensitivity versus 45, and 100% specificity versus 86% respectively, p < 001, Fisher's exact test). Evaluation at 6 months showed a similar advantage to the test group. Discussion: The MBVRS is a useful pedagogic tool for the HINTS protocol in the emergency department. The advantage of a unique training session can be measured up to 6 months after the lesson.

Effect of Sound Coding Strategies on Music Perception with a Cochlear Implant.

The goal of this study was to evaluate the music perception of cochlear implantees with two different sound processing strategies. Methods: Twenty-one patients with unilateral or bilateral cochlear implants (Oticon Medical®) were included. A music trial evaluated emotions (sad versus happy based on tempo and/or minor versus major modes) with three tests of increasing difficulty. This was followed by a test evaluating the perception of musical dissonances (marked out of 10). A novel sound processing strategy reducing spectral distortions (CrystalisXDP, Oticon Medical) was compared to the standard strategy (main peak interleaved sampling). Each strategy was used one week before the music trial. Results: Total music score was higher with CrystalisXDP than with the standard strategy. Nine patients (21%) categorized music above the random level (>5) on test 3 only based on mode with either of the strategies. In this group, CrystalisXDP improved the performances. For dissonance detection, 17 patients (40%) scored above random level with either of the strategies. In this group, CrystalisXDP did not improve the performances. Conclusions: CrystalisXDP, which enhances spectral cues, seemed to improve the categorization of happy versus sad music. Spectral cues could participate in musical emotions in cochlear implantees and improve the quality of musical perception.

Frequency Fitting Optimization Using Evolutionary Algorithm in Cochlear Implant Users with Bimodal Binaural Hearing.

Optimizing hearing in patients with a unilateral cochlear implant (CI) and contralateral acoustic hearing is a challenge. Evolutionary algorithms (EA) can explore a large set of potential solutions in a stochastic manner to approach the optimum of a minimization problem. The objective of this study was to develop and evaluate an EA-based protocol to modify the default frequency settings of a MAP (fMAP) of the CI in patients with bimodal hearing. METHODS: This monocentric prospective study included 27 adult CI users (with post-lingual deafness and contralateral functional hearing). A fitting program based on EA was developed to approach the best fMAP. Generated fMAPs were tested by speech recognition (word recognition score, WRS) in noise and free-field-like conditions. By combining these first fMAPs and adding some random changes, a total of 13 fMAPs over 3 generations were produced. Participants were evaluated before and 45 to 60 days after the fitting by WRS in noise and questionnaires on global sound quality and music perception in bimodal binaural conditions. RESULTS: WRS in noise improved with the EA-based fitting in comparison to the default fMAP (41.67 ± 9.70% versus 64.63 ± 16.34%, respectively, p = 0.0001, signed-rank test). The global sound quality and music perception were also improved, as judged by ratings on questionnaires and scales. Finally, most patients chose to keep the new fitting definitively. CONCLUSIONS: By modifying the default fMAPs, the EA improved the speech discrimination in noise and the sound quality in bimodal binaural conditions.

Augmented Reality Based Transmodiolar Cochlear Implantation.

HYPOTHESIS: Transmodiolar auditory implantation via the middle ear cavity could be possible using an augmented reality system (ARS). BACKGROUND: There is no clear landmark to indicate the cochlear apex or the modiolar axis. The ARS seems to be a promising tool for transmodiolar implantation by combining information from the preprocedure computed tomography scan (CT-scan) images to the real-time video of the surgical field. METHODS: Eight human temporal bone resin models were included (five adults and three children). The procedure started by the identification of the modiolar axis on the preprocedure CT-scan followed by a 3D reconstruction of the images. Information on modiolar location and navigational guidance was supplemented to the reconstructed model, which was then registered with the surgical video using a point-based approach. Relative movements between the phantom and the microscope were tracked using image feature-based motion tracking. Based on the information provided via the ARS, the surgeon implanted the electrode-array inside the modiolus after drilling the helicothrema. Postprocedure CT-scan images were acquired to evaluate the registration error and the implantation accuracy. RESULTS: The implantation could be conducted in all cases with a 2D registration error of 0.4 ±â€Š0.24 mm. The mean entry point error was 0.6 ±â€Š1.00 mm and the implant angular error 13.5 ±â€Š8.93 degrees (n = 8), compatible with the procedure requirements. CONCLUSION: We developed an image-based ARS to identify the extremities and the axis of the cochlear modiolus on intraprocedure videos. The system yielded submillimetric accuracy for implantation and remained stable throughout the experimental study.

Vision-Based Augmented Reality System for Middle Ear Surgery: Evaluation in Operating Room Environment.

HYPOTHESIS: Augmented reality (AR) solely based on image features is achievable in operating room conditions and its precision is compatible with otological surgery. BACKGROUND: The objective of this work was to evaluate the performance of a vision-based AR system for middle ear surgery in the operating room conditions. METHODS: Nine adult patients undergoing ossicular procedures were included in this prospective study. AR was obtained by combining real-time video from the operating microscope with the virtual image obtained from the preoperative computed tomography (CT)-scan. Initial registration between the video and the virtual CT image was achieved using manual selection of six points on the tympanic sulcus. Patient-microscope movements during the procedure were tracked using image-feature matching algorithm. The microscope was randomly moved at an approximated speed of 5 mm/s in the three axes of space and rotation for 180 seconds. The accuracy of the system was assessed by calculating the distance between each fiducial point selected on the video image and its corresponding point on the scanner. RESULTS: AR could be obtained for at least 3 minutes in seven out of nine patients. The overlay fiducial and target registration errors were 0.38 ±â€Š0.23 mm (n = 7) and 0.36 ±â€Š0.15 mm (n = 5) respectively, with a drift error of 1.2 ±â€Š0.5 µm/s. The system was stable throughout the procedure and achieved a refresh rate of 12 fps. Moderate bleeding and introduction of surgical instruments did not compromise the performance of the system. CONCLUSION: The AR system yielded sub-millimetric accuracy and remained stable throughout the experimental study despite patient-microscope movements and field of view obtrusions.

Measuring threshold and latency of motion perception on a swinging bed.

INTRODUCTION: Our objective was to develop and to evaluate a system to measure latency and threshold of pendular motion perception based on a swinging bed. MATERIALS AND METHODS: This prospective study included 30 healthy adults (age: 32 ± 12 years). All subjects were tested twice with a 10 min. interval. A second trial was conducted 2 to 15 days after. A rehabilitation swinging bed was connected to an electronic device emitting a beep at the beginning of each oscillation phase with an adjustable time lag. Subjects were blindfolded and auditory cues other than the beep were minimized. The acceleration threshold was measured by letting the bed oscillate freely until a natural break and asking the patient when he did not perceive any motion. The perception latency was determined by asking the patient to indicate whether the beep and the peak of each oscillation were synchronous. The time lag between sound and peak of the head position was swept from -750 to +750 ms by 50 ms increments. RESULTS: The mean acceleration threshold was 9.2±4.60 cm/s2. The range width of the synchronous perception interval was estimated as 535±190 ms. The point of subjective synchronicity defined as the center of this interval was -195±106 ms (n = 30). The test-retest evaluation in the same trial showed an acceptable reproducibility for the acceleration threshold and good to excellent for all parameters related to sound-movement latency. CONCLUSION: Swinging bed combined to sound stimulation can provide reproducible information on movement perception in a simple and non-invasive manner with highly reproducible results.

Participation of Acoustic and Electric Hearing in Perceiving Musical Sounds.

Introduction: The objective of our study was to evaluate musical perception and its relation to the quality of life in patients with bimodal binaural auditory stimulation. Materials and Methods: Nineteen adult patients with a cochlear implant (CI) for minimum 6 months, and moderate to severe contralateral hearing loss with a hearing aid (HA), and 21 normal hearing adults were included in this prospective, cross-sectional study. Pure-tone and speech audiometry, musical test evaluating sound perception characteristics and musical listening abilities, Munich questionnaire for musical habits, and the APHAB questionnaire were recoded. Performance in musical perception test with HA, CI, and HA + CI, and potential correlations between music test, audiometry and questionnaires were investigated. Results: Bimodal stimulation improved musical perception in several features (sound brightness, roughness, and clarity) in comparison to unimodal hearing, but CI did not add to HA performances in texture, polyphony or musical emotion and even appeared to interfere negatively in pitch perception with HA. Musical perception performances (sound clarity, instrument recognition) appeared to be correlated to hearing-related quality of life (APHAB RV and EC subdomains) but not with speech performances suggesting that the exploration of musical perception complements speech understanding evaluation to better describe every-day life hearing handicap. Conclusion: Testing musical sound perception provides important information on hearing performances as a complement to speech audiometry and appears to be related to hearing-related quality of life.

Use of Super Paramagnetic Iron Oxide Nanoparticles as Drug Carriers in Brain and Ear: State of the Art and Challenges.

Drug delivery and distribution in the central nervous system (CNS) and the inner ear represent a challenge for the medical and scientific world, especially because of the blood-brain and the blood-perilymph barriers. Solutions are being studied to circumvent or to facilitate drug diffusion across these structures. Using superparamagnetic iron oxide nanoparticles (SPIONs), which can be coated to change their properties and ensure biocompatibility, represents a promising tool as a drug carrier. They can act as nanocarriers and can be driven with precision by magnetic forces. The aim of this study was to systematically review the use of SPIONs in the CNS and the inner ear. A systematic PubMed search between 1999 and 2019 yielded 97 studies. In this review, we describe the applications of the SPIONS, their design, their administration, their pharmacokinetic, their toxicity and the methods used for targeted delivery of drugs into the ear and the CNS.

Bone-Anchored and Closed Skin Bonebridge Implant in Adults: Hearing Performances and Quality of Life.

INTRODUCTION: Bonebridge® is a novel active bone-anchored hearing implant. The purpose of this study was to evaluate the ease of implantation, the hearing performances, and the patient-reported benefit. MATERIALS AND METHODS: This is a prospective cross-sectional study of 24 consecutive adult patients implanted for a mixed hearing loss (13 chronic otitis media (COM) and 11 other aetiologies). Twenty-one implants were placed in the retrosigmoid position and 3 in the mastoid. Audiometry, Abbreviated Profile of Hearing Aid Benefit (APHAB) questionnaire, as well as 5 implant-specific questions (analogue visual scale [AVS] 0-10 score), was administered. RESULTS: Surgery lasted 73 ± 29.7 min on average. No major complication occurred. All patients were users at the last follow-up visit (median: 9-month range: 3-25). The average prosthetic gain was similar in COM and other aetiologies (43 ± 4.8 dB and 50 ± 7.2, respectively, not significant, Wilcoxon test). Bone-conduction thresholds were not deteriorated by surgery (Kruskal-Wallis test, not significant). APHAB scores improved in all categories except aversiveness (global score 45 ± 7.0% in COM and 32 ± 10.2% in others, not significant, and Wilcoxon test). Local pain (AVS: 3.23 ± 3.2, n = 16) and manipulation difficulties (3.1 ± 3.69) were low. The device was considered aesthetic (8.3 ± 2.49). Perfectible autonomy (5.0 ± 2.8) and difficulties wearing the implant during sport or at work (5.1 ± 3.47) were the weakest points. CONCLUSIONS: BoneBridge® implant provides reproducible results for the rehabilitation of mixed hearing losses and unilateral hearing loss.

Automatic segmentation of inner ear on CT-scan using auto-context convolutional neural network.

Temporal bone CT-scan is a prerequisite in most surgical procedures concerning the ear such as cochlear implants. The 3D vision of inner ear structures is crucial for diagnostic and surgical preplanning purposes. Since clinical CT-scans are acquired at relatively low resolutions, improved performance can be achieved by registering patient-specific CT images to a high-resolution inner ear model built from accurate 3D segmentations based on micro-CT of human temporal bone specimens. This paper presents a framework based on convolutional neural network for human inner ear segmentation from micro-CT images which can be used to build such a model from an extensive database. The proposed approach employs an auto-context based cascaded 2D U-net architecture with 3D connected component refinement to segment the cochlear scalae, semicircular canals, and the vestibule. The system was formulated on a data set composed of 17 micro-CT from public Hear-EU dataset. A Dice coefficient of 0.90 and Hausdorff distance of 0.74 mm were obtained. The system yielded precise and fast automatic inner-ear segmentations.

Curvilinear Multiplanar Reconstruction to Predict Useful Length and Diameter of Cochlear Lumen for Cochlear Implantation.

OBJECTIVE: Evaluate the useful length and the diameter of the cochlear lumen (CL) using routine imaging before cochlear implantation to study inter-individual variability and its impact on the insertion depth of the electrode carrier (EC). STUDY DESIGN: Prospective cross-sectional study. SETTING: Tertiary referral center. PATIENTS: Thirty-one preoperative and postimplantation temporal bone CT scans were analyzed by two investigators. INTERVENTION: Images were analyzed via orthogonal multiplanar reconstruction (Osirix) to measure the lengths of the entire CL and the basal turn. By means of curvilinear reconstruction, the CL was unfolded and the diameters of the CL and of the EC were measured every 2 mm from the round window (RW) to the apex. RESULTS: Very high-inter individual variability was found for the length of the basal turn (RSD > 1000%), the entire CL length (RSD > 800%), and the CL diameter at the RW (RSD > 600%). CL diameter was not correlated to the CL length. The inserted EC/total visible CL length ratio was 1.0 ±â€Š0.12. Reliability of the measures was acceptable for the CL length and the diameter at 16 mm from the RW (Crohnbach's alpha > 0.7, n = 31). CONCLUSION: CL length and diameter can be directly measured in a reliable manner by commercially available tools. These parameters potentially influence the EC insertion and should be assessed before cochlear implant surgery.