Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses.

BACKGROUND: Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts. NEW METHOD: Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario. RESULTS: We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials. CONCLUSION: Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

A Phosphenotron Device for Sensoric Spatial Resolution of Phosphenes within the Visual Field Using Non-Invasive Transcranial Alternating Current Stimulation.

This study presents phosphenotron, a device for enhancing the sensory spatial resolution of phosphenes in the visual field (VF). The phosphenotron employs a non-invasive transcranial alternating current stimulation (NITACS) to modulate brain activity by applying weak electrical currents to the scalp or face. NITACS's unique application induces phosphenes, a phenomenon where light is perceived without external stimuli. Unlike previous invasive methods, NITACS offers a non-invasive approach to create these effects. The study focused on assessing the spatial resolution of NITACS-induced phosphenes, crucial for advancements in visual aid technology and neuroscience. Eight participants were subjected to NITACS using a novel electrode arrangement around the eye orbits. Results showed that NITACS could generate spatially defined phosphene patterns in the VF, varying among individuals but consistently appearing within their VF and remaining stable through multiple stimulations. The study established optimal parameters for vibrant phosphene induction without discomfort and identified electrode positions that altered phosphene locations within different VF regions. Receiver Operating characteristics analysis indicated a specificity of 70.7%, sensitivity of 73.9%, and a control trial accuracy of 98.4%. These findings suggest that NITACS is a promising, reliable method for non-invasive visual perception modulation through phosphene generation.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex.

Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Flexible Polymer Electrodes for Stable Prosthetic Visual Perception in Mice.

Brain interfaces that can stimulate neurons, cause minimal damage, and work for a long time will be central for future neuroprosthetics. Here, the long-term performance of highly flexible, thin polyimide shanks with several small (<15 µm) electrodes during electrical microstimulation of the visual cortex, is reported. The electrodes exhibit a remarkable stability when several billions of electrical pulses are applied in vitro. When the devices are implanted in the primary visual cortex (area V1) of mice and the animals are trained to detect electrical microstimulation, it is found that the perceptual thresholds are 2-20 microamperes (µA), which is far below the maximal currents that the electrodes can withstand. The long-term functionality of the devices in vivo is excellent, with stable performance for up to more than a year and little damage to the brain tissue. These results demonstrate the potential of thin floating electrodes for the long-term restoration of lost sensory functions.

Neural activity of retinal ganglion cells under continuous, dynamically-modulated high frequency electrical stimulation.

Objective.Current retinal prosthetics are limited in their ability to precisely control firing patterns of functionally distinct retinal ganglion cell (RGC) types. The aim of this study was to characterise RGC responses to continuous, kilohertz-frequency-varying stimulation to assess its utility in controlling RGC activity.Approach.We usedin vitropatch-clamp experiments to assess electrically-evoked ON and OFF RGC responses to frequency-varying pulse train sequences. In each sequence, the stimulation amplitude was kept constant while the stimulation frequency (0.5-10 kHz) was changed every 40 ms, in either a linearly increasing, linearly decreasing or randomised manner. The stimulation amplitude across sequences was increased from 10 to 300µA.Main results.We found that continuous stimulation without rest periods caused complex and irreproducible stimulus-response relationships, primarily due to strong stimulus-induced response adaptation and influence of the preceding stimulus frequency on the response to a subsequent stimulus. In addition, ON and OFF populations showed different sensitivities to continuous, frequency-varying pulse trains, with OFF cells generally exhibiting more dependency on frequency changes within a sequence. Finally, the ability to maintain spiking behaviour to continuous stimulation in RGCs significantly reduced over longer stimulation durations irrespective of the frequency order.Significance.This study represents an important step in advancing and understanding the utility of continuous frequency modulation in controlling functionally distinct RGCs. Our results indicate that continuous, kHz-frequency-varying stimulation sequences provide very limited control of RGC firing patterns due to inter-dependency between adjacent frequencies and generally, different RGC types do not display different frequency preferences under such stimulation conditions. For future stimulation strategies using kHz frequencies, careful consideration must be given to design appropriate pauses in stimulation, stimulation frequency order and the length of continuous stimulation duration.

Robot-assisted implantation of a microelectrode array in the occipital lobe as a visual prosthesis: technical note.

The prospect of direct interaction between the brain and computers has been investigated in recent decades, revealing several potential applications. One of these is sight restoration in profoundly blind people, which is based on the ability to elicit visual perceptions while directly stimulating the occipital cortex. Technological innovation has led to the development of microelectrodes implantable on the brain surface. The feasibility of implanting a microelectrode on the visual cortex has already been shown in animals, with promising results. Current research has focused on the implantation of microelectrodes into the occipital brain of blind volunteers. The technique raises several technical challenges. In this technical note, the authors suggest a safe and effective approach for robot-assisted implantation of microelectrodes in the occipital lobe for sight restoration.

Obstacle avoidance in simulated prosthetic vision based on SOLOv2-RS / 中国医学物理学杂志

Aiming at the obstacle avoidance in simulated prosthetic vision,an improved instance segmentation model SOLOv2-RS is proposed for providing a basis for implant recipients to accurately perceive the relevant instance objects of navigation tasks in low-resolution prosthetic vision.According to the visual attention mechanism,the distance from the center of the visual field and the target scale are adopted as the importance calculation criteria for each instance,and the obtained importance score is used as the basis for the hierarchical representation of the obstacles to be avoided.Meanwhile,edge information is used to cue the tactile paving,and it is morphologically inflated for avoiding the edge information loss caused by the limited phosphene.The prosthetic vision simulation results demonstrate that the hierarchical optimization processing strategy for simulated prosthetic vision can effectively achieve the optimal representation of tactile paving and obstacles,thus facilitating the implant recipients to accomplish outdoor obstacle avoidance tasks more efficiently,and providing ideas for the research on the image processing of visual prosthetic devices.

Artificial cornea transplantation and visual rehabilitation: an integrative review / Transplante de córnea artificial e reabilitação visual: uma revisão integrativa

ABSTRACT Due to the development of complications and the biocompatibility and scarcity of transplant donor tissues, artificial corneas, which can be used for the rehabilitation of optical functions, have been developed. The current study aimed to analyze the visual rehabilitation effects of the Boston type I keratoprosthesis, Boston type II keratoprosthesis, Aurolab keratoprosthesis, osteo-odonto-keratoprosthesis, and tibial bone keratoprosthesis. Results showed that the Boston type I keratoprosthesis was the most effective for visual rehabilitation in patients with moist ocular surfaces. The Aurolab keratoprosthesis had a lower efficacy for visual rehabilitation. Nevertheless, it is still a viable option for individuals in economically restricted countries. In patients with dry eyes, the Boston type II keratoprosthesis was associated with the best visual rehabilitation. However, the final visual acuity of patients who received osteo-odonto-keratoprosthesis and tibial bone keratoprosthesis implantation was not evaluated as the necessary information was not available.

RESUMO Em decorrência de complicações, da biocompatibilidade e da escassez de tecido doador para transplantes de córnea natural, foram elaboradas córneas artificiais que são potenciais para reabilitar funções ópticas. Nessa perspectiva, objetivou-se a análise da eficácia da reabilitação visual entre os implantes: Boston tipo I, Boston tipo II, Aurolab, osteo-odonto-ceratoprótese e ceratoprótese de Osso Tibial. De modo geral, a princípio observou-se uma tendência de melhoria da Best-corrected visual acuity em todos os tipos de lentes, mas considerável queda durante acompanhamento a longo prazo. O dispositivo com melhor reabilitação visual em pacientes com superfícies oculares úmidas é a Boston tipo I, seguida pela Aurolab, que é economicamente viável em países emergentes. Ao considerar pacientes com olhos secos, o implante de Boston tipo II apresenta maior reabilitação visual. Por fim, em virtude de não apresentarem dados equiparáveis, as lentes osteo-odonto-ceratoprótese e de osso tibial não puderam ser analisadas.

Prosthetic Visual Acuity with the PRIMA System in Patients with Atrophic Age-related Macular Degeneration at 4 years follow-up.

Objective: To assess the efficacy and safety of the PRIMA subretinal neurostimulation system 48-months post-implantation for improving visual acuity (VA) in patients with geographic atrophy (GA) due to age-related macular degeneration (AMD) at 48-months post-implantation. Design: First-in-human clinical trial of the PRIMA subretinal prosthesis in patients with atrophic AMD, measuring best-corrected ETDRS VA (Clinicaltrials.gov NCT03333954). Subjects: Five patients with GA, no foveal light perception and VA of logMAR 1.3 to 1.7 in their worse-seeing "study" eye. Methods: In patients implanted with a subretinal photovoltaic neurostimulation array containing 378 pixels of 100 µm in size, the VA was measured with and without the PRIMA system using ETDRS charts at 1 meter. The system's external components: augmented reality glasses and pocket computer, provide image processing capabilities, including zoom. Main Outcome Measures: VA using ETDRS charts with and without the system. Light sensitivity in the central visual field, as measured by Octopus perimetry. Anatomical outcomes demonstrated by fundus photography and optical coherence tomography up to 48-months post-implantation. Results: All five subjects met the primary endpoint of light perception elicited by the implant in the scotoma area. In one patient the implant was incorrectly inserted into the choroid. One subject died 18-months post-implantation due to study-unrelated reason. ETDRS VA results for the remaining three subjects are reported herein. Without zoom, VA closely matched the pixel size of the implant: 1.17 ± 0.13 pixels, corresponding to mean logMAR 1.39, or Snellen 20/500, ranging from 20/438 to 20/565. Using zoom at 48 months, subjects improved their VA by 32 ETDRS letters versus baseline (SE 5.1) 95% CI[13.4,49.9], p<0.0001. Natural peripheral visual function in the treated eye did not decline after surgery compared to the fellow eye (p=0.08) during the 48 months follow-up period. Conclusions: Subretinal implantation of PRIMA in subjects with GA suffering from profound vision loss due to AMD is feasible and well tolerated, with no reduction of natural peripheral vision up to 48-months. Using prosthetic central vision through photovoltaic neurostimulation, patients reliably recognized letters and sequences of letters,and with zoom it provided a clinically meaningful improvement in VA of up to eight ETDRS lines.

A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision.

Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.

Optical-Quality Assessment of a Miniaturized Intraocular Telescope.

Age-related macular degeneration (AMD) causes severe vision impairments, including blindness. An option to improve vision in AMD patients is through intraocular lenses and optics. Among others, implantable miniaturized telescopes, which direct light to healthy lateral regions of the retina, can be highly effective in improving vision in AMD patients. Yet, the quality of the restored vision might be sensitive to the optical transmission and aberrations of the telescope. To shed light on these points, we studied the in vitro optical performance of an implantable miniaturized telescope, namely, the SING IMT™ (Samsara Vision Ltd., Far Hills, NJ, USA) designed to improve vision in patients affected by late-stage AMD. Specifically, we measured the optical transmission in the spectral range 350-750 nm of the implantable telescope with a fiber-optic spectrometer. Wavefront aberrations were studied by measuring the wavefront of a laser beam after passing through the telescope and expanding the measured wavefront into a Zernike polynomial basis. Wavefront concavity indicated that the SING IMT™ behaves as a diverging lens with a focal length of -111 mm. The device exhibited even optical transmission in the whole visible spectrum and effective curvature suitable for retinal images magnification with negligible geometrical aberrations. Optical spectrometry and in vitro wavefront analysis provide evidence supporting the feasibility of miniaturized telescopes as high-quality optical elements and a favorable option for AMD visual impairment treatments.

Three-Month Safety and Efficacy Outcomes for the Smaller-Incision New-Generation Implantable Miniature Telescope (SING IMT™).

The smaller-incision new-generation implantable miniature telescope (SING IMT™) is the second generation of the IMT™, a telescope prosthesis that is indicated for monocular implantation in patients with stable vision impairment caused by bilateral central scotomas associated with end-stage Age-related macular degeneration (AMD). This non-comparative retrospective study is the first and largest single-surgeon case series to evaluate the short-term (3 months) safety and efficacy of the device in patients with disciform scars or geographic atrophy at baseline. The main outcome measures included best-corrected distance and near visual acuity (CDVA and CDNVA, respectively), endothelial cell density (ECD) loss, and the incidence of complications. At postoperative month 3 in the study eyes, mean CDVA and CDNVA improved by +14.9 ± 7.1 letters and +7.7 ± 3.2 Jaeger levels, respectively. Importantly, 70.83% of patients gained ≥ 2 lines, 58.33% ≥ 3 lines, and 25.00% ≥ 4 lines of CDVA. From baseline, ECD loss in the study eyes was 10.4 ± 13.3% at 3 months, however, ECD was comparable between the study and fellow eyes at all time points. The most common complication was corneal edema. In all, these short-term outcomes suggest that the SING IMT™ delivers lower ECD loss than the first-generation IMT ™, but similar visual outcomes and safety.

Intraoperative Iridectomy in Femto-Laser Assisted Smaller-Incision New Generation Implantable Miniature Telescope.

BACKGROUND: In this study, we aimed to report the short-term (6 months) effects on visual functionality and safety of femto-laser assisted smaller-incision new-generation implantable miniature telescope (SING-IMT™) implanting, particularly related to postsurgical intraocular pressure increase, in patients suffering from end-stage age-related macular degeneration (AMD) and cataract. This device, designed for monocular use, aims to minimise the impact of the central scotoma by projecting the images onto a larger area of the photoreceptors surrounding the macula. METHODS: In this prospective multicentric observational case series study, 6 eyes of 6 patients who underwent SING-IMT™ implantations were enrolled. At baseline and 6 months follow-up, best corrected distance visual acuity (BCDV) and best corrected near visual acuity (BCNVA), intraocular pressure (IOP), anterior chamber depth, endothelial cells count were assessed. In addition, IOP was also measured at 7, 15, 30, 45 days, and at 3 months follow-up. Finally, the incidence of complications was evaluated. RESULTS: At final follow-up, in the study eyes, mean BCDVA improved by +10.0 letters (6.25; 13.8) letters and mean BCNVA improved by -0.30 logMAR (-0.55; -0.20). At postoperative month 6, we reported a mean IOP decrease of 4.50 mmHg (-5.75; -0.25). Interestingly, 83.3% of patients had an increased IOP value in at least one of the first two postoperative follow-ups (7 days and 15 days). In patients in whom intraoperative mechanical iridotomy was not performed, it was necessary to perform a postoperative YAG laser iridotomy to improve IOP management. Compared to the baseline, ECD loss at 6 months follow-up was 12.6%. CONCLUSIONS: The SING IMT™ device was found to be effective in the distance and near vision improvement, without serious postoperative complications. We recommend intraoperative mechanical iridectomy in order to easily manage post-operative IOP and to avoid sudden IOP rise with its possible consequences. These good results can be a hope to partially improve the quality of life of patients suffering from severe end stage macular atrophy.

Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness.

Objective.How can we return a functional form of sight to people who are living with incurable blindness? Despite recent advances in the development of visual neuroprostheses, the quality of current prosthetic vision is still rudimentary and does not differ much across different device technologies.Approach.Rather than aiming to represent the visual scene as naturally as possible, aSmart Bionic Eyecould provide visual augmentations through the means of artificial intelligence-based scene understanding, tailored to specific real-world tasks that are known to affect the quality of life of people who are blind, such as face recognition, outdoor navigation, and self-care.Main results.Complementary to existing research aiming to restore natural vision, we propose a patient-centered approach to incorporate deep learning-based visual augmentations into the next generation of devices.Significance.The ability of a visual prosthesis to support everyday tasks might make the difference between abandoned technology and a widely adopted next-generation neuroprosthetic device.

Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses.

Visual prostheses, used to assist in restoring functional vision to the visually impaired, convert captured external images into corresponding electrical stimulation patterns that are stimulated by implanted microelectrodes to induce phosphenes and eventually visual perception. Detecting and providing useful visual information to the prosthesis wearer under limited artificial vision has been an important concern in the field of visual prosthesis. Along with the development of prosthetic device design and stimulus encoding methods, researchers have explored the possibility of the application of computer vision by simulating visual perception under prosthetic vision. Effective image processing in computer vision is performed to optimize artificial visual information and improve the ability to restore various important visual functions in implant recipients, allowing them to better achieve their daily demands. This paper first reviews the recent clinical implantation of different types of visual prostheses, summarizes the artificial visual perception of implant recipients, and especially focuses on its irregularities, such as dropout and distorted phosphenes. Then, the important aspects of computer vision in the optimization of visual information processing are reviewed, and the possibilities and shortcomings of these solutions are discussed. Ultimately, the development direction and emphasis issues for improving the performance of visual prosthesis devices are summarized.

Ultrasound stimulation for non-invasive visual prostheses.

Globally, it is estimated there are more than 2.2 billion visually impaired people. Visual diseases such as retinitis pigmentosa, age-related macular degeneration, glaucoma, and optic neuritis can cause irreversible profound vision loss. Many groups have investigated different approaches such as microelectronic prostheses, optogenetics, stem cell therapy, and gene therapy to restore vision. However, these methods have some limitations such as invasive implantation surgery and unknown long-term risk of genetic manipulation. In addition to the safety of ultrasound as a medical imaging modality, ultrasound stimulation can be a viable non-invasive alternative approach for the sight restoration because of its ability to non-invasively control neuronal activities. Indeed, recent studies have demonstrated ultrasound stimulation can successfully modulate retinal/brain neuronal activities without causing any damage to the nerve cells. Superior penetration depth and high spatial resolution of focused ultrasound can open a new avenue in neuromodulation researches. This review summarizes the latest research results about neural responses to ultrasound stimulation. Also, this work provides an overview of technical viewpoints in the future design of a miniaturized ultrasound transducer for a non-invasive acoustic visual prosthesis for non-surgical and painless restoration of vision.

Micro-magnetic stimulation of primary visual cortex induces focal and sustained activation of secondary visual cortex.

Cortical visual prostheses that aim to restore sight to the blind require the ability to create neural activity in the visual cortex. Electric stimulation delivered via microelectrodes implanted in the primary visual cortex (V1) has been the most common approach, although conventional electrodes may not effectively confine activation to focal regions and thus the acuity they create may be limited. Magnetic stimulation from microcoils confines activation to single cortical columns of V1 and thus may prove to be more effective than conventional microelectrodes, but the ability of microcoils to drive synaptic connections has not been explored. Here, we show that magnetic stimulation of V1 using microcoils induces spatially confined activation in the secondary visual cortex (V2) in mouse brain slices. Single-loop microcoils were fabricated using platinum-iridium flat microwires, and their effectiveness was evaluated using calcium imaging and compared with that of monopolar and bipolar electrodes. Our results show that compared to the electrodes, the microcoils better confined activation to a small region in V1. In addition, they produced more precise and sustained activation in V2. The finding that microcoil-based stimulation propagates to higher visual centres raises the possibility that complex visual perception, e.g. that requiring sustained synaptic inputs, may be achievable. This article is part of the theme issue 'Advanced neurotechnologies: translating innovation for health and well-being'.

Human-in-the-loop optimization of visual prosthetic stimulation.

Objective. Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in part, to current spread, unintended axonal activation, and the limited resolution of existing devices. Here we show, using a recent model of prosthetic vision, that optimizing how visual stimuli are encoded by the device can help overcome some of these limitations, leading to dramatic improvements in visual perception.Approach. We propose a strategy to do this in practice, using patients' feedback in a visual task. The main challenge of our approach comes from the fact that, typically, one only has access to a limited number of noisy responses from patients. We propose two ways to deal with this: first, we use a model of prosthetic vision to constrain and simplify the optimization. We show that, if one knew the parameters of this model for a given patient, it would be possible to greatly improve their perceptual performance. Second we propose a preferential Bayesian optimization to efficiently learn these model parameters for each patient, using minimal trials.Main results. To test our approach, we presented healthy subjects with visual stimuli generated by a recent model of prosthetic vision, to replicate the perceptual experience of patients fitted with an implant. Our optimization procedure led to significant and robust improvements in perceived image quality, that transferred to increased performance in other tasks.Significance. Importantly, our strategy is agnostic to the type of prosthesis and thus could readily be implemented in existing implants.

A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution.

The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience.