High-resolution lensless holographic microscopy using a physics-aware deep network.

Significance: Lensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data. Aim: We aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM. Approach: We propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process. Results: Simulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells). Conclusions: We showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.

Three-Dimensional Holographic-Guided Robotic Lung Segmentectomy for Deep Pulmonary Nodules: Technique and Initial Results.

Background: Diagnosis and treatment of small and isolated lung nodules remain challenging issues. Purpose: The aim of this article is to report the technique of real-time navigation using holographic reconstruction technology combined with a robot assisted thoracic surgery (RATS) platform for lung resection in patients with small deep nodules.Research Design: The pre-surgery 3D planning was based on the chest CT scan. The reconstruction was uploaded to a head-mounted display for real-time navigation during mini invasive robot assisted surgery performed with an open console platform. We evaluated this technique with the success rate of diagnosis, the operative time and the post-operative course.Study Sample: This technique was performed in 6 patients (4 female, mean age 65 years) to date.Results: The precision of the head-mounted display based localization system was effective in all cases without the need of open conversion. The mean diameter of the nodules was 8 mm (6-9). The diagnosis was a lung cancer (n = 5) and tuberculoma (n = 1). The mean operative time was 125 min (100-145). The mean hospital stay was 2.5 days (1-3).Conclusions: In conclusion, the intraoperative navigation using the 3D holographic assistance was an helpful tool for mini invasive RATS lung segmentectomy without the need of preoperative localization.

NeuroART: Real-Time Analysis and Targeting of Neuronal Population Activity during Calcium Imaging for Informed Closed-Loop Experiments.

Two-photon calcium imaging allows for the activity readout of large populations of neurons at single cell resolution in living organisms, yielding new insights into how the brain processes information. Holographic optogenetics allows us to trigger activity of this population directly, raising the possibility of injecting information into a living brain. Optogenetic triggering of activity that mimics "natural" information, however, requires identification of stimulation targets based on real-time analysis of the functional network. We have developed NeuroART (Neuronal Analysis in Real Time), software that provides real-time readout of neuronal activity integrated with downstream analysis of correlations and synchrony and of sensory metadata. On the example of auditory stimuli, we demonstrate real-time inference of the contribution of each neuron in the field of view to sensory information processing. To avoid the limitations of microscope hardware and enable collaboration of multiple research groups, NeuroART taps into microscope data streams without the need for modification of microscope control software and is compatible with a wide range of microscope platforms. NeuroART also integrates the capability to drive a spatial light modulator (SLM) for holographic photostimulation of optimal stimulation targets, enabling real-time modification of functional networks. Neurons used for photostimulation experiments were extracted from Sprague Dawley rat embryos of both sexes.

Mixed Reality Assisted Navigation Guided Microsurgical Removal of Cranial Lesions.

AIM: To demonstrate the possible use of mixed reality (MR) technology in neurosurgery for multiple purposes, including preoperative planning, training, and three-dimensional (3D) navigation. MATERIAL AND METHODS: Using magnetic resonance imaging (MRI) and computed tomography (CT), 3D holographic images of three patients were created and inspected using a remote control. Preoperative planning was performed in a conference room using holographic images. Intraoperatively, the 3D images were matched and the adjacent structures were examined. RESULTS: The MR System (MRS) was a useful tool for preoperative planning and intraoperative navigation during the cranial intervention. It reduces operative time, decreases complication rates, increases surgical success, and enhances surgical outcomes. Eventually, MRS may be more economical. CONCLUSION: The MRS can be used for intraoperative navigation by displaying a 3D hologram at the surgeon's fingertips and for preoperative 3D examination of the lesions and its surrounding structures. The MRS enhances surgical efficacy, reduces healthcare costs, and has a shorter learning curve than the conventional methods. It also enables customized patient-specific surgery.

A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries.

BACKGROUND AND OBJECTIVE: During open surgeries, telementoring serves as a valuable tool for transferring surgical knowledge from a specialist surgeon (mentor) to an operating surgeon (mentee). Depicting the intended movements of the surgical instruments over the operative field improves the understanding of the required tool-tissue interaction. The objective of this work is to develop a telementoring system tailored for open surgeries, enabling the mentor to remotely demonstrate the necessary motions of surgical instruments to the mentee. METHODS: A remote telementoring system for open surgery was implemented. The system generates visual cues in the form of virtual surgical instrument motion augmented onto the live view of the operative field. These cues can be rendered on both conventional screens in the operating room and as dynamic holograms on a head mounted display device worn by the mentee. The technical performance of the system was evaluated, where the operating room and remote location were geographically separated and connected via the Internet. Additionally, user studies were conducted to assess the effectiveness of the system as a mentoring tool. RESULTS: The system took 307 ± 12 ms to transmit an operative field view of 1920 × 1080 resolution, along with depth information spanning 36 cm, from the operating room to the remote location. Conversely, it took 145 ± 14 ms to receive the motion of virtual surgical instruments from the remote location back to the operating room. Furthermore, the user studies demonstrated: (a) mentor's capability to annotate the operative field with an accuracy of 3.92 ± 2.1 mm, (b) mentee's ability to comprehend and replicate the motion of surgical instruments in real-time with an average deviation of 12.8 ± 3 mm, (c) efficacy of the rendered dynamic holograms in conveying information intended for surgical instrument motion. CONCLUSIONS: The study demonstrates the feasibility of transmitting information over the Internet from the mentor to the mentee in the form of virtual surgical instruments' motion and projecting it as holograms onto the live view of the operative field. This holds potential to enhance real-time collaborative capabilities between the mentor and the mentee during an open surgery.

Clinical application of mixed reality holographic imaging technology in scaling and root planing of severe periodontitis: a proof of concept.

OBJECTIVES: To demonstrate the potential application of mixed reality (MR) holographic imaging technology in subgingival scaling and root planing (SRP) for patient with advanced periodontitis. METHODS: This case series comprised the analysis of 1566 sites from 261 teeth of 10 patients with advanced periodontitis. Digital CBCT scans and intraoral scans of the patients were digitally acquired preoperatively and aligned to create a three-dimensional periodontal visualization model. Through rendering, interactive holographic images were displayed using MR. The surgeon first used MR images to communicate with the patients, and then facilitated SRP under their guidance. Probing pocket depth (PPD), clinical attachment loss (CAL), Plaque index (PI), and bleeding on probing (BOP) parameters were recorded at baseline and at 8-week postoperatively. Patient-reported outcome indicator questionnaires on self-efficacy were also collected. RESULTS: PPD, CAL, PI, and BOP significantly decreased at 8-week following MR hologram-assisted SRP (p<0.001). For sites with PPD≥4 mm, PPD and CAL declined by 2.33±1.23 mm and 0.69±1.07 mm, respectively. PI significantly decreased from 1.94±0.61 to 0.82±0.58 (p < 0.001) and BOP sites decreased significantly from 84.11% to 40.25%. After receiving MR holograms for condition communication, most patients had a better perception of the effectiveness of SRP treatment and the benefits it brings. 80% of the subjects expressed their willingness to undergo MR-assisted periodontal treatment in the future. CONCLUSION: These results provide preliminary support for MR hologram-assisted digital SRP. With this technology, images of the gingiva and alveolar bone can be displayed in real time, accurately and three-dimensionally. This improves SRP effectiveness, diminishes complications, and enhances patients' confidence in the treatment. CLINICAL SIGNIFICANCE: MR holographic imaging-based digital SRP is a clinically feasible and promising adjunctive periodontal treatment option. It may contribute to improved non-surgical treatment efficacy in patients with severe periodontitis.

Feasibility of Hologram-Assisted Bilateral Blood-Brain Barrier Opening in Non-Human Primates.

Focused ultrasound (FUS) and microbubbles facilitate blood-brain barrier opening (BBBO) noninvasively, transiently, and safely for targeted drug delivery. Unlike state-of-the-art approaches, in this study, we demonstrate for the first time the simultaneous, bilateral BBBO in non-human primates (NHPs) using acoustic holograms at caudate and putamen structures. The simple and low-cost system with a single-element FUS transducer and 3-D printed acoustic hologram was guided by neuronavigation and a robotic arm. The advantages of holograms are transcranial aberration correction, simultaneous multifocus and high localization, and target-independent transducer positioning, defining a promising alternative for time- and cost-efficient FUS procedures. Holograms were designed with the k-space method by time-reversal techniques. T1-weighted MRI was used for treatment planning, while the computed tomography (CT) scan provided the head tissues acoustic properties. For the BBBO procedure, a robotic arm allowed transducer positioning errors below 0.1 mm and 0.1°. Following positioning, 0.5-0.6-MPa, 513-kHz microbubble-enhanced FUS was applied for 4 min. For BBBO assessment, Post-FUS T1-weighted MRI was acquired, and contrast enhancement indicated bilateral gadolinium extravasation at both caudate or putamen structures. The two BBBO locations were separated by 13.13 mm with a volume of 91.81 mm3 in the caudate, compared with 9.40 mm with a volume of 124.52 mm3 in simulation, while they were separated by 21.74 mm with a volume of 145.38 mm3 in the putamen and compared with 22.32 mm with a volume of 156.42 mm3 in simulation. No neurological damage was observed through T2-weighted and susceptibility-weighted imaging. This study demonstrates the feasibility and safety of hologram-assisted neuronavigation-guided-FUS for BBBO in NHP, providing thus an avenue for clinical translation.

Off-axis digital lensless holographic microscopy based on spatially multiplexed interferometry.

Significance: Digital holographic microscopy (DHM) is a label-free microscopy technique that provides time-resolved quantitative phase imaging (QPI) by measuring the optical path delay of light induced by transparent biological samples. DHM has been utilized for various biomedical applications, such as cancer research and sperm cell assessment, as well as for in vitro drug or toxicity testing. Its lensless version, digital lensless holographic microscopy (DLHM), is an emerging technology that offers size-reduced, lightweight, and cost-effective imaging systems. These features make DLHM applicable, for example, in limited resource laboratories, remote areas, and point-of-care applications. Aim: In addition to the abovementioned advantages, in-line arrangements for DLHM also include the limitation of the twin-image presence, which can restrict accurate QPI. We therefore propose a compact lensless common-path interferometric off-axis approach that is capable of quantitative imaging of fast-moving biological specimens, such as living cells in flow. Approach: We suggest lensless spatially multiplexed interferometric microscopy (LESSMIM) as a lens-free variant of the previously reported spatially multiplexed interferometric microscopy (SMIM) concept. LESSMIM comprises a common-path interferometric architecture that is based on a single diffraction grating to achieve digital off-axis holography. From a series of single-shot off-axis holograms, twin-image free and time-resolved QPI is achieved by commonly used methods for Fourier filtering-based reconstruction, aberration compensation, and numerical propagation. Results: Initially, the LESSMIM concept is experimentally demonstrated by results from a resolution test chart and investigations on temporal stability. Then, the accuracy of QPI and capabilities for imaging of living adherent cell cultures is characterized. Finally, utilizing a microfluidic channel, the cytometry of suspended cells in flow is evaluated. Conclusions: LESSMIM overcomes several limitations of in-line DLHM and provides fast time-resolved QPI in a compact optical arrangement. In summary, LESSMIM represents a promising technique with potential biomedical applications for fast imaging such as in imaging flow cytometry or sperm cell analysis.

Holographic mixed reality for planning transcatheter aortic valve replacement.

BACKGROUND: Using three-dimensional (3D) modalities for optimal pre-procedure planning in transcatheter aortic valve replacement (TAVR) is critical for procedural success. However, current methods rely on visualizing images on a two-dimensional screen, using shading and colors to create the illusion of 3D, potentially impeding the accurate comprehension of the actual anatomy structures. In contrast, a new Mixed Reality (MxR) based software enables accurate 3D visualization, imaging manipulation, and quantification of measurements. AIMS: The study aims to evaluate the feasibility, reproducibility, and accuracy of dimensions of the aortic valve complex as measured with a new holographic MxR software (ARTICOR®, Artiness srl, Milano, Italy) compared to a widely used software for pre-operative sizing and planning (3mensio Medical Imaging BV, Bilthoven, The Netherlands). METHODS: This retrospective, observational, double-center study enrolled 100 patients with severe aortic stenosis who underwent cardiac computed tomography (CCT) before TAVR. The CCT datasets of volumetric aortic valve images were analyzed using 3Mensio and newly introduced MxR-based software. RESULTS: Ninety-eight percent of the CCT datasets were successfully converted into holographic models. A higher level of agreement between the two software systems was observed for linear metrics (short, long, and average diameter). In comparison, agreement was lower for area, perimeter, and annulus-to-coronary ostia distance measurements. Notably, the annulus area, annular perimeter, left ventricular outflow tract (LVOT) area, and LVOT perimeter were significantly and consistently smaller with the MxR-based software compared to the 3Mensio. Excellent interobserver reliability was demonstrated for most measurements, especially for direct linear measurements. CONCLUSIONS: Linear measurements of the aortic valve complex using MxR-based software are reproducible compared to the standard CCT dataset analyzed with 3Mensio. MxR-based software could represent an accurate tool for the pre-procedural planning of TAVR.

Holo-Stroke: Assessing for Immersive Stroke Care Through Stroke Hologram Teleportation.

Background: Augmented reality enables the wearer to see both their physical environment and virtual objects. Holograms could allow 3D video of providers to be transmitted to distant sites, allowing patients to interact with virtual providers as if they are in the same physical space. Our aim was to determine if Tele-Stroke augmented with Holo-Stroke, compared with Tele-Stroke alone, could improve satisfaction and perception of immersion for the patient. Methods: Kinect cameras positioned at 90-degree intervals around the hub practitioner were used. Cameras streamed real-time optical video to a unity point-cloud program where the data were stitched together in a 360-degree view. The resultant hologram was positioned in 3D space and was visible through the head-mounted display by the patient. Radiology images were shared in Tele-Stroke and via hologram. Likert satisfaction questions were administered. Wilcoxon signed-rank testing was used. Results: Each of the 30 neurology clinic participants scored both Tele-Stroke and Holo-Stroke. Out of these, 29 patients completed the assessments (1 failure owing to computer reboot). Average age was 52 years, with 53.3% of the patients being female, 70.0% being White, and 13.3% being Hispanic. Likert scale score median "Overall" was 32 Tele-Stroke versus 48 Holo-Stroke (p < 0.00001), "Immersion" was 5 versus 10 (p < 0.00001), "Beneficial Technique" was 6 versus 10 (p < 0.00001), and "Ability to See Images" was 5 versus 10 (p < 0.00001). Discussion: Holo-Stroke 3D holographic Tele-Stroke exams resulted in feasibility, satisfaction, and high perception of immersion for the patient. Patients were enthusiastic for the more immersive, personal discussion with their provider and a robust way to experience radiology images. Though further assessments are needed, Holo-Stroke can help the provider "be there, not just see there!"

Holographic surface relief diffraction gratings made of hydrogels for direct label-free biosensing of IgGs.

This work describes the development of a label-free (LF) biosensing platform for the direct detection of targets based on diffractive structures fabricated with acrylamide-based hydrogels biofunctionalized with proteins and antibodies. Hydrogels containing Bovine Serum Albumin protein (BSA) with different crosslinking degrees were synthesized and characterized to find the optimal conditions for the suitable fabrication of surface relief gratings (SRGs). The bioavailability of BSA-functionalized hydrogels for the specific recognition of anti-BSA antibodies was verified by fluorescence detection. After the hydrogel-based SRG fabrication, diffraction efficiency measures at two different laser wavelengths were used for the direct LF detection of anti-BSA antibodies. The limit of detection in the sub mg L-1 range was read. Additionally, SRGs were prepared with hydrogels biofunctionalized with anti-rabbit antibodies for the direct detection of IgGs from rabbit serum, obtaining similar analytical performance without the necessity of labeling or applying amplification strategies.

Label-free three-dimensional imaging and quantitative analysis of living fibroblasts and myofibroblasts by holotomographic microscopy.

Holotomography (HT) is a cutting-edge fast live-cell quantitative label-free imaging technique. Based on the principle of quantitative phase imaging, it combines holography and tomography to record a three-dimensional map of the refractive index, used as intrinsic optical and quantitative imaging contrast parameter of biological samples, at a sub-micrometer spatial resolution. In this study HT has been employed for the first time to analyze the changes of fibroblasts differentiating towards myofibroblasts - recognized as the main cell player of fibrosis - when cultured in vitro with the pro-fibrotic factor, namely transforming growth factor-ß1. In parallel, F-actin, vinculin, α-smooth muscle actin, phospho-myosin light chain 2, type-1 collagen, peroxisome proliferator-activated receptor-gamma coactivator-1α expression and mitochondria were evaluated by confocal laser scanning microscopy. Plasmamembrane passive properties and transient receptor potential canonical channels' currents were also recorded by whole-cell patch-clamp. The fluorescence images and electrophysiological results have been compared to the data obtained by HT and their congruence has been discussed. HT turned out to be a valid approach to morphologically distinguish fibroblasts from well differentiated myofibroblasts while obtaining objective measures concerning volume, surface area, projection area, surface index and dry mass (i.e., the mass of the non-aqueous content inside the cell including proteins and subcellular organelles) of the entire cell, nuclei and nucleoli with the major advantage to monitor outer and inner features in living cells in a non-invasive, rapid and label-free approach. HT might open up new research opportunities in the field of fibrotic diseases. RESEARCH HIGHLIGHTS: Holotomography (HT) is a label-free laser interferometric imaging technology exploiting the intrinsic optical property of cells namely refractive index (RI) to enable a direct imaging and analysis of whole cells or intracellular organelles. HT turned out a valid approach to distinguish morphological features of living unlabeled fibroblasts from differentiated myofibroblasts. HT provided quantitative information concerning volume, surface area, projection area, surface index and dry mass of the entire fibroblasts/myofibroblasts, nuclei and nucleoli.

Implant placement using mixed reality-based dynamic navigation: A proof of concept.

OBJECTIVES: To present the first clinical application of a novel mixed reality-based dynamic navigation (MR-DN) system in the rehabilitation of a single tooth gap. METHODS: The protocol consisted of the following: (1) three-dimensional patient data acquisition using intraoral scanning (IOS) and cone-beam computed tomography (CBCT), (2) implant planning using guided surgery software, (3) holography-guided implant placement using the novel MR-DN system (ANNA®, MARS Dental, Haifa, Israel) and (4) placement accuracy verification. RESULTS: The novel MR-DN system was safe and time-efficient, as the surgery took 30 min from anaesthesia to suturing. The accuracy of implant placement was high with minimal deviations recorded in the three planes of space compared to the presurgical planning: the error at the entry point planar distance (XY) was 0.381 mm, and the entry point planar distance (Z) was 0.173 mm, for a 3D entry point distance (En) of 0.417 mm. A 3D apex deviation (An) of 0.193 mm was registered, with an angle difference of 1.852° Conclusions: This proof-of-concept study demonstrated the clinical feasibility of MR-DN for guided implant placement in single tooth gaps. Further clinical studies on a large sample of patients are needed to confirm these positive preliminary results. Statement of clinical relevance: The use of MR-DN can change the perspectives of guided dental implant surgery as a possible alternative to the classic static and dynamic guided surgical techniques for the rehabilitation of single tooth gaps.

Single-beam digital holographic reconstruction: a phase-support enhanced complex wavefront on phase-only function for twin-image elimination.

Significance: In in-line digital holographic microscopy (DHM), twin-image artifacts pose a significant challenge, and reduction or complete elimination is essential for object reconstruction. Aim: To facilitate object reconstruction using a single hologram, significantly reduce inaccuracies, and avoid iterative processing, a digital holographic reconstruction algorithm called phase-support constraint on phase-only function (PCOF) is presented. Approach: In-line DHM simulations and tabletop experiments employing the sliding-window approach are used to compute the arithmetic mean and variance of the phase values in the reconstructed image. A support constraint mask, through variance thresholding, effectively enabled twin-image artifacts. Results: Quantitative evaluations using metrics such as mean squared error, peak signal-to-noise ratio, and mean structural similarity index show PCOF's superior capability in eliminating twin-image artifacts and achieving high-fidelity reconstructions compared with conventional methods such as angular spectrum and iterative phase retrieval methods. Conclusions: PCOF stands as a promising approach to in-line digital holographic reconstruction, offering a robust solution to mitigate twin-image artifacts and enhance the fidelity of reconstructed objects.

Acoustic-holography-patterned primary hepatocytes possess liver functions.

Acoustic holography (AH), a promising approach for cell patterning, emerges as a powerful tool for constructing novel invitro 3D models that mimic organs and cancers features. However, understanding changes in cell function post-AH remains limited. Furthermore, replicating complex physiological and pathological processes solely with cell lines proves challenging. Here, we employed acoustical holographic lattice to assemble primary hepatocytes directly isolated from mice into a cell cluster matrix to construct a liver-shaped tissue sample. For the first time, we evaluated the liver functions of AH-patterned primary hepatocytes. The patterned model exhibited large numbers of self-assembled spheroids and superior multifarious core hepatocyte functions compared to cells in 2D and traditional 3D culture models. AH offers a robust protocol for long-term in vitro culture of primary cells, underscoring its potential for future applications in disease pathogenesis research, drug testing, and organ replacement therapy.

Connectomic reconstruction of a female Drosophila ventral nerve cord.

A deep understanding of how the brain controls behaviour requires mapping neural circuits down to the muscles that they control. Here, we apply automated tools to segment neurons and identify synapses in an electron microscopy dataset of an adult female Drosophila melanogaster ventral nerve cord (VNC)1, which functions like the vertebrate spinal cord to sense and control the body. We find that the fly VNC contains roughly 45 million synapses and 14,600 neuronal cell bodies. To interpret the output of the connectome, we mapped the muscle targets of leg and wing motor neurons using genetic driver lines2 and X-ray holographic nanotomography3. With this motor neuron atlas, we identified neural circuits that coordinate leg and wing movements during take-off. We provide the reconstruction of VNC circuits, the motor neuron atlas and tools for programmatic and interactive access as resources to support experimental and theoretical studies of how the nervous system controls behaviour.

Probing multiplexed basal dendritic computations using two-photon 3D holographic uncaging.

Basal dendrites of layer 5 cortical pyramidal neurons exhibit Na+ and N-methyl-D-aspartate receptor (NMDAR) regenerative spikes and are uniquely poised to influence somatic output. Nevertheless, due to technical limitations, how multibranch basal dendritic integration shapes and enables multiplexed barcoding of synaptic streams remains poorly mapped. Here, we combine 3D two-photon holographic transmitter uncaging, whole-cell dynamic clamp, and biophysical modeling to reveal how synchronously activated synapses (distributed and clustered) across multiple basal dendritic branches are multiplexed under quiescent and in vivo-like conditions. While dendritic regenerative Na+ spikes promote millisecond somatic spike precision, distributed synaptic inputs and NMDAR spikes regulate gain. These concomitantly occurring dendritic nonlinearities enable multiplexed information transfer amid an ongoing noisy background, including under back-propagating voltage resets, by barcoding the axo-somatic spike structure. Our results unveil a multibranch dendritic integration framework in which dendritic nonlinearities are critical for multiplexing different spatial-temporal synaptic input patterns, enabling optimal feature binding.

A prostate seed implantation robot system based on human-computer interactions: Augmented reality and voice control.

The technology of robot-assisted prostate seed implantation has developed rapidly. However, during the process, there are some problems to be solved, such as non-intuitive visualization effects and complicated robot control. To improve the intelligence and visualization of the operation process, a voice control technology of prostate seed implantation robot in augmented reality environment was proposed. Initially, the MRI image of the prostate was denoised and segmented. The three-dimensional model of prostate and its surrounding tissues was reconstructed by surface rendering technology. Combined with holographic application program, the augmented reality system of prostate seed implantation was built. An improved singular value decomposition three-dimensional registration algorithm based on iterative closest point was proposed, and the results of three-dimensional registration experiments verified that the algorithm could effectively improve the three-dimensional registration accuracy. A fusion algorithm based on spectral subtraction and BP neural network was proposed. The experimental results showed that the average delay of the fusion algorithm was 1.314 s, and the overall response time of the integrated system was 1.5 s. The fusion algorithm could effectively improve the reliability of the voice control system, and the integrated system could meet the responsiveness requirements of prostate seed implantation.