RESUMO
Only recently have more specific circuit-probing techniques become available to inform previous reports implicating the rodent hippocampus in orexigenic appetitive processing1-4. This function has been reported to be mediated at least in part by lateral hypothalamic inputs, including those involving orexigenic lateral hypothalamic neuropeptides, such as melanin-concentrating hormone5,6. This circuit, however, remains elusive in humans. Here we combine tractography, intracranial electrophysiology, cortico-subcortical evoked potentials, and brain-clearing 3D histology to identify an orexigenic circuit involving the lateral hypothalamus and converging in a hippocampal subregion. We found that low-frequency power is modulated by sweet-fat food cues, and this modulation was specific to the dorsolateral hippocampus. Structural and functional analyses of this circuit in a human cohort exhibiting dysregulated eating behaviour revealed connectivity that was inversely related to body mass index. Collectively, this multimodal approach describes an orexigenic subnetwork within the human hippocampus implicated in obesity and related eating disorders.
Assuntos
Hipocampo , Vias Neurais , Orexinas , Humanos , Índice de Massa Corporal , Estudos de Coortes , Sinais (Psicologia) , Eletrofisiologia , Potenciais Evocados/fisiologia , Transtornos da Alimentação e da Ingestão de Alimentos/metabolismo , Comportamento Alimentar , Alimentos , Hipocampo/anatomia & histologia , Hipocampo/citologia , Hipocampo/metabolismo , Obesidade/metabolismo , Orexinas/metabolismoRESUMO
Plastic surgeons routinely use 3D-models in their clinical practice, from 3D-photography and surface imaging to 3D-segmentations from radiological scans. However, these models continue to be viewed on flattened 2D screens that do not enable an intuitive understanding of 3D-relationships and cause challenges regarding collaboration with colleagues. The Metaverse has been proposed as a new age of applications building on modern Mixed Reality headset technology that allows remote collaboration on virtual 3D-models in a shared physical-virtual space in real-time. We demonstrate the first use of the Metaverse in the context of reconstructive surgery, focusing on preoperative planning discussions and trainee education. Using a HoloLens headset with the Microsoft Mesh application, we performed planning sessions for 4 DIEP-flaps in our reconstructive metaverse on virtual patient-models segmented from routine CT angiography. In these sessions, surgeons discuss perforator anatomy and perforator selection strategies whilst comprehensively assessing the respective models. We demonstrate the workflow for a one-on-one interaction between an attending surgeon and a trainee in a video featuring both viewpoints as seen through the headset. We believe the Metaverse will provide novel opportunities to use the 3D-models that are already created in everyday plastic surgery practice in a more collaborative, immersive, accessible, and educational manner.
RESUMO
BACKGROUND: Microsurgical breast reconstruction using abdominal tissue is a complex procedure, in part, due to variable vascular/perforator anatomy. Preoperative computed tomography angiography (CTA) has mitigated this challenge to some degree; yet it continues to pose certain challenges. The ability to map perforators with Mixed Reality has been demonstrated in case studies, but its accuracy has not been studied intraoperatively. Here, we compare the accuracy of "HoloDIEP" in identifying perforator location (vs. Doppler ultrasound) by using holographic 3D models derived from preoperative CTA. METHODS: Using a custom application on HoloLens, the deep inferior epigastric artery vascular tree was traced in 15 patients who underwent microsurgical breast reconstruction. Perforator markings were compared against the 3D model in a coordinate system centered on the umbilicus. Holographic- and Doppler-identified markings were compared using a perspective-corrected photo technique against the 3D model along with measurement of duration of perforator mapping for each technique. RESULTS: Vascular points in HoloDIEP skin markings were -0.97 ± 6.2 mm (perforators: -0.62 ± 6.13 mm) away from 3D-model ground-truth in radial length from the umbilicus at a true distance of 10.81 ± 6.14 mm (perforators: 11.40 ± 6.15 mm). Absolute difference in radial distance was twice as high for Doppler markings compared with Holo-markings (9.71 ± 6.16 and 4.02 ± 3.20 mm, respectively). Only in half of all cases (7/14), more than 50% of the Doppler-identified points were reasonably close (<30 mm) to 3D-model ground-truth. HoloDIEP was twice as fast as Doppler ultrasound (76.9s vs. 150.4 s per abdomen). CONCLUSION: HoloDIEP allows for faster and more accurate intraoperative perforator mapping than Doppler ultrasound.
RESUMO
Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices' safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration's public workshop, "Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine" and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.
Assuntos
Realidade Aumentada , Medicina , Realidade Virtual , Estados Unidos , HumanosRESUMO
Diffusion spectrum MRI (DSI) provides model-free estimation of the diffusion ensemble average propagator (EAP) and orientation distribution function (ODF) but requires the diffusion data to be acquired on a Cartesian q-space grid. Multi-shell diffusion acquisitions are more flexible and more commonly acquired but have, thus far, only been compatible with model-based analysis methods. Here, we propose a generalized DSI (GDSI) framework to recover the EAP from multi-shell diffusion MRI data. The proposed GDSI approach corrects for q-space sampling density non-uniformity using a fast geometrical approach. The EAP is directly calculated in a preferable coordinate system by multiplying the sampling density corrected q-space signals by a discrete Fourier transform matrix, without any need for gridding. The EAP is demonstrated as a way to map diffusion patterns in brain regions such as the thalamus, cortex and brainstem where the tissue microstructure is not as well characterized as in white matter. Scalar metrics such as the zero displacement probability and displacement distances at different fractions of the zero displacement probability were computed from the recovered EAP to characterize the diffusion pattern within each voxel. The probability averaged across directions at a specific displacement distance provides a diffusion property based image contrast that clearly differentiates tissue types. The displacement distance at the first zero crossing of the EAP averaged across directions orthogonal to the primary fiber orientation in the corpus callosum is found to be larger in the body (5.65⯱â¯0.09⯵m) than in the genu (5.55⯱â¯0.15⯵m) and splenium (5.4⯱â¯0.15⯵m) of the corpus callosum, which corresponds well to prior histological studies. The EAP also provides model-free representations of angular structure such as the diffusion ODF, which allows estimation and comparison of fiber orientations from both the model-free and model-based methods on the same multi-shell data. For the model-free methods, detection of crossing fibers is found to be strongly dependent on the maximum b-value and less sensitive compared to the model-based methods. In conclusion, our study provides a generalized DSI approach that allows flexible reconstruction of the diffusion EAP and ODF from multi-shell diffusion data and data acquired with other sampling patterns.
Assuntos
Encéfalo/diagnóstico por imagem , Imagem de Difusão por Ressonância Magnética/métodos , Processamento de Imagem Assistida por Computador/métodos , Neuroimagem/métodos , Simulação por Computador , HumanosRESUMO
Dysregulation of the nucleus accumbens (NAc) is implicated in numerous neuropsychiatric disorders. Treatments targeting this area directly (e.g. deep brain stimulation) demonstrate variable efficacy, perhaps owing to non-specific targeting of a functionally heterogeneous nucleus. Here we provide support for this notion, first observing disparate behavioral effects in response to direct simulation of different locations within the NAc in a human patient. These observations motivate a segmentation of the NAc into subregions, which we produce from a diffusion-tractography based analysis of 245 young, unrelated healthy subjects. We further explore the mechanism of these stimulation-induced behavioral responses by identifying the most probable subset of axons activated using a patient-specific computational model. We validate our diffusion-based segmentation using evidence from several modalities, including MRI-based measures of function and microstructure, human post-mortem immunohistochemical staining, and cross-species comparison of cortical-NAc projections that are known to be conserved. Finally, we visualize the passage of individual axon bundles through one NAc subregion in a post-mortem human sample using CLARITY 3D histology corroborated by 7T tractography. Collectively, these findings extensively characterize human NAc subregions and provide insight into their structural and functional distinctions with implications for stereotactic treatments targeting this region.
Assuntos
Axônios/fisiologia , Córtex Cerebral/anatomia & histologia , Córtex Cerebral/fisiologia , Núcleo Accumbens/anatomia & histologia , Núcleo Accumbens/fisiologia , Animais , Mapeamento Encefálico/métodos , Córtex Cerebral/diagnóstico por imagem , Imagem de Tensor de Difusão , Estimulação Elétrica , Feminino , Humanos , Processamento de Imagem Assistida por Computador , Masculino , Camundongos , Modelos Neurológicos , Vias Neurais/anatomia & histologia , Vias Neurais/diagnóstico por imagem , Vias Neurais/fisiologia , Núcleo Accumbens/diagnóstico por imagemRESUMO
Background and Purpose- Many restorative therapies have been used to study brain repair after stroke. These therapeutic-induced changes have revealed important insights on brain repair and recovery mechanisms; however, the intrinsic changes that occur in spontaneously recovery after stroke is less clear. The goal of this study is to elucidate the intrinsic changes in spontaneous recovery after stroke, by directly investigating the transcriptome of primary motor cortex in mice that naturally recovered after stroke. Methods- Male C57BL/6J mice were subjected to transient middle cerebral artery occlusion. Functional recovery was evaluated using the horizontal rotating beam test. A novel in-depth lesion mapping analysis was used to evaluate infarct size and locations. Ipsilesional and contralesional primary motor cortices (iM1 and cM1) were processed for RNA-sequencing transcriptome analysis. Results- Cluster analysis of the stroke mice behavior performance revealed 2 distinct recovery groups: a spontaneously recovered and a nonrecovered group. Both groups showed similar lesion profile, despite their differential recovery outcome. RNA-sequencing transcriptome analysis revealed distinct biological pathways in the spontaneously recovered stroke mice, in both iM1 and cM1. Correlation analysis revealed that 38 genes in the iM1 were significantly correlated with improved recovery, whereas 74 genes were correlated in the cM1. In particular, ingenuity pathway analysis highlighted the involvement of cAMP signaling in the cM1, with selective reduction of Adora2a (adenosine receptor A2A), Drd2 (dopamine receptor D2), and Pde10a (phosphodiesterase 10A) expression in recovered mice. Interestingly, the expressions of these genes in cM1 were negatively correlated with behavioral recovery. Conclusions- Our RNA-sequencing data revealed a panel of recovery-related genes in the motor cortex of spontaneously recovered stroke mice and highlighted the involvement of contralesional cortex in spontaneous recovery, particularly Adora2a, Drd2, and Pde10a-mediated cAMP signaling pathway. Developing drugs targeting these candidates after stroke may provide beneficial recovery outcome.
Assuntos
Infarto da Artéria Cerebral Média/genética , Córtex Motor/metabolismo , RNA Mensageiro/metabolismo , Recuperação de Função Fisiológica/genética , Animais , Análise por Conglomerados , AMP Cíclico/metabolismo , Perfilação da Expressão Gênica , Infarto da Artéria Cerebral Média/diagnóstico por imagem , Infarto da Artéria Cerebral Média/patologia , Infarto da Artéria Cerebral Média/fisiopatologia , Imageamento por Ressonância Magnética , Camundongos , Córtex Motor/diagnóstico por imagem , Córtex Motor/patologia , Córtex Motor/fisiopatologia , Diester Fosfórico Hidrolases/genética , Receptor A2A de Adenosina/genética , Receptores de Dopamina D2/genética , Receptores de Prostaglandina E Subtipo EP4/genética , Remissão Espontânea , Análise de Sequência de RNA , Transdução de Sinais , Acidente Vascular Cerebral/diagnóstico por imagem , Acidente Vascular Cerebral/genética , Acidente Vascular Cerebral/patologia , Acidente Vascular Cerebral/fisiopatologiaRESUMO
PURPOSE: The purpose of this study is to develop double diffusion encoding (DDE) MRI methods for clinical use. Microscopic diffusion anisotropy measurements from DDE promise greater specificity to changes in tissue microstructure compared with conventional diffusion tensor imaging, but implementation of DDE sequences on whole-body MRI scanners is challenging because of the limited gradient strengths and lengthy acquisition times. METHODS: A custom single-refocused DDE sequence was implemented on a 3T whole-body scanner. The DDE gradient orientation scheme and sequence parameters were optimized based on a Gaussian diffusion assumption. Using an optimized 5-min DDE acquisition, microscopic fractional anisotropy (µFA) maps were acquired for the first time in multiple sclerosis patients. RESULTS: Based on simulations and in vivo human measurements, six parallel and six orthogonal diffusion gradient pairs were found to be the minimum number of diffusion gradient pairs necessary to produce a rotationally invariant measurement of µFA. Simulations showed that optimal precision and accuracy of µFA measurements were obtained using b-values between 1500 and 3000 s/mm2 . The µFA maps showed improved delineation of multiple sclerosis lesions compared with conventional fractional anisotropy and distinct contrast from T2 -weighted fluid attenuated inversion recovery and T1 -weighted imaging. CONCLUSION: The µFA maps can be measured using DDE in a clinical setting and may provide new opportunities for characterizing multiple sclerosis lesions and other types of tissue degeneration. Magn Reson Med 80:507-520, 2018. © 2017 International Society for Magnetic Resonance in Medicine.
Assuntos
Encéfalo/diagnóstico por imagem , Imagem de Difusão por Ressonância Magnética/métodos , Processamento de Imagem Assistida por Computador/métodos , Adulto , Simulação por Computador , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Esclerose Múltipla/diagnóstico por imagem , Substância Branca/diagnóstico por imagemRESUMO
Despite the widespread use of magnetic resonance imaging (MRI) of the brain, the relative contribution of different biological components (e.g. lipids and proteins) to structural MRI contrasts (e.g., T1, T2, T2*, proton density, diffusion) remains incompletely understood. This limitation can undermine the interpretation of clinical MRI and hinder the development of new contrast mechanisms. Here, we determine the respective contribution of lipids and proteins to MRI contrast by removing lipids and preserving proteins in mouse brains using CLARITY. We monitor the temporal dynamics of tissue clearance via NMR spectroscopy, protein assays and optical emission spectroscopy. MRI of cleared brain tissue showed: 1) minimal contrast on standard MRI sequences; 2) increased relaxation times; and 3) diffusion rates close to free water. We conclude that lipids, present in myelin and membranes, are a dominant source of MRI contrast in brain tissue.
Assuntos
Química Encefálica , Encéfalo/diagnóstico por imagem , Lipídeos , Imageamento por Ressonância Magnética , Proteínas , Animais , Espectroscopia de Ressonância Magnética , Camundongos , Neuroimagem/métodos , Fixação de Tecidos/métodosRESUMO
In this work, we show for the first time that the tangential diffusion component is orientationally coherent at the human cortical surface. Using diffusion magnetic resonance imaging (dMRI), we have succeeded in tracking intracortical fiber pathways running tangentially within the cortex. In contrast with histological methods, which reveal little regarding 3-dimensional organization in the human brain, dMRI delivers additional understanding of the layer dependence of the fiber orientation. A postmortem brain block was measured at very high angular and spatial resolution. The dMRI data had adequate resolution to allow analysis of the fiber orientation within 4 notional cortical laminae. We distinguished a lamina at the cortical surface where diffusion was tangential along the surface, a lamina below the surface where diffusion was mainly radial, an internal lamina covering the Stria of Gennari, where both strong radial and tangential diffusion could be observed, and a deep lamina near the white matter, which also showed mainly radial diffusion with a few tangential compartments. The measurement of the organization of the tangential diffusion component revealed a strong orientational coherence at the cortical surface.
Assuntos
Córtex Cerebral/anatomia & histologia , Imagem de Difusão por Ressonância Magnética , Idoso , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Vias Neurais/anatomia & histologiaRESUMO
During the last five years ultra-high-field magnetic resonance imaging (MRI) has enabled an unprecedented view of living human brain. Brain tissue contrast in most MRI sequences is known to reflect mainly the spatial distributions of myelin and iron. These distributions have been shown to overlap significantly in many brain regions, especially in the cortex. It is of increasing interest to distinguish and identify cortical areas by their appearance in MRI, which has been shown to be feasible in vivo. Parcellation can benefit greatly from quantification of the independent contributions of iron and myelin to MRI contrast. Recent studies using susceptibility mapping claim to allow such a separation of the effects of myelin and iron in MRI. We show, using post-mortem human brain tissue, that this goal can be achieved. After MRI scanning of the block with appropriate T1 mapping and T2* weighted sequences, we section the block and apply a novel technique, proton induced X-ray emission (PIXE), to spatially map iron, phosphorus and sulfur elemental concentrations, simultaneously with 1µm spatial resolution. Because most brain phosphorus is located in myelin phospholipids, a calibration step utilizing element maps of sulfur enables semi-quantitative ex vivo mapping of myelin concentration. Combining results for iron and myelin concentration in a linear model, we have accurately modeled MRI tissue contrasts. Conversely, iron and myelin concentrations can now be estimated from appropriate MRI measurements in post-mortem brain samples.
Assuntos
Química Encefálica , Ferro/análise , Proteínas da Mielina/análise , Idoso , Feminino , Humanos , Imageamento por Ressonância Magnética , Masculino , Pessoa de Meia-IdadeRESUMO
BACKGROUND: Autologous breast reconstruction yields improved long-term aesthetic results but requires increased resources of practitioners and hospital systems. Innovations in radiographic imaging have been increasingly used to improve the efficiency and success of free flap harvest. Augmented reality affords the opportunity to superimpose relevant imaging on a surgeon's native field of view, potentially facilitating dissection of anatomically variable structures. To validate the spatial fidelity of augmented reality projections of deep inferior epigastric perforator flap-relevant anatomy, comparisons of three-dimensional (3D) models and their virtual renderings were performed by four independent observers. Measured discrepancies between the real and holographic models were evaluated. METHODS: The 3D-printed models of deep inferior epigastric perforator flap-relevant anatomy were fabricated from computed tomographic angiography data from 19 de-identified patients. The corresponding computed tomographic angiography data were similarly formatted for the Microsoft HoloLens to generate corresponding projections. Anatomic points were initially measured on 3D models, after which the corresponding points were measured on the HoloLens projections from two separate vantage points (V1 and V2). Statistical analyses, including generalized linear modeling, were performed to characterize spatial fidelity regarding translation, rotation, and scale of holographic projections. RESULTS: Among all participants, the median translational displacement at corresponding points was 9.0 mm between the real-3D model and V1, 12.1 mm between the 3D model and V2, and 13.5 mm between V1 and V2. CONCLUSION: Corresponding points, including topography of perforating vessels, for the purposes of breast reconstruction can be identified within millimeters, but there remain multiple independent contributors of error, most notably the participant and location at which the projection is perceived.
Assuntos
Realidade Aumentada , Mamoplastia , Retalho Perfurante , Humanos , Retalho Perfurante/irrigação sanguínea , Mamoplastia/métodos , Angiografia por Tomografia Computadorizada , Tomografia Computadorizada por Raios X/métodos , Artérias EpigástricasRESUMO
Preoperative CT angiography (CTA) is increasingly performed prior to perforator flap-based reconstruction. However, radiological 2D thin-slices do not allow for intuitive interpretation and translation to intraoperative findings. 3D volume rendering has been used to alleviate the need for mental 2D-to-3D abstraction. Even though volume rendering allows for a much easier understanding of anatomy, it currently has limited utility as the skin obstructs the view of critical structures. Using free, open-source software, we introduce a new skin-masking technique that allows surgeons to easily create a segmentation mask of the skin that can later be used to toggle the skin on and off. Additionally, the mask can be used in other rendering applications. We use Cinematic Anatomy for photorealistic volume rendering and interactive exploration of the CTA with and without skin. We present results from using this technique to investigate perforator anatomy in deep inferior epigastric perforator flaps and demonstrate that the skin-masking workflow is performed in less than 5 minutes. In Cinematic Anatomy, the view onto the abdominal wall and especially onto perforators becomes significantly sharper and more detailed when no longer obstructed by the skin. We perform a virtual, partial muscle dissection to show the intramuscular and submuscular course of the perforators. The skin-masking workflow allows surgeons to improve arterial and perforator detail in volume renderings easily and quickly by removing skin and could alternatively also be performed solely using open-source and free software. The workflow can be easily expanded to other perforator flaps without the need for modification.
RESUMO
We introduce a novel technique using augmented reality (AR) on smartphones and tablets, making it possible for surgeons to review perforator anatomy in three dimensions on the go. Autologous breast reconstruction with abdominal flaps remains challenging due to the highly variable anatomy of the deep inferior epigastric artery. Computed tomography angiography has mitigated some but not all challenges. Previously, volume rendering and different headsets were used to enable better three-dimensional (3D) review for surgeons. However, surgeons have been dependent on others to provide 3D imaging data. Leveraging the ubiquity of Apple devices, our approach permits surgeons to review 3D models of deep inferior epigastric artery anatomy segmented from abdominal computed tomography angiography directly on their iPhone/iPad. Segmentation can be performed in common radiology software. The models are converted to the universal scene description zipped format, which allows immediate use on Apple devices without third-party software. They can be easily shared using secure, Health Insurance Portability and Accountability Act-compliant sharing services already provided by most hospitals. Surgeons can simply open the file on their mobile device to explore the images in 3D using "object mode" natively without additional applications or can switch to AR mode to pin the model in their real-world surroundings for intuitive exploration. We believe patient-specific 3D anatomy models are a powerful tool for intuitive understanding and communication of complex perforator anatomy and would be a valuable addition in routine clinical practice and education. Using this one-click solution on existing devices that is simple to implement, we hope to streamline the adoption of AR models by plastic surgeons.
RESUMO
Preoperative vascular imaging has become standard practice in the planning of microsurgical breast reconstruction. Currently, translating perforator locations from radiological findings to a patient's abdomen is often not easy or intuitive. Techniques using three-dimensional printing or patient-specific guides have been introduced to superimpose anatomy onto the abdomen for reference. Augmented and mixed reality is currently actively investigated for perforator mapping by superimposing virtual models directly onto the patient. Most techniques have found only limited adoption due to complexity and price. Additionally, a critical step is aligning virtual models to patients. We propose repurposing suture packaging as an image tracking marker. Tracking markers allow quick and easy alignment of virtual models to the individual patient's anatomy. Current techniques are often complicated or expensive and limit intraoperative use of augmented reality models. Suture packs are sterile, readily available, and can be used to align abdominal models on the patients. Using an iPad, the augmented reality models automatically align in the correct position by using a suture pack as a tracking marker. Given the ubiquity of iPads, the combination of these devices with readily available suture packs will predictably lower the barrier to entry and utilization of this technology. Here, our workflow is presented along with its intraoperative utilization. Additionally, we investigated the accuracy of this technology.
RESUMO
As the oscillating gradient spin-echo sequence has shown promise as a means to probe tissue microstructure, it was applied here to diffusion-tensor imaging of in vivo rat brain. The apparent diffusion tensor (ADT) was estimated for motion-probing gradient (MPG) frequencies in the range 33.3-133.3 Hz, and regions-of-interest (ROIs) in the corpus callosum (CC), visual cortex (VC), cerebellar white matter (CBWM) and cerebellar grey matter (CBGM) were selected for detailed analysis. There were substantial, approximately linear changes to the ADT with increasing MPG frequency for all four ROIs. All ROIs showed clear increases in mean diffusivity. CBWM had a substantial decrease in fractional anisotropy, whereas the CC and VC had minor increases of the same parameter. All eigenvalues of the ADT tended to increase with frequency for the CBWM, CBGM and VC, but only the principal eigenvalue increased strongly for the CC. On the other hand, there was no evidence that the orientation of the principal eigenvector varied systematically with MPG frequency for any of the ROIs. The relationship between the behaviour of the eigenvalues and the behaviours of the mean diffusivity and fractional anisotropy is investigated in detail. Pixelwise linear fits to the MD from individual animals found elevated changes across the cerebellum. The data acquired for this work encompassed a range of effective diffusion-times from 7.5 ms down to 1.875 ms, and some ideas on how the results might be used to extract quantitative information about brain tissue microstructure are discussed.
Assuntos
Encéfalo/anatomia & histologia , Encéfalo/fisiologia , Imagem de Tensor de Difusão , Animais , Anisotropia , Imagem de Tensor de Difusão/métodos , Masculino , Ratos , Ratos Sprague-DawleyRESUMO
This paper investigates the accuracy of Augmented Reality (AR) technologies, particularly commercially available optical see-through displays, in depicting virtual content inside the human body for surgical planning. Their inherent limitations result in inaccuracies in perceived object positioning. We examine how occlusion, specifically with opaque surfaces, affects perceived depth of virtual objects at arm's length working distances. A custom apparatus with a half-silvered mirror was developed, providing accurate depth cues excluding occlusion, differing from commercial displays. We carried out a study, contrasting our apparatus with a HoloLens 2, involving a depth estimation task under varied surface complexities and illuminations. In addition, we explored the effects of creating a virtual "hole" in the surface. Subjects' depth estimation accuracy and confidence were a ssessed. Results showed more depth estimation variation with HoloLens and significant depth error beneath complex occluding surfaces. However, creating a virtual hole significantly reduced depth errors and increased subjects' confidence, irrespective of accuracy enhancement. These findings have important implications for the design and use of mixed-reality technologies in surgical applications, and industrial applications such as using virtual content to guide maintenance or repair of components hidden beneath the opaque outer surface of equipment. A free copy of this paper and all supplemental materials are available at https://bit.ly/3YbkwjU.
Assuntos
Braço , Realidade Aumentada , Humanos , Gráficos por Computador , Interface Usuário-Computador , Percepção de ProfundidadeRESUMO
Head and neck surgeons often have difficulty in relocating sites of positive margins due to the complex 3-dimensional (3D) anatomy of the head and neck. We introduce a new technique where resection specimens are 3D scanned with a smartphone, annotated in computer-assisted design software, and immediately visualized on augmented reality (AR) glasses. The 3D virtual specimen can be accurately superimposed onto surgical sites for orientation and sizing applications. During an operative workshop, a surgeon using AR glasses projected virtual, annotated specimen models back into the resection bed onto a cadaver within approximately 10 minutes. Colored annotations can correspond with pathologic annotations and guide the orientation of the virtual 3D specimen. The model was also overlayed onto a flap harvest site to aid in reconstructive planning. We present a new technique allowing interactive, sterile inspection of tissue specimens in AR that could facilitate communication among surgeons and pathologists and assist with reconstructive surgery.
Assuntos
Realidade Aumentada , Cirurgia Assistida por Computador , Humanos , Software , Cirurgia Assistida por Computador/métodos , Processamento de Imagem Assistida por Computador , Cabeça , Imageamento TridimensionalRESUMO
PURPOSE: Middle and inner ear procedures target hearing loss, infections, and tumors of the temporal bone and lateral skull base. Despite the advances in surgical techniques, these procedures remain challenging due to limited haptic and visual feedback. Augmented reality (AR) may improve operative safety by allowing the 3D visualization of anatomical structures from preoperative computed tomography (CT) scans on real intraoperative microscope video feed. The purpose of this work was to develop a real-time CT-augmented stereo microscope system using camera calibration and electromagnetic (EM) tracking. METHODS: A 3D printed and electromagnetically tracked calibration board was used to compute the intrinsic and extrinsic parameters of the surgical stereo microscope. These parameters were used to establish a transformation between the EM tracker coordinate system and the stereo microscope image space such that any tracked 3D point can be projected onto the left and right images of the microscope video stream. This allowed the augmentation of the microscope feed of a 3D printed temporal bone with its corresponding CT-derived virtual model. Finally, the calibration board was also used for evaluating the accuracy of the calibration. RESULTS: We evaluated the accuracy of the system by calculating the registration error (RE) in 2D and 3D in a microsurgical laboratory setting. Our calibration workflow achieved a RE of 0.11 ± 0.06 mm in 2D and 0.98 ± 0.13 mm in 3D. In addition, we overlaid a 3D CT model on the microscope feed of a 3D resin printed model of a segmented temporal bone. The system exhibited small latency and good registration accuracy. CONCLUSION: We present the calibration of an electromagnetically tracked surgical stereo microscope for augmented reality visualization. The calibration method achieved accuracy within a range suitable for otologic procedures. The AR process introduces enhanced visualization of the surgical field while allowing depth perception.
RESUMO
Objective: In recent years, transcranial magnetic resonance-guided focused ultrasound (tcMRgFUS) has been established as a potential treatment option for movement disorders, including essential tremor (ET). So far, however, little is known about the impact of tcMRgFUS on structural connectivity. The objective of this study was to detect microstructural changes in tremor- and motor-related white matter tracts in ET patients treated with tcMRgFUS thalamotomy. Methods: Eleven patients diagnosed with ET were enrolled in this tcMRgFUS thalamotomy study. For each patient, 3 Tesla magnetic resonance imaging (3T MRI) including structural and diffusion MRI were acquired and the Clinical Rating Scale for Tremor was assessed before the procedure as well as 1 year after the treatment. Diffusion MRI tractography was performed to identify the cerebello-thalamo-cortical tract (CTCT), the medial lemniscus, and the corticospinal tract in both hemispheres on pre-treatment data. Pre-treatment tractography results were co-registered to post-treatment diffusion data. Diffusion tensor imaging (DTI) metrics, including fractional anisotropy (FA), mean diffusivity (MD) and radial diffusivity (RD), were averaged across the tracts in the pre- and post-treatment data. Results: The mean value of tract-specific DTI metrics changed significantly within the thalamic lesion and in the CTCT on the treated side (p < 0.05). Changes of DTI-derived indices within the CTCT correlated well with lesion overlap (FA: r = -0.54, p = 0.04; MD: r = 0.57, p = 0.04); RD: r = 0.67, p = 0.036). Further, a trend was seen for the correlation between changes of DTI-derived indices within the CTCT and clinical improvement (FA: r = 0.58; p = 0.062; MD: r = -0.52, p = 0.64; RD: r = -0.61 p = 0.090). Conclusions: Microstructural changes were detected within the CTCT after tcMRgFUS, and these changes correlated well with lesion-tract overlap. Our results show that diffusion MRI is able to detect the microstructural effects of tcMRgFUS, thereby further elucidating the treatment mechanism, and ultimately to improve targeting prospectively. Impact statement The results of this study demonstrate microstructural changes within the cerebello-thalamo-cortical pathways 1 year after MR-guided focused ultrasound thalamotomy. Even more, microstructural changes within the cerebello-thalamo-cortical pathways correlated significantly with clinical outcome. These findings do not only highly emphasize the need of new targeting strategies for MR-guided focused ultrasound thalamotomy but also help to elucidate the treatment mechanism of it.