RESUMO
Deep learning models for medical image segmentation are usually trained with voxel-wise losses, e.g., cross-entropy loss, focusing on unary supervision without considering inter-voxel relationships. This oversight potentially leads to semantically inconsistent predictions. Here, we propose a contextual similarity loss (CSL) and a structural similarity loss (SSL) to explicitly and efficiently incorporate inter-voxel relationships for improved performance. The CSL promotes consistency in predicted object categories for each image sub-region compared to ground truth. The SSL enforces compatibility between the predictions of voxel pairs by computing pair-wise distances between them, ensuring that voxels of the same class are close together whereas those from different classes are separated by a wide margin in the distribution space. The effectiveness of the CSL and SSL is evaluated using a clinical cone-beam computed tomography (CBCT) dataset of patients with various craniomaxillofacial (CMF) deformities and a public pancreas dataset. Experimental results show that the CSL and SSL outperform state-of-the-art regional loss functions in preserving segmentation semantics.
RESUMO
BACKGROUND: Clinical practice guidelines (CPGs) are designed to assist doctors in clinical decision making. High-quality research articles are important for the development of good CPGs. Commonly used manual screening processes are time-consuming and labor-intensive. Artificial intelligence (AI)-based techniques have been widely used to analyze unstructured data, including texts and images. Currently, there are no effective/efficient AI-based systems for screening literature. Therefore, developing an effective method for automatic literature screening can provide significant advantages. METHODS: Using advanced AI techniques, we propose the Paper title, Abstract, and Journal (PAJO) model, which treats article screening as a classification problem. For training, articles appearing in the current CPGs are treated as positive samples. The others are treated as negative samples. Then, the features of the texts (e.g., titles and abstracts) and journal characteristics are fully utilized by the PAJO model using the pretrained bidirectional-encoder-representations-from-transformers (BERT) model. The resulting text and journal encoders, along with the attention mechanism, are integrated in the PAJO model to complete the task. RESULTS: We collected 89,940 articles from PubMed to construct a dataset related to neck pain. Extensive experiments show that the PAJO model surpasses the state-of-the-art baseline by 1.91% (F1 score) and 2.25% (area under the receiver operating characteristic curve). Its prediction performance was also evaluated with respect to subject-matter experts, proving that PAJO can successfully screen high-quality articles. CONCLUSIONS: The PAJO model provides an effective solution for automatic literature screening. It can screen high-quality articles on neck pain and significantly improve the efficiency of CPG development. The methodology of PAJO can also be easily extended to other diseases for literature screening.
Assuntos
Aprendizado Profundo , Guias de Prática Clínica como Assunto , Humanos , Inteligência Artificial , Tomada de Decisão Clínica , Cervicalgia , Literatura de Revisão como AssuntoRESUMO
BACKGROUND: Most existing algorithms have been focused on the segmentation from several public Liver CT datasets scanned regularly (no pneumoperitoneum and horizontal supine position). This study primarily segmented datasets with unconventional liver shapes and intensities deduced by contrast phases, irregular scanning conditions, different scanning objects of pigs and patients with large pathological tumors, which formed the multiple heterogeneity of datasets used in this study. METHODS: The multiple heterogeneous datasets used in this paper includes: (1) One public contrast-enhanced CT dataset and one public non-contrast CT dataset; (2) A contrast-enhanced dataset that has abnormal liver shape with very long left liver lobes and large-sized liver tumors with abnormal presets deduced by microvascular invasion; (3) One artificial pneumoperitoneum dataset under the pneumoperitoneum and three scanning profiles (horizontal/left/right recumbent position); (4) Two porcine datasets of Bama type and domestic type that contains pneumoperitoneum cases but with large anatomy discrepancy with humans. The study aimed to investigate the segmentation performances of 3D U-Net in: (1) generalization ability between multiple heterogeneous datasets by cross-testing experiments; (2) the compatibility when hybrid training all datasets in different sampling and encoder layer sharing schema. We further investigated the compatibility of encoder level by setting separate level for each dataset (i.e., dataset-wise convolutions) while sharing the decoder. RESULTS: Model trained on different datasets has different segmentation performance. The prediction accuracy between LiTS dataset and Zhujiang dataset was about 0.955 and 0.958 which shows their good generalization ability due to that they were all contrast-enhanced clinical patient datasets scanned regularly. For the datasets scanned under pneumoperitoneum, their corresponding datasets scanned without pneumoperitoneum showed good generalization ability. Dataset-wise convolution module in high-level can improve the dataset unbalance problem. The experimental results will facilitate researchers making solutions when segmenting those special datasets. CONCLUSIONS: (1) Regularly scanned datasets is well generalized to irregularly ones. (2) The hybrid training is beneficial but the dataset imbalance problem always exits due to the multi-domain homogeneity. The higher levels encoded more domain specific information than lower levels and thus were less compatible in terms of our datasets.
Assuntos
Imageamento Tridimensional , Neoplasias Hepáticas/diagnóstico por imagem , Fígado/diagnóstico por imagem , Aprendizado de Máquina , Interpretação de Imagem Radiográfica Assistida por Computador/métodos , Tomografia Computadorizada por Raios X/métodos , Animais , Meios de Contraste , Conjuntos de Dados como Assunto , Humanos , Pneumoperitônio/diagnóstico por imagem , SuínosRESUMO
Mammalian target of rapamycin (mTOR) is a Ser/Thr protein kinase that functions as an ATP and amino acid sensor to govern cell growth and proliferation by mediating mitogen- and nutrient-dependent signal transduction. Protein phosphatase 2A (PP2A), a ubiquitously expressed serine/threonine phosphatase, negatively regulates mTOR signaling. Methylation of PP2A is catalyzed by leucine carboxyl methyltransferase-1 (LCMT1) and reversed by protein phosphatase methylesterase 1 (PME-1), which regulates PP2A activity and substrate specificity. However, whether PP2A methylation is related to mTOR signaling is still unknown. In this study, we examined the effect of PP2A methylation on mTOR signaling in HEK293 cells under oxidative stress. Our results show that oxidative stress induces PP2A demethylation and inhibits the mTORC1 signaling pathway. Next, we examined two strategies to block PP2A demethylation under oxidative stress. One strategy was to prevent PP2A demethylation using a PME-1 inhibitor; the other strategy was to activate PP2A methylation via overexpression of LCMT1. The results show that both the PME-1 inhibitor and LCMT1 overexpression prevent the mTORC1 signaling suppression induced by oxidative stress. Additionally, LCMT1 overexpression rescued cell viability and the mitochondrial membrane potential decrease in response to oxidative stress. These results demonstrate that H2 O2 induces PP2A demethylation to downregulate mTORC1 signaling. These findings provide a novel mechanism for the regulation of PP2A demethylation and mTORC1 signaling under oxidative stress.
Assuntos
Peróxido de Hidrogênio/farmacologia , Alvo Mecanístico do Complexo 1 de Rapamicina/metabolismo , Proteína Fosfatase 2/metabolismo , Hidrolases de Éster Carboxílico/metabolismo , Linhagem Celular Tumoral , Citoplasma/metabolismo , Desmetilação/efeitos dos fármacos , Regulação para Baixo , Células HEK293 , Humanos , Estresse Oxidativo/efeitos dos fármacos , Estresse Oxidativo/fisiologia , Fosforilação , Proteína O-Metiltransferase/metabolismo , Processamento de Proteína Pós-Traducional , Transdução de Sinais/efeitos dos fármacos , Serina-Treonina Quinases TOR/metabolismoRESUMO
PP2Acα2 is a recently discovered PP2Acα alternative splicing isoform that can be induced following serum withdrawal. It shows enhanced binding to immunoglobulin binding protein 1 and is overexpressed in chronic lymphocytic leukemia patients. Current knowledge concerning PP2Acα2 is limited. In this study, we induced and cloned PP2Acα2 from HL-60 cells and human lymphocytes, transfected them into human embryonic kidney 293 cells and constructed a stable overexpression cell line. We found that PP2Acα2 mRNA inhibits expression of its longer isoform PP2Acα mRNA but had no effect on the final protein expression and modification of this longer isoform. Moreover, PP2Acα2-overexpressed cells demonstrated increased expression of IGBP1, activated mTORC1 signaling to reduce basal autophagy and increased anchorage-independent growth. Our study provides new insights into the complex mechanisms of PP2A regulation.
Assuntos
Processamento Alternativo/fisiologia , Autofagia/fisiologia , Isoenzimas/metabolismo , Proteína Fosfatase 2/metabolismo , Catálise , Domínio Catalítico/fisiologia , Células HL-60 , Humanos , Subunidades Proteicas/metabolismo , Regulação para Cima/fisiologiaRESUMO
Medical image segmentation and registration are two fundamental and highly related tasks. However, current works focus on the mutual promotion between the two at the loss function level, ignoring the feature information generated by the encoder-decoder network during the task-specific feature mapping process and the potential inter-task feature relationship. This paper proposes a unified multi-task joint learning framework based on bi-fusion of structure and deformation at multi-scale, called BFM-Net, which simultaneously achieves the segmentation results and deformation field in a single-step estimation. BFM-Net consists of a segmentation subnetwork (SegNet), a registration subnetwork (RegNet), and the multi-task connection module (MTC). The MTC module is used to transfer the latent feature representation between segmentation and registration at multi-scale and link different tasks at the network architecture level, including the spatial attention fusion module (SAF), the multi-scale spatial attention fusion module (MSAF) and the velocity field fusion module (VFF). Extensive experiments on MR, CT and ultrasound images demonstrate the effectiveness of our approach. The MTC module can increase the Dice scores of segmentation and registration by 3.2%, 1.6%, 2.2%, and 6.2%, 4.5%, 3.0%, respectively. Compared with six state-of-the-art algorithms for segmentation and registration, BFM-Net can achieve superior performance in various modal images, fully demonstrating its effectiveness and generalization.
RESUMO
BACKGROUND: Inferring the shape and position of coronary artery poses challenges when using fluoroscopic image guidance during percutaneous coronary intervention (PCI) procedure. Although angiography enables coronary artery visualization, the use of injected contrast agent raises concerns about radiation exposure and the risk of contrast-induced nephropathy. To address these issues, dynamic coronary roadmapping overlaid on fluoroscopic images can provide coronary visual feedback without contrast injection. PURPOSE: This paper proposes a novel cardio-respiratory motion compensation method that utilizes cardiac state synchronization and catheter motion estimation to achieve coronary roadmapping in fluoroscopic images. METHODS: For more accurate cardiac state synchronization, video frame interpolation is applied to increase the frame rate of the original limited angiographic images, resulting in higher framerate and more adequate roadmaps. The proposed method also incorporates a multi-length cross-correlation based adaptive electrocardiogram (ECG) matching to address irregular cardiac motion situation. Furthermore, a shape-constrained path searching method is proposed to extract catheter structure from both fluoroscopic and angiographic image. Then catheter motion is estimated using a cascaded matching approach with an outlier removal strategy, leading to a final corrected roadmap. RESULTS: Evaluation of the proposed method on clinical x-ray images demonstrates its effectiveness, achieving a 92.8% F1 score for catheter extraction on 589 fluoroscopic and angiographic images. Additionally, the method achieves a 5.6-pixel distance error of the coronary roadmap on 164 intraoperative fluoroscopic images. CONCLUSIONS: Overall, the proposed method achieves accurate coronary roadmapping in fluoroscopic images and shows potential to overlay accurate coronary roadmap on fluoroscopic image in assisting PCI.
RESUMO
Detecting coronary stenosis accurately in X-ray angiography (XRA) is important for diagnosing and treating coronary artery disease (CAD). However, challenges arise from factors like breathing and heart motion, poor imaging quality, and the complex vascular structures, making it difficult to identify stenosis fast and precisely. In this study, we proposed a Quantum Diffusion Model with Spatio-Temporal Feature Sharing to Real-time detect Stenosis (STQD-Det). Our framework consists of two modules: Sequential Quantum Noise Boxes module and spatio-temporal feature module. To evaluate the effectiveness of the method, we conducted a 4-fold cross-validation using a dataset consisting of 233 XRA sequences. Our approach achieved the F1 score of 92.39% with a real-time processing speed of 25.08 frames per second. These results outperform 17 state-of-the-art methods. The experimental results show that the proposed method can accomplish the stenosis detection quickly and accurately.
RESUMO
BACKGROUND: Monocular depth estimation plays a fundamental role in clinical endoscopy surgery. However, the coherent illumination, smooth surfaces, and texture-less nature of endoscopy images present significant challenges to traditional depth estimation methods. Existing approaches struggle to accurately perceive depth in such settings. METHOD: To overcome these challenges, this paper proposes a novel multi-scale residual fusion method for estimating the depth of monocular endoscopy images. Specifically, we address the issue of coherent illumination by leveraging image frequency domain component space transformation, thereby enhancing the stability of the scene's light source. Moreover, we employ an image radiation intensity attenuation model to estimate the initial depth map. Finally, to refine the accuracy of depth estimation, we utilize a multi-scale residual fusion optimization technique. RESULTS: To evaluate the performance of our proposed method, extensive experiments were conducted on public datasets. The structural similarity measures for continuous frames in three distinct clinical data scenes reached impressive values of 0.94, 0.82, and 0.84, respectively. These results demonstrate the effectiveness of our approach in capturing the intricate details of endoscopy images. Furthermore, the depth estimation accuracy achieved remarkable levels of 89.3 % and 91.2 % for the two models' data, respectively, underscoring the robustness of our method. CONCLUSIONS: Overall, the promising results obtained on public datasets highlight the significant potential of our method for clinical applications, facilitating reliable depth estimation and enhancing the quality of endoscopy surgical procedures.
Assuntos
Endoscopia Gastrointestinal , EndoscopiaRESUMO
In recent years, 4D medical image involving structural and motion information of tissue has attracted increasing attention. The key to the 4D image reconstruction is to stack the 2D slices based on matching the aligned motion states. In this study, the distribution of the 2D slices with the different motion states is modeled as a manifold graph, and the reconstruction is turned to be the graph alignment. An embedding-alignment fusion-based graph convolution network (GCN) with a mixed-learning strategy is proposed to align the graphs. Herein, the embedding and alignment processes of graphs interact with each other to realize a precise alignment with retaining the manifold distribution. The mixed strategy of self- and semi-supervised learning makes the alignment sparse to avoid the mismatching caused by outliers in the graph. In the experiment, the proposed 4D reconstruction approach is validated on the different modalities including Computed Tomography (CT), Magnetic Resonance Imaging (MRI), and Ultrasound (US). We evaluate the reconstruction accuracy and compare it with those of state-of-the-art methods. The experiment results demonstrate that our approach can reconstruct a more accurate 4D image.
Assuntos
Algoritmos , Imageamento Tridimensional , Humanos , Imageamento Tridimensional/métodos , Redes Neurais de Computação , Processamento de Imagem Assistida por Computador/métodos , Imageamento por Ressonância Magnética/métodos , Ultrassonografia/métodos , Aprendizado de MáquinaRESUMO
PURPOSE: This work proposes a robot-assisted augmented reality (AR) surgical navigation system for mandibular reconstruction. The system accurately superimposes the preoperative osteotomy plan of the mandible and fibula into a real scene. It assists the doctor in osteotomy quickly and safely under the guidance of the robotic arm. METHODS: The proposed system mainly consists of two modules: the AR guidance module of the mandible and fibula and the robot navigation module. In the AR guidance module, we propose an AR calibration method based on the spatial registration of the image tracking marker to superimpose the virtual models of the mandible and fibula into the real scene. In the robot navigation module, the posture of the robotic arm is first calibrated under the tracking of the optical tracking system. The robotic arm can then be positioned at the planned osteotomy after the registration of the computed tomography image and the patient position. The combined guidance of AR and robotic arm can enhance the safety and precision of the surgery. RESULTS: The effectiveness of the proposed system was quantitatively assessed on cadavers. In the AR guidance module, osteotomies of the mandible and fibula achieved mean errors of 1.61 ± 0.62 and 1.08 ± 0.28 mm, respectively. The mean reconstruction error of the mandible was 1.36 ± 0.22 mm. In the AR-robot guidance module, the mean osteotomy errors of the mandible and fibula were 1.47 ± 0.46 and 0.98 ± 0.24 mm, respectively. The mean reconstruction error of the mandible was 1.20 ± 0.36 mm. CONCLUSIONS: The cadaveric experiments of 12 fibulas and six mandibles demonstrate the proposed system's effectiveness and potential clinical value in reconstructing the mandibular defect with a free fibular flap.
Assuntos
Realidade Aumentada , Retalhos de Tecido Biológico , Reconstrução Mandibular , Robótica , Cirurgia Assistida por Computador , Humanos , Reconstrução Mandibular/métodos , Cirurgia Assistida por Computador/métodos , Retalhos de Tecido Biológico/cirurgia , Mandíbula/diagnóstico por imagem , Mandíbula/cirurgiaRESUMO
Fractional flow reserve (FFR) is considered as the gold standard for diagnosing coronary myocardial ischemia. Existing 3D computational fluid dynamics (CFD) methods attempt to predict FFR noninvasively using coronary computed tomography angiography (CTA). However, the accuracy and efficiency of the 3D CFD methods in coronary arteries are considerably limited. In this work, we introduce a multi-dimensional CFD framework that improves the accuracy of FFR prediction by estimating 0D patient-specific boundary conditions, and increases the efficiency by generating 3D initial conditions. The multi-dimensional CFD models contain the 3D vascular model for coronary simulation, the 1D vascular model for iterative optimization, and the 0D vascular model for boundary conditions expression. To improve the accuracy, we utilize clinical parameters to derive 0D patient-specific boundary conditions with an optimization algorithm. To improve the efficiency, we evaluate the convergence state using the 1D vascular model and obtain the convergence parameters to generate appropriate 3D initial conditions. The 0D patient-specific boundary conditions and the 3D initial conditions are used to predict FFR (FFRC). We conducted a retrospective study involving 40 patients (61 diseased vessels) with invasive FFR and their corresponding CTA images. The results demonstrate that the FFRC and the invasive FFR have a strong linear correlation (r = 0.80, p < 0.001) and high consistency (mean difference: 0.014 ±0.071). After applying the cut-off value of FFR (0.8), the accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of FFRC were 88.5%, 93.3%, 83.9%, 84.8%, and 92.9%, respectively. Compared with the conventional zero initial conditions method, our method improves prediction efficiency by 71.3% per case. Therefore, our multi-dimensional CFD framework is capable of improving the accuracy and efficiency of FFR prediction significantly.
Assuntos
Doença da Artéria Coronariana , Estenose Coronária , Reserva Fracionada de Fluxo Miocárdico , Isquemia Miocárdica , Humanos , Estudos Retrospectivos , Hidrodinâmica , Angiografia Coronária/métodos , Doença da Artéria Coronariana/diagnóstico por imagem , Valor Preditivo dos Testes , Vasos Coronários/diagnóstico por imagemRESUMO
In virtual surgical training, it is crucial to achieve real-time, high-fidelity simulation of the tissue deformation. The anisotropic and nonlinear characteristics of the organ with multi-component make accurate real-time deformation simulation difficult. A localized tissue constraint progressive transfer learning method is proposed in this paper, where the base-compensated dual-output transfer learning strategy and the localized tissue constraint progressive learning architecture are developed. The proposed strategy enriches the multi-component biomechanical dataset to fully represent complex force-displacement with minimal high-quality data. Meanwhile, the proposed architecture adopts focused and progressive model to accurately describe tissues with varied biomechanical properties rather than singular homogeneous model. We made comparison with 4 state-of-the-art (SOTA) methods in simulating multi-component biomechanical deformations of organs with 100 pairs of testing data. Results show that the accuracy of our method is 50% higher than other methods in different validation matrix. And our method can stably simulate the deformations in 0.005 s per frame, which largely improves the computing efficiency.
Assuntos
Fenômenos Mecânicos , Fenômenos Biomecânicos , Simulação por Computador , Fatores de Tempo , Aprendizado de Máquina , HumanosRESUMO
OBJECTIVE: Biliary interventional procedures require physicians to track the interventional instrument tip (Tip) precisely with X-ray image. However, Tip positioning relies heavily on the physicians' experience due to the limitations of X-ray imaging and the respiratory interference, which leads to biliary damage, prolonged operation time, and increased X-ray radiation. METHODS: We construct an augmented reality (AR) navigation system for biliary interventional procedures. It includes system calibration, respiratory motion correction and fusion navigation. Firstly, the magnetic and 3D computed tomography (CT) coordinates are aligned through system calibration. Secondly, a respiratory motion correction method based on manifold regularization is proposed to correct the misalignment of the two coordinates caused by respiratory motion. Thirdly, the virtual biliary, liver and Tip from CT are overlapped to the corresponding position of the patient for dynamic virtual-real fusion. RESULTS: Our system is respectively evaluated and achieved an average alignment error of 0.75 ± 0.17 mm and 2.79 ± 0.46 mm on phantoms and patients. The navigation experiments conducted on phantoms achieve an average Tip positioning error of 0.98 ± 0.15 mm and an average fusion error of 1.67 ± 0.34 mm after correction. CONCLUSION: Our system can automatically register the Tip to the corresponding location in CT, and dynamically overlap the 3D virtual model onto patients to provide accurate and intuitive AR navigation. SIGNIFICANCE: This study demonstrates the clinical potential of our system by assisting physicians during biliary interventional procedures. Our system enables dynamic visualization of virtual model on patients, reducing the reliance on contrast agents and X-ray usage.
Assuntos
Realidade Aumentada , Cirurgia Assistida por Computador , Humanos , Imageamento Tridimensional , Fígado , Imagens de Fantasmas , Tomografia Computadorizada por Raios X/métodos , Cirurgia Assistida por Computador/métodosRESUMO
Automatic vessel segmentation is a critical area of research in medical image analysis, as it can greatly assist doctors in accurately and efficiently diagnosing vascular diseases. However, accurately extracting the complete vessel structure from images remains a challenge due to issues such as uneven contrast and background noise. Existing methods primarily focus on segmenting individual pixels and often fail to consider vessel features and morphology. As a result, these methods often produce fragmented results and misidentify vessel-like background noise, leading to missing and outlier points in the overall segmentation. To address these issues, this paper proposes a novel approach called the progressive edge information aggregation network for vessel segmentation (PEA-Net). The proposed method consists of several key components. First, a dual-stream receptive field encoder (DRE) is introduced to preserve fine structural features and mitigate false positive predictions caused by background noise. This is achieved by combining vessel morphological features obtained from different receptive field sizes. Second, a progressive complementary fusion (PCF) module is designed to enhance fine vessel detection and improve connectivity. This module complements the decoding path by combining features from previous iterations and the DRE, incorporating nonsalient information. Additionally, segmentation-edge decoupling enhancement (SDE) modules are employed as decoders to integrate upsampling features with nonsalient information provided by the PCF. This integration enhances both edge and segmentation information. The features in the skip connection and decoding path are iteratively updated to progressively aggregate fine structure information, thereby optimizing segmentation results and reducing topological disconnections. Experimental results on multiple datasets demonstrate that the proposed PEA-Net model and strategy achieve optimal performance in both pixel-level and topology-level metrics.
Assuntos
Benchmarking , Pisum sativum , Processamento de Imagem Assistida por ComputadorRESUMO
Accurately reconstructing 4D critical organs contributes to the visual guidance in X-ray image-guided interventional operation. Current methods estimate intraoperative dynamic meshes by refining a static initial organ mesh from the semantic information in the single-frame X-ray images. However, these methods fall short of reconstructing an accurate and smooth organ sequence due to the distinct respiratory patterns between the initial mesh and X-ray image. To overcome this limitation, we propose a novel dual-stage complementary 4D organ reconstruction (DSC-Recon) model for recovering dynamic organ meshes by utilizing the preoperative and intraoperative data with different respiratory patterns. DSC-Recon is structured as a dual-stage framework: 1) The first stage focuses on addressing a flexible interpolation network applicable to multiple respiratory patterns, which could generate dynamic shape sequences between any pair of preoperative 3D meshes segmented from CT scans. 2) In the second stage, we present a deformation network to take the generated dynamic shape sequence as the initial prior and explore the discriminate feature (i.e., target organ areas and meaningful motion information) in the intraoperative X-ray images, predicting the deformed mesh by introducing a designed feature mapping pipeline integrated into the initialized shape refinement process. Experiments on simulated and clinical datasets demonstrate the superiority of our method over state-of-the-art methods in both quantitative and qualitative aspects.
RESUMO
BACKGROUND: The existing face matching method requires a point cloud to be drawn on the real face for registration, which results in low registration accuracy due to the irregular deformation of the patient's skin that makes the point cloud have many outlier points. METHODS: This work proposes a non-contact pose estimation method based on similarity aspect graph hierarchical optimization. The proposed method constructs a distance-weighted and triangular-constrained similarity measure to describe the similarity between views by automatically identifying the 2D and 3D feature points of the face. A mutual similarity clustering method is proposed to construct a hierarchical aspect graph with 3D pose as nodes. A Monte Carlo tree search strategy is used to search the hierarchical aspect graph for determining the optimal pose of the facial 3D model, so as to realize the accurate registration of the facial 3D model and the real face. RESULTS: The proposed method was used to conduct accuracy verification experiments on the phantoms and volunteers, which were compared with four advanced pose calibration methods. The proposed method obtained average fusion errors of 1.13 ± 0.20 mm and 0.92 ± 0.08 mm in head phantom and volunteer experiments, respectively, which exhibits the best fusion performance among all comparison methods. CONCLUSIONS: Our experiments proved the effectiveness of the proposed pose estimation method in facial augmented reality.
Assuntos
Algoritmos , Realidade Aumentada , Humanos , Imageamento Tridimensional/métodosRESUMO
Objective.Freehand 3D ultrasound volume reconstruction has received considerable attention in medical research because it can freely perform spatial imaging at a low cost. However, the uneven distribution of the original ultrasound images in space reduces the reconstruction effect of the traditional method.Approach.An adaptive tetrahedral interpolation algorithm is proposed to reconstruct 3D ultrasound volume data. The algorithm adaptively divides the unevenly distributed images into numerous tetrahedrons and interpolates the voxel value in each tetrahedron to reconstruct 3D ultrasound volume data.Main results.Extensive experiments on simulated and clinical data confirm that the proposed method can achieve more accurate reconstruction than six benchmark methods. Specifically, the averaged interpolation error at the gray level can be reduced by 0.22-0.82, and the peak signal-to-noise ratio and the mean structure similarity can be improved by 0.32-1.83 dB and 0.01-0.05, respectively.Significance.With the parallel implementation of the algorithm, one 3D ultrasound volume data with size 279 × 279 × 276 can be reconstructed from 100 slices 2D ultrasound images with size 200 × 200 at 1.04 s. Such a quick and accurate approach has practical value in medical research.
Assuntos
Algoritmos , Imageamento Tridimensional , Imageamento Tridimensional/métodos , Ultrassonografia/métodosRESUMO
Objective.3D ultrasound non-rigid registration is significant for intraoperative motion compensation. Nevertheless, distorted textures in the registered image due to the poor image quality and low signal-to-noise ratio of ultrasound images reduce the accuracy and efficiency of the existing methods.Approach.A novel 3D ultrasound non-rigid registration objective function with texture and content constraints in both image space and multiscale feature space based on an unsupervised generative adversarial network based registration framework is proposed to eliminate distorted textures. A similarity metric in the image space is formulated based on combining self-structural constraint with intensity to strengthen the robustness to abnormal intensity change compared with common intensity-based metrics. The proposed framework takes two discriminators as feature extractors to formulate the texture and content similarity between the registered image and the fixed image in the multiscale feature space respectively. A distinctive alternating training strategy is established to jointly optimize the combination of various similarity loss functions to overcome the difficulty and instability of training convergence and balance the training of generator and discriminators.Main results.Compared with five registration methods, the proposed method is evaluated both with small and large deformations, and achieves the best registration accuracy with average target registration error of 1.089 mm and 2.139 mm in cases of small and large deformations, respectively. The performance on peak signal to noise ratio (PSNR) and structural similarity (SSIM) also proves the effective constraints on distorted textures of the proposed method (PSNR is 31.693 dB and SSIM is 0.9 in the case of small deformation; PSNR is 28.177 dB and SSIM is 0.853 in the case of large deformation).Significance.The proposed 3D ultrasound non-rigid registration method based on texture and content constraints with the distinctive alternating training strategy can eliminate the distorted textures with improving the registration accuracy.
Assuntos
Imageamento Tridimensional , Imageamento por Ressonância Magnética , Imageamento por Ressonância Magnética/métodos , Imageamento Tridimensional/métodos , Ultrassonografia , Razão Sinal-Ruído , Movimento (Física) , Processamento de Imagem Assistida por Computador/métodosRESUMO
Microwave ablation (MWA) is a minimally invasive procedure for the treatment of liver tumor. Accumulating clinical evidence has considered the minimal ablative margin (MAM) as a significant predictor of local tumor progression (LTP). In clinical practice, MAM assessment is typically carried out through image registration of pre- and post-MWA images. However, this process faces two main challenges: non-homologous match between tumor and coagulation with inconsistent image appearance, and tissue shrinkage caused by thermal dehydration. These challenges result in low precision when using traditional registration methods for MAM assessment. In this paper, we present a local contractive nonrigid registration method using a biomechanical model (LC-BM) to address these challenges and precisely assess the MAM. The LC-BM contains two consecutive parts: (1) local contractive decomposition (LC-part), which reduces the incorrect match between the tumor and coagulation and quantifies the shrinkage in the external coagulation region, and (2) biomechanical model constraint (BM-part), which compensates for the shrinkage in the internal coagulation region. After quantifying and compensating for tissue shrinkage, the warped tumor is overlaid on the coagulation, and then the MAM is assessed. We evaluated the method using prospectively collected data from 36 patients with 47 liver tumors, comparing LC-BM with 11 state-of-the-art methods. LTP was diagnosed through contrast-enhanced MR follow-up images, serving as the ground truth for tumor recurrence. LC-BM achieved the highest accuracy (97.9%) in predicting LTP, outperforming other methods. Therefore, our proposed method holds significant potential to improve MAM assessment in MWA surgeries.