Whole-body integration of gene expression and single-cell morphology.

Animal bodies are composed of cell types with unique expression programs that implement their distinct locations, shapes, structures, and functions. Based on these properties, cell types assemble into specific tissues and organs. To systematically explore the link between cell-type-specific gene expression and morphology, we registered an expression atlas to a whole-body electron microscopy volume of the nereid Platynereis dumerilii. Automated segmentation of cells and nuclei identifies major cell classes and establishes a link between gene activation, chromatin topography, and nuclear size. Clustering of segmented cells according to gene expression reveals spatially coherent tissues. In the brain, genetically defined groups of neurons match ganglionic nuclei with coherent projections. Besides interneurons, we uncover sensory-neurosecretory cells in the nereid mushroom bodies, which thus qualify as sensory organs. They furthermore resemble the vertebrate telencephalon by molecular anatomy. We provide an integrated browser as a Fiji plugin for remote exploration of all available multimodal datasets.

SuperCUT, an unsupervised multimodal image registration with deep learning for biomedical microscopy.

Numerous imaging techniques are available for observing and interrogating biological samples, and several of them can be used consecutively to enable correlative analysis of different image modalities with varying resolutions and the inclusion of structural or molecular information. Achieving accurate registration of multimodal images is essential for the correlative analysis process, but it remains a challenging computer vision task with no widely accepted solution. Moreover, supervised registration methods require annotated data produced by experts, which is limited. To address this challenge, we propose a general unsupervised pipeline for multimodal image registration using deep learning. We provide a comprehensive evaluation of the proposed pipeline versus the current state-of-the-art image registration and style transfer methods on four types of biological problems utilizing different microscopy modalities. We found that style transfer of modality domains paired with fully unsupervised training leads to comparable image registration accuracy to supervised methods and, most importantly, does not require human intervention.

CRCS: An automatic image processing pipeline for hormone level analysis of Cushing's disease.

Due to the abnormal secretion of adreno-cortico-tropic-hormone (ACTH) by tumors, Cushing's disease leads to hypercortisonemia, a precursor to a series of metabolic disorders and serious complications. Cushing's disease has high recurrence rate, short recurrence time and undiscovered recurrence reason after surgical resection. Qualitative or quantitative automatic image analysis of histology images can potentially in providing insights into Cushing's disease, but still no software has been available to the best of our knowledge. In this study, we propose a quantitative image analysis-based pipeline CRCS, which aims to explore the relationship between the expression level of ACTH in normal cell tissues adjacent to tumor cells and the postoperative prognosis of patients. CRCS mainly consists of image-level clustering, cluster-level multi-modal image registration, patch-level image classification and pixel-level image segmentation on the whole slide imaging (WSI). On both image registration and classification tasks, our method CRCS achieves state-of-the-art performance compared to recently published methods on our collected benchmark dataset. In addition, CRCS achieves an accuracy of 0.83 for postoperative prognosis of 12 cases. CRCS demonstrates great potential for instrumenting automatic diagnosis and treatment for Cushing's disease.

Dynamics of Drosophila endoderm specification.

During early Drosophila embryogenesis, a network of gene regulatory interactions orchestrates terminal patterning, playing a critical role in the subsequent formation of the gut. We utilized CRISPR gene editing at endogenous loci to create live reporters of transcription and light-sheet microscopy to monitor the individual components of the posterior gut patterning network across 90 min prior to gastrulation. We developed a computational approach for fusing imaging datasets of the individual components into a common multivariable trajectory. Data fusion revealed low intrinsic dimensionality of posterior patterning and cell fate specification in wild-type embryos. The simple structure that we uncovered allowed us to construct a model of interactions within the posterior patterning regulatory network and make testable predictions about its dynamics at the protein level. The presented data fusion strategy is a step toward establishing a unified framework that would explore how stochastic spatiotemporal signals give rise to highly reproducible morphogenetic outcomes.

3-Dimensional Reconstruction From Histopathological Sections: A Systematic Review.

Although pathological tissue analysis is typically performed on single 2-dimensional (2D) histologic reference slides, 3-dimensional (3D) reconstruction from a sequence of histologic sections could provide novel opportunities for spatial analysis of the extracted tissue. In this review, we analyze recent works published after 2018 and report information on the extracted tissue types, the section thickness, and the number of sections used for reconstruction. By analyzing the technological requirements for 3D reconstruction, we observe that software tools exist, both free and commercial, which include the functionality to perform 3D reconstruction from a sequence of histologic images. Through the analysis of the most recent works, we provide an overview of the workflows and tools that are currently used for 3D reconstruction from histologic sections and address points for future work, such as a missing common file format or computer-aided analysis of the reconstructed model.

Atlas-based assessment of hypomyelination: Quantitative MRI in Pelizaeus-Merzbacher disease.

Pelizaeus-Merzbacher disease (PMD) is a rare childhood hypomyelinating leukodystrophy. Quantification of the pronounced myelin deficit and delineation of subtle myelination processes are of high clinical interest. Quantitative magnetic resonance imaging (qMRI) techniques can provide in vivo insights into myelination status, its spatial distribution, and dynamics during brain maturation. They may serve as potential biomarkers to assess the efficacy of myelin-modulating therapies. However, registration techniques for image quantification and statistical comparison of affected pediatric brains, especially those of low or deviant image tissue contrast, with healthy controls are not yet established. This study aimed first to develop and compare postprocessing pipelines for atlas-based quantification of qMRI data in pediatric patients with PMD and evaluate their registration accuracy. Second, to apply an optimized pipeline to investigate spatial myelin deficiency using myelin water imaging (MWI) data from patients with PMD and healthy controls. This retrospective single-center study included five patients with PMD (mean age, 6 years ± 3.8) who underwent conventional brain MRI and diffusion tensor imaging (DTI), with MWI data available for a subset of patients. Three methods of registering PMD images to a pediatric template were investigated. These were based on (a) T1-weighted (T1w) images, (b) fractional anisotropy (FA) maps, and (c) a combination of T1w, T2-weighted, and FA images in a multimodal approach. Registration accuracy was determined by visual inspection and calculated using the structural similarity index method (SSIM). SSIM values for the registration approaches were compared using a t test. Myelin water fraction (MWF) was quantified from MWI data as an assessment of relative myelination. Mean MWF was obtained from two PMDs (mean age, 3.1 years ± 0.3) within four major white matter (WM) pathways of a pediatric atlas and compared to seven healthy controls (mean age, 3 years ± 0.2) using a Mann-Whitney U test. Our results show that visual registration accuracy estimation and computed SSIM were highest for FA-based registration, followed by multimodal, and T1w-based registration (SSIMFA = 0.67 ± 0.04 vs. SSIMmultimodal = 0.60 ± 0.03 vs. SSIMT1 = 0.40 ± 0.14). Mean MWF of patients with PMD within the WM pathways was significantly lower than in healthy controls MWFPMD = 0.0267 ± 0.021 vs. MWFcontrols = 0.1299 ± 0.039. Specifically, MWF was measurable in brain structures known to be myelinated at birth (brainstem) or postnatally (projection fibers) but was scarcely detectable in other brain regions (commissural and association fibers). Taken together, our results indicate that registration accuracy was highest with an FA-based registration pipeline, providing an alternative to conventional T1w-based registration approaches in the case of hypomyelinating leukodystrophies missing normative intrinsic tissue contrasts. The applied atlas-based analysis of MWF data revealed that the extent of spatial myelin deficiency in patients with PMD was most pronounced in commissural and association and to a lesser degree in brainstem and projection pathways.

Image registration for in situ X-ray nano-imaging of a composite battery cathode with deformation.

The structural and chemical evolution of battery electrodes at the nanoscale plays an important role in affecting the cell performance. Nano-resolution X-ray microscopy has been demonstrated as a powerful technique for characterizing the evolution of battery electrodes under operating conditions with sensitivity to their morphology, compositional distribution and redox heterogeneity. In real-world batteries, the electrode could deform upon battery operation, causing challenges for the image registration which is necessary for several experimental modalities, e.g. XANES imaging. To address this challenge, this work develops a deep-learning-based method for automatic particle identification and tracking. This approach was not only able to facilitate image registration with good robustness but also allowed quantification of the degree of sample deformation. The effectiveness of the method was first demonstrated using synthetic datasets with known ground truth. The method was then applied to an experimental dataset collected on an operating lithium battery cell, revealing a high degree of intra- and interparticle chemical complexity in operating batteries.

DNA choreography: correlating mobility and organization of DNA across different resolutions from loops to chromosomes.

The dynamics of DNA in the cell nucleus plays a role in cellular processes and fates but the interplay of DNA mobility with the hierarchical levels of DNA organization is still underexplored. Here, we made use of DNA replication to directly label genomic DNA in an unbiased genome-wide manner. This was followed by live-cell time-lapse microscopy of the labeled DNA combining imaging at different resolutions levels simultaneously and allowing one to trace DNA motion across organization levels within the same cells. Quantification of the labeled DNA segments at different microscopic resolution levels revealed sizes comparable to the ones reported for DNA loops using 3D super-resolution microscopy, topologically associated domains (TAD) using 3D widefield microscopy, and also entire chromosomes. By employing advanced chromatin tracking and image registration, we discovered that DNA exhibited higher mobility at the individual loop level compared to the TAD level and even less at the chromosome level. Additionally, our findings indicate that chromatin movement, regardless of the resolution, slowed down during the S phase of the cell cycle compared to the G1/G2 phases. Furthermore, we found that a fraction of DNA loops and TADs exhibited directed movement with the majority depicting constrained movement. Our data also indicated spatial mobility differences with DNA loops and TADs at the nuclear periphery and the nuclear interior exhibiting lower velocity and radius of gyration than the intermediate locations. On the basis of these insights, we propose that there is a link between DNA mobility and its organizational structure including spatial distribution, which impacts cellular processes.

Evaluating artificial intelligence for comparative radiography.

INTRODUCTION: Comparative radiography is a forensic identification and shortlisting technique based on the comparison of skeletal structures in ante-mortem and post-mortem images. The images (e.g., 2D radiographs or 3D computed tomographies) are manually superimposed and visually compared by a forensic practitioner. It requires a significant amount of time per comparison, limiting its utility in large comparison scenarios. METHODS: We propose and validate a novel framework for automating the shortlisting of candidates using artificial intelligence. It is composed of (1) a segmentation method to delimit skeletal structures' silhouettes in radiographs, (2) a superposition method to generate the best simulated "radiographs" from 3D images according to the segmented radiographs, and (3) a decision-making method for shortlisting all candidates ranked according to a similarity metric. MATERIAL: The dataset is composed of 180 computed tomographies and 180 radiographs where the frontal sinuses are visible. Frontal sinuses are the skeletal structure analyzed due to their high individualization capability. RESULTS: Firstly, we validate two deep learning-based techniques for segmenting the frontal sinuses in radiographs, obtaining high-quality results. Secondly, we study the framework's shortlisting capability using both automatic segmentations and superimpositions. The obtained superimpositions, based only on the superimposition metric, allowed us to filter out 40% of the possible candidates in a completely automatic manner. Thirdly, we perform a reliability study by comparing 180 radiographs against 180 computed tomographies using manual segmentations. The results allowed us to filter out 73% of the possible candidates. Furthermore, the results are robust to inter- and intra-expert-related errors.

Voxel-wise body composition analysis using image registration of a three-slice CT imaging protocol: methodology and proof-of-concept studies.

BACKGROUND: Computed tomography (CT) is an imaging modality commonly used for studies of internal body structures and very useful for detailed studies of body composition. The aim of this study was to develop and evaluate a fully automatic image registration framework for inter-subject CT slice registration. The aim was also to use the results, in a set of proof-of-concept studies, for voxel-wise statistical body composition analysis (Imiomics) of correlations between imaging and non-imaging data. METHODS: The current study utilized three single-slice CT images of the liver, abdomen, and thigh from two large cohort studies, SCAPIS and IGT. The image registration method developed and evaluated used both CT images together with image-derived tissue and organ segmentation masks. To evaluate the performance of the registration method, a set of baseline 3-single-slice CT images (from 2780 subjects including 8285 slices) from the SCAPIS and IGT cohorts were registered. Vector magnitude and intensity magnitude error indicating inverse consistency were used for evaluation. Image registration results were further used for voxel-wise analysis of associations between the CT images (as represented by tissue volume from Hounsfield unit and Jacobian determinant) and various explicit measurements of various tissues, fat depots, and organs collected in both cohort studies. RESULTS: Our findings demonstrated that the key organs and anatomical structures were registered appropriately. The evaluation parameters of inverse consistency, such as vector magnitude and intensity magnitude error, were on average less than 3 mm and 50 Hounsfield units. The registration followed by Imiomics analysis enabled the examination of associations between various explicit measurements (liver, spleen, abdominal muscle, visceral adipose tissue (VAT), subcutaneous adipose tissue (SAT), thigh SAT, intermuscular adipose tissue (IMAT), and thigh muscle) and the voxel-wise image information. CONCLUSION: The developed and evaluated framework allows accurate image registrations of the collected three single-slice CT images and enables detailed voxel-wise studies of associations between body composition and associated diseases and risk factors.

Compromised Accuracy of Stereotactic Target Delineation Associated with Computed Tomography-Based Frame Registration: A Comparative Analysis of Magnetic Resonance Imaging-Computed Tomography Fusion.

INTRODUCTION: Recent advancements in stereotactic neurosurgical techniques have become increasingly reliant on image-based target planning. We devised a case-phantom comparative analysis to evaluate the target registration errors arising during the magnetic resonance imaging (MRI)-computed tomography (CT) image fusion process. METHODS: For subjects whose preoperative MRI and CT images both contained fiducial frame localizers, we investigated discrepancies in target coordinates derived from frame registration based on either MRI or CT. We generated a phantom target through an image fusion process, merging the framed CT images with their corresponding reference MRIs after masking their fiducial indicators. This phantom target was then compared with the original during each instance of target planning. RESULTS: In our investigative study with 26 frame registrations, a systematic error in the y-axis was observed as -0.89 ± 0.42 mm across cases using either conventional CT and/or cone-beam CT (O-arm). For the z-axis, errors varied on a case-by-case basis, recording at +0.64 ± 1.09 mm with a predominant occurrence in those merged with cone-beam CT. Collectively, these errors resulted in an average Euclidean error of 1.33 ± 0.93 mm. CONCLUSION: Our findings suggest that the accuracy of frame-based stereotactic planning is potentially compromised during MRI-CT fusion process. Practitioners should recognize this issue, underscoring a pressing need for strategies and advancements to optimize the process.

MMIR: an open-source software for the registration of multimodal histological images.

BACKGROUND: Multimodal histology image registration is a process that transforms into a common coordinate system two or more images obtained from different microscopy modalities. The combination of information from various modalities can contribute to a comprehensive understanding of tissue specimens, aiding in more accurate diagnoses, and improved research insights. Multimodal image registration in histology samples presents a significant challenge due to the inherent differences in characteristics and the need for tailored optimization algorithms for each modality. RESULTS: We developed MMIR a cloud-based system for multimodal histological image registration, which consists of three main modules: a project manager, an algorithm manager, and an image visualization system. CONCLUSION: Our software solution aims to simplify image registration tasks with a user-friendly approach. It facilitates effective algorithm management, responsive web interfaces, supports multi-resolution images, and facilitates batch image registration. Moreover, its adaptable architecture allows for the integration of custom algorithms, ensuring that it aligns with the specific requirements of each modality combination. Beyond image registration, our software enables the conversion of segmented annotations from one modality to another.

Visual-motor integration in children with unilateral cerebral palsy: application of the computer-aided measure of visual-motor integration.

BACKGROUND: Children with unilateral cerebral palsy (UCP) are encouraged to participate in the regular school curriculum. However, even when using the less-affected hand for handwriting, children with UCP still experience handwriting difficulties. Visual-motor integration (VMI) is a predictor of handwriting quality. Investigating VMI in children with UCP is important but still lacking. Conventional paper-based VMI assessments is subjective and use all-or-nothing scoring procedures, which may compromise the fidelity of VMI assessments. Moreover, identifying important shapes that are predictive of VMI performance might benefit clinical decision-making because different geometric shapes represent different developmental stepping stones of VMI. Therefore, a new computer-aided measure of VMI (the CAM-VMI) was developed to investigate VMI performance in children with UCP and to identify shapes important for predicting their VMI performance. METHODS: Twenty-eight children with UCP and 28 typically-developing (TD) children were recruited. All participants were instructed to complete the CAM-VMI and Beery-Buktenica Developmental Test of Visual-Motor Integration (Beery-VMI). The test items of the CAM-VMI consisted of nine simple geometric shapes related to writing readiness. Two scores of the CAM-VMI, namely, Error and Effort, were obtained by image registration technique. The performances on the Beery-VMI and the CAM-VMI of children with UCP and TD children were compared by independent t-test. A series of stepwise regression analyses were used to identify shapes important for predicting VMI performance in children with UCP. RESULTS: Significant group differences were found in both the CAM-VMI and the Beery-VMI results. Furthermore, Error was identified as a significant aspect for predicting VMI performance in children with UCP. Specifically, the square item was the only significant predictor of VMI performance in children with UCP. CONCLUSIONS: This study was a large-scale study that provided direct evidence of impaired VMI in school-aged children with UCP. Even when using the less-affected hand, children with UCP could not copy the geometric shapes as well as TD children did. The copied products of children with UCP demonstrated poor constructional accuracy and inappropriate alignment. Furthermore, the predictive model suggested that the constructional accuracy of a copied square is an important predictor of VMI performance in children with UCP.

Evaluation of cumulative dose distributions from external beam radiation therapy using CT-to-CBCT deformable image registration (DIR) for cervical cancer patients.

PURPOSE: To investigate dose differences between the planning CT (pCT) and dose calculated on pre-treatment verification CBCTs using DIR and dose summation for cervical cancer patients. METHODS: Cervical cancer patients treated at our institution with 45 Gy EBRT undergo a pCT and 5 CBCTs, once every five fractions of treatment. A free-form intensity-based DIR in MIM was performed between the pCT and each CBCT using the "Merged CBCT" feature to generate an extended FOV-CBCT (mCBCT). DIR-generated bladder and rectum contours were adjusted by a physician, and dice similarity coefficients (DSC) were calculated. After deformation, the investigated doses were (1) recalculated in Eclipse using original plan parameters (ecD), and (2) deformed from planning dose (pD) using the deformation matrix in MIM (mdD). Dose summation was performed to the first week's mCBCT. Dose distributions were compared for the bladder, rectum, and PTV in terms of percent dose difference, dose volume histograms (DVHs), and gamma analysis between the calculated doses. RESULTS: For the 20 patients, the mean DSC was 0.68 ± 0.17 for bladder and 0.79 ± 0.09 for rectum. Most patients were within 5% of pD for D2cc (19/20), Dmax (17/20), and Dmean (16/20). All patients demonstrated a percent difference > 5% for bladder V45 due to variations in bladder volume from the pCT. D90 showed fewer differences with 19/20 patients within 2% of pD. Gamma rates between pD and ecD averaged 94% for bladder and 94% for rectum, while pD and mdD exhibited slightly better performance for bladder (93%) and lower for rectum (85%). CONCLUSION: Using DIR with weekly CBCT images, the MIM deformed dose (mdD) was found to be in close agreement with the Eclipse calculated dose (ecD). The proposed workflow should be used on a case-by-case basis when the weekly CBCT shows marked difference in organs-at-risk from the planning CT.

Evaluation of the geometric and dosimetric accuracies of deformable image registration of targets and critical organs in prostate CBCT-guided adaptive radiotherapy.

PURPOSE: Kilovoltage cone beam computed tomography (kVCBCT)-guided adaptive radiation therapy (ART) uses daily deformed CT (dCT), which is generated automatically through deformable registration methods. These registration methods may perform poorly in reproducing volumes of the target organ, rectum, and bladder during treatment. We analyzed the registration errors between the daily kVCBCTs and corresponding dCTs for these organs using the default optical flow algorithm and two registration procedures. We validated the effectiveness of these registration methods in replicating the geometry for dose calculation on kVCBCT for ART. METHODS: We evaluated three deformable image registration (DIR) methods to assess their registration accuracy and dose calculation effeciency in mapping target and critical organs. The DIR methods include (1) default intensity-based deformable registration, (2) hybrid deformable registration, and (3) a two-step deformable registration process. Each technique was applied to a computerized imaging reference system (CIRS) phantom (Model 062 M) and to five patients who received volumetric modulated arc therapy to the prostate. Registration accuracy was assessed using the 95% Hausdorff distance (HD95) and Dice similarity coefficient (DSC), and each method was compared with the intensity-based registration method. The improvement in the dCT image quality of the CIRS phantom and five patients was assessed by comparing dCT with kVCBCT. Image quality quantitative metrics for the phantom included the signal-to-noise ratio (SNR), uniformity, and contrast-to-noise ratio (CNR), whereas those for the patients included the mean absolute error (MAE), mean error, peak signal-to-noise ratio (PSNR), and structural similarity index measure (SSIM). To determine dose metric differences, we used a dose-volume histogram (DVH) and 3.0%/0.3 mm gamma analysis to compare planning computed tomography (pCT) and kVCBCT recalculations with restimulated CT images used as a reference. RESULTS: The dCT images generated by the hybrid (dCTH) and two-step (dCTC) registration methods resulted in significant improvements compared to kVCBCT in the phantom model. Specifically, the SNR improved by 107% and 107.2%, the uniformity improved by 90% and 75%, and the CNR improved by 212.2% and 225.6 for dCTH and dCTC methods, respectively. For the patient images, the MAEs improved by 98% and 94%, the PSNRs improved by 16.3% and 22.9%, and the SSIMs improved by 1% and 1% in the dCTH and dCTC methods, respectively. For the geometric evaluation, only the two-step registration method improved registration accuracy. The dCTH method yielded an average HD95 of 12 mm and average DSC of 0.73, whereas dCTC yielded an average HD95 of 2.9 mm and average DSC of 0.902. The DVH showed that the dCTC-based dose calculations differed by <2% from the expected results for treatment targets and volumes of organs at risk. Additionally, gamma indices for dCTC-based treatment plans were >95% at all points, whereas they were <95% for kVCBCT-based treatment plans. CONCLUSION: The two-step registration method outperforms the intensity-based and hybrid registration methods. While the hybrid and two-step-based methods improved the image quality of kVCBCT in a linear accelerator, only the two-step method improved the registration accuracy of the corresponding structures among the pCT and kVCBCT datasets. A two-step registration process is recommended for applying kVCBCT to ART, which achieves better registration accuracy for local and global image structures. This method appears to be beneficial for radiotherapy dose calculation in patients with pelvic cancer.

Evaluation of the availability of single-position treatment with a rotating gantry and the validity of deformable image registration dose assessment for pancreatic cancer carbon-ion radiotherapy.

BACKGROUND: This study aimed to evaluate the clinical acceptability of rotational gantry-based single-position carbon-ion radiotherapy (CIRT) to reduce the gastrointestinal (GI) dose in pancreatic cancer. We also evaluated the usefulness of the deformable image registration (DIR)-based dosimetry method for CIRT. MATERIAL AND METHODS: Fifteen patients with pancreatic cancer were analyzed. The treatment plans were developed for four beam angles in the supine (SP plan) and prone (PR plan) positions. In the case of using multiple positions, the treatment plan was created with two angles for each of the supine and prone position (SP + PR plan). Dose evaluation for multiple positions was performed in two ways: by directly adding the values of the DVH parameters for each position treatment plan (DVH sum), and by calculating the DVH parameters from the accumulative dose distribution created using DIR (DIR sum). The D2cc and D6cc of the stomach and duodenum were recorded for each treatment plan and dosimetry method and compared. RESULTS: There were no significant differences among any of the treatment planning and dosimetry methods (p > 0.05). The DVH parameters for the stomach and duodenum were higher in the PR plan and SP plan, respectively, and DVH sum tended to be between the SP and PR plans. DVH sum and DIR sum, DVH sum tended to be higher for D2cc and DIR sum tended to be higher for D6cc. CONCLUSION: There were no significant differences in the GI dose, which suggests that treatment with a simple workflow performed in one position should be clinically acceptable. In CIRT, DIR-based dosimetry should be carefully considered because of the potential for increased uncertainty due to the steep dose distributions.

Evaluation and mitigation of deformable image registration uncertainties for MRI-guided adaptive radiotherapy.

PURPOSE: We evaluate the performance of a deformable image registration (DIR) software package in registering abdominal magnetic resonance images (MRIs) and then develop a mechanical modeling method to mitigate detected DIR uncertainties. MATERIALS AND METHODS: Three evaluation metrics, namely mean displacement to agreement (MDA), DICE similarity coefficient (DSC), and standard deviation of Jacobian determinants (STD-JD), are used to assess the multi-modality (MM), contour-consistency (CC), and image-intensity (II)-based DIR algorithms in the MIM software package, as well as an in-house developed, contour matching-based finite element method (CM-FEM). Furthermore, we develop a hybrid FEM registration technique to modify the displacement vector field of each MIM registration. The MIM and FEM registrations were evaluated on MRIs obtained from 10 abdominal cancer patients. One-tailed Wilcoxon-Mann-Whitney (WMW) tests were conducted to compare the MIM registrations with their FEM modifications. RESULTS: For the registrations performed with the MIM-CC, MIM-MM, MIM-II, and CM-FEM algorithms, their average MDAs are 0.62 ± 0.27, 2.39 ± 1.30, 3.07 ± 2.42, 1.04 ± 0.72 mm, and average DSCs are 0.94 ± 0.03, 0.80 ± 0.12, 0.77 ± 0.15, 0.90 ± 0.11, respectively. The p-values of the WMW tests between the MIM registrations and their FEM modifications are less than 0.0084 for STD-JDs and greater than 0.87 for MDA and DSC. CONCLUSIONS: Among the three MIM DIR algorithms, MIM-CC shows the smallest errors in terms of MDA and DSC but exhibits significant Jacobian uncertainties in the interior regions of abdominal organs. The hybrid FEM technique effectively mitigates the Jacobian uncertainties in these regions.

Experimental Setup for Evaluating Depth Sensors in Augmented Reality Technologies Used in Medical Devices.

This paper presents a fully automated experimental setup tailored for evaluating the effectiveness of augmented and virtual reality technologies in healthcare settings for regulatory purposes, with a focus on the characterization of depth sensors. The setup is constructed as a modular benchtop platform that enables quantitative analysis of depth cameras essential for extended reality technologies in a controlled environment. We detail a design concept and considerations for an experimental configuration aimed at simulating realistic scenarios for head-mounted displays. The system includes an observation platform equipped with a three-degree-of-freedom motorized system and a test object stage. To accurately replicate real-world scenarios, we utilized an array of sensors, including commonly available range-sensing cameras and commercial augmented reality headsets, notably the Intel RealSense L515 LiDAR camera, integrated into the motion control system. The paper elaborates on the system architecture and the automated data collection process. We discuss several evaluation studies performed with this setup, examining factors such as spatial resolution, Z-accuracy, and pixel-to-pixel correlation. These studies provide valuable insights into the precision and reliability of these technologies in simulated healthcare environments.

OS-PSO: A Modified Ratio of Exponentially Weighted Averages-Based Optical and SAR Image Registration.

Optical and synthetic aperture radar (SAR) images exhibit non-negligible intensity differences due to their unique imaging mechanisms, which makes it difficult for classical SIFT-based algorithms to obtain sufficiently correct correspondences when processing the registration of these two types of images. To tackle this problem, an accurate optical and SAR image registration algorithm based on the SIFT algorithm (OS-PSO) is proposed. First, a modified ratio of exponentially weighted averages (MROEWA) operator is introduced to resolve the sudden dark patches in SAR images, thus generating more consistent gradients between optical and SAR images. Next, we innovatively construct the Harris scale space to replace the traditional difference in the Gaussian (DoG) scale space, identify repeatable key-points by searching for local maxima, and perform localization refinement on the identified key-points to improve their accuracy. Immediately after that, the gradient location orientation histogram (GLOH) method is adopted to construct the feature descriptors. Finally, we propose an enhanced matching method. The transformed relation is obtained in the initial matching stage using the nearest neighbor distance ratio (NNDR) and fast sample consensus (FSC) methods. And the re-matching takes into account the location, scale, and main direction of key-points to increase the number of correctly corresponding points. The proposed OS-PSO algorithm has been implemented on the Gaofen and Sentinel series with excellent results. The superior performance of the designed registration system can also be applied in complex scenarios, including urban, suburban, river, farmland, and lake areas, with more efficiency and accuracy than the state-of-the-art methods based on the WHU-OPT-SAR dataset and the BISTU-OPT-SAR dataset.

Star Image Registration Modeling and Parameter Calibration for a 3CMOS Star Sensor.

This paper presents an image registration method specifically designed for a star sensor equipped with three complementary metal oxide semiconductor (CMOS) detectors. Its purpose is to register the red-, green-, and blue-channel star images acquired from three CMOS detectors, assuring the precision of star image fusion and centroid extraction in subsequent stages. This study starts with a theoretical analysis aimed at investigating the effect of inconsistent three-channel imaging parameters on the position of feature points. Based on this analysis, this paper establishes a registration model for transforming the red- and blue-channel star images into the green channel's coordinate system. Subsequently, the method estimates model parameters by finding a nonlinear least-squares solution. The experimental results demonstrate the correctness of the theoretical analysis and the proposed registration method. This method can achieve subpixel alignment accuracy in both the x and y directions, thus effectively ensuring the performance of subsequent operation steps in the 3CMOS star sensor.