Skin strata delineation in reflectance confocal microscopy images using recurrent convolutional networks with attention.

Reflectance confocal microscopy (RCM) is an effective non-invasive tool for cancer diagnosis. However, acquiring and reading RCM images requires extensive training and experience, and novice clinicians exhibit high discordance in diagnostic accuracy. Quantitative tools to standardize image acquisition could reduce both required training and diagnostic variability. To perform diagnostic analysis, clinicians collect a set of RCM mosaics (RCM images concatenated in a raster fashion to extend the field view) at 4-5 specific layers in skin, all localized in the junction between the epidermal and dermal layers (dermal-epidermal junction, DEJ), necessitating locating that junction before mosaic acquisition. In this study, we automate DEJ localization using deep recurrent convolutional neural networks to delineate skin strata in stacks of RCM images collected at consecutive depths. Success will guide to automated and quantitative mosaic acquisition thus reducing inter operator variability and bring standardization in imaging. Testing our model against an expert labeled dataset of 504 RCM stacks, we achieved [Formula: see text] classification accuracy and nine-fold reduction in the number of anatomically impossible errors compared to the previous state-of-the-art.

Semantic segmentation of reflectance confocal microscopy mosaics of pigmented lesions using weak labels.

Reflectance confocal microscopy (RCM) is a non-invasive imaging tool that reduces the need for invasive histopathology for skin cancer diagnoses by providing high-resolution mosaics showing the architectural patterns of skin, which are used to identify malignancies in-vivo. RCM mosaics are similar to dermatopathology sections, both requiring extensive training to interpret. However, these modalities differ in orientation, as RCM mosaics are horizontal (parallel to the skin surface) while histopathology sections are vertical, and contrast mechanism, RCM with a single (reflectance) mechanism resulting in grayscale images and histopathology with multi-factor color-stained contrast. Image analysis and machine learning methods can potentially provide a diagnostic aid to clinicians to interpret RCM mosaics, eventually helping to ease the adoption and more efficiently utilizing RCM in routine clinical practice. However standard supervised machine learning may require a prohibitive volume of hand-labeled training data. In this paper, we present a weakly supervised machine learning model to perform semantic segmentation of architectural patterns encountered in RCM mosaics. Unlike more widely used fully supervised segmentation models that require pixel-level annotations, which are very labor-demanding and error-prone to obtain, here we focus on training models using only patch-level labels (e.g. a single field of view within an entire mosaic). We segment RCM mosaics into "benign" and "aspecific (nonspecific)" regions, where aspecific regions represent the loss of regular architecture due to injury and/or inflammation, pre-malignancy, or malignancy. We adopt Efficientnet, a deep neural network (DNN) proven to accurately accomplish classification tasks, to generate class activation maps, and use a Gaussian weighting kernel to stitch smaller images back into larger fields of view. The trained DNN achieved an average area under the curve of 0.969, and Dice coefficient of 0.778 showing the feasibility of spatial localization of aspecific regions in RCM images, and making the diagnostics decision model more interpretable to the clinicians.

Segmentation of cellular patterns in confocal images of melanocytic lesions in vivo via a multiscale encoder-decoder network (MED-Net).

In-vivo optical microscopy is advancing into routine clinical practice for non-invasively guiding diagnosis and treatment of cancer and other diseases, and thus beginning to reduce the need for traditional biopsy. However, reading and analysis of the optical microscopic images are generally still qualitative, relying mainly on visual examination. Here we present an automated semantic segmentation method called "Multiscale Encoder-Decoder Network (MED-Net)" that provides pixel-wise labeling into classes of patterns in a quantitative manner. The novelty in our approach is the modeling of textural patterns at multiple scales (magnifications, resolutions). This mimics the traditional procedure for examining pathology images, which routinely starts with low magnification (low resolution, large field of view) followed by closer inspection of suspicious areas with higher magnification (higher resolution, smaller fields of view). We trained and tested our model on non-overlapping partitions of 117 reflectance confocal microscopy (RCM) mosaics of melanocytic lesions, an extensive dataset for this application, collected at four clinics in the US, and two in Italy. With patient-wise cross-validation, we achieved pixel-wise mean sensitivity and specificity of 74% and 92%, respectively, with 0.74 Dice coefficient over six classes. In the scenario, we partitioned the data clinic-wise and tested the generalizability of the model over multiple clinics. In this setting, we achieved pixel-wise mean sensitivity and specificity of 77% and 94%, respectively, with 0.77 Dice coefficient. We compared MED-Net against the state-of-the-art semantic segmentation models and achieved better quantitative segmentation performance. Our results also suggest that, due to its nested multiscale architecture, the MED-Net model annotated RCM mosaics more coherently, avoiding unrealistic-fragmented annotations.

FiXR: a framework to reconstruct fiber cross-sections from X-ray fiber diffraction experiments.

Ab initio reconstruction methods have revolutionized the capabilities of small-angle X-ray scattering (SAXS), allowing the data-driven discovery of previously unknown molecular conformations, exploiting optimization heuristics and assumptions behind the composition of globular molecules. While these methods have been successful for the analysis of small particles, their impact on fibrillar assemblies has been more limited. The micrometre-range size of these assemblies and the complex interaction of their periodicities in their scattering profiles indicate that the discovery of fibril structures from SAXS measurements requires novel approaches beyond extending existing tools for molecular discovery. In this work, it is proposed to use SAXS measurements, together with diffraction theory, to infer the electron distribution of the average cross-section of a fiber. This cross-section is modeled as a discrete electron density with continuous support, allowing representations beyond binary distributions. Additional constraints, such as non-negativity or smoothness/connectedness, can also be added to the framework. The proposed approach is tested using simulated SAXS data from amyloid ß fibril models and using measured data of Tobacco mosaic virus from SAXS experiments, recovering the geometry and density of the cross-sections in all cases. The approach is further tested by analyzing SAXS data from different amyloid ß fibril assemblies, with results that are in agreement with previously proposed models from cryo-EM measurements. The limitations of the proposed method, together with an analysis of the robustness of the method and the combination with different experimental sources, are also discussed.

Multichannel correlation improves the noise tolerance of real-time hyperspectral microimage mosaicking.

Live-subject microscopies, including microendoscopy and other related technologies, offer promise for basic biology research as well as the optical biopsy of disease in the clinic. However, cellular resolution generally comes with the trade-off of a microscopic field-of-view. Microimage mosaicking enables stitching many small scenes together to aid visualization, quantitative interpretation, and mapping of microscale features, for example, to guide surgical intervention. The development of hyperspectral and multispectral systems for biomedical applications provides motivation for adapting mosaicking algorithms to process a number of simultaneous spectral channels. We present an algorithm that mosaics multichannel video by correlating channels of consecutive frames as a basis for efficiently calculating image alignments. We characterize the noise tolerance of the algorithm by using simulated video with known ground-truth alignments to quantify mosaicking accuracy and speed, showing that multiplexed molecular imaging enhances mosaic accuracy by leveraging observations of distinct molecular constituents to inform frame alignment. A simple mathematical model is introduced to characterize the noise suppression provided by a given group of spectral channels, thus predicting the performance of selected subsets of data channels in order to balance mosaic computation accuracy and speed. The characteristic noise tolerance of a given number of channels is shown to improve through selection of an optimal subset of channels that maximizes this model. We also demonstrate that the multichannel algorithm produces higher quality mosaics than the analogous single-channel methods in an empirical test case. To compensate for the increased data rate of hyperspectral video compared to single-channel systems, we employ parallel processing via GPUs to alleviate computational bottlenecks and to achieve real-time mosaicking even for video-rate multichannel systems anticipated in the future. This implementation paves the way for real-time multichannel mosaicking to accompany next-generation hyperspectral and multispectral video microscopy.

Automated video-mosaicking approach for confocal microscopic imaging in vivo: an approach to address challenges in imaging living tissue and extend field of view.

We describe a computer vision-based mosaicking method for in vivo videos of reflectance confocal microscopy (RCM). RCM is a microscopic imaging technique, which enables the users to rapidly examine tissue in vivo. Providing resolution at cellular-level morphology, RCM imaging combined with mosaicking has shown to be highly sensitive and specific for non-invasively guiding skin cancer diagnosis. However, current RCM mosaicking techniques with existing microscopes have been limited to two-dimensional sequences of individual still images, acquired in a highly controlled manner, and along a specific predefined raster path, covering a limited area. The recent advent of smaller handheld microscopes is enabling acquisition of videos, acquired in a relatively uncontrolled manner and along an ad-hoc arbitrarily free-form, non-rastered path. Mosaicking of video-images (video-mosaicking) is necessary to display large areas of tissue. Our video-mosaicking methods addresses this need. The method can handle unique challenges encountered during video capture such as motion blur artifacts due to rapid motion of the microscope over the imaged area, warping in frames due to changes in contact angle and varying resolution with depth. We present test examples of video-mosaics of melanoma and non-melanoma skin cancers, to demonstrate potential clinical utility.

Effects of Catalytic Action and Ligand Binding on Conformational Ensembles of Adenylate Kinase.

Crystal structures of adenylate kinase (AdK) from Escherichia coli capture two states: an "open" conformation (apo) obtained in the absence of ligands and a "closed" conformation in which ligands are bound. Other AdK crystal structures suggest intermediate conformations that may lie on the transition pathway between these two states. To characterize the transition from open to closed states in solution, X-ray solution scattering data were collected from AdK in the apo form and with progressively increasing concentrations of five different ligands. Scattering data from apo AdK are consistent with scattering predicted from the crystal structure of AdK in the open conformation. In contrast, data from AdK samples saturated with Ap5A do not agree with that calculated from AdK in the closed conformation. Using cluster analysis of available structures, we selected representative structures in five conformational states: open, partially open, intermediate, partially closed, and closed. We used these structures to estimate the relative abundances of these states for each experimental condition. X-ray solution scattering data obtained from AdK with AMP are dominated by scattering from AdK in the open conformation. For AdK in the presence of high concentrations of ATP and ADP, the conformational ensemble shifts to a mixture of partially open and closed states. Even when AdK is saturated with Ap5A, a significant proportion of AdK remains in a partially open conformation. These results are consistent with an induced-fit model in which the transition of AdK from an open state to a closed state is initiated by ATP binding.

A Marked Poisson Process Driven Latent Shape Model for 3D Segmentation of Reflectance Confocal Microscopy Image Stacks of Human Skin.

Segmenting objects of interest from 3D data sets is a common problem encountered in biological data. Small field of view and intrinsic biological variability combined with optically subtle changes of intensity, resolution, and low contrast in images make the task of segmentation difficult, especially for microscopy of unstained living or freshly excised thick tissues. Incorporating shape information in addition to the appearance of the object of interest can often help improve segmentation performance. However, the shapes of objects in tissue can be highly variable and design of a flexible shape model that encompasses these variations is challenging. To address such complex segmentation problems, we propose a unified probabilistic framework that can incorporate the uncertainty associated with complex shapes, variable appearance, and unknown locations. The driving application that inspired the development of this framework is a biologically important segmentation problem: the task of automatically detecting and segmenting the dermal-epidermal junction (DEJ) in 3D reflectance confocal microscopy (RCM) images of human skin. RCM imaging allows noninvasive observation of cellular, nuclear, and morphological detail. The DEJ is an important morphological feature as it is where disorder, disease, and cancer usually start. Detecting the DEJ is challenging, because it is a 2D surface in a 3D volume which has strong but highly variable number of irregularly spaced and variably shaped "peaks and valleys." In addition, RCM imaging resolution, contrast, and intensity vary with depth. Thus, a prior model needs to incorporate the intrinsic structure while allowing variability in essentially all its parameters. We propose a model which can incorporate objects of interest with complex shapes and variable appearance in an unsupervised setting by utilizing domain knowledge to build appropriate priors of the model. Our novel strategy to model this structure combines a spatial Poisson process with shape priors and performs inference using Gibbs sampling. Experimental results show that the proposed unsupervised model is able to automatically detect the DEJ with physiologically relevant accuracy in the range 10- 20 µm .

Characterization of structural-prior guided optical tomography using realistic breast models derived from dual-energy x-ray mammography.

Multi-spectral near-infrared diffuse optical tomography (DOT) is capable of providing functional tissue assessment that can complement structural mammographic images for more comprehensive breast cancer diagnosis. To take full advantage of the readily available sub-millimeter resolution structural information in a multi-modal imaging setting, an efficient x-ray/optical joint image reconstruction model has been proposed previously to utilize anatomical information from a mammogram as a structural prior. In this work, we develop a complex digital breast phantom (available at http://openjd.sf.net/digibreast) based on direct measurements of fibroglandular tissue volume fractions using dual-energy mammographic imaging of a human breast. We also extend our prior-guided reconstruction algorithm to facilitate the recovery of breast tumors, and perform a series of simulation-based studies to systematically evaluate the impact of lesion sizes and contrasts, tissue background, mesh resolution, inaccurate priors, and regularization parameters, on the recovery of breast tumors using multi-modal DOT/x-ray measurements. Our studies reveal that the optical property estimation error can be reduced by half by utilizing structural priors; the minimum detectable tumor size can also be reduced by half when prior knowledge regarding the tumor location is provided. Moreover, our algorithm is shown to be robust to false priors on tumor location.

Automated delineation of dermal-epidermal junction in reflectance confocal microscopy image stacks of human skin.

Reflectance confocal microscopy (RCM) images skin noninvasively, with optical sectioning and nuclear-level resolution comparable with that of pathology. On the basis of the assessment of the dermal-epidermal junction (DEJ) and morphologic features in its vicinity, skin cancer can be diagnosed in vivo with high sensitivity and specificity. However, the current visual, qualitative approach for reading images leads to subjective variability in diagnosis. We hypothesize that machine learning-based algorithms may enable a more quantitative, objective approach. Testing and validation were performed with two algorithms that can automatically delineate the DEJ in RCM stacks of normal human skin. The test set was composed of 15 fair- and 15 dark-skin stacks (30 subjects) with expert labelings. In dark skin, in which the contrast is high owing to melanin, the algorithm produced an average error of 7.9±6.4 µm. In fair skin, the algorithm delineated the DEJ as a transition zone, with average error of 8.3±5.8 µm for the epidermis-to-transition zone boundary and 7.6±5.6 µm for the transition zone-to-dermis. Our results suggest that automated algorithms may quantitatively guide the delineation of the DEJ, to assist in objective reading of RCM images. Further development of such algorithms may guide assessment of abnormal morphological features at the DEJ.

Visualizing simulated electrical fields from electroencephalography and transcranial electric brain stimulation: a comparative evaluation.

Electrical activity of neuronal populations is a crucial aspect of brain activity. This activity is not measured directly but recorded as electrical potential changes using head surface electrodes (electroencephalogram - EEG). Head surface electrodes can also be deployed to inject electrical currents in order to modulate brain activity (transcranial electric stimulation techniques) for therapeutic and neuroscientific purposes. In electroencephalography and noninvasive electric brain stimulation, electrical fields mediate between electrical signal sources and regions of interest (ROI). These fields can be very complicated in structure, and are influenced in a complex way by the conductivity profile of the human head. Visualization techniques play a central role to grasp the nature of those fields because such techniques allow for an effective conveyance of complex data and enable quick qualitative and quantitative assessments. The examination of volume conduction effects of particular head model parameterizations (e.g., skull thickness and layering), of brain anomalies (e.g., holes in the skull, tumors), location and extent of active brain areas (e.g., high concentrations of current densities) and around current injecting electrodes can be investigated using visualization. Here, we evaluate a number of widely used visualization techniques, based on either the potential distribution or on the current-flow. In particular, we focus on the extractability of quantitative and qualitative information from the obtained images, their effective integration of anatomical context information, and their interaction. We present illustrative examples from clinically and neuroscientifically relevant cases and discuss the pros and cons of the various visualization techniques.

Validation Study of Automated Dermal/Epidermal Junction Localization Algorithm in Reflectance Confocal Microscopy Images of Skin.

Reflectance confocal microscopy (RCM) has seen increasing clinical application for noninvasive diagnosis of skin cancer. Identifying the location of the dermal-epidermal junction (DEJ) in the image stacks is key for effective clinical imaging. For example, one clinical imaging procedure acquires a dense stack of 0.5×0.5mm FOV images and then, after manual determination of DEJ depth, collects a 5×5mm mosaic at that depth for diagnosis. However, especially in lightly pigmented skin, RCM images have low contrast at the DEJ which makes repeatable, objective visual identification challenging. We have previously published proof of concept for an automated algorithm for DEJ detection in both highly- and lightly-pigmented skin types based on sequential feature segmentation and classification. In lightly-pigmented skin the change of skin texture with depth was detected by the algorithm and used to locate the DEJ. Here we report on further validation of our algorithm on a more extensive collection of 24 image stacks (15 fair skin, 9 dark skin). We compare algorithm performance against classification by three clinical experts. We also evaluate inter-expert consistency among the experts. The average correlation across experts was 0.81 for lightly pigmented skin, indicating the difficulty of the problem. The algorithm achieved epidermis/dermis misclassification rates smaller than 10% (based on 25×25 mm tiles) and average distance from the expert labeled boundaries of ~6.4 µm for fair skin and ~5.3 µm for dark skin, well within average cell size and less than 2x the instrument resolution in the optical axis.

Semi-automated Algorithm for Localization of Dermal/ Epidermal Junction in Reflectance Confocal Microscopy Images of Human Skin.

The examination of the dermis/epidermis junction (DEJ) is clinically important for skin cancer diagnosis. Reflectance confocal microscopy (RCM) is an emerging tool for detection of skin cancers in vivo. However, visual localization of the DEJ in RCM images, with high accuracy and repeatability, is challenging, especially in fair skin, due to low contrast, heterogeneous structure and high inter- and intra-subject variability. We recently proposed a semi-automated algorithm to localize the DEJ in z-stacks of RCM images of fair skin, based on feature segmentation and classification. Here we extend the algorithm to dark skin. The extended algorithm first decides the skin type and then applies the appropriate DEJ localization method. In dark skin, strong backscatter from the pigment melanin causes the basal cells above the DEJ to appear with high contrast. To locate those high contrast regions, the algorithm operates on small tiles (regions) and finds the peaks of the smoothed average intensity depth profile of each tile. However, for some tiles, due to heterogeneity, multiple peaks in the depth profile exist and the strongest peak might not be the basal layer peak. To select the correct peak, basal cells are represented with a vector of texture features. The peak with most similar features to this feature vector is selected. The results show that the algorithm detected the skin types correctly for all 17 stacks tested (8 fair, 9 dark). The DEJ detection algorithm achieved an average distance from the ground truth DEJ surface of around 4.7µm for dark skin and around 7-14µm for fair skin.

Pilot study of semiautomated localization of the dermal/epidermal junction in reflectance confocal microscopy images of skin.

Reflectance confocal microscopy (RCM) continues to be translated toward the detection of skin cancers in vivo. Automated image analysis may help clinicians and accelerate clinical acceptance of RCM. For screening and diagnosis of cancer, the dermal/epidermal junction (DEJ), at which melanomas and basal cell carcinomas originate, is an important feature in skin. In RCM images, the DEJ is marked by optically subtle changes and features and is difficult to detect purely by visual examination. Challenges for automation of DEJ detection include heterogeneity of skin tissue, high inter-, intra-subject variability, and low optical contrast. To cope with these challenges, we propose a semiautomated hybrid sequence segmentation/classification algorithm that partitions z-stacks of tiles into homogeneous segments by fitting a model of skin layer dynamics and then classifies tile segments as epidermis, dermis, or transitional DEJ region using texture features. We evaluate two different training scenarios: 1. training and testing on portions of the same stack; 2. training on one labeled stack and testing on one from a different subject with similar skin type. Initial results demonstrate the detectability of the DEJ in both scenarios with epidermis/dermis misclassification rates smaller than 10% and average distance from the expert labeled boundaries around 8.5 µm.

Combined optical and X-ray tomosynthesis breast imaging.

PURPOSE: To explore the optical and physiologic properties of normal and lesion-bearing breasts by using a combined optical and digital breast tomosynthesis (DBT) imaging system. MATERIALS AND METHODS: Institutional review board approval and patient informed consent were obtained for this HIPAA-compliant study. Combined optical and tomosynthesis imaging analysis was performed in 189 breasts from 125 subjects (mean age, 56 years ± 13 [standard deviation]), including 138 breasts with negative findings and 51 breasts with lesions. Three-dimensional (3D) maps of total hemoglobin concentration (Hb(T)), oxygen saturation (So(2)), and tissue reduced scattering coefficients were interpreted by using the coregistered DBT images. Paired and unpaired t tests were performed between various tissue types to identify significant differences. RESULTS: The estimated average bulk Hb(T) from 138 normal breasts was 19.2 µmol/L. The corresponding mean So(2) was 0.73, within the range of values in the literature. A linear correlation (R = 0.57, P < .0001) was found between Hb(T) and the fibroglandular volume fraction derived from the 3D DBT scans. Optical reconstructions of normal breasts revealed structures corresponding to chest-wall muscle, fibroglandular, and adipose tissues in the Hb(T), So(2), and scattering images. In 26 malignant tumors of 0.6-2.5 cm in size, Hb(T) was significantly greater than that in the fibroglandular tissue of the same breast (P = .0062). Solid benign lesions (n = 17) and cysts (n = 8) had significantly lower Hb(T) contrast than did the malignant lesions (P = .025 and P = .0033, respectively). CONCLUSION: The optical and DBT images were structurally consistent. The malignant tumors and benign lesions demonstrated different Hb(T) and scattering contrasts, which can potentially be exploited to reduce the false-positive rate of conventional mammography and unnecessary biopsies.

Centerline extraction with principal curve tracing to improve 3D level set esophagus segmentation in CT images.

For radiotherapy planning, contouring of target volume and healthy structures at risk in CT volumes is essential. To automate this process, one of the available segmentation techniques can be used for many thoracic organs except the esophagus, which is very hard to segment due to low contrast. In this work we propose to initialize our previously introduced model based 3D level set esophagus segmentation method with a principal curve tracing (PCT) algorithm, which we adapted to solve the esophagus centerline detection problem. To address challenges due to low intensity contrast, we enhanced the PCT algorithm by learning spatial and intensity priors from a small set of annotated CT volumes. To locate the esophageal wall, the model based 3D level set algorithm including a shape model that represents the variance of esophagus wall around the estimated centerline is utilized. Our results show improvement in esophagus segmentation when initialized by PCT compared to our previous work, where an ad hoc centerline initialization was performed. Unlike previous approaches, this work does not need a very large set of annotated training images and has similar performance.

Combined optical imaging and mammography of the healthy breast: optical contrast derived from breast structure and compression.

In this paper, we report new progress in developing the instrument and software platform of a combined X-ray mammography/diffuse optical breast imaging system. Particularly, we focus on system validation using a series of balloon phantom experiments and the optical image analysis of 49 healthy patients. Using the finite-element method for forward modeling and a regularized Gauss-Newton method for parameter reconstruction, we recovered the inclusions inside the phantom and the hemoglobin images of the human breasts. An enhanced coupling coefficient estimation scheme was also incorporated to improve the accuracy and robustness of the reconstructions. The recovered average total hemoglobin concentration (HbT) and oxygen saturation (SO2) from 68 breast measurements are 16.2 microm and 71%, respectively, where the HbT presents a linear trend with breast density. The low HbT value compared to literature is likely due to the associated mammographic compression. From the spatially co-registered optical/X-ray images, we can identify the chest-wall muscle, fatty tissue, and fibroglandular regions with an average HbT of 20.1+/-6.1 microm for fibroglandular tissue, 15.4+/-5.0 microm for adipose, and 22.2+/-7.3 microm for muscle tissue. The differences between fibroglandular tissue and the corresponding adipose tissue are significant (p < 0.0001). At the same time, we recognize that the optical images are influenced, to a certain extent, by mammographical compression. The optical images from a subset of patients show composite features from both tissue structure and pressure distribution. We present mechanical simulations which further confirm this hypothesis.

Estimation and statistical bounds for three-dimensional polar shapes in diffuse optical tomography.

Voxel-based reconstructions in diffuse optical tomography (DOT) using a quadratic regularization functional tend to produce very smooth images due to the attenuation of high spatial frequencies. This then causes difficulty in estimating the spatial extent and contrast of anomalous regions such as tumors. Given an assumption that the target image is piecewise constant, we can employ a parametric model to estimate the boundaries and contrast of an inhomogeneity directly. In this paper, we describe a method to directly reconstruct such a shape boundary from diffuse optical measurements. We parameterized the object boundary using a spherical harmonic basis, and derived a method to compute sensitivities of measurements with respect to shape parameters. We introduced a centroid constraint to ensure uniqueness of the combined shape/center parameter estimate, and a projected Newton method was utilized to optimize the object center position and shape parameters simultaneously. Using the shape Jacobian, we also computed the Cramér-Rao lower bound on the theoretical estimator accuracy given a particular measurement configuration, object shape, and level of measurement noise. Knowledge of the shape sensitivity matrix and of the measurement noise variance allows us to visualize the shape uncertainty region in three dimensions, giving a confidence region for our shape estimate. We have implemented our shape reconstruction method, using a finite-difference-based forward model to compute the forward and adjoint fields. Reconstruction results are shown for a number of simulated target shapes, and we investigate the problem of model order selection using realistic levels of measurement noise. Assuming a signal-to-noise ratio in the amplitude measurements of 40 dB and a standard deviation in the phase measurements of 0.1 degrees , we are able to estimate an object represented with an eighth-order spherical harmonic model having an absorption contrast of 0.15 cm(-1) and a volume of 4.82 cm(3) with errors of less than 10% in object volume and absorption contrast. We also investigate the robustness of our shape-based reconstruction approach to a violation of the assumption that the medium is purely piecewise constant.

Spatio-temporal imaging of the hemoglobin in the compressed breast with diffuse optical tomography.

We develop algorithms for imaging the time-varying optical absorption within the breast given diffuse optical tomographic data collected over a time span that is long compared to the dynamics of the medium. Multispectral measurements allow for the determination of the time-varying total hemoglobin concentration and of oxygen saturation. To facilitate the image reconstruction, we decompose the hemodynamics in time into a linear combination of spatio-temporal basis functions, the coefficients of which are estimated using all of the data simultaneously, making use of a Newton-based nonlinear optimization algorithm. The solution of the extremely large least-squares problem which arises in computing the Newton update is obtained iteratively using the LSQR algorithm. A Laplacian spatial regularization operator is applied, and, in addition, we make use of temporal regularization which tends to encourage similarity between the images of the spatio-temporal coefficients. Results are shown for an extensive simulation, in which we are able to image and quantify localized changes in both total hemoglobin concentration and oxygen saturation. Finally, a breast compression study has been performed for a normal breast cancer screening subject, using an instrument which allows for highly accurate co-registration of multispectral diffuse optical measurements with an x-ray tomosynthesis image of the breast. We are able to quantify the global return of blood to the breast following compression, and, in addition, localized changes are observed which correspond to the glandular region of the breast.

A statistical approach to inverting the Born ratio.

We examine the problem of fluorescence molecular tomography using the normalized Born approximation, termed herein the Born ratio, from a statistical perspective. Experimentally verified noise models for received signals at the excitation and emission wavelengths are combined to generate a stochastic model for the Born ratio. This model is then utilized within a maximum likelihood framework to obtain an inverse solution based on a fixed point iteration. Results are presented for three experimental scenarios: phantom data with a homogeneous background, phantoms implanted within a small animal, and in vivo data using an exogenous probe.