Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 24
Filter
1.
Comput Struct Biotechnol J ; 24: 89-104, 2024 Dec.
Article in English | MEDLINE | ID: mdl-38268780

ABSTRACT

Background: Bone marrow adipose tissue (BMAT) represents > 10% fat mass in healthy humans and can be measured by magnetic resonance imaging (MRI) as the bone marrow fat fraction (BMFF). Human MRI studies have identified several diseases associated with BMFF but have been relatively small scale. Population-scale studies therefore have huge potential to reveal BMAT's true clinical relevance. The UK Biobank (UKBB) is undertaking MRI of 100,000 participants, providing the ideal opportunity for such advances. Objective: To establish deep learning for high-throughput multi-site BMFF analysis from UKBB MRI data. Materials and methods: We studied males and females aged 60-69. Bone marrow (BM) segmentation was automated using a new lightweight attention-based 3D U-Net convolutional neural network that improved segmentation of small structures from large volumetric data. Using manual segmentations from 61-64 subjects, the models were trained to segment four BM regions of interest: the spine (thoracic and lumbar vertebrae), femoral head, total hip and femoral diaphysis. Models were tested using a further 10-12 datasets per region and validated using datasets from 729 UKBB participants. BMFF was then quantified and pathophysiological characteristics assessed, including site- and sex-dependent differences and the relationships with age, BMI, bone mineral density, peripheral adiposity, and osteoporosis. Results: Model accuracy matched or exceeded that for conventional U-Nets, yielding Dice scores of 91.2% (spine), 94.5% (femoral head), 91.2% (total hip) and 86.6% (femoral diaphysis). One case of severe scoliosis prevented segmentation of the spine, while one case of Non-Hodgkin Lymphoma prevented segmentation of the spine, femoral head and total hip because of T2 signal depletion; however, successful segmentation was not disrupted by any other pathophysiological variables. The resulting BMFF measurements confirmed expected relationships between BMFF and age, sex and bone density, and identified new site- and sex-specific characteristics. Conclusions: We have established a new deep learning method for accurate segmentation of small structures from large volumetric data, allowing high-throughput multi-site BMFF measurement in the UKBB. Our findings reveal new pathophysiological insights, highlighting the potential of BMFF as a novel clinical biomarker. Applying our method across the full UKBB cohort will help to reveal the impact of BMAT on human health and disease.

2.
IEEE J Biomed Health Inform ; 28(3): 1398-1411, 2024 Mar.
Article in English | MEDLINE | ID: mdl-38157463

ABSTRACT

Medical imaging is a key component in clinical diagnosis, treatment planning and clinical trial design, accounting for almost 90% of all healthcare data. CNNs achieved performance gains in medical image analysis (MIA) over the last years. CNNs can efficiently model local pixel interactions and be trained on small-scale MI data. Despite their important advances, typical CNN have relatively limited capabilities in modelling "global" pixel interactions, which restricts their generalisation ability to understand out-of-distribution data with different "global" information. The recent progress of Artificial Intelligence gave rise to Transformers, which can learn global relationships from data. However, full Transformer models need to be trained on large-scale data and involve tremendous computational complexity. Attention and Transformer compartments ("Transf/Attention") which can well maintain properties for modelling global relationships, have been proposed as lighter alternatives of full Transformers. Recently, there is an increasing trend to co-pollinate complementary local-global properties from CNN and Transf/Attention architectures, which led to a new era of hybrid models. The past years have witnessed substantial growth in hybrid CNN-Transf/Attention models across diverse MIA problems. In this systematic review, we survey existing hybrid CNN-Transf/Attention models, review and unravel key architectural designs, analyse breakthroughs, and evaluate current and future opportunities as well as challenges. We also introduced an analysis framework on generalisation opportunities of scientific and clinical impact, based on which new data-driven domain generalisation and adaptation methods can be stimulated.


Subject(s)
Artificial Intelligence , Image Processing, Computer-Assisted , Computer Simulation
3.
Commun Med (Lond) ; 3(1): 189, 2023 Dec 20.
Article in English | MEDLINE | ID: mdl-38123736

ABSTRACT

BACKGROUND: Primary immunodeficiency (PI) is a group of heterogeneous disorders resulting from immune system defects. Over 70% of PI is undiagnosed, leading to increased mortality, co-morbidity and healthcare costs. Among PI disorders, combined immunodeficiencies (CID) are characterized by complex immune defects. Common variable immunodeficiency (CVID) is among the most common types of PI. In light of available treatments, it is critical to identify adult patients at risk for CID and CVID, before the development of serious morbidity and mortality. METHODS: We developed a deep learning-based method (named "TabMLPNet") to analyze clinical history from nationally representative medical claims from electronic health records (Optum® data, covering all US), evaluated in the setting of identifying CID/CVID in adults. Further, we revealed the most important CID/CVID-associated antecedent phenotype combinations. Four large cohorts were generated: a total of 47,660 PI cases and (1:1 matched) controls. RESULTS: The sensitivity/specificity of TabMLPNet modeling ranges from 0.82-0.88/0.82-0.85 across cohorts. Distinctive combinations of antecedent phenotypes associated with CID/CVID are identified, consisting of respiratory infections/conditions, genetic anomalies, cardiac defects, autoimmune diseases, blood disorders and malignancies, which can possibly be useful to systematize the identification of CID and CVID. CONCLUSIONS: We demonstrated an accurate method in terms of CID and CVID detection evaluated on large-scale medical claims data. Our predictive scheme can potentially lead to the development of new clinical insights and expanded guidelines for identification of adult patients at risk for CID and CVID as well as be used to improve patient outcomes on population level.


Primary immunodeficiencies (PI) are disorders that weaken the immune system, increasing the incident of life-threatening infections, organ damage and the development of cancer and autoimmune diseases. Although PI is estimated to affect 1-2% of the global population, 70-90% of these patients remain undiagnosed. Many patients are diagnosed during adulthood, after other serious diseases have already developed. We developed a computational method to analyze the clinical history from a large group of people with and without PI. We focused on combined (CID) and common variable immunodeficiency (CVID), which are among the least studied and most common PI subtypes, respectively. We could identify people with CID or CVID and combinations of diseases and symptoms which could make it easier to identify CID or CVID. Our method could be used to more readily identify adults at risk of CID or CVID, enabling treatment to start earlier and their long-term health to be improved.

4.
Comput Biol Med ; 166: 107540, 2023 Oct 04.
Article in English | MEDLINE | ID: mdl-37806060

ABSTRACT

Percutaneous coronary intervention (PCI) is a minimally invasive technique for treating vascular diseases. PCI requires precise and real-time visualization and guidance to ensure surgical safety and efficiency. Existing mainstream guiding methods rely on hemodynamic parameters. However, these methods are less intuitive than images and pose some challenges to the decision-making of cardiologists. This paper proposes a novel PCI guiding assistance system by combining a novel vascular segmentation network and a heuristic intervention path planning algorithm, providing cardiologists with clear and visualized information. A dataset of 1077 DSA images from 288 patients is also collected in clinical practice. A Likert Scale is also designed to evaluate system performance in user experiments. Results of user experiments demonstrate that the system can generate satisfactory and reasonable paths for PCI. Our proposed method outperformed the state-of-the-art baselines based on three metrics (Jaccard: 0.4091, F1: 0.5626, Accuracy: 0.9583). The proposed system can effectively assist cardiologists in PCI by providing a clear segmentation of vascular structures and optimal real-time intervention paths, thus demonstrating great potential for robotic PCI autonomy.

6.
Radiol Cardiothorac Imaging ; 4(2): e210260, 2022 Apr.
Article in English | MEDLINE | ID: mdl-35506136

ABSTRACT

Purpose: To assess the association between nonalcoholic fatty liver disease (NAFLD) and quantitative atherosclerotic plaque at CT. Materials and Methods: In this post hoc analysis of the prospective Scottish Computed Tomography of the HEART trial (November 2010 to September 2014), hepatosteatosis and coronary artery calcium score were measured at noncontrast CT. Presence of stenoses, visually assessed high-risk plaque, and quantitative plaque burden were assessed at coronary CT angiography. Multivariable models were constructed to assess the impact of hepatosteatosis and cardiovascular risk factors on coronary artery disease. Results: Images from 1726 participants (mean age, 58 years ± 9 [SD]; 974 men) were included. Participants with hepatosteatosis (155 of 1726, 9%) had a higher body mass index, more hypertension and diabetes mellitus, and higher cardiovascular risk scores (P < .001 for all) compared with those without hepatosteatosis. They had increased coronary artery calcium scores (median, 43 Agatston units [AU] [interquartile range, 0-273] vs 19 AU [0-225], P = .046), more nonobstructive disease (48% vs 37%, P = .02), and higher low-attenuation plaque burden (5.11% [0-7.16] vs 4.07% [0-6.84], P = .04). However, these associations were not independent of cardiovascular risk factors. Over a median of 4.7 years, there was no evidence of a difference in myocardial infarction between those with and without hepatosteatosis (1.9% vs 2.4%, P = .92). Conclusion: Hepatosteatosis at CT was associated with an increased prevalence of coronary artery disease at CT, but this was not independent of the presence of cardiovascular risk factors.Keywords: CT, Cardiac, Nonalcoholic Fatty Liver Disease, Coronary Artery Disease, Hepatosteatosis, Plaque QuantificationClinical trial registration no. NCT01149590 Supplemental material is available for this article. © RSNA, 2022See also commentary by Abohashem and Blankstein in this issue.

7.
JACC Cardiovasc Imaging ; 15(6): 1078-1088, 2022 06.
Article in English | MEDLINE | ID: mdl-35450813

ABSTRACT

BACKGROUND: Pericoronary adipose tissue (PCAT) attenuation and low-attenuation noncalcified plaque (LAP) burden can both predict outcomes. OBJECTIVES: This study sought to assess the relative and additive values of PCAT attenuation and LAP to predict future risk of myocardial infarction. METHODS: In a post hoc analysis of the multicenter SCOT-HEART (Scottish Computed Tomography of the Heart) trial, the authors investigated the relationships between the future risk of fatal or nonfatal myocardial infarction and PCAT attenuation measured from coronary computed tomography angiography (CTA) using multivariable Cox regression models including plaque burden, obstructive coronary disease, and cardiac risk score (incorporating age, sex, diabetes, smoking, hypertension, hyperlipidemia, and family history). RESULTS: In 1,697 evaluable participants (age: 58 ± 10 years), there were 37 myocardial infarctions after a median follow-up of 4.7 years. Mean PCAT was -76 ± 8 HU and median LAP burden was 4.20% (IQR: 0%-6.86%). PCAT attenuation of the right coronary artery (RCA) was predictive of myocardial infarction (HR: 1.55; P = 0.017, per 1 SD increment) with an optimum threshold of -70.5 HU (HR: 2.45; P = 0.01). In multivariable analysis, adding PCAT-RCA of ≥-70.5 HU to an LAP burden of >4% (the optimum threshold for future myocardial infarction; HR: 4.87; P < 0.0001) led to improved prediction of future myocardial infarction (HR: 11.7; P < 0.0001). LAP burden showed higher area under the curve compared to PCAT attenuation for the prediction of myocardial infarction (AUC = 0.71 [95% CI: 0.62-0.80] vs AUC = 0.64 [95% CI: 0.54-0.74]; P < 0.001), with increased area under the curve when the 2 metrics are combined (AUC = 0.75 [95% CI: 0.65-0.85]; P = 0.037). CONCLUSION: Coronary CTA-defined LAP burden and PCAT attenuation have marked and complementary predictive value for the risk of fatal or nonfatal myocardial infarction.


Subject(s)
Coronary Artery Disease , Myocardial Infarction , Plaque, Atherosclerotic , Adipose Tissue/diagnostic imaging , Aged , Computed Tomography Angiography/methods , Coronary Angiography/methods , Coronary Artery Disease/diagnostic imaging , Humans , Middle Aged , Myocardial Infarction/diagnostic imaging , Myocardial Infarction/etiology , Predictive Value of Tests
8.
Colloids Surf B Biointerfaces ; 214: 112463, 2022 Jun.
Article in English | MEDLINE | ID: mdl-35316703

ABSTRACT

A drug delivery nanosystem of noble bimetallic nanoparticles (NPs) which consists of Au NPs capped with Pt NPs (Au@Pt NPs) is constructed and functionalised with a quinazoline based small molecule (Au@Pt@Q NPs), acting as a theranostic agent against glioblastoma. Two different hydrothermal synthetic procedures for bimetallic Au@Pt NPs are presented and the resulting nanostructures are fully characterised by means of spectroscopic and microscopic methods. The imaging and targeting capacity of the new drug delivery system is assessed through fluorescent optical microscopy and cytotoxicity evaluations. The constructed Au@Pt NPs consist a monodispersed colloidal solution of 25 nm with photoluminescent, fluorescent and X-Ray absorption properties that confirm their diagnostic potential. Haemolysis testing demonstrated that Au@Pt NPs are biocompatible and fluorescent microscopy confirmed their entering the cells. Cytological evaluation of the NPs through MTT assay showed that they do not inhibit the proliferation of control cell line HEK293, whereas they are toxic in U87MG, U251 and D54 glioblastoma cell lines; rendering them selective targeting agents for treating glioblastoma.


Subject(s)
Glioblastoma , Metal Nanoparticles , Drug Delivery Systems , Glioblastoma/drug therapy , Gold/chemistry , HEK293 Cells , Humans , Metal Nanoparticles/chemistry , Platinum/chemistry
9.
Sensors (Basel) ; 22(6)2022 Mar 09.
Article in English | MEDLINE | ID: mdl-35336295

ABSTRACT

Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, affine and non-rigid image registration is not extensively investigated using a single unsupervised model architecture. In our work, we present an unsupervised deep learning registration methodology that can accurately model affine and non-rigid transformations, simultaneously. Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms. To address inverse consistency, our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent representations, and involves two factorised transformation networks (one per each encoder-decoder channel) and an inverse-consistency loss to learn topology-preserving anatomical transformations. Overall, our model (named "FIRE") shows improved performances against the reference standard baseline method (i.e., Symmetric Normalization implemented using the ANTs toolbox) on multi-modality brain 2D and 3D MRI and intra-modality cardiac 4D MRI data experiments. We focus on explaining model-data components to enhance model explainability in medical image registration. On computational time experiments, we show that the FIRE model performs on a memory-saving mode, as it can inherently learn topology-preserving image registration directly in the training phase. We therefore demonstrate an efficient and versatile registration technique that can have merit in multi-modal image registrations in the clinical setting.


Subject(s)
Brain , Image Processing, Computer-Assisted , Algorithms , Brain/diagnostic imaging , Heart/diagnostic imaging , Image Processing, Computer-Assisted/methods , Magnetic Resonance Imaging/methods
10.
Eur Heart J Cardiovasc Imaging ; 23(9): 1210-1221, 2022 08 22.
Article in English | MEDLINE | ID: mdl-34529050

ABSTRACT

AIMS: Coronary artery calcification is a marker of cardiovascular risk, but its association with qualitatively and quantitatively assessed plaque subtypes is unknown. METHODS AND RESULTS: In this post-hoc analysis, computed tomography (CT) images and 5-year clinical outcomes were assessed in SCOT-HEART trial participants. Agatston coronary artery calcium score (CACS) was measured on non-contrast CT and was stratified as zero (0 Agatston units, AU), minimal (1-9 AU), low (10-99 AU), moderate (100-399 AU), high (400-999 AU), and very high (≥1000 AU). Adverse plaques were investigated by qualitative (visual categorization of positive remodelling, low-attenuation plaque, spotty calcification, and napkin ring sign) and quantitative (calcified, non-calcified, low-attenuation, and total plaque burden; Autoplaque) assessments. Of 1769 patients, 36% had a zero, 9% minimal, 20% low, 17% moderate, 10% high, and 8% very high CACS. Amongst patients with a zero CACS, 14% had non-obstructive disease, 2% had obstructive disease, 2% had visually assessed adverse plaques, and 13% had low-attenuation plaque burden >4%. Non-calcified and low-attenuation plaque burden increased between patients with zero, minimal, and low CACS (P < 0.001), but there was no statistically significant difference between those with medium, high, and very high CACS. Myocardial infarction occurred in 41 patients, 10% of whom had zero CACS. CACS >1000 AU and low-attenuation plaque burden were the only predictors of myocardial infarction, independent of obstructive disease, and 10-year cardiovascular risk score. CONCLUSION: In patients with stable chest pain, zero CACS is associated with a good but not perfect prognosis, and CACS cannot rule out obstructive coronary artery disease, non-obstructive plaque, or adverse plaque phenotypes, including low-attenuation plaque.


Subject(s)
Coronary Artery Disease , Myocardial Infarction , Plaque, Atherosclerotic , Vascular Calcification , Calcium , Computed Tomography Angiography/methods , Coronary Angiography/methods , Coronary Artery Disease/complications , Coronary Artery Disease/diagnostic imaging , Humans , Myocardial Infarction/complications , Plaque, Atherosclerotic/complications , Plaque, Atherosclerotic/diagnostic imaging , Predictive Value of Tests , Risk Assessment , Risk Factors , Tomography, X-Ray Computed , Vascular Calcification/complications , Vascular Calcification/diagnostic imaging
11.
Appl Soft Comput ; 116: 108291, 2022 Feb.
Article in English | MEDLINE | ID: mdl-34934410

ABSTRACT

The world is currently experiencing an ongoing pandemic of an infectious disease named coronavirus disease 2019 (i.e., COVID-19), which is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Computed Tomography (CT) plays an important role in assessing the severity of the infection and can also be used to identify those symptomatic and asymptomatic COVID-19 carriers. With a surge of the cumulative number of COVID-19 patients, radiologists are increasingly stressed to examine the CT scans manually. Therefore, an automated 3D CT scan recognition tool is highly in demand since the manual analysis is time-consuming for radiologists and their fatigue can cause possible misjudgment. However, due to various technical specifications of CT scanners located in different hospitals, the appearance of CT images can be significantly different leading to the failure of many automated image recognition approaches. The multi-domain shift problem for the multi-center and multi-scanner studies is therefore nontrivial that is also crucial for a dependable recognition and critical for reproducible and objective diagnosis and prognosis. In this paper, we proposed a COVID-19 CT scan recognition model namely coronavirus information fusion and diagnosis network (CIFD-Net) that can efficiently handle the multi-domain shift problem via a new robust weakly supervised learning paradigm. Our model can resolve the problem of different appearance in CT scan images reliably and efficiently while attaining higher accuracy compared to other state-of-the-art methods.

13.
Front Med (Lausanne) ; 8: 699984, 2021.
Article in English | MEDLINE | ID: mdl-34195215

ABSTRACT

The rapid spread of coronavirus 2019 disease (COVID-19) has manifested a global public health crisis, and chest CT has been proven to be a powerful tool for screening, triage, evaluation and prognosis in COVID-19 patients. However, CT is not only costly but also associated with an increased incidence of cancer, in particular for children. This study will question whether clinical symptoms and laboratory results can predict the CT outcomes for the pediatric patients with positive RT-PCR testing results in order to determine the necessity of CT for such a vulnerable group. Clinical data were collected from 244 consecutive pediatric patients (16 years of age and under) treated at Wuhan Children's Hospital with positive RT-PCR testing, and the chest CT were performed within 3 days of clinical data collection, from January 21 to March 8, 2020. This study was approved by the local ethics committee of Wuhan Children's Hospital. Advanced decision tree based machine learning models were developed for the prediction of CT outcomes. Results have shown that age, lymphocyte, neutrophils, ferritin and C-reactive protein are the most related clinical indicators for predicting CT outcomes for pediatric patients with positive RT-PCR testing. Our decision support system has managed to achieve an AUC of 0.84 with 0.82 accuracy and 0.84 sensitivity for predicting CT outcomes. Our model can effectively predict CT outcomes, and our findings have indicated that the use of CT should be reconsidered for pediatric patients, as it may not be indispensable.

14.
Med Image Anal ; 73: 102169, 2021 10.
Article in English | MEDLINE | ID: mdl-34311421

ABSTRACT

How will my face look when I get older? Or, for a more challenging question: How will my brain look when I get older? To answer this question one must devise (and learn from data) a multivariate auto-regressive function which given an image and a desired target age generates an output image. While collecting data for faces may be easier, collecting longitudinal brain data is not trivial. We propose a deep learning-based method that learns to simulate subject-specific brain ageing trajectories without relying on longitudinal data. Our method synthesises images conditioned on two factors: age (a continuous variable), and status of Alzheimer's Disease (AD, an ordinal variable). With an adversarial formulation we learn the joint distribution of brain appearance, age and AD status, and define reconstruction losses to address the challenging problem of preserving subject identity. We compare with several benchmarks using two widely used datasets. We evaluate the quality and realism of synthesised images using ground-truth longitudinal data and a pre-trained age predictor. We show that, despite the use of cross-sectional data, our model learns patterns of gray matter atrophy in the middle temporal gyrus in patients with AD. To demonstrate generalisation ability, we train on one dataset and evaluate predictions on the other. In conclusion, our model shows an ability to separate age, disease influence and anatomy using only 2D cross-sectional data that should be useful in large studies into neurodegenerative disease, that aim to combine several data sources. To facilitate such future studies by the community at large our code is made available at https://github.com/xiat0616/BrainAgeing.


Subject(s)
Neurodegenerative Diseases , Aging , Brain/diagnostic imaging , Cross-Sectional Studies , Humans , Magnetic Resonance Imaging
15.
JACC Cardiovasc Imaging ; 14(9): 1804-1814, 2021 09.
Article in English | MEDLINE | ID: mdl-33865779

ABSTRACT

OBJECTIVES: This study was designed to investigate whether coronary computed tomography angiography assessments of coronary plaque might explain differences in the prognosis of men and women presenting with chest pain. BACKGROUND: Important sex differences exist in coronary artery disease. Women presenting with chest pain have different risk factors, symptoms, prevalence of coronary artery disease and prognosis compared to men. METHODS: Within a multicenter randomized controlled trial, we explored sex differences in stenosis, adverse plaque characteristics (positive remodeling, low-attenuation plaque, spotty calcification, or napkin ring sign) and quantitative assessment of total, calcified, noncalcified and low-attenuation plaque burden. RESULTS: Of the 1,769 participants who underwent coronary computed tomography angiography, 772 (43%) were female. Women were more likely to have normal coronary arteries and less likely to have adverse plaque characteristics (p < 0.001 for all). They had lower total, calcified, noncalcified, and low-attenuation plaque burdens (p < 0.001 for all) and were less likely to have a low-attenuation plaque burden >4% (41% vs. 59%; p < 0.001). Over a median follow-up of 4.7 years, myocardial infarction (MI) occurred in 11 women (1.4%) and 30 men (3%). In those who had MI, women had similar total, noncalcified, and low-attenuation plaque burdens as men, but men had higher calcified plaque burden. Low-attenuation plaque burden predicted MI (hazard ratio: 1.60; 95% confidence interval: 1.10 to 2.34; p = 0.015), independent of calcium score, obstructive disease, cardiovascular risk score, and sex. CONCLUSIONS: Women presenting with stable chest pain have less atherosclerotic plaque of all subtypes compared to men and a lower risk of subsequent MI. However, quantitative low-attenuation plaque is as strong a predictor of subsequent MI in women as in men. (Scottish Computed Tomography of the HEART Trial [SCOT-HEART]; NCT01149590).


Subject(s)
Coronary Artery Disease , Myocardial Infarction , Plaque, Atherosclerotic , Computed Tomography Angiography , Coronary Angiography , Coronary Artery Disease/diagnostic imaging , Coronary Artery Disease/epidemiology , Coronary Vessels/diagnostic imaging , Female , Humans , Male , Myocardial Infarction/diagnostic imaging , Myocardial Infarction/epidemiology , Predictive Value of Tests , Risk Factors
16.
Inf Fusion ; 67: 147-160, 2021 Mar.
Article in English | MEDLINE | ID: mdl-33658909

ABSTRACT

Cycle-consistent generative adversarial network (CycleGAN) has been widely used for cross-domain medical image synthesis tasks particularly due to its ability to deal with unpaired data. However, most CycleGAN-based synthesis methods cannot achieve good alignment between the synthesized images and data from the source domain, even with additional image alignment losses. This is because the CycleGAN generator network can encode the relative deformations and noises associated to different domains. This can be detrimental for the downstream applications that rely on the synthesized images, such as generating pseudo-CT for PET-MR attenuation correction. In this paper, we present a deformation invariant cycle-consistency model that can filter out these domain-specific deformation. The deformation is globally parameterized by thin-plate-spline (TPS), and locally learned by modified deformable convolutional layers. Robustness to domain-specific deformations has been evaluated through experiments on multi-sequence brain MR data and multi-modality abdominal CT and MR data. Experiment results demonstrated that our method can achieve better alignment between the source and target data while maintaining superior image quality of signal compared to several state-of-the-art CycleGAN-based methods.

17.
IEEE Trans Med Imaging ; 40(3): 781-792, 2021 03.
Article in English | MEDLINE | ID: mdl-33156786

ABSTRACT

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the common information shared between modalities (an organ's anatomy) is beneficial for multi-modality processing and learning. However, we must overcome inherent anatomical misregistrations and disparities in signal intensity across the modalities to obtain this benefit. We present a method that offers improved segmentation accuracy of the modality of interest (over a single input model), by learning to leverage information present in other modalities, even if few (semi-supervised) or no (unsupervised) annotations are available for this specific modality. Core to our method is learning a disentangled decomposition into anatomical and imaging factors. Shared anatomical factors from the different inputs are jointly processed and fused to extract more accurate segmentation masks. Image misregistrations are corrected with a Spatial Transformer Network, which non-linearly aligns the anatomical factors. The imaging factor captures signal intensity characteristics across different modality data and is used for image reconstruction, enabling semi-supervised learning. Temporal and slice pairing between inputs are learned dynamically. We demonstrate applications in Late Gadolinium Enhanced (LGE) and Blood Oxygenation Level Dependent (BOLD) cardiac segmentation, as well as in T2 abdominal segmentation. Code is available at https://github.com/vios-s/multimodal_segmentation.


Subject(s)
Image Processing, Computer-Assisted , Supervised Machine Learning , Heart/diagnostic imaging , Magnetic Resonance Imaging
18.
Neuroimage ; 225: 117482, 2021 01 15.
Article in English | MEDLINE | ID: mdl-33157265

ABSTRACT

PURPOSE: Cerebral amyloid angiopathy (CAA) is a cerebral small vessel disease associated with perivascular ß-amyloid deposition. CAA is also associated with strokes due to lobar intracerebral haemorrhage (ICH). 18F-flutemetamol amyloid ligand PET may improve the early detection of CAA. We performed pharmacokinetic modelling using both full (0-30, 90-120 min) and reduced (30 min) 18F-flutemetamol PET-MR acquisitions, to investigate regional cerebral perfusion and amyloid deposition in ICH patients. METHODS: Dynamic18F-flutemetamol PET-MR was performed in a pilot cohort of sixteen ICH participants; eight lobar ICH cases with probable CAA and eight deep ICH patients. A model-based input function (mIF) method was developed for compartmental modelling. mIF 1-tissue (1-TC) and 2-tissue (2-TC) compartmental modelling, reference tissue models and standardized uptake value ratios were assessed in the setting of probable CAA detection. RESULTS: The mIF 1-TC model detected perfusion deficits and 18F-flutemetamol uptake in cases with probable CAA versus deep ICH patients, in both full and reduced PET acquisition time (all P < 0.05). In the reduced PET acquisition, mIF 1-TC modelling reached the highest sensitivity and specificity in detecting perfusion deficits (0.87, 0.77) and 18F-flutemetamol uptake (0.83, 0.71) in cases with probable CAA. Overall, 52 and 48 out of the 64 brain areas with 18F-flutemetamol-determined amyloid deposition showed reduced perfusion for 1-TC and 2-TC models, respectively. CONCLUSION: Pharmacokinetic (1-TC) modelling using a 30 min PET-MR time frame detected impaired haemodynamics and increased amyloid load in probable CAA. Perfusion deficits and amyloid burden co-existed within cases with CAA, demonstrating a distinct imaging pattern which may have merit in elucidating the pathophysiological process of CAA.


Subject(s)
Aniline Compounds/metabolism , Aniline Compounds/pharmacokinetics , Benzothiazoles/metabolism , Benzothiazoles/pharmacokinetics , Cerebral Amyloid Angiopathy/metabolism , Cerebrovascular Circulation , Positron-Emission Tomography/methods , Aged , Aged, 80 and over , Brain/metabolism , Female , Humans , Male , Middle Aged
19.
Nanomedicine (Lond) ; 15(25): 2433-2445, 2020 10.
Article in English | MEDLINE | ID: mdl-32914695

ABSTRACT

Aim: To examine the multimodal contrasting ability of gold-dotted magnetic nanoparticles (Au*MNPs) for magnetic resonance (MR), computed tomography (CT) and intravascular ultrasound (IVUS) imaging. Materials & methods: Au*MNPs were prepared by adapting an impregnation method, without using surface capping reagents and characterized (transmission electron microscopy, x-ray diffraction and Fourier-transform infrared spectroscopy) with their in vitro cytotoxicity assessed, followed by imaging assessments. Results: The contrast-enhancing ability of Au*MNPs was shown to be concentration-dependent across MR, CT and IVUS imaging. The Au content of the Au*MNP led to evident increases of the IVUS signal. Conclusion: We demonstrated that Au*MNPs showed concentration-dependent contrast-enhancing ability in MRI and CT imaging, and for the first-time in IVUS imaging due to the Au content. These Au*MNPs are promising toward solidifying tri-modal imaging-based theragnostics.


Subject(s)
Gold , Magnetite Nanoparticles , Cell Line, Tumor , Humans , Magnetic Resonance Imaging , Metal Nanoparticles , Tomography, X-Ray Computed , Ultrasonography, Interventional
20.
Comput Biol Med ; 120: 103728, 2020 05.
Article in English | MEDLINE | ID: mdl-32250857

ABSTRACT

Multiview based learning has generally returned dividends in performance because additional information can be extracted for the representation of the diversity of different views. The advantage of multiview based learning fits the purpose of segmenting cardiac anatomy from multiview echocardiography, which is a non-invasive, low-cost and low-risk imaging modality. Nevertheless, it is still challenging because of limited training data, a poor signal-to-noise ratio of the echocardiographic data, and large variances across views for a joint learning. In addition, for a better interpretation of pathophysiological processes, clinical decision-making and prognosis, such cardiac anatomy segmentation and quantitative analysis of various clinical indices should ideally be performed for the data covering the full cardiac cycle. To tackle these challenges, a multiview recurrent aggregation network (MV-RAN) has been developed for the echocardiographic sequences segmentation with the full cardiac cycle analysis. Experiments have been carried out on multicentre and multi-scanner clinical studies consisting of spatio-temporal (2D + t) datasets. Compared to other state-of-the-art deep learning based methods, the MV-RAN method has achieved significantly superior results (0.92 ± 0.04 Dice scores) for the segmentation of the left ventricle on the independent testing datasets. For the estimation of clinical indices, our MV-RAN method has also demonstrated great promise and will undoubtedly propel forward the understanding of pathophysiological processes, computer-aided diagnosis and personalised prognosis using echocardiography.


Subject(s)
Echocardiography , Heart , Diagnosis, Computer-Assisted , Heart/diagnostic imaging , Heart Ventricles/diagnostic imaging , Signal-To-Noise Ratio
SELECTION OF CITATIONS
SEARCH DETAIL
...