DE-MRI myocardial fibrosis segmentation and classification model based on multi-scale self-supervision and transformer.

ABSTRACT

OBJECTIVE: The segmentation and categorization of fibrotic tissue in time-lapse enhanced MRI scanning are quite challenging, and it is mainly done manually for myocardial DE-MRI images. On the other hand, DE-MRI instructions for segmenting and classifying cardiac hypertrophy are complex and prone to inaccuracy. Developing cardiac DE-MRI classification and prediction methods is crucial. METHODS: This paper introduces a self-supervised myocardial histology segmentation algorithm with multi-scale portrayal consistency to address the degree of sophistication of cardiology DE-MRI. The model retrieves multi-scale representations from multiple expanded viewpoints using a Siamese system and uses resemblance learning instruction to achieve unlabeled representations. The DE-MRI data train the network weights to generate a superior segmentation effect by accurately reflecting the exact scale information. The paper provides an end-to-end method for detecting myocardial fibrosis tissue using a Transformer as a result of the poor classification outcomes of myocardial fibrosis substance in DE-MRI. A deep learning model is created using the Pre-LN Transformer decoded simultaneously with the Multi-Scale Transformer backbone structure developed in this paper. In addition, the joint regression cost, which incorporates the CIoU Loss and the L1 Loss, is used to determine the distance between forecast blocks and labels. RESULTS: Increasing the independent evaluation and annotations position compared enhances performance compared to the segmentation method without canvas matching by 1.76%, 1.27%, 0.93%, and -1.17 mm on Dice, PPV, SEN, and HD, respectively. Based on the strongest of the three single-scale representation methodologies, the segmentation model in this study is enhanced by 0.71%, 0.79%, and 1.47%, as well as -1.49 mm on Dice, PPV, SEN, and HD, respectively. The effectiveness and reliability of the segmentation model are confirmed. Additionally, testing results show that this study's recognition system's mAP is 84.97%, which is greater than the benchmark techniques used in most other studies. The framework converges round is compressed by 18.1% compared to the DETR detection approach, and the identification rate is improved by 3.5%, proving the strategy's value. CONCLUSION: The self-supervised cardiac fibrosis segmentation method with multi-scale portrayal consistency and end-to-end myocardial histology categorization is introduced in this study. To solve the challenges of segmentation and myocardial fibrosis identification in cardiology DE-MRI, a Transformer-based detection approach is put forth. It may address the issue of the myocardial scarring material's low accuracy in segmentation and classification in DE-MRI, as well as provide clinicians with a fibrosis diagnosis that is supplementary to the conventional therapy of heart ailments.