Medical image analysis using improved SAM-Med2D: segmentation and classification perspectives.
BMC Med Imaging
; 24(1): 241, 2024 Sep 16.
Article
en En
| MEDLINE
| ID: mdl-39285324
ABSTRACT
Recently emerged SAM-Med2D represents a state-of-the-art advancement in medical image segmentation. Through fine-tuning the Large Visual Model, Segment Anything Model (SAM), on extensive medical datasets, it has achieved impressive results in cross-modal medical image segmentation. However, its reliance on interactive prompts may restrict its applicability under specific conditions. To address this limitation, we introduce SAM-AutoMed, which achieves automatic segmentation of medical images by replacing the original prompt encoder with an improved MobileNet v3 backbone. The performance on multiple datasets surpasses both SAM and SAM-Med2D. Current enhancements on the Large Visual Model SAM lack applications in the field of medical image classification. Therefore, we introduce SAM-MedCls, which combines the encoder of SAM-Med2D with our designed attention modules to construct an end-to-end medical image classification model. It performs well on datasets of various modalities, even achieving state-of-the-art results, indicating its potential to become a universal model for medical image classification.
Palabras clave
Texto completo:
1
Base de datos:
MEDLINE
Asunto principal:
Algoritmos
Idioma:
En
Revista:
BMC Med Imaging
Asunto de la revista:
DIAGNOSTICO POR IMAGEM
Año:
2024
Tipo del documento:
Article