[Automatic classification of immune-mediated glomerular diseases based on multi-modal multi-instance learning].
Nan Fang Yi Ke Da Xue Xue Bao
; 44(3): 585-593, 2024 Mar 20.
Article
en Zh
| MEDLINE
| ID: mdl-38597451
ABSTRACT
OBJECTIVE:
To develop a multi-modal deep learning method for automatic classification of immune-mediated glomerular diseases based on images of optical microscopy (OM), immunofluorescence microscopy (IM), and transmission electron microscopy (TEM).METHODS:
We retrospectively collected the pathological images from 273 patients and constructed a multi-modal multi- instance model for classification of 3 immune-mediated glomerular diseases, namely immunoglobulin A nephropathy (IgAN), membranous nephropathy (MN), and lupus nephritis (LN). This model adopts an instance-level multi-instance learning (I-MIL) method to select the TEM images for multi-modal feature fusion with the OM images and IM images of the same patient. By comparing this model with unimodal and bimodal models, we explored different combinations of the 3 modalities and the optimal methods for modal feature fusion.RESULTS:
The multi-modal multi-instance model combining OM, IM, and TEM images had a disease classification accuracy of (88.34±2.12)%, superior to that of the optimal unimodal model [(87.08±4.25)%] and that of the optimal bimodal model [(87.92±3.06)%].CONCLUSION:
This multi- modal multi- instance model based on OM, IM, and TEM images can achieve automatic classification of immune-mediated glomerular diseases with a good classification accuracy.Palabras clave
Texto completo:
1
Base de datos:
MEDLINE
Asunto principal:
Levamisol
/
Glomerulonefritis por IGA
Límite:
Humans
Idioma:
Zh
Revista:
Nan Fang Yi Ke Da Xue Xue Bao
Año:
2024
Tipo del documento:
Article
País de afiliación:
China