RESUMEN
The automatic generation of descriptions for medical images has sparked increasing interest in the healthcare field due to its potential to assist professionals in the interpretation and analysis of clinical exams. This study explores the development and evaluation of a generalist generative model for medical images. Gaps were identified in the literature, such as the lack of studies that explore the performance of specific models for medical description generation and the need for objective evaluation of the quality of generated descriptions. Additionally, there is a lack of model generalization to different image modalities and medical conditions. To address these issues, a methodological strategy was adopted, combining natural language processing and features extraction from medical images and feeding them into a generative model based on neural networks. The goal was to achieve model generalization across various image modalities and medical conditions. The results showed promising outcomes in the generation of descriptions, with an accuracy of 0.7628 and a BLEU-1 score of 0.5387. However, the quality of the generated descriptions may still be limited, exhibiting semantic errors or lacking relevant details. These limitations could be attributed to the availability and representativeness of the data, as well as the techniques used.
RESUMEN
Congenital Generalized Lipodystrophy (CGL) is a rare autosomal recessive disease characterized by near complete absence of functional adipose tissue from birth. CGL diagnosis can be based on clinical data including acromegaloid features, acanthosis nigricans, reduction of total body fat, muscular hypertrophy, and protrusion of the umbilical scar. The identification and knowledge of CGL by the health care professionals is crucial once it is associated with severe and precocious cardiometabolic complications and poor outcome. Image processing by deep learning algorithms have been implemented in medicine and the application into routine clinical practice is feasible. Therefore, the aim of this study was to identify congenital generalized lipodystrophy phenotype using deep learning. A deep learning approach model using convolutional neural network was presented as a detailed experiment with evaluation steps undertaken to test the effectiveness. These experiments were based on CGL patient's photography database. The dataset consists of two main categories (training and testing) and three subcategories containing photos of patients with CGL, individuals with malnutrition and eutrophic individuals with athletic build. A total of 337 images of individuals of different ages, children and adults were carefully chosen from internet open access database and photographic records of stored images of medical records of a reference center for inherited lipodystrophies. For validation, the dataset was partitioned into four parts, keeping the same proportion of the three subcategories in each part. The fourfold cross-validation technique was applied, using 75% (3 parts) of the data as training and 25% (1 part) as a test. Following the technique, four tests were performed, changing the parts that were used as training and testing until each part was used exactly once as validation data. As a result, a mean accuracy, sensitivity, and specificity were obtained with values of [90.85 ± 2.20%], [90.63 ± 3.53%] and [91.41 ± 1.10%], respectively. In conclusion, this study presented for the first time a deep learning model able to identify congenital generalized lipodystrophy phenotype with excellent accuracy, sensitivity and specificity, possibly being a strategic tool for detecting this disease.