RESUMEN
OBJECTIVE: This ex vivo diagnostic study aimed to externally validate a freely accessible AI-based model for caries detection, classification, localisation and segmentation using an independent image dataset. It was hypothesised that there would be no difference in diagnostic performance compared to previously published internal validation data. METHODS: For the independent dataset, 718 dental images representing different stages of carious (n = 535) and noncarious teeth (n = 183) were retrieved from the internet. All photographs were evaluated by the dental team (reference standard) and the AI-based model (test method). Diagnostic performance was statistically determined using cross-tabulations to calculate accuracy (ACC), sensitivity (SE), specificity (SP) and area under the curve (AUC). RESULTS: An overall ACC of 92.0% was achieved for caries detection, with an ACC of 85.5-95.6%, SE of 42.9-93.3%, SP of 82.1-99.4% and AUC of 0.702-0.909 for the classification of caries. Furthermore, 97.0% of the cases were accurately localised. Fully and partially correct segmentation was achieved in 52.9% and 44.1% of the cases, respectively. CONCLUSIONS: The validated AI-based model showed promising diagnostic performance in detecting and classifying caries using an independent image dataset. Future studies are needed to investigate the validity, reliability and practicability of AI-based models using dental photographs from different image sources and/or patient groups.
RESUMEN
OBJECTIVES: This ex vivo diagnostic study aimed to externally validate an open-access artificial intelligence (AI)-based model for the detection, classification, localisation and segmentation of enamel/molar incisor hypomineralisation (EH/MIH). METHODS: An independent sample of web images showing teeth with (n = 277) and without (n = 178) EH/MIH was evaluated by a workgroup of dentists whose consensus served as the reference standard. Then, an AI-based model was used for the detection of EH/MIH, followed by automated classification and segmentation of the findings (test method). The accuracy (ACC), sensitivity (SE), specificity (SP) and area under the curve (AUC) were determined. Furthermore, the correctness of EH/MIH lesion localisation and segmentation was evaluated. RESULTS: An overall ACC of 94.3 % was achieved for image-based detection of EH/MIH. Cross-classification of the AI-based class prediction and the reference standard resulted in an agreement of 89.2 % for all diagnostic decisions (n = 594), with an ACC between 91.4 % and 97.8 %. The corresponding SE and SP values ranged from 81.7 % to 92.8 % and 91.9 % to 98.7 %, respectively. The AUC varied between 0.894 and 0.945. Image size had only a limited impact on diagnostic performance. The AI-based model correctly predicted EH/MIH localisation in 97.3 % of cases. For the detected lesions, segmentation was fully correct in 63.4 % of all cases and partially correct in 33.9 %. CONCLUSIONS: This study documented the promising diagnostic performance of an open-access AI tool in the detection and classification of EH/MIH in external images. CLINICAL SIGNIFICANCE: Externally validated AI-based diagnostic methods could facilitate the detection of EH/MIH lesions in dental photographs.
Asunto(s)
Inteligencia Artificial , Incisivo , Hipomineralización Molar , Fotografía Dental , Humanos , Área Bajo la Curva , Esmalte Dental/diagnóstico por imagen , Esmalte Dental/patología , Procesamiento de Imagen Asistido por Computador/métodos , Incisivo/diagnóstico por imagen , Incisivo/patología , Diente Molar/diagnóstico por imagen , Diente Molar/patología , Hipomineralización Molar/diagnóstico por imagen , Hipomineralización Molar/patología , Reproducibilidad de los Resultados , Sensibilidad y EspecificidadRESUMEN
Background/Objectives: Early childhood caries (ECC) is a widespread and severe oral health problem that potentially affects the general health of children. Visual-tactile examination remains the diagnostic method of choice to diagnose ECC, although visual examination could be automated by artificial intelligence (AI) tools in the future. The aim of this study was the external validation of a recently published and freely accessible AI-based model for detecting ECC and classifying carious lesions in dental photographs. Methods: A total of 143 anonymised photographs of anterior deciduous teeth (ECC = 107, controls = 36) were visually evaluated by the dental study group (reference test) and analysed using the AI-based model (test method). Diagnostic performance was determined statistically. Results: ECC detection accuracy was 97.2%. Diagnostic performance varied between carious lesion classes (noncavitated lesions, greyish translucency/microcavity, cavitation, destructed tooth), with accuracies ranging from 88.9% to 98.1%, sensitivities ranging from 68.8% to 98.5% and specificities ranging from 86.1% to 99.4%. The area under the curve ranged from 0.834 to 0.964. Conclusions: The performance of the AI-based model is similar to that reported for the internal dataset used by developers. Further studies with independent image samples are required to comprehensively gauge the performance of the model.