Artificial intelligence-based diagnosis in fetal pathology using external ear shapes.

OBJECTIVE: Here we trained an automatic phenotype assessment tool to recognize syndromic ears in two syndromes in fetuses-=CHARGE and Mandibulo-Facial Dysostosis Guion Almeida type (MFDGA)-versus controls. METHOD: We trained an automatic model on all profile pictures of children diagnosed with genetically confirmed MFDGA and CHARGE syndromes, and a cohort of control patients, collected from 1981 to 2023 in Necker Hospital (Paris) with a visible external ear. The model consisted in extracting landmarks from photographs of external ears, in applying geometric morphometry methods, and in a classification step using machine learning. The approach was then tested on photographs of two groups of fetuses: controls and fetuses with CHARGE and MFDGA syndromes. RESULTS: The training set contained a total of 1489 ear photographs from 526 children. The validation set contained a total of 51 ear photographs from 51 fetuses. The overall accuracy was 72.6% (58.3%-84.1%, p < 0.001), and 76.4%, 74.9%, and 86.2% respectively for CHARGE, control and MFDGA fetuses. The area under the curves were 86.8%, 87.5%, and 90.3% respectively for CHARGE, controls, and MFDGA fetuses. CONCLUSION: We report the first automatic fetal ear phenotyping model, with satisfactory classification performances. Further validations are required before using this approach as a diagnostic tool.

An automatic facial landmarking for children with rare diseases.

Two to three thousand syndromes modify facial features: their screening requires the eye of an expert in dysmorphology. A widely used tool in shape characterization is geometric morphometrics based on landmarks, which are precise and reproducible anatomical points. Landmark positioning is user dependent and time consuming. Many automatic landmarking tools are currently available but do not work for children, because they have mainly been trained using photographic databases of healthy adults. Here, we developed a method for building an automatic landmarking pipeline for frontal and lateral facial photographs as well as photographs of external ears. We evaluated the algorithm on patients diagnosed with Treacher Collins (TC) syndrome as it is the most frequent mandibulofacial dysostosis in humans and is clinically recognizable although highly variable in severity. We extracted photographs from the photographic database of the maxillofacial surgery and plastic surgery department of Hôpital Necker-Enfants Malades in Paris, France with the diagnosis of TC syndrome. The control group was built from children admitted for craniofacial trauma or skin lesions. After testing two methods of object detection by bounding boxes, a Haar Cascade-based tool and a Faster Region-based Convolutional Neural Network (Faster R-CNN)-based tool, we evaluated three different automatic annotation algorithms: the patch-based active appearance model (AAM), the holistic AAM, and the constrained local model (CLM). The final error corresponding to the distance between the points placed by automatic annotation and those placed by manual annotation was reported. We included, respectively, 1664, 2044, and 1375 manually annotated frontal, profile, and ear photographs. Object recognition was optimized with the Faster R-CNN-based detector. The best annotation model was the patch-based AAM (p < 0.001 for frontal faces, p = 0.082 for profile faces and p < 0.001 for ears). This automatic annotation model resulted in the same classification performance as manually annotated data. Pretraining on public photographs did not improve the performance of the model. We defined a pipeline to create automatic annotation models adapted to faces with congenital anomalies, an essential prerequisite for research in dysmorphology.

Humanitarian Facial Recognition for Rare Craniofacial Malformations.

Children with congenital disorders are unfortunate collateral victims of wars and natural disasters. Improved diagnosis could help organize targeted medical support campaigns. Patient identification is a key issue in the management of life-threatening conditions in extreme situations, such as in oncology or for diabetes, and can be challenging when diagnosis requires biological or radiological investigations. Dysmorphology is a central element of diagnosis for craniofacial malformations, with high sensibility and specificity. Massive amounts of public data, including facial pictures circulate daily on news channels and social media, offering unique possibilities for automatic diagnosis based on facial recognition. Furthermore, AI-based algorithms assessing facial features are currently being developed to decrease diagnostic delays. Here, as a case study, we used a facial recognition algorithm trained on a large photographic database to assess an online picture of a family of refugees. Our aim was to evaluate the relevance of using an academic tool on a journalistic picture and discuss its potential application to large-scale screening in humanitarian perspectives. This group picture featured one child with signs of Apert syndrome, a rare condition with risks of severe complications in cases of delayed management. We report the successful automatic screening of Apert syndrome on this low-resolution picture, suggesting that AI-based facial recognition could be used on public data in crisis conditions to localize at-risk patients.

Next generation phenotyping for diagnosis and phenotype-genotype correlations in Kabuki syndrome.

The field of dysmorphology has been changed by the use Artificial Intelligence (AI) and the development of Next Generation Phenotyping (NGP). The aim of this study was to propose a new NGP model for predicting KS (Kabuki Syndrome) on 2D facial photographs and distinguish KS1 (KS type 1, KMT2D-related) from KS2 (KS type 2, KDM6A-related). We included retrospectively and prospectively, from 1998 to 2023, all frontal and lateral pictures of patients with a molecular confirmation of KS. After automatic preprocessing, we extracted geometric and textural features. After incorporation of age, gender, and ethnicity, we used XGboost (eXtreme Gradient Boosting), a supervised machine learning classifier. The model was tested on an independent validation set. Finally, we compared the performances of our model with DeepGestalt (Face2Gene). The study included 1448 frontal and lateral facial photographs from 6 centers, corresponding to 634 patients (527 controls, 107 KS); 82 (78%) of KS patients had a variation in the KMT2D gene (KS1) and 23 (22%) in the KDM6A gene (KS2). We were able to distinguish KS from controls in the independent validation group with an accuracy of 95.8% (78.9-99.9%, p < 0.001) and distinguish KS1 from KS2 with an empirical Area Under the Curve (AUC) of 0.805 (0.729-0.880, p < 0.001). We report an automatic detection model for KS with high performances (AUC 0.993 and accuracy 95.8%). We were able to distinguish patients with KS1 from KS2, with an AUC of 0.805. These results outperform the current commercial AI-based solutions and expert clinicians.

AI-based diagnosis in mandibulofacial dysostosis with microcephaly using external ear shapes.

Introduction: Mandibulo-Facial Dysostosis with Microcephaly (MFDM) is a rare disease with a broad spectrum of symptoms, characterized by zygomatic and mandibular hypoplasia, microcephaly, and ear abnormalities. Here, we aimed at describing the external ear phenotype of MFDM patients, and train an Artificial Intelligence (AI)-based model to differentiate MFDM ears from non-syndromic control ears (binary classification), and from ears of the main differential diagnoses of this condition (multi-class classification): Treacher Collins (TC), Nager (NAFD) and CHARGE syndromes. Methods: The training set contained 1,592 ear photographs, corresponding to 550 patients. We extracted 48 patients completely independent of the training set, with only one photograph per ear per patient. After a CNN-(Convolutional Neural Network) based ear detection, the images were automatically landmarked. Generalized Procrustes Analysis was then performed, along with a dimension reduction using PCA (Principal Component Analysis). The principal components were used as inputs in an eXtreme Gradient Boosting (XGBoost) model, optimized using a 5-fold cross-validation. Finally, the model was tested on an independent validation set. Results: We trained the model on 1,592 ear photographs, corresponding to 1,296 control ears, 105 MFDM, 33 NAFD, 70 TC and 88 CHARGE syndrome ears. The model detected MFDM with an accuracy of 0.969 [0.838-0.999] (p < 0.001) and an AUC (Area Under the Curve) of 0.975 within controls (binary classification). Balanced accuracies were 0.811 [0.648-0.920] (p = 0.002) in a first multiclass design (MFDM vs. controls and differential diagnoses) and 0.813 [0.544-0.960] (p = 0.003) in a second multiclass design (MFDM vs. differential diagnoses). Conclusion: This is the first AI-based syndrome detection model in dysmorphology based on the external ear, opening promising clinical applications both for local care and referral, and for expert centers.