Risk Stratifying Indeterminate Thyroid Nodules With Machine Learning.

ABSTRACT

BACKGROUND: Up to 30% of thyroid nodules are classified as indeterminate after fine needle aspiration biopsy. These indeterminate thyroid nodules (ITNs) require surgical pathology for definitive diagnosis. Molecular testing provides additional pre-operative cancer risk stratification but adds expense and invasive testing. The purpose of this study is to utilize a machine learning (ML) algorithm to predict malignancy of ITNs using data available from less invasive tests. MATERIALS AND METHODS: We conducted a retrospective study using medical records from one academic and one community center. Thyroid nodules with an indeterminate diagnosis on fine needle aspiration biopsy and completed diagnostic pathology were included. Linear, non-linear, and non-linear-ensemble ML methods were tested for accuracy when predicting malignancy using 10-fold cross-validation. Classifiers were evaluated using area under the receiver operating characteristics curve (AUROC). RESULTS: A total of 355 nodules met inclusion criteria. Of these, 171 (48.2%) were diagnosed with cancer. A Random Forest classifier performed the best, producing an accuracy of 79.1%, a sensitivity of 75.5%, specificity of 82.4%, positive predicative value of 80.3%, negative predictive value of 79.0%, and an AUROC of 0.859. CONCLUSIONS: ML methods accurately risk stratify ITNs using data gathered from existing, non-invasive, and inexpensive diagnostic tests. Applying an ML model with existing data can become a cost-effective alternative to molecular testing. Future studies will prospectively evaluate the performance of this ML approach when combined with expert judgment.