The Lung Cancer Prediction Model "Stress Test": Assessment of Models' Performance in a High-Risk Prospective Pulmonary Nodule Cohort.

ABSTRACT

BACKGROUND: Pulmonary nodules represent a growing health care burden because of delayed diagnosis of malignant lesions and overtesting for benign processes. Clinical prediction models were developed to inform physician assessment of pretest probability of nodule malignancy but have not been validated in a high-risk cohort of nodules for which biopsy was ultimately performed. RESEARCH QUESTION Do guideline-recommended prediction models sufficiently discriminate between benign and malignant nodules when applied to cases referred for biopsy by navigational bronchoscopy? STUDY DESIGN AND METHODS: We assembled a prospective cohort of 322 indeterminate pulmonary nodules in 282 patients referred to a tertiary medical center for diagnostic navigational bronchoscopy between 2017 and 2019. We calculated the probability of malignancy for each nodule using the Brock model, Mayo Clinic model, and Veterans Affairs (VA) model. On a subset of 168 patients who also had PET-CT scans before biopsy, we also calculated the probability of malignancy using the Herder model. The performance of the models was evaluated by calculating the area under the receiver operating characteristic curves (AUCs) for each model. RESULTS: The study cohort contained 185 malignant and 137 benign nodules (57% prevalence of malignancy). The malignant and benign cohorts were similar in terms of size, with a median longest diameter for benign and malignant nodules of 15 and 16 mm, respectively. The Brock model, Mayo Clinic model, and VA model showed similar performance in the entire cohort (Brock AUC, 0.70; 95% CI, 0.64-0.76; Mayo Clinic AUC, 0.70; 95% CI, 0.64-0.76; VA AUC, 0.67; 95% CI, 0.62-0.74). For 168 nodules with available PET-CT scans, the Herder model had an AUC of 0.77 (95% CI, 0.68-0.85). INTERPRETATION: Currently available clinical models provide insufficient discrimination between benign and malignant nodules in the common clinical scenario in which a patient is being referred for biopsy, especially when PET-CT scan information is not available.