POPCORN: A web service for individual PrognOsis prediction based on multi-center clinical data CollabORatioN without patient-level data sharing.

BACKGROUND AND OBJECTIVE: Clinical prognosis prediction plays an important role in clinical research and practice. The construction of prediction models based on electronic health record data has recently become a research focus. Due to the lack of external validation, prediction models based on single-center, hospital-specific datasets may not perform well with datasets from other medical institutions. Therefore, research investigating prognosis prediction model construction based on a collaborative analysis of multi-center electronic health record data could increase the number and coverage of patients used for model training, enrich patient prognostic features and ultimately improve the accuracy and generalization of prognosis prediction. MATERIALS AND METHODS: A web service for individual prognosis prediction based on multi-center clinical data collaboration without patient-level data sharing (POPCORN) was proposed. POPCORN focuses on solving key issues in multi-center collaborative research based on electronic health record systems; these issues include the standardization of clinical data expression, the preservation of patient privacy during model training and the effect of case mix variance on the prediction model construction and application. POPCORN is based on a multivariable meta-analysis and a Bayesian framework and can construct suitable prediction models for multiple clinical scenarios that can effectively adapt to complex clinical application environments. RESULTS: POPCORN was validated using a joint, multi-center collaborative research network between China and the United States with patients diagnosed with colorectal cancer. The performance of the models based on POPCORN was comparable to that of the standard prognosis prediction model; however, POPCORN did not expose raw patient data. The prediction models had similar AUC, but the BMA model had the lowest ECI across all prediction models, indicating that this model had better calibration performance than the other models, especially for patients in Chinese hospitals. CONCLUSIONS: The POPCORN system can build prediction models that perform well in complex clinical application scenarios and can provide effective decision support for individual patient prognostic predictions.

Time-dependent and nonlinear effects of prognostic factors in nonmetastatic colorectal cancer.

The survival risk following curative surgery for nonmetastatic colorectal cancer (CRC) may be over- or underestimated due to a lack of attention to nonlinear effects and violation of the proportional hazards assumption. In this paper, we aimed to detect and interpret the shape of time-dependent and nonlinear effects to improve the predictive performance of models of prognoses in nonmetastatic CRC patients. Data for nonmetastatic CRC patients diagnosed between 2004 and 2012 were obtained from the Surveillance Epidemiology End Results registry. Time-dependent and nonlinear effects were tested and plotted. A nonlinear model that used random survival forests was implemented. The estimated 5-year cancer-specific death rate was 17.95% (95% CI, 17.70-18.20%). Tumor invasion depth, lymph node status, age at diagnosis, tumor grade, histology and tumor site were significantly associated with cancer-specific death. Nonlinear and time-dependent effects on survival were detected. Positive lymph node number had a larger effect per unit of measurement at low values than at high values, whereas age at diagnosis showed the opposite pattern. Moreover, nonproportional hazards were detected for all covariates, indicating that the contributions of these risks to survival outcomes decreased over time. The nonlinear model predicted prognoses more accurately (C-index: 0.7934, 0.7933-0.7934) than did the Fine and Gray model (C-index: 0.7550, 0.7510-0.7583). The three-dimensional cumulative incidence curves derived from nonlinear model were used to identify the change points of the risk trends. It would be useful to implement these findings in treatment plans and follow-up surveillance in nonmetastatic CRC patients.