Individualized MRI-based stroke PRediction scOre using plaque Vulnerability for symptomatic carotid artEry disease patients (IMPROVE).

Objective: In TIA and stroke patients with carotid stenosis, estimations of future ipsilateral ischemic stroke risk and treatment decisions are currently primarily based on the degree of stenosis. Intraplaque hemorrhage (IPH), which can be readily visualized on carotid MRI, is increasingly established as an easy to assess and a very strong and independent predictor for ipsilateral stroke risk, stronger than any clinical risk factor. We developed a clinical prediction model (IMPROVE) incorporating IPH, degree of stenosis, and clinical risk factors to select patients with symptomatic carotid stenosis at high risk for stroke. Methods: IMPROVE was developed on pooled clinical and MRI data from five cohort studies of 760 recent TIA or minor stroke patients with carotid plaque who received optimal medical treatment. We used Cox proportional hazards models to determine the coefficients of IMPROVE. IMPROVE was internally validated using bootstrapping and converted to one- and three-year ipsilateral ischemic stroke risk. Results: The development dataset contained 65 ipsilateral incident ischemic strokes that occurred during a median follow-up of 1.2 years (IQR: 0.5-4.1). The IMPROVE model includes five predictors, which are in order of importance: degree of stenosis, presence of IPH on MRI, classification of last event (cerebral vs ocular), sex, and age. Internal validation revealed a good accuracy (C-statistic: 0.82; 95% CI: 0.77-0.87) and no evidence for miscalibration (calibration slope: 0.93). Interpretation: Using presence of IPH on MRI and only four conventional parameters, the IMPROVE model provides accurate individual stroke risk estimates, which may facilitate stratification for revascularization.

Development and validation of prediction models for fetal growth restriction and birthweight: an individual participant data meta-analysis.

Background: Fetal growth restriction is associated with perinatal morbidity and mortality. Early identification of women having at-risk fetuses can reduce perinatal adverse outcomes. Objectives: To assess the predictive performance of existing models predicting fetal growth restriction and birthweight, and if needed, to develop and validate new multivariable models using individual participant data. Design: Individual participant data meta-analyses of cohorts in International Prediction of Pregnancy Complications network, decision curve analysis and health economics analysis. Participants: Pregnant women at booking. External validation of existing models (9 cohorts, 441,415 pregnancies); International Prediction of Pregnancy Complications model development and validation (4 cohorts, 237,228 pregnancies). Predictors: Maternal clinical characteristics, biochemical and ultrasound markers. Primary outcomes: fetal growth restriction defined as birthweight <10th centile adjusted for gestational age and with stillbirth, neonatal death or delivery before 32 weeks' gestation birthweight. Analysis: First, we externally validated existing models using individual participant data meta-analysis. If needed, we developed and validated new International Prediction of Pregnancy Complications models using random-intercept regression models with backward elimination for variable selection and undertook internal-external cross-validation. We estimated the study-specific performance (c-statistic, calibration slope, calibration-in-the-large) for each model and pooled using random-effects meta-analysis. Heterogeneity was quantified using τ2 and 95% prediction intervals. We assessed the clinical utility of the fetal growth restriction model using decision curve analysis, and health economics analysis based on National Institute for Health and Care Excellence 2008 model. Results: Of the 119 published models, one birthweight model (Poon) could be validated. None reported fetal growth restriction using our definition. Across all cohorts, the Poon model had good summary calibration slope of 0.93 (95% confidence interval 0.90 to 0.96) with slight overfitting, and underpredicted birthweight by 90.4 g on average (95% confidence interval 37.9 g to 142.9 g). The newly developed International Prediction of Pregnancy Complications-fetal growth restriction model included maternal age, height, parity, smoking status, ethnicity, and any history of hypertension, pre-eclampsia, previous stillbirth or small for gestational age baby and gestational age at delivery. This allowed predictions conditional on a range of assumed gestational ages at delivery. The pooled apparent c-statistic and calibration were 0.96 (95% confidence interval 0.51 to 1.0), and 0.95 (95% confidence interval 0.67 to 1.23), respectively. The model showed positive net benefit for predicted probability thresholds between 1% and 90%. In addition to the predictors in the International Prediction of Pregnancy Complications-fetal growth restriction model, the International Prediction of Pregnancy Complications-birthweight model included maternal weight, history of diabetes and mode of conception. Average calibration slope across cohorts in the internal-external cross-validation was 1.00 (95% confidence interval 0.78 to 1.23) with no evidence of overfitting. Birthweight was underestimated by 9.7 g on average (95% confidence interval -154.3 g to 173.8 g). Limitations: We could not externally validate most of the published models due to variations in the definitions of outcomes. Internal-external cross-validation of our International Prediction of Pregnancy Complications-fetal growth restriction model was limited by the paucity of events in the included cohorts. The economic evaluation using the published National Institute for Health and Care Excellence 2008 model may not reflect current practice, and full economic evaluation was not possible due to paucity of data. Future work: International Prediction of Pregnancy Complications models' performance needs to be assessed in routine practice, and their impact on decision-making and clinical outcomes needs evaluation. Conclusion: The International Prediction of Pregnancy Complications-fetal growth restriction and International Prediction of Pregnancy Complications-birthweight models accurately predict fetal growth restriction and birthweight for various assumed gestational ages at delivery. These can be used to stratify the risk status at booking, plan monitoring and management. Study registration: This study is registered as PROSPERO CRD42019135045. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 17/148/07) and is published in full in Health Technology Assessment; Vol. 28, No. 14. See the NIHR Funding and Awards website for further award information.

One in ten babies is born small for their age. A third of such small babies are considered to be 'growth-restricted' as they have complications such as dying in the womb (stillbirth) or after birth (newborn death), cerebral palsy, or needing long stays in hospital. When growth restriction is suspected in fetuses, they are closely monitored and often delivered early to avoid complications. Hence, it is important that we identify growth-restricted babies early to plan care. Our goal was to provide personalised and accurate estimates of the mother's chances of having a growth-restricted baby and predict the baby's weight if delivered at various time points in pregnancy. To do so, first we tested how accurate existing risk calculators ('prediction models') were in predicting growth restriction and birthweight. We then developed new risk-calculators and studied their clinical and economic benefits. We did so by accessing the data from individual pregnant women and their babies in our large database library (International Prediction of Pregnancy Complications). Published risk-calculators had various definitions of growth restriction and none predicted the chances of having a growth-restricted baby using our definition. One predicted baby's birthweight. This risk-calculator performed well, but underpredicted the birthweight by up to 143 g. We developed two new risk-calculators to predict growth-restricted babies (International Prediction of Pregnancy Complications-fetal growth restriction) and birthweight (International Prediction of Pregnancy Complications-birthweight). Both calculators accurately predicted the chances of the baby being born with growth restriction, and its birthweight. The birthweight was underpredicted by <9.7 g. The calculators performed well in both mothers predicted to be low and high risk. Further research is needed to determine the impact of using these calculators in practice, and challenges to implementing them in practice. Both International Prediction of Pregnancy Complications-fetal growth restriction and International Prediction of Pregnancy Complications-birthweight risk calculators will inform healthcare professionals and empower parents make informed decisions on monitoring and timing of delivery.

Validation and development of models using clinical, biochemical and ultrasound markers for predicting pre-eclampsia: an individual participant data meta-analysis.

BACKGROUND: Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk is needed to plan management. OBJECTIVES: To assess the performance of existing pre-eclampsia prediction models and to develop and validate models for pre-eclampsia using individual participant data meta-analysis. We also estimated the prognostic value of individual markers. DESIGN: This was an individual participant data meta-analysis of cohort studies. SETTING: Source data from secondary and tertiary care. PREDICTORS: We identified predictors from systematic reviews, and prioritised for importance in an international survey. PRIMARY OUTCOMES: Early-onset (delivery at < 34 weeks' gestation), late-onset (delivery at ≥ 34 weeks' gestation) and any-onset pre-eclampsia. ANALYSIS: We externally validated existing prediction models in UK cohorts and reported their performance in terms of discrimination and calibration. We developed and validated 12 new models based on clinical characteristics, clinical characteristics and biochemical markers, and clinical characteristics and ultrasound markers in the first and second trimesters. We summarised the data set-specific performance of each model using a random-effects meta-analysis. Discrimination was considered promising for C-statistics of ≥ 0.7, and calibration was considered good if the slope was near 1 and calibration-in-the-large was near 0. Heterogeneity was quantified using I2 and τ2. A decision curve analysis was undertaken to determine the clinical utility (net benefit) of the models. We reported the unadjusted prognostic value of individual predictors for pre-eclampsia as odds ratios with 95% confidence and prediction intervals. RESULTS: The International Prediction of Pregnancy Complications network comprised 78 studies (3,570,993 singleton pregnancies) identified from systematic reviews of tests to predict pre-eclampsia. Twenty-four of the 131 published prediction models could be validated in 11 UK cohorts. Summary C-statistics were between 0.6 and 0.7 for most models, and calibration was generally poor owing to large between-study heterogeneity, suggesting model overfitting. The clinical utility of the models varied between showing net harm to showing minimal or no net benefit. The average discrimination for IPPIC models ranged between 0.68 and 0.83. This was highest for the second-trimester clinical characteristics and biochemical markers model to predict early-onset pre-eclampsia, and lowest for the first-trimester clinical characteristics models to predict any pre-eclampsia. Calibration performance was heterogeneous across studies. Net benefit was observed for International Prediction of Pregnancy Complications first and second-trimester clinical characteristics and clinical characteristics and biochemical markers models predicting any pre-eclampsia, when validated in singleton nulliparous women managed in the UK NHS. History of hypertension, parity, smoking, mode of conception, placental growth factor and uterine artery pulsatility index had the strongest unadjusted associations with pre-eclampsia. LIMITATIONS: Variations in study population characteristics, type of predictors reported, too few events in some validation cohorts and the type of measurements contributed to heterogeneity in performance of the International Prediction of Pregnancy Complications models. Some published models were not validated because model predictors were unavailable in the individual participant data. CONCLUSION: For models that could be validated, predictive performance was generally poor across data sets. Although the International Prediction of Pregnancy Complications models show good predictive performance on average, and in the singleton nulliparous population, heterogeneity in calibration performance is likely across settings. FUTURE WORK: Recalibration of model parameters within populations may improve calibration performance. Additional strong predictors need to be identified to improve model performance and consistency. Validation, including examination of calibration heterogeneity, is required for the models we could not validate. STUDY REGISTRATION: This study is registered as PROSPERO CRD42015029349. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 72. See the NIHR Journals Library website for further project information.

WHAT IS THE PROBLEM?: Pre-eclampsia, a condition in pregnancy that results in raised blood pressure and protein in the urine, is a major cause of complications for the mother and baby. WHAT IS NEEDED?: A way of accurately identifying women at high risk of pre-eclampsia to allow clinicians to start preventative interventions such as administering aspirin or frequently monitoring women during pregnancy. WHERE ARE THE RESEARCH GAPS?: Although over 100 tools (models) have been reported worldwide to predict pre-eclampsia, to date their performance in women managed in the UK NHS is unknown. WHAT DID WE PLAN TO DO?: We planned to comprehensively identify all published models that predict the risk of pre-eclampsia occurring at any time during pregnancy and to assess if this prediction is accurate in the UK population. If the existing models did not perform satisfactorily, we aimed to develop new prediction models. WHAT DID WE FIND?: We formed the International Prediction of Pregnancy Complications network, which provided data from a large number of studies (78 studies, 25 countries, 125 researchers, 3,570,993 singleton pregnancies). We were able to assess the performance of 24 out of the 131 models published to predict pre-eclampsia in 11 UK data sets. The models did not accurately predict the risk of pre-eclampsia across all UK data sets, and their performance varied within individual data sets. We developed new prediction models that showed promising performance on average across all data sets, but their ability to correctly identify women who develop pre-eclampsia varied between populations. The models were more clinically useful when used in the care of first-time mothers pregnant with one child, compared to a strategy of treating them all as if they were at high-risk of pre-eclampsia. WHAT DOES THIS MEAN?: Before using the International Prediction of Pregnancy Complications models in various populations, they need to be adjusted for characteristics of the particular population and the setting of application.

Implementation and Effects of Risk-Dependent Obstetric Care in the Netherlands (Expect Study II): Protocol for an Impact Study.

BACKGROUND: Recently, validated risk models predicting adverse obstetric outcomes combined with risk-dependent care paths have been made available for early antenatal care in the southeastern part of the Netherlands. This study will evaluate implementation progress and impact of the new approach in obstetric care. OBJECTIVE: The objective of this paper is to describe the design of a study evaluating the impact of implementing risk-dependent care. Validated first-trimester prediction models are embedded in daily clinical practice and combined with risk-dependent obstetric care paths. METHODS: A multicenter prospective cohort study consisting of women who receive risk-dependent care is being performed from April 2017 to April 2018 (Expect Study II). Obstetric risk profiles will be calculated using a Web-based tool, the Expect prediction tool. The primary outcomes are the adherence of health care professionals and compliance of women. Secondary outcomes are patient satisfaction and cost-effectiveness. Outcome measures will be established using Web-based questionnaires. The secondary outcomes of the risk-dependent care cohort (Expect II) will be compared with the outcomes of a similar prospective cohort (Expect I). Women of this similar cohort received former care-as-usual and were prospectively included between July 1, 2013 and December 31, 2015 (Expect I). RESULTS: Currently, women are being recruited for the Expect Study II, and a total of 300 women are enrolled. CONCLUSIONS: This study will provide information about the implementation and impact of a new approach in obstetric care using prediction models and risk-dependent obstetric care paths. TRIAL REGISTRATION: Netherlands Trial Register NTR4143; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4143 (Archived by WebCite at http://www.webcitation.org/6t8ijtpd9).

External Validation Study of First Trimester Obstetric Prediction Models (Expect Study I): Research Protocol and Population Characteristics.

BACKGROUND: A number of first-trimester prediction models addressing important obstetric outcomes have been published. However, most models have not been externally validated. External validation is essential before implementing a prediction model in clinical practice. OBJECTIVE: The objective of this paper is to describe the design of a study to externally validate existing first trimester obstetric prediction models, based upon maternal characteristics and standard measurements (eg, blood pressure), for the risk of pre-eclampsia (PE), gestational diabetes mellitus (GDM), spontaneous preterm birth (PTB), small-for-gestational-age (SGA) infants, and large-for-gestational-age (LGA) infants among Dutch pregnant women (Expect Study I). The results of a pilot study on the feasibility and acceptability of the recruitment process and the comprehensibility of the Pregnancy Questionnaire 1 are also reported. METHODS: A multicenter prospective cohort study was performed in The Netherlands between July 1, 2013 and December 31, 2015. First trimester obstetric prediction models were systematically selected from the literature. Predictor variables were measured by the Web-based Pregnancy Questionnaire 1 and pregnancy outcomes were established using the Postpartum Questionnaire 1 and medical records. Information about maternal health-related quality of life, costs, and satisfaction with Dutch obstetric care was collected from a subsample of women. A pilot study was carried out before the official start of inclusion. External validity of the models will be evaluated by assessing discrimination and calibration. RESULTS: Based on the pilot study, minor improvements were made to the recruitment process and online Pregnancy Questionnaire 1. The validation cohort consists of 2614 women. Data analysis of the external validation study is in progress. CONCLUSIONS: This study will offer insight into the generalizability of existing, non-invasive first trimester prediction models for various obstetric outcomes in a Dutch obstetric population. An impact study for the evaluation of the best obstetric prediction models in the Dutch setting with respect to their effect on clinical outcomes, costs, and quality of life-Expect Study II-is being planned. TRIAL REGISTRATION: Netherlands Trial Registry (NTR): NTR4143; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4143 (Archived by WebCite at http://www.webcitation.org/6t8ijtpd9).