ABSTRACT
BACKGROUND: The myocardial-ischaemic-injury-index (MI3) is a novel machine learning algorithm for the early diagnosis of type 1 non-ST-segment elevation myocardial infarction (NSTEMI). The performance of MI3, both when using early serial blood draws (eg, at 1 h or 2 h) and in direct comparison with guideline-recommended algorithms, remains unknown. Our aim was to externally validate MI3 and compare its performance with that of the European Society of Cardiology (ESC) 0/1h-algorithm. METHODS: In this secondary analysis of a multicentre international diagnostic cohort study, adult patients (age >18 years) presenting to the emergency department with symptoms suggestive of myocardial infarction were prospectively enrolled from April 21, 2006, to Feb 27, 2019 in 12 centres from five European countries (Switzerland, Spain, Italy, Poland, and Czech Republic). Patients were excluded if they presented with ST-segment-elevation myocardial infarction, did not have at least two serial high-sensitivity cardiac troponin I (hs-cTnI) measurements, or if the final diagnosis remained unclear. The final diagnosis was centrally adjudicated by two independent cardiologists using all available medical records, including serial hs-cTnI measurements and cardiac imaging. The primary outcome was type 1 NSTEMI. The performance of MI3 was directly compared with that of the ESC 0/1h-algorithm. FINDINGS: Among 6487 patients, (median age 61·0 years [IQR 49·0-73·0]; 2122 [33%] female and 4365 [67%] male), 882 (13·6%) patients had type 1 NSTEMI. The median time difference between the first and second hs-cTnI measurement was 60·0 mins (IQR 57·0-70·0). MI3 performance was very good, with an area under the receiver-operating-characteristic curve of 0·961 (95% CI 0·957 to 0·965) and a good overall calibration (intercept -0·09 [-0·2 to 0·02]; slope 1·02 [0·97 to 1·08]). The originally defined MI3 score of less than 1·6 identified 4186 (64·5%) patients as low probability of having a type 1 NSTEMI (sensitivity 99·1% [95% CI 98·2 to 99·5]; negative predictive value [NPV] 99·8% [95% CI 99·6 to 99·9]) and an MI3 score of 49·7 or more identified 915 (14·1%) patients as high probability of having a type 1 NSTEMI (specificity 95·0% [94·3 to 95·5]; positive predictive value [PPV] 69·1% [66·0-72·0]). The sensitivity and NPV of the ESC 0/1h-algorithm were higher than that of MI3 (difference for sensitivity 0·88% [0·19 to 1·60], p=0·0082; difference for NPV 0·18% [0·05 to 0·32], p=0·016), and the rule-out efficacy was higher for MI3 (11% difference, p<0·0001). Specificity and PPV for MI3 were superior (difference for specificity 3·80% [3·24 to 4·36], p<0·0001; difference for PPV 7·84% [5·86 to 9·97], p<0·0001), and the rule-in efficacy was higher for the ESC 0/1h-algorithm (5·4% difference, p<0·0001). INTERPRETATION: MI3 performs very well in diagnosing type 1 NSTEMI, demonstrating comparability to the ESC 0/1h-algorithm in an emergency department setting when using early serial blood draws. FUNDING: Swiss National Science Foundation, Swiss Heart Foundation, the EU, the University Hospital Basel, the University of Basel, Abbott, Beckman Coulter, Roche, Idorsia, Ortho Clinical Diagnostics, Quidel, Siemens, and Singulex.
Subject(s)
Algorithms , Early Diagnosis , Machine Learning , Non-ST Elevated Myocardial Infarction , Humans , Male , Female , Middle Aged , Aged , Non-ST Elevated Myocardial Infarction/diagnosis , Troponin I/blood , Prospective Studies , Cohort Studies , Europe , Myocardial Infarction/diagnosis , Emergency Service, Hospital , Biomarkers/bloodABSTRACT
BACKGROUND: Point-of-care (POC) high-sensitivity cardiac troponin assays may further accelerate the diagnosis of myocardial infarction (MI). OBJECTIVES: This study sought to assess the clinical and analytical performance of the novel high-sensitivity cardiac troponin I (hs-cTnI)-SPINCHIP POC test. METHODS: Adult patients presenting with acute chest discomfort to the emergency department were enrolled in an international, diagnostic, multicenter study. The final diagnosis was centrally adjudicated by 2 independent cardiologists using all clinical information. We compared the discriminatory performance of hs-cTnI-SPINCHIP with current established central laboratory assays and derived an assay-specific hs-cTnI-SPINCHIP 0/1-hour algorithm. Secondary analyses included sample type comparisons (whole blood, fresh/frozen plasma, and capillary finger prick) and precision analysis. RESULTS: MI was the adjudicated final diagnosis in 214 (19%) of 1,102 patients. Area under the receiver-operating characteristic curve was 0.94 (95% CI: 0.92-0.95) for hs-cTnI-SPINCHIP vs 0.94 (95% CI: 0.92-0.95) for hs-cTnI-Architect (P = 0.907) and 0.93 (95% CI: 0.91-0.95) for high-sensitivity cardiac troponin T Elecsys (P = 0.305). A cutoff <7 ng/L at presentation (if chest pain onset was >3 hours) or <7 ng/L together with a 0/1-hour delta of <4 ng/L ruled out 51% with a sensitivity and negative predictive value of 100% (95% CI: 97.7%-100%) and 100% (95% CI: 99.0%-100%), respectively. A hs-cTnI-SPINCHIP concentration ≥36 ng/L or a 0/1-hour delta ≥11 ng/L ruled in 27% with a specificity and positive predictive value of 90.9% (95% CI: 88.3%-92.9%) and 72.9% (95% CI: 66.4%-78.6%), respectively. Bootstrap internal validation confirmed excellent diagnostic performance. High agreement was observed between different sample types. CONCLUSIONS: The SPINCHIP hs-cTnI POC test has very high diagnostic accuracy. Its assay-specific 0/1-hour algorithm achieved very high sensitivity/negative predictive value and specificity/positive predictive value for rule-out/in MI. (Advantageous Predictors of Acute Coronary Syndromes Evaluation [APACE] Study [APACE]; NCT00470587).