Blood transcriptomic discrimination of bacterial and viral infections in the emergency department: a multi-cohort observational validation study.

BACKGROUND: There is an urgent need to develop biomarkers that stratify risk of bacterial infection in order to support antimicrobial stewardship in emergency hospital admissions. METHODS: We used computational machine learning to derive a rule-out blood transcriptomic signature of bacterial infection (SeptiCyte™ TRIAGE) from eight published case-control studies. We then validated this signature by itself in independent case-control data from more than 1500 samples in total, and in combination with our previously published signature for viral infections (SeptiCyte™ VIRUS) using pooled data from a further 1088 samples. Finally, we tested the performance of these signatures in a prospective observational cohort of emergency department (ED) patients with fever, and we used the combined SeptiCyte™ signature in a mixture modelling approach to estimate the prevalence of bacterial and viral infections in febrile ED patients without microbiological diagnoses. RESULTS: The combination of SeptiCyte™ TRIAGE with our published signature for viral infections (SeptiCyte™ VIRUS) discriminated bacterial and viral infections in febrile ED patients, with a receiver operating characteristic area under the curve of 0.95 (95% confidence interval 0.90-1), compared to 0.79 (0.68-0.91) for WCC and 0.73 (0.61-0.86) for CRP. At pre-test probabilities 0.35 and 0.72, the combined SeptiCyte™ score achieved a negative predictive value for bacterial infection of 0.97 (0.90-0.99) and 0.86 (0.64-0.96), compared to 0.90 (0.80-0.94) and 0.66 (0.48-0.79) for WCC and 0.88 (0.69-0.95) and 0.60 (0.31-0.72) for CRP. In a mixture modelling approach, the combined SeptiCyte™ score estimated that 24% of febrile ED cases receiving antibacterials without a microbiological diagnosis were due to viral infections. Our analysis also suggested that a proportion of patients with bacterial infection recovered without antibacterials. CONCLUSIONS: Blood transcriptional biomarkers offer exciting opportunities to support precision antibacterial prescribing in ED and improve diagnostic classification of patients without microbiologically confirmed infections.

Correction to: Blood transcriptomic discrimination of bacterial and viral infections in the emergency department: a multi-cohort observational validation study.

An amendment to this paper has been published and can be accessed via the original article.

Serum Protein Changes in Pediatric Sepsis Patients Identified With an Aptamer-Based Multiplexed Proteomic Approach.

OBJECTIVES: Sepsis, a life-threatening organ dysfunction caused by a dysregulated host response to infection, is a leading cause of death and disability among children worldwide. Identifying sepsis in pediatric patients is difficult and can lead to treatment delay. Our objective was to assess the host proteomic response to infection utilizing an aptamer-based multiplexed proteomics approach to identify novel serum protein changes that might help distinguish between pediatric sepsis and infection-negative systemic inflammation and hence can potentially improve sensitivity and specificity of the diagnosis of sepsis over current clinical criteria approaches. DESIGN: Retrospective, observational cohort study. SETTING: PICU and cardiac ICU, Seattle Children's Hospital, Seattle, WA. PATIENTS: A cohort of 40 children with clinically overt sepsis and 30 children immediately postcardiopulmonary bypass surgery (infection-negative systemic inflammation control subjects) was recruited. Children with sepsis had a confirmed or suspected infection, two or more systemic inflammatory response syndrome criteria, and at least cardiovascular and/or pulmonary organ dysfunction. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Serum samples from 35 of the sepsis and 28 of the bypass surgery subjects were available for screening with an aptamer-based proteomic platform that measures 1,305 proteins to search for large-scale serum protein expression pattern changes in sepsis. A total of 111 proteins were significantly differentially expressed between the sepsis and control groups, using the linear models for microarray data (linear modeling) and Boruta (decision trees) R packages, with 55 being previously identified in sepsis patients. Weighted gene correlation network analysis helped identify 76 proteins that correlated highly with clinical sepsis traits, 27 of which had not been previously reported in sepsis. CONCLUSIONS: The serum protein changes identified with the aptamer-based multiplexed proteomics approach used in this study can be useful to distinguish between sepsis and noninfectious systemic inflammation.

Validation of a Host Response Assay, SeptiCyte LAB, for Discriminating Sepsis from Systemic Inflammatory Response Syndrome in the ICU.

RATIONALE: A molecular test to distinguish between sepsis and systemic inflammation of noninfectious etiology could potentially have clinical utility. OBJECTIVES: This study evaluated the diagnostic performance of a molecular host response assay (SeptiCyte LAB) designed to distinguish between sepsis and noninfectious systemic inflammation in critically ill adults. METHODS: The study employed a prospective, observational, noninterventional design and recruited a heterogeneous cohort of adult critical care patients from seven sites in the United States (n = 249). An additional group of 198 patients, recruited in the large MARS (Molecular Diagnosis and Risk Stratification of Sepsis) consortium trial in the Netherlands ( www.clinicaltrials.gov identifier NCT01905033), was also tested and analyzed, making a grand total of 447 patients in our study. The performance of SeptiCyte LAB was compared with retrospective physician diagnosis by a panel of three experts. MEASUREMENTS AND MAIN RESULTS: In receiver operating characteristic curve analysis, SeptiCyte LAB had an estimated area under the curve of 0.82-0.89 for discriminating sepsis from noninfectious systemic inflammation. The relative likelihood of sepsis versus noninfectious systemic inflammation was found to increase with increasing test score (range, 0-10). In a forward logistic regression analysis, the diagnostic performance of the assay was improved only marginally when used in combination with other clinical and laboratory variables, including procalcitonin. The performance of the assay was not significantly affected by demographic variables, including age, sex, or race/ethnicity. CONCLUSIONS: SeptiCyte LAB appears to be a promising diagnostic tool to complement physician assessment of infection likelihood in critically ill adult patients with systemic inflammation. Clinical trial registered with www.clinicaltrials.gov (NCT01905033 and NCT02127502).

Diagnostic Accuracy of a Host Gene Expression Signature That Discriminates Clinical Severe Sepsis Syndrome and Infection-Negative Systemic Inflammation Among Critically Ill Children.

OBJECTIVES: SeptiCyte Lab (Immunexpress, Seattle, WA), a molecular signature measuring the relative expression levels of four host messenger RNAs, was developed to discriminate critically ill adults with infection-positive versus infection-negative systemic inflammation. The objective was to assess the performance of Septicyte Lab in critically ill pediatric patients. DESIGN: Prospective observational study. SETTING: Pediatric and Cardiac ICUs, Seattle Children's Hospital, Seattle, WA. PATIENTS: A cohort of 40 children with clinically overt severe sepsis syndrome and 30 children immediately postcardiopulmonary bypass surgery was recruited. The clinically overt severe sepsis syndrome children had confirmed or highly suspected infection (microbial culture orders, antimicrobial prescription), two or more systemic inflammatory response syndrome criteria (including temperature and leukocyte criteria), and at least cardiovascular ± pulmonary organ dysfunction. INTERVENTIONS: None (observational study only). MEASUREMENTS AND MAIN RESULTS: Next-generation RNA sequencing was conducted on PAXgene blood RNA samples, successfully for 35 of 40 (87.5%) of the clinically overt severe sepsis syndrome patients and 29 of 30 (96.7%) of the postcardiopulmonary bypass patients. Forty patient samples (~ 60% of cohort) were reanalyzed by reverse transcription-quantitative polymerase chain reaction, to check for concordance with next-generation sequencing results. Postcardiopulmonary bypass versus clinically overt severe sepsis syndrome descriptors included the following: age, 7.3 ± 5.5 versus 9.0 ± 6.6 years; gender, 41% versus 49% male; Pediatric Risk of Mortality, version III, 7.0 ± 4.6 versus 8.7 ± 6.4; Pediatric Logistic Organ Dysfunction, version II, 5.1 ± 2.2 versus 4.8 ± 2.8. SeptiCyte Lab strongly differentiated postcardiopulmonary bypass and clinically overt severe sepsis syndrome patients by receiver operating characteristic curve analysis, with an area-under-curve value of 0.99 (95% CI, 0.96-1.00). Equivalent performance was found using reverse transcription-quantitative polymerase chain reaction. There was no significant correlation between the score produced by the SeptiCyte Lab test and measures of illness severity, immune compromise, or microbial culture status. CONCLUSIONS: SeptiCyte Lab is able to discriminate clearly between clinically well-defined and homogeneous postcardiopulmonary bypass and clinically overt severe sepsis syndrome groups in children. A broader investigation among children with more heterogeneous inflammation-associated diagnoses and care settings is warranted.

A Molecular Host Response Assay to Discriminate Between Sepsis and Infection-Negative Systemic Inflammation in Critically Ill Patients: Discovery and Validation in Independent Cohorts.

BACKGROUND: Systemic inflammation is a whole body reaction having an infection-positive (i.e., sepsis) or infection-negative origin. It is important to distinguish between these two etiologies early and accurately because this has significant therapeutic implications for critically ill patients. We hypothesized that a molecular classifier based on peripheral blood RNAs could be discovered that would (1) determine which patients with systemic inflammation had sepsis, (2) be robust across independent patient cohorts, (3) be insensitive to disease severity, and (4) provide diagnostic utility. The goal of this study was to identify and validate such a molecular classifier. METHODS AND FINDINGS: We conducted an observational, non-interventional study of adult patients recruited from tertiary intensive care units (ICUs). Biomarker discovery utilized an Australian cohort (n = 105) consisting of 74 cases (sepsis patients) and 31 controls (post-surgical patients with infection-negative systemic inflammation) recruited at five tertiary care settings in Brisbane, Australia, from June 3, 2008, to December 22, 2011. A four-gene classifier combining CEACAM4, LAMP1, PLA2G7, and PLAC8 RNA biomarkers was identified. This classifier, designated SeptiCyte Lab, was validated using reverse transcription quantitative PCR and receiver operating characteristic (ROC) curve analysis in five cohorts (n = 345) from the Netherlands. Patients for validation were selected from the Molecular Diagnosis and Risk Stratification of Sepsis study (ClinicalTrials.gov, NCT01905033), which recruited ICU patients from the Academic Medical Center in Amsterdam and the University Medical Center Utrecht. Patients recruited from November 30, 2012, to August 5, 2013, were eligible for inclusion in the present study. Validation cohort 1 (n = 59) consisted entirely of unambiguous cases and controls; SeptiCyte Lab gave an area under curve (AUC) of 0.95 (95% CI 0.91-1.00) in this cohort. ROC curve analysis of an independent, more heterogeneous group of patients (validation cohorts 2-5; 249 patients after excluding 37 patients with an infection likelihood of "possible") gave an AUC of 0.89 (95% CI 0.85-0.93). Disease severity, as measured by Sequential Organ Failure Assessment (SOFA) score or Acute Physiology and Chronic Health Evaluation (APACHE) IV score, was not a significant confounding variable. The diagnostic utility of SeptiCyte Lab was evaluated by comparison to various clinical and laboratory parameters available to a clinician within 24 h of ICU admission. SeptiCyte Lab was significantly better at differentiating cases from controls than all tested parameters, both singly and in various logistic combinations, and more than halved the diagnostic error rate compared to procalcitonin in all tested cohorts and cohort combinations. Limitations of this study relate to (1) cohort compositions that do not perfectly reflect the composition of the intended use population, (2) potential biases that could be introduced as a result of the current lack of a gold standard for diagnosing sepsis, and (3) lack of a complete, unbiased comparison to C-reactive protein. CONCLUSIONS: SeptiCyte Lab is a rapid molecular assay that may be clinically useful in managing ICU patients with systemic inflammation. Further study in population-based cohorts is needed to validate this assay for clinical use.

Validation of SeptiCyte RAPID to Discriminate Sepsis from Non-Infectious Systemic Inflammation.

(1) Background: SeptiCyte RAPID is a molecular test for discriminating sepsis from non-infectious systemic inflammation, and for estimating sepsis probabilities. The objective of this study was the clinical validation of SeptiCyte RAPID, based on testing retrospectively banked and prospectively collected patient samples. (2) Methods: The cartridge-based SeptiCyte RAPID test accepts a PAXgene blood RNA sample and provides sample-to-answer processing in ~1 h. The test output (SeptiScore, range 0-15) falls into four interpretation bands, with higher scores indicating higher probabilities of sepsis. Retrospective (N = 356) and prospective (N = 63) samples were tested from adult patients in ICU who either had the systemic inflammatory response syndrome (SIRS), or were suspected of having/diagnosed with sepsis. Patients were clinically evaluated by a panel of three expert physicians blinded to the SeptiCyte test results. Results were interpreted under either the Sepsis-2 or Sepsis-3 framework. (3) Results: Under the Sepsis-2 framework, SeptiCyte RAPID performance for the combined retrospective and prospective cohorts had Areas Under the ROC Curve (AUCs) ranging from 0.82 to 0.85, a negative predictive value of 0.91 (sensitivity 0.94) for SeptiScore Band 1 (score range 0.1-5.0; lowest risk of sepsis), and a positive predictive value of 0.81 (specificity 0.90) for SeptiScore Band 4 (score range 7.4-15; highest risk of sepsis). Performance estimates for the prospective cohort ranged from AUC 0.86-0.95. For physician-adjudicated sepsis cases that were blood culture (+) or blood, urine culture (+)(+), 43/48 (90%) of SeptiCyte scores fell in Bands 3 or 4. In multivariable analysis with up to 14 additional clinical variables, SeptiScore was the most important variable for sepsis diagnosis. A comparable performance was obtained for the majority of patients reanalyzed under the Sepsis-3 definition, although a subgroup of 16 patients was identified that was called septic under Sepsis-2 but not under Sepsis-3. (4) Conclusions: This study validates SeptiCyte RAPID for estimating sepsis probability, under both the Sepsis-2 and Sepsis-3 frameworks, for hospitalized patients on their first day of ICU admission.

Stratification of COVID-19 Severity Using SeptiCyte RAPID, a Novel Host Immune Response Test.

SeptiCyte® RAPID is a gene expression assay measuring the relative expression levels of host response genes PLA2G7 and PLAC8, indicative of a dysregulated immune response during sepsis. As severe forms of COVID-19 may be considered viral sepsis, we evaluated SeptiCyte RAPID in a series of 94 patients admitted to Foch Hospital (Suresnes, France) with proven SARS-CoV-2 infection. EDTA blood was collected in the emergency department (ED) in 67 cases, in the intensive care unit (ICU) in 23 cases and in conventional units in 4 cases. SeptiScore (0-15 scale) increased with COVID-19 severity. Patients in ICU had the highest SeptiScores, producing values comparable to 8 patients with culture-confirmed bacterial sepsis. Receiver operating characteristic (ROC) curve analysis had an area under the curve (AUC) of 0.81 for discriminating patients requiring ICU admission from patients who were immediately discharged or from patients requiring hospitalization in conventional units. SeptiScores increased with the extent of the lung injury. For 68 patients, a chest computed tomography (CT) scan was performed within 24 h of COVID-19 diagnosis. SeptiScore >7 suggested lung injury ≥50% (AUC = 0.86). SeptiCyte RAPID was compared to other biomarkers for discriminating Critical + Severe COVID-19 in ICU, versus Moderate + Mild COVID-19 not in ICU. The mean AUC for SeptiCyte RAPID was superior to that of any individual biomarker or combination thereof. In contrast to C-reactive protein (CRP), correlation of SeptiScore with lung injury was not impacted by treatment with anti-inflammatory agents. SeptiCyte RAPID can be a useful tool to identify patients with severe forms of COVID-19 in ED, as well as during follow-up.

Evaluation of the host immune response assay SeptiCyte RAPID for potential triage of COVID-19 patients.

Tools for the evaluation of COVID-19 severity would help clinicians with triage decisions, especially the decision whether to admit to ICU. The aim of this study was to evaluate SeptiCyte RAPID, a host immune response assay (Immunexpress, Seattle USA) as a triaging tool for COVID-19 patients requiring hospitalization and potentially ICU care. SeptiCyte RAPID employs a host gene expression signature consisting of the ratio of expression levels of two immune related mRNAs, PLA2G7 and PLAC8, measured from whole blood samples. Blood samples from 146 adult SARS-CoV-2 (+) patients were collected within 48 h of hospital admission in PAXgene blood RNA tubes at Hospital del Mar, Barcelona, Spain, between July 28th and December 1st, 2020. Data on demographics, vital signs, clinical chemistry parameters, radiology, interventions, and SeptiCyte RAPID were collected and analyzed with bioinformatics methods. The performance of SeptiCyte RAPID for COVID-19 severity assessment and ICU admission was evaluated, relative to the comparator of retrospective clinical assessment by the Hospital del Mar clinical care team. In conclusion, SeptiCyte RAPID was able to stratify COVID-19 cases according to clinical severity: critical vs. mild (AUC = 0.93, p < 0.0001), critical vs. moderate (AUC = 0.77, p = 0.002), severe vs. mild (AUC = 0.85, p = 0.0003), severe vs. moderate (AUC = 0.63, p = 0.05). This discrimination was significantly better (by AUC or p-value) than could be achieved by CRP, lactate, creatine, IL-6, or D-dimer. Some of the critical or severe cases had "early" blood draws (before ICU admission; n = 33). For these cases, when compared to moderate and mild cases not in ICU (n = 37), SeptiCyte RAPID had AUC = 0.78 (p = 0.00012). In conclusion, SeptiCyte RAPID was able to stratify COVID-19 cases according to clinical severity as defined by the WHO COVID-19 Clinical Management Living Guidance of January 25th, 2021. Measurements taken early (before a patient is considered for ICU admission) suggest that high SeptiScores could aid in predicting the need for later ICU admission.

The effect of uncertainty in patient classification on diagnostic performance estimations.

BACKGROUND: The performance of a new diagnostic test is typically evaluated against a comparator which is assumed to correspond closely to some true state of interest. Judgments about the new test's performance are based on the differences between the outputs of the test and comparator. It is commonly assumed that a small amount of uncertainty in the comparator's classifications will negligibly affect the measured performance of a diagnostic test. METHODS: Simulated datasets were generated to represent typical diagnostic scenarios. Comparator noise was introduced in the form of random misclassifications, and the effect on the apparent performance of the diagnostic test was determined. An actual dataset from a clinical trial on a new diagnostic test for sepsis was also analyzed. RESULTS: We demonstrate that as little as 5% misclassification of patients by the comparator can be enough to statistically invalidate performance estimates such as sensitivity, specificity and area under the receiver operating characteristic curve, if this uncertainty is not measured and taken into account. This distortion effect is found to increase non-linearly with comparator uncertainty, under some common diagnostic scenarios. For clinical populations exhibiting high degrees of classification uncertainty, failure to measure and account for this effect will introduce significant risks of drawing false conclusions. The effect of classification uncertainty is magnified further for high performing tests that would otherwise reach near-perfection in diagnostic evaluation trials. A requirement of very high diagnostic performance for clinical adoption, such as a 99% sensitivity, can be rendered nearly unachievable even for a perfect test, if the comparator diagnosis contains even small amounts of uncertainty. This paper and an accompanying online simulation tool demonstrate the effect of classification uncertainty on the apparent performance of tests across a range of typical diagnostic scenarios. Both simulated and real datasets are used to show the degradation of apparent test performance as comparator uncertainty increases. CONCLUSIONS: Overall, a 5% or greater misclassification rate by the comparator can lead to significant underestimation of true test performance. An online simulation tool allows researchers to explore this effect using their own trial parameters (https://imperfect-gold-standard.shinyapps.io/classification-noise/) and the source code is freely available (https://github.com/ksny/Imperfect-Gold-Standard).

Correction: The effect of uncertainty in patient classification on diagnostic performance estimations.

[This corrects the article DOI: 10.1371/journal.pone.0217146.].

Physician agreement on the diagnosis of sepsis in the intensive care unit: estimation of concordance and analysis of underlying factors in a multicenter cohort.

BACKGROUND: Differentiating sepsis from the systemic inflammatory response syndrome (SIRS) in critical care patients is challenging, especially before serious organ damage is evident, and with variable clinical presentations of patients and variable training and experience of attending physicians. Our objective was to describe and quantify physician agreement in diagnosing SIRS or sepsis in critical care patients as a function of available clinical information, infection site, and hospital setting. METHODS: We conducted a post hoc analysis of previously collected data from a prospective, observational trial (N = 249 subjects) in intensive care units at seven US hospitals, in which physicians at different stages of patient care were asked to make diagnostic calls of either SIRS, sepsis, or indeterminate, based on varying amounts of available clinical information (clinicaltrials.gov identifier: NCT02127502). The overall percent agreement and the free-marginal, inter-observer agreement statistic kappa (κ free) were used to quantify agreement between evaluators (attending physicians, site investigators, external expert panelists). Logistic regression and machine learning techniques were used to search for significant variables that could explain heterogeneity within the indeterminate and SIRS patient subgroups. RESULTS: Free-marginal kappa decreased between the initial impression of the attending physician and (1) the initial impression of the site investigator (κ free 0.68), (2) the consensus discharge diagnosis of the site investigators (κ free 0.62), and (3) the consensus diagnosis of the external expert panel (κ free 0.58). In contrast, agreement was greatest between the consensus discharge impression of site investigators and the consensus diagnosis of the external expert panel (κ free 0.79). When stratified by infection site, κ free for agreement between initial and later diagnoses had a mean value + 0.24 (range - 0.29 to + 0.39) for respiratory infections, compared to + 0.70 (range + 0.42 to + 0.88) for abdominal + urinary + other infections. Bioinformatics analysis failed to clearly resolve the indeterminate diagnoses and also failed to explain why 60% of SIRS patients were treated with antibiotics. CONCLUSIONS: Considerable uncertainty surrounds the differential clinical diagnosis of sepsis vs. SIRS, especially before organ damage has become highly evident, and for patients presenting with respiratory clinical signs. Our findings underscore the need to provide physicians with accurate, timely diagnostic information in evaluating possible sepsis.

The Time-Course of Hatching Enzyme Secretion in the Sea Urchin Strongylocentrotus purpuratus: (Timing/secretion/hatching enzyme).

By two independent methods, we have determined approximately the time-course of hatching enzyme secretion in the sea urchin Strongylocentrotus purpuratus. A quick-kill method indicates that a significant fraction of the enzyme is secreted between 90% and 97% of the fertilization-hatching interval. A direct assay method indicates that the remainder of the enzyme is secreted on either side of the 90-97%"window". The entire period of secretion spans from 75% to 100% or more of the fertilization-hatching interval. For embryos raised at 15°C this translates to an interval of 4.8 or more hr.

A general approach to the analysis of errors and failure modes in the base-calling function in automated fluorescent DNA sequencing.

We describe the analysis of errors and failure modes in the base-calling function in automated DNA sequencing, on instruments in which fluorescently-labeled Sanger dideoxy-sequencing ladders are detected via their times of migration past a fixed detector. A general approach entails the joint use of: (i) well-defined control samples such as M13mp18, and (ii) mathematical simulation of sequencing electropherograms, with the deliberate introduction of different types of distortion and noise. An algorithm, the electrophoretic trace simulator (ETS), is used to calculate electrophoresis traces corresponding to the output data stream of an automated fluorescent DNA sequencer. The ETS accepts a user-defined sequence of nucleotide bases (A, C, G, T) as input, and employs user-adjustable functions to compute the following critical parameters of an electropherogram: peak intensity, peak spacing, peak shape as a function of base number; background, noise, and spectral cross-talk correction (for a sequencer using multiple dyes). We use a combination of M13mp18 controls and simulated electropherograms to analyze two problems of considerable practical importance: (i) variation in electrophoretic migration rates between different lanes of a gel, and (ii) variation in signal intensity due to user-dependent loading artifacts. The issue of base-calling errors and failure modes, for electropherograms that contain noise and distortion, is addressed.