Prospective validation of a transcriptomic severity classifier among patients with suspected acute infection and sepsis in the emergency department.

BACKGROUND AND IMPORTANCE: mRNA-based host response signatures have been reported to improve sepsis diagnostics. Meanwhile, prognostic markers for the rapid and accurate prediction of severity in patients with suspected acute infections and sepsis remain an unmet need. IMX-SEV-2 is a 29-host-mRNA classifier designed to predict disease severity in patients with acute infection or sepsis. OBJECTIVE: Validation of the host-mRNA infection severity classifier IMX-SEV-2. DESIGN, SETTINGS AND PARTICIPANTS: Prospective, observational, convenience cohort of emergency department (ED) patients with suspected acute infections. OUTCOME MEASURES AND ANALYSIS: Whole blood RNA tubes were analyzed using independently trained and validated composite target genes (IMX-SEV-2). IMX-SEV-2-generated risk scores for severity were compared to the patient outcomes in-hospital mortality and 72-h multiorgan failure. MAIN RESULTS: Of the 312 eligible patients, 22 (7.1%) died in hospital and 58 (18.6%) experienced multiorgan failure within 72 h of presentation. For predicting in-hospital mortality, IMX-SEV-2 had a significantly higher area under the receiver operating characteristic (AUROC) of 0.84 [95% confidence intervals (CI), 0.76-0.93] compared to 0.76 (0.64-0.87) for lactate, 0.68 (0.57-0.79) for quick Sequential Organ Failure Assessment (qSOFA) and 0.75 (0.65-0.85) for National Early Warning Score 2 (NEWS2), ( P = 0.015, 0.001 and 0.013, respectively). For identifying and predicting 72-h multiorgan failure, the AUROC of IMX-SEV-2 was 0.76 (0.68-0.83), not significantly different from lactate (0.73, 0.65-0.81), qSOFA (0.77, 0.70-0.83) or NEWS2 (0.81, 0.75-0.86). CONCLUSION: The IMX-SEV-2 classifier showed a superior prediction of in-hospital mortality compared to biomarkers and clinical scores among ED patients with suspected infections. No improvement for predicting multiorgan failure was found compared to established scores or biomarkers. Identifying patients with a high risk of mortality or multiorgan failure may improve patient outcomes, resource utilization and guide therapy decision-making.

A 6-mRNA host response classifier in whole blood predicts outcomes in COVID-19 and other acute viral infections.

Predicting the severity of COVID-19 remains an unmet medical need. Our objective was to develop a blood-based host-gene-expression classifier for the severity of viral infections and validate it in independent data, including COVID-19. We developed a logistic regression-based classifier for the severity of viral infections and validated it in multiple viral infection settings including COVID-19. We used training data (N = 705) from 21 retrospective transcriptomic clinical studies of influenza and other viral illnesses looking at a preselected panel of host immune response messenger RNAs. We selected 6 host RNAs and trained logistic regression classifier with a cross-validation area under curve of 0.90 for predicting 30-day mortality in viral illnesses. Next, in 1417 samples across 21 independent retrospective cohorts the locked 6-RNA classifier had an area under curve of 0.94 for discriminating patients with severe vs. non-severe infection. Next, in independent cohorts of prospectively (N = 97) and retrospectively (N = 100) enrolled patients with confirmed COVID-19, the classifier had an area under curve of 0.89 and 0.87, respectively, for identifying patients with severe respiratory failure or 30-day mortality. Finally, we developed a loop-mediated isothermal gene expression assay for the 6-messenger-RNA panel to facilitate implementation as a rapid assay. With further study, the classifier could assist in the risk assessment of COVID-19 and other acute viral infections patients to determine severity and level of care, thereby improving patient management and reducing healthcare burden.

The Optimization and Biological Significance of a 29-Host-Immune-mRNA Panel for the Diagnosis of Acute Infections and Sepsis.

In response to the unmet need for timely accurate diagnosis and prognosis of acute infections and sepsis, host-immune-response-based tests are being developed to help clinicians make more informed decisions including prescribing antimicrobials, ordering additional diagnostics, and assigning level of care. One such test (InSep™, Inflammatix, Inc.) uses a 29-mRNA panel to determine the likelihood of bacterial infection, the separate likelihood of viral infection, and the risk of physiologic decompensation (severity of illness). The test, being implemented in a rapid point-of-care platform with a turnaround time of 30 min, enables accurate and rapid diagnostic use at the point of impact. In this report, we provide details on how the 29-biomarker signature was chosen and optimized, together with its molecular, immunological, and medical significance to better understand the pathophysiological relevance of altered gene expression in disease. We synthesize key results obtained from gene-level functional annotations, geneset-level enrichment analysis, pathway-level analysis, and gene-network-level upstream regulator analysis. Emerging findings are summarized as hallmarks on immune cell interaction, inflammatory mediators, cellular metabolism and homeostasis, immune receptors, intracellular signaling and antiviral response; and converging themes on neutrophil degranulation and activation involved in immune response, interferon, and other signaling pathways.

A Novel 29-Messenger RNA Host-Response Assay From Whole Blood Accurately Identifies Bacterial and Viral Infections in Patients Presenting to the Emergency Department With Suspected Infections: A Prospective Observational Study.

OBJECTIVES: The rapid diagnosis of acute infections and sepsis remains a serious challenge. As a result of limitations in current diagnostics, guidelines recommend early antimicrobials for suspected sepsis patients to improve outcomes at a cost to antimicrobial stewardship. We aimed to develop and prospectively validate a new, 29-messenger RNA blood-based host-response classifier Inflammatix Bacterial Viral Non-Infected version 2 (IMX-BVN-2) to determine the likelihood of bacterial and viral infections. DESIGN: Prospective observational study. SETTING: Emergency Department, Campus Benjamin Franklin, Charité-Universitätsmedizin Berlin, Germany. PATIENTS: Three hundred twelve adult patients presenting to the emergency department with suspected acute infections or sepsis with at least one vital sign change. INTERVENTIONS: None (observational study only). MEASUREMENTS AND MAIN RESULTS: Gene expression levels from extracted whole blood RNA was quantified on a NanoString nCounter SPRINT (NanoString Technologies, Seattle, WA). Two predicted probability scores for the presence of bacterial and viral infection were calculated using the IMX-BVN-2 neural network classifier, which was trained on an independent development set. The IMX-BVN-2 bacterial score showed an area under the receiver operating curve for adjudicated bacterial versus ruled out bacterial infection of 0.90 (95% CI, 0.85-0.95) compared with 0.89 (95% CI, 0.84-0.94) for procalcitonin with procalcitonin being used in the adjudication. The IMX-BVN-2 viral score area under the receiver operating curve for adjudicated versus ruled out viral infection was 0.83 (95% CI, 0.77-0.89). CONCLUSIONS: IMX-BVN-2 demonstrated accuracy for detecting both viral infections and bacterial infections. This shows the potential of host-response tests as a novel and practical approach for determining the causes of infections, which could improve patient outcomes while upholding antimicrobial stewardship.

Optimization of Genomic Classifiers for Clinical Deployment: Evaluation of Bayesian Optimization to Select Predictive Models of Acute Infection and In-Hospital Mortality.

Acute infection, if not rapidly and accurately detected, can lead to sepsis, organ failure and even death. Current detection of acute infection as well as assessment of a patient's severity of illness are imperfect. Characterization of a patient's immune response by quantifying expression levels of specific genes from blood represents a potentially more timely and precise means of accomplishing both tasks. Machine learning methods provide a platform to leverage this host response for development of deployment-ready classification models. Prioritization of promising classifiers is dependent, in part, on hyperparameter optimization for which a number of approaches including grid search, random sampling and Bayesian optimization have been shown to be effective. We compare HO approaches for the development of diagnostic classifiers of acute infection and in-hospital mortality from gene expression of 29 diagnostic markers. We take a deployment-centered approach to our comprehensive analysis, accounting for heterogeneity in our multi-study patient cohort with our choices of dataset partitioning and hyperparameter optimization objective as well as assessing selected classifiers in external (as well as internal) validation. We find that classifiers selected by Bayesian optimization for in-hospital mortality can outperform those selected by grid search or random sampling. However, in contrast to previous research: 1) Bayesian optimization is not more efficient in selecting classifiers in all instances compared to grid search or random sampling-based methods and 2) we note marginal gains in classifier performance in only specific circumstances when using a common variant of Bayesian optimization (i.e. automatic relevance determination). Our analysis highlights the need for further practical, deployment-centered benchmarking of HO approaches in the healthcare context.

Cost Impact Model of a Novel Multi-mRNA Host Response Assay for Diagnosis and Risk Assessment of Acute Respiratory Tract Infections and Sepsis in the Emergency Department.

BACKGROUND: Early identification of acute infections and sepsis remains an unmet medical need. While early detection and initiation of treatment reduces mortality, inappropriate treatment leads to adverse events and the development of antimicrobial resistance. Current diagnostic and prognostic solutions, including procalcitonin, lack required accuracy. A novel blood-based host response test, HostDx™ Sepsis by Inflammatix, Inc., assesses the likelihood of a bacterial infection, the likelihood of a viral infection, and the severity of the condition. OBJECTIVES: We estimated the economic impact of adopting HostDx Sepsis testing among patients with suspected acute respiratory tract infection (ARTI) in the emergency department (ED). METHODS: Our cost impact model estimated costs for adult ED patients with suspected ARTI under the standard of care versus with the adoption of HostDx Sepsis from the perspective of US payers. Included costs were those assumed to be associated with an episode of sepsis diagnosis, management, and treatment. Projected accuracies for test predictions, disease prevalence, and clinical parameters was derived from patient-level meta-analysis data of randomized trials, supplemented with published performance data for HostDx Sepsis. One-way sensitivity analysis was performed on key input parameters. RESULTS: Compared to standard of care including procalcitonin, the superior test characteristics of HostDx Sepsis resulted in an average cost savings of approximately US$1974 per patient (-31.3%) exclusive of the cost of HostDx Sepsis. Reductions in hospital days (-0.80 days, -36.7%), antibiotic days (-1.49 days, -29.5%), and percent 30-day mortality (-1.67%, -13.64%) were driven by HostDx Sepsis providing fewer "noninformative" moderate risk predictions and more "certain" low- or high-risk predictions compared to standard of care, especially for patients who were not severely ill. These results were robust to changes in key parameters, including disease prevalence. CONCLUSIONS: Our model shows substantial savings associated with introduction of HostDx Sepsis among patients with ARTIs in EDs. These results need confirmation in interventional trials.

Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms.

Importance: Mammography screening currently relies on subjective human interpretation. Artificial intelligence (AI) advances could be used to increase mammography screening accuracy by reducing missed cancers and false positives. Objective: To evaluate whether AI can overcome human mammography interpretation limitations with a rigorous, unbiased evaluation of machine learning algorithms. Design, Setting, and Participants: In this diagnostic accuracy study conducted between September 2016 and November 2017, an international, crowdsourced challenge was hosted to foster AI algorithm development focused on interpreting screening mammography. More than 1100 participants comprising 126 teams from 44 countries participated. Analysis began November 18, 2016. Main Outcomes and Measurements: Algorithms used images alone (challenge 1) or combined images, previous examinations (if available), and clinical and demographic risk factor data (challenge 2) and output a score that translated to cancer yes/no within 12 months. Algorithm accuracy for breast cancer detection was evaluated using area under the curve and algorithm specificity compared with radiologists' specificity with radiologists' sensitivity set at 85.9% (United States) and 83.9% (Sweden). An ensemble method aggregating top-performing AI algorithms and radiologists' recall assessment was developed and evaluated. Results: Overall, 144 231 screening mammograms from 85 580 US women (952 cancer positive ≤12 months from screening) were used for algorithm training and validation. A second independent validation cohort included 166 578 examinations from 68 008 Swedish women (780 cancer positive). The top-performing algorithm achieved an area under the curve of 0.858 (United States) and 0.903 (Sweden) and 66.2% (United States) and 81.2% (Sweden) specificity at the radiologists' sensitivity, lower than community-practice radiologists' specificity of 90.5% (United States) and 98.5% (Sweden). Combining top-performing algorithms and US radiologist assessments resulted in a higher area under the curve of 0.942 and achieved a significantly improved specificity (92.0%) at the same sensitivity. Conclusions and Relevance: While no single AI algorithm outperformed radiologists, an ensemble of AI algorithms combined with radiologist assessment in a single-reader screening environment improved overall accuracy. This study underscores the potential of using machine learning methods for enhancing mammography screening interpretation.

A generalizable 29-mRNA neural-network classifier for acute bacterial and viral infections.

Improved identification of bacterial and viral infections would reduce morbidity from sepsis, reduce antibiotic overuse, and lower healthcare costs. Here, we develop a generalizable host-gene-expression-based classifier for acute bacterial and viral infections. We use training data (N = 1069) from 18 retrospective transcriptomic studies. Using only 29 preselected host mRNAs, we train a neural-network classifier with a bacterial-vs-other area under the receiver-operating characteristic curve (AUROC) 0.92 (95% CI 0.90-0.93) and a viral-vs-other AUROC 0.92 (95% CI 0.90-0.93). We then apply this classifier, inflammatix-bacterial-viral-noninfected-version 1 (IMX-BVN-1), without retraining, to an independent cohort (N = 163). In this cohort, IMX-BVN-1 AUROCs are: bacterial-vs.-other 0.86 (95% CI 0.77-0.93), and viral-vs.-other 0.85 (95% CI 0.76-0.93). In patients enrolled within 36 h of hospital admission (N = 70), IMX-BVN-1 AUROCs are: bacterial-vs.-other 0.92 (95% CI 0.83-0.99), and viral-vs.-other 0.91 (95% CI 0.82-0.98). With further study, IMX-BVN-1 could provide a tool for assessing patients with suspected infection and sepsis at hospital admission.

Analytical validation of CanAssist-Breast: an immunohistochemistry based prognostic test for hormone receptor positive breast cancer patients.

BACKGROUND: CanAssist-Breast is an immunohistochemistry based test that predicts risk of distant recurrence in early-stage hormone receptor positive breast cancer patients within first five years of diagnosis. Immunohistochemistry gradings for 5 biomarkers (CD44, ABCC4, ABCC11, N-Cadherin and pan-Cadherins) and 3 clinical parameters (tumor size, tumor grade and node status) of 298 patient cohort were used to develop a machine learning based statistical algorithm. The algorithm generates a risk score based on which patients are stratified into two groups, low- or high-risk for recurrence. The aim of the current study is to demonstrate the analytical performance with respect to repeatability and reproducibility of CanAssist-Breast. METHODS: All potential sources of variation in CanAssist-Breast testing involving operator, run and observer that could affect the immunohistochemistry performance were tested using appropriate statistical analysis methods for each of the CanAssist-Breast biomarkers using a total 309 samples. The cumulative effect of these variations in the immunohistochemistry gradings on the generation of CanAssist-Breast risk score and risk category were also evaluated. Intra-class Correlation Coefficient, Bland Altman plots and pair-wise agreement were performed to establish concordance on IHC gradings, risk score and risk categorization respectively. RESULTS: CanAssist-Breast test exhibited high levels of concordance on immunohistochemistry gradings for all biomarkers with Intra-class Correlation Coefficient of ≥0.75 across all reproducibility and repeatability experiments. Bland-Altman plots demonstrated that agreement on risk scores between the comparators was within acceptable limits. We also observed > 90% agreement on risk categorization (low- or high-risk) across all variables tested. CONCLUSIONS: The extensive analytical validation data for the CanAssist-Breast test, evaluating immunohistochemistry performance, risk score generation and risk categorization showed excellent agreement across variables, demonstrating that the test is robust.

Clinical validation of an immunohistochemistry-based CanAssist-Breast test for distant recurrence prediction in hormone receptor-positive breast cancer patients.

CanAssist-Breast (CAB) is an immunohistochemistry (IHC)-based prognostic test for early-stage Hormone Receptor (HR+)-positive breast cancer patients. CAB uses a Support Vector Machine (SVM) trained algorithm which utilizes expression levels of five biomarkers (CD44, ABCC4, ABCC11, N-Cadherin, and Pan-Cadherin) and three clinical parameters such as tumor size, grade, and node status as inputs to generate a risk score and categorizes patients as low- or high-risk for distant recurrence within 5 years of diagnosis. In this study, we present clinical validation of CAB. CAB was validated using a retrospective cohort of 857 patients. All patients were treated either with endocrine therapy or chemoendocrine therapy. Risk categorization by CAB was analyzed by calculating Distant Metastasis-Free Survival (DMFS) and recurrence rates using Kaplan-Meier survival curves. Multivariate analysis was performed to calculate Hazard ratios (HR) for CAB high-risk vs low-risk patients. The results showed that Distant Metastasis-Free Survival (DMFS) was significantly different (P-0.002) between low- (DMFS: 95%) and high-risk (DMFS: 80%) categories in the endocrine therapy treated alone subgroup (n = 195) as well as in the total cohort (n = 857, low-risk DMFS: 95%, high-risk DMFS: 84%, P < 0.0001). In addition, the segregation of the risk categories was significant (P = 0.0005) in node-positive patients, with a difference in DMFS of 12%. In multivariate analysis, CAB risk score was the most significant predictor of distant recurrence with hazard ratio of 3.2048 (P < 0.0001). CAB stratified patients into discrete risk categories with high statistical significance compared to Ki-67 and IHC4 score-based stratification. CAB stratified a higher percentage of the cohort (82%) as low-risk than IHC4 score (41.6%) and could re-stratify >74% of high Ki-67 and IHC4 score intermediate-risk zone patients into low-risk category. Overall the data suggest that CAB can effectively predict risk of distant recurrence with clear dichotomous high- or low-risk categorization.

Development of a Novel Proteomic Risk-Classifier for Prognostication of Patients With Early-Stage Hormone Receptor-Positive Breast Cancer.

Use of proteomic strategies to identify a risk classifier that estimates probability of distant recurrence in early-stage hormone receptor (HR)-positive breast cancer is relevant to physiological cellular function and therefore to intrinsic tumor biology. We used a 298-sample retrospective training set to develop an immunohistochemistry-based novel risk classifier called CanAssist-Breast (CAB) which combines 5 prognostically relevant biomarkers and 3 clinico-pathological parameters to arrive at probability of distant recurrence within 5 years from diagnosis. Five selected biomarkers, namely, CD44, ABCC4, ABCC11, N-cadherin, and pan-cadherin, were chosen based on their role in tumor metastasis. The chosen biomarkers represent the hallmarks of cancer and are distinct from other proliferation and gene expression-based prognostic signatures. The 3 clinico-pathological parameters integrated into the machine learning-based CAB algorithm are tumor size, tumor grade, and node status. These features are used to calculate a "CAB risk score" that classifies patients into low- or high-risk groups and predicts probability of distant recurrence in 5 years. Independent clinical validation of CAB in a retrospective study comprising 196 patients indicated that distant metastasis-free survival (DMFS) was significantly different in the 2 risk groups. The difference in DMFS between the low- and high-risk categories was 19% in the validation cohort (P = .0002). In multivariate analysis, CAB risk score was the most significant independent predictor of distant recurrence with a hazard ratio of 4.3 (P = .0003). CanAssist-Breast is a precise and unique machine learning-based proteomic risk-classifier that can assist in risk stratification of patients with early-stage HR+ breast cancer.

Evaluation of a Machine Learning-Based Prognostic Model for Unrelated Hematopoietic Cell Transplantation Donor Selection.

The survival of patients undergoing hematopoietic cell transplantation (HCT) from unrelated donors for acute leukemia exhibits considerable variation, even after stringent genetic matching. To improve the donor selection process, we attempted to create an algorithm to quantify the likelihood of survival to 5 years after unrelated donor HCT for acute leukemia, based on the clinical characteristics of the donor selected. All standard clinical variables were included in the model, which also included average leukocyte telomere length of the donor based on its association with recipient survival in severe aplastic anemia, and links to multiple malignancies. We developed a multivariate classifier that assigned a Preferred or NotPreferred label to each prospective donor based on the survival of the recipient. In a previous analysis using a resampling method, recipients with donors labeled Preferred experienced clinically compelling better survival compared with those labeled NotPreferred by the test. However, in a pivotal validation study in an independent cohort of 522 patients, the overall survival of the Preferred and NotPreferred donor groups was not significantly different. Although machine learning approaches have successfully modeled other biological phenomena and have led to accurate predictive models, our attempt to predict HCT outcomes after unrelated donor transplantation was not successful.

No association between donor telomere length and outcomes after allogeneic unrelated hematopoietic cell transplant in patients with acute leukemia.

Recent studies suggest improved survival in patients with severe aplastic anemia receiving hematopoietic cell transplant (HCT) from unrelated donors with longer telomeres. Here, we tested whether this effect is generalizable to patients with acute leukemia. From the Center for International Blood and Marrow Transplant Research (CIBMTR®) database, we identified 1097 patients who received 8/8 HLA-matched unrelated HCT for acute myeloid leukemia (AML) or acute lymphocytic leukemia (ALL) between 2004 and 2012 with myeloablative conditioning, and had pre-HCT blood sample from the donor in CIBMTR repository. The median age at HCT for recipients was 40 years (range ≤1-68), and 32 years for donors (range = 18-61). We used qPCR for relative telomere length (RTL) measurement, and Cox proportional hazard models for statistical analyses. In a discovery cohort of 300 patients, longer donor RTL (>25th percentile) was associated with reduced risks of relapse (HR = 0.62, p = 0.05) and acute graft-versus-host disease II-IV (HR = 0.68, p = 0.05), and possibly with a higher probability of neutrophil engraftment (HR = 1.3, p = 0.06). However, these results did not replicate in two validation cohorts of 297 and 488 recipients. There was one exception; a higher probability of neutrophil engraftment was observed in one validation cohort (HR = 1.24, p = 0.05). In a combined analysis of the three cohorts, no statistically significant associations (all p > 0.1) were found between donor RTL and any outcomes.

Cross-validation pitfalls when selecting and assessing regression and classification models.

BACKGROUND: We address the problem of selecting and assessing classification and regression models using cross-validation. Current state-of-the-art methods can yield models with high variance, rendering them unsuitable for a number of practical applications including QSAR. In this paper we describe and evaluate best practices which improve reliability and increase confidence in selected models. A key operational component of the proposed methods is cloud computing which enables routine use of previously infeasible approaches. METHODS: We describe in detail an algorithm for repeated grid-search V-fold cross-validation for parameter tuning in classification and regression, and we define a repeated nested cross-validation algorithm for model assessment. As regards variable selection and parameter tuning we define two algorithms (repeated grid-search cross-validation and double cross-validation), and provide arguments for using the repeated grid-search in the general case. RESULTS: We show results of our algorithms on seven QSAR datasets. The variation of the prediction performance, which is the result of choosing different splits of the dataset in V-fold cross-validation, needs to be taken into account when selecting and assessing classification and regression models. CONCLUSIONS: We demonstrate the importance of repeating cross-validation when selecting an optimal model, as well as the importance of repeating nested cross-validation when assessing a prediction error.

High precision prediction of functional sites in protein structures.

We address the problem of assigning biological function to solved protein structures. Computational tools play a critical role in identifying potential active sites and informing screening decisions for further lab analysis. A critical parameter in the practical application of computational methods is the precision, or positive predictive value. Precision measures the level of confidence the user should have in a particular computed functional assignment. Low precision annotations lead to futile laboratory investigations and waste scarce research resources. In this paper we describe an advanced version of the protein function annotation system FEATURE, which achieved 99% precision and average recall of 95% across 20 representative functional sites. The system uses a Support Vector Machine classifier operating on the microenvironment of physicochemical features around an amino acid. We also compared performance of our method with state-of-the-art sequence-level annotator Pfam in terms of precision, recall and localization. To our knowledge, no other functional site annotator has been rigorously evaluated against these key criteria. The software and predictive models are incorporated into the WebFEATURE service at http://feature.stanford.edu/wf4.0-beta.

A gene expression profile test to resolve head & neck squamous versus lung squamous cancers.

BACKGROUND: The differential diagnosis between metastatic head & neck squamous cell carcinomas (HNSCC) and lung squamous cell carcinomas (lung SCC) is often unresolved because the histologic appearance of these two tumor types is similar. We have developed and validated a gene expression profile test (GEP-HN-LS) that distinguishes HNSCC and lung SCC in formalin-fixed, paraffin-embedded (FFPE) specimens using a 2160-gene classification model. METHODS: The test was validated in a blinded study using a pre-specified algorithm and microarray data files for 76 metastatic or poorly-differentiated primary tumors with a known HNSCC or lung SCC diagnosis. RESULTS: The study met the primary Bayesian statistical endpoint for acceptance. Measures of test performance include overall agreement with the known diagnosis of 82.9% (95% CI, 72.5% to 90.6%), an area under the ROC curve (AUC) of 0.91 and a diagnostics odds ratio (DOR) of 23.6. HNSCC (N = 38) gave an agreement with the known diagnosis of 81.6% and lung SCC (N = 38) gave an agreement of 84.2%. Reproducibility in test results between three laboratories had a concordance of 91.7%. CONCLUSION: GEP-HN-LS can aid in resolving the important differential diagnosis between HNSCC and lung SCC tumors. VIRTUAL SLIDES: The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/1753227817890930.

A gene expression profile test for the differential diagnosis of ovarian versus endometrial cancers.

We have developed a gene expression profile test (Pathwork Tissue of Origin Endometrial Test) that distinguishes primary epithelial ovarian and endometrial cancers in formalin-fixed, paraffin-embedded (FFPE) specimens using a 316-gene classification model. The test was validated in a blinded study using a pre-specified algorithm and microarray files for 75 metastatic, poorly differentiated or undifferentiated specimens with a known ovarian or endometrial cancer diagnosis. Measures of test performance include a 94.7% overall agreement with the known diagnosis, an area under the ROC curve (AUC) of 0.997 and a diagnostic odds ratio (DOR) of 406. Ovarian cancers (n=30) gave an agreement of 96.7% with the known diagnosis while endometrial cancers (n=45) gave an agreement of 93.3%. In a precision study, concordance in test results was 100%. Reproducibility in test results between three laboratories was 94.3%. The Tissue of Origin Endometrial Test can aid in resolving important differential diagnostic questions in gynecologic oncology.

Validation and reproducibility of a microarray-based gene expression test for tumor identification in formalin-fixed, paraffin-embedded specimens.

Tumors whose primary site is challenging to diagnose represent a considerable proportion of new cancer cases. We present validation study results for a gene expression-based diagnostic test (the Pathwork Tissue of Origin Test) that aids in determining the tissue of origin using formalin-fixed, paraffin-embedded (FFPE) specimens. Microarray data files were generated for 462 metastatic, poorly differentiated, or undifferentiated FFPE tumor specimens, all of which had a reference diagnosis. The reference diagnoses were masked, and the microarray data files were analyzed using a 2000-gene classification model. The algorithm quantifies the similarity between RNA expression patterns of the study specimens and the 15 tissues on the test panel. Among the 462 specimens, overall agreement with the reference diagnosis was 89% (95% CI, 85% to 91%). In addition to the positive test results (ie, rule-ins), an average of 12 tissues for each specimen could be ruled out with >99% probability. The large size of this study increases confidence in the test results. A multisite reproducibility study showed 89.3% concordance between laboratories. The Tissue of Origin Test makes the benefits of microarray-based gene expression tests for tumor diagnosis available for use with the most common type of histology specimen (ie, FFPE).

Multicenter validation of a 1,550-gene expression profile for identification of tumor tissue of origin.

PURPOSE: Malignancies found in unexpected locations or with poorly differentiated morphologies can pose a significant challenge for tissue of origin determination. Current histologic and imaging techniques fail to yield definitive identification of the tissue of origin in a significant number of cases. The aim of this study was to validate a predefined 1,550-gene expression profile for this purpose. METHODS: Four institutions processed 547 frozen specimens representing 15 tissues of origin using oligonucleotide microarrays. Half of the specimens were metastatic tumors, with the remainder being poorly differentiated and undifferentiated primary cancers chosen to resemble those that present as a clinical challenge. RESULTS: In this blinded multicenter validation study the 1,550-gene expression profile was highly informative in tissue determination. The study found overall sensitivity (positive percent agreement with reference diagnosis) of 87.8% (95% CI, 84.7% to 90.4%) and overall specificity (negative percent agreement with reference diagnosis) of 99.4% (95% CI, 98.3% to 99.9%). Performance within the subgroup of metastatic tumors (n = 258) was found to be slightly lower than that of the poorly differentiated and undifferentiated primary tumor subgroup, 84.5% and 90.7%, respectively (P = .04). Differences between individual laboratories were not statistically significant. CONCLUSION: This study represents the first adequately sized, multicenter validation of a gene-expression profile for tissue of origin determination restricted to poorly differentiated and undifferentiated primary cancers and metastatic tumors. These results indicate that this profile should be a valuable addition or alternative to currently available diagnostic methods for the evaluation of uncertain primary cancers.