Postanalytical tools improve performance of newborn screening by tandem mass spectrometry.

PURPOSE: The purpose of this study was to compare performance metrics of postanalytical interpretive tools of the Region 4 Stork collaborative project to the actual outcome based on cutoff values for amino acids and acylcarnitines selected by the California newborn screening program. METHODS: This study was a retrospective review of the outcome of 176,186 subjects born in California between 1 January and 30 June 2012. Raw data were uploaded to the Region 4 Stork Web portal as .csv files to calculate tool scores for 48 conditions simultaneously using a previously unpublished functionality, the tool runner. Scores for individual target conditions were deemed informative when equal or greater to the value representing the first percentile rank of known true-positive cases (17,099 cases in total). RESULTS: In the study period, the actual false-positive rate and positive predictive value were 0.26 and 10%, respectively. Utilization of the Region 4 Stork tools, simple interpretation rules, and second-tier tests could have achieved a false-positive rate as low as 0.02% and a positive predictive value >50% by replacing the cutoff system with Region 4 Stork tools as the primary method for postanalytical interpretation. CONCLUSION: Region 4 Stork interpretive tools, second-tier tests, and other evidence-based interpretation rules could have reduced false-positive cases by up to 90% in California.

Enhanced interpretation of newborn screening results without analyte cutoff values.

PURPOSE: To improve quality of newborn screening by tandem mass spectrometry with a novel approach made possible by the collaboration of 154 laboratories in 49 countries. METHODS: A database of 767,464 results from 12,721 cases affected with 60 conditions was used to build multivariate pattern recognition software that generates tools integrating multiple clinically significant results into a single score. This score is determined by the overlap between normal and disease ranges, penetration within the disease range, differences between conditions, and weighted correction factors. RESULTS: Ninety tools target either a single condition or the differential diagnosis between multiple conditions. Scores are expressed as the percentile rank among all cases with the same condition and are compared to interpretation guidelines. Retrospective evaluation of past cases suggests that these tools could have avoided at least half of 279 false-positive outcomes caused by carrier status for fatty-acid oxidation disorders and could have prevented 88% of known false-negative events. CONCLUSION: Application of this computational approach to raw data is independent from single analyte cutoff values. In Minnesota, the tools have been a major contributing factor to the sustained achievement of a false-positive rate below 0.1% and a positive predictive value above 60%.

Clinical validation of cutoff target ranges in newborn screening of metabolic disorders by tandem mass spectrometry: a worldwide collaborative project.

PURPOSE: To achieve clinical validation of cutoff values for newborn screening by tandem mass spectrometry through a worldwide collaborative effort. METHODS: Cumulative percentiles of amino acids and acylcarnitines in dried blood spots of approximately 25­30 million normal newborns and 10,742 deidentified true positive cases are compared to assign clinical significance, which is achieved when the median of a disorder range is, and usually markedly outside, either the 99th or the 1st percentile of the normal population. The cutoff target ranges of analytes and ratios are then defined as the interval between selected percentiles of the two populations. When overlaps occur, adjustments are made to maximize sensitivity and specificity taking all available factors into consideration. RESULTS: As of December 1, 2010, 130 sites in 45 countries have uploaded a total of 25,114 percentile data points, 565,232 analyte results of true positive cases with 64 conditions, and 5,341 cutoff values. The average rate of submission of true positive cases between December 1, 2008, and December 1, 2010, was 5.1 cases/day. This cumulative evidence generated 91 high and 23 low cutoff target ranges. The overall proportion of cutoff values within the respective target range was 42% (2,269/5,341). CONCLUSION: An unprecedented level of cooperation and collaboration has allowed the objective definition of cutoff target ranges for 114 markers to be applied to newborn screening of rare metabolic disorders.