Critical assessment of variant prioritization methods for rare disease diagnosis within the rare genomes project.

BACKGROUND: A major obstacle faced by families with rare diseases is obtaining a genetic diagnosis. The average "diagnostic odyssey" lasts over five years and causal variants are identified in under 50%, even when capturing variants genome-wide. To aid in the interpretation and prioritization of the vast number of variants detected, computational methods are proliferating. Knowing which tools are most effective remains unclear. To evaluate the performance of computational methods, and to encourage innovation in method development, we designed a Critical Assessment of Genome Interpretation (CAGI) community challenge to place variant prioritization models head-to-head in a real-life clinical diagnostic setting. METHODS: We utilized genome sequencing (GS) data from families sequenced in the Rare Genomes Project (RGP), a direct-to-participant research study on the utility of GS for rare disease diagnosis and gene discovery. Challenge predictors were provided with a dataset of variant calls and phenotype terms from 175 RGP individuals (65 families), including 35 solved training set families with causal variants specified, and 30 unlabeled test set families (14 solved, 16 unsolved). We tasked teams to identify causal variants in as many families as possible. Predictors submitted variant predictions with estimated probability of causal relationship (EPCR) values. Model performance was determined by two metrics, a weighted score based on the rank position of causal variants, and the maximum F-measure, based on precision and recall of causal variants across all EPCR values. RESULTS: Sixteen teams submitted predictions from 52 models, some with manual review incorporated. Top performers recalled causal variants in up to 13 of 14 solved families within the top 5 ranked variants. Newly discovered diagnostic variants were returned to two previously unsolved families following confirmatory RNA sequencing, and two novel disease gene candidates were entered into Matchmaker Exchange. In one example, RNA sequencing demonstrated aberrant splicing due to a deep intronic indel in ASNS, identified in trans with a frameshift variant in an unsolved proband with phenotypes consistent with asparagine synthetase deficiency. CONCLUSIONS: Model methodology and performance was highly variable. Models weighing call quality, allele frequency, predicted deleteriousness, segregation, and phenotype were effective in identifying causal variants, and models open to phenotype expansion and non-coding variants were able to capture more difficult diagnoses and discover new diagnoses. Overall, computational models can significantly aid variant prioritization. For use in diagnostics, detailed review and conservative assessment of prioritized variants against established criteria is needed.

A metabolic signature for NADSYN1-dependent congenital NAD deficiency disorder.

Nicotinamide adenine dinucleotide (NAD) is essential for embryonic development. To date, biallelic loss-of-function variants in 3 genes encoding nonredundant enzymes of the NAD de novo synthesis pathway - KYNU, HAAO, and NADSYN1 - have been identified in humans with congenital malformations defined as congenital NAD deficiency disorder (CNDD). Here, we identified 13 further individuals with biallelic NADSYN1 variants predicted to be damaging, and phenotypes ranging from multiple severe malformations to the complete absence of malformation. Enzymatic assessment of variant deleteriousness in vitro revealed protein domain-specific perturbation, complemented by protein structure modeling in silico. We reproduced NADSYN1-dependent CNDD in mice and assessed various maternal NAD precursor supplementation strategies to prevent adverse pregnancy outcomes. While for Nadsyn1+/- mothers, any B3 vitamer was suitable to raise NAD, preventing embryo loss and malformation, Nadsyn1-/- mothers required supplementation with amidated NAD precursors (nicotinamide or nicotinamide mononucleotide) bypassing their metabolic block. The circulatory NAD metabolome in mice and humans before and after NAD precursor supplementation revealed a consistent metabolic signature with utility for patient identification. Our data collectively improve clinical diagnostics of NADSYN1-dependent CNDD, provide guidance for the therapeutic prevention of CNDD, and suggest an ongoing need to maintain NAD levels via amidated NAD precursor supplementation after birth.