Building a vertically integrated genomic learning health system: The biobank at the Colorado Center for Personalized Medicine.

Precision medicine initiatives across the globe have led to a revolution of repositories linking large-scale genomic data with electronic health records, enabling genomic analyses across the entire phenome. Many of these initiatives focus solely on research insights, leading to limited direct benefit to patients. We describe the biobank at the Colorado Center for Personalized Medicine (CCPM Biobank) that was jointly developed by the University of Colorado Anschutz Medical Campus and UCHealth to serve as a unique, dual-purpose research and clinical resource accelerating personalized medicine. This living resource currently has more than 200,000 participants with ongoing recruitment. We highlight the clinical, laboratory, regulatory, and HIPAA-compliant informatics infrastructure along with our stakeholder engagement, consent, recontact, and participant engagement strategies. We characterize aspects of genetic and geographic diversity unique to the Rocky Mountain region, the primary catchment area for CCPM Biobank participants. We leverage linked health and demographic information of the CCPM Biobank participant population to demonstrate the utility of the CCPM Biobank to replicate complex trait associations in the first 33,674 genotyped individuals across multiple disease domains. Finally, we describe our current efforts toward return of clinical genetic test results, including high-impact pathogenic variants and pharmacogenetic information, and our broader goals as the CCPM Biobank continues to grow. Bringing clinical and research interests together fosters unique clinical and translational questions that can be addressed from the large EHR-linked CCPM Biobank resource within a HIPAA- and CLIA-certified environment.

SMASH: Scalable Method for Analyzing Spatial Heterogeneity of genes in spatial transcriptomics data.

In high-throughput spatial transcriptomics (ST) studies, it is of great interest to identify the genes whose level of expression in a tissue covaries with the spatial location of cells/spots. Such genes, also known as spatially variable genes (SVGs), can be crucial to the biological understanding of both structural and functional characteristics of complex tissues. Existing methods for detecting SVGs either suffer from huge computational demand or significantly lack statistical power. We propose a non-parametric method termed SMASH that achieves a balance between the above two problems. We compare SMASH with other existing methods in varying simulation scenarios demonstrating its superior statistical power and robustness. We apply the method to four ST datasets from different platforms uncovering interesting biological insights.

SpaceANOVA: Spatial Co-occurrence Analysis of Cell Types in Multiplex Imaging Data Using Point Process and Functional ANOVA.

Multiplex imaging platforms have enabled the identification of the spatial organization of different types of cells in complex tissue or the tumor microenvironment. Exploring the potential variations in the spatial co-occurrence or colocalization of different cell types across distinct tissue or disease classes can provide significant pathological insights, paving the way for intervention strategies. However, the existing methods in this context either rely on stringent statistical assumptions or suffer from a lack of generalizability. We present a highly powerful method to study differential spatial co-occurrence of cell types across multiple tissue or disease groups, based on the theories of the Poisson point process and functional analysis of variance. Notably, the method accommodates multiple images per subject and addresses the problem of missing tissue regions, commonly encountered due to data-collection complexities. We demonstrate the superior statistical power and robustness of the method in comparison with existing approaches through realistic simulation studies. Furthermore, we apply the method to three real data sets on different diseases collected using different imaging platforms. In particular, one of these data sets reveals novel insights into the spatial characteristics of various types of colorectal adenoma.

FunSpace: A functional and spatial analytic approach to cell imaging data using entropy measures.

Spatial heterogeneity in the tumor microenvironment (TME) plays a critical role in gaining insights into tumor development and progression. Conventional metrics typically capture the spatial differential between TME cellular patterns by either exploring the cell distributions in a pairwise fashion or aggregating the heterogeneity across multiple cell distributions without considering the spatial contribution. As such, none of the existing approaches has fully accounted for the simultaneous heterogeneity caused by both cellular diversity and spatial configurations of multiple cell categories. In this article, we propose an approach to leverage spatial entropy measures at multiple distance ranges to account for the spatial heterogeneity across different cellular organizations. Functional principal component analysis (FPCA) is applied to estimate FPC scores which are then served as predictors in a Cox regression model to investigate the impact of spatial heterogeneity in the TME on survival outcome, potentially adjusting for other confounders. Using a non-small cell lung cancer dataset (n = 153) as a case study, we found that the spatial heterogeneity in the TME cellular composition of CD14+ cells, CD19+ B cells, CD4+ and CD8+ T cells, and CK+ tumor cells, had a significant non-zero effect on the overall survival (p = 0.027). Furthermore, using a publicly available multiplexed ion beam imaging (MIBI) triple-negative breast cancer dataset (n = 33), our proposed method identified a significant impact of cellular interactions between tumor and immune cells on the overall survival (p = 0.046). In simulation studies under different spatial configurations, the proposed method demonstrated a high predictive power by accounting for both clinical effect and the impact of spatial heterogeneity.

A platform-independent framework for phenotyping of multiplex tissue imaging data.

Multiplex imaging is a powerful tool to analyze the structural and functional states of cells in their morphological and pathological contexts. However, hypothesis testing with multiplex imaging data is a challenging task due to the extent and complexity of the information obtained. Various computational pipelines have been developed and validated to extract knowledge from specific imaging platforms. A common problem with customized pipelines is their reduced applicability across different imaging platforms: Every multiplex imaging technique exhibits platform-specific characteristics in terms of signal-to-noise ratio and acquisition artifacts that need to be accounted for to yield reliable and reproducible results. We propose a pixel classifier-based image preprocessing step that aims to minimize platform-dependency for all multiplex image analysis pipelines. Signal detection and noise reduction as well as artifact removal can be posed as a pixel classification problem in which all pixels in multiplex images can be assigned to two general classes of either I) signal of interest or II) artifacts and noise. The resulting feature representation maps contain pixel-scale representations of the input data, but exhibit significantly increased signal-to-noise ratios with normalized pixel values as output data. We demonstrate the validity of our proposed image preprocessing approach by comparing the results of two well-accepted and widely-used image analysis pipelines.

Model-agnostic explanations for survival prediction models.

Advanced machine learning methods capable of capturing complex and nonlinear relationships can be used in biomedical research to accurately predict time-to-event outcomes. However, these methods have been criticized as "black boxes" that are not interpretable and thus are difficult to trust in making important clinical decisions. Explainable machine learning proposes the use of model-agnostic explainers that can be applied to predictions from any complex model. These explainers describe how a patient's characteristics are contributing to their prediction, and thus provide insight into how the model is arriving at that prediction. The specific application of these explainers to survival prediction models can be used to obtain explanations for (i) survival predictions at particular follow-up times, and (ii) a patient's overall predicted survival curve. Here, we present a model-agnostic approach for obtaining these explanations from any survival prediction model. We extend the local interpretable model-agnostic explainer framework for classification outcomes to survival prediction models. Using simulated data, we assess the performance of the proposed approaches under various settings. We illustrate application of the new methodology using prostate cancer data.

Electrochemical and photochemical reaction of isatins: a decade update.

This review presents the latest progress in photochemical and electrochemical reactions involving isatins. Isatin and its functionalized scaffolds e.g., oxindoles, spirooxindoles, and quinolines are privileged heterocycles as they are largely present in several agrochemical, natural products, and pharmaceuticals. Thus, the functionalization of isatins using sustainable approaches, i.e., electro- and photochemical methods is of recent research interest worldwide. In this review, we have discussed most of the important reactions of isatins based on types of bond formation involved under electro- and photochemical conditions over the last decade. The reaction mechanism for each reaction has been discussed in detail to offer an inclusive guide to readers. Lastly, a summary of current challenges and the future outlook toward the development of effective electrochemical and photochemical methods for the reaction of isatins is also presented.

TreeKernel: interpretable kernel machine tests for interactions between -omics and clinical predictors with applications to metabolomics and COPD phenotypes.

BACKGROUND: In this paper, we are interested in interactions between a high-dimensional -omics dataset and clinical covariates. The goal is to evaluate the relationship between a phenotype of interest and a high-dimensional omics pathway, where the effect of the omics data depends on subjects' clinical covariates (age, sex, smoking status, etc.). For instance, metabolic pathways can vary greatly between sexes which may also change the relationship between certain metabolic pathways and a clinical phenotype of interest. We propose partitioning the clinical covariate space and performing a kernel association test within those partitions. To illustrate this idea, we focus on hierarchical partitions of the clinical covariate space and kernel tests on metabolic pathways. RESULTS: We see that our proposed method outperforms competing methods in most simulation scenarios. It can identify different relationships among clinical groups with higher power in most scenarios while maintaining a proper Type I error rate. The simulation studies also show a robustness to the grouping structure within the clinical space. We also apply the method to the COPDGene study and find several clinically meaningful interactions between metabolic pathways, the clinical space, and lung function. CONCLUSION: TreeKernel provides a simple and interpretable process for testing for relationships between high-dimensional omics data and clinical outcomes in the presence of interactions within clinical cohorts. The method is broadly applicable to many studies.

Dysregulated Lymphocyte Antigen Receptor Signaling in Common Variable Immunodeficiency with Granulomatous Lymphocytic Interstitial Lung Disease.

PURPOSE: A subset of common variable immunodeficiency (CVID) patients either presents with or develops autoimmune and lymphoproliferative complications, such as granulomatous lymphocytic interstitial lung disease (GLILD), a major cause of morbidity and mortality in CVID. While a myriad of phenotypic lymphocyte derangements has been associated with and described in GLILD, defects in T and B cell antigen receptor (TCR/BCR) signaling in CVID and CVID with GLILD (CVID/GLILD) remain undefined, hindering discovery of biomarkers for disease monitoring, prognostic prediction, and personalized medicine approaches. METHODS: To identify perturbations of immune cell subsets and TCR/BCR signal transduction, we applied mass cytometry analysis to peripheral blood mononuclear cells (PBMCs) from healthy control participants (HC), CVID, and CVID/GLILD patients. RESULTS: Patients with CVID, regardless of GLILD status, had increased frequency of HLADR+CD4+ T cells, CD57+CD8+ T cells, and CD21lo B cells when compared to healthy controls. Within these cellular populations in CVID/GLILD patients only, engagement of T or B cell antigen receptors resulted in discordant downstream signaling responses compared to CVID. In CVID/GLILD patients, CD21lo B cells showed perturbed BCR-mediated phospholipase C gamma and extracellular signal-regulated kinase activation, while HLADR+CD4+ T cells and CD57+CD8+ T cells displayed disrupted TCR-mediated activation of kinases most proximal to the receptor. CONCLUSION: Both CVID and CVID/GLILD patients demonstrate an activated T and B cell phenotype compared to HC. However, only CVID/GLILD patients exhibit altered TCR/BCR signaling in the activated lymphocyte subsets. These findings contribute to our understanding of the mechanisms of immune dysregulation in CVID with GLILD.

Retinoic acid signaling within pancreatic endocrine progenitors regulates mouse and human ß cell specification.

Retinoic acid (RA) signaling is essential for multiple developmental processes, including appropriate pancreas formation from the foregut endoderm. RA is also required to generate pancreatic progenitors from human pluripotent stem cells. However, the role of RA signaling during endocrine specification has not been fully explored. In this study, we demonstrate that the disruption of RA signaling within the NEUROG3-expressing endocrine progenitor population impairs mouse ß cell differentiation and induces ectopic expression of crucial δ cell genes, including somatostatin. In addition, the inhibition of the RA pathway in hESC-derived pancreatic progenitors downstream of NEUROG3 induction impairs insulin expression. We further determine that RA-mediated regulation of endocrine cell differentiation occurs through Wnt pathway components. Together, these data demonstrate the importance of RA signaling in endocrine specification and identify conserved mechanisms by which RA signaling directs pancreatic endocrine cell fate.

MIAMI: mutual information-based analysis of multiplex imaging data.

MOTIVATION: Studying the interaction or co-expression of the proteins or markers in the tumor microenvironment of cancer subjects can be crucial in the assessment of risks, such as death or recurrence. In the conventional approach, the cells need to be declared positive or negative for a marker based on its intensity. For multiple markers, manual thresholds are required for all the markers, which can become cumbersome. The performance of the subsequent analysis relies heavily on this step and thus suffers from subjectivity and lacks robustness. RESULTS: We present a new method where different marker intensities are viewed as dependent random variables, and the mutual information (MI) between them is considered to be a metric of co-expression. Estimation of the joint density, as required in the traditional form of MI, becomes increasingly challenging as the number of markers increases. We consider an alternative formulation of MI which is conceptually similar but has an efficient estimation technique for which we develop a new generalization. With the proposed method, we analyzed a lung cancer dataset finding the co-expression of the markers, HLA-DR and CK to be associated with survival. We also analyzed a triple negative breast cancer dataset finding the co-expression of the immuno-regulatory proteins, PD1, PD-L1, Lag3 and IDO, to be associated with disease recurrence. We demonstrated the robustness of our method through different simulation studies. AVAILABILITY AND IMPLEMENTATION: The associated R package can be found here, https://github.com/sealx017/MIAMI. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

SPF: A spatial and functional data analytic approach to cell imaging data.

The tumor microenvironment (TME), which characterizes the tumor and its surroundings, plays a critical role in understanding cancer development and progression. Recent advances in imaging techniques enable researchers to study spatial structure of the TME at a single-cell level. Investigating spatial patterns and interactions of cell subtypes within the TME provides useful insights into how cells with different biological purposes behave, which may consequentially impact a subject's clinical outcomes. We utilize a class of well-known spatial summary statistics, the K-function and its variants, to explore inter-cell dependence as a function of distances between cells. Using techniques from functional data analysis, we introduce an approach to model the association between these summary spatial functions and subject-level outcomes, while controlling for other clinical scalar predictors such as age and disease stage. In particular, we leverage the additive functional Cox regression model (AFCM) to study the nonlinear impact of spatial interaction between tumor and stromal cells on overall survival in patients with non-small cell lung cancer, using multiplex immunohistochemistry (mIHC) data. The applicability of our approach is further validated using a publicly available multiplexed ion beam imaging (MIBI) triple-negative breast cancer dataset.

DNA Methylation Near DLGAP2 May Mediate the Relationship between Family History of Type 1 Diabetes and Type 1 Diabetes Risk.

Given the differential risk of type 1 diabetes (T1D) in offspring of affected fathers versus affected mothers and our observation that T1D cases have differential DNA methylation near the imprinted DLGAP2 gene compared to controls, we examined whether methylation near DLGAP2 mediates the association between T1D family history and T1D risk. In a nested case-control study of 87 T1D cases and 87 controls from the Diabetes Autoimmunity Study in the Young, we conducted causal mediation analyses at 12 DLGAP2 region CpGs to decompose the effect of family history on T1D risk into indirect and direct effects. These effects were estimated from two regression models adjusted for the human leukocyte antigen DR3/4 genotype: a linear regression of family history on methylation (mediator model) and a logistic regression of family history and methylation on T1D (outcome model). For 8 of the 12 CpGs, we identified a significant interaction between T1D family history and methylation on T1D risk. Accounting for this interaction, we found that the increased risk of T1D for children with affected mothers compared to those with no family history was mediated through differences in methylation at two CpGs (cg27351978, cg00565786) in the DLGAP2 region, as demonstrated by a significant pure natural indirect effect (odds ratio (OR) = 1.98, 95% confidence interval (CI): 1.06-3.71) and nonsignificant total natural direct effect (OR = 1.65, 95% CI: 0.16-16.62) (for cg00565786). In contrast, the increased risk of T1D for children with an affected father or sibling was not explained by DNA methylation changes at these CpGs. Results were similar for cg27351978 and robust in sensitivity analyses. Lastly, we found that DNA methylation in the DLGAP2 region was associated (P<0:05) with gene expression of nearby protein-coding genes DLGAP2, ARHGEF10, ZNF596, and ERICH1. Results indicate that the maternal protective effect conferred through exposure to T1D in utero may operate through changes to DNA methylation that have functional downstream consequences.

Cell-Mediated Immune Responses After Administration of the Live or the Recombinant Zoster Vaccine: 5-Year Persistence.

We compared glycoprotein E (gE)- and varicella zoster virus (VZV)-specific Th1 immunity in 160 adults, aged 50-85 years, randomized to receive live or recombinant zoster vaccine (RZV). gE-specific responses measured by interferon-γ (IFN-γ) and interleukin 2 (IL-2) dual-color Fluorospot were significantly higher at all time points postimmunization in RZV recipients. VZV-specific IL-2+ memory, but not IFN-γ+ or IFN-γ+IL-2+ effector responses, were higher in RZV recipients at ≥3 months postimmunization. Only RZV recipients maintained higher postvaccination gE-specific IL-2+ and IFN-γ+ and VZV-specific IL-2+ responses for 5 years. The 5-year persistence of VZV-specific memory and gE-specific Th1 immunity may underlie superior RZV efficacy. Clinical Trials Registration NCT02114333.

Mechanism-aware imputation: a two-step approach in handling missing values in metabolomics.

When analyzing large datasets from high-throughput technologies, researchers often encounter missing quantitative measurements, which are particularly frequent in metabolomics datasets. Metabolomics, the comprehensive profiling of metabolite abundances, are typically measured using mass spectrometry technologies that often introduce missingness via multiple mechanisms: (1) the metabolite signal may be smaller than the instrument limit of detection; (2) the conditions under which the data are collected and processed may lead to missing values; (3) missing values can be introduced randomly. Missingness resulting from mechanism (1) would be classified as Missing Not At Random (MNAR), that from mechanism (2) would be Missing At Random (MAR), and that from mechanism (3) would be classified as Missing Completely At Random (MCAR). Two common approaches for handling missing data are the following: (1) omit missing data from the analysis; (2) impute the missing values. Both approaches may introduce bias and reduce statistical power in downstream analyses such as testing metabolite associations with clinical variables. Further, standard imputation methods in metabolomics often ignore the mechanisms causing missingness and inaccurately estimate missing values within a data set. We propose a mechanism-aware imputation algorithm that leverages a two-step approach in imputing missing values. First, we use a random forest classifier to classify the missing mechanism for each missing value in the data set. Second, we impute each missing value using imputation algorithms that are specific to the predicted missingness mechanism (i.e., MAR/MCAR or MNAR). Using complete data, we conducted simulations, where we imposed different missingness patterns within the data and tested the performance of combinations of imputation algorithms. Our proposed algorithm provided imputations closer to the original data than those using only one imputation algorithm for all the missing values. Consequently, our two-step approach was able to reduce bias for improved downstream analyses.

Profiling Parkinson's disease cognitive phenotypes via resting-state magnetoencephalography.

Aberrant brain oscillations are a hallmark of Parkinson's disease (PD) pathophysiology and may be related to both motor and nonmotor symptoms. Mild cognitive impairment (MCI) affects many people with PD even at the time of diagnosis and conversion risks to PD dementia (PDD) are very high. Unfortunately, pharmacotherapies are not addressing cognitive symptoms in PD. Profiling PD cognitive phenotypes (e.g., MCI, PDD, etc.) may therefore help inform future treatments. Neurophysiological methods, such as magnetoencephalography (MEG), offer the advantage of observing oscillatory patterns, whose regional and temporal profiles may elucidate how cognitive changes relate to neural mechanisms. We conducted a resting-state MEG cross-sectional study of 89 persons with PD stratified into three phenotypic groups: normal cognition, MCI, and PDD, to identify brain regions and frequencies most associated with each cognitive profile. In addition, a neuropsychological battery was administered to assess each domain of cognition. Our data showed higher power in lower frequency bands (delta and theta) observed along with more severe cognitive impairment and associated with memory, language, attention, and global cognition. Of the total 119 brain parcels assessed during source analysis, widespread group differences were found in the beta band, with significant changes mostly occurring between the normal cognition and MCI groups. Moreover, bilateral frontal and left-hemispheric regions were particularly affected in the other frequencies as cognitive decline becomes more pronounced. Our results suggest that MCI and PDD may be qualitatively distinct cognitive phenotypes, and most dramatic changes seem to have happened when the PD brain shows mild cognitive decline.NEW & NOTEWORTHY Can we better stage cognitive decline in patients with Parkinson's disease (PD)? Here, we provide evidence that mild cognitive impairment, rather than being simply a milder form of dementia, may be a qualitatively distinct phase in its development. We suggest that the most dramatic neurophysiological changes may occur during the time the PD brain transitions from normal cognition to MCI, then compensatory changes further occur as the brain "switches" to a dementia state.

Heterogeneous treatment effects of intensive glycemic control on major adverse cardiovascular events in the ACCORD and VADT trials: a machine-learning analysis.

BACKGROUND: Evidence to guide type 2 diabetes treatment individualization is limited. We evaluated heterogeneous treatment effects (HTE) of intensive glycemic control in type 2 diabetes patients on major adverse cardiovascular events (MACE) in the Action to Control Cardiovascular Risk in Diabetes Study (ACCORD) and the Veterans Affairs Diabetes Trial (VADT). METHODS: Causal forests machine learning analysis was performed using pooled individual data from two randomized trials (n = 12,042) to identify HTE of intensive versus standard glycemic control on MACE in patients with type 2 diabetes. We used variable prioritization from causal forests to build a summary decision tree and examined the risk difference of MACE between treatment arms in the resulting subgroups. RESULTS: A summary decision tree used five variables (hemoglobin glycation index, estimated glomerular filtration rate, fasting glucose, age, and body mass index) to define eight subgroups in which risk differences of MACE ranged from - 5.1% (95% CI - 8.7, - 1.5) to 3.1% (95% CI 0.2, 6.0) (negative values represent lower MACE associated with intensive glycemic control). Intensive glycemic control was associated with lower MACE in pooled study data in subgroups with low (- 4.2% [95% CI - 8.1, - 1.0]), intermediate (- 5.1% [95% CI - 8.7, - 1.5]), and high (- 4.3% [95% CI - 7.7, - 1.0]) MACE rates with consistent directions of effect in ACCORD and VADT alone. CONCLUSIONS: This data-driven analysis provides evidence supporting the diabetes treatment guideline recommendation of intensive glucose lowering in diabetes patients with low cardiovascular risk and additionally suggests potential benefits of intensive glycemic control in some individuals at higher cardiovascular risk.

Synthesis of Unsymmetrical Biheteroarenes via Dehydrogenative and Decarboxylative Coupling: a Decade Update.

The design and development of robust and efficient methods for installing one heterocycle with another is endowed as a ubiquitous and powerful synthetic strategy to access complex organic biheterocycles in recent days due to their pervasive applications in medicinal as well as material chemistry. This perspective presents an overview on the recent findings and developments for the synthesis of unsymmetrical biheteroarenes via dehydrogenative and decarboxylative couplings with literature coverage mainly extending from 2011 to 2021. For simplification of the readers, the article has been subcategorized based on the catalysts used in the reactions.

PaIRKAT: A pathway integrated regression-based kernel association test with applications to metabolomics and COPD phenotypes.

High-throughput data such as metabolomics, genomics, transcriptomics, and proteomics have become familiar data types within the "-omics" family. For this work, we focus on subsets that interact with one another and represent these "pathways" as graphs. Observed pathways often have disjoint components, i.e., nodes or sets of nodes (metabolites, etc.) not connected to any other within the pathway, which notably lessens testing power. In this paper we propose the Pathway Integrated Regression-based Kernel Association Test (PaIRKAT), a new kernel machine regression method for incorporating known pathway information into the semi-parametric kernel regression framework. This work extends previous kernel machine approaches. This paper also contributes an application of a graph kernel regularization method for overcoming disconnected pathways. By incorporating a regularized or "smoothed" graph into a score test, PaIRKAT can provide more powerful tests for associations between biological pathways and phenotypes of interest and will be helpful in identifying novel pathways for targeted clinical research. We evaluate this method through several simulation studies and an application to real metabolomics data from the COPDGene study. Our simulation studies illustrate the robustness of this method to incorrect and incomplete pathway knowledge, and the real data analysis shows meaningful improvements of testing power in pathways. PaIRKAT was developed for application to metabolomic pathway data, but the techniques are easily generalizable to other data sources with a graph-like structure.

A calibration approach to transportability and data-fusion with observational data.

Two important considerations in clinical research studies are proper evaluations of internal and external validity. While randomized clinical trials can overcome several threats to internal validity, they may be prone to poor external validity. Conversely, large prospective observational studies sampled from a broadly generalizable population may be externally valid, yet susceptible to threats to internal validity, particularly confounding. Thus, methods that address confounding and enhance transportability of study results across populations are essential for internally and externally valid causal inference, respectively. These issues persist for another problem closely related to transportability known as data-fusion. We develop a calibration method to generate balancing weights that address confounding and sampling bias, thereby enabling valid estimation of the target population average treatment effect. We compare the calibration approach to two additional doubly robust methods that estimate the effect of an intervention on an outcome within a second, possibly unrelated target population. The proposed methodologies can be extended to resolve data-fusion problems that seek to evaluate the effects of an intervention using data from two related studies sampled from different populations. A simulation study is conducted to demonstrate the advantages and similarities of the different techniques. We also test the performance of the calibration approach in a motivating real data example comparing whether the effect of biguanides vs sulfonylureas-the two most common oral diabetes medication classes for initial treatment-on all-cause mortality described in a historical cohort applies to a contemporary cohort of US Veterans with diabetes.