A Multi-Faceted Digital Health Solution for Monitoring and Managing Diabetic Foot Ulcer Risk: A Case Series.

INTRODUCTION: Diabetic foot ulcers (DFU) are a devastating complication of diabetes. There are numerous challenges with preventing diabetic foot complications and barriers to achieving the care processes suggested in established foot care guidelines. Multi-faceted digital health solutions, which combine multimodal sensing, patient-facing biofeedback, and remote patient monitoring (RPM), show promise in improving our ability to understand, prevent, and manage DFUs. METHODS: Patients with a history of diabetic plantar foot ulcers were enrolled in a prospective cohort study and equipped with custom sensory insoles to track plantar pressure, plantar temperature, step count, and adherence data. Sensory insole data enabled patient-facing biofeedback to cue active plantar offloading in response to sustained high plantar pressures, and RPM assessments in response to data trends of concern in plantar pressure, plantar temperature, or sensory insole adherence. Three non-consecutive case participants that ultimately presented with pre-ulcerative lesions (a callus and/or erythematous area on the plantar surface of the foot) during the study were selected for this case series. RESULTS: Across three illustrative patients, continuous plantar pressure monitoring demonstrated promise for empowering both the patient and provider with information for data-driven management of pressure offloading treatments. CONCLUSION: Multi-faceted digital health solutions can naturally enable and reinforce the integrative foot care guidelines. Multi-modal sensing across multiple physiologic domains supports the monitoring of foot health at various stages along the DFU pathogenesis pathway. Furthermore, digital health solutions equipped with remote patient monitoring unlock new opportunities for personalizing treatments, providing periodic self-care reinforcement, and encouraging patient engagement-key tools for improving patient adherence to their diabetic foot care plan.

Characteristics and outcomes of COVID-19 patients with and without asthma from the United States, South Korea, and Europe.

Objective: Large international comparisons describing the clinical characteristics of patients with COVID-19 are limited. The aim of the study was to perform a large-scale descriptive characterization of COVID-19 patients with asthma.Methods: We included nine databases contributing data from January to June 2020 from the US, South Korea (KR), Spain, UK and the Netherlands. We defined two cohorts of COVID-19 patients ('diagnosed' and 'hospitalized') based on COVID-19 disease codes. We followed patients from COVID-19 index date to 30 days or death. We performed descriptive analysis and reported the frequency of characteristics and outcomes in people with asthma defined by codes and prescriptions.Results: The diagnosed and hospitalized cohorts contained 666,933 and 159,552 COVID-19 patients respectively. Exacerbation in people with asthma was recorded in 1.6-8.6% of patients at presentation. Asthma prevalence ranged from 6.2% (95% CI 5.7-6.8) to 18.5% (95% CI 18.2-18.8) in the diagnosed cohort and 5.2% (95% CI 4.0-6.8) to 20.5% (95% CI 18.6-22.6) in the hospitalized cohort. Asthma patients with COVID-19 had high prevalence of comorbidity including hypertension, heart disease, diabetes and obesity. Mortality ranged from 2.1% (95% CI 1.8-2.4) to 16.9% (95% CI 13.8-20.5) and similar or lower compared to COVID-19 patients without asthma. Acute respiratory distress syndrome occurred in 15-30% of hospitalized COVID-19 asthma patients.Conclusion: The prevalence of asthma among COVID-19 patients varies internationally. Asthma patients with COVID-19 have high comorbidity. The prevalence of asthma exacerbation at presentation was low. Whilst mortality was similar among COVID-19 patients with and without asthma, this could be confounded by differences in clinical characteristics. Further research could help identify high-risk asthma patients.[Box: see text]Supplemental data for this article is available online at https://doi.org/10.1080/02770903.2021.2025392 .

Preventative Sensor-Based Remote Monitoring of the Diabetic Foot in Clinical Practice.

Diabetes and its complications, particularly diabetic foot ulcers (DFUs), pose significant challenges to healthcare systems worldwide. DFUs result in severe consequences such as amputation, increased mortality rates, reduced mobility, and substantial healthcare costs. The majority of DFUs are preventable and treatable through early detection. Sensor-based remote patient monitoring (RPM) has been proposed as a possible solution to overcome limitations, and enhance the effectiveness, of existing foot care best practices. However, there are limited frameworks available on how to approach and act on data collected through sensor-based RPM in DFU prevention. This perspective article offers insights from deploying sensor-based RPM through digital DFU prevention regimens. We summarize the data domains and technical architecture that characterize existing commercially available solutions. We then highlight key elements for effective RPM integration based on these new data domains, including appropriate patient selection and the need for detailed clinical assessments to contextualize sensor data. Guidance on establishing escalation pathways for remotely monitored at-risk patients and the importance of predictive system management is provided. DFU prevention RPM should be integrated into a comprehensive disease management strategy to mitigate foot health concerns, reduce activity-associated risks, and thereby seek to be synergistic with other components of diabetes disease management. This integrated approach has the potential to enhance disease management in diabetes, positively impacting foot health and the healthspan of patients living with diabetes.

COVID-19 in patients with autoimmune diseases: characteristics and outcomes in a multinational network of cohorts across three countries.

OBJECTIVE: Patients with autoimmune diseases were advised to shield to avoid coronavirus disease 2019 (COVID-19), but information on their prognosis is lacking. We characterized 30-day outcomes and mortality after hospitalization with COVID-19 among patients with prevalent autoimmune diseases, and compared outcomes after hospital admissions among similar patients with seasonal influenza. METHODS: A multinational network cohort study was conducted using electronic health records data from Columbia University Irving Medical Center [USA, Optum (USA), Department of Veterans Affairs (USA), Information System for Research in Primary Care-Hospitalization Linked Data (Spain) and claims data from IQVIA Open Claims (USA) and Health Insurance and Review Assessment (South Korea). All patients with prevalent autoimmune diseases, diagnosed and/or hospitalized between January and June 2020 with COVID-19, and similar patients hospitalized with influenza in 2017-18 were included. Outcomes were death and complications within 30 days of hospitalization. RESULTS: We studied 133 589 patients diagnosed and 48 418 hospitalized with COVID-19 with prevalent autoimmune diseases. Most patients were female, aged ≥50 years with previous comorbidities. The prevalence of hypertension (45.5-93.2%), chronic kidney disease (14.0-52.7%) and heart disease (29.0-83.8%) was higher in hospitalized vs diagnosed patients with COVID-19. Compared with 70 660 hospitalized with influenza, those admitted with COVID-19 had more respiratory complications including pneumonia and acute respiratory distress syndrome, and higher 30-day mortality (2.2-4.3% vs 6.32-24.6%). CONCLUSION: Compared with influenza, COVID-19 is a more severe disease, leading to more complications and higher mortality.

Description of a Multi-faceted COVID-19 Pandemic Physician Workforce Plan at a Multi-site Academic Health System.

BACKGROUND: The evolving COVID-19 pandemic has and continues to present a threat to health system capacity. Rapidly expanding an existing acute care physician workforce is critical to pandemic response planning in large urban academic health systems. INTERVENTION: The Medical Emergency-Pandemic Operations Command (MEOC)-a multi-specialty team of physicians, operational leaders, and support staff within an academic Department of Medicine in Calgary, Canada-partnered with its provincial health system to rapidly develop a comprehensive, scalable pandemic physician workforce plan for non-ventilated inpatients with COVID-19 across multiple hospitals. The MEOC Pandemic Plan comprised seven components, each with unique structure and processes. METHODS: In this manuscript, we describe MEOC's Pandemic Plan that was designed and implemented from March to May 2020 and re-escalated in October 2020. We report on the plan's structure and process, early implementation outcomes, and unforeseen challenges. Data sources included MEOC documents, health system, public health, and physician engagement implementation data. KEY RESULTS: From March 5 to October 26, 2020, 427 patients were admitted to COVID-19 units in Calgary hospitals. In the initial implementation period (March-May 2020), MEOC communications reached over 2500 physicians, leading to 1446 physicians volunteering to provide care on COVID-19 units. Of these, 234 physicians signed up for hospital shifts, and 227 physicians received in-person personal protective equipment simulation training. Ninety-three physicians were deployed on COVID-19 units at four large acute care hospitals. The resurgence of cases in September 2020 has prompted re-escalation including re-activation of COVID-19 units. CONCLUSIONS: MEOC leveraged an academic health system partnership to rapidly design, implement, and refine a comprehensive, scalable COVID-19 acute care physician workforce plan whose components are readily applicable across jurisdictions or healthcare crises. This description may guide other institutions responding to COVID-19 and future health emergencies.

Feasibility and evaluation of a large-scale external validation approach for patient-level prediction in an international data network: validation of models predicting stroke in female patients newly diagnosed with atrial fibrillation.

BACKGROUND: To demonstrate how the Observational Healthcare Data Science and Informatics (OHDSI) collaborative network and standardization can be utilized to scale-up external validation of patient-level prediction models by enabling validation across a large number of heterogeneous observational healthcare datasets. METHODS: Five previously published prognostic models (ATRIA, CHADS2, CHADS2VASC, Q-Stroke and Framingham) that predict future risk of stroke in patients with atrial fibrillation were replicated using the OHDSI frameworks. A network study was run that enabled the five models to be externally validated across nine observational healthcare datasets spanning three countries and five independent sites. RESULTS: The five existing models were able to be integrated into the OHDSI framework for patient-level prediction and they obtained mean c-statistics ranging between 0.57-0.63 across the 6 databases with sufficient data to predict stroke within 1 year of initial atrial fibrillation diagnosis for females with atrial fibrillation. This was comparable with existing validation studies. The validation network study was run across nine datasets within 60 days once the models were replicated. An R package for the study was published at https://github.com/OHDSI/StudyProtocolSandbox/tree/master/ExistingStrokeRiskExternalValidation. CONCLUSION: This study demonstrates the ability to scale up external validation of patient-level prediction models using a collaboration of researchers and a data standardization that enable models to be readily shared across data sites. External validation is necessary to understand the transportability or reproducibility of a prediction model, but without collaborative approaches it can take three or more years for a model to be validated by one independent researcher. In this paper we show it is possible to both scale-up and speed-up external validation by showing how validation can be done across multiple databases in less than 2 months. We recommend that researchers developing new prediction models use the OHDSI network to externally validate their models.

Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury.

BACKGROUND: Acute kidney injury (AKI) is common in hospitalized patients and is associated with poor patient outcomes and high costs of care. The implementation of clinical decision support tools within electronic medical record (EMR) could improve AKI care and outcomes. While clinical decision support tools have the potential to enhance recognition and management of AKI, there is limited description in the literature of how these tools were developed and whether they meet end-user expectations. METHODS: We developed and evaluated the content, acceptability, and usability of electronic clinical decision support tools for AKI care. Multi-component tools were developed within a hospital EMR (Sunrise Clinical Manager™, Allscripts Healthcare Solutions Inc.) currently deployed in Calgary, Alberta, and included: AKI stage alerts, AKI adverse medication warnings, AKI clinical summary dashboard, and an AKI order set. The clinical decision support was developed for use by multiple healthcare providers at the time and point of care on general medical and surgical units. Functional and usability testing for the alerts and clinical summary dashboard was conducted via in-person evaluation sessions, interviews, and surveys of care providers. Formal user acceptance testing with clinical end-users, including physicians and nursing staff, was conducted to evaluate the AKI order set. RESULTS: Considerations for appropriate deployment of both non-disruptive and interruptive functions was important to gain acceptability by clinicians. Functional testing and usability surveys for the alerts and clinical summary dashboard indicated that the tools were operating as desired and 74% (17/23) of surveyed healthcare providers reported that these tools were easy to use and could be learned quickly. Over three-quarters of providers (18/23) reported that they would utilize the tools in their practice. Three-quarters of the participants (13/17) in user acceptance testing agreed that recommendations within the order set were useful. Overall, 88% (15/17) believed that the order set would improve the care and management of AKI patients. CONCLUSIONS: Development and testing of EMR-based decision support tools for AKI with clinicians led to high acceptance by clinical end-users. Subsequent implementation within clinical environments will require end-user education and engagement in system-level initiatives to use the tools to improve care.

Exploration of association rule mining for coding consistency and completeness assessment in inpatient administrative health data.

OBJECTIVE: Data quality assessment is a challenging facet for research using coded administrative health data. Current assessment approaches are time and resource intensive. We explored whether association rule mining (ARM) can be used to develop rules for assessing data quality. MATERIALS AND METHODS: We extracted 2013 and 2014 records from the hospital discharge abstract database (DAD) for patients between the ages of 55 and 65 from five acute care hospitals in Alberta, Canada. The ARM was conducted using the 2013 DAD to extract rules with support ≥0.0019 and confidence ≥0.5 using the bootstrap technique, and tested in the 2014 DAD. The rules were compared against the method of coding frequency and assessed for their ability to detect error introduced by two kinds of data manipulation: random permutation and random deletion. RESULTS: The association rules generally had clear clinical meanings. Comparing 2014 data to 2013 data (both original), there were 3 rules with a confidence difference >0.1, while coding frequency difference of codes in the right hand of rules was less than 0.004. After random permutation of 50% of codes in the 2014 data, average rule confidence dropped from 0.72 to 0.27 while coding frequency remained unchanged. Rule confidence decreased with the increase of coding deletion, as expected. Rule confidence was more sensitive to code deletion compared to coding frequency, with slope of change ranging from 1.7 to 184.9 with a median of 9.1. CONCLUSION: The ARM is a promising technique to assess data quality. It offers a systematic way to derive coding association rules hidden in data, and potentially provides a sensitive and efficient method of assessing data quality compared to standard methods.

Think global, act local: medical students contextualize global health education.

BACKGROUND: There is considerable heterogeneity in the extent to which global health education is emphasized in undergraduate medical curricula. Here, we performed an exploratory analysis to test the hypothesis that exposure to global health education may influence the attitudes of medical students toward the treatment of local vulnerable patient populations. METHODS: All pre-clerkship students at an urban Canadian university were invited to attend a voluntary global health education session on challenges in treating human immunodeficiency virus (HIV) in the developing world. Those who attended as well as those who did not completed pre- and post-session surveys measuring willingness to treat patients with HIV and related attitudes. A repeated measure analysis of variance (ANOVA) was performed to assess the effect of the intervention on attitudes toward locally affected populations. RESULTS: A total of 201 (81.4%) and 143 (58.3%) students completed the pre- and post-session surveys, respectively. Students who scored their willingness to treat patients with HIV within highest 10% of the scale on the pre-session survey were excluded from the analysis to account for a ceiling effect. On repeated measure ANOVA, willingness to treat local patients with HIV increased significantly following the session (P < 0.01). Students intending to attend the session also reported a greater propensity to treat patients with HIV than those who did not (P = 0.03). DISCUSSION: In this exploratory study, we find that following exposure to a global health lecture on the challenges of HIV in the developing world, students possessed more favorable attitudes toward the treatment of marginalized local patient populations, a finding that may be exploited in undergraduate and continuing medical education.

Stepped-Wedge Trial of Decision Support for Acute Kidney Injury on Surgical Units.

Introduction: Acute kidney injury (AKI) is common in the perioperative setting and associated with poor outcomes. Whether clinical decision support improves early management and outcomes of AKI on surgical units is uncertain. Methods: In this cluster-randomized, stepped-wedge trial, 8 surgical units in Alberta, Canada were randomized to various start dates to receive an education and clinical decision support intervention for recognition and early management of AKI. Eligible patients were aged ≥18 years, receiving care on a surgical unit, not already receiving dialysis, and with AKI. Results: There were 2135 admissions of 2038 patients who met the inclusion criteria; mean (SD) age was 64.3 (16.2) years, and 885 (41.4%) were females. The proportion of patients who experienced the composite primary outcome of progression of AKI to a higher stage, receipt of dialysis, or death was 16.0% (178 events/1113 admissions) in the intervention group; and 17.5% (179 events/1022 admissions) in the control group (time-adjusted odds ratio, 0.76; 95% confidence interval [CI], 0.53-1.08; P = 0.12). There were no significant differences between groups in process of care outcomes within 48 hours of AKI onset, including administration of i.v. fluids, or withdrawal of medications affecting kidney function. Both groups experienced similar lengths of stay in hospital after AKI and change in estimated glomerular filtration rate (eGFR) at 3 months. Conclusion: An education and clinical decision support intervention did not significantly improve processes of care or reduce progression of AKI, length of hospital stays, or recovery of kidney function in patients with AKI on surgical units.

Similar Risk of Kidney Failure among Patients with Blinding Diseases Who Receive Ranibizumab, Aflibercept, and Bevacizumab: An Observational Health Data Sciences and Informatics Network Study.

PURPOSE: To characterize the incidence of kidney failure associated with intravitreal anti-VEGF exposure; and compare the risk of kidney failure in patients treated with ranibizumab, aflibercept, or bevacizumab. DESIGN: Retrospective cohort study across 12 databases in the Observational Health Data Sciences and Informatics (OHDSI) network. SUBJECTS: Subjects aged ≥ 18 years with ≥ 3 monthly intravitreal anti-VEGF medications for a blinding disease (diabetic retinopathy, diabetic macular edema, exudative age-related macular degeneration, or retinal vein occlusion). METHODS: The standardized incidence proportions and rates of kidney failure while on treatment with anti-VEGF were calculated. For each comparison (e.g., aflibercept versus ranibizumab), patients from each group were matched 1:1 using propensity scores. Cox proportional hazards models were used to estimate the risk of kidney failure while on treatment. A random effects meta-analysis was performed to combine each database's hazard ratio (HR) estimate into a single network-wide estimate. MAIN OUTCOME MEASURES: Incidence of kidney failure while on anti-VEGF treatment, and time from cohort entry to kidney failure. RESULTS: Of the 6.1 million patients with blinding diseases, 37 189 who received ranibizumab, 39 447 aflibercept, and 163 611 bevacizumab were included; the total treatment exposure time was 161 724 person-years. The average standardized incidence proportion of kidney failure was 678 per 100 000 persons (range, 0-2389), and incidence rate 742 per 100 000 person-years (range, 0-2661). The meta-analysis HR of kidney failure comparing aflibercept with ranibizumab was 1.01 (95% confidence interval [CI], 0.70-1.47; P = 0.45), ranibizumab with bevacizumab 0.95 (95% CI, 0.68-1.32; P = 0.62), and aflibercept with bevacizumab 0.95 (95% CI, 0.65-1.39; P = 0.60). CONCLUSIONS: There was no substantially different relative risk of kidney failure between those who received ranibizumab, bevacizumab, or aflibercept. Practicing ophthalmologists and nephrologists should be aware of the risk of kidney failure among patients receiving intravitreal anti-VEGF medications and that there is little empirical evidence to preferentially choose among the specific intravitreal anti-VEGF agents. FINANCIAL DISCLOSURES: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Comparative Effectiveness of Second-line Antihyperglycemic Agents for Cardiovascular Outcomes: A Large-scale, Multinational, Federated Analysis of the LEGEND-T2DM Study.

Background: SGLT2 inhibitors (SGLT2is) and GLP-1 receptor agonists (GLP1-RAs) reduce major adverse cardiovascular events (MACE) in patients with type 2 diabetes mellitus (T2DM). However, their effectiveness relative to each other and other second-line antihyperglycemic agents is unknown, without any major ongoing head-to-head trials. Methods: Across the LEGEND-T2DM network, we included ten federated international data sources, spanning 1992-2021. We identified 1,492,855 patients with T2DM and established cardiovascular disease (CVD) on metformin monotherapy who initiated one of four second-line agents (SGLT2is, GLP1-RAs, dipeptidyl peptidase 4 inhibitor [DPP4is], sulfonylureas [SUs]). We used large-scale propensity score models to conduct an active comparator, target trial emulation for pairwise comparisons. After evaluating empirical equipoise and population generalizability, we fit on-treatment Cox proportional hazard models for 3-point MACE (myocardial infarction, stroke, death) and 4-point MACE (3-point MACE + heart failure hospitalization) risk, and combined hazard ratio (HR) estimates in a random-effects meta-analysis. Findings: Across cohorts, 16·4%, 8·3%, 27·7%, and 47·6% of individuals with T2DM initiated SGLT2is, GLP1-RAs, DPP4is, and SUs, respectively. Over 5·2 million patient-years of follow-up and 489 million patient-days of time at-risk, there were 25,982 3-point MACE and 41,447 4-point MACE events. SGLT2is and GLP1-RAs were associated with a lower risk for 3-point MACE compared with DPP4is (HR 0·89 [95% CI, 0·79-1·00] and 0·83 [0·70-0·98]), and SUs (HR 0·76 [0·65-0·89] and 0·71 [0·59-0·86]). DPP4is were associated with a lower 3-point MACE risk versus SUs (HR 0·87 [0·79-0·95]). The pattern was consistent for 4-point MACE for the comparisons above. There were no significant differences between SGLT2is and GLP1-RAs for 3-point or 4-point MACE (HR 1·06 [0·96-1·17] and 1·05 [0·97-1·13]). Interpretation: In patients with T2DM and established CVD, we found comparable cardiovascular risk reduction with SGLT2is and GLP1-RAs, with both agents more effective than DPP4is, which in turn were more effective than SUs. These findings suggest that the use of GLP1-RAs and SGLT2is should be prioritized as second-line agents in those with established CVD. Funding: National Institutes of Health, United States Department of Veterans Affairs.

Comparative Effectiveness of Second-Line Antihyperglycemic Agents for Cardiovascular Outcomes: A Multinational, Federated Analysis of LEGEND-T2DM.

BACKGROUND: Sodium-glucose cotransporter 2 inhibitors (SGLT2is) and glucagon-like peptide-1 receptor agonists (GLP-1 RAs) reduce the risk of major adverse cardiovascular events (MACE) in patients with type 2 diabetes mellitus (T2DM). However, their effectiveness relative to each other and other second-line antihyperglycemic agents is unknown, without any major ongoing head-to-head clinical trials. OBJECTIVES: The aim of this study was to compare the cardiovascular effectiveness of SGLT2is, GLP-1 RAs, dipeptidyl peptidase-4 inhibitors (DPP4is), and clinical sulfonylureas (SUs) as second-line antihyperglycemic agents in T2DM. METHODS: Across the LEGEND-T2DM (Large-Scale Evidence Generation and Evaluation Across a Network of Databases for Type 2 Diabetes Mellitus) network, 10 federated international data sources were included, spanning 1992 to 2021. In total, 1,492,855 patients with T2DM and cardiovascular disease (CVD) on metformin monotherapy were identified who initiated 1 of 4 second-line agents (SGLT2is, GLP-1 RAs, DPP4is, or SUs). Large-scale propensity score models were used to conduct an active-comparator target trial emulation for pairwise comparisons. After evaluating empirical equipoise and population generalizability, on-treatment Cox proportional hazards models were fit for 3-point MACE (myocardial infarction, stroke, and death) and 4-point MACE (3-point MACE plus heart failure hospitalization) risk and HR estimates were combined using random-effects meta-analysis. RESULTS: Over 5.2 million patient-years of follow-up and 489 million patient-days of time at risk, patients experienced 25,982 3-point MACE and 41,447 4-point MACE. SGLT2is and GLP-1 RAs were associated with lower 3-point MACE risk than DPP4is (HR: 0.89 [95% CI: 0.79-1.00] and 0.83 [95% CI: 0.70-0.98]) and SUs (HR: 0.76 [95% CI: 0.65-0.89] and 0.72 [95% CI: 0.58-0.88]). DPP4is were associated with lower 3-point MACE risk than SUs (HR: 0.87; 95% CI: 0.79-0.95). The pattern for 3-point MACE was also observed for the 4-point MACE outcome. There were no significant differences between SGLT2is and GLP-1 RAs for 3-point or 4-point MACE (HR: 1.06 [95% CI: 0.96-1.17] and 1.05 [95% CI: 0.97-1.13]). CONCLUSIONS: In patients with T2DM and CVD, comparable cardiovascular risk reduction was found with SGLT2is and GLP-1 RAs, with both agents more effective than DPP4is, which in turn were more effective than SUs. These findings suggest that the use of SGLT2is and GLP-1 RAs should be prioritized as second-line agents in those with established CVD.

Shifting perceptions: a pre-post study to assess the impact of a senior resident rotation bundle.

BACKGROUND: Extended duty hours for residents are associated with negative consequences. Strategies to accommodate duty hour restrictions may also have unintended impacts. To eliminate extended duty hours and potentially lessen these impacts, we developed a senior resident rotation bundle that integrates a night float system, educational sessions on sleep hygiene, an electronic handover tool, and a simulation-based medical education curriculum. The aim of this study was to assess internal medicine residents' perceptions of the impact of the bundle on three domains: the senior residents' wellness, ability to deliver quality health care, and medical education experience. METHODS: This prospective study compared eligible residents' experiences (N = 67) before and after a six-month trial of the bundle at a training program in western Canada. Data was collected using an on-line survey. Pre- and post-intervention scores for the final sample (N = 50) were presented as means and compared using the t-test for paired samples. RESULTS: Participants felt that most aspects of the three domains were unaffected by the introduction of the bundle. Four improved and two worsened perception shifts emerged post-intervention: less exposure to personal harm, reduced potential for medical error, more successful teaching, fewer disruptions to other rotations, increased conflicting role demands and less staff physician supervision. CONCLUSIONS: The rotation bundle integrates components that potentially ease some of the perceived negative consequences of night float rotations and duty hour restrictions. Future areas of study should include objective measures of the three domains to validate our study participants' perceptions.

Serially Combining Epidemiological Designs Does Not Improve Overall Signal Detection in Vaccine Safety Surveillance.

INTRODUCTION: Vaccine safety surveillance commonly includes a serial testing approach with a sensitive method for 'signal generation' and specific method for 'signal validation.' The extent to which serial testing in real-world studies improves or hinders overall performance in terms of sensitivity and specificity remains unknown. METHODS: We assessed the overall performance of serial testing using three administrative claims and one electronic health record database. We compared type I and II errors before and after empirical calibration for historical comparator, self-controlled case series (SCCS), and the serial combination of those designs against six vaccine exposure groups with 93 negative control and 279 imputed positive control outcomes. RESULTS: The historical comparator design mostly had fewer type II errors than SCCS. SCCS had fewer type I errors than the historical comparator. Before empirical calibration, the serial combination increased specificity and decreased sensitivity. Type II errors mostly exceeded 50%. After empirical calibration, type I errors returned to nominal; sensitivity was lowest when the methods were combined. CONCLUSION: While serial combination produced fewer false-positive signals compared with the most specific method, it generated more false-negative signals compared with the most sensitive method. Using a historical comparator design followed by an SCCS analysis yielded decreased sensitivity in evaluating safety signals relative to a one-stage SCCS approach. While the current use of serial testing in vaccine surveillance may provide a practical paradigm for signal identification and triage, single epidemiological designs should be explored as valuable approaches to detecting signals.

A metadata framework for computational phenotypes.

With the burgeoning development of computational phenotypes, it is increasingly difficult to identify the right phenotype for the right tasks. This study uses a mixed-methods approach to develop and evaluate a novel metadata framework for retrieval of and reusing computational phenotypes. Twenty active phenotyping researchers from 2 large research networks, Electronic Medical Records and Genomics and Observational Health Data Sciences and Informatics, were recruited to suggest metadata elements. Once consensus was reached on 39 metadata elements, 47 new researchers were surveyed to evaluate the utility of the metadata framework. The survey consisted of 5-Likert multiple-choice questions and open-ended questions. Two more researchers were asked to use the metadata framework to annotate 8 type-2 diabetes mellitus phenotypes. More than 90% of the survey respondents rated metadata elements regarding phenotype definition and validation methods and metrics positively with a score of 4 or 5. Both researchers completed annotation of each phenotype within 60 min. Our thematic analysis of the narrative feedback indicates that the metadata framework was effective in capturing rich and explicit descriptions and enabling the search for phenotypes, compliance with data standards, and comprehensive validation metrics. Current limitations were its complexity for data collection and the entailed human costs.

Reproducible variability: assessing investigator discordance across 9 research teams attempting to reproduce the same observational study.

OBJECTIVE: Observational studies can impact patient care but must be robust and reproducible. Nonreproducibility is primarily caused by unclear reporting of design choices and analytic procedures. This study aimed to: (1) assess how the study logic described in an observational study could be interpreted by independent researchers and (2) quantify the impact of interpretations' variability on patient characteristics. MATERIALS AND METHODS: Nine teams of highly qualified researchers reproduced a cohort from a study by Albogami et al. The teams were provided the clinical codes and access to the tools to create cohort definitions such that the only variable part was their logic choices. We executed teams' cohort definitions against the database and compared the number of subjects, patient overlap, and patient characteristics. RESULTS: On average, the teams' interpretations fully aligned with the master implementation in 4 out of 10 inclusion criteria with at least 4 deviations per team. Cohorts' size varied from one-third of the master cohort size to 10 times the cohort size (2159-63 619 subjects compared to 6196 subjects). Median agreement was 9.4% (interquartile range 15.3-16.2%). The teams' cohorts significantly differed from the master implementation by at least 2 baseline characteristics, and most of the teams differed by at least 5. CONCLUSIONS: Independent research teams attempting to reproduce the study based on its free-text description alone produce different implementations that vary in the population size and composition. Sharing analytical code supported by a common data model and open-source tools allows reproducing a study unambiguously thereby preserving initial design choices.

Real-world evidence to advance knowledge in pulmonary hypertension: Status, challenges, and opportunities. A consensus statement from the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative's Real-world Evidence Working Group.

This manuscript on real-world evidence (RWE) in pulmonary hypertension (PH) incorporates the broad experience of members of the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative Real-World Evidence Working Group. We aim to strengthen the research community's understanding of RWE in PH to facilitate clinical research advances and ultimately improve patient care. Herein, we review real-world data (RWD) sources, discuss challenges and opportunities when using RWD sources to study PH populations, and identify resources needed to support the generation of meaningful RWE for the global PH community.

Multinational patterns of second line antihyperglycaemic drug initiation across cardiovascular risk groups: federated pharmacoepidemiological evaluation in LEGEND-T2DM.

Objective: To assess the uptake of second line antihyperglycaemic drugs among patients with type 2 diabetes mellitus who are receiving metformin. Design: Federated pharmacoepidemiological evaluation in LEGEND-T2DM. Setting: 10 US and seven non-US electronic health record and administrative claims databases in the Observational Health Data Sciences and Informatics network in eight countries from 2011 to the end of 2021. Participants: 4.8 million patients (≥18 years) across US and non-US based databases with type 2 diabetes mellitus who had received metformin monotherapy and had initiated second line treatments. Exposure: The exposure used to evaluate each database was calendar year trends, with the years in the study that were specific to each cohort. Main outcomes measures: The outcome was the incidence of second line antihyperglycaemic drug use (ie, glucagon-like peptide-1 receptor agonists, sodium-glucose cotransporter-2 inhibitors, dipeptidyl peptidase-4 inhibitors, and sulfonylureas) among individuals who were already receiving treatment with metformin. The relative drug class level uptake across cardiovascular risk groups was also evaluated. Results: 4.6 million patients were identified in US databases, 61 382 from Spain, 32 442 from Germany, 25 173 from the UK, 13 270 from France, 5580 from Scotland, 4614 from Hong Kong, and 2322 from Australia. During 2011-21, the combined proportional initiation of the cardioprotective antihyperglycaemic drugs (glucagon-like peptide-1 receptor agonists and sodium-glucose cotransporter-2 inhibitors) increased across all data sources, with the combined initiation of these drugs as second line drugs in 2021 ranging from 35.2% to 68.2% in the US databases, 15.4% in France, 34.7% in Spain, 50.1% in Germany, and 54.8% in Scotland. From 2016 to 2021, in some US and non-US databases, uptake of glucagon-like peptide-1 receptor agonists and sodium-glucose cotransporter-2 inhibitors increased more significantly among populations with no cardiovascular disease compared with patients with established cardiovascular disease. No data source provided evidence of a greater increase in the uptake of these two drug classes in populations with cardiovascular disease compared with no cardiovascular disease. Conclusions: Despite the increase in overall uptake of cardioprotective antihyperglycaemic drugs as second line treatments for type 2 diabetes mellitus, their uptake was lower in patients with cardiovascular disease than in people with no cardiovascular disease over the past decade. A strategy is needed to ensure that medication use is concordant with guideline recommendations to improve outcomes of patients with type 2 diabetes mellitus.