Simulating complex patient populations with hierarchical learning effects to support methods development for post-market surveillance.

BACKGROUND: Validating new algorithms, such as methods to disentangle intrinsic treatment risk from risk associated with experiential learning of novel treatments, often requires knowing the ground truth for data characteristics under investigation. Since the ground truth is inaccessible in real world data, simulation studies using synthetic datasets that mimic complex clinical environments are essential. We describe and evaluate a generalizable framework for injecting hierarchical learning effects within a robust data generation process that incorporates the magnitude of intrinsic risk and accounts for known critical elements in clinical data relationships. METHODS: We present a multi-step data generating process with customizable options and flexible modules to support a variety of simulation requirements. Synthetic patients with nonlinear and correlated features are assigned to provider and institution case series. The probability of treatment and outcome assignment are associated with patient features based on user definitions. Risk due to experiential learning by providers and/or institutions when novel treatments are introduced is injected at various speeds and magnitudes. To further reflect real-world complexity, users can request missing values and omitted variables. We illustrate an implementation of our method in a case study using MIMIC-III data for reference patient feature distributions. RESULTS: Realized data characteristics in the simulated data reflected specified values. Apparent deviations in treatment effects and feature distributions, though not statistically significant, were most common in small datasets (n < 3000) and attributable to random noise and variability in estimating realized values in small samples. When learning effects were specified, synthetic datasets exhibited changes in the probability of an adverse outcomes as cases accrued for the treatment group impacted by learning and stable probabilities as cases accrued for the treatment group not affected by learning. CONCLUSIONS: Our framework extends clinical data simulation techniques beyond generation of patient features to incorporate hierarchical learning effects. This enables the complex simulation studies required to develop and rigorously test algorithms developed to disentangle treatment safety signals from the effects of experiential learning. By supporting such efforts, this work can help identify training opportunities, avoid unwarranted restriction of access to medical advances, and hasten treatment improvements.

Registry-Based Prospective, Active Surveillance of Medical-Device Safety.

BACKGROUND: The process of assuring the safety of medical devices is constrained by reliance on voluntary reporting of adverse events. We evaluated a strategy of prospective, active surveillance of a national clinical registry to monitor the safety of an implantable vascular-closure device that had a suspected association with increased adverse events after percutaneous coronary intervention (PCI). METHODS: We used an integrated clinical-data surveillance system to conduct a prospective, propensity-matched analysis of the safety of the Mynx vascular-closure device, as compared with alternative approved vascular-closure devices, with data from the CathPCI Registry of the National Cardiovascular Data Registry. The primary outcome was any vascular complication, which was a composite of access-site bleeding, access-site hematoma, retroperitoneal bleeding, or any vascular complication requiring intervention. Secondary safety end points were access-site bleeding requiring treatment and postprocedural blood transfusion. RESULTS: We analyzed data from 73,124 patients who had received Mynx devices after PCI procedures with femoral access from January 1, 2011, to September 30, 2013. The Mynx device was associated with a significantly greater risk of any vascular complication than were alternative vascular-closure devices (absolute risk, 1.2% vs. 0.8%; relative risk, 1.59; 95% confidence interval [CI], 1.42 to 1.78; P<0.001); there was also a significantly greater risk of access-site bleeding (absolute risk, 0.4% vs. 0.3%; relative risk, 1.34; 95% CI, 1.10 to 1.62; P=0.001) and transfusion (absolute risk, 1.8% vs. 1.5%; relative risk, 1.23; 95% CI, 1.13 to 1.34; P<0.001). The initial alerts occurred within the first 12 months of monitoring. Relative risks were greater in three prespecified high-risk subgroups: patients with diabetes, those 70 years of age or older, and women. All safety alerts were confirmed in an independent sample of 48,992 patients from April 1, 2014, to September 30, 2015. CONCLUSIONS: A strategy of prospective, active surveillance of a clinical registry rapidly identified potential safety signals among recipients of an implantable vascular-closure device, with initial alerts occurring within the first 12 months of monitoring. (Funded by the Food and Drug Administration and others.).

Outcomes of COVID-19 in Patients With a History of Cancer and Comorbid Cardiovascular Disease.

BACKGROUND: Cancer and cardiovascular disease (CVD) are independently associated with adverse outcomes in patients with COVID-19. However, outcomes in patients with COVID-19 with both cancer and comorbid CVD are unknown. METHODS: This retrospective study included 2,476 patients who tested positive for SARS-CoV-2 at 4 Massachusetts hospitals between March 11 and May 21, 2020. Patients were stratified by a history of either cancer (n=195) or CVD (n=414) and subsequently by the presence of both cancer and CVD (n=82). We compared outcomes between patients with and without cancer and patients with both cancer and CVD compared with patients with either condition alone. The primary endpoint was COVID-19-associated severe disease, defined as a composite of the need for mechanical ventilation, shock, or death. Secondary endpoints included death, shock, need for mechanical ventilation, need for supplemental oxygen, arrhythmia, venous thromboembolism, encephalopathy, abnormal troponin level, and length of stay. RESULTS: Multivariable analysis identified cancer as an independent predictor of COVID-19-associated severe disease among all infected patients. Patients with cancer were more likely to develop COVID-19-associated severe disease than were those without cancer (hazard ratio [HR], 2.02; 95% CI, 1.53-2.68; P<.001). Furthermore, patients with both cancer and CVD had a higher likelihood of COVID-19-associated severe disease compared with those with either cancer (HR, 1.86; 95% CI, 1.11-3.10; P=.02) or CVD (HR, 1.79; 95% CI, 1.21-2.66; P=.004) alone. Patients died more frequently if they had both cancer and CVD compared with either cancer (35% vs 17%; P=.004) or CVD (35% vs 21%; P=.009) alone. Arrhythmias and encephalopathy were also more frequent in patients with both cancer and CVD compared with those with cancer alone. CONCLUSIONS: Patients with a history of both cancer and CVD are at significantly higher risk of experiencing COVID-19-associated adverse outcomes. Aggressive public health measures are needed to mitigate the risks of COVID-19 infection in this vulnerable patient population.

Identifying patients for safe early hospital discharge following st elevation myocardial infarction.

OBJECTIVES: To examine whether the CADILLAC risk score is an effective method of patient stratification for early discharge following ST elevation myocardial infarction (STEMI). BACKGROUND: Patients with STEMI are typically hospitalized to monitor for serious complications such as arrhythmias, heart failure, and reinfarction. Optimal length of stay is unclear. Whether low risk patients can be safely discharged before 72 hr of hospitalization is unclear. METHODS: Patients with STEMI who underwent successful PCI were retrospectively stratified using CADILLAC risk score to low risk (n = 123) and intermediate to high risk (n = 105). The primary outcome was adverse clinical events at day 3 or later. Secondary outcomes were adverse clinical events on day 1 and mortality rates at 30 days and 31 to 365 days. RESULTS: Low risk patients had lower major adverse clinical events at day 3 or later (0 vs. 11.4%, P = 0.0002) and lower total mortality at 1 year (0 vs. 4.8%, P = 0.02) than patients with intermediate to high risk. Low risk patients were also less likely to have a cardiovascular event during the first 24 hr when compared to those with an intermediate to high risk score (3.3% vs. 13.3%, P = 0.006). CONCLUSION: Low risk patients identified using CADILLAC risk score with STEMI treated successfully with primary PCI have a low adverse event rate on the third day or later of hospitalization suggesting that an earlier discharge is safe in properly selected patients. Monitoring in a noncritical care setting following primary PCI for STEMI may be feasible for selected patients. © 2016 Wiley Periodicals, Inc.

Learning curve estimation in medical devices and procedures: hierarchical modeling.

In the use of medical device procedures, learning effects have been shown to be a critical component of medical device safety surveillance. To support their estimation of these effects, we evaluated multiple methods for modeling these rates within a complex simulated dataset representing patients treated by physicians clustered within institutions. We employed unique modeling for the learning curves to incorporate the learning hierarchy between institution and physicians and then modeled them within established methods that work with hierarchical data such as generalized estimating equations (GEE) and generalized linear mixed effect models. We found that both methods performed well, but that the GEE may have some advantages over the generalized linear mixed effect models for ease of modeling and a substantially lower rate of model convergence failures. We then focused more on using GEE and performed a separate simulation to vary the shape of the learning curve as well as employed various smoothing methods to the plots. We concluded that while both hierarchical methods can be used with our mathematical modeling of the learning curve, the GEE tended to perform better across multiple simulated scenarios in order to accurately model the learning effect as a function of physician and hospital hierarchical data in the use of a novel medical device. We found that the choice of shape used to produce the 'learning-free' dataset would be dataset specific, while the choice of smoothing method was negligibly different from one another. This was an important application to understand how best to fit this unique learning curve function for hierarchical physician and hospital data. Copyright © 2017 John Wiley & Sons, Ltd.

A comparison of in-hospital acute myocardial infarction management between Portugal and the United States: 2000-2010.

OBJECTIVE: To compare healthcare in acute myocardial infarction (AMI) treatment between contrasting health systems using comparable representative data from Europe and USA. DESIGN: Repeated cross-sectional retrospective cohort study. SETTING: Acute care hospitals in Portugal and USA during 2000-2010. PARTICIPANTS: Adults discharged with AMI. INTERVENTIONS: Coronary revascularizations procedures (percutaneous coronary intervention (PCI), coronary artery bypass graft (CABG) surgery). MAIN OUTCOME MEASURES: In-hospital mortality and length of stay. RESULTS: We identified 1 566 601 AMI hospitalizations. Relative to the USA, more hospitalizations in Portugal presented with elevated ST-segment, and fewer had documented comorbidities. Age-sex-adjusted AMI hospitalization rates decreased in USA but increased in Portugal. Crude procedure rates were generally lower in Portugal (PCI: 44% vs. 47%; CABG: 2% vs. 9%, 2010) but only CABG rates differed significantly after standardization. PCI use increased annually in both countries but CABG decreased only in the USA (USA: 0.95 [0.94, 0.95], Portugal: 1.04 [1.02, 1.07], odds ratios). Both countries observed annual decreases in risk-adjusted mortality (USA: 0.97 [0.965, 0.969]; Portugal: 0.99 [0.979, 0.991], hazard ratios). While between-hospital variability in procedure use was larger in USA, the risk of dying in a high relative to a low mortality hospital (hospitals in percentiles 95 and 5) was 2.65 in Portugal when in USA was only 1.03. CONCLUSIONS: Although in-hospital mortality due to an AMI improved in both countries, patient management in USA seems more effective and alarming disparities in quality of care across hospitals are more likely to exist in Portugal.

Multivessel vs culprit-only percutaneous coronary intervention among patients 65 years or older with acute myocardial infarction.

BACKGROUND: Older adults presenting with acute myocardial infarction (MI) often have multivessel coronary artery disease amenable to percutaneous coronary intervention (PCI), yet the risks of multivessel intervention may outweigh potential benefits in these patients. We sought to determine if nonculprit intervention during the index PCI is associated with better outcomes among older patients with acute MI and multivessel disease. METHODS: We examined 19,271 ST-segment elevation MI (STEMI) and 31,361 non-STEMI (NSTEMI) patients 65years or older with multivessel disease in a linked CathPCI Registry-Medicare database, excluding patients with prior coronary artery bypass grafting, left main disease, or cardiogenic shock. Using inverse probability-weighted propensity adjustment, we compared mortality between patients receiving culprit-only vs multivessel intervention during the index PCI procedure. RESULTS: Most older MI patients (91% STEMI and 74% NSTEMI) received culprit-only intervention during the index PCI. Among STEMI patients, multivessel intervention during the index PCI was associated with higher 30-day mortality (8.3% vs 6.3%, adjusted hazard ratio [HR] 1.36, 95% CI 1.14-1.62) than culprit-only intervention, and this trend persisted at 1year (13.8% vs 12.2%, adjusted HR 1.14, 95% CI 0.99-1.31). No significant mortality differences were observed among NSTEMI patients at 30days (3.4% vs 4.1%, adjusted HR 1.01, 95% CI 0.88-1.15) or at 1year (10.1% vs 10.8%, adjusted HR 0.99, 95% CI 0.91-1.08). CONCLUSIONS: Nonculprit intervention during the index PCI was associated with worse outcomes among STEMI patients, but not NSTEMI patients.

Comparison of Two Risk Models in Predicting the Incidence of Contrast-Induced Nephropathy after Percutaneous Coronary Intervention.

OBJECTIVES: We sought to compare 2 contrast-induced nephropathy (CIN) risk prediction models in a validation cohort using a consensus definition. BACKGROUND: Contrast-induced nephropathy (CIN) is independently associated with mortality following percutaneous coronary intervention (PCI). Multiple prediction models for the development of CIN have been published using heterogeneous outcome definitions. METHODS: We analyzed 5,540 patients who underwent PCI from January 2005 to June 2012 at a single academic medical center. The primary outcome was development of CIN, defined as an increase in serum creatinine of ≥0.5 mg/dl or a relative increase of ≥25% from baseline. Receiver operator characteristic (ROC) curves were used to evaluate the discriminatory power of Mehran and WBH prediction models. RESULTS: The mean age of our cohort was 68 ± 12 years. The mean baseline creatinine was 1.2 ± 0.53 mg/dl (eGFR 73 ± 27 ml/min). The mean contrast volume used was 212 ± 92 ml. CIN occurred in 436 patients (7.9%). The Mehran risk score demonstrated better discrimination than the William Beaumont Hospital (WBH) risk score to predict the occurrence of CIN (c statistic: 0.82 vs. 0.73, respectively). Mortality at 30 days was approximately 8 times higher among patients with CIN as compared to those without (14.7% vs. 1.8% P < 0.01). CONCLUSIONS: In an independent validation cohort, the Mehran risk model demonstrates greater discriminatory power than the WBH model in predicting the incidence of CIN. Mortality was significantly higher in patients who developed CIN after PCI.

Assessing the cost burden of United States FDA-mandated post-approval studies for medical devices.

Approved medical devices frequently undergo FDA mandated post-approval studies (PAS). However, there is uncertainty as to the value of PAS in assessing the safety of medical devices and the cost of these studies to the healthcare system is unknown. Since PAS costs are funded through device manufacturers who do not share the costs with regulators, we sought to estimate the total PAS costs through interviews with a panel of experts in medical device clinical trial design in order to design a general cost model for PAS which was then applied to the FDA PAS. A total of 277 PAS were initiated between 3/1/05 through 6/30/13 and demonstrated a median cost of $2.16 million per study and an overall cost of $1.22 billion over the 8.25 years of study. While these costs are funded through manufacturers, the ultimate cost is borne by the healthcare system through the medical device costs. Given concerns regarding the informational value of PAS, the resources used to support mandated PAS may be better allocated to other approaches to assure safety.

Reporting trends and outcomes in ST-segment-elevation myocardial infarction national hospital quality assessment programs.

BACKGROUND: For patients who undergo primary percutaneous coronary intervention (PCI) for ST-segment-elevation myocardial infarction, the door-to-balloon time is an important performance measure reported to the Centers for Medicare & Medicaid Services (CMS) and tied to hospital quality assessment and reimbursement. We sought to assess the use and impact of exclusion criteria associated with the CMS measure of door-to-balloon time in primary PCI. METHODS AND RESULTS: All primary PCI-eligible patients at 3 Massachusetts hospitals (Brigham and Women's, Massachusetts General, and North Shore Medical Center) were evaluated for CMS reporting status. Rates of CMS reporting exclusion were the primary end points of interest. Key secondary end points were between-group differences in patient characteristics, door-to-balloon times, and 1-year mortality rates. From 2005 to 2011, 26% (408) of the 1548 primary PCI cases were excluded from CMS reporting. This percentage increased over the study period from 13.9% in 2005 to 36.7% in the first 3 quarters of 2011 (P<0.001). The most frequent cause of exclusion was for a diagnostic dilemma such as a nondiagnostic initial ECG, accounting for 31.2% of excluded patients. Although 95% of CMS-reported cases met door-to-balloon time goals in 2011, this was true of only 61% of CMS-excluded cases and consequently 82.6% of all primary PCI cases performed that year. The 1-year mortality for CMS-excluded patients was double that of CMS-included patients (13.5% versus 6.6%; P<0.001). CONCLUSIONS: More than a quarter of patients who underwent primary PCI were excluded from hospital quality reports collected by CMS, and this percentage has grown substantially over time. These findings may have significant implications for our understanding of process improvement in primary PCI and mechanisms for reimbursement through Medicare.

Drug-eluting stents versus bare metal stents prior to noncardiac surgery.

BACKGROUND: The safety of drug-eluting stents (DES) vs. bare metal stents (BMS) in the perioperative setting, a heightened state of inflammation and thrombosis is not well defined. METHODS: All adults undergoing noncardiac surgical (NCS) procedures within 1 year following percutaneous coronary intervention (PCI) in Massachusetts between April 1, 2004, and September 30, 2007, were identified from an administrative claims database. Patients were divided into those who received BMS vs. DES at index PCI. Primary net clinical outcome was death, myocardial infarction (MI) or bleeding within 30 days of NCS. Primary clinical outcome was 30-day death or MI. RESULTS: Among 8,415 (22% BMS) patients that satisfied our inclusion criteria, 1,838 BMS patients were matched with 3,565 DES patients with similar propensity scores. In the DES cohort, the 30-day primary net clinical outcome rate was lower with longer time from PCI to NCS (P = 0.02) with lowest rates if NCS was performed after 90 days from PCI (event rate 8.57, 7.53, 5.21, and 5.75% for 1-30, 31-90, 91-180, and 181-365 days from PCI to NCS). However, in the BMS cohort, the event rate was uniformly high regardless of the time from PCI to NCS (P = 0.60) (event rate 8.20, 6.56, 8.05, and 8.82% for 1-30, 31-90, 91-180, and 181-365 days from PCI to NCS). There was no significant difference between DES and the BMS group for 30-day primary net clinical outcome (6.64 vs. 7.89%; P = 0.10), but there was a 26% lower odds of primary clinical outcome (OR = 0.74, 95% CI 0.58-0.94) with DES when compared with BMS, driven mainly by differences in event rates when NCS was performed >90 days post PCI. CONCLUSION: DES implantation was not associated with higher adverse events after NCS. Moreover, the incidence of adverse events following NCS was lower when NCS was performed >90 days post-DES implantation suggesting that it may not be necessary to wait until 12 months post PCI with DES before NCS.

Spontaneous Migration of Ventriculoperitoneal Shunt Into the Right Heart and Pulmonary Vasculature.

A 73-year-old woman with ventriculoperitoneal (VP) shunt presented for stress echocardiogram for evaluation of chest pain. Transthoracic echocardiogram revealed an incidental right heart mass representing a migrated VP shunt. This case highlights the role of multimodality cardiac imaging in diagnosing right heart masses and the multidisciplinary approach to management.

Testing a Cloud-Based Model for Active Surveillance of Medical Devices with Analyses of Coronary Stent Safety Using the Data Extraction and Longitudinal Trend Analysis (DELTA) System.

Objective: To demonstrate the use of the Data Extraction and Longitudinal Trend Analysis (DELTA) system in the National Evaluation System for health Technology's (NEST) medical device surveillance cloud environment by analyzing coronary stent safety using real world clinical data and comparing results to clinical trial findings. Design and Setting: Electronic health record (EHR) data from two health systems, the Social Security Death Master File, and device databases were ingested into the NEST cloud, and safety analyses of two stents were performed using DELTA. Participants and Interventions: This is an observational study of patients receiving zotarolimus drug-eluting coronary stents (ZES) or everolimus eluting coronary stents (EES) between July 1, 2015 and December 31, 2017. Results: After exclusions, 3334 patients receiving EES and 1002 receiving ZES were available for study. Analysis using inverse probability weighting showed no significant difference in one-year mortality or major adverse cardiac events (MACE) for EES compared to ZES [Mortality Odds Ratio 0.94 (95% CI 0.81-1.175); p = 0.780] [MACE Odds Ratio 1.04 (95% CI 0.92-1.16; p = 0.551]). Analysis using propensity matching showed no significant difference in EES one-year mortality (547 of 992 alive and available after censoring) compared to ZES (546 of 992) [Log-Rank statistic 0.3348 (p = 0.563)]. Conclusion: Automated cloud-based medical device safety surveillance using EHR data is feasible and was efficiently performed using DELTA. No statistically significant differences in 1-year safety outcomes between ZES and EES were identified using two statistical approaches, consistent with randomized trial findings.

Association of public reporting for percutaneous coronary intervention with utilization and outcomes among Medicare beneficiaries with acute myocardial infarction.

CONTEXT: Public reporting of patient outcomes is an important tool to improve quality of care, but some observers worry that such efforts will lead clinicians to avoid high-risk patients. OBJECTIVE: To determine whether public reporting for percutaneous coronary intervention (PCI) is associated with lower rates of PCI for patients with acute myocardial infarction (MI) or with higher mortality rates in this population. DESIGN, SETTING, AND PATIENTS: Retrospective observational study conducted using data from fee-for-service Medicare patients (49,660 from reporting states and 48,142 from nonreporting states) admitted with acute MI to US acute care hospitals between 2002 and 2010. Logistic regression was used to compare PCI and mortality rates between reporting states (New York, Massachusetts, and Pennsylvania) and regional nonreporting states (Maine, Vermont, New Hampshire, Connecticut, Rhode Island, Maryland, and Delaware). Changes in PCI rates over time in Massachusetts compared with nonreporting states were also examined. MAIN OUTCOME MEASURES: Risk-adjusted PCI and mortality rates. RESULTS: In 2010, patients with acute MI were less likely to receive PCI in public reporting states than in nonreporting states (unadjusted rates, 37.7% vs 42.7%, respectively; risk-adjusted odds ratio [OR], 0.82 [95% CI, 0.71-0.93]; P = .003). Differences were greatest among the 6708 patients with ST-segment elevation MI (61.8% vs 68.0%; OR, 0.73 [95% CI, 0.59-0.89]; P = .002) and the 2194 patients with cardiogenic shock or cardiac arrest (41.5% vs 46.7%; OR, 0.79 [95% CI, 0.64-0.98]; P = .03). There were no differences in overall mortality among patients with acute MI in reporting vs nonreporting states. In Massachusetts, odds of PCI for acute MI were comparable with odds in nonreporting states prior to public reporting (40.6% vs 41.8%; OR, 1.00 [95% CI, 0.71-1.41]). However, after implementation of public reporting, odds of undergoing PCI in Massachusetts decreased compared with nonreporting states (41.1% vs 45.6%; OR, 0.81 [95% CI, 0.47-1.38]; P = .03 for difference in differences). Differences were most pronounced for the 6081 patients with cardiogenic shock or cardiac arrest (prereporting: 44.2% vs 36.6%; OR, 1.40 [95% CI, 0.85-2.32]; postreporting: 43.9% vs 44.8%; OR, 0.92 [95% CI, 0.38-2.22]; P = .03 for difference in differences). CONCLUSIONS: Among Medicare beneficiaries with acute MI, the use of PCI was lower for patients treated in 3 states with public reporting of PCI outcomes compared with patients treated in 7 regional control states without public reporting. However, there was no difference in overall acute MI mortality between states with and without public reporting.

Evaluation of intervertebral body implant performance using active surveillance of electronic health records.

Objectives: To assess the feasibility of using electronic health record (EHR) derived clinical data within an active surveillance setting to evaluate the safety of a novel intervertebral body implant (IVBI) stabilization device. Design: Retrospective, longitudinal observational cohort study comparing clinical outcomes for patients seen through 1 year following spinal fusion surgery. Setting: Lahey Health network, which includes academic tertiary hospitals, outpatient clinics, and independent provider offices in the New England region of the USA. Participants: All spine surgery patients aged 18 or older who underwent thoracic or lumbar spinal arthrodesis surgeries were included. Main outcome measures: The clinical outcomes of patients treated with the CONCORDE Bullet (CB) interbody spine system (DePuy) between April 2015 and December 2018 were compared with those patients receiving alternative spine stabilization interbody device implants. The primary endpoint was reoperation rate at 1 year, with secondary endpoints including the requirement for blood transfusion during index hospitalization, 1 year rate of any cause hospitalization, 1 year rate of surgical site infection, and mortality at 1 year. Results: Among the 606 patients undergoing thoracic or lumbar spinal fusion surgery during the study period, 136 received only the CB. In comparison with patients who did not receive the CB, no significant differences were found in the rate of reoperation at 1 year or the rates of secondary safety outcomes. Conclusions: Data derived from the EHR can be successfully leveraged to assess the safety of IVBI devices, in this case demonstrating no significant differences in the rates of risk-adjusted safety endpoints between patients undergoing spinal surgery with the CB as compared with alternative spinal implants.

Advancing the Real-World Evidence for Medical Devices through Coordinated Registry Networks.

Objectives: Generating and using real-world evidence (RWE) is a pragmatic solution for evaluating health technologies. RWE is recognized by regulators, health technology assessors, clinicians, and manufacturers as a valid source of information to support their decision-making. Well-designed registries can provide RWE and become more powerful when linked with electronic health records and administrative databases in coordinated registry networks (CRNs). Our objective was to create a framework of maturity of CRNs and registries, so guiding their development and the prioritization of funding. Design setting and participants: We invited 52 stakeholders from diverse backgrounds including patient advocacy groups, academic, clinical, industry and regulatory experts to participate on a Delphi survey. Of those invited, 42 participated in the survey to provide feedback on the maturity framework for CRNs and registries. An expert panel reviewed the responses to refine the framework until the target consensus of 80% was reached. Two rounds of the Delphi were distributed via Qualtrics online platform from July to August 2020 and from October to November 2020. Main outcome measures: Consensus on the maturity framework for CRNs and registries consisted of seven domains (unique device identification, efficient data collection, data quality, product life cycle approach, governance and sustainability, quality improvement, and patient-reported outcomes), each presented with five levels of maturity. Results: Of 52 invited experts, 41 (79.9%) responded to round 1; all 41 responded to round 2; and consensus was reached for most domains. The expert panel resolved the disagreements and final consensus estimates ranged from 80.5% to 92.7% for seven domains. Conclusions: We have developed a robust framework to assess the maturity of any CRN (or registry) to provide reliable RWE. This framework will promote harmonization of approaches to RWE generation across different disciplines and health systems. The domains and their levels may evolve over time as new solutions become available.

Catheter directed lysis and thrombectomy of submassive pulmonary embolism.

Acute pulmonary embolism (PE) is a common and potentially highly morbid disease. However, there are a broad range of clinical presentations, varying from asymptomatic to life-threatening hemodynamic compromise. Accordingly, the aggressiveness of treatment for acute PE must be adjusted to the acuity of the presentation and patient-specific comorbidities. Thrombolysis is FDA approved for massive PE with hemodynamic compromise. However, this therapy has associated risk, most notably intracranial hemorrhage and other bleeding complications. This has prompted interest in catheter-directed therapies to mechanically remove thrombus and to locally deliver reduced doses of thrombolytics. Guidelines support use of this catheter-based strategy in cases of increased bleeding risk or high acuity with insufficient time for systemic pharmacologic therapy to be effective. We present the case of an 83-year-old man with acute high-risk PE and worsening hemodynamic and respiratory status who was treated with catheter-directed thrombolysis and rheolytic thrombectomy. There was significant improvement in thrombus burden, symptoms, and hemodynamic parameters including right ventricular function and pulmonary artery pressures. However, his course was complicated by intracranial hemorrhage and access site hematoma, demonstrating that even reduced doses and local delivery of thrombolytics do not ensure freedom from bleeding complications.