RESUMO
OBJECTIVES: This manuscript presents a comprehensive framework for the assessment of the value of real-world evidence (RWE) in healthcare decision-making. While RWE has been proposed to overcome some limitations of traditional, one-off studies, no systematic framework exists to measure if RWE actually lowers the burden. This framework aims to fill that gap by providing conceptual approaches for evaluating the time and cost efficiencies of RWE, thus guiding strategic investments in RWE infrastructure. METHODS: The framework consists of four components: (114th Congress. 21st Century Cures Act.; 2015. https://www.congress.gov/114/plaws/publ255/PLAW-114publ255.pdf .) identification of stakeholders using and producing RWE, (National Health Council. Glossary of Patient Engagement Terms. Published 2019. Accessed May 18. 2021. https://nationalhealthcouncil.org/glossary-of-patient-engagement-terms/ .) understanding value propositions on how RWE can benefit stakeholders, (Center for Drug Evaluation and Research. CDER Patient-Focused Drug Development. U.S. Food & Drug Administration.) defining key performance indicators (KPIs), and (U.S. Department of Health and Human Services - Food and Drug Administration: Center for Devices and Radiological Health and Center for Biologics Evaluation and Research. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices - Guidance for Industry and Food and Drug Administration Staff. 2017. http://www.fda.gov/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guida .) establishing metrics and case studies to assess value. KPIs are categorized as 'better, faster, or cheaper" as an indicator of value: better focusing on high-quality actionable evidence; 'faster,' denoting time-saving in evidence generation, and 'cheaper,' emphasizing cost-efficiency decision compared to methodologies that do not involve data routinely collected in clinical practice. Metrics and relevant case studies are tailored based on stakeholder value propositions and selected KPIs that can be used to assess what value has been created by using RWE compared to traditional evidence-generation approaches and comparing different RWE sources. RESULTS: Operationalized through metrics and case studies drawn from the literature, the value of RWE is documented as improving treatment effect heterogeneity evaluation, expanding medical product labels, and expediting post-market compliance. RWE is also shown to reduce the cost and time required to produce evidence compared to traditional one-off approaches. An original example of a metric that measures the time saved by RWE methods to detect a signal of a product failure was presented based on analysis of the National Cardiovascular Disease Registry. CONCLUSIONS: The framework presented in this manuscript offers a comprehensive approach for evaluating the value of RWE, applicable to all stakeholders engaged in leveraging RWE for healthcare decision-making. Through the proposed metrics and illustrated case studies, valuable insights are provided into the heightened efficiency, cost-effectiveness, and improved decision-making within clinical and regulatory domains facilitated by RWE. While this framework is primarily focused on medical devices, it could potentially inform the determination of RWE value in other medical products. By discerning the variations in cost, time, and data utility among various evidence-generation methods, stakeholders are empowered to invest strategically in RWE infrastructure and shape future research endeavors.
RESUMO
A 73-year-old woman with ventriculoperitoneal (VP) shunt presented for stress echocardiogram for evaluation of chest pain. Transthoracic echocardiogram revealed an incidental right heart mass representing a migrated VP shunt. This case highlights the role of multimodality cardiac imaging in diagnosing right heart masses and the multidisciplinary approach to management.
RESUMO
Objective: To demonstrate the use of the Data Extraction and Longitudinal Trend Analysis (DELTA) system in the National Evaluation System for health Technology's (NEST) medical device surveillance cloud environment by analyzing coronary stent safety using real world clinical data and comparing results to clinical trial findings. Design and Setting: Electronic health record (EHR) data from two health systems, the Social Security Death Master File, and device databases were ingested into the NEST cloud, and safety analyses of two stents were performed using DELTA. Participants and Interventions: This is an observational study of patients receiving zotarolimus drug-eluting coronary stents (ZES) or everolimus eluting coronary stents (EES) between July 1, 2015 and December 31, 2017. Results: After exclusions, 3334 patients receiving EES and 1002 receiving ZES were available for study. Analysis using inverse probability weighting showed no significant difference in one-year mortality or major adverse cardiac events (MACE) for EES compared to ZES [Mortality Odds Ratio 0.94 (95% CI 0.81-1.175); p = 0.780] [MACE Odds Ratio 1.04 (95% CI 0.92-1.16; p = 0.551]). Analysis using propensity matching showed no significant difference in EES one-year mortality (547 of 992 alive and available after censoring) compared to ZES (546 of 992) [Log-Rank statistic 0.3348 (p = 0.563)]. Conclusion: Automated cloud-based medical device safety surveillance using EHR data is feasible and was efficiently performed using DELTA. No statistically significant differences in 1-year safety outcomes between ZES and EES were identified using two statistical approaches, consistent with randomized trial findings.
RESUMO
BACKGROUND: Validating new algorithms, such as methods to disentangle intrinsic treatment risk from risk associated with experiential learning of novel treatments, often requires knowing the ground truth for data characteristics under investigation. Since the ground truth is inaccessible in real world data, simulation studies using synthetic datasets that mimic complex clinical environments are essential. We describe and evaluate a generalizable framework for injecting hierarchical learning effects within a robust data generation process that incorporates the magnitude of intrinsic risk and accounts for known critical elements in clinical data relationships. METHODS: We present a multi-step data generating process with customizable options and flexible modules to support a variety of simulation requirements. Synthetic patients with nonlinear and correlated features are assigned to provider and institution case series. The probability of treatment and outcome assignment are associated with patient features based on user definitions. Risk due to experiential learning by providers and/or institutions when novel treatments are introduced is injected at various speeds and magnitudes. To further reflect real-world complexity, users can request missing values and omitted variables. We illustrate an implementation of our method in a case study using MIMIC-III data for reference patient feature distributions. RESULTS: Realized data characteristics in the simulated data reflected specified values. Apparent deviations in treatment effects and feature distributions, though not statistically significant, were most common in small datasets (n < 3000) and attributable to random noise and variability in estimating realized values in small samples. When learning effects were specified, synthetic datasets exhibited changes in the probability of an adverse outcomes as cases accrued for the treatment group impacted by learning and stable probabilities as cases accrued for the treatment group not affected by learning. CONCLUSIONS: Our framework extends clinical data simulation techniques beyond generation of patient features to incorporate hierarchical learning effects. This enables the complex simulation studies required to develop and rigorously test algorithms developed to disentangle treatment safety signals from the effects of experiential learning. By supporting such efforts, this work can help identify training opportunities, avoid unwarranted restriction of access to medical advances, and hasten treatment improvements.
Assuntos
Aprendizado Profundo , Humanos , Simulação por Computador , AlgoritmosRESUMO
Objectives: Generating and using real-world evidence (RWE) is a pragmatic solution for evaluating health technologies. RWE is recognized by regulators, health technology assessors, clinicians, and manufacturers as a valid source of information to support their decision-making. Well-designed registries can provide RWE and become more powerful when linked with electronic health records and administrative databases in coordinated registry networks (CRNs). Our objective was to create a framework of maturity of CRNs and registries, so guiding their development and the prioritization of funding. Design setting and participants: We invited 52 stakeholders from diverse backgrounds including patient advocacy groups, academic, clinical, industry and regulatory experts to participate on a Delphi survey. Of those invited, 42 participated in the survey to provide feedback on the maturity framework for CRNs and registries. An expert panel reviewed the responses to refine the framework until the target consensus of 80% was reached. Two rounds of the Delphi were distributed via Qualtrics online platform from July to August 2020 and from October to November 2020. Main outcome measures: Consensus on the maturity framework for CRNs and registries consisted of seven domains (unique device identification, efficient data collection, data quality, product life cycle approach, governance and sustainability, quality improvement, and patient-reported outcomes), each presented with five levels of maturity. Results: Of 52 invited experts, 41 (79.9%) responded to round 1; all 41 responded to round 2; and consensus was reached for most domains. The expert panel resolved the disagreements and final consensus estimates ranged from 80.5% to 92.7% for seven domains. Conclusions: We have developed a robust framework to assess the maturity of any CRN (or registry) to provide reliable RWE. This framework will promote harmonization of approaches to RWE generation across different disciplines and health systems. The domains and their levels may evolve over time as new solutions become available.
RESUMO
Objectives: To assess the feasibility of using electronic health record (EHR) derived clinical data within an active surveillance setting to evaluate the safety of a novel intervertebral body implant (IVBI) stabilization device. Design: Retrospective, longitudinal observational cohort study comparing clinical outcomes for patients seen through 1 year following spinal fusion surgery. Setting: Lahey Health network, which includes academic tertiary hospitals, outpatient clinics, and independent provider offices in the New England region of the USA. Participants: All spine surgery patients aged 18 or older who underwent thoracic or lumbar spinal arthrodesis surgeries were included. Main outcome measures: The clinical outcomes of patients treated with the CONCORDE Bullet (CB) interbody spine system (DePuy) between April 2015 and December 2018 were compared with those patients receiving alternative spine stabilization interbody device implants. The primary endpoint was reoperation rate at 1 year, with secondary endpoints including the requirement for blood transfusion during index hospitalization, 1 year rate of any cause hospitalization, 1 year rate of surgical site infection, and mortality at 1 year. Results: Among the 606 patients undergoing thoracic or lumbar spinal fusion surgery during the study period, 136 received only the CB. In comparison with patients who did not receive the CB, no significant differences were found in the rate of reoperation at 1 year or the rates of secondary safety outcomes. Conclusions: Data derived from the EHR can be successfully leveraged to assess the safety of IVBI devices, in this case demonstrating no significant differences in the rates of risk-adjusted safety endpoints between patients undergoing spinal surgery with the CB as compared with alternative spinal implants.
RESUMO
OBJECTIVES: This study sought to determine the safety and efficacy of paclitaxel (PTX) devices in the treatment of peripheral artery disease involving the femoropopliteal artery. BACKGROUND: A meta-analysis of PTX devices for the treatment of femoropopliteal artery disease reported a mortality signal. METHODS: This was a multicenter cohort study using an integrated clinical data surveillance system to conduct a prospective, propensity score-matched survival analysis of 2,456 patients in the Society for Vascular Surgery Vascular Quality Initiative from January 2017 to May 2020. The study compared PTX drug-coated balloon angioplasty versus percutaneous transluminal balloon angioplasty, PTX drug-eluting stents versus bare-metal stents, and any PTX device versus any non-PTX device. The primary outcome was 2-year survival. Secondary endpoints were successful ambulation and interventional success. RESULTS: Treatment with any PTX device versus any non-PTX device was associated with increased 2-year survival (89.5% vs 86.7%; HR: 0.79; 95% CI: 0.72-0.87; P = 0.004), improved interventional success (81.6% vs 77.6%; HR: 0.82; 95% CI: 0.74-0.91; P < 0.001), and higher rates of independent ambulation at 1 year (86.0% vs 83.4%; HR: 0.85; 95% CI: 0.79-0.91; P = 0.008). Treatment with PTX drug-coated balloon angioplasty was associated with improved survival at 2 years (88.9% vs 85.7%; HR: 0.77; 95% CI: 0.70-0.86; P = 0.005), while PTX drug-eluting stent therapy was associated with similar survival compared with bare-metal stent therapy (91.3% vs 89.6%; HR: 0.84; 95% CI: 0.70-1.01; P = 0.36). CONCLUSIONS: In this prospective, active surveillance of a national clinical registry, PTX-containing devices were associated with increased survival at 2 years and improved clinical outcomes at 1 year. (VQI DELTA Paclitaxel Device Safety Analysis [VQI-PTX]; NCT04110288).
Assuntos
Angioplastia com Balão , Fármacos Cardiovasculares , Stents Farmacológicos , Doença Arterial Periférica , Estudos de Coortes , Artéria Femoral/diagnóstico por imagem , Artéria Femoral/cirurgia , Humanos , Estudos Multicêntricos como Assunto , Paclitaxel , Doença Arterial Periférica/tratamento farmacológico , Doença Arterial Periférica/terapia , Artéria Poplítea/diagnóstico por imagem , Artéria Poplítea/cirurgia , Estudos Prospectivos , Resultado do Tratamento , Grau de Desobstrução VascularRESUMO
Giant cell myocarditis is a rare, often rapidly progressive and potentially fatal, disease due to T-cell lymphocyte-mediated inflammation of the myocardium that typically affects young and middle-aged adults. Frequently, the disease course is marked by acute heart failure, cardiogenic shock, intractable ventricular arrhythmias, and/or heart block. Diagnosis is often difficult due to its varied clinical presentation and overlap with other cardiovascular conditions. Although cardiac biomarkers and multimodality imaging are often used as initial diagnostic tests, endomyocardial biopsy is required for definitive diagnosis. Combination immunosuppressive therapy, along with guideline-directed medical therapy, has led to a paradigm shift in the management of giant cell myocarditis resulting in an improvement in overall and transplant-free survival. Early diagnosis and prompt management can decrease the risk of transplantation or death, which remain common in patients who present with cardiogenic shock.
Assuntos
Células Gigantes/patologia , Miocardite/terapia , Algoritmos , Biomarcadores/sangue , Biópsia , Fármacos Cardiovasculares/uso terapêutico , Desfibriladores Implantáveis , Eletrocardiografia , Endocárdio/patologia , Coração/diagnóstico por imagem , Transplante de Coração , Coração Auxiliar , Humanos , Imunossupressores/uso terapêutico , Miocardite/diagnóstico , Peptídeo Natriurético Encefálico/sangue , Troponina I/sangueRESUMO
In the spring of 2020, our hospital faced a surge of critically ill coronavirus disease 2019 patients, with intensive care unit (ICU) occupancy peaking at 204% of the baseline maximum capacity. In anticipation of this surge, we developed a remote communication liaison program to help the ICU and palliative care teams support families of critically ill patients. In just nine days from inception until implementation, we recruited and prepared ambulatory specialty providers to serve in this role effectively, despite minimal prior critical care experience. We report here the primary elements needed to reproduce and scale this program in other hospitals facing similar ICU surges, including a checklist for replication (Appendix I). Keys to success include strong logistical support, clinical reference material designed for rapid evolution, and a liaison team structure with peer coaching.
Assuntos
COVID-19/terapia , Cuidados Críticos/organização & administração , Comunicação Interdisciplinar , Cuidados Paliativos/organização & administração , HumanosRESUMO
BACKGROUND: Cancer and cardiovascular disease (CVD) are independently associated with adverse outcomes in patients with COVID-19. However, outcomes in patients with COVID-19 with both cancer and comorbid CVD are unknown. METHODS: This retrospective study included 2,476 patients who tested positive for SARS-CoV-2 at 4 Massachusetts hospitals between March 11 and May 21, 2020. Patients were stratified by a history of either cancer (n=195) or CVD (n=414) and subsequently by the presence of both cancer and CVD (n=82). We compared outcomes between patients with and without cancer and patients with both cancer and CVD compared with patients with either condition alone. The primary endpoint was COVID-19-associated severe disease, defined as a composite of the need for mechanical ventilation, shock, or death. Secondary endpoints included death, shock, need for mechanical ventilation, need for supplemental oxygen, arrhythmia, venous thromboembolism, encephalopathy, abnormal troponin level, and length of stay. RESULTS: Multivariable analysis identified cancer as an independent predictor of COVID-19-associated severe disease among all infected patients. Patients with cancer were more likely to develop COVID-19-associated severe disease than were those without cancer (hazard ratio [HR], 2.02; 95% CI, 1.53-2.68; P<.001). Furthermore, patients with both cancer and CVD had a higher likelihood of COVID-19-associated severe disease compared with those with either cancer (HR, 1.86; 95% CI, 1.11-3.10; P=.02) or CVD (HR, 1.79; 95% CI, 1.21-2.66; P=.004) alone. Patients died more frequently if they had both cancer and CVD compared with either cancer (35% vs 17%; P=.004) or CVD (35% vs 21%; P=.009) alone. Arrhythmias and encephalopathy were also more frequent in patients with both cancer and CVD compared with those with cancer alone. CONCLUSIONS: Patients with a history of both cancer and CVD are at significantly higher risk of experiencing COVID-19-associated adverse outcomes. Aggressive public health measures are needed to mitigate the risks of COVID-19 infection in this vulnerable patient population.
RESUMO
Patients with pre-existing cardiovascular disease and risk factors are more likely to experience adverse outcomes associated with the novel coronavirus disease-2019 (COVID-19). Additionally, consistent reports of cardiac injury and de novo cardiac complications, including possible myocarditis, arrhythmia, and heart failure in patients without prior cardiovascular disease or significant risk factors, are emerging, possibly due to an accentuated host immune response and cytokine release syndrome. As the spread of the virus increases exponentially, many patients will require medical care either for COVID-19 related or traditional cardiovascular issues. While the COVID-19 pandemic is dominating the attention of the healthcare system, there is an unmet need for a standardized approach to deal with COVID-19 associated and other traditional cardiovascular issues during this period. We provide consensus guidance for the management of various cardiovascular conditions during the ongoing COVID-19 pandemic with the goal of providing the best care to all patients and minimizing the risk of exposure to frontline healthcare workers.
Assuntos
Betacoronavirus , Doenças Cardiovasculares/terapia , Infecções por Coronavirus/epidemiologia , Pneumonia Viral/epidemiologia , COVID-19 , Doenças Cardiovasculares/diagnóstico , Doenças Cardiovasculares/etiologia , Humanos , Pandemias , SARS-CoV-2RESUMO
BACKGROUND: Several defibrillator leads have been recalled due to early lead failure leading to significant patient harm. Confirming the safety of contemporary defibrillator leads is essential to optimizing treatment for patients receiving implantable cardioverter-defibrillators (ICDs). We therefore sought to assess the comparative long-term safety of the 4 most commonly implanted ICD leads within the National Cardiovascular Data Registry ICD Registry. METHODS AND RESULTS: A propensity-matched survival analysis of the ICD Registry was performed evaluating 4 contemporary ICD leads in patients receiving an ICD system for the first time. All patients in the ICD Registry aged ≥18 years who underwent an implant of an ICD between April 1, 2011 and March 31, 2016 were included. Monitoring of safety began with ICD implant and continued up to 5 years. A meaningful difference in ICD failure rate was defined as twice (or more) the lead failure rate observed in the propensity-matched comparator patients. Among the 374 132 patients who received a new ICD implant, no safety alerts were triggered for the primary safety end point of lead failure for any of the high energy leads studied. Estimated rates of freedom from lead failure at 5 years ranged from 97.7% to 98.9% for the 4 high-energy leads of interest. CONCLUSIONS: Though limited by incomplete long-term outcomes ascertainment, active surveillance of the ICD Registry suggests that there were no meaningful differences in the rate of ICD high-energy lead survival for the 4 most commonly used high-energy ICD leads.
Assuntos
Desfibriladores Implantáveis , Cardioversão Elétrica/instrumentação , Falha de Prótese , Idoso , Cardioversão Elétrica/efeitos adversos , Estudos de Viabilidade , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Segurança do Paciente , Vigilância de Produtos Comercializados , Estudos Prospectivos , Desenho de Prótese , Sistema de Registros , Medição de Risco , Fatores de Risco , Fatores de Tempo , Resultado do Tratamento , Estados UnidosRESUMO
OBJECTIVES: The CathPCI Data Extraction and Longitudinal Trend Analysis study was designed to determine the feasibility of conducting prospective surveillance of a large national registry to perform comparative safety analyses of medical devices. We sought to determine whether the complementary use of retrospective case data could improve safety signal detection time. DESIGN: We performed a simulated surveillance study of the comparative safety of the Mynx vascular closure device (VCD) with propensity score matched alternate VCD recipients, using both retrospective and prospective cohort data. SETTING: Centers within the USA using the National Cardiovascular Data Registry (NCDR) CathPCI Registry. PARTICIPANTS: Percutaneous coronary intervention cases captured within the NCDR CathPCI Registry from July 1, 2009 to September 30, 2013 were included in the analysis. INTERVENTIONS: None. MAIN OUTCOME MEASURES: Absolute and relative risk (RR) of any vascular complication (a composite of bleeding at access site, hematoma at access site, retroperitoneal bleeding, and other vascular complications requiring treatment); time to signal detection. RESULTS: A safety alert was detected for the primary outcome of "any vascular complication" after 15 months of surveillance and was sustained for the study duration (absolute risk of any vascular complication, 1.20% vs 0.73%, RR, 1.63; 95% CI 1.50 to 1.79; p<0.001). The safety signal was identified 12 months earlier with the use of retrospective case data than during the initial study. CONCLUSIONS: Prospective, active surveillance of cardiovascular registries is feasible to perform comparative analyses of medical devices. Retrospective data may complement prospective surveillance to improve time to signal detection, indicating the need for earlier prospective application of safety surveillance for devices new to the market.
RESUMO
BACKGROUND: Real-world data (RWD) from the Society for Vascular Surgery Vascular Quality Initiative (VQI) registry has been used to support US Food and Drug Administration (FDA) regulatory decisions regarding vascular devices. The variables of cost and time needed for these registry-based studies have not been previously compared to traditional, independent, industry studies that would otherwise have been conducted to support regulatory decisions. OBJECTIVES: To determine the potential value (cost and time saving and return on investment) created by device evaluation studies using the VQI registry infrastructure. METHODS: We compared studies that used data from the VQI registry with estimated costs of independent industry studies (counterfactual studies) using an established model using design specifications determined by FDA reviewers. RESULTS: We analyzed the initial six studies evaluating vascular devices for regulatory decisions using data from the VQI registry that generated evidence for four device manufacturers. Return on investment for these studies was estimated to be 143% and cost saving as 59% based on an actual per patient (with 5-year follow-up) cost of US$11K using VQI data versus US$26K from the counterfactual when averaged across all studies. Significant enrollment time savings (45%-71%) were also realized compared with industry-based estimates. CONCLUSIONS: The use of RWD from the VQI registry in this study and the transcatheter valve treatment coordinated registry network in a prior study indicates that substantial value was added to device evaluation projects by the reuse of registry data, with additional potential savings if linked claims data can be used instead of costly long-term in-person follow-up.
Assuntos
Revelação/estatística & dados numéricos , Política de Saúde , Infarto do Miocárdio/cirurgia , Avaliação de Resultados em Cuidados de Saúde/métodos , Intervenção Coronária Percutânea/estatística & dados numéricos , Carga de Trabalho/estatística & dados numéricos , Humanos , Infarto do Miocárdio/mortalidade , Taxa de Sobrevida/tendências , Estados Unidos/epidemiologiaRESUMO
Background Current strategies for ensuring the postmarket safety of medical devices are limited by small sample size and reliance on voluntary reporting of adverse events. Prospective, active surveillance of clinical registries may provide early warnings in the postmarket evaluation of medical device safety but has not been demonstrated in national clinical data registries. Methods and Results The CathPCI DELTA (Data Extraction and Longitudinal Trend Analysis) study was designed to assess the feasibility of prospective, active safety surveillance of medical devices within a national cardiovascular registry. We sought to assess the ability of our surveillance strategy to avoid false safety alerts by conducting an active safety surveillance study of aspiration thrombectomy catheters using data within the National Cardiovascular Data Registry CathPCI registry, where no difference in safety outcomes were anticipated for the primary in-hospital safety outcome of death and major adverse cardiovascular events (MACE). We performed a propensity-matched analysis of 5 aspiration thrombectomy catheter devices used during percutaneous coronary intervention among 95 925 patients presenting with ST-segment-elevation myocardial infarction between January 1, 2011 and September 30, 2013. After 33 months of surveillance, no safety alerts were triggered for the primary safety endpoints of death or MACE, with no between-catheter differences observed. The absolute risk of death during acute hospitalization ranged from 5.11% to 5.32% among the most commonly used aspiration thrombectomy catheter devices, with relative risks for death ranging from 0.96 to 1.03. The absolute risk of MACE ranged from 9.78% to 10.18%, with relative risks for MACE ranging from 0.99 to 1.02. There were no statistically significant differences in the rates of death or MACE between any of the aspiration thrombectomy catheter devices analyzed. Conclusions The CathPCI DELTA study demonstrates that prospective, active safety surveillance of national clinical registries is feasible to provide near-real-time safety assessments of new medical devices.