Early technology review: towards an expedited pathway.

OBJECTIVES: Evidence development for medical devices is often focused on satisfying regulatory requirements with the result that health professional and payer expectations may not be met, despite considerable investment in clinical trials. Early engagement with payers and health professionals could allow companies to understand these expectations and reflect them in clinical study design, increasing chances of positive coverage determination and adoption into clinical practice. METHODS: An example of early engagement through the EXCITE International model using an early technology review (ETR) is described which includes engagement with payers and health professionals to better inform companies to develop data that meet their expectations. ETR is based on an early evidence review, a framework of expectations that guides the process and identified gaps in evidence. The first fourteen ETRs were reviewed for examples of advice to companies that provided additional information from payers and health professionals that was thought likely to impact on downstream outcomes or strategic direction. Given that limitations were imposed by confidentiality, examples were genericized. RESULTS: Advice through early engagement can inform evidence development that coincides with expectations of payers and health professionals through a structured, objective, evidence-based approach. This could reduce the risk of business-related adverse outcomes such as failure to secure a positive coverage determination and/or acceptance by expert health professionals. CONCLUSIONS: Early engagement with key stakeholders exemplified by the ETR approach offers an alternative to the current approach of focusing on regulatory expectations. This could reduce the time to reimbursement and clinical adoption and benefit patient outcomes and/or health system efficiencies.

Use of Bayesian decision analysis to maximize value in patient-centered randomized clinical trials in Parkinson's disease.

A fixed one-sided significance level of 5% is commonly used to interpret the statistical significance of randomized clinical trial (RCT) outcomes. While it is necessary to reduce the false positive rate, the threshold used could be chosen quantitatively and transparently to specifically reflect patient preferences regarding benefit-risk tradeoffs as well as other considerations. How can patient preferences be explicitly incorporated into RCTs in Parkinson's disease (PD), and what is the impact on statistical thresholds for device approval? In this analysis, we apply Bayesian decision analysis (BDA) to PD patient preference scores elicited from survey data. BDA allows us to choose a sample size (n) and significance level (α) that maximizes the overall expected value to patients of a balanced two-arm fixed-sample RCT, where the expected value is computed under both null and alternative hypotheses. For PD patients who had previously received deep brain stimulation (DBS) treatment, the BDA-optimal significance levels fell between 4.0% and 10.0%, similar to or greater than the traditional value of 5%. Conversely, for patients who had never received DBS, the optimal significance level ranged from 0.2% to 4.4%. In both of these populations, the optimal significance level increased with the severity of the patients' cognitive and motor function symptoms. By explicitly incorporating patient preferences into clinical trial designs and the regulatory decision-making process, BDA provides a quantitative and transparent approach to combine clinical and statistical significance. For PD patients who have never received DBS treatment, a 5% significance threshold may not be conservative enough to reflect their risk-aversion level. However, this study shows that patients who previously received DBS treatment present a higher tolerance to accept therapeutic risks in exchange for improved efficacy which is reflected in a higher statistical threshold.

Developing a Coordinated Registry Network for devices used for acute ischemic stroke intervention: basilar artery occlusion quality assessment pilot.

BACKGROUND: Real-world data can be helpful in evaluating endovascular therapy (EVT) in ischemic stroke care. We conducted a pilot study to aggregate data on basilar artery occlusion (BAO) EVT from existing registries in the USA. We evaluated the availability, completeness, quality, and consistency of common data elements (CDEs) across data sources. METHODS: We harmonized patient-level data from five registry data sources and assessed the availability, completeness (defined by the presence in at least four data sources), and consistency of CDEs. We assessed data quality based on seven pre-defined critical domains for BAO EVT investigation: baseline patient and disease characteristics; time metrics; description of intervention; adjunctive devices, revascularization scores, complications; post-intervention National Institutes of Health Stroke Scale scores; discharge disposition; 30-day and 90-day mortality and modified Rankin Scale (mRS) scores. RESULTS: The aggregated dataset of five registries included 493 BAO procedures between January 2013 and January 2020. In total, 88 CDEs were screened and 35 (40%) elements were considered prevalent. Of these 35 CDEs, the majority were collected for >80% of cases when aggregated. All seven pre-defined domains for BAO device investigation could be fulfilled with harmonized data elements. Most data elements were collected with consistent or compatible definitions across registries. The main challenge was the collection of 90-day outcomes. CONCLUSIONS: This pilot shows the feasibility of aggregating and harmonizing critical CDEs across registries to create a Coordinated Registry Network (CRN). The CRN with partnerships between multiple registries and stakeholders could help improve the breadth and/or depth of real-world data to help answer relevant questions and support clinical and regulatory decisions.

Development of a Patient Preference Survey for Wearable Kidney Replacement Therapy Devices.

Background: Recent innovations have the potential to disrupt the current paradigm for kidney failure treatment. The US Food and Drug Administration is committed to incorporating valid scientific evidence about how patients weigh the benefits and risks of new devices into their decision making, but to date, premarket submission of patient preference information (PPI) has been limited for kidney devices. With input from stakeholders, we developed a survey intended to yield valid PPI, capturing how patients trade off the potential benefits and risks of wearable dialysis devices and in-center hemodialysis. Methods: We conducted concept elicitation interviews with individuals receiving dialysis to inform instrument content. After instrument drafting, we conducted two rounds of pretest interviews to evaluate survey face validity, comprehensibility, and perceived relevance. We pilot tested the survey with in-center hemodialysis patients to assess comprehensibility and usability further. Throughout, we used participant input to guide survey refinements. Results: Thirty-six individuals receiving in-center or home dialysis participated in concept elicitation (N=20) and pretest (N=16) interviews. Participants identified reduced fatigue, lower treatment burden, and enhanced freedom as important benefits of a wearable device, and many expressed concerns about risks related to device disconnection-specifically bleeding and infection. We drafted a survey that included descriptions of the risks of serious bleeding and serious infection and an assessment of respondent willingness to wait for a safer device. Input from pretest interviewees led to various instrument modifications, including treatment descriptions, item wording, and risk-level explanations. Pilot testing of the updated survey among 24 in-center hemodialysis patients demonstrated acceptable survey comprehensibility and usability, although 50% of patients required some assistance. Conclusions: The final survey is a 54-item web-based instrument that will yield estimates of the maximal acceptable risk for the described wearable device and willingness to wait for wearable devices with lower risk.

Advancing the Real-World Evidence for Medical Devices through Coordinated Registry Networks.

Objectives: Generating and using real-world evidence (RWE) is a pragmatic solution for evaluating health technologies. RWE is recognized by regulators, health technology assessors, clinicians, and manufacturers as a valid source of information to support their decision-making. Well-designed registries can provide RWE and become more powerful when linked with electronic health records and administrative databases in coordinated registry networks (CRNs). Our objective was to create a framework of maturity of CRNs and registries, so guiding their development and the prioritization of funding. Design setting and participants: We invited 52 stakeholders from diverse backgrounds including patient advocacy groups, academic, clinical, industry and regulatory experts to participate on a Delphi survey. Of those invited, 42 participated in the survey to provide feedback on the maturity framework for CRNs and registries. An expert panel reviewed the responses to refine the framework until the target consensus of 80% was reached. Two rounds of the Delphi were distributed via Qualtrics online platform from July to August 2020 and from October to November 2020. Main outcome measures: Consensus on the maturity framework for CRNs and registries consisted of seven domains (unique device identification, efficient data collection, data quality, product life cycle approach, governance and sustainability, quality improvement, and patient-reported outcomes), each presented with five levels of maturity. Results: Of 52 invited experts, 41 (79.9%) responded to round 1; all 41 responded to round 2; and consensus was reached for most domains. The expert panel resolved the disagreements and final consensus estimates ranged from 80.5% to 92.7% for seven domains. Conclusions: We have developed a robust framework to assess the maturity of any CRN (or registry) to provide reliable RWE. This framework will promote harmonization of approaches to RWE generation across different disciplines and health systems. The domains and their levels may evolve over time as new solutions become available.

Patient-Centered Identification of Meaningful Regulatory Endpoints for Medical Devices to Treat Parkinson's Disease.

Introduction. A growing literature has developed on identifying outcomes that matter to patients. This study demonstrates an approach involving patient and regulatory perspectives to identify outcomes that are meaningful in the context of medical devices for Parkinson's disease (PD). Methods. A systematic process was used for specifying relevant regulatory endpoints by synthesizing inputs of various sources and stakeholders. First, a literature review was conducted to identify important benefits, risks, and other considerations for medical devices to treat PD; patient discussion groups (n = 6) were conducted to refine the list of considerations, followed by a survey (n = 29) to prioritize them; and patient and Food and Drug Administration (FDA) reviewers informed specification of the final endpoints. Two FDA clinicians gave clinical and regulatory perspectives at each step. Results. Movement symptoms were ranked as most important (ranked 1 or 2 by 72% of participants) and psychological and cognitive symptoms as the next most important (ranked 1 or 2 by 52% of participants). Within movement symptoms, falls, impaired movement, bradykinesia, resting tremor, stiffness, and rigidity were ranked highly. Overall, nine attributes were identified and prioritized as patient-centric for use in clinical trial design and quantitative patient preference studies. These attributes were benefits and risks related to therapeutics for PD as well as other considerations, including time until a medical device is available for patient use. Discussion. This prospective approach identified meaningful and relevant benefits, risks, and other considerations that may be used for clinical trial design and quantitative patient preference studies. Although PD was the focus of this study, the approach can be used to study patient perspectives about other disease or treatment areas.

Parkinson's Patients' Tolerance for Risk and Willingness to Wait for Potential Benefits of Novel Neurostimulation Devices: A Patient-Centered Threshold Technique Study.

Background. Parkinson's disease (PD) is neurodegenerative, causing motor, cognitive, psychological, somatic, and autonomic symptoms. Understanding PD patients' preferences for novel neurostimulation devices may help ensure that devices are delivered in a timely manner with the appropriate level of evidence. Our objective was to elicit preferences and willingness-to-wait for novel neurostimulation devices among PD patients to inform a model of optimal trial design. Methods. We developed and administered a survey to PD patients to quantify the maximum levels of risks that patients would accept to achieve potential benefits of a neurostimulation device. Threshold technique was used to quantify patients' risk thresholds for new or worsening depression or anxiety, brain bleed, or death in exchange for improvements in "on-time," motor symptoms, pain, cognition, and pill burden. The survey elicited patients' willingness to wait to receive treatment benefit. Patients were recruited through Fox Insight, an online PD observational study. Results. A total of 2740 patients were included and a majority were White (94.6%) and had a 4-year college degree (69.8%). Risk thresholds increased as benefits increased. Threshold for depression or anxiety was substantially higher than threshold for brain bleed or death. Patient age, ambulation, and prior neurostimulation experience influenced risk tolerance. Patients were willing to wait an average of 4 to 13 years for devices that provide different levels of benefit. Conclusions. PD patients are willing to accept substantial risks to improve symptoms. Preferences are heterogeneous and depend on treatment benefit and patient characteristics. The results of this study may be useful in informing review of device applications and other regulatory decisions and will be input into a model of optimal trial design for neurostimulation devices.

A Technology Roadmap for Innovative Approaches to Kidney Replacement Therapies: A Catalyst for Change.

The number of patients dialyzed for ESKD exceeds 500,000 in the United States and more than 2.6 million people worldwide, with the expectation that the worldwide number will double by 2030. The human cost of health and societal financial cost of ESKD is substantial. Dialytic therapy is associated with an unacceptably high morbidity and mortality rate and poor quality of life. Although innovation in many areas of science has been transformative, there has been little innovation in dialysis or alternatives for kidney replacement therapy (KRT) since its introduction approximately 70 years ago. Advances in kidney biology, stem cells and kidney cell differentiation protocols, biomaterials, sensors, nano/microtechnology, sorbents and engineering, and interdisciplinary approaches and collaborations can lead to disruptive innovation. The Kidney Health Initiative, a public-private partnership between the American Society of Nephrology and the US Food and Drug Administration, has convened a multidisciplinary group to create a technology roadmap for innovative approaches to KRT to address patients' needs. The Roadmap is a living document. It identifies the design criteria that must be considered to replace the myriad functions of the kidney, as well as scientific, technical, regulatory, and payor milestones required to commercialize and provide patient access to KRT alternatives. Various embodiments of potential solutions are discussed, but the Roadmap is agnostic to any particular solution set. System enablers are identified, including vascular access, biomaterial development, biologic and immunologic modulation, function, and safety monitoring. Important Roadmap supporting activities include regulatory alignment and innovative financial incentives and payment pathways. The Roadmap provides estimated timelines for replacement of specific kidney functions so that approaches can be conceptualized in ways that are actionable and attract talented innovators from multiple disciplines. The Roadmap has been used to guide the selection of KidneyX prizes for innovation in KRT.

Patient-centered clinical trials.

We apply Bayesian decision analysis (BDA) to incorporate patient preferences in the regulatory approval process for new therapies. By assigning weights to type I and type II errors based on patient preferences, the significance level (α) and power (1-ß) of a randomized clinical trial (RCT) for a new therapy can be optimized to maximize the value to current and future patients and, consequently, to public health. We find that for weight-loss devices, potentially effective low-risk treatments have optimal αs larger than the traditional one-sided significance level of 5%, whereas potentially less effective and riskier treatments have optimal αs below 5%. Moreover, the optimal RCT design, including trial size, varies with the risk aversion and time-to-access preferences and the medical need of the target population.