Use of Bayesian decision analysis to maximize value in patient-centered randomized clinical trials in Parkinson's disease.

A fixed one-sided significance level of 5% is commonly used to interpret the statistical significance of randomized clinical trial (RCT) outcomes. While it is necessary to reduce the false positive rate, the threshold used could be chosen quantitatively and transparently to specifically reflect patient preferences regarding benefit-risk tradeoffs as well as other considerations. How can patient preferences be explicitly incorporated into RCTs in Parkinson's disease (PD), and what is the impact on statistical thresholds for device approval? In this analysis, we apply Bayesian decision analysis (BDA) to PD patient preference scores elicited from survey data. BDA allows us to choose a sample size (n) and significance level (α) that maximizes the overall expected value to patients of a balanced two-arm fixed-sample RCT, where the expected value is computed under both null and alternative hypotheses. For PD patients who had previously received deep brain stimulation (DBS) treatment, the BDA-optimal significance levels fell between 4.0% and 10.0%, similar to or greater than the traditional value of 5%. Conversely, for patients who had never received DBS, the optimal significance level ranged from 0.2% to 4.4%. In both of these populations, the optimal significance level increased with the severity of the patients' cognitive and motor function symptoms. By explicitly incorporating patient preferences into clinical trial designs and the regulatory decision-making process, BDA provides a quantitative and transparent approach to combine clinical and statistical significance. For PD patients who have never received DBS treatment, a 5% significance threshold may not be conservative enough to reflect their risk-aversion level. However, this study shows that patients who previously received DBS treatment present a higher tolerance to accept therapeutic risks in exchange for improved efficacy which is reflected in a higher statistical threshold.

Patient-Centered Identification of Meaningful Regulatory Endpoints for Medical Devices to Treat Parkinson's Disease.

Introduction. A growing literature has developed on identifying outcomes that matter to patients. This study demonstrates an approach involving patient and regulatory perspectives to identify outcomes that are meaningful in the context of medical devices for Parkinson's disease (PD). Methods. A systematic process was used for specifying relevant regulatory endpoints by synthesizing inputs of various sources and stakeholders. First, a literature review was conducted to identify important benefits, risks, and other considerations for medical devices to treat PD; patient discussion groups (n = 6) were conducted to refine the list of considerations, followed by a survey (n = 29) to prioritize them; and patient and Food and Drug Administration (FDA) reviewers informed specification of the final endpoints. Two FDA clinicians gave clinical and regulatory perspectives at each step. Results. Movement symptoms were ranked as most important (ranked 1 or 2 by 72% of participants) and psychological and cognitive symptoms as the next most important (ranked 1 or 2 by 52% of participants). Within movement symptoms, falls, impaired movement, bradykinesia, resting tremor, stiffness, and rigidity were ranked highly. Overall, nine attributes were identified and prioritized as patient-centric for use in clinical trial design and quantitative patient preference studies. These attributes were benefits and risks related to therapeutics for PD as well as other considerations, including time until a medical device is available for patient use. Discussion. This prospective approach identified meaningful and relevant benefits, risks, and other considerations that may be used for clinical trial design and quantitative patient preference studies. Although PD was the focus of this study, the approach can be used to study patient perspectives about other disease or treatment areas.

Parkinson's Patients' Tolerance for Risk and Willingness to Wait for Potential Benefits of Novel Neurostimulation Devices: A Patient-Centered Threshold Technique Study.

Background. Parkinson's disease (PD) is neurodegenerative, causing motor, cognitive, psychological, somatic, and autonomic symptoms. Understanding PD patients' preferences for novel neurostimulation devices may help ensure that devices are delivered in a timely manner with the appropriate level of evidence. Our objective was to elicit preferences and willingness-to-wait for novel neurostimulation devices among PD patients to inform a model of optimal trial design. Methods. We developed and administered a survey to PD patients to quantify the maximum levels of risks that patients would accept to achieve potential benefits of a neurostimulation device. Threshold technique was used to quantify patients' risk thresholds for new or worsening depression or anxiety, brain bleed, or death in exchange for improvements in "on-time," motor symptoms, pain, cognition, and pill burden. The survey elicited patients' willingness to wait to receive treatment benefit. Patients were recruited through Fox Insight, an online PD observational study. Results. A total of 2740 patients were included and a majority were White (94.6%) and had a 4-year college degree (69.8%). Risk thresholds increased as benefits increased. Threshold for depression or anxiety was substantially higher than threshold for brain bleed or death. Patient age, ambulation, and prior neurostimulation experience influenced risk tolerance. Patients were willing to wait an average of 4 to 13 years for devices that provide different levels of benefit. Conclusions. PD patients are willing to accept substantial risks to improve symptoms. Preferences are heterogeneous and depend on treatment benefit and patient characteristics. The results of this study may be useful in informing review of device applications and other regulatory decisions and will be input into a model of optimal trial design for neurostimulation devices.

Integrating the Voice of the Patient Into the Medical Device Regulatory Process Using Patient Preference Information.

The US Food and Drug Administration is one of several US and global agencies making strides to incorporate patient preference information (PPI) into its decision making. PPI has been included in 5 completed medical device marketing decisions to date. Its usage is not more widespread because of uncertainty about how to design "fit-for-purpose" patient preference studies and a lack of standards for the choice of preference elicitation methods, among other reasons. To advance the application of PPI to decision making about medical devices, the Food and Drug Administration has published a guidance document, "Patient Preference Information-Voluntary Submission, Review in Premarket Approval Applications, Humanitarian Device Exemption Applications, and De Novo Requests, and Inclusion in Decision Summaries and Device Labeling." This article discusses key concepts in the guidance document, in addition to providing lessons learned from the use of PPI for medical device regulatory applications to date and identifying new opportunities to leverage PPI to elevate the patient voice in the medical device product life cycle.

Changes in human brain dynamics during behavioral priming and repetition suppression.

Behavioral responses to a perceptual stimulus are typically faster with repeated exposure to the stimulus (behavioral priming). This implicit learning mechanism is critical for survival but impaired in a variety of neurological disorders, including Alzheimer's disease. Many studies of the neural bases for behavioral priming have encountered an interesting paradox: in spite of faster behavioral responses, repeated stimuli usually elicit weaker neural responses (repetition suppression). Several neurophysiological models have been proposed to resolve this paradox, but noninvasive techniques for human studies have had insufficient spatial-temporal precision for testing their predictions. Here, we used the unparalleled precision of electrocorticography (ECoG) to analyze the timing and magnitude of task-related changes in neural activation and propagation while patients named novel vs repeated visual objects. Stimulus repetition was associated with faster verbal responses and decreased neural activation (repetition suppression) in ventral occipito-temporal cortex (VOTC) and left prefrontal cortex (LPFC). Interestingly, we also observed increased neural activation (repetition enhancement) in LPFC and other recording sites. Moreover, with analysis of high gamma propagation we observed increased top-down propagation from LPFC into VOTC, preceding repetition suppression. The latter results indicate that repetition suppression and behavioral priming are associated with strengthening of top-down network influences on perceptual processing, consistent with predictive coding models of repetition suppression, and they support a central role for changes in large-scale cortical dynamics in achieving more efficient and rapid behavioral responses.

Virtual Reality Provides an Effective Platform for Functional Evaluations of Closed-Loop Neuromyoelectric Control.

Although recent advances in neuroprostheses offer opportunities for improved and intuitive control of advanced motorized and sensorized robotic arms, practical complications associated with such hardware can impede the research necessary for clinical translation. These hurdles potentially can be reduced with virtual reality environments (VREs) with embedded physics engines using virtual models of physical robotic hands. These software suites offer several advantages over physical prototypes, including high repeatability, reduced human error, elimination of many secondary sensory cues, and others. There are limited demonstrations of closed-loop prostheses in the VRE, and it is unclear whether VRE performance translates to the physical world. Here we describe how two trans-radial amputees with neural and intramuscular implants identified objects and performed activities of daily living with closed-loop control of prostheses in the VRE. Our initial evidence further suggests that capabilities with virtual prostheses may be predictors of physical prosthesis performance, demonstrating the utility of VREs for neuroprosthetic research.

Identifying and prioritizing concerns associated with prosthetic devices for use in a benefit-risk assessment: a mixed-methods approach.

OBJECTIVE: We identified and prioritized concerns reported by stakeholders associated with novel upper-limb prostheses. METHODS: An evidence review and key-informant engagement, identified 62 concerns with upper-limb prostheses with implantable components. We selected 16 concerns for inclusion in a best-worst scaling (BWS) prioritization survey. Focus groups and BWS were used to engage stakeholders at a public meeting on prostheses. In 16 BWS choice tasks, attendees selected the most and least influential concern when choosing an upper-limb prosthesis. Aggregate data were analyzed using choice frequencies and conditional logit analysis. Latent class analysis examined heterogeneity in priorities. Estimates were adjusted to importance ratios which indicate how influential each concern is in the decision making process. RESULTS: Forty-seven (47) stakeholders from diverse backgrounds completed the BWS survey (response rate 51%). On aggregate, the most influential concern was reliability of the device (importance ratio: 13%), and least influential was the concern of an outdated device (importance ratio: 1%). Latent class analysis identified two classes with approximately 50% of participants each. The first class was most influenced by effectiveness of the device. The second class was most influenced by minimizing risks. CONCLUSION: In this pilot, we identified heterogeneity in how participants prioritize concerns for upper-limb prostheses.

Neuroprosthetics and the science of patient input.

Safe and effective neuroprosthetic systems are of great interest to both DARPA and CDRH, due to their innovative nature and their potential to aid severely disabled populations. By expanding what is possible in human-device interaction, these devices introduce new potential benefits and risks. Therefore patient input, which is increasingly important in weighing benefits and risks, is particularly relevant for this class of devices. FDA has been a significant contributor to an ongoing stakeholder conversation about the inclusion of the patient voice, working collaboratively to create a new framework for a patient-centered approach to medical device development. This framework is evolving through open dialogue with researcher and patient communities, investment in the science of patient input, and policymaking that is responsive to patient-centered data throughout the total product life cycle. In this commentary, we will discuss recent developments in patient-centered benefit-risk assessment and their relevance to the development of neural prosthetic systems.

Cortical subnetwork dynamics during human language tasks.

Language tasks require the coordinated activation of multiple subnetworks-groups of related cortical interactions involved in specific components of task processing. Although electrocorticography (ECoG) has sufficient temporal and spatial resolution to capture the dynamics of event-related interactions between cortical sites, it is difficult to decompose these complex spatiotemporal patterns into functionally discrete subnetworks without explicit knowledge of each subnetwork's timing. We hypothesized that subnetworks corresponding to distinct components of task-related processing could be identified as groups of interactions with co-varying strengths. In this study, five subjects implanted with ECoG grids over language areas performed word repetition and picture naming. We estimated the interaction strength between each pair of electrodes during each task using a time-varying dynamic Bayesian network (tvDBN) model constructed from the power of high gamma (70-110Hz) activity, a surrogate for population firing rates. We then reduced the dimensionality of this model using principal component analysis (PCA) to identify groups of interactions with co-varying strengths, which we term functional network components (FNCs). This data-driven technique estimates both the weight of each interaction's contribution to a particular subnetwork, and the temporal profile of each subnetwork's activation during the task. We found FNCs with temporal and anatomical features consistent with articulatory preparation in both tasks, and with auditory and visual processing in the word repetition and picture naming tasks, respectively. These FNCs were highly consistent between subjects with similar electrode placement, and were robust enough to be characterized in single trials. Furthermore, the interaction patterns uncovered by FNC analysis correlated well with recent literature suggesting important functional-anatomical distinctions between processing external and self-produced speech. Our results demonstrate that subnetwork decomposition of event-related cortical interactions is a powerful paradigm for interpreting the rich dynamics of large-scale, distributed cortical networks during human cognitive tasks.

Upper extremity prosthesis user perspectives on unmet needs and innovative technology.

The needs of individuals with upper limb amputation and congenital limb difference are not being fully met by current prostheses, as evidenced by prosthesis rejection, non-wear, and user reports of pain and challenging activities. Emerging technologies such as dexterous sensorized robotic limbs, osseointegrated prostheses, implantable EMG electrodes, and electrical stimulation for sensory feedback have the potential to address unmet needs, but pose additional risks. We plan to assess upper limb prosthesis user needs and perspectives on these new benefits and risks using an extensive quantitative survey. In preparation for this survey, we report here on qualitative interviews with seven individuals with upper limb amputation or congenital limb difference. Unstructured text was mined using topic modeling and the results compared with identified themes. A more complete understanding of how novel technologies could address real user concerns will inform implementation of new technologies and regulatory decision-making.

System to induce and measure embodiment of an artificial hand with programmable convergent visual and tactile stimuli.

The sense of prosthesis embodiment, or the feeling that the device has been incorporated into a user's body image, may be enhanced by emerging technology such as invasive electrical stimulation for sensory feedback. In turn, prosthesis embodiment may be linked to increased prosthesis use and improved functional outcomes. We describe the development of a tool to assay artificial hand embodiment in a quantitative way in people with intact limbs, and characterize its operation. The system delivers temporally coordinated visual and tactile stimuli at a programmable latency while recording limb temperature. When programmed to deliver visual and tactile stimuli synchronously, recorded latency between the two was 33 ± 24 ms in the final pilot subject. This system enables standardized assays of the conditions necessary for prosthesis embodiment.

Coarse electrocorticographic decoding of ipsilateral reach in patients with brain lesions.

In patients with unilateral upper limb paralysis from strokes and other brain lesions, strategies for functional recovery may eventually include brain-machine interfaces (BMIs) using control signals from residual sensorimotor systems in the damaged hemisphere. When voluntary movements of the contralateral limb are not possible due to brain pathology, initial training of such a BMI may require use of the unaffected ipsilateral limb. We conducted an offline investigation of the feasibility of decoding ipsilateral upper limb movements from electrocorticographic (ECoG) recordings in three patients with different lesions of sensorimotor systems associated with upper limb control. We found that the first principal component (PC) of unconstrained, naturalistic reaching movements of the upper limb could be decoded from ipsilateral ECoG using a linear model. ECoG signal features yielding the best decoding accuracy were different across subjects. Performance saturated with very few input features. Decoding performances of 0.77, 0.73, and 0.66 (median Pearson's r between the predicted and actual first PC of movement using nine signal features) were achieved in the three subjects. The performance achieved here with small numbers of electrodes and computationally simple decoding algorithms suggests that it may be possible to control a BMI using ECoG recorded from damaged sensorimotor brain systems.

Joint spatial-spectral feature space clustering for speech activity detection from ECoG signals.

Brain-machine interfaces for speech restoration have been extensively studied for more than two decades. The success of such a system will depend in part on selecting the best brain recording sites and signal features corresponding to speech production. The purpose of this study was to detect speech activity automatically from electrocorticographic signals based on joint spatial-frequency clustering of the ECoG feature space. For this study, the ECoG signals were recorded while a subject performed two different syllable repetition tasks. We found that the optimal frequency resolution to detect speech activity from ECoG signals was 8 Hz, achieving 98.8% accuracy by employing support vector machines as a classifier. We also defined the cortical areas that held the most information about the discrimination of speech and nonspeech time intervals. Additionally, the results shed light on the distinct cortical areas associated with the two syllables repetition tasks and may contribute to the development of portable ECoG-based communication.

Neuroprosthetic limb control with electrocorticography: approaches and challenges.

Advanced upper limb prosthetics, such as the Johns Hopkins Applied Physics Lab Modular Prosthetic Limb (MPL), are now available for research and preliminary clinical applications. Research attention has shifted to developing means of controlling these prostheses. Penetrating microelectrode arrays are often used in animal and human models to decode action potentials for cortical control. These arrays may suffer signal loss over the long-term and therefore should not be the only implant type investigated for chronic BMI use. Electrocorticographic (ECoG) signals from electrodes on the cortical surface may provide more stable long-term recordings. Several studies have demonstrated ECoG's potential for decoding cortical activity. As a result, clinical studies are investigating ECoG encoding of limb movement, as well as its use for interfacing with and controlling advanced prosthetic arms. This overview presents the technical state of the art in the use of ECoG in controlling prostheses. Technical limitations of the current approach and future directions are also presented.

Toward electrocorticographic control of a dexterous upper limb prosthesis: building brain-machine interfaces.

One of the most exciting and compelling areas of research and development is building brain machine interfaces (BMIs) for controlling prosthetic limbs. Prosthetic limb technology is advancing rapidly, and the modular prosthetic limb (MPL) of the Johns Hopkins University/ Applied Physics Laboratory (JHU/APL) permits actuation with 17 degrees of freedom in 26 articulating joints. There are many signals from the brain that can be leveraged, including the spiking rates of neurons in the cortex, electrocorticographic (ECoG) signals from the surface of the cortex, and electroencephalographic (EEG) signals from the scalp. Unlike microelectrodes that record spikes, ECoG does not penetrate the cortex and has a higher spatial specificity, signal-to-noise ratio, and bandwidth than EEG signals. We have implemented an ECoG-based system for controlling the MPL in the Johns Hopkins Hospital Epilepsy Monitoring Unit, where patients are implanted with ECoG electrode grids for clinical seizure mapping and asked to perform various recorded finger or grasp movements. We have shown that low-frequency local motor potentials (LMPs) and ECoG power in the high gamma frequency (70,150 Hz) range correlate well with grasping parameters, and they stand out as good candidate features for closed-loop control of the MPL.

Directed causality of the human electrocorticogram during dexterous movement.

While significant strides have been made in designing brain-machine interfaces for use in humans, efforts to decode truly dexterous movements in real time have been hindered by difficulty extracting detailed movement-related information from the most practical human neural interface, the electrocorticogram (ECoG). We explore a potentially rich, largely untapped source of movement-related information in the form of cortical connectivity computed with time-varying dynamic Bayesian networks (TV-DBN). We discover that measures of connectivity between ECoG electrodes derived from the local motor potential vary with dexterous movement in 65% of movement-related electrode pairs tested, and measures of connectivity derived from spectral features vary with dexterous movement in 76%. Due to the large number of features generated with connectivity methods, the TV-DBN a promising tool for dexterous decoding.

Connectivity analysis as a novel approach to motor decoding for prosthesis control.

The use of neural signals for prosthesis control is an emerging frontier of research to restore lost function to amputees and the paralyzed. Electrocorticography (ECoG) brain-machine interfaces (BMI) are an alternative to EEG and neural spiking and local field potential BMI approaches. Conventional ECoG BMIs rely on spectral analysis at specific electrode sites to extract signals for controlling prostheses. We compare traditional features with information about the connectivity of an ECoG electrode network. We use time-varying dynamic Bayesian networks (TV-DBN) to determine connectivity between ECoG channels in humans during a motor task. We show that, on average, TV-DBN connectivity decreases from baseline preceding movement and then becomes negative, indicating an alteration in the phase relationship between electrode pairs. In some subjects, this change occurs preceding and during movement, before changes in low or high frequency power. We tested TV-DBN output in a hand kinematic decoder and obtained an average correlation coefficient (r(2)) between actual and predicted joint angle of 0.40, and as high as 0.66 in one subject. This result compares favorably with spectral feature decoders, for which the average correlation coefficient was 0.13. This work introduces a new feature set based on connectivity and demonstrates its potential to improve ECoG BMI accuracy.

Connectivity mapping of the human ECoG during a motor task with a time-varying dynamic Bayesian network.

As a partially invasive and clinically obtained neural signal, the electrocorticogram (ECoG) provides a unique opportunity to study cortical processing in humans in vivo. Functional connectivity mapping based on the ECoG signal can provide insight into epileptogenic zones and putative cortical circuits. We describe the first application of time-varying dynamic Bayesian networks (TVDBN) to the ECoG signal for the identification and study of cortical circuits. Connectivity between motor areas as well as between sensory and motor areas preceding and during movement is described. We further apply the connectivity results of the TVDBN to a movement decoder, which achieves a correlation between actual and predicted hand movements of 0.68. This paper presents evidence that the connectivity information discovered with TVDBN is applicable to the design of an ECoG-based brain-machine interface.