Stochastic perturbation methods for spike-timing-dependent plasticity.

Online machine learning rules and many biological spike-timing-dependent plasticity (STDP) learning rules generate jump process Markov chains for the synaptic weights. We give a perturbation expansion for the dynamics that, unlike the usual approximation by a Fokker-Planck equation (FPE), is well justified. Our approach extends the related system size expansion by giving an expansion for the probability density as well as its moments. We apply the approach to two observed STDP learning rules and show that in regimes where the FPE breaks down, the new perturbation expansion agrees well with Monte Carlo simulations. The methods are also applicable to the dynamics of stochastic neural activity. Like previous ensemble analyses of STDP, we focus on equilibrium solutions, although the methods can in principle be applied to transients as well.

Kernels for longitudinal data with variable sequence length and sampling intervals.

We develop several kernel methods for classification of longitudinal data and apply them to detect cognitive decline in the elderly. We first develop mixed-effects models, a type of hierarchical empirical Bayes generative models, for the time series. After demonstrating their utility in likelihood ratio classifiers (and the improvement over standard regression models for such classifiers), we develop novel Fisher kernels based on mixture of mixed-effects models and use them in support vector machine classifiers. The hierarchical generative model allows us to handle variations in sequence length and sampling interval gracefully. We also give nonparametric kernels not based on generative models, but rather on the reproducing kernel Hilbert space. We apply the methods to detecting cognitive decline from longitudinal clinical data on motor and neuropsychological tests. The likelihood ratio classifiers based on the neuropsychological tests perform better than than classifiers based on the motor behavior. Discriminant classifiers performed better than likelihood ratio classifiers for the motor behavior tests.

Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness.

BACKGROUND: Emotional awareness and self-regulation are important skills for improving mental health and reducing the risk of cardiovascular disease. Cognitive behavioral therapy can teach these skills but is not widely available. OBJECTIVE: This exploratory study examined the potential of mobile phone technologies to broaden access to cognitive behavioral therapy techniques and to provide in-the-moment support. METHODS: We developed a mobile phone application with touch screen scales for mood reporting and therapeutic exercises for cognitive reappraisal (ie, examination of maladaptive interpretations) and physical relaxation. The application was deployed in a one-month field study with eight individuals who had reported significant stress during an employee health assessment. Participants were prompted via their mobile phones to report their moods several times a day on a Mood Map-a translation of the circumplex model of emotion-and a series of single-dimension mood scales. Using the prototype, participants could also activate mobile therapies as needed. During weekly open-ended interviews, participants discussed their use of the device and responded to longitudinal views of their data. Analyses included a thematic review of interview narratives, assessment of mood changes over the course of the study and the diurnal cycle, and interrogation of this mobile data based on stressful incidents reported in interviews. RESULTS: Five case studies illustrate participants' use of the mobile phone application to increase self-awareness and to cope with stress. One example is a participant who had been coping with longstanding marital conflict. After reflecting on his mood data, particularly a drop in energy each evening, the participant began practicing relaxation therapies on the phone before entering his house, applying cognitive reappraisal techniques to cope with stressful family interactions, and talking more openly with his wife. His mean anger, anxiety and sadness ratings all were lower in the second half of the field study than in the first (P

Optimizing medication reminders using a decision-theoretic framework.

We discuss a new approach to patients' adherence to enhance to their medication-taking regimen by developing a context-aware alerting system that would optimize the expected utility of alerts. Each patient's instantaneous context is assessed using a real-time sensor network deploying a variety of sensors. The alerts are generated to optimize the expected value to the patient. This paper is focused on the initial assessment of the utility of alerts, including the tradeoff between effectiveness and annoyance.

A study of medication-taking and unobtrusive, intelligent reminding.

Poor medication adherence is one of the major causes of illness and of treatment failure in the United States. The objective of this study was to conduct an initial evaluation of a context-aware reminder system, which generated reminders at an opportune time to take the medication. Ten participants aged 65 or older, living alone and managing their own medications, participated in the study. Participants took a low-dose vitamin C tablet twice daily at times that they specified. Participants were considered adherent if they took the vitamin within 90 minutes (before or after) of the prescribed time. Adherence and activity in the home was measured using a system of sensors, including an instrumented pillbox. There were three phases of the study: baseline, in which there was no prompting; time-based, in which there was prompting at the prescribed times for pill-taking; and context-aware, in which participants were only prompted if they forgot to take their pills and were likely able to take their pills. The context-based prompting resulted in significantly better adherence (92.3%) as compared to time-based (73.5%) or no prompting (68.1%) conditions (p < 0.0002, chi(2) = 17.0). In addition, subjects had better adherence in the morning than in the evening. We have shown in this study that a system that generates reminders at an opportune time to take the medication significantly improves adherence. This study indicates that context-aware prompting may provide improved adherence over standard time-based reminders.

A Probabilistic Active Learning Algorithm Based on Fisher Information Ratio.

The task of labeling samples is demanding and expensive. Active learning aims to generate the smallest possible training data set that results in a classifier with high performance in the test phase. It usually consists of two steps of selecting a set of queries and requesting their labels. Among the suggested objectives to score the query sets, information theoretic measures have become very popular. Yet among them, those based on Fisher information (FI) have the advantage of considering the diversity among the queries and tractable computations. In this work, we provide a practical algorithm based on Fisher information ratio to obtain query distribution for a general framework where, in contrast to the previous FI-based querying methods, we make no assumptions over the test distribution. The empirical results on synthetic and real-world data sets indicate that this algorithm gives competitive results.

Fast neural network surrogates for very high dimensional physics-based models in computational oceanography.

We present neural network surrogates that provide extremely fast and accurate emulation of a large-scale circulation model for the coupled Columbia River, its estuary and near ocean regions. The circulation model has O(10(7)) degrees of freedom, is highly nonlinear and is driven by ocean, atmospheric and river influences at its boundaries. The surrogates provide accurate emulation of the full circulation code and run over 1000 times faster. Such fast dynamic surrogates will enable significant advances in ensemble forecasts in oceanography and weather.

Random walks for spike-timing-dependent plasticity.

Random walk methods are used to calculate the moments of negative image equilibrium distributions in synaptic weight dynamics governed by spike-timing-dependent plasticity. The neural architecture of the model is based on the electrosensory lateral line lobe of mormyrid electric fish, which forms a negative image of the reafferent signal from the fish's own electric discharge to optimize detection of sensory electric fields. Of particular behavioral importance to the fish is the variance of the equilibrium postsynaptic potential in the presence of noise, which is determined by the variance of the equilibrium weight distribution. Recurrence relations are derived for the moments of the equilibrium weight distribution, for arbitrary postsynaptic potential functions and arbitrary learning rules. For the case of homogeneous network parameters, explicit closed form solutions are developed for the covariances of the synaptic weight and postsynaptic potential distributions.

Stability of negative-image equilibria in spike-timing-dependent plasticity.

We investigate the stability of negative image equilibria in mean synaptic weight dynamics governed by spike-timing-dependent plasticity (STDP). The model architecture closely follows the anatomy and physiology of the electrosensory lateral line lobe (ELL) of mormyrid electric fish. The ELL uses a spike-timing-dependent learning rule to form a negative image of the reafferent signal from the fish's own electric discharge, thus improving detectability of external electric fields. We derive sufficient conditions for existence of the negative image and necessary and sufficient conditions for stability, for arbitrary postsynaptic potential functions and arbitrary learning rules. This significantly generalizes earlier investigations. We then apply the general result to several examples of biological interest, including a class of learning rules consistent with the rule observed experimentally in the mormyrid ELL.

Statistical error detection for clinical laboratory tests.

Errors in clinical laboratory tests lead to increased costs and patient risks. Such errors are relatively rare, affecting ∼0.5% of samples. Existing techniques for detecting errors have either far too low sensitivity or specificity to be useful. This preliminary study develops statistical sample selection criteria that capture faults upwards of fifty times more efficiently than expected from random sampling. Although this is only the first step towards an integrated discriminant system for reliable detection of laboratory errors, the statistical detection scheme demonstrated here outperforms existing methods.

Approximating distributions in stochastic learning.

On-line machine learning algorithms, many biological spike-timing-dependent plasticity (STDP) learning rules, and stochastic neural dynamics evolve by Markov processes. A complete description of such systems gives the probability densities for the variables. The evolution and equilibrium state of these densities are given by a Chapman-Kolmogorov equation in discrete time, or a master equation in continuous time. These formulations are analytically intractable for most cases of interest, and to make progress a nonlinear Fokker-Planck equation (FPE) is often used in their place. The FPE is limited, and some argue that its application to describe jump processes (such as in these problems) is fundamentally flawed. We develop a well-grounded perturbation expansion that provides approximations for both the density and its moments. The approach is based on the system size expansion in statistical physics (which does not give approximations for the density), but our simple development makes the methods accessible and invites application to diverse problems. We apply the method to calculate the equilibrium distributions for two biologically-observed STDP learning rules and for a simple nonlinear machine-learning problem. In all three examples, we show that our perturbation series provides good agreement with Monte-Carlo simulations in regimes where the FPE breaks down.

Anti-hebbian spike-timing-dependent plasticity and adaptive sensory processing.

Adaptive sensory processing influences the central nervous system's interpretation of incoming sensory information. One of the functions of this adaptive sensory processing is to allow the nervous system to ignore predictable sensory information so that it may focus on important novel information needed to improve performance of specific tasks. The mechanism of spike-timing-dependent plasticity (STDP) has proven to be intriguing in this context because of its dual role in long-term memory and ongoing adaptation to maintain optimal tuning of neural responses. Some of the clearest links between STDP and adaptive sensory processing have come from in vitro, in vivo, and modeling studies of the electrosensory systems of weakly electric fish. Plasticity in these systems is anti-Hebbian, so that presynaptic inputs that repeatedly precede, and possibly could contribute to, a postsynaptic neuron's firing are weakened. The learning dynamics of anti-Hebbian STDP learning rules are stable if the timing relations obey strict constraints. The stability of these learning rules leads to clear predictions of how functional consequences can arise from the detailed structure of the plasticity. Here we review the connection between theoretical predictions and functional consequences of anti-Hebbian STDP, focusing on adaptive processing in the electrosensory system of weakly electric fish. After introducing electrosensory adaptive processing and the dynamics of anti-Hebbian STDP learning rules, we address issues of predictive sensory cancelation and novelty detection, descending control of plasticity, synaptic scaling, and optimal sensory tuning. We conclude with examples in other systems where these principles may apply.

Model-based inference of cognitive processes from unobtrusive gait velocity measurements.

In this paper we describe a preliminary modeling and analysis of a unique data set comprising unobtrusive and continuous measurements of gait velocity in the elder participants' residences. The data have been collected as a part of a longitudinal study aimed at early detection of cognitive decline. We motivate these analyses by first presenting evidence that suggests significant relationship between gait parameters and cognitive functions. We then describe a simple, model-based approach to the analysis of gait velocity using a weighted correlation function estimates. One of the main challenges is due to the fact that the daily estimates of the gait parameters vary with the number of walks. We illustrate the importance of using weighted as opposed to unweighted estimates on a sample of different houses. The correlation functions appear to capture behavioral differences that can be related to the cognitive functioning of the participants.

Penalized probabilistic clustering.

While clustering is usually an unsupervised operation, there are circumstances in which we believe (with varying degrees of certainty) that items A and B should be assigned to the same cluster, while items A and C should not. We would like such pairwise relations to influence cluster assignments of out-of-sample data in a manner consistent with the prior knowledge expressed in the training set. Our starting point is probabilistic clustering based on gaussian mixture models (GMM) of the data distribution. We express clustering preferences in a prior distribution over assignments of data points to clusters. This prior penalizes cluster assignments according to the degree with which they violate the preferences. The model parameters are fit with the expectation-maximization (EM) algorithm. Our model provides a flexible framework that encompasses several other semisupervised clustering models as its special cases. Experiments on artificial and real-world problems show that our model can consistently improve clustering results when pairwise relations are incorporated. The experiments also demonstrate the superiority of our model to other semisupervised clustering methods on handling noisy pairwise relations.

Reduction of multi-dimensional laboratory data to a two-dimensional plot: a novel technique for the identification of laboratory error.

BACKGROUND: The clinical laboratory generates large amounts of patient-specific data. Detection of errors that arise during pre-analytical, analytical, and post-analytical processes is difficult. We performed a pilot study, utilizing a multidimensional data reduction technique, to assess the utility of this method for identifying errors in laboratory data. METHODS: We evaluated 13,670 individual patient records collected over a 2-month period from hospital inpatients and outpatients. We utilized those patient records that contained a complete set of 14 different biochemical analytes. We used two-dimensional generative topographic mapping to project the 14-dimensional record to a two-dimensional space. RESULTS AND CONCLUSIONS: The use of a two-dimensional generative topographic mapping technique to plot multi-analyte patient data as a two-dimensional graph allows for the rapid identification of potentially anomalous data. Although we performed a retrospective analysis, this technique has the benefit of being able to assess laboratory-generated data in real time, allowing for the rapid identification and correction of anomalous data before they are released to the physician. In addition, serial laboratory multi-analyte data for an individual patient can also be plotted as a two-dimensional plot. This tool might also be useful for assessing patient wellbeing and prognosis.