Spiking Laguerre Volterra networks - predicting neuronal activity from local field potentials.

OBJECTIVE: Understanding the generative mechanism between Local Field Potentials (LFP) and neuronal spiking activity is a crucial step for understanding information processing in the brain. Up to now, most approaches have relied on simply quantifying the coupling between LFP and spikes. However, very few have managed to predict the exact timing of spike occurrence based on LFP variations. APPROACH: Here, we fill this gap by proposing novel spiking Laguerre-Volterra Network (sLVN) models to describe the dynamic LFP-spike relationship. Compared to conventional artificial neural networks, the sLVNs are interpretable models that provide explainable features of the underlying dynamics. MAIN RESULTS: The proposed networks were applied on extracellular microelectrode recordings of Parkinson's Disease (PD) patients during Deep Brain Stimulation (DBS) surgery. Based on the predictability of the LFP-spike pairs, we detected three neuronal populations with unique signal characteristics and sLVN model features. SIGNIFICANCE: These clusters were indirectly associated with motor score improvement following DBS surgery, warranting further investigation into the potential of spiking activity predictability as an intraoperative biomarker for optimal DBS lead placement.

Artificial Intelligence and Machine Learning for Improving Glycemic Control in Diabetes: Best Practices, Pitfalls, and Opportunities.

OBJECTIVE: Artificial intelligence and machine learning are transforming many fields including medicine. In diabetes, robust biosensing technologies and automated insulin delivery therapies have created a substantial opportunity to improve health. While the number of manuscripts addressing the topic of applying machine learning to diabetes has grown in recent years, there has been a lack of consistency in the methods, metrics, and data used to train and evaluate these algorithms. This manuscript provides consensus guidelines for machine learning practitioners in the field of diabetes, including best practice recommended approaches and warnings about pitfalls to avoid. METHODS: Algorithmic approaches are reviewed and benefits of different algorithms are discussed including importance of clinical accuracy, explainability, interpretability, and personalization. We review the most common features used in machine learning applications in diabetes glucose control and provide an open-source library of functions for calculating features, as well as a framework for specifying data sets using data sheets. A review of current data sets available for training algorithms is provided as well as an online repository of data sources. SIGNIFICANCE: These consensus guidelines are designed to improve performance and translatability of new machine learning algorithms developed in the field of diabetes for engineers and data scientists.

The smarty4covid dataset and knowledge base as a framework for interpretable physiological audio data analysis.

Harnessing the power of Artificial Intelligence (AI) and m-health towards detecting new bio-markers indicative of the onset and progress of respiratory abnormalities/conditions has greatly attracted the scientific and research interest especially during COVID-19 pandemic. The smarty4covid dataset contains audio signals of cough (4,676), regular breathing (4,665), deep breathing (4,695) and voice (4,291) as recorded by means of mobile devices following a crowd-sourcing approach. Other self reported information is also included (e.g. COVID-19 virus tests), thus providing a comprehensive dataset for the development of COVID-19 risk detection models. The smarty4covid dataset is released in the form of a web-ontology language (OWL) knowledge base enabling data consolidation from other relevant datasets, complex queries and reasoning. It has been utilized towards the development of models able to: (i) extract clinically informative respiratory indicators from regular breathing records, and (ii) identify cough, breath and voice segments in crowd-sourced audio recordings. A new framework utilizing the smarty4covid OWL knowledge base towards generating counterfactual explanations in opaque AI-based COVID-19 risk detection models is proposed and validated.

The Ultrasound Window Into Vascular Ageing: A Technology Review by the VascAgeNet COST Action.

Non-invasive ultrasound (US) imaging enables the assessment of the properties of superficial blood vessels. Various modes can be used for vascular characteristics analysis, ranging from radiofrequency (RF) data, Doppler- and standard B/M-mode imaging, to more recent ultra-high frequency and ultrafast techniques. The aim of the present work was to provide an overview of the current state-of-the-art non-invasive US technologies and corresponding vascular ageing characteristics from a technological perspective. Following an introduction about the basic concepts of the US technique, the characteristics considered in this review are clustered into: 1) vessel wall structure; 2) dynamic elastic properties, and 3) reactive vessel properties. The overview shows that ultrasound is a versatile, non-invasive, and safe imaging technique that can be adopted for obtaining information about function, structure, and reactivity in superficial arteries. The most suitable setting for a specific application must be selected according to spatial and temporal resolution requirements. The usefulness of standardization in the validation process and performance metric adoption emerges. Computer-based techniques should always be preferred to manual measures, as long as the algorithms and learning procedures are transparent and well described, and the performance leads to better results. Identification of a minimal clinically important difference is a crucial point for drawing conclusions regarding robustness of the techniques and for the translation into practice of any biomarker.

Long Short-term Memory-Based Prediction of the Spread of Influenza-Like Illness Leveraging Surveillance, Weather, and Twitter Data: Model Development and Validation.

BACKGROUND: The potential to harness the plurality of available data in real time along with advanced data analytics for the accurate prediction of influenza-like illness (ILI) outbreaks has gained significant scientific interest. Different methodologies based on the use of machine learning techniques and traditional and alternative data sources, such as ILI surveillance reports, weather reports, search engine queries, and social media, have been explored with the ultimate goal of being used in the development of electronic surveillance systems that could complement existing monitoring resources. OBJECTIVE: The scope of this study was to investigate for the first time the combined use of ILI surveillance data, weather data, and Twitter data along with deep learning techniques toward the development of prediction models able to nowcast and forecast weekly ILI cases. By assessing the predictive power of both traditional and alternative data sources on the use case of ILI, this study aimed to provide a novel approach for corroborating evidence and enhancing accuracy and reliability in the surveillance of infectious diseases. METHODS: The model's input space consisted of information related to weekly ILI surveillance, web-based social (eg, Twitter) behavior, and weather conditions. For the design and development of the model, relevant data corresponding to the period of 2010 to 2019 and focusing on the Greek population and weather were collected. Long short-term memory (LSTM) neural networks were leveraged to efficiently handle the sequential and nonlinear nature of the multitude of collected data. The 3 data categories were first used separately for training 3 LSTM-based primary models. Subsequently, different transfer learning (TL) approaches were explored with the aim of creating various feature spaces combining the features extracted from the corresponding primary models' LSTM layers for the latter to feed a dense layer. RESULTS: The primary model that learned from weather data yielded better forecast accuracy (root mean square error [RMSE]=0.144; Pearson correlation coefficient [PCC]=0.801) than the model trained with ILI historical data (RMSE=0.159; PCC=0.794). The best performance was achieved by the TL-based model leveraging the combination of the 3 data categories (RMSE=0.128; PCC=0.822). CONCLUSIONS: The superiority of the TL-based model, which considers Twitter data, weather data, and ILI surveillance data, reflects the potential of alternative public sources to enhance accurate and reliable prediction of ILI spread. Despite its focus on the use case of Greece, the proposed approach can be generalized to other locations, populations, and social media platforms to support the surveillance of infectious diseases with the ultimate goal of reinforcing preparedness for future epidemics.

Development of a Low-Power IoMT Portable Pillbox for Medication Adherence Improvement and Remote Treatment Adjustment.

Patients usually deviate from prescribed medication schedules and show reduced adherence. Even when the adherence is sufficient, there are conditions where the medication schedule should be modified. Crucial drug-drug, food-drug, and supplement-drug interactions can lead to treatment failure. We present the development of an internet of medical things (IoMT) platform to improve medication adherence and enable remote treatment modifications. Based on photos of food and supplements provided by the patient, using a camera integrated to a portable 3D-printed low-power pillbox, dangerous interactions with treatment medicines can be detected and prevented. We compare the medication adherence of 14 participants following a complex medication schedule using a functional prototype that automatically receives remote adjustments, to a dummy pillbox where the adjustments are sent with text messages. The system usability scale (SUS) score was 86.79, which denotes excellent user acceptance. Total errors (wrong/no pill) between the functional prototype and the dummy pillbox did not demonstrate any statistically significant difference (p = 0.57), but the total delay of the intake time was higher (p = 0.03) during dummy pillbox use. Thus, the proposed low-cost IoMT pillbox improves medication adherence even with a complex regimen while supporting remote dose adjustment.

A Multimodal Approach for Real Time Recognition of Engagement towards Adaptive Serious Games for Health.

In this article, an unobtrusive and affordable sensor-based multimodal approach for real time recognition of engagement in serious games (SGs) for health is presented. This approach aims to achieve individualization in SGs that promote self-health management. The feasibility of the proposed approach was investigated by designing and implementing an experimental process focusing on real time recognition of engagement. Twenty-six participants were recruited and engaged in sessions with a SG that promotes food and nutrition literacy. Data were collected during play from a heart rate sensor, a smart chair, and in-game metrics. Perceived engagement, as an approximation to the ground truth, was annotated continuously by participants. An additional group of six participants were recruited for smart chair calibration purposes. The analysis was conducted in two directions, firstly investigating associations between identified sitting postures and perceived engagement, and secondly evaluating the predictive capacity of features extracted from the multitude of sources towards the ground truth. The results demonstrate significant associations and predictive capacity from all investigated sources, with a multimodal feature combination displaying superiority over unimodal features. These results advocate for the feasibility of real time recognition of engagement in adaptive serious games for health by using the presented approach.

CurveletTransform-Based Texture Analysis of Carotid B-mode Ultrasound Images in Asymptomatic Men With Moderate and Severe Stenoses: A Preliminary Clinical Study.

The curvelet transform, which represents images in terms of their geometric and textural characteristics, was investigated toward revealing differences between moderate (50%-69%, n = 11) and severe (70%-100%, n = 14) stenosis asymptomatic plaque from B-mode ultrasound. Texture features were estimated in original and curvelet transformed images of atheromatous plaque (PL), the adjacent arterial wall (intima-media [IM]) and the plaque shoulder (SH) (i.e., the boundary between plaque and wall), separately at end systole and end diastole. Seventeen features derived from the original images were significantly different between the two groups (4 for IM, 3 for PL and 10 for SH; 9 for end diastole and 8 for end systole); 19 of 234 features (2 for IM and 17 for SH; 8 for end systole and 11 for end diastole) derived from curvelet transformed images were significantly higher in the patients with severe stenosis, indicating higher magnitude, variation and randomness of image gray levels. In these patients, lower body height and higher serum creatinine concentration were observed. Our findings suggest that (a) moderate and severe plaque have similar curvelet-based texture properties, and (b) IM and SH provide useful information about arterial wall pathophysiology, complementary to PL itself. The curvelet transform is promising for identifying novel indices of cardiovascular risk and warrants further investigation in larger cohorts.

Using Biologically-inspired Image Features to Model Retinal Response: Evidence from Biological Datasets.

Retinal models are needed to simulate the translation of visual percepts to Retinal Ganglion Cells (RGCs) neural spike trains, through which visual information is transmitted to the brain. Restoring vision through neural prostheses motivates the development of accurate retinal models. We integrate biologically-inspired image features to RGC models. We trained Linear-Nonlinear models using response data from biological retinae. We show that augmenting raw image input with retina-inspired image features leads to performance improvements: in a smaller (30sec. of retina recordings) set integration of features leads to improved models in approximately $\frac{2}{3}$ of the modeled RGCS; in a larger (4min. recording) we show that utilizing Spike Triggered Average analysis to localize RGCs in input images and extract features in a cell-based manner leads to improved models in all (except two) of the modeled RGCs.

Stratification of carotid atheromatous plaque using interpretable deep learning methods on B-mode ultrasound images.

Carotid atherosclerosis is the major cause of ischemic stroke resulting in significant rates of mortality and disability annually. Early diagnosis of such cases is of great importance, since it enables clinicians to apply a more effective treatment strategy. This paper introduces an interpretable classification approach of carotid ultrasound images for the risk assessment and stratification of patients with carotid atheromatous plaque. To address the highly imbalanced distribution of patients between the symptomatic and asymptomatic classes (16 vs 58, respectively), an ensemble learning scheme based on a sub-sampling approach was applied along with a two-phase, cost-sensitive strategy of learning, that uses the original and a resampled data set. Convolutional Neural Networks (CNNs) were utilized for building the primary models of the ensemble. A six-layer deep CNN was used to automatically extract features from the images, followed by a classification stage of two fully connected layers. The obtained results (Area Under the ROC Curve (AUC): 73%, sensitivity: 75%, specificity: 70%) indicate that the proposed approach achieved acceptable discrimination performance. Finally, interpretability methods were applied on the model's predictions in order to reveal insights on the model's decision process as well as to enable the identification of novel image biomarkers for the stratification of patients with carotid atheromatous plaque.Clinical Relevance-The integration of interpretability methods with deep learning strategies can facilitate the identification of novel ultrasound image biomarkers for the stratification of patients with carotid atheromatous plaque.

Machine Learning Method for Functional Assessment of Retinal Models.

Challenges in the field of retinal prostheses motivate the development of retinal models to accurately simulate Retinal Ganglion Cells (RGCs) responses. The goal of retinal prostheses is to enable blind individuals to solve complex, reallife visual tasks. In this paper, we introduce the functional assessment (FA) of retinal models, which describes the concept of evaluating the performance of retinal models on visual understanding tasks. We present a machine learning method for FA: we feed traditional machine learning classifiers with RGC responses generated by retinal models, to solve object and digit recognition tasks (CIFAR-10, MNIST, Fashion MNIST, Imagenette). We examined critical FA aspects, including how the performance of FA depends on the task, how to optimally feed RGC responses to the classifiers and how the number of output neurons correlates with the model's accuracy. To increase the number of output neurons, we manipulated input images - by splitting and then feeding them to the retinal model and we found that image splitting does not significantly improve the model's accuracy. We also show that differences in the structure of datasets result in largely divergent performance of the retinal model (MNIST and Fashion MNIST exceeded 80% accuracy, while CIFAR-10 and Imagenette achieved ∼40%). Furthermore, retinal models which perform better in standard evaluation, i.e. more accurately predict RGC response, perform better in FA as well. However, unlike standard evaluation, FA results can be straightforwardly interpreted in the context of comparing the quality of visual perception.

Assessing Vision Quality in Retinal Prosthesis Implantees through Deep Learning: Current Progress and Improvements by Optimizing Hardware Design Parameters and Rehabilitation.

Retinal prosthesis (RP) is used to partially restore vision in patients with degenerative retinal diseases. Assessing the quality of RP-acquired (i.e., prosthetic) vision is needed to evaluate RP impact and prospects. Spatial distortions caused by electrical stimulation of the retina in RP, and the low number of electrodes, have limited the prosthetic vision: patients mostly localize shapes and shadows rather than recognizing objects. We simulate prosthetic vision and evaluate vision on image classification tasks, varying critical hardware parameters: total number and size of electrodes. We also simulate rehabilitation by re-training our models on prosthetic vision images. We find that electrode size has little impact on vision while at least 400 electrodes are needed to sufficiently restore vision (more than 65% classification accuracy on a complex visual task after rehabilitation). Argus II, a currently available implant, produces a low-resolution vision leading to low accuracy (21.3% score after rehabilitation) in complex vision tasks. Rehabilitation produces significant improvements (accuracy improvement of up to 30% on complex tasks, depending on the number of electrodes) in the attained vision, boosting our expectations for RP interventions and motivating the establishment of rehabilitation procedures for RP implantees.

Artificial intelligence in clinical care amidst COVID-19 pandemic: A systematic review.

The worldwide health crisis caused by the SARS-Cov-2 virus has resulted in>3 million deaths so far. Improving early screening, diagnosis and prognosis of the disease are critical steps in assisting healthcare professionals to save lives during this pandemic. Since WHO declared the COVID-19 outbreak as a pandemic, several studies have been conducted using Artificial Intelligence techniques to optimize these steps on clinical settings in terms of quality, accuracy and most importantly time. The objective of this study is to conduct a systematic literature review on published and preprint reports of Artificial Intelligence models developed and validated for screening, diagnosis and prognosis of the coronavirus disease 2019. We included 101 studies, published from January 1st, 2020 to December 30th, 2020, that developed AI prediction models which can be applied in the clinical setting. We identified in total 14 models for screening, 38 diagnostic models for detecting COVID-19 and 50 prognostic models for predicting ICU need, ventilator need, mortality risk, severity assessment or hospital length stay. Moreover, 43 studies were based on medical imaging and 58 studies on the use of clinical parameters, laboratory results or demographic features. Several heterogeneous predictors derived from multimodal data were identified. Analysis of these multimodal data, captured from various sources, in terms of prominence for each category of the included studies, was performed. Finally, Risk of Bias (RoB) analysis was also conducted to examine the applicability of the included studies in the clinical setting and assist healthcare providers, guideline developers, and policymakers.

Safety of smartwatches and their chargers in patients with cardiac implantable electronic devices.

AIMS: Cardiac implantable electronic devices (CIEDs) are susceptible to electromagnetic interference (EMI). Smartwatches and their chargers could be a possible source of EMI. We sought to assess whether the latest generation smartwatches and their chargers interfere with proper CIED function. METHODS AND RESULTS: We included consecutive CIED recipients in two centres. We tested two latest generation smartwatches (Apple Watch and Samsung Galaxy Watch) and their charging cables for potential EMI. The testing was performed under continuous electrocardiogram recording and real-time device telemetry, with nominal and 'worst-case' settings. In vitro magnetic field measurements were performed to assess the emissions from the tested devices, initially in contact with the probe and then at a distance of 10 cm and 20 cm. In total, 171 patients with CIEDs (71.3% pacemakers-28.7% implantable cardioverter-defibrillators) from five manufacturers were enrolled (63.2% males, 74.8 ± 11.4 years), resulting in 684 EMI tests. No EMI was identified in any patient either under nominal or 'worst-case scenario' programming. The peak magnetic flux density emitted by the smartwatches was similar to the background noise level (0.81 µT) even when in contact with the measuring probe. The respective values for the chargers were 4.696 µΤ and 4.299 µΤ for the Samsung and Apple chargers, respectively, which fell at the background noise level when placed at 20 cm and 10 cm, respectively. CONCLUSION: Two latest generation smartwatches and their chargers resulted in no EMI in CIED recipients. The absence of EMI in conjunction with the extremely low intensity of magnetic fields emitted by these devices support the safety of their use by CIED patients.

Motion synchronisation patterns of the carotid atheromatous plaque from B-mode ultrasound.

Asynchronous movement of the carotid atheromatous plaque from B-mode ultrasound has been previously reported, and associated with higher risk of stroke, but not quantitatively estimated. Based on the hypothesis that asynchronous plaque motion is associated with vulnerable plaque, in this study, synchronisation patterns of different tissue areas were estimated using cross-correlations of displacement waveforms. In 135 plaques (77 subjects), plaque radial deformation was synchronised by approximately 50% with the arterial diameter, and the mean phase shift was 0.4 s. Within the plaque, the mean phase shifts between the displacements of the top and bottom surfaces were 0.2 s and 0.3 s, in the radial and longitudinal directions, respectively, and the synchronisation about 80% in both directions. Classification of phase-shift-based features using Random Forests yielded Area-Under-the-Curve scores of 0.81, 0.79, 0.89 and 0.90 for echogenicity, symptomaticity, stenosis degree and plaque risk, respectively. Statistical analysis showed that echolucent, high-stenosis and high-risk plaques exhibited higher phase shifts between the radial displacements of their top and bottom surfaces. These findings are useful in the study of plaque kinematics.

Carotid Wall Longitudinal Motion in Ultrasound Imaging: An Expert Consensus Review.

Motion extracted from the carotid artery wall provides unique information for vascular health evaluation. Carotid artery longitudinal wall motion corresponds to the multiphasic arterial wall excursion in the direction parallel to blood flow during the cardiac cycle. While this motion phenomenon has been well characterized, there is a general lack of awareness regarding its implications for vascular health assessment or even basic vascular physiology. In the last decade, novel estimation strategies and clinical investigations have greatly advanced our understanding of the bi-axial behavior of the carotid artery, necessitating an up-to-date review to summarize and classify the published literature in collaboration with technical and clinical experts in the field. Within this review, the state-of-the-art methodologies for carotid wall motion estimation are described, and the observed relationships between longitudinal motion-derived indices and vascular health are reported. The vast number of studies describing the longitudinal motion pattern in plaque-free arteries, with its putative application to cardiovascular disease prediction, point to the need for characterizing the added value and applicability of longitudinal motion beyond established biomarkers. To this aim, the main purpose of this review was to provide a strong base of theoretical knowledge, together with a curated set of practical guidelines and recommendations for longitudinal motion estimation in patients, to foster future discoveries in the field, toward the integration of longitudinal motion in basic science as well as clinical practice.

AI in Medical Imaging Informatics: Current Challenges and Future Directions.

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine.

New-Onset Psychosis Associated With a Lesion Localized in the Rostral Tectum: Insights Into Pathway-Specific Connectivity Disrupted in Psychosis.

OBJECTIVE: To investigate pathway-specific connectivity disrupted in psychosis. METHODS: We carried out a case study of a middle-aged patient who presented with new-onset psychosis associated with a space-occupying lesion localized in the right superior colliculus/periaqueductal gray. The study sought to investigate potential connectivity deficits related to the lesion by the use of diffusion tensor imaging and resting-state functional magnetic resonance imaging. To this aim, we generated a functional connectivity map of the patient's brain, centered on the lesion area, and compared this map with the corresponding map of 10 sex- and age-matched control individuals identified from the Max Planck Institute-Leipzig Mind-Brain-Body database. RESULTS: Our analysis revealed a discrete area in the right rostral tectum, in the immediate vicinity of the lesion, whose activity is inversely correlated with the activity of left amygdala, whereas left amygdala is functionally associated with select areas of the temporal, parietal, and occipital lobes. Based on a comparative analysis of the patient with 10 control individuals, the lesion has impacted on the connectivity of rostral tectum (superior colliculus/periaqueductal gray) with left amygdala as well as on the connectivity of left amygdala with subcortical and cortical areas. CONCLUSIONS: The superior colliculus/periaqueductal gray might play important roles in the initiation and perpetuation of psychosis, at least partially through dysregulation of left amygdala activity.

Biologically-inspired image processing in computational retina models.

Retinal Prosthesis (RP) is an approach to restore vision, using an implanted device to electrically stimulate the retina. A fundamental problem in RP is to translate the visual scene to retina neural spike patterns, mimicking the computations normally done by retina neural circuits. Towards the perspective of improved RP interventions, we propose a Computer Vision (CV) image preprocessing method based on Retinal Ganglion Cells functions and then use the method to reproduce retina output with a standard Generalized Integrate & Fire (GIF) neuron model. "Virtual Retina" simulation software is used to provide the stimulus-retina response data to train and test our model. We use a sequence of natural images as model input and show that models using the proposed CV image preprocessing outperform models using raw image intensity (interspike-interval distance 0.17 vs 0.27). This result is aligned with our hypothesis that raw image intensity is an improper image representation for Retinal Ganglion Cells response prediction.

An Ontology-Based Serious Game Design for the Development of Nutrition and Food Literacy Skills.

Unhealthy dietary habits constitute a major risk factor for the onset of chronic diseases, such as cardiovascular diseases, cancer, diabetes and other conditions linked to obesity. Effective dietary changes are of paramount importance and can be promoted through empowering individuals with Nutrition Literacy (NL) and Food Literacy (FL) skills. This paper presents a novel serious game aiming at building NL and FL skills in adolescents and young adults. It is based on an innovative conceptual framework, incorporating a recipe ontology and a theory driven game design approach maximizing user attractiveness and promoting sustainable effective dietary changes. The ontological modeling of recipes offers game experience personalization while providing a realistic and diverse simulation environment. Modern game design techniques from three game genres (cooking, roguelike, puzzle) are employed along with a compelling plot for engagement purposes.