MultiFusionNet: Atrial Fibrillation Detection With Deep Neural Networks.

Atrial fibrillation (AF) is the most common cardiac arrhythmia as well as a significant risk factor in heart failure and coronary artery disease. AF can be detected by using a short ECG recording. However, discriminating atrial fibrillation from normal sinus rhythm, other arrhythmia and strong noise, given a short ECG recording, is challenging. Towards this end, we propose MultiFusionNet, a deep learning network that uses a multiplicative fusion method to combine two deep neural networks trained on different sources of knowledge, i.e., extracted features and raw data. Thus, MultiFusionNet can exploit the relevant extracted features to improve upon the utilization of the deep learning model on the raw data. Our experiments show that this approach offers the most accurate AF classification and outperforms recently published algorithms that either use extracted features or raw data separately. Finally, we show that our multiplicative fusion method for combining the two sub-networks outperforms several other combining methods.

Building an Automated Orofacial Pain, Headache and Temporomandibular Disorder Diagnosis System.

Physicians collect data in patient encounters that they use to diagnose patients. This process can fail if the needed data is not collected or if physicians fail to interpret the data. Previous work in orofacial pain (OFP) has automated diagnosis from encounter notes and pre-encounter diagnoses questionnaires, however they do not address how variables are selected and how to scale the number of diagnoses. With a domain expert we extract a dataset of 451 cases from patient notes. We examine the performance of various machine learning (ML) approaches and compare with a simplified model that captures the diagnostic process followed by the expert. Our experiments show that the methods are adequate to making data-driven diagnoses predictions for 5 diagnoses and we discuss the lessons learned to scale the number of diagnoses and cases as to allow for an actual implementation in an OFP clinic.

Continuous Measurement of Reconnaissance Marines in Training With Custom Smartphone App and Watch: Observational Cohort Study.

BACKGROUND: Specialized training for elite US military units is associated with high attrition due to intense psychological and physical demands. The need to graduate more service members without degrading performance standards necessitates the identification of factors to predict success or failure in targeted training interventions. OBJECTIVE: The aim of this study was to continuously quantify the mental and physical status of trainees of an elite military unit to identify novel predictors of success in training. METHODS: A total of 3 consecutive classes of a specialized training course were provided with an Apple iPhone, Watch, and specially designed mobile app. Baseline personality assessments and continuous daily measures of mental status, physical pain, heart rate, activity, sleep, hydration, and nutrition were collected from the app and Watch data. RESULTS: A total of 115 trainees enrolled and completed the study (100% male; age: mean 22 years, SD 4 years) and 64 (55.7%) successfully graduated. Most training withdrawals (27/115, 23.5%) occurred by day 7 (mean 5.5 days, SD 3.4 days; range 1-22 days). Extraversion, positive affect personality traits, and daily psychological profiles were associated with course completion; key psychological factors could predict withdrawals 1-2 days in advance (P=.009). CONCLUSIONS: Gathering accurate and continuous mental and physical status data during elite military training is possible with early predictors of withdrawal providing an opportunity for intervention.

Quantified Kinematics to Evaluate Patient Chemotherapy Risks in Clinic.

PURPOSE: Performance status (PS) is a key factor in oncologic decision making, but conventional scales used to measure PS vary among observers. Consumer-grade biometric sensors have previously been identified as objective alternatives to the assessment of PS. Here, we investigate how one such biometric sensor can be used during a clinic visit to identify patients who are at risk for complications, particularly unexpected hospitalizations that may delay treatment or result in low physical activity. We aim to provide a novel and objective means of predicting tolerability to chemotherapy. METHODS: Thirty-eight patients across three centers in the United States who were diagnosed with a solid tumor with plans for treatment with two cycles of highly emetogenic chemotherapy were included in this single-arm, observational prospective study. A noninvasive motion-capture system quantified patient movement from chair to table and during the get-up-and-walk test. Activity levels were recorded using a wearable sensor over a 2-month period. Changes in kinematics from two motion-capture data points pre- and post-treatment were tested for correlation with unexpected hospitalizations and physical activity levels as measured by a wearable activity sensor. RESULTS: Among 38 patients (mean age, 48.3 years; 53% female), kinematic features from chair to table were the best predictors for unexpected health care encounters (area under the curve, 0.775 ± 0.029) and physical activity (area under the curve, 0.830 ± 0.080). Chair-to-table acceleration of the nonpivoting knee (t = 3.39; P = .002) was most correlated with unexpected health care encounters. Get-up-and-walk kinematics were most correlated with physical activity, particularly the right knee acceleration (t = -2.95; P = .006) and left arm angular velocity (t = -2.4; P = .025). CONCLUSION: Chair-to-table kinematics are good predictors of unexpected hospitalizations, whereas the get-up-and-walk kinematics are good predictors of low physical activity.

Use of Wearable Activity Tracker in Patients With Cancer Undergoing Chemotherapy: Toward Evaluating Risk of Unplanned Health Care Encounters.

PURPOSE: Unplanned health care encounters (UHEs) such as emergency room visits can occur commonly during cancer chemotherapy treatments. Patients at an increased risk of UHEs are typically identified by clinicians using performance status (PS) assessments based on a descriptive scale, such as the Eastern Cooperative Oncology Group (ECOG) scale. Such assessments can be bias prone, resulting in PS score disagreements between assessors. We therefore propose to evaluate PS using physical activity measurements (eg, energy expenditure) from wearable activity trackers. Specifically, we examined the feasibility of using a wristband (band) and a smartphone app for PS assessments. METHODS: We conducted an observational study on a cohort of patients with solid tumor receiving highly emetogenic chemotherapy. Patients were instructed to wear the band for a 60-day activity-tracking period. During clinic visits, we obtained ECOG scores assessed by physicians, coordinators, and patients themselves. UHEs occurring during the activity-tracking period plus a 90-day follow-up period were later compiled. We defined our primary outcome as the percentage of patients adherent to band-wear ≥ 80% of 10 am to 8 pm for ≥ 80% of the activity-tracking period. In an exploratory analysis, we computed hourly metabolic equivalent of task (MET) and counted 10 am to 8 pm hours with > 1.5 METs as nonsedentary physical activity hours. RESULTS: Forty-one patients completed the study (56.1% female; 61.0% age 40-60 years); 68% were adherent to band-wear. ECOG score disagreement between assessors ranged from 35.3% to 50.0%. In our exploratory analysis, lower average METs and nonsedentary hours, but not higher ECOG scores, were associated with higher 150-day UHEs. CONCLUSION: The use of a wearable activity tracker is generally feasible in a similar population of patients with cancer. A larger randomized controlled trial should be conducted to confirm the association between lower nonsedentary hours and higher UHEs.

Identification of Developmental Delay in Infants Using Wearable Sensors: Full-Day Leg Movement Statistical Feature Analysis.

This paper examines how features extracted from full-day data recorded by wearable sensors are able to differentiate between infants with typical development and those with or at risk for developmental delays. Wearable sensors were used to collect full-day (8-13 h) leg movement data from infants with typical development ([Formula: see text]) and infants at risk for developmental delay ([Formula: see text]). At 24 months, at-risk infants were assessed as having good ([Formula: see text]) or poor ([Formula: see text]) developmental outcomes. With this limited size dataset, our statistical analysis indicated that accelerometer features collected earlier in infancy differentiated between at-risk infants with poor and good outcomes at 24 months, as well as infants with typical development. This paper also tested how these features performed on a subset of the data for which the infant movement was known, i.e., 5-min intervals more representative of clinical observations. Our results on this limited dataset indicated that features for full-day data showed more group differences than similar features for the 5-min intervals, supporting the usefulness of full-day movement monitoring.

Patient reported outcomes can improve performance status assessment: a pilot study.

BACKGROUND: Patient performance status is routinely used in oncology to estimate physical functioning, an important factor in clinical treatment decisions and eligibility for clinical trials. However, validity and reliability data for ratings of performance status have not been optimal. This study recruited oncology patients who were about to begin emetogenic palliative or adjuvant chemotherapy for treatment of solid tumors. We employed actigraphy as the gold standard for physical activity level. Correspondences between actigraphy and oncologists' and patients' ratings of performance status were examined and compared with the correspondences of actigraphy and several patient reported outcomes (PROs). The study was designed to determine feasibility of the measurement approaches and if PROs can improve the accuracy of assessment of performance status. METHODS: Oncologists and patients made performance status ratings at visit 1. Patients wore an actigraph and entered weekly PROs on a smartphone app. Data for days 1-14 after visit 1 were analyzed. Chart reviews were conducted to tabulate all unexpected medical events across days 1-150. RESULTS: Neither oncologist nor patient ratings of performance status predicted steps/hour (actigraphy). The PROMIS® Physical Function PRO (average of Days 1, 7, 14) was associated with steps/hour at high (for men) and moderate (for women) levels; the PROMIS® Fatigue PRO predicted steps for men, but not for women. Unexpected medical events occurred in 57% of patients. Only body weight in female patients predicted events; oncologist and patient performance status ratings, steps/hour, and other PROs did not. CONCLUSIONS: PROMIS® Physical Function and Fatigue PROs show good correspondence with steps/hour making them easy, useful tools for oncologists to improve their assessment of performance status, especially for male patients. Female patients had lower levels of steps/hour than males and lower correlations among the predictors, suggesting the need for further work to improve performance status assessment in women. Assessment of pre-morbid sedentary behavior alongside current Physical Functioning and Fatigue PROs may allow for a more valid determination of disease-related activity level and performance status.

Low-dimensional dynamical characterization of human performance of cancer patients using motion data.

BACKGROUND: Biomechanical characterization of human performance with respect to fatigue and fitness is relevant in many settings, however is usually limited to either fully qualitative assessments or invasive methods which require a significant experimental setup consisting of numerous sensors, force plates, and motion detectors. Qualitative assessments are difficult to standardize due to their intrinsic subjective nature, on the other hand, invasive methods provide reliable metrics but are not feasible for large scale applications. METHODS: Presented here is a dynamical toolset for detecting performance groups using a non-invasive system based on the Microsoft Kinect motion capture sensor, and a case study of 37 cancer patients performing two clinically monitored tasks before and after therapy regimens. Dynamical features are extracted from the motion time series data and evaluated based on their ability to i) cluster patients into coherent fitness groups using unsupervised learning algorithms and to ii) predict Eastern Cooperative Oncology Group performance status via supervised learning. FINDINGS: The unsupervised patient clustering is comparable to clustering based on physician assigned Eastern Cooperative Oncology Group status in that they both have similar concordance with change in weight before and after therapy as well as unexpected hospitalizations throughout the study. The extracted dynamical features can predict physician, coordinator, and patient Eastern Cooperative Oncology Group status with an accuracy of approximately 80%. INTERPRETATION: The non-invasive Microsoft Kinect sensor and the proposed dynamical toolset comprised of data preprocessing, feature extraction, dimensionality reduction, and machine learning offers a low-cost and general method for performance segregation and can complement existing qualitative clinical assessments.

Multimodality and interactivity: connecting properties of serious games with educational outcomes.

Serious games have become an important genre of digital media and are often acclaimed for their potential to enhance deeper learning because of their unique technological properties. Yet the discourse has largely remained at a conceptual level. For an empirical evaluation of educational games, extra effort is needed to separate intertwined and confounding factors in order to manipulate and thus attribute the outcome to one property independent of another. This study represents one of the first attempts to empirically test the educational impact of two important properties of serious games, multimodality and interactivity, through a partial 2 x 3 (interactive, noninteractive by high, moderate, low in multimodality) factorial between-participants follow-up experiment. Results indicate that both multimodality and interactivity contribute to educational outcomes individually. Implications for educational strategies and future research directions are discussed.