A smartphone- and wearable-based biomarker for the estimation of unipolar depression severity.

Drug development for mood disorders can greatly benefit from the development of robust, reliable, and objective biomarkers. The incorporation of smartphones and wearable devices in clinical trials provide a unique opportunity to monitor behavior in a non-invasive manner. The objective of this study is to identify the correlations between remotely monitored self-reported assessments and objectively measured activities with depression severity assessments often applied in clinical trials. 30 unipolar depressed patients and 29 age- and gender-matched healthy controls were enrolled in this study. Each participant's daily physiological, physical, and social activity were monitored using a smartphone-based application (CHDR MORE™) for 3 weeks continuously. Self-reported depression anxiety stress scale-21 (DASS-21) and positive and negative affect schedule (PANAS) were administered via smartphone weekly and daily respectively. The structured interview guide for the Hamilton depression scale and inventory of depressive symptomatology-clinical rated (SIGHD-IDSC) was administered in-clinic weekly. Nested cross-validated linear mixed-effects models were used to identify the correlation between the CHDR MORE™ features with the weekly in-clinic SIGHD-IDSC scores. The SIGHD-IDSC regression model demonstrated an explained variance (R2) of 0.80, and a Root Mean Square Error (RMSE) of ± 15 points. The SIGHD-IDSC total scores were positively correlated with the DASS and mean steps-per-minute, and negatively correlated with the travel duration. Unobtrusive, remotely monitored behavior and self-reported outcomes are correlated with depression severity. While these features cannot replace the SIGHD-IDSC for estimating depression severity, it can serve as a complementary approach for assessing depression and drug effects outside the clinic.

Treatment Detection and Movement Disorder Society-Unified Parkinson's Disease Rating Scale, Part III Estimation Using Finger Tapping Tasks.

The validation of objective and easy-to-implement biomarkers that can monitor the effects of fast-acting drugs among Parkinson's disease (PD) patients would benefit antiparkinsonian drug development. We developed composite biomarkers to detect levodopa/carbidopa effects and to estimate PD symptom severity. For this development, we trained machine learning algorithms to select the optimal combination of finger tapping task features to predict treatment effects and disease severity. Data were collected during a placebo-controlled, crossover study with 20 PD patients. The alternate index and middle finger tapping (IMFT), alternative index finger tapping (IFT), and thumb-index finger tapping (TIFT) tasks and the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) III were performed during treatment. We trained classification algorithms to select features consisting of the MDS-UPDRS III item scores; the individual IMFT, IFT, and TIFT; and all three tapping tasks collectively to classify treatment effects. Furthermore, we trained regression algorithms to estimate the MDS-UPDRS III total score using the tapping task features individually and collectively. The IFT composite biomarker had the best classification performance (83.50% accuracy, 93.95% precision) and outperformed the MDS-UPDRS III composite biomarker (75.75% accuracy, 73.93% precision). It also achieved the best performance when the MDS-UPDRS III total score was estimated (mean absolute error: 7.87, Pearson's correlation: 0.69). We demonstrated that the IFT composite biomarker outperformed the combined tapping tasks and the MDS-UPDRS III composite biomarkers in detecting treatment effects. This provides evidence for adopting the IFT composite biomarker for detecting antiparkinsonian treatment effect in clinical trials. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Machine Learning Techniques for Developing Remotely Monitored Central Nervous System Biomarkers Using Wearable Sensors: A Narrative Literature Review.

BACKGROUND: Central nervous system (CNS) disorders benefit from ongoing monitoring to assess disease progression and treatment efficacy. Mobile health (mHealth) technologies offer a means for the remote and continuous symptom monitoring of patients. Machine Learning (ML) techniques can process and engineer mHealth data into a precise and multidimensional biomarker of disease activity. OBJECTIVE: This narrative literature review aims to provide an overview of the current landscape of biomarker development using mHealth technologies and ML. Additionally, it proposes recommendations to ensure the accuracy, reliability, and interpretability of these biomarkers. METHODS: This review extracted relevant publications from databases such as PubMed, IEEE, and CTTI. The ML methods employed across the selected publications were then extracted, aggregated, and reviewed. RESULTS: This review synthesized and presented the diverse approaches of 66 publications that address creating mHealth-based biomarkers using ML. The reviewed publications provide a foundation for effective biomarker development and offer recommendations for creating representative, reproducible, and interpretable biomarkers for future clinical trials. CONCLUSION: mHealth-based and ML-derived biomarkers have great potential for the remote monitoring of CNS disorders. However, further research and standardization of study designs are needed to advance this field. With continued innovation, mHealth-based biomarkers hold promise for improving the monitoring of CNS disorders.

Smartphone and Wearable Sensors for the Estimation of Facioscapulohumeral Muscular Dystrophy Disease Severity: Cross-sectional Study.

BACKGROUND: Facioscapulohumeral muscular dystrophy (FSHD) is a progressive neuromuscular disease. Its slow and variable progression makes the development of new treatments highly dependent on validated biomarkers that can quantify disease progression and response to drug interventions. OBJECTIVE: We aimed to build a tool that estimates FSHD clinical severity based on behavioral features captured using smartphone and remote sensor data. The adoption of remote monitoring tools, such as smartphones and wearables, would provide a novel opportunity for continuous, passive, and objective monitoring of FSHD symptom severity outside the clinic. METHODS: In total, 38 genetically confirmed patients with FSHD were enrolled. The FSHD Clinical Score and the Timed Up and Go (TUG) test were used to assess FSHD symptom severity at days 0 and 42. Remote sensor data were collected using an Android smartphone, Withings Steel HR+, Body+, and BPM Connect+ for 6 continuous weeks. We created 2 single-task regression models that estimated the FSHD Clinical Score and TUG separately. Further, we built 1 multitask regression model that estimated the 2 clinical assessments simultaneously. Further, we assessed how an increasingly incremental time window affected the model performance. To do so, we trained the models on an incrementally increasing time window (from day 1 until day 14) and evaluated the predictions of the clinical severity on the remaining 4 weeks of data. RESULTS: The single-task regression models achieved an R2 of 0.57 and 0.59 and a root-mean-square error (RMSE) of 2.09 and 1.66 when estimating FSHD Clinical Score and TUG, respectively. Time spent at a health-related location (such as a gym or hospital) and call duration were features that were predictive of both clinical assessments. The multitask model achieved an R2 of 0.66 and 0.81 and an RMSE of 1.97 and 1.61 for the FSHD Clinical Score and TUG, respectively, and therefore outperformed the single-task models in estimating clinical severity. The 3 most important features selected by the multitask model were light sleep duration, total steps per day, and mean steps per minute. Using an increasing time window (starting from day 1 to day 14) for the FSHD Clinical Score, TUG, and multitask estimation yielded an average R2 of 0.65, 0.79, and 0.76 and an average RMSE of 3.37, 2.05, and 4.37, respectively. CONCLUSIONS: We demonstrated that smartphone and remote sensor data could be used to estimate FSHD clinical severity and therefore complement the assessment of FSHD outside the clinic. In addition, our results illustrated that training the models on the first week of data allows for consistent and stable prediction of FSHD symptom severity. Longitudinal follow-up studies should be conducted to further validate the reliability and validity of the multitask model as a tool to monitor disease progression over a longer period. TRIAL REGISTRATION: ClinicalTrials.gov NCT04999735; https://www.clinicaltrials.gov/ct2/show/NCT04999735.

How do others cope? Extracting coping strategies for adverse drug events from social media.

Patients advise their peers on how to cope with their illness in daily life on online support groups. To date, no efforts have been made to automatically extract recommended coping strategies from online patient discussion groups. We introduce this new task, which poses a number of challenges including complex, long entities, a large long-tailed label space, and cross-document relations. We present an initial ontology for coping strategies as a starting point for future research on coping strategies, and the first end-to-end pipeline for extracting coping strategies for side effects. We also compared two possible computational solutions for this novel and highly challenging task; multi-label classification and named entity recognition (NER) with entity linking (EL). We evaluated our methods on the discussion forum from the Facebook group of the worldwide patient support organization 'GIST support international' (GSI); GIST support international donated the data to us. We found that coping strategy extraction is difficult and both methods attain limited performance (measured with F1 score) on held out test sets; multi-label classification outperforms NER+EL (F1=0.220 vs F1=0.155). An inspection of the multi-label classification output revealed that for some of the incorrect predictions, the reference label is close to the predicted label in the ontology (e.g. the predicted label 'juice' instead of the more specific reference label 'grapefruit juice'). Performance increased to F1=0.498 when we evaluated at a coarser level of the ontology. We conclude that our pipeline can be used in a semi-automatic setting, in interaction with domain experts to discover coping strategies for side effects from a patient forum. For example, we found that patients recommend ginger tea for nausea and magnesium and potassium supplements for cramps. This information can be used as input for patient surveys or clinical studies.

Sample Bias in Web-Based Patient-Generated Health Data of Dutch Patients With Gastrointestinal Stromal Tumor: Survey Study.

BACKGROUND: Increasingly, social media is being recognized as a potential resource for patient-generated health data, for example, for pharmacovigilance. Although the representativeness of the web-based patient population is often noted as a concern, studies in this field are limited. OBJECTIVE: This study aimed to investigate the sample bias of patient-centered social media in Dutch patients with gastrointestinal stromal tumor (GIST). METHODS: A population-based survey was conducted in the Netherlands among 328 patients with GIST diagnosed 2-13 years ago to investigate their digital communication use with fellow patients. A logistic regression analysis was used to analyze clinical and demographic differences between forum users and nonusers. RESULTS: Overall, 17.9% (59/328) of survey respondents reported having contact with fellow patients via social media. Moreover, 78% (46/59) of forum users made use of GIST patient forums. We found no statistically significant differences for age, sex, socioeconomic status, and time since diagnosis between forum users (n=46) and nonusers (n=273). Patient forum users did differ significantly in (self-reported) treatment phase from nonusers (P=.001). Of the 46 forum users, only 2 (4%) were cured and not being monitored; 3 (7%) were on adjuvant, curative treatment; 19 (41%) were being monitored after adjuvant treatment; and 22 (48%) were on palliative treatment. In contrast, of the 273 patients who did not use disease-specific forums to communicate with fellow patients, 56 (20.5%) were cured and not being monitored, 31 (11.3%) were on curative treatment, 139 (50.9%) were being monitored after treatment, and 42 (15.3%) were on palliative treatment. The odds of being on a patient forum were 2.8 times as high for a patient who is being monitored compared with a patient that is considered cured. The odds of being on a patient forum were 1.9 times as high for patients who were on curative (adjuvant) treatment and 10 times as high for patients who were in the palliative phase compared with patients who were considered cured. Forum users also reported a lower level of social functioning (84.8 out of 100) than nonusers (93.8 out of 100; P=.008). CONCLUSIONS: Forum users showed no particular bias on the most important demographic variables of age, sex, socioeconomic status, and time since diagnosis. This may reflect the narrowing digital divide. Overrepresentation and underrepresentation of patients with GIST in different treatment phases on social media should be taken into account when sourcing patient forums for patient-generated health data. A further investigation of the sample bias in other web-based patient populations is warranted.

Lifestyle and health changes in wheelchair users with a chronic disability after 12 weeks of using the WHEELS mHealth application.

PURPOSE: The aim of this study was to determine changes in physical activity, nutrition, sleep behaviour and body composition in wheelchair users with a chronic disability after 12 weeks of using the WHEELS mHealth application (app). METHODS: A 12-week pre-post intervention study was performed, starting with a 1-week control period. Physical activity and sleep behaviour were continuously measured with a Fitbit charge 3. Self-reported nutritional intake, body mass and waist circumference were collected. Pre-post outcomes were compared with a paired-sample t-test or Wilcoxon signed-rank test. Fitbit data were analysed with a mixed model or a panel linear model. Effect sizes were determined and significance was accepted at p < .05. RESULTS: Thirty participants completed the study. No significant changes in physical activity (+1.5 √steps) and sleep quality (-9.7 sleep minutes; -1.2% sleep efficiency) were found. Significant reduction in energy (-1022 kJ, d = 0.71), protein (-8.3 g, d = 0.61) and fat (-13.1 g, d = 0.87) intake, body mass (-2.2 kg, d = 0.61) and waist circumference (-3.3 cm, d = 0.80) were found. CONCLUSION: Positive changes were found in nutritional behaviour and body composition, but not in physical activity and sleep quality. The WHEELS app seems to partly support healthy lifestyle behaviour.Implications for RehabilitationHealthy lifestyle promotion is crucial, especially for wheelchair users as they tend to show poorer lifestyle behaviour despite an increased risk of obesity and comorbidity.The WHEELS lifestyle app seems to be a valuable tool to support healthy nutrition choices and weight loss and to improve body satisfaction, mental health and vitality.

Automated gathering of real-world data from online patient forums can complement pharmacovigilance for rare cancers.

Current methods of pharmacovigilance result in severe under-reporting of adverse drug events (ADEs). Patient forums have the potential to complement current pharmacovigilance practices by providing real-time uncensored and unsolicited information. We are the first to explore the value of patient forums for rare cancers. To this end, we conduct a case study on a patient forum for Gastrointestinal Stromal Tumor patients. We have developed machine learning algorithms to automatically extract and aggregate side effects from messages on open online discussion forums. We show that patient forum data can provide suggestions for which ADEs impact quality of life the most: For many side effects the relative reporting rate differs decidedly from that of the registration trials, including for example cognitive impairment and alopecia as side effects of avapritinib. We also show that our methods can provide real-world data for long-term ADEs, such as osteoporosis and tremors for imatinib, and novel ADEs not found in registration trials, such as dry eyes and muscle cramping for imatinib. We thus posit that automated pharmacovigilance from patient forums can provide real-world data for ADEs and should be employed as input for medical hypotheses for rare cancers.

Symptoms reported by gastrointestinal stromal tumour (GIST) patients on imatinib treatment: combining questionnaire and forum data.

PURPOSE: Treatment with the tyrosine kinase inhibitor (TKI) imatinib in patients with gastrointestinal stromal tumours (GIST) causes symptoms that could negatively impact health-related quality of life (HRQoL). Treatment-related symptoms are usually clinician-reported and little is known about patient reports. We used survey and online patient forum data to investigate (1) prevalence of patient-reported symptoms; (2) coverage of symptoms mentioned on the forum by existing HRQoL questionnaires; and (3) priorities of prevalent symptoms in HRQoL assessment. METHODS: In the cross-sectional population-based survey study, Dutch GIST patients completed items from the EORTC QLQ-C30 and Symptom-Based Questionnaire (SBQ). In the forum study, machine learning algorithms were used to extract TKI side-effects from English messages on an international online forum for GIST patients. Prevalence of symptoms related to imatinib treatment in both sources was calculated and exploratively compared. RESULTS: Fatigue and muscle pain or cramps were reported most frequently. Seven out of 10 most reported symptoms (i.e. fatigue, muscle pain or cramps, facial swelling, joint pain, skin problems, diarrhoea, and oedema) overlapped between the two sources. Alopecia was frequently mentioned on the forum, but not in the survey. Four out of 10 most reported symptoms on the online forum are covered by the EORTC QLQ-C30. The EORTC-SBQ and EORTC Item Library cover 9 and 10 symptoms, respectively. CONCLUSION: This first overview of patient-reported imatinib-related symptoms from two data sources helps to determine coverage of items in existing questionnaires, and prioritize HRQoL issues. Combining cancer-generic instruments with treatment-specific item lists will improve future HRQoL assessment in care and research in GIST patients using TKI.

Accuracy of Heart Rate Measurement by the Fitbit Charge 2 During Wheelchair Activities in People With Spinal Cord Injury: Instrument Validation Study.

BACKGROUND: Heart rate (HR) is an important and commonly measured physiological parameter in wearables. HR is often measured at the wrist with the photoplethysmography (PPG) technique, which determines HR based on blood volume changes, and is therefore influenced by blood pressure. In individuals with spinal cord injury (SCI), blood pressure control is often altered and could therefore influence HR accuracy measured by the PPG technique. OBJECTIVE: The objective of this study is to investigate the HR accuracy measured with the PPG technique with a Fitbit Charge 2 (Fitbit Inc) in wheelchair users with SCI, how the activity intensity affects the HR accuracy, and whether this HR accuracy is affected by lesion level. METHODS: The HR of participants with (38/48, 79%) and without (10/48, 21%) SCI was measured during 11 wheelchair activities and a 30-minute strength exercise block. In addition, a 5-minute seated rest period was measured in people with SCI. HR was measured with a Fitbit Charge 2, which was compared with the HR measured by a Polar H7 HR monitor used as a reference device. Participants were grouped into 4 groups-the no SCI group and based on lesion level into the T1 (cervical) group. Mean absolute percentage error (MAPE) and concordance correlation coefficient were determined for each group for each activity type, that is, rest, wheelchair activities, and strength exercise. RESULTS: With an overall MAPEall lesions of 12.99%, the accuracy fell below the standard acceptable MAPE of -10% to +10% with a moderate agreement (concordance correlation coefficient=0.577). The HR accuracy of Fitbit Charge 2 seems to be reduced in those with cervical lesion level in all activities (MAPEno SCI=8.09%; MAPET1=20.43%). The accuracy of the Fitbit Charge 2 decreased with increasing intensity in all lesions (MAPErest=6.5%, MAPEactivity=12.97%, and MAPEstrength=14.2%). CONCLUSIONS: HR measured with the PPG technique showed lower accuracy in people with SCI than in those without SCI. The accuracy was just above the acceptable level in people with paraplegia, whereas in people with tetraplegia, a worse accuracy was found. The accuracy seemed to worsen with increasing intensities. Therefore, high-intensity HR data, especially in people with cervical lesions, should be used with caution.

Privacy-preserving dataset combination and Lasso regression for healthcare predictions.

BACKGROUND: Recent developments in machine learning have shown its potential impact for clinical use such as risk prediction, prognosis, and treatment selection. However, relevant data are often scattered across different stakeholders and their use is regulated, e.g. by GDPR or HIPAA. As a concrete use-case, hospital Erasmus MC and health insurance company Achmea have data on individuals in the city of Rotterdam, which would in theory enable them to train a regression model in order to identify high-impact lifestyle factors for heart failure. However, privacy and confidentiality concerns make it unfeasible to exchange these data. METHODS: This article describes a solution where vertically-partitioned synthetic data of Achmea and of Erasmus MC are combined using Secure Multi-Party Computation. First, a secure inner join protocol takes place to securely determine the identifiers of the patients that are represented in both datasets. Then, a secure Lasso Regression model is trained on the securely combined data. The involved parties thus obtain the prediction model but no further information on the input data of the other parties. RESULTS: We implement our secure solution and describe its performance and scalability: we can train a prediction model on two datasets with 5000 records each and a total of 30 features in less than one hour, with a minimal difference from the results of standard (non-secure) methods. CONCLUSIONS: This article shows that it is possible to combine datasets and train a Lasso regression model on this combination in a secure way. Such a solution thus further expands the potential of privacy-preserving data analysis in the medical domain.

A multi-stakeholder approach to eHealth development: Promoting sustained healthy living among cardiovascular patients.

BACKGROUND: Healthy living is key in the prevention and rehabilitation of cardiovascular disease (CVD). Yet, supporting and maintaining a healthy lifestyle is exceptionally difficult and people differ in their needs regarding optimal support for healthy lifestyle interventions. OBJECTIVE: The goals of this study were threefold: to uncover stakeholders' needs and preferences, to translate these to core values, and develop eHealth technology based on these core values. Our primary research question is: What type of eHealth application to support healthy living among people with (a high risk of) CVD would provide the greatest benefit for all stakeholders? METHODS: User-centered design principles from the CeHRes roadmap for eHealth development were followed to guide the uncovering of important stakeholder values. Data were synthesized from various qualitative studies (i.e., literature studies, interviews, think-aloud sessions, focus groups) and usability tests (i.e., heuristic evaluation, cognitive walkthrough, think aloud study). We also developed an innovative application evaluation tool to perform a competitor analysis on 33 eHealth applications. Finally, to make sure to take into account all end-users needs and preferences in eHealth technology development, we created personas and a customer journey. RESULTS: We uncovered 10 universal values to which eHealth-based initiatives to support healthy living in the context of CVD prevention and rehabilitation should adhere to (e.g., providing social support, stimulating intrinsic motivation, offering continuity of care). These values were translated to 14 desired core attributes and then prototype designs. Interestingly, we found that the primary attribute of good eHealth technology was not a single intervention principle, but rather that the technology should be in the form of a digital platform disseminating various interventions, i.e., a 'one-stop-shop'. CONCLUSION: Various stakeholders in the field of cardiovascular prevention and rehabilitation may benefit most from utilizing one personalized eHealth platform that integrates a variety of evidence-based interventions, rather than a new tool. Instead of a one-size-fits-all approach, this digital platform should aid the matchmaking between patients and specific interventions based on personal characteristics and preferences.

Behavior Change Techniques in mHealth Apps for the Mental and Physical Health of Employees: Systematic Assessment.

BACKGROUND: Employees remain at risk of developing physical and mental health problems. To improve the lifestyle, health, and productivity many workplace interventions have been developed. However, not all of these interventions are effective. Mobile and wireless technology to support health behavior change (mobile health [mHealth] apps) is a promising, but relatively new domain for the occupational setting. Research on mHealth apps for the mental and physical health of employees is scarce. Interventions are more likely to be useful if they are rooted in health behavior change theory. Evaluating the presence of specific combinations of behavior change techniques (BCTs) in mHealth apps might be used as an indicator of potential quality and effectiveness. OBJECTIVE: The aim of this study was to assess whether mHealth apps for the mental and physical health of employees incorporate BCTs and, if so, which BCTs can be identified and which combinations of BCTs are present. METHODS: An assessment was made of apps aiming to reduce the risk of physical and psychosocial work demands and to promote a healthy lifestyle for employees. A systematic search was performed in iTunes and Google Play. Forty-five apps were screened and downloaded. BCTs were identified using a taxonomy applied in similar reviews. The mean and ranges were calculated. RESULTS: On average, the apps included 7 of the 26 BCTs (range 2-18). Techniques such as "provide feedback on performance," "provide information about behavior-health link," and "provide instruction" were used most frequently. Techniques that were used least were "relapse prevention," "prompt self-talk," "use follow-up prompts," and "provide information about others' approval." "Stress management," "prompt identification as a role model," and "agree on behavioral contract" were not used by any of the apps. The combination "provide information about behavior-health link" with "prompt intention formation" was found in 7/45 (16%) apps. The combination "provide information about behavior-health link" with "provide information on consequences," and "use follow-up prompts" was found in 2 (4%) apps. These combinations indicated potential effectiveness. The least potentially effective combination "provide feedback on performance" without "provide instruction" was found in 13 (29%) apps. CONCLUSIONS: Apps for the occupational setting might be substantially improved to increase potential since results showed a limited presence of BCTs in general, limited use of potentially successful combinations of BCTs in apps, and use of potentially unsuccessful combinations of BCTs. Increasing knowledge on the effectiveness of BCTs in apps might be used to develop guidelines for app developers and selection criteria for companies and individuals. Also, this might contribute to decreasing the burden of work-related diseases. To achieve this, app developers, health behavior change professionals, experts on physical and mental health, and end-users should collaborate when developing apps for the working context.

Enabling Analytics on Sensitive Medical Data with Secure Multi-Party Computation.

While there is a clear need to apply data analytics in the healthcare sector, this is often difficult because it requires combining sensitive data from multiple data sources. In this paper, we show how the cryptographic technique of secure multi-party computation can enable such data analytics by performing analytics without the need to share the underlying data. We discuss the issue of compliance to European privacy legislation; report on three pilots bringing these techniques closer to practice; and discuss the main challenges ahead to make fully privacy-preserving data analytics in the medical sector commonplace.

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

BACKGROUND: To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. OBJECTIVE: The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. METHODS: Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. RESULTS: Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. CONCLUSIONS: Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users.

Instance Search Retrospective with Focus on TRECVID.

This paper presents an overview of the Video Instance Search benchmark which was run over a period of 6 years (2010-2015) as part of the TREC Video Retrieval (TRECVID) workshop series. The main contributions of the paper include i) an examination of the evolving design of the evaluation framework and its components (system tasks, data, measures); ii) an analysis of the influence of topic characteristics (such as rigid/non rigid, planar/non-planar, stationary/mobile on performance; iii) a high-level overview of results and best-performing approaches. The Instance Search (INS) benchmark worked with a variety of large collections of data including Sound & Vision, Flickr, BBC (British Broadcasting Corporation) Rushes for the first 3 pilot years and with the small world of the BBC Eastenders series for the last 3 years.

Deriving Requirements for Pervasive Well-Being Technology From Work Stress and Intervention Theory: Framework and Case Study.

BACKGROUND: Stress in office environments is a big concern, often leading to burn-out. New technologies are emerging, such as easily available sensors, contextual reasoning, and electronic coaching (e-coaching) apps. In the Smart Reasoning for Well-being at Home and at Work (SWELL) project, we explore the potential of using such new pervasive technologies to provide support for the self-management of well-being, with a focus on individuals' stress-coping. Ideally, these new pervasive systems should be grounded in existing work stress and intervention theory. However, there is a large diversity of theories and they hardly provide explicit directions for technology design. OBJECTIVE: The aim of this paper is to present a comprehensive and concise framework that can be used to design pervasive technologies that support knowledge workers to decrease stress. METHODS: Based on a literature study we identify concepts relevant to well-being at work and select different work stress models to find causes of work stress that can be addressed. From a technical perspective, we then describe how sensors can be used to infer stress and the context in which it appears, and use intervention theory to further specify interventions that can be provided by means of pervasive technology. RESULTS: The resulting general framework relates several relevant theories: we relate "engagement and burn-out" to "stress", and describe how relevant aspects can be quantified by means of sensors. We also outline underlying causes of work stress and how these can be addressed with interventions, in particular utilizing new technologies integrating behavioral change theory. Based upon this framework we were able to derive requirements for our case study, the pervasive SWELL system, and we implemented two prototypes. Small-scale user studies proved the value of the derived technology-supported interventions. CONCLUSIONS: The presented framework can be used to systematically develop theory-based technology-supported interventions to address work stress. In the area of pervasive systems for well-being, we identified the following six key research challenges and opportunities: (1) performing multi-disciplinary research, (2) interpreting personal sensor data, (3) relating measurable aspects to burn-out, (4) combining strengths of human and technology, (5) privacy, and (6) ethics.

MeSH Up: effective MeSH text classification for improved document retrieval.

MOTIVATION: Controlled vocabularies such as the Medical Subject Headings (MeSH) thesaurus and the Gene Ontology (GO) provide an efficient way of accessing and organizing biomedical information by reducing the ambiguity inherent to free-text data. Different methods of automating the assignment of MeSH concepts have been proposed to replace manual annotation, but they are either limited to a small subset of MeSH or have only been compared with a limited number of other systems. RESULTS: We compare the performance of six MeSH classification systems [MetaMap, EAGL, a language and a vector space model-based approach, a K-Nearest Neighbor (KNN) approach and MTI] in terms of reproducing and complementing manual MeSH annotations. A KNN system clearly outperforms the other published approaches and scales well with large amounts of text using the full MeSH thesaurus. Our measurements demonstrate to what extent manual MeSH annotations can be reproduced and how they can be complemented by automatic annotations. We also show that a statistically significant improvement can be obtained in information retrieval (IR) when the text of a user's query is automatically annotated with MeSH concepts, compared to using the original textual query alone. CONCLUSIONS: The annotation of biomedical texts using controlled vocabularies such as MeSH can be automated to improve text-only IR. Furthermore, the automatic MeSH annotation system we propose is highly scalable and it generates improvements in IR comparable with those observed for manual annotations.