The Digital Therapeutics Real-World Evidence Framework: An Approach for Guiding Evidence-Based Digital Therapeutics Design, Development, Testing, and Monitoring.

Digital therapeutics (DTx) are a promising way to provide safe, effective, accessible, sustainable, scalable, and equitable approaches to advance individual and population health. However, developing and deploying DTx is inherently complex in that DTx includes multiple interacting components, such as tools to support activities like medication adherence, health behavior goal-setting or self-monitoring, and algorithms that adapt the provision of these according to individual needs that may change over time. While myriad frameworks exist for different phases of DTx development, no single framework exists to guide evidence production for DTx across its full life cycle, from initial DTx development to long-term use. To fill this gap, we propose the DTx real-world evidence (RWE) framework as a pragmatic, iterative, milestone-driven approach for developing DTx. The DTx RWE framework is derived from the 4-phase development model used for behavioral interventions, but it includes key adaptations that are specific to the unique characteristics of DTx. To ensure the highest level of fidelity to the needs of users, the framework also incorporates real-world data (RWD) across the entire life cycle of DTx development and use. The DTx RWE framework is intended for any group interested in developing and deploying DTx in real-world contexts, including those in industry, health care, public health, and academia. Moreover, entities that fund research that supports the development of DTx and agencies that regulate DTx might find the DTx RWE framework useful as they endeavor to improve how DTxcan advance individual and population health.

Perceptions of Pharmacy Graduate Students Toward Research Ethics Education: A Cross-Sectional Study from a Developing Country.

Despite the potential value of graduate-level research ethics training, most Middle East countries, including Jordan, do not routinely offer formal research ethics training. In students enrolled in Jordanian master's level graduate program in pharmacy, the current study assessed: 1- differences in pre- and post-enrollment exposure to research ethics core themes, 2- whether this exposure was through a formal course or in an informal setting, and 3- student attitudes towards research ethics education and the need for integrating a dedicated research ethics course into pharmacy graduate programs. A 12-item on-line survey was developed by the authors and disseminated to a convenience sample of current and former master-level pharmacy students in Jordan. A total of 61 eligible respondents completed the survey. A minority of respondents (38%) acknowledged receiving research ethics training prior to enrollment into a postgraduate pharmacy program with nearly half (16%) describing this training as informal. In comparison, a larger percentage of the total respondents (56%) had received research ethics training during their postgraduate program enrollment, with nearly half of those (25%) indicating that this training was informal. A majority of respondents reported a strong need for integrating a formal research ethics course into postgraduate pharmacy curriculum (90%) to support their research training and thesis writing (89%). Overall, the study revealed a notable lack of research ethics education for graduate-level pharmacy students in Jordan.

Ethics review of big data research: What should stay and what should be reformed?

BACKGROUND: Ethics review is the process of assessing the ethics of research involving humans. The Ethics Review Committee (ERC) is the key oversight mechanism designated to ensure ethics review. Whether or not this governance mechanism is still fit for purpose in the data-driven research context remains a debated issue among research ethics experts. MAIN TEXT: In this article, we seek to address this issue in a twofold manner. First, we review the strengths and weaknesses of ERCs in ensuring ethical oversight. Second, we map these strengths and weaknesses onto specific challenges raised by big data research. We distinguish two categories of potential weakness. The first category concerns persistent weaknesses, i.e., those which are not specific to big data research, but may be exacerbated by it. The second category concerns novel weaknesses, i.e., those which are created by and inherent to big data projects. Within this second category, we further distinguish between purview weaknesses related to the ERC's scope (e.g., how big data projects may evade ERC review) and functional weaknesses, related to the ERC's way of operating. Based on this analysis, we propose reforms aimed at improving the oversight capacity of ERCs in the era of big data science. CONCLUSIONS: We believe the oversight mechanism could benefit from these reforms because they will help to overcome data-intensive research challenges and consequently benefit research at large.

Lessons Learned: Beta-Testing the Digital Health Checklist for Researchers Prompts a Call to Action by Behavioral Scientists.

Digital technologies offer unique opportunities for health research. For example, Twitter posts can support public health surveillance to identify outbreaks (eg, influenza and COVID-19), and a wearable fitness tracker can provide real-time data collection to assess the effectiveness of a behavior change intervention. With these opportunities, it is necessary to consider the potential risks and benefits to research participants when using digital tools or strategies. Researchers need to be involved in the risk assessment process, as many tools in the marketplace (eg, wellness apps, fitness sensors) are underregulated. However, there is little guidance to assist researchers and institutional review boards in their evaluation of digital tools for research purposes. To address this gap, the Digital Health Checklist for Researchers (DHC-R) was developed as a decision support tool. A participatory research approach involving a group of behavioral scientists was used to inform DHC-R development. Scientists beta-tested the checklist by retrospectively evaluating the technologies they had chosen for use in their research. This paper describes the lessons learned because of their involvement in the beta-testing process and concludes with recommendations for how the DHC-R could be useful for a variety of digital health stakeholders. Recommendations focus on future research and policy development to support research ethics, including the development of best practices to advance safe and responsible digital health research.

Prioritizing Competencies for "Research" Promotores and Community Health Workers.

Background. The community health worker (CHW) model is utilized globally to promote health and reduce health disparities in hard-to-reach and underserved communities. The model is deemed successful due to involvement of these natural helpers who are familiar with the local customs, language, and traditions. "Research" CHWs (also known as promotores) serve as cultural mediators between their community and academic researchers and are increasingly involved in the design and implementation of research; yet few of these individuals have received formal training in research methods or ethics. This study identified requisite skills and knowledge needed by research CHWs. Method. Investigators who utilized the CHW/promotor model were recruited to complete a survey and participate in one of four focus group sessions. Participants identified (1) research roles, (2) training received, (3) research competencies, (4) training barriers and facilitators, and (5) assessment preferences. Results. Participants (n = 20) completed a survey with 19 also participating in a focus group session. All participants involved CHWs in research implementation, with nearly half involving CHWs in the study design and/or dissemination of findings phases. Critical thinking skills and application of ethical principles (e.g., demonstrating respect) were prioritized over knowledge of research infrastructure (e.g., institutional review board/ethics review process). Research ethics training designed for academic researchers was deemed inappropriate because sophisticated terminology and web-based delivery were perceived as an access barrier. Self-assessment and contextualized scenarios were recommended to assess critical thinking. Conclusions. Researchers using the CHW model should provide relevant and accessible research competency training.

Precision Health: The Role of the Social and Behavioral Sciences in Advancing the Vision.

BACKGROUND: In 2015, Collins and Varmus articulated a vision for precision medicine emphasizing molecular characterization of illness to identify actionable biomarkers to support individualized treatment. Researchers have argued for a broader conceptualization, precision health. Precision health is an ambitious conceptualization of health, which includes dynamic linkages between research and practice as well as medicine, population health, and public health. The goal is a unified approach to match a full range of promotion, prevention, diagnostic, and treatment interventions to fundamental and actionable determinants of health; to not just address symptoms, but to directly target genetic, biological, environmental, and social and behavioral determinants of health. PURPOSE: The purpose of this paper is to elucidate the role of social and behavioral sciences within precision health. MAIN BODY: Recent technologies, research frameworks, and methods are enabling new approaches to measure, intervene, and conduct social and behavioral science research. These approaches support three opportunities in precision health that the social and behavioral sciences could colead including: (a) developing interventions that continuously "tune" to each person's evolving needs; (b) enhancing and accelerating links between research and practice; and (c) studying mechanisms of change in real-world contexts. There are three challenges for precision health: (a) methods of knowledge organization and curation; (b) ethical conduct of research; and (c) equitable implementation of precision health. CONCLUSIONS: Precision health requires active coleadership from social and behavioral scientists. Prior work and evidence firmly demonstrate why the social and behavioral sciences should colead with regard to three opportunity and three challenge areas.

Using Participatory Design to Inform the Connected and Open Research Ethics (CORE) Commons.

Mobile health (mHealth) research involving pervasive sensors, mobile apps and other novel data collection tools and methods present new ethical, legal, and social challenges specific to informed consent, data management and bystander rights. To address these challenges, a participatory design approach was deployed whereby stakeholders contributed to the development of a web-based commons to support the mHealth research community including researchers and ethics board members. The CORE (Connected and Open Research Ethics) platform now features a community forum, a resource library and a network of nearly 600 global members. The utility of the participatory design process was evaluated by analyzing activities carried out over an 8-month design phase consisting of 86 distinct events including iterative design deliberations and social media engagement. This article describes how participatory design yielded 55 new features directly mapped to community needs and discusses relationships to user engagement as demonstrated by a steady increase in CORE member activity and followers on Twitter.

Qualifying and quantifying the precision medicine rhetoric.

BACKGROUND: With the rise of precision medicine efforts worldwide, our study objective was to describe and map the emerging precision medicine landscape. A Google search was conducted between June 19, 2017 to July 20, 2017 to examine how "precision medicine" and its analogous terminology were used to describe precision medicine efforts. Resulting web-pages were reviewed for geographic location, data type(s), program aim(s), sample size, duration, and the key search terms used and recorded in a database. Descriptive statistics were applied to quantify terminology used to describe specific precision medicine efforts. Qualitative data were analyzed for content and patterns. RESULTS: Of the 108 programs identified through our search, 84% collected only biospecimen(s) and, of those that collected at least two data types, 42% mentioned both Electronic Health Records (EHR) and biospecimen. Given the majority of efforts limited to biospecimen(s) use, genetic research seems to be prioritized in association with precision medicine. Roughly, 54% were found to collect two or more data types, which limits the output of information that may contribute to understanding of the interplay of genetic, lifestyle, and environmental factors. Over half were government-funded with roughly a third being industry-funded. Most initiatives were concentrated in the United States, Europe, and Asia. CONCLUSIONS: To our knowledge, this is the first study to map and qualify the global precision medicine landscape. Our findings reveal that precision medicine efforts range from large model cohort studies involving multidimensional, longitudinal data to biorepositories with a collection of blood samples. We present a spectrum where past, present, and future PM-like efforts can fall based on their scope and potential impact. If precision medicine is based on genes, lifestyle and environmental factors, we recommend programs claiming to be precision medicine initiatives to incorporate multidimensional data that can inform a holistic approach to healthcare.

Building the case for actionable ethics in digital health research supported by artificial intelligence.

The digital revolution is disrupting the ways in which health research is conducted, and subsequently, changing healthcare. Direct-to-consumer wellness products and mobile apps, pervasive sensor technologies and access to social network data offer exciting opportunities for researchers to passively observe and/or track patients 'in the wild' and 24/7. The volume of granular personal health data gathered using these technologies is unprecedented, and is increasingly leveraged to inform personalized health promotion and disease treatment interventions. The use of artificial intelligence in the health sector is also increasing. Although rich with potential, the digital health ecosystem presents new ethical challenges for those making decisions about the selection, testing, implementation and evaluation of technologies for use in healthcare. As the 'Wild West' of digital health research unfolds, it is important to recognize who is involved, and identify how each party can and should take responsibility to advance the ethical practices of this work. While not a comprehensive review, we describe the landscape, identify gaps to be addressed, and offer recommendations as to how stakeholders can and should take responsibility to advance socially responsible digital health research.

Study of Independent Living Residents of a Continuing Care Senior Housing Community: Sociodemographic and Clinical Associations of Cognitive, Physical, and Mental Health.

OBJECTIVE: To examine associations of sociodemographic and clinical factors with cognitive, physical, and mental health among independent living older adults in a continuing care senior housing community (CCSHC). METHODS: This was a cross-sectional study at the independent living sector of a CCSHC in San Diego County, California. Participants included English-speaking adults aged 65-95 years, of which two-thirds were women. Of the 112 subjects recruited, 104 completed basic study assessments. The authors computed composite measures of cognitive, physical, and mental health. The authors also assessed relevant clinical correlates including psychosocial factors such as resilience, loneliness, wisdom, and social support. RESULTS: The CCSHC residents were similar to a randomly selected community-based sample of older adults on most standardized clinical measures. In the CCSHC, physical health correlated with both cognitive function and mental health, but there was no significant correlation between cognitive and mental health. Cognitive function was significantly associated with physical mobility, satisfaction with life, and wisdom, whereas physical health was associated with age, self-rated physical functioning, mental well-being, and resilience. Mental health was significantly associated with income, optimism, self-compassion, loneliness, and sleep disturbances. CONCLUSION: Different psychosocial factors are significantly associated with cognitive, physical, and mental health. Longitudinal studies of diverse samples of older adults are necessary to determine risk factors and protective factors for specific domains of health. With rapidly growing numbers of older adults who require healthcare as well as supportive housing, CCSHCs will become increasingly important sites for studying and promoting the health of older adults.

Artificial Intelligence for Mental Health and Mental Illnesses: an Overview.

PURPOSE OF REVIEW: Artificial intelligence (AI) technology holds both great promise to transform mental healthcare and potential pitfalls. This article provides an overview of AI and current applications in healthcare, a review of recent original research on AI specific to mental health, and a discussion of how AI can supplement clinical practice while considering its current limitations, areas needing additional research, and ethical implications regarding AI technology. RECENT FINDINGS: We reviewed 28 studies of AI and mental health that used electronic health records (EHRs), mood rating scales, brain imaging data, novel monitoring systems (e.g., smartphone, video), and social media platforms to predict, classify, or subgroup mental health illnesses including depression, schizophrenia or other psychiatric illnesses, and suicide ideation and attempts. Collectively, these studies revealed high accuracies and provided excellent examples of AI's potential in mental healthcare, but most should be considered early proof-of-concept works demonstrating the potential of using machine learning (ML) algorithms to address mental health questions, and which types of algorithms yield the best performance. As AI techniques continue to be refined and improved, it will be possible to help mental health practitioners re-define mental illnesses more objectively than currently done in the DSM-5, identify these illnesses at an earlier or prodromal stage when interventions may be more effective, and personalize treatments based on an individual's unique characteristics. However, caution is necessary in order to avoid over-interpreting preliminary results, and more work is required to bridge the gap between AI in mental health research and clinical care.

Navigating Ethics in the Digital Age: Introducing Connected and Open Research Ethics (CORE), a Tool for Researchers and Institutional Review Boards.

Research studies that leverage emerging technologies, such as passive sensing devices and mobile apps, have demonstrated encouraging potential with respect to favorably influencing the human condition. As a result, the nascent fields of mHealth and digital medicine have gained traction over the past decade as demonstrated in the United States by increased federal funding for research that cuts across a broad spectrum of health conditions. The existence of mHealth and digital medicine also introduced new ethical and regulatory challenges that both institutional review boards (IRBs) and researchers are struggling to navigate. In response, the Connected and Open Research Ethics (CORE) initiative was launched. The CORE initiative has employed a participatory research approach, whereby researchers and IRB affiliates are involved in identifying the priorities and functionality of a shared resource. The overarching goal of CORE is to develop dynamic and relevant ethical practices to guide mHealth and digital medicine research. In this Viewpoint paper, we describe the CORE initiative and call for readers to join the CORE Network and contribute to the bigger conversation on ethics in the digital age.

Reimagining Human Research Protections for 21st Century Science.

BACKGROUND: Evolving research practices and new forms of research enabled by technological advances require a redesigned research oversight system that respects and protects human research participants. OBJECTIVE: Our objective was to generate creative ideas for redesigning our current human research oversight system. METHODS: A total of 11 researchers and institutional review board (IRB) professionals participated in a January 2015 design thinking workshop to develop ideas for redesigning the IRB system. RESULTS: Ideas in 5 major domains were generated. The areas of focus were (1) improving the consent form and process, (2) empowering researchers to protect their participants, (3) creating a system to learn from mistakes, (4) improving IRB efficiency, and (5) facilitating review of research that leverages technological advances. CONCLUSIONS: We describe the impetus for and results of a design thinking workshop to reimagine a human research protections system that is responsive to 21st century science.

Ethical, legal, and social implications of digital health: A needs assessment from the Society of Behavioral Medicine to inform capacity building for behavioral scientists.

The ethical, legal, and social implications (ELSIs) of digital health are important when researchers and practitioners are using technology to collect, process, or store personal health data. Evidence underscores a strong need for digital health ELSI training, yet little is known about the specific ELSI topic areas that researchers and practitioners would most benefit from learning. To identify ELSI educational needs, a needs assessment survey was administered to the members of the Society of Behavioral Medicine (SBM). We sought to identify areas of ELSI proficiency and training need, and also evaluate interest and expertise in ELSI topics by career level and prior ELSI training history. The 14-item survey distributed to SBM members utilized the Digital Health Checklist tool (see recode.health/tools) and included items drawn from the four-domain framework: data management, access and usability, privacy and risk to benefit assessment. Respondents (N = 66) were majority faculty (74.2%) from psychology or public health. Only 39.4% reported receiving "formal" ELSI training. ELSI topics of greatest interest included practices that supported participant engagement, and dissemination and implementation of digital tools beyond the research setting. Respondents were least experienced in managing "bystander" data, having discussions about ELSIs, and reviewing terms of service agreements and privacy policies with participants and patients. There is opportunity for formalized ELSI training across career levels. Findings serve as an evidence base for continuous and ongoing evaluation of ELSI training needs to support scientists in conducting ethical and impactful digital health research.

New technologies are increasingly used in research and practice, which introduce new ethical, legal, and social implications (ELSIs). While there are scholars who study ELSIs in research, it is important that behavioral scientists have ELSI training in order to identify and mitigate possible harms and maximize benefits among their patients/participants, particularly when using technologies that collect personal health information. ELSI training opportunities are limited and, because ELSI is a broad complicated field, we know very little about the specific topics that researchers/practitioners would benefit from learning. To understand ELSI training needs specific to the field of digital health, we asked the members of the Society of Behavioral Medicine, a multidisciplinary nonprofit organization, to tell us about which ELSI areas they are most interested in. We found that 39.4% of members received formal ELSI training. Members were most interested in using technology to help patients/participants stay engaged in their treatments, and developing technologies that can be used outside of research (in the "real world"). Members were least experienced in reviewing terms of service/privacy policies and handling information collected from non-patient/participants (people in the backgrounds of voice recordings/videos). Training interests differed by career level (faculty vs. students), and so future ELSI trainings could be more beneficial if they were mindful of prior experiences.

Evaluating Users' Experiences of a Child Multimodal Wearable Device: Mixed Methods Approach.

BACKGROUND: Wearable devices permit the continuous, unobtrusive collection of data from children in their natural environments and can transform our understanding of child development. Although the use of wearable devices has begun to emerge in research involving children, few studies have considered families' experiences and perspectives of participating in research of this kind. OBJECTIVE: Through a mixed methods approach, we assessed parents' and children's experiences of using a new wearable device in the home environment. The wearable device was designed specifically for use with infants and young children, and it integrates audio, electrocardiogram, and motion sensors. METHODS: In study 1, semistructured phone interviews were conducted with 42 parents of children aged 1 month to 9.5 years who completed 2 day-long recordings using the device, which the children wore on a specially designed shirt. In study 2, a total of 110 parents of children aged 2 months to 5.5 years responded to a questionnaire assessing their experience of completing 3 day-long device recordings in the home. Guided by the Digital Health Checklist, we assessed parental responses from both studies in relation to the following three key domains: (1) access and usability, (2) privacy, and (3) risks and benefits. RESULTS: In study 1, most parents viewed the device as easy to use and safe and remote visits as convenient. Parents' views on privacy related to the audio recordings were more varied. The use of machine learning algorithms (vs human annotators) in the analysis of the audio data, the ability to stop recordings at any time, and the view that the recordings reflected ordinary family life were some reasons cited by parents who expressed minimal, if any, privacy concerns. Varied risks and benefits were also reported, including perceived child comfort or discomfort, the need to adjust routines to accommodate the study, the understanding gained from the study procedures, and the parent's and child's enjoyment of study participation. In study 2, parents' ratings on 5 close-ended items yielded a similar pattern of findings. Compared with a "neutral" rating, parents were significantly more likely to agree that (1) device instructions were helpful and clear (t109=-45.98; P<.001), (2) they felt comfortable putting the device on their child (t109=-22.22; P<.001), and (3) they felt their child was safe while wearing the device (t109=-34.48; P<.001). They were also less likely to worry about the audio recordings gathered by the device (t108=6.14; P<.001), whereas parents' rating of the burden of the study procedures did not differ significantly from a "neutral" rating (t109=-0.16; P=.87). CONCLUSIONS: On the basis of parents' feedback, several concrete changes can be implemented to improve this new wearable platform and, ultimately, parents' and children's experiences of using child wearable devices in the home setting.

Evaluating Mobile Apps Targeting Older Adults: Descriptive Study.

BACKGROUND: Smartphone use has increased dramatically and, in parallel, a market for mobile apps, including health apps, has emerged. The business model of targeted mobile app advertisements allows for the collection of personal and potentially sensitive information, often without user knowledge. Older adults comprise a rapidly growing demographic that is potentially vulnerable to exploitation by those accessing data collected via these apps. OBJECTIVE: This research examined apps that claimed to be useful to older adults with a goal of (1) classifying the functionality of each app, (2) identifying whether a privacy policy existed and was accessible, and (3) evaluating evidence that could support claims of value to older adults. METHODS: An environmental scan was conducted using the Google search engine and typing "apps for older adults." The first 25 sites that this search returned comprised the primary data for this study. Data were organized by descriptive features of purpose (eg, health, finance, and utility), the existence of an electronically accessible privacy policy, price, and evidence supporting each recommended mobile app. RESULTS: A total of 133 mobile apps were identified and promoted as being the best "apps for older adults." Of these 133 mobile apps, 83% (n=110) included a privacy policy. Fewer apps designated in the "medical" category included a privacy policy than those classified otherwise. CONCLUSIONS: The results suggest that most mobile apps targeting older adults include a privacy policy. Research is needed to determine whether these privacy policies are readable, succinct, and incorporate accessible data use and sharing practices to mitigate potential risks, particularly when collecting potentially sensitive health information.

Digital exposure notification tools: A global landscape analysis.

BACKGROUND: As the COVID-19 pandemic continues, digital exposure notification systems are increasingly used to support traditional contact tracing and other preventive strategies. Likewise, a plethora of COVID-19 mobile applications have emerged. Objective: To characterize the global landscape of pandemic related mobile applications, including digital exposure notification and contact tracing tools. DATA SOURCES AND METHODS: The following queries were entered into the Google search engine: "(*country name* COVID app) OR (COVID app *country name*) OR (COVID app *country name*+) OR (*country name*+ COVID app)". The App Store, Google Play, and official government websites were then accessed to collect descriptive data for each application. Descriptive data were qualified and quantified using standard methods. COVID-19 Exposure Notification Systems (ENS) and non-Exposure Notification products were categorized and summarized to provide a global landscape review. RESULTS: Our search resulted in a global count of 224 COVID-19 mobile applications, in 127 countries. Of these 224 apps, 128 supported exposure notification, with 75 employing the Google Apple Exposure Notification (GAEN) application programming interface (API). Of the 75 apps using the GAEN API, 15 apps were developed using Exposure Notification Express, a GAEN turnkey solution. COVID-19 applications that did not include exposure notifications (n = 96) focused on COVID-19 Self-Assessment (35·4%), COVID-19 Statistics and Information (32·3%), and COVID-19 Health Advice (29·2%). CONCLUSIONS: The digital response to COVID-19 generated diverse and novel solutions to support non-pharmacologic public health interventions. More research is needed to evaluate the extent to which these services and strategies were useful in reducing viral transmission.