Peril and Promise: Teens, Tech, and America's Mental Health Crisis.

Advances in Internet technologies have implications for the health and development of children and adolescents with potential for both beneficial and harmful outcomes. Similar technological advances also impact how psychiatrists deliver mental health care in clinical settings. Internet tech adds complexities to psychiatric practice in the form of electronic health records, patient portals, and virtual patient contact, which clinicians must understand and successfully incorporate into practice. Digital therapeutics and virtual mental health endeavors offer new treatment delivery options for patients and providers. Some have proven benefits, such as improved accessibility for patients, but all require provider expertise to utilize.

A deep learning-based model for detecting Leishmania amastigotes in microscopic slides: a new approach to telemedicine.

BACKGROUND: Leishmaniasis, an illness caused by protozoa, accounts for a substantial number of human fatalities globally, thereby emerging as one of the most fatal parasitic diseases. The conventional methods employed for detecting the Leishmania parasite through microscopy are not only time-consuming but also susceptible to errors. Therefore, the main objective of this study is to develop a model based on deep learning, a subfield of artificial intelligence, that could facilitate automated diagnosis of leishmaniasis. METHODS: In this research, we introduce LeishFuNet, a deep learning framework designed for detecting Leishmania parasites in microscopic images. To enhance the performance of our model through same-domain transfer learning, we initially train four distinct models: VGG19, ResNet50, MobileNetV2, and DenseNet 169 on a dataset related to another infectious disease, COVID-19. These trained models are then utilized as new pre-trained models and fine-tuned on a set of 292 self-collected high-resolution microscopic images, consisting of 138 positive cases and 154 negative cases. The final prediction is generated through the fusion of information analyzed by these pre-trained models. Grad-CAM, an explainable artificial intelligence technique, is implemented to demonstrate the model's interpretability. RESULTS: The final results of utilizing our model for detecting amastigotes in microscopic images are as follows: accuracy of 98.95 1.4%, specificity of 98 2.67%, sensitivity of 100%, precision of 97.91 2.77%, F1-score of 98.92 1.43%, and Area Under Receiver Operating Characteristic Curve of 99 1.33. CONCLUSION: The newly devised system is precise, swift, user-friendly, and economical, thus indicating the potential of deep learning as a substitute for the prevailing leishmanial diagnostic techniques.

Mobile Phone-Based Confidential Social Network Referrals for HIV Testing (CONSORT): Protocol for a Randomized Controlled Trial.

BACKGROUND: Critical to efforts to end the HIV epidemic is the identification of persons living with HIV who have yet to be diagnosed and engaged in care. Expanded HIV testing outreach efforts need to be both efficient and ambitious, targeting the social networks of persons living with HIV and those at above-average risk of undiagnosed HIV infection. The ubiquity of mobile phones across many high HIV prevalence settings has created opportunities to leverage mobile health (mHealth) technologies to engage social networks for HIV testing outreach, prevention, and treatment. OBJECTIVE: The purpose of this study is to evaluate the acceptability and efficacy of a novel mHealth intervention, "Confidential Social Network Referrals for HIV Testing (CONSORT)," to nudge at-risk individuals to test for HIV using SMS text messages. METHODS: We will conduct the CONSORT study in Moshi, Tanzania, the commercial center and administrative capital of the Kilimanjaro Region in northern Tanzania. After qualitative formative work and pilot testing, we will enroll 400 clients presenting for HIV counseling and testing and 200 persons living with HIV and receiving care at HIV care and treatment centers as "inviters" into a randomized controlled trial. Eligible participants will be aged 18 years or older and live, work, or regularly receive care in Moshi. We will randomize inviters into 1 of 2 study arms. All inviters will be asked to complete a survey of their HIV testing and risk behaviors and to think of social network contacts who would benefit from HIV testing. They will then be asked to whom they would prefer to extend an HIV testing invitation in the form of a physical invitation card. Arm 1 participants will also be given the opportunity to extend CONSORT invitations in the form of automated confidential SMS text messages to any of their social network contacts or "invitees." Arm 2 participants will be offered physical invitation cards alone. The primary outcome will be counselor-documented uptake of HIV testing by invitees within 30 days of inviter enrollment. Secondary outcomes will include the acceptability of CONSORT among inviters, the number of new HIV diagnoses, and the HIV risk of invitees who present for testing. RESULTS: Enrollment in the randomized controlled trial is expected to start in September 2024. The findings will be disseminated to stakeholders and published in peer-reviewed journals. CONCLUSIONS: If CONSORT is acceptable and effective for increasing the uptake of HIV testing, given the minimal costs of SMS text reminders and the potential for exponential but targeted growth using chain referrals, it may shift current practices for HIV testing programs in the area. TRIAL REGISTRATION: ClincalTrials.gov NCT05967208; https://clinicaltrials.gov/study/NCT05967208. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/55068.

Intra and inter-rater remote assessment of bradykinesia in Parkinson's disease / Evaluación remota de la bradicinesia en la enfermedad de Parkinson mediante análisis intra e inter evaluadores

Introduction: Reliable assessment of individuals with Parkinson's disease (PD) is essential for providing adequate treatment. Clinical assessment is a complex and time-consuming task, especially for bradykinesia, since its evaluation can be influenced by the degree of experience of the examiner, patient collaboration and individual bias. Improvement of the clinical evaluation can be obtained by considering assessments from several professionals. However, this is only true when inter and intra-rater agreement are high. Recently, the Movement Disorder Society highlighted, during the COVID-19 pandemic, the need to develop and validate technologies for remote assessment of the motor status of people with PD. Thus, this study introduces an objective strategy for the remote evaluation of bradykinesia using multi-specialist analysis. Methods: Twelve volunteers with PD participated and these were asked to execute finger tapping, hand opening/closing and pronation/supination movements. Each task was recorded and rated by fourteen PD health experts for each patient. The scores were assessed on an individual basis. Intra and inter-rater agreement and correlation were estimated. Results: The results showed that agreements and correlations between experienced examiners were high with low variability. In addition, group analysis was noted as possessing the potential to solve individual inconsistency bias. Conclusion: Furthermore, this study demonstrated the need for a group with prior training and experience, along with indicating the importance for the development of a clinical protocol that can use telemedicine for the evaluation of individuals with PD, as well as the inclusion of a specialized mediating group. In Addition, this research helps to the development of a valid remote assessment of bradykinesia.(AU)

Introducción: La evaluación confiable de las personas con la enfermedad de Parkinson (EP) es esencial para lograr con un tratamiento adecuado. La evaluación clínica es una tarea compleja y que requiere mucho tiempo, especialmente para la bradicinesia, ya que su evaluación puede verse influenciada por el grado de experiencia del examinador, la colaboración del paciente y el sesgo individual. La mejora de la evaluación clínica se puede obtener considerando las evaluaciones de varios profesionales. Sin embargo, esto solo es más preciso cuando el convenio intra e inter evaluadores es alto. Recientemente, la Sociedad de Trastornos del Movimiento destacó, durante la pandemia COVID-19, la necesidad de desarrollar y validar tecnologías para la evaluación remota del estado motor de las personas con EP. Por lo tanto, este estudio presenta una estrategia objetiva para la evaluación remota de la bradicinesia mediante un análisis multi evaluadores. Métodos: Participaron 12 voluntarios con EP y se les pidió que ejecutaran movimientos de golpeteo de dedos de las manos, movimientos con las manos y pronación-supinación de las manos. Cada ejecución del movimiento fue registrado y calificado por 14 expertos en salud. Las puntuaciones se evaluaron de forma individual. Se estimó el convenio y la correlación intra e inter evaluadores. Resultados: Los resultados mostraron que los convenios y las correlaciones inter evaluadores experimentados son altos con baja variabilidad. Además, se observó que el análisis de grupo posee el potencial de resolver el sesgo de inconsistencia individual. Conclusiones: De esta forma, este estudio demostró la necesidad de un grupo con formación y experiencia previa, señalando la importancia para el desarrollo de un protocolo clínico que utiliza la telemedicina para la evaluación de personas con EP y como la inclusión de un grupo mediador especializado. En realidad, esta investigación propone una evaluación remota eficaz de la bradicinesia.(AU)

Use of tele-nursing in primary care: A qualitative study on its negative and positive aspects / Uso de teleenfermería en atención primaria: estudio cualitativo sobre sus aspectos negativos y positivos

Objective To analyze the opinions of nursing professionals on the current limitations and future potential of digital tools in healthcare. Design Qualitative and descriptive study. Location The study took place during an asynchronous MOODLE course on the use of ICT in healthcare, specifically aimed at nursing professionals. Participants The number of nurses enrolled in the course was 150. Methods A qualitative study was conducted focusing on the positive and negative aspects that telenursing can offer in the context of a Moodle training in new technologies for nurses. A thematic analysis was carried out following the method proposed by Braun and Clarke. Results In the end 68 nurses participated in the forum. Their statements, opinions and perceptions were analyzed and 28 descriptive codes were obtained and subsequently categorized into positive and negative aspects. Conclusions Nurses positively value the usefulness of digital tools and identify a wide range of benefits of telenursing in daily practice. At the same time, they point out crucial limitations that may slow down the adoption of telenursing, pointing to areas for improvement such as training and digital literacy of both patients and professionals. They consider that telenursing can humanise care, but insist on the need to prevent its use from increasing health inequalities. (AU)

Objetivo Analizar las opiniones de los profesionales de enfermería sobre las limitaciones actuales y el potencial futuro de las herramientas digitales en la atención sanitaria. Diseño Estudio cualitativo y descriptivo. Lugar El estudio se desarrolló durante un curso MOODLE asíncrono sobre el uso de las TIC en la atención sanitaria, dirigido específicamente a profesionales de enfermería. Participantes El número de enfermeras inscritas en el curso fue de 150. MétodosSe realizó un estudio cualitativo centrado en los aspectos positivos y negativos que puede ofrecer la teleenfermería en el contexto de una formación Moodle en nuevas tecnologías para enfermeras. Se realizó un análisis temático siguiendo el método propuesto por Braun y Clarke. Resultados Finalmente participaron en el foro 68 enfermeras. Se analizaron las declaraciones, las opiniones y las percepciones de las mismas, obteniéndose 28 códigos descriptivos que posteriormente se categorizaron en aspectos positivos y negativos. Conclusiones Las enfermeras valoran positivamente la utilidad de las herramientas digitales e identifican una amplia gama de beneficios de la teleenfermería en la práctica diaria. Al mismo tiempo, señalan limitaciones cruciales que pueden ralentizar la adopción de la teleenfermería, señalando áreas de mejora como la formación y la alfabetización digital tanto de pacientes como de profesionales. Consideran que la teleenfermería puede humanizar la asistencia, pero insisten en la necesidad de evitar que su uso aumente las desigualdades en salud. (AU)

Preferences of people with chronic kidney disease regarding digital health interventions that promote healthy lifestyle: qualitative systematic review with meta-ethnography.

OBJECTIVES: Diet and physical activity are crucial for people with chronic kidney disease (CKD) to maintain good health. Digital health interventions can increase access to lifestyle services. However, consumers' perspectives are unclear, which may reduce the capacity to develop interventions that align with specific needs and preferences. Therefore, this review aims to synthesise the preferences of people with CKD regarding digital health interventions that promote healthy lifestyle. DESIGN: Qualitative systematic review with meta-ethnography. DATA SOURCES: Databases Scopus, CENTRAL, MEDLINE, CINAHL and SPORTDiscus were searched between 2000 and 2023. ELIGIBILITY CRITERIA: Primary research papers that used qualitative exploration methods to explore the preferences of adults with CKD (≥18 years) regarding digital health interventions that promoted diet, physical activity or a combination of these health behaviours. DATA EXTRACTION AND SYNTHESIS: Two independent reviewers screened title, abstract and full text. Discrepancies were resolved by a third reviewer. Consumers' quotes were extracted verbatim and synthesised into higher-order themes and subthemes. RESULTS: Database search yielded 5761 records. One record was identified following communication with a primary author. 15 papers were included. These papers comprised 197 consumers (mean age 51.0±7.2), including 83 people with CKD 1-5; 61 kidney transplant recipients; 53 people on dialysis. Sex was reported in 182 people, including 53% male. Five themes were generated regarding consumers' preferences for digital lifestyle interventions. These included simple instruction and engaging design; individualised interventions; virtual communities of care; education and action plans; and timely reminders and automated behavioural monitoring. CONCLUSION: Digital health interventions were considered an important mechanism to access lifestyle services. Consumers' preferences are important to ensure future interventions are tailored to specific needs and goals. Future research may consider applying the conceptual framework of consumers' preferences in this review to develop and evaluate the effect of a digital lifestyle intervention on health outcomes. PROSPERO REGISTRATION NUMBER: CRD42023411511.

Epidemic preparedness and innovations in digital healthcare: enhancing post-pandemic speech-language pathology services for child and adolescent mental health in Qatar.

BACKGROUND: This paper discusses the critical importance of epidemic preparedness and innovations in digital health care by examining the transformative impact on speech-language pathology (SLP) services in a specialist outpatient child and adolescent service (CAMHS). METHOD: This retrospective review analyzes referral data from three periods: pre-pandemic (15 March 2019-14 March 2020), pandemic (15 March 2020-14 March 2021), and post-pandemic (15 March 2021-14 March 2022). Statistical analyses assess trends in referrals and diagnoses during these periods. Feedback was also obtained from Parents of children who received virtual consultations during the pandemic. RESULTS: The results reveal an increase in the demand for SLP services during and after the pandemic, with a surge in referrals (increased from 9.7 to 12.9% when compared pre-pandemic to post-pandemic periods; Chi-Square value 3.33, P = 0.068) for children with social communication challenges and autism spectrum disorder. Phone and video consultations were effectively adopted. Feedback from families shows a positive response (69%-98% of participants responded as strongly agreed and agreed on various items listed in feedback form specifically designed in line with the service objectives) to telehealth interventions, with many parents finding virtual consultations effective and helpful. CONCLUSIONS: The study emphasizes the importance of telehealth SLP services in meeting the increasing demand for mental health interventions among children and adolescents. It suggests integrating telehealth into clinical practice beyond the pandemic and highlights the need for long-term evaluation and addressing potential barriers to access.

Understanding Patient Perspectives on the Use of Gamification and Incentives in mHealth Apps to Improve Medication Adherence: Qualitative Study.

BACKGROUND: Medication nonadherence remains a significant health and economic burden in many high-income countries. Emerging smartphone interventions have started to use features such as gamification and financial incentives with varying degrees of effectiveness on medication adherence and health outcomes. A more consistent approach to applying these features, informed by patient perspectives, may result in more predictable and beneficial results from this type of intervention. OBJECTIVE: This qualitative study aims to identify patient perspectives on the use of gamification and financial incentives in mobile health (mHealth) apps for medication adherence in Australian patients taking medication for chronic conditions. METHODS: A total of 19 participants were included in iterative semistructured web-based focus groups conducted between May and December 2022. The facilitator used exploratory prompts relating to mHealth apps, gamification, and financial incentives, along with concepts raised from previous focus groups. Transcriptions were independently coded to develop a set of themes. RESULTS: Three themes were identified: purpose-driven design, trust-based standards, and personal choice. All participants acknowledged gamification and financial incentives as potentially effective features in mHealth apps for medication adherence. However, they also indicated that the effectiveness heavily depended on implementation and execution. Major concerns relating to gamification and financial incentives were perceived trivialization and potential for medication abuse, respectively. CONCLUSIONS: The study's findings provide a foundation for developers seeking to apply these novel features in an app intervention for a general cohort of patients. However, the study highlights the need for standards for mHealth apps for medication adherence, with particular attention to the use of gamification and financial incentives. Future research with patients and stakeholders across the mHealth app ecosystem should be explored to formalize and validate a set of standards or framework.

Designing for Improved Patient Experiences in Home Dialysis: Usability and User Experience Findings From User-Based Evaluation Study With Patients With Chronic Conditions.

BACKGROUND: Chronic kidney disease affects 10% of the population worldwide, and the number of patients receiving treatment for end-stage kidney disease is forecasted to increase. Therefore, there is a pressing need for innovative digital solutions that increase the efficiency of care and improve patients' quality of life. The aim of the eHealth in Home Dialysis project is to create a novel eHealth solution, called eC4Me, to facilitate predialysis and home dialysis care for patients with chronic kidney disease. OBJECTIVE: Our study aimed to evaluate the usability, user experience (UX), and patient experience (PX) of the first version of the eC4Me solution. METHODS: We used a user-based evaluation approach involving usability testing, questionnaire, and interview methods. The test sessions were conducted remotely with 10 patients with chronic kidney disease, 5 of whom had used the solution in their home environment before the tests, while the rest were using it for the first time. Thematic analysis was used to analyze user test and questionnaire data, and descriptive statistics were calculated for the UMUX (Usability Metric for User Experience) scores. RESULTS: Most usability problems were related to navigation, the use of terminology, and the presentation of health-related data. Despite usability challenges, UMUX ratings of the solution were positive overall. The results showed noteworthy variation in the expected benefits and perceived effort of using the solution. From a PX perspective, it is important that the solution supports patients' own health-related goals and fits with the needs of their everyday lives with the disease. CONCLUSIONS: A user-based evaluation is a useful and necessary part of the eHealth solution development process. Our study findings can be used to improve the usability and UX of the evaluated eC4Me solution. Patients should be actively involved in the solution development process when specifying what information is relevant for them. Traditional usability tests complemented with questionnaire and interview methods can serve as a meaningful methodological approach for gaining insight not only into usability but also into UX- and PX-related aspects of digital health solutions.

Best Practices and Recommendations for Research Using Virtual Real-Time Data Collection: Protocol for Virtual Data Collection Studies.

BACKGROUND: The COVID-19 pandemic and the subsequent need for social distancing required the immediate pivoting of research modalities. Research that had previously been conducted in person had to pivot to remote data collection. Researchers had to develop data collection protocols that could be conducted remotely with limited or no evidence to guide the process. Therefore, the use of web-based platforms to conduct real-time research visits surged despite the lack of evidence backing these novel approaches. OBJECTIVE: This paper aims to review the remote or virtual research protocols that have been used in the past 10 years, gather existing best practices, and propose recommendations for continuing to use virtual real-time methods when appropriate. METHODS: Articles (n=22) published from 2013 to June 2023 were reviewed and analyzed to understand how researchers conducted virtual research that implemented real-time protocols. "Real-time" was defined as data collection with a participant through a live medium where a participant and research staff could talk to each other back and forth in the moment. We excluded studies for the following reasons: (1) studies that collected participant or patient measures for the sole purpose of engaging in a clinical encounter; (2) studies that solely conducted qualitative interview data collection; (3) studies that conducted virtual data collection such as surveys or self-report measures that had no interaction with research staff; (4) studies that described research interventions but did not involve the collection of data through a web-based platform; (5) studies that were reviews or not original research; (6) studies that described research protocols and did not include actual data collection; and (7) studies that did not collect data in real time, focused on telehealth or telemedicine, and were exclusively intended for medical and not research purposes. RESULTS: Findings from studies conducted both before and during the COVID-19 pandemic suggest that many types of data can be collected virtually in real time. Results and best practice recommendations from the current protocol review will be used in the design and implementation of a substudy to provide more evidence for virtual real-time data collection over the next year. CONCLUSIONS: Our findings suggest that virtual real-time visits are doable across a range of participant populations and can answer a range of research questions. Recommended best practices for virtual real-time data collection include (1) providing adequate equipment for real-time data collection, (2) creating protocols and materials for research staff to facilitate or guide participants through data collection, (3) piloting data collection, (4) iteratively accepting feedback, and (5) providing instructions in multiple forms. The implementation of these best practices and recommendations for future research are further discussed in the paper. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/53790.

The effectiveness of e-mental health interventions on stress, anxiety, and depression among healthcare professionals: a systematic review and meta-analysis.

BACKGROUND: Many healthcare professionals are experiencing psychological distress. Electronic mental health (e-mental health) interventions are convenient and multifunctional. This review aimed to examine the effectiveness of e-mental health interventions in enhancing the well-being of healthcare professionals and to identify moderating factors. METHODS: A comprehensive and systematic retrieval of randomized controlled trial (RCT) studies was conducted across eight databases. Population, intervention, comparison, and outcome (PICO) were used to define eligibility criteria. Stress, anxiety, and depression were included as the main outcomes. The overall effect was calculated based on the random effect model, and the effect size was presented using the standardized mean difference. The characteristics of the research design, intervention object, and intervention design were further selected as potential moderating factors for subgroup analysis. Meta-regression analyses were finally performed, incorporating intervention duration and sample size as independent variables. RESULTS: A total of 20 studies were included in the systematic review, and 17 were included in the meta-analysis. A large effect on relieving stress and anxiety and a small-to-medium effect on reducing depression were observed. Subgroup analyses showed that features including mindfulness approaches, online courses, computer use, group interventions, and professional guidance were more favorable in the design of services. Meta-regression revealed that intervention duration only affected anxiety symptoms. Caution should be exercised, as some subgroups had fewer studies and higher heterogeneity. For the secondary outcomes, a large effect on emotional exhaustion and a small-to-medium effect on well-being were observed. CONCLUSION: In general, e-mental health interventions significantly improve the psychological health of healthcare staff. Future high-quality, large-scale studies targeting healthcare professionals and specific intervention scenarios are warranted.

The potential of virtual healthcare technologies to reduce healthcare services' carbon footprint.

The COVID-19 pandemic demonstrated the potential to reduce our carbon footprint especially by reducing travel. We aim to describe healthcare and health education services' contribution to the global climate emergency and identify the need for increased use of virtual health service delivery and undergraduate/postgraduate education to help reduce the impact of health service and health education delivery on the environment. Health care services, as one of the largest contributors to carbon emissions, must take steps to rapidly reduce their carbon footprint. Health services have unfortunately paid little attention to this issue until recently. Virtual healthcare and education have a valuable role in transition to a net carbon-zero outcome. Given the increasing use of and satisfaction with virtual health services such as telehealth, and the increase in virtual education opportunities, it is important that a concerted effort is undertaken to increase their use across health services and education in the future.

Participatory Development of an Integrated, eHealth-Supported, Educational Care Pathway (Diabetes Box) for People With Type 2 Diabetes: Development and Usability Study.

BACKGROUND: Type 2 diabetes (T2D) tremendously affects patient health and health care globally. Changing lifestyle behaviors can help curb the burden of T2D. However, health behavior change is a complex interplay of medical, behavioral, and psychological factors. Personalized lifestyle advice and promotion of self-management can help patients change their health behavior and improve glucose regulation. Digital tools are effective in areas of self-management and have great potential to support patient self-management due to low costs, 24/7 availability, and the option of dynamic automated feedback. To develop successful eHealth solutions, it is important to include stakeholders throughout the development and use a structured approach to guide the development team in planning, coordinating, and executing the development process. OBJECTIVE: The aim of this study is to develop an integrated, eHealth-supported, educational care pathway for patients with T2D. METHODS: The educational care pathway was developed using the first 3 phases of the Center for eHealth and Wellbeing Research roadmap: the contextual inquiry, the value specification, and the design phase. Following this roadmap, we used a scoping review about diabetes self-management education and eHealth, past experiences of eHealth practices in our hospital, focus groups with health care professionals (HCPs), and a patient panel to develop a prototype of an educational care pathway. This care pathway is called the Diabetes Box (Leiden University Medical Center) and consists of personalized education, digital educational material, self-measurements of glucose, blood pressure, activity, and sleep, and a smartphone app to bring it all together. RESULTS: The scoping review highlights the importance of self-management education and the potential of telemonitoring and mobile apps for blood glucose regulation in patients with T2D. Focus groups with HCPs revealed the importance of including all relevant lifestyle factors, using a tailored approach, and using digital consultations. The contextual inquiry led to a set of values that stakeholders found important to include in the educational care pathway. All values were specified in biweekly meetings with key stakeholders, and a prototype was designed. This prototype was evaluated in a patient panel that revealed an overall positive impression of the care pathway but stressed that the number of apps should be restricted to one, that there should be no delay in glucose value visualization, and that insulin use should be incorporated into the app. Both patients and HCPs stressed the importance of direct automated feedback in the Diabetes Box. CONCLUSIONS: After developing the Diabetes Box prototype using the Center for eHealth and Wellbeing Research roadmap, all stakeholders believe that the concept of the Diabetes Box is useful and feasible and that direct automated feedback and education on stress and sleep are essential. A pilot study is planned to assess feasibility, acceptability, and usefulness in more detail.

Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review.

BACKGROUND: Digital health interventions (DHIs) have the potential to enable public end users, such as citizens and patients, to manage and improve their health. Although the number of available DHIs is increasing, examples of successfully established DHIs in public health systems are limited. To counteract the nonuse of DHIs, they should be comprehensively evaluated while integrating end users. Unfortunately, there is a wide variability and heterogeneity according to the approaches of evaluation, which creates a methodological challenge. OBJECTIVE: This scoping review aims to provide an overview of the current established processes for evaluating DHIs, including methods, indicators, and end-user involvement. The review is not limited to a specific medical field or type of DHI but offers a holistic overview. METHODS: This scoping review was conducted following the JBI methodology for scoping reviews based on the framework by Arksey & O'Malley and complies with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three scientific databases (PubMed, Scopus, and Science Direct) were searched in April 2023. English and German studies between 2008 and 2023 were considered when evaluating DHIs that explicitly address public end users. The process of study selection was carried out by several researchers to avoid reviewer bias. RESULTS: The search strategy identified 9618 publications, of which 160 were included. Among these included articles, 200 evaluations were derived and analyzed. The results showed that there is neither a consensus on the methods to evaluate DHIs nor a commonly agreed definition or usage of the evaluated indicators, which results in a broad variety of evaluation practices. This aligns with observations of the existing literature. It was found that there is a lack of references to existing frameworks for the evaluation of DHIs. The majority of the included studies referred to user-centered approaches and involved end users in the evaluation process. As assistance for people developing and evaluating DHIs and as a basis for thinking about appropriate ways to evaluate DHIs, a results matrix was created where the findings were combined per DHI cluster. Additionally, general recommendations for the evaluators of DHIs were formulated. CONCLUSIONS: The findings of this scoping review offer a holistic overview of the variety and heterogeneity according to the approaches of evaluation of DHIs for public end users. Evaluators of these DHIs should be encouraged to reference established frameworks or measurements for justification. This would ease the transferability of the results among similar evaluation studies within the digital health sector, thereby enhancing the coherence and comparability of research in this area.

Implementing team-based telemedicine workflows in safety-net primary care.

OBJECTIVES: Challenges in implementing telemedicine disproportionately affect patients served in safety-net settings. Few studies have elucidated pragmatic, team-based strategies for successful telemedicine implementation in primary care, especially with a safety-net population. STUDY DESIGN: We conducted in-depth, semistructured qualitative interviews with primary care clinicians and staff in a large urban safety-net health care system on the facilitators, challenges, and impact of implementing team workflows for synchronous telemedicine video and audio-only visits. METHODS: Interviews were analyzed using modified grounded theory with multistage coding. Common themes were identified and reviewed to describe within-group and between-group variations. We used the Practical, Robust Implementation Sustainability Model framework to organize the final themes with an implementation science lens. RESULTS: Four themes emerged from 11 interviews: (1) having a dedicated individual preparing patients for video visits is a prerequisite for the successful introduction of video visits to patients with limited digital literacy; (2) health care maintenance during video and audio-only visits benefits from standardized workflows and communication; (3) the increased flexibility and accessibility of telemedicine visits were perceived benefits to patient care, despite barriers for subsets of patients; and (4) telemedicine visits generally have a positive impact on work experience for clinicians and staff due to increased efficiency, despite audio-only visits feeling less engaging. CONCLUSIONS: Understanding how to strategically use team-based workflows to expand video visit access while ensuring care quality of all telemedicine visits will allow primary care practices to maximize telemedicine's benefits to patients in the safety-net setting.

Navigating privacy and security in telemedicine for primary care.

OBJECTIVE: To examine patient and provider perspectives on privacy and security considerations in telemedicine during the COVID-19 pandemic. STUDY DESIGN: Qualitative study with patients and providers from primary care practices in 3 National Patient-Centered Clinical Research Network sites in New York, New York; North Carolina; and Florida. METHODS: Semistructured interviews were conducted, audio recorded, transcribed verbatim, and coded using an inductive process. Data related to privacy and information security were analyzed. RESULTS: Sixty-five patients and 21 providers participated. Patients and providers faced technology-related security concerns as well as difficulties ensuring privacy in the transformed shared space of telemedicine. Patients expressed increased comfort doing telemedicine from home but often did not like their providers to offer virtual visits from outside an office setting. Providers initially struggled to find secure and Health Insurance Portability and Accountability Act-compliant platforms and devices to host the software. Whereas some patients preferred familiar platforms such as FaceTime, others recognized potential security concerns. Audio-only encounters sometimes raised patient concerns that they would not be able to confirm the identity of the provider. CONCLUSIONS: Telemedicine led to novel concerns about privacy because patients and providers were often at home or in public spaces, and they shared concerns about software and hardware security. In addition to technological safeguards, our study emphasizes the critical role of physical infrastructure in ensuring privacy and security. As telemedicine continues to evolve, it is important to address and mitigate concerns around privacy and security to ensure high-quality and safe delivery of care to patients in remote settings.