Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review.

BACKGROUND: Digital health interventions (DHIs) have the potential to enable public end users, such as citizens and patients, to manage and improve their health. Although the number of available DHIs is increasing, examples of successfully established DHIs in public health systems are limited. To counteract the nonuse of DHIs, they should be comprehensively evaluated while integrating end users. Unfortunately, there is a wide variability and heterogeneity according to the approaches of evaluation, which creates a methodological challenge. OBJECTIVE: This scoping review aims to provide an overview of the current established processes for evaluating DHIs, including methods, indicators, and end-user involvement. The review is not limited to a specific medical field or type of DHI but offers a holistic overview. METHODS: This scoping review was conducted following the JBI methodology for scoping reviews based on the framework by Arksey & O'Malley and complies with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three scientific databases (PubMed, Scopus, and Science Direct) were searched in April 2023. English and German studies between 2008 and 2023 were considered when evaluating DHIs that explicitly address public end users. The process of study selection was carried out by several researchers to avoid reviewer bias. RESULTS: The search strategy identified 9618 publications, of which 160 were included. Among these included articles, 200 evaluations were derived and analyzed. The results showed that there is neither a consensus on the methods to evaluate DHIs nor a commonly agreed definition or usage of the evaluated indicators, which results in a broad variety of evaluation practices. This aligns with observations of the existing literature. It was found that there is a lack of references to existing frameworks for the evaluation of DHIs. The majority of the included studies referred to user-centered approaches and involved end users in the evaluation process. As assistance for people developing and evaluating DHIs and as a basis for thinking about appropriate ways to evaluate DHIs, a results matrix was created where the findings were combined per DHI cluster. Additionally, general recommendations for the evaluators of DHIs were formulated. CONCLUSIONS: The findings of this scoping review offer a holistic overview of the variety and heterogeneity according to the approaches of evaluation of DHIs for public end users. Evaluators of these DHIs should be encouraged to reference established frameworks or measurements for justification. This would ease the transferability of the results among similar evaluation studies within the digital health sector, thereby enhancing the coherence and comparability of research in this area.

Breast-feeding promotion in hospitals and prospective breast-feeding rates during the first year of life in two national surveys 1997-1998 and 2017-2019 in Germany.

OBJECTIVES: The present study aimed to assess the current state of breast-feeding promotion in hospitals and the prevalence of breast-feeding during the first year of life in Germany and to compare the results with a study 20 years earlier. DESIGN: In the studies on 'breast-feeding and infant nutrition in Germany' named 'SuSe', a cross-sectional survey in hospitals was combined with a subsequent prospective survey of breast-feeding and infant nutrition during the first year of life (0·5, 2, 4, 6 and 12 months after birth) in mother-infant pairs who were recruited in the hospitals. Written questionnaires and phone calls were used in SuSe I and web-based questionnaires in SuSe II. Breast-feeding promotion and prevalence were evaluated using recommendations from the WHO and the UNICEF. SETTING: Two nationwide surveys SuSe I (1997-1998) and SuSe II (2017-2019). PARTICIPANTS: In SuSe I, 177 hospitals and 1717 mother-infant pairs and in SuSe II 109 hospitals and 962 mother-infant pairs were included. RESULTS: In SuSe II, hospitals implemented seven of the WHO 'Ten Steps to Successful Breastfeeding' to a greater extent than the hospitals in SuSe I. More mothers exclusively breastfed for 4 months (57 % v. 33 %) and continued breast-feeding until 6 (78 % v. 48 %) and 12 months (41 % v. 13 %). In both studies, exclusive breast-feeding decreased between 4 and 6 months of age due to the introduction of complementary feeding. CONCLUSIONS: In Germany, breast-feeding habits have come closer to the recommendations over the last 20 years.

Vascular Auscultation of Carotid Artery: Towards Biometric Identification and Verification of Individuals.

BACKGROUND: Biometric sensing is a security method for protecting information and property. State-of-the-art biometric traits are behavioral and physiological in nature. However, they are vulnerable to tampering and forgery. METHODS: The proposed approach uses blood flow sounds in the carotid artery as a source of biometric information. A handheld sensing device and an associated desktop application were built. Between 80 and 160 carotid recordings of 11 s in length were acquired from seven individuals each. Wavelet-based signal analysis was performed to assess the potential for biometric applications. RESULTS: The acquired signals per individual proved to be consistent within one carotid sound recording and between multiple recordings spaced by several weeks. The averaged continuous wavelet transform spectra for all cardiac cycles of one recording showed specific spectral characteristics in the time-frequency domain, allowing for the discrimination of individuals, which could potentially serve as an individual fingerprint of the carotid sound. This is also supported by the quantitative analysis consisting of a small convolutional neural network, which was able to differentiate between different users with over 95% accuracy. CONCLUSION: The proposed approach and processing pipeline appeared promising for the discrimination of individuals. The biometrical recognition could clinically be used to obtain and highlight differences from a previously established personalized audio profile and subsequently could provide information on the source of the deviation as well as on its effects on the individual's health. The limited number of individuals and recordings require a study in a larger population along with an investigation of the long-term spectral stability of carotid sounds to assess its potential as a biometric marker. Nevertheless, the approach opens the perspective for automatic feature extraction and classification.

A Digital Sexual Health Education Web Application for Resource-Poor Regions in Kenya: Implementation-Oriented Case Study Using the Intercultural Research Model.

BACKGROUND: Developing a digital educational application focused on sexual health education necessitates a framework that integrates cultural considerations effectively. Drawing from previous research, we identified the problem and essential requirements to incorporate cultural insights into the development of a solution. OBJECTIVE: This study aims to explore the Solution Room of the self-established Intercultural Research Model, with a focus on creating a reusable framework for developing and implementing a widely accessible digital educational tool for sexual health. The study centers on advancing from a low-fidelity prototype (She!Masomo) to a high-fidelity prototype (We!Masomo), while evaluating its system usability through differentiation. This research contributes to the pursuit of Sustainable Development Goals 3, 4, and 5. METHODS: The research methodology is anchored in the Solution Room of the self-expanded Intercultural Research Model, which integrates cultural considerations. It uses a multimethod, user-centered design thinking approach, focusing on extensive human involvement for the open web-based application. This includes gathering self-assessed textual user feedback, conducting a System Usability Scale (SUS) analysis, and conducting 4 face-to-face semistructured expert interviews, following COREQ (Consolidated Criteria for Reporting Qualitative Research) guidelines. RESULTS: Based on the identified limitations of the low-fidelity prototype, She!Masomo (SUS score 67), which were highlighted through textual user feedback (63/77) and prototype feature comparisons, iterative development and improvement were implemented. This process led to the creation of an enhanced high-fidelity prototype (We!Masomo). The improved effectiveness of the enhanced prototype was evaluated using the qualitative SUS analysis (82/90), resulting in a favorable score of 77.3, compared with the previous SUS score of 67 for the low-fidelity prototype. Highlighting the importance of accessible digital educational tools, this study conducted 4 expert interviews (4/4) and reported e-survey results following the CHERRIES (Checklist for Reporting Results of Internet E-Surveys) guideline. The digital educational platform, We!Masomo, is specifically designed to promote universal and inclusive free access to information. Therefore, the developed high-fidelity prototype was implemented in Kenya. CONCLUSIONS: The primary outcome of this research provides a comprehensive exploration of utilizing a case study methodology to advance the development of digital educational web tools, particularly focusing on cultural sensitivity and sensitive educational subjects. It offers critical insights for effectively introducing such tools in regions with limited resources. Nonetheless, it is crucial to emphasize that the findings underscore the importance of integrating culture-specific components during the design phase. This highlights the necessity of conducting a thorough requirement engineering analysis and developing a low-fidelity prototype, followed by an SUS analysis. These measures are particularly critical when disseminating sensitive information, such as sexual health, through digital platforms. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s12905-023-02839-6.

Managing Directors' Perspectives on Digital Maturity in German Hospitals-A Multi-Point Online-Based Survey Study.

BACKGROUND: The digitalization and integration of data are increasingly relevant for hospitals. Several methods exist to assess and structurally develop digital maturity. However, it is notable that German hospitals lag behind the European average with respect to digitalization. OBJECTIVE: We hypothesized that: (a) the perspective of hospital managing directors regarding the state of digitalization in German hospitals plays an important role in the investigation of barriers, and (b) the Hospital Future Act in 2020 may help to surmount those barriers. METHODS: Aligned with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES), two online surveys were conducted, one in 2019 and one in 2021. RESULTS: The first study covered 184/344 hospitals and the second, 83/344. The responsibility for deciding on the implementation of digitalization lay with the management (115/184; 62.5%). About 54.9% (101/184) of the managing directors desired digitally supported workflows, together with employees or users. In total, 74.7% (62/83) of hospital managing directors expressed an increase in digitization compared to 2019, with a percentage increase of 25.4% (SD 14.41). In some cases, we analyzed the data using an ANOVA, chi-squared test and Pearson's correlation, but there was no significant relation identified among the variables. CONCLUSIONS: This online-based survey study demonstrated that the development of a digitalization strategy is still strongly tied to or dominated by the attitude of the management. One could assume a lack of acceptance among employees, which should be surveyed in future research. The Hospital Future Act, as well as the COVID-19 pandemic, has positively influenced the digital maturity of hospitals.

The Role of Physicians in Digitalizing Health Care Provision: Web-Based Survey Study.

BACKGROUND: Digitalization affects all areas of society, including the health care sector. However, the digitalization of health care provision is progressing slowly compared to other sectors. In the professional and political literature, physicians are partially portrayed as digitalization sceptics. Thus, the role of physicians in this process requires further investigation. The theory of "digital natives" suggests a lower hurdle for younger generations to engage with digital technologies. OBJECTIVE: The objective of this study was to investigate the role of physicians in the process of digitalizing health care provision in Germany and to assess the age factor. METHODS: We conducted a large-scale study to assess the role of this professional group in the progress of the digital transformation of the German health care sector. Therefore, in an anonymous online survey, we inquired about the current digital penetration of the personal working environment, expectations, attitude toward, and concerns regarding digitalization. Based on these data, we studied associations with the nominal variable age and variations across 2 age groups. RESULTS: The 1274 participants included in the study generally showed a high affinity towards digitalization with a mean of 3.88 on a 5-point Likert scale; 723 respondents (56.75%) stated they personally use mobile apps in their everyday working life, with a weak tendency to be associated with the respondents' age (η=0.26). Participants saw the most noticeable existing benefits through digitalization in data quality and readability (882/1274, 69.23%) and the least in patient engagement (213/1274, 16.72%). Medical practitioners preponderantly expect further improvements through increased digitalization across almost all queried areas but the most in access to medical knowledge (1136/1274, 89.17%), treatment of orphan diseases (1016/1274, 79.75%), and medical research (1023/1274, 80.30%). CONCLUSIONS: Respondents defined their role in the digitalization of health care provision as ambivalent: "scrutinizing" on the one hand but "active" and "open" on the other. A gap between willingness to participate and digital sovereignty was indicated. Thus, education on digitalization as a means to support health care provision should not only be included in the course of study but also in the continuing process of further and advanced training.