External validation of a prediction model for timely implementation of innovations in radiotherapy.

BACKGROUND AND PURPOSE: The aim of this study was to externally validate a model that predicts timely innovation implementation, which can support radiotherapy professionals to be more successful in innovation implementation. MATERIALS AND METHODS: A multivariate prediction model was built based on the TRIPOD (Transparent Reporting of a multivariate prediction model for Individual Prognosis Or Diagnosis) criteria for a type 4 study (1). The previously built internally validated model had an AUC of 0.82, and was now validated using a completely new multicentre dataset. Innovation projects that took place between 2017-2019 were included in this study. Semi-structured interviews were performed to retrieve the prognostic variables of the previously built model. Projects were categorized according to the size of the project; the success of the project and thepresence of pre-defined success factors were analysed. RESULTS: Of the 80 included innovation projects (32.5% technological, 35% organisational and 32.5% treatment innovations), 55% were successfully implemented within the planned timeframe. Comparing the outcome predictions with the observed outcomes of all innovations resulted in an AUC of the external validation of the prediction model of 0.72 (0.60-0.84, 95% CI). Factors related to successful implementation included in the model are sufficient and competent employees, desirability and feasibility, clear goals and processes and the complexity of a project. CONCLUSION: For the first time, a prediction model focusing on the timely implementation of innovations has been successfully built and externally validated. This model can now be widely used to enable more successful innovation in radiotherapy.

Analyzing the determinants to accept a virtual assistant and use cases among cancer patients: a mixed methods study.

BACKGROUND: Technological progress in artificial intelligence has led to the increasing popularity of virtual assistants, i.e., embodied or disembodied conversational agents that allow chatting with a technical system in a natural language. However, only little comprehensive research is conducted about patients' perceptions and possible applications of virtual assistant in healthcare with cancer patients. This research aims to investigate the key acceptance factors and value-adding use cases of a virtual assistant for patients diagnosed with cancer. METHODS: Qualitative interviews with eight former patients and four doctors of a Dutch radiotherapy institute were conducted to determine what acceptance factors they find most important for a virtual assistant and gain insights into value-adding applications. The unified theory of acceptance and use of technology (UTAUT) was used to structure perceptions and was inductively modified as a result of the interviews. The subsequent research model was triangulated via an online survey with 127 respondents diagnosed with cancer. A structural equation model was used to determine the relevance of acceptance factors. Through a multigroup analysis, differences between sample subgroups were compared. RESULTS: The interviews found support for all factors of the UTAUT: performance expectancy, effort expectancy, social influence and facilitating conditions. Additionally, self-efficacy, trust, and resistance to change, were added as an extension of the UTAUT. Former patients found a virtual assistant helpful in receiving information about logistic questions, treatment procedures, side effects, or scheduling appointments. The quantitative study found that the constructs performance expectancy (ß = 0.399), effort expectancy (ß = 0.258), social influence (ß = 0.114), and trust (ß = 0.210) significantly influenced behavioral intention to use a virtual assistant, explaining 80% of its variance. Self-efficacy (ß = 0.792) acts as antecedent of effort expectancy. Facilitating conditions and resistance to change were not found to have a significant relationship with user intention. CONCLUSIONS: Performance and effort expectancy are the leading determinants of virtual assistant acceptance. The latter is dependent on a patient's self-efficacy. Therefore, including patients during the development and introduction of a VA in cancer treatment is important. The high relevance of trust indicates the need for a reliable, secure service that should be promoted as such. Social influence suggests using doctors in endorsing the VA.

[Implementation of innovations in healthcare: radiotherapy as an example]. / Implementatie van innovaties in de zorg.

The implementation of innovations is considered necessary in healthcare, both for improving patient outcomes and services and to reduce costs. Two problems can occur during the implementation process: innovations that have not been properly evaluated in terms of patient outcomes or cost-effectiveness can sometimes spread quickly, whereas innovations that have shown to lead to significant improvements in a research study setting may struggle to find their way into clinical practice. Problems may also arise when organizational innovations are implemented that are not evidence-based: an example would be the implementation of a new ICT system that affects the patient's environment negatively upon introduction. In this article, the problems surrounding innovation implementation in medical care are described in general and in more concrete terms, we describe how Dutch radiotherapy centres perform in this area. Based on the findings, a systematic plan is described that can help to innovate more effectively and efficiently to the benefit of clinical practice in all disciplines.