Early Experiences of Integrating an Artificial Intelligence-Based Diagnostic Decision Support System into Radiology Settings: A Qualitative Study.

BACKGROUND: Artificial Intelligence (AI) based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based e-learning imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest. We performed semi-structured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations and Macro-environmental factors framework (TPOM). We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs. Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure. These under-researched factors require attention and further research.

Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative study.

OBJECTIVES: Artificial intelligence (AI)-based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest. MATERIALS AND METHODS: We performed semistructured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations, and Macroenvironmental factors framework. RESULTS: We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs. DISCUSSION: Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure. CONCLUSION: The socio-organizational factors affecting performance of diagnostic AI are under-researched and require attention and further research.

Running App "Zombies, Run!" Users' Engagement with Physical Activity: A Qualitative Study.

Introduction: Sufficient physical activity (PA) is important for all aspects of health. Smartphone apps and the use of gamification, such as narrative-based augmented reality (AR), have a great potential to engage a variety of people in more PA. Zombies, Run! (ZR) is the world's most popular running exergame app and therefore a suitable model to understand what users find engaging. Objective: To understand people's motivation and experience of using a narrative-based AR exergame app ZR for PA. Materials and Methods: ZR users were randomly selected for interview from a quantitative ZR user's survey. Interviews which were guided by a semistructured topic guide were audio-recorded, transcribed, and analyzed using inductive and deductive thematic analysis. Results: Participants were 15 males and 15 females aged 16-53 years (mean = 36, SD = 10), from 13 countries, with the largest proportions from the United States (30%) and United Kingdom (23%). The majority (73%) used ZR while running, followed by cycling and walking. Four overarching themes that emerged were: "Reasons for starting and staying with ZR," "Preferred features," "Perceived effects of ZR," and "Pros and cons of the app." Sixteen subthemes included the attraction of gamification and narrative appeal, desire to add something fun to PA, or to distract from the negative physiological effects of PA. Users' favorite features were the feelings of immersion and presence through narrative, story line, and characters. The narrative motivated participants to engage in PA for longer sessions and encouraged long-term use. Conclusions: This study identified a number of factors that users found attractive in an AR running exergame, particularly narrative. Our findings suggest that ZR may engage people in exercise by modifying their perception of PA through a story line or narrative, dissociating the players from the effort of exertion. AR narrative-based apps may be an effective way of engaging people with health-related behaviors or habit-forming activities.

A Virtual Reality Exergame to Engage Adolescents in Physical Activity: Mixed Methods Study Describing the Formative Intervention Development Process.

BACKGROUND: Early adolescence (13-17 years) is a critical developmental stage for physical activity promotion. Virtual reality (VR) exergaming is a promising intervention strategy to engage adolescents in physical activity. OBJECTIVE: The vEngage project aims to develop a physical activity intervention for adolescents using VR exergaming. Here, we describe the formative intervention development work and process of academic-industry collaboration. METHODS: The formative development was guided by the Medical Research Council framework and included recruiting an adolescent user group to provide iterative feedback, a literature review, a quantitative survey of adolescents, qualitative interviews with adolescents and parents, inductive thematic analysis of public reviews of VR exergames, a quantitative survey and qualitative interviews with users of the augmented reality running app Zombies, Run!, and building and testing a prototype with our adolescent user group. RESULTS: VR exergaming was appealing to adolescents and acceptable to parents. We identified behavior change techniques that users would engage with and features that should be incorporated into a VR exergame, including realistic body movements, accurate graphics, stepped levels of gameplay difficulty, new challenges, in-game rewards, multiplayer options, and the potential to link with real-world aspects such as physical activity trackers. We also identified some potential barriers to use, such as cost, perceived discomfort of VR headsets, and motion sickness concerns. A prototype game was developed and user-tested with generally positive feedback. CONCLUSIONS: This is the first attempt to develop a VR exergame designed to engage adolescents in physical activity that has been developed within a public health intervention development framework. Our formative work suggests that this is a very promising avenue. The benefit of the design process was the collaborative parallel work between academics and game designers and the involvement of the target population in the game (intervention) design from the outset. Developing the game within an intervention framework allowed us to consider factors, such as parental support, that would be important for future implementation. This study also serves as a call to action for potential collaborators who may wish to join this endeavor for future phases and an example of how academic-industry collaboration can be successful and beneficial.

Parents of Adolescents Perspectives of Physical Activity, Gaming and Virtual Reality: Qualitative Study.

BACKGROUND: Virtual reality (VR) exergaming may be a promising avenue to engage adolescents with physical activity. Since parental support is a consistent determinant of physical activity in adolescents, it is crucial to gather the views of parents of adolescents about this type of intervention. OBJECTIVE: This study aimed to interview parents of younger adolescents (13-17 years old) about physical activity, gaming, and VR as part of the larger vEngage study. METHODS: Semistructured interviews were conducted with 18 parents of adolescents. Data were synthesized using framework analysis. RESULTS: Parents believed that encouraging physical activity in adolescents was important, particularly for mental health. Most parents felt that their children were not active enough. Parents reported their adolescents regularly gamed, with mostly negative perceptions of gaming due to violent content and becoming addicted. Parents discussed an inability to relate to gaming due to "generational differences," but an exception was exergaming, which they had played with their children in the past (eg, Wii Fit). Specific recommendations for promoting a VR exergaming intervention were provided, but ultimately parents strongly supported harnessing gaming for any positive purpose. CONCLUSIONS: The current study suggests promise for a VR exergaming intervention, but this must be framed in a way that addresses parental concerns, particularly around addiction, violence, and safety, without actively involving their participation. While parents would rather their children performed "real-world" physical activity, they believed the key to engagement was through technology. Overall, there was the perception that harnessing gaming and sedentary screen time for a positive purpose would be strongly supported.

What Players of Virtual Reality Exercise Games Want: Thematic Analysis of Web-Based Reviews.

BACKGROUND: Physical activity (PA) is associated with a variety of physical and psychosocial health benefits, but levels of moderate-to-vigorous intensity PA remain low worldwide. Virtual reality (VR) gaming systems involving movement (VR exergames) could be used to engage people in more PA. OBJECTIVE: This study aimed to synthesize public reviews of popular VR exergames to identify common features that players liked or disliked to inform future VR exergame design. METHODS: We conducted a thematic analysis of 498 reviews of the 29 most popular exergames sold in the top 3 VR marketplaces: Steam (Valve Corporation), Viveport (Valve Corporation), and Oculus (Oculus VR). We categorized reviews as positive and negative as they appeared in the marketplaces and identified the most common themes using an inductive thematic analysis. RESULTS: The reviews were often mixed, reporting a wide variety of expectations, preferences, and gaming experiences. Players preferred highly realistic games (eg, closely simulated real-world sport), games that were intuitive (in terms of body movement and controls), and games that provided gradual increases in skill acquisition. Players reported feeling that they reached a high level of exertion when playing and that the immersion distracted them from the intensity of the exercise. Some preferred features included music and social aspects of the games, with multiplayer options to include friends or receive help from experienced players. There were 3 main themes in negative reviews. The first concerned bugs that rendered games frustrating. Second, the quality of graphics had a particularly strong impact on perceived enjoyment. Finally, reviewers disliked when games had overly complex controls and display functions that evoked motion sickness. CONCLUSIONS: Exergames prove to be a stimulating avenue for players to engage in PA and distract themselves from the negative perceptions of performing exercise. The common negative aspects of VR exergames should be addressed for increased uptake and continued engagement.

Title Correction: Younger Adolescents' Perceptions of Physical Activity, Exergaming, and Virtual Reality: Qualitative Intervention Development Study.

[This corrects the article DOI: 10.2196/11960.].

Younger Adolescents' Perceptions of Physical Activity, Exergaming, and Virtual Reality: Qualitative Intervention Development Study.

BACKGROUND: Novel strategies to promote physical activity (PA) in adolescence are required. The vEngage study aims to test whether a virtual reality (VR) exergaming intervention can engage younger adolescents (aged 13 to 15 years) with PA. OBJECTIVE: This study aimed to gather adolescents' views of using VR to encourage PA and identify the key features they would like to see in a VR exergaming intervention via interviews. METHODS: Participants were recruited through 2 schools in London, United Kingdom. Semistructured interviews were conducted with adolescents about their views on PA and what might work to increase PA, technology, knowledge and experience of VR, and desired features in a VR exergaming intervention. Data were analyzed using Framework Analysis. RESULTS: A total of 31 participants aged between 13 and 15 years (58% female, 62% from nonwhite ethnicities) participated in this interview study. The vast majority had no awareness of government PA recommendations but felt they should be more thoroughly informed. All participants were positive about the use of VR in PA promotion. Rewards, increasing challenges, and a social or multiplayer aspect were identified by participants as crucial aspects to include in a VR exercise game. Barriers were related to cost of high-end systems. Being able to exercise at home was very appealing. VR exergaming was viewed as a way to overcome multiple perceived social and cultural barriers to PA, particularly for girls. CONCLUSIONS: Key elements that should be incorporated into a VR game for health intervention were identified and described. These also included the use of rewards, novelty and enjoyment in immersive game play, multiplayer options, and real-world elements, as well as continual updates and new challenge levels. The use of VR to promote PA in adolescents is promising, but some barriers were raised.

Motivations for contributing to health-related articles on Wikipedia: an interview study.

BACKGROUND: Wikipedia is one of the most accessed sources of health information online. The current English-language Wikipedia contains more than 28,000 articles pertaining to health. OBJECTIVE: The aim was to characterize individuals' motivations for contributing to health content on the English-language Wikipedia. METHODS: A set of health-related articles were randomly selected and recent contributors invited to complete an online questionnaire and follow-up interview (by Skype, by email, or face-to-face). Interviews were transcribed and analyzed using thematic analysis and a realist grounded theory approach. RESULTS: A total of 32 Wikipedians (31 men) completed the questionnaire and 17 were interviewed. Those completing the questionnaire had a mean age of 39 (range 12-59) years; 16 had a postgraduate qualification, 10 had or were currently studying for an undergraduate qualification, 3 had no more than secondary education, and 3 were still in secondary education. In all, 15 were currently working in a health-related field (primarily clinicians). The median period for which they have been an active editing Wikipedia was 3-5 years. Of this group, 12 were in the United States, 6 were in the United Kingdom, 4 were in Canada, and the remainder from another 8 countries. Two-thirds spoke more than 1 language and 90% (29/32) were also active contributors in domains other than health. Wikipedians in this study were identified as health professionals, professionals with specific health interests, students, and individuals with health problems. Based on the interviews, their motivations for editing health-related content were summarized in 5 strongly interrelated categories: education (learning about subjects by editing articles), help (wanting to improve and maintain Wikipedia), responsibility (responsibility, often a professional responsibility, to provide good quality health information to readers), fulfillment (editing Wikipedia as a fun, relaxing, engaging, and rewarding activity), and positive attitude to Wikipedia (belief in the value of Wikipedia). An additional factor, hostility (from other contributors), was identified that negatively affected Wikipedians' motivations. CONCLUSIONS: Contributions to Wikipedia's health-related content in this study were made by both health specialists and laypeople of varying editorial skills. Their motivations for contributing stem from an inherent drive based on values, standards, and beliefs. It became apparent that the community who most actively monitor and edit health-related articles is very small. Although some contributors correspond to a model of "knowledge philanthropists," others were focused on maintaining articles (improving spelling and grammar, organization, and handling vandalism). There is a need for more people to be involved in Wikipedia's health-related content.