Early Experiences of Integrating an Artificial Intelligence-Based Diagnostic Decision Support System into Radiology Settings: A Qualitative Study.

BACKGROUND: Artificial Intelligence (AI) based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based e-learning imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest. We performed semi-structured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations and Macro-environmental factors framework (TPOM). We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs. Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure. These under-researched factors require attention and further research.

Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative study.

OBJECTIVES: Artificial intelligence (AI)-based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest. MATERIALS AND METHODS: We performed semistructured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations, and Macroenvironmental factors framework. RESULTS: We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs. DISCUSSION: Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure. CONCLUSION: The socio-organizational factors affecting performance of diagnostic AI are under-researched and require attention and further research.

Care organising technologies and the post-phenomenology of care: An ethnographic case study.

Care organising technologies are software applications that are intended primarily for informal carers, to help organise, document and coordinate caring work. These may be purchased privately or provided as part of state support. Take-up to date remains low. Based on empirical case studies of three such technologies and drawing on post-phenomenology and political science, we examined people's experience of caring when caring technologies find a way into their lives. Our findings show how care organising technologies have evolved in a political context that assumes informal support will supplement and sometimes substitute for state support. Technologies were largely designed to foreground the technical and organisational aspects of care such as planning meals, coordinating medication, and allocating and monitoring tasks among carers. For carers, the result was often a flattening of the landscape of care such that the socio-emotional work of caring was rendered invisible and relations between cared-for and caregiver were configured in narrow transactional terms. For a small number of carers, the focus on tasks was out of tune with their (often emotionally charged) experiences of care and led to active rejection of the technology. However, we also found examples of caregivers and the individuals they cared for using technologies adaptively to facilitate and embed existing care relationships. In these examples, the material/technical, socio-emotional and bodily aspects of caring were interwoven with the situated context of close, unique and evolving relationships. We conclude that the design and development of caring technologies would benefit by being informed by a broader orientation of caring as a relational practice.

Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework.

BACKGROUND: Failures and partial successes are common in technology-supported innovation programmes in health and social care. Complexity theory can help explain why. Phenomena may be simple (straightforward, predictable, few components), complicated (multiple interacting components or issues) or complex (dynamic, unpredictable, not easily disaggregated into constituent components). The recently published NASSS framework applies this taxonomy to explain Non-adoption or Abandonment of technology by individuals and difficulties achieving Scale-up, Spread and Sustainability. This paper reports the first empirical application of the NASSS framework. METHODS: Six technology-supported programmes were studied using ethnography and action research for up to 3 years across 20 health and care organisations and 10 national-level bodies. They comprised video outpatient consultations, GPS tracking technology for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organising software and integrated case management via data warehousing. Data were collected at three levels: micro (individual technology users), meso (organisational processes and systems) and macro (national policy and wider context). Data analysis and synthesis were guided by socio-technical theories and organised around the seven NASSS domains: (1) the condition or illness, (2) the technology, (3) the value proposition, (4) the adopter system (professional staff, patients and lay carers), (5) the organisation(s), (6) the wider (institutional and societal) system and (7) interaction and mutual adaptation among all these domains over time. RESULTS: The study generated more than 400 h of ethnographic observation, 165 semi-structured interviews and 200 documents. The six case studies raised multiple challenges across all seven domains. Complexity was a common feature of all programmes. In particular, individuals' health and care needs were often complex and hence unpredictable and 'off algorithm'. Programmes in which multiple domains were complicated proved difficult, slow and expensive to implement. Those in which multiple domains were complex did not become mainstreamed (or, if mainstreamed, did not deliver key intended outputs). CONCLUSION: The NASSS framework helped explain the successes, failures and changing fortunes of this diverse sample of technology-supported programmes. Since failure is often linked to complexity across multiple NASSS domains, further research should systematically address ways to reduce complexity and/or manage programme implementation to take account of it.

SCALS: a fourth-generation study of assisted living technologies in their organisational, social, political and policy context.

INTRODUCTION: Research to date into assisted living technologies broadly consists of 3 generations: technical design, experimental trials and qualitative studies of the patient experience. We describe a fourth-generation paradigm: studies of assisted living technologies in their organisational, social, political and policy context. Fourth-generation studies are necessarily organic and emergent; they view technology as part of a dynamic, networked and potentially unstable system. They use co-design methods to generate and stabilise local solutions, taking account of context. METHODS AND ANALYSIS: SCALS (Studies in Co-creating Assisted Living Solutions) consists (currently) of 5 organisational case studies, each an English health or social care organisation striving to introduce technology-supported services to support independent living in people with health and/or social care needs. Treating these cases as complex systems, we seek to explore interdependencies, emergence and conflict. We employ a co-design approach informed by the principles of action research to help participating organisations establish, refine and evaluate their service. To that end, we are conducting in-depth ethnographic studies of people's experience of assisted living technologies (micro level), embedded in evolving organisational case studies that use interviews, ethnography and document analysis (meso level), and exploring the wider national and international context for assisted living technologies and policy (macro level). Data will be analysed using a sociotechnical framework developed from structuration theory. ETHICS AND DISSEMINATION: Research ethics approval for the first 4 case studies has been granted. An important outcome will be lessons learned from individual co-design case studies. We will document the studies' credibility and rigour, and assess the transferability of findings to other settings while also recognising unique aspects of the contexts in which they were generated. Academic outputs will include a cross-case analysis and progress in theory and method of fourth-generation assisted living technology research. We will produce practical guidance for organisations, policymakers, designers and service users.

Co-production in practice: how people with assisted living needs can help design and evolve technologies and services.

BACKGROUND: The low uptake of telecare and telehealth services by older people may be explained by the limited involvement of users in the design. If the ambition of 'care closer to home' is to be realised, then industry, health and social care providers must evolve ways to work with older people to co-produce useful and useable solutions. METHOD: We conducted 10 co-design workshops with users of telehealth and telecare, their carers, service providers and technology suppliers. Using vignettes developed from in-depth ethnographic case studies, we explored participants' perspectives on the design features of technologies and services to enable and facilitate the co-production of new care solutions. Workshop discussions were audio recorded, transcribed and analysed thematically. RESULTS: Analysis revealed four main themes. First, there is a need to raise awareness and provide information to potential users of assisted living technologies (ALTs). Second, technologies must be highly customisable and adaptable to accommodate the multiple and changing needs of different users. Third, the service must align closely with the individual's wider social support network. Finally, the service must support a high degree of information sharing and coordination. CONCLUSIONS: The case vignettes within inclusive and democratic co-design workshops provided a powerful means for ALT users and their carers to contribute, along with other stakeholders, to technology and service design. The workshops identified a need to focus attention on supporting the social processes that facilitate the collective efforts of formal and informal care networks in ALT delivery and use.

What is quality in assisted living technology? The ARCHIE framework for effective telehealth and telecare services.

BACKGROUND: We sought to define quality in telehealth and telecare with the aim of improving the proportion of patients who receive appropriate, acceptable and workable technologies and services to support them living with illness or disability. METHODS: This was a three-phase study: (1) interviews with seven technology suppliers and 14 service providers, (2) ethnographic case studies of 40 people, 60 to 98 years old, with multi-morbidity and assisted living needs and (3) 10 co-design workshops. In phase 1, we explored barriers to uptake of telehealth and telecare. In phase 2, we used ethnographic methods to build a detailed picture of participants' lives, illness experiences and technology use. In phase 3, we brought users and their carers together with suppliers and providers to derive quality principles for assistive technology products and services. RESULTS: Interviews identified practical, material and organisational barriers to smooth introduction and continued support of assistive technologies. The experience of multi-morbidity was characterised by multiple, mutually reinforcing and inexorably worsening impairments, producing diverse and unique care challenges. Participants and their carers managed these pragmatically, obtaining technologies and adapting the home. Installed technologies were rarely fit for purpose. Support services for technologies made high (and sometimes oppressive) demands on users. Six principles emerged from the workshops. Quality telehealth or telecare is 1) ANCHORED in a shared understanding of what matters to the user; 2) REALISTIC about the natural history of illness; 3) CO-CREATIVE, evolving and adapting solutions with users; 4) HUMAN, supported through interpersonal relationships and social networks; 5) INTEGRATED, through attention to mutual awareness and knowledge sharing; 6) EVALUATED to drive system learning. CONCLUSIONS: Technological advances are important, but must be underpinned by industry and service providers following a user-centred approach to design and delivery. For the ARCHIE principles to be realised, the sector requires: (1) a shift in focus from product ('assistive technologies') to performance ('supporting technologies-in-use'); (2) a shift in the commissioning model from standardised to personalised home care contracts; and (3) a shift in the design model from 'walled garden', branded products to inter-operable components that can be combined and used flexibly across devices and platforms. Please see related article: http://dx.doi.org/10.1186/s12916-015-0305-8.

Technology as system innovation: a key informant interview study of the application of the diffusion of innovation model to telecare.

PURPOSE: To identify and explore factors that influence adoption, implementation and continued use of telecare technologies. METHOD: As part of the Assistive Technologies for Healthy Living in Elders: Needs Assessment by Ethnography (ATHENE) project, 16 semi-structured interviews were conducted with key participants from organisations involved in developing and providing telecare technologies and services. Data were analysed thematically, using a conceptual model of diffusion of innovations. RESULTS: Participants identified numerous interacting factors that facilitated or hindered adoption and use. As predicted by the model, these related variously to the technology, individual adopters, the process of social influence, the innovativeness and readiness of organisations, implementation and routinisation processes following initial adoption, and the nature and strength of linkages between these elements. Key issues included (i) the complexity and uniqueness of the "user system", (ii) the ongoing work needed to support telecare use beyond initial adoption, and (iii) the relatively weak links that typically exist between users of telecare technologies and the organisations who design and distribute them. CONCLUSIONS: Telecare is not merely a technology but a complex innovation requiring input from, and coordination between, people and organisations. To promote adoption and use, these contextual factors must be specified, understood and addressed.

The Day-to-Day Co-Production of Ageing in Place.

We report findings from a study that set out to explore the experience of older people living with assisted living technologies and care services. We find that successful 'ageing in place' is socially and collaboratively accomplished - 'co-produced' - day-to-day by the efforts of older people, and their formal and informal networks of carers (e.g. family, friends, neighbours). First, we reveal how 'bricolage' allows care recipients and family members to customise assisted living technologies to individual needs. We argue that making customisation easier through better design must be part of making assisted living technologies 'work'. Second, we draw attention to the importance of formal and informal carers establishing and maintaining mutual awareness of the older person's circumstances day-to-day so they can act in a concerted and coordinated way when problems arise. Unfortunately, neither the design of most current assisted living technologies, nor the ways care services are typically configured, acknowledges these realities of ageing in place. We conclude that rather than more 'advanced' technologies, the success of ageing in place programmes will depend on effortful alignments in the technical, organisational and social configuration of support.

What matters to older people with assisted living needs? A phenomenological analysis of the use and non-use of telehealth and telecare.

Telehealth and telecare research has been dominated by efficacy trials. The field lacks a sophisticated theorisation of [a] what matters to older people with assisted living needs; [b] how illness affects people's capacity to use technologies; and [c] the materiality of assistive technologies. We sought to develop a phenomenologically and socio-materially informed theoretical model of assistive technology use. Forty people aged 60-98 (recruited via NHS, social care and third sector) were visited at home several times in 2011-13. Using ethnographic methods, we built a detailed picture of participants' lives, illness experiences and use (or non-use) of technologies. Data were analysed phenomenologically, drawing on the work of Heidegger, and contextualised using a structuration approach with reference to Bourdieu's notions of habitus and field. We found that participants' needs were diverse and unique. Each had multiple, mutually reinforcing impairments (e.g. tremor and visual loss and stiff hands) that were steadily worsening, culturally framed and bound up with the prospect of decline and death. They managed these conditions subjectively and experientially, appropriating or adapting technologies so as to enhance their capacity to sense and act on their world. Installed assistive technologies met few participants' needs; some devices had been abandoned and a few deliberately disabled. Successful technology arrangements were often characterised by 'bricolage' (pragmatic customisation, combining new with legacy devices) by the participant or someone who knew and cared about them. With few exceptions, the current generation of so-called 'assisted living technologies' does not assist people to live with illness. To overcome this irony, technology providers need to move beyond the goal of representing technology users informationally (e.g. as biometric data) to providing flexible components from which individuals and their carers can 'think with things' to improve the situated, lived experience of multi-morbidity. A radical revision of assistive technology design policy may be needed.

GP perspectives of irritable bowel syndrome--an accepted illness, but management deviates from guidelines: a qualitative study.

BACKGROUND: The estimated prevalence of irritable bowel syndrome (IBS) is 10%. Up to one third of patients develop chronic symptoms, which impact on everyday functioning and psychological wellbeing. Guidelines suggest an increased role for primary care in the management of patients with IBS, and referral for psychological interventions. Literature reports dissatisfaction and frustration experienced by both patients with IBS and healthcare professionals. The aim of this study was to explore the perspectives of general practitioners (GPs) in relation to the diagnosis and management of IBS and their views on the potential use of a risk assessment tool to aid management decisions for patients with IBS in primary care. METHODS: This was a qualitative study using face-to-face semi-structured interviews with GPs in North West England. Interviews were fully transcribed and data analyzed using constant comparison across interviews. Tensions between GP accounts and the NICE guideline for the management of IBS were highlighted. RESULTS: GPs described IBS as a diagnosis of exclusion and the process as tentative and iterative, with delay in adding a Read code to the patient record until they were confident of the diagnosis. Whilst GPs accepted there was a link between IBS and psychological symptoms they suggested that the majority of patients could be managed within primary care without referral for psychological interventions, in conflict with the NICE guideline. They did not feel that a risk assessment tool for patients with IBS would be helpful. CONCLUSIONS: This study highlights the tensions between evidence recognizing the need to identify patients whose symptoms may become chronic and offer pro-active care, including referral for psychological therapies, and the perspectives of GPs managing patients in every-day clinical practice. The reluctance of GPs to refer patients for evidence-based psychological treatments may have implications for commissioning services and patient care.

Designing assisted living technologies 'in the wild': preliminary experiences with cultural probe methodology.

BACKGROUND: There is growing interest in assisted living technologies to support independence at home. Such technologies should ideally be designed 'in the wild' i.e. taking account of how real people live in real homes and communities. The ATHENE (Assistive Technologies for Healthy Living in Elders: Needs Assessment by Ethnography) project seeks to illuminate the living needs of older people and facilitate the co-production with older people of technologies and services. This paper describes the development of a cultural probe tool produced as part of the ATHENE project and how it was used to support home visit interviews with elders with a range of ethnic and social backgrounds, family circumstances, health conditions and assisted living needs. METHOD: Thirty one people aged 60 to 98 were visited in their homes on three occasions. Following an initial interview, participants were given a set of cultural probe materials, including a digital camera and the 'Home and Life Scrapbook' to complete in their own time for one week. Activities within the Home and Life Scrapbook included maps (indicating their relationships to people, places and objects), lists (e.g. likes, dislikes, things they were concerned about, things they were comfortable with), wishes (things they wanted to change or improve), body outline (indicating symptoms or impairments), home plan (room layouts of their homes to indicate spaces and objects used) and a diary. After one week, the researcher and participant reviewed any digital photos taken and the content of the Home and Life Scrapbook as part of the home visit interview. FINDINGS: The cultural probe facilitated collection of visual, narrative and material data by older people, and appeared to generate high levels of engagement from some participants. However, others used the probe minimally or not at all for various reasons including limited literacy, physical problems (e.g. holding a pen), lack of time or energy, limited emotional or psychological resources, life events, and acute illness. Discussions between researchers and participants about the materials collected (and sometimes about what had prevented them completing the tasks) helped elicit further information relevant to assisted living technology design. The probe materials were particularly helpful when having conversations with non-English speaking participants through an interpreter. CONCLUSIONS: Cultural probe methods can help build a rich picture of the lives and experiences of older people to facilitate the co-production of assisted living technologies. But their application may be constrained by the participant's physical, mental and emotional capacity. They are most effective when used as a tool to facilitate communication and development of a deeper understanding of older people's needs.