Concerted adoption as an emerging strategy for digital transformation of healthcare-lessons from Australia, Canada, and England.

OBJECTIVES: With an increasing focus on the digitalization of health and care settings, there is significant scope to learn from international approaches to promote concerted adoption of electronic health records. MATERIALS AND METHODS: We review three large-scale initiatives from Australia, Canada, and England, and extract common lessons for future health and social care transformation strategy. RESULTS: We discuss how, despite differences in contexts, concerted adoption enables sharing of experience and learning to streamline the digital transformation of health and care. DISCUSSION AND CONCLUSION: Concerted adoption can be accelerated through building communities of expertise and partnerships promoting knowledge transfer and circulation of expertise; commonalities in geographical and cultural contexts; and commonalities in technological systems.

Socio-Organizational Dimensions: The Key to Advancing the Shared Care Record Agenda in Health and Social Care.

Integrating health and social care delivery with the help of digital technologies is a grand challenge. We argue that previous attempts have largely failed to achieve their objectives because implementers and decision makers disregard the complex socio-organizational dimensions of change associated with initiatives. These include structural and organizational complexity inhibiting the development of shared care pathways; professional jurisdictions, interests, and expertise; and existing data and governance structures. We provide an overview of those dimensions that can inform strategic decisions going forward, thereby contributing to the chances of success of shared care initiatives.

Benefits realization management in the context of a national digital transformation initiative in English provider organizations.

BACKGROUND: The Global Digital Exemplar (GDE) Programme is a national initiative to promote digitally enabled transformation in English provider organizations. The Programme applied benefits realization management techniques to promote and demonstrate transformative outcomes. This work was part of an independent national evaluation of the GDE Programme. AIMS: We explored how benefits realization management was approached and conceptualized in the GDE Programme. METHODS: We conducted a series of 36 longitudinal case studies of provider organizations participating in the GDE Programme, 12 of which were in depth. Data collection included a combination of 628 interviews (with implementation staff in provider organizations, national programme management staff, and suppliers), 499 documents (of national and local implementation plans and lessons learned), and 190 nonparticipant observations (of national and local programme management meetings to develop insights into the broader context of benefits realization activities, tensions arising, and how these were negotiated). Data were coded drawing on a sociotechnical framework developed in related work and thematically analyzed, initially within and then across cases, with the help of NVivo 11 software. RESULTS: Most stakeholders broadly agreed with the rationale of benefits realization in the GDE Programme to show due diligence that public money was appropriately spent, and to develop an evidence base supporting the value of digitally enabled transformation. Differing national and local reporting purposes, however, created tensions. Central requirements, for progress reporting and tracking high-level benefits, had limited perceived local value and were seen to impose an unnecessary burden on provider organizations. This was accentuated by the lack of harmonization of reporting requirements to different stakeholders (which differed in content and timing). There were tensions between the desire for early evidence of outcomes and the slow processes of infrastructural change (which created problems of attribution of benefits to causes as benefits emerged gradually and over long timeframes), and also between reporting immediately visible local changes and showing how these flowed through to high level organization wide benefits (eg, in terms of health outcomes or cost savings/return on investment). The attempt to fulfill these diverging agendas and informational needs within a single reporting tool had limited success. These difficulties were mitigated by efforts to simplify reporting requirements and to support targeted collection of key national outcome measures. Although progress was hampered by an initial lack of benefits realization expertise in provider organizations, some providers subsequently retained these skills for their own change management purposes. CONCLUSIONS: There is a need to recognize the limitations and cost of benefits realization management practices in the context of healthcare digitalization where benefits may materialize over long timeframes and in unanticipated ways. Although diverse stakeholder information needs may create tensions, prior agreement about rationales for collecting information and a targeted approach to tracking local and high-level benefits may enhance local relevance, reduce perceived reporting burdens, and improve acceptance/effectiveness. A single integrated reporting mechanism is unlikely to fulfill both national and local requirements.

Driving digital health transformation in hospitals: a formative qualitative evaluation of the English Global Digital Exemplar programme.

BACKGROUND: There is currently a strong drive internationally towards creating digitally advanced healthcare systems through coordinated efforts at a national level. The English Global Digital Exemplar (GDE) programme is a large-scale national health information technology change programme aiming to promote digitally-enabled transformation in secondary healthcare provider organisations by supporting relatively digitally mature provider organisations to become international centres of excellence. AIM: To qualitatively evaluate the impact of the GDE programme in promoting digital transformation in provider organisations that took part in the programme. METHODS: We conducted a series of in-depth case studies in 12 purposively selected provider organisations and a further 24 wider case studies of the remaining organisations participating in the GDE programme. Data collected included 628 interviews, non-participant observations of 190 meetings and workshops and analysis of 9 documents. We used thematic analysis aided by NVivo software and drew on sociotechnical theory to analyse the data. RESULTS: We found the GDE programme accelerated digital transformation within participating provider organisations. This acceleration was triggered by: (1) dedicated funding and the associated requirement for matched internal funding, which in turn helped to prioritise digital transformation locally; (2) governance requirements put in place by the programme that helped strengthen existing local governance and project management structures and supported the emergence of a cadre of clinical health informatics leaders locally; and (3) reputational benefits associated with being recognised as a centre of digital excellence, which facilitated organisational buy-in for digital transformation and increased negotiating power with vendors. CONCLUSION: The GDE programme has been successful in accelerating digital transformation in participating provider organisations. Large-scale digital transformation programmes in healthcare can stimulate local progress through protected funding, putting in place governance structures and leveraging reputational benefits for participating provider organisations, around a coherent vision of transformation.

Promoting inter-organisational knowledge sharing: A qualitative evaluation of England's Global Digital Exemplar and Fast Follower Programme.

BACKGROUND: The Global Digital Exemplar (GDE) Programme was designed to promote the digitisation of hospital services in England. Selected provider organisations that were reasonably digitally-mature were funded with the expectation that they would achieve internationally recognised levels of excellence and act as exemplars ('GDE sites') and share their learning with somewhat less digitally-mature Fast Follower (FF) sites. AIMS: This paper explores how partnerships between GDE and FF sites have promoted knowledge sharing and learning between organisations. METHODS: We conducted an independent qualitative longitudinal evaluation of the GDE Programme, collecting data across 36 provider organisations (including acute, mental health and speciality), 12 of which we studied as in-depth ethnographic case studies. We used a combination of semi-structured interviews with programme leads, vendors and national policy leads, non-participant observations of meetings and workshops, and analysed national and local documents. This allowed us to explore both how inter-organisational learning and knowledge sharing was planned, and how it played out in practice. Thematic qualitative analysis, combining findings from diverse data sources, was facilitated by NVivo 11 and drew on sociotechnical systems theory. RESULTS: Formally established GDE and FF partnerships were perceived to enhance learning and accelerate adoption of technologies in most pairings. They were seen to be most successful where they had encouraged, and were supported by, informal knowledge networking, driven by the mutual benefits of information sharing. Informal networking was enhanced where the benefits were maximised (for example where paired sites had implemented the same technological system) and networking costs minimised (for example by geographical proximity, prior links and institutional alignment). Although the intervention anticipated uni-directional learning between exemplar sites and 'followers', in most cases we observed a two-way flow of information, with GDEs also learning from FFs, through informal networking which also extended to other health service providers outside the Programme. The efforts of the GDE Programme to establish a learning ecosystem has enhanced the profile of shared learning within the NHS. CONCLUSIONS: Inter-organisational partnerships have produced significant gains for both follower (FF) and exemplar (GDE) sites. Formal linkages were most effective where they had facilitated, and were supported by, informal networking. Informal networking was driven by the mutual benefits of information sharing and was optimised where sites were well aligned in terms of technology, geography and culture. Misalignments that created barriers to networking between organisations in a few cases were attributed to inappropriate choice of partners. Policy makers seeking to promote learning through centrally directed mechanisms need to create a framework that enables networking and informal knowledge transfer, allowing local organisations to develop bottom-up collaboration and exchanges, where they are productive, in an organic manner.

Interorganizational Knowledge Sharing to Establish Digital Health Learning Ecosystems: Qualitative Evaluation of a National Digital Health Transformation Program in England.

BACKGROUND: The English Global Digital Exemplar (GDE) program is one of the first concerted efforts to create a digital health learning ecosystem across a national health service. OBJECTIVE: This study aims to explore mechanisms that support or inhibit the exchange of interorganizational digital transformation knowledge. METHODS: We conducted a formative qualitative evaluation of the GDE program. We used semistructured interviews with clinical, technical, and managerial staff; national program managers and network leaders; nonparticipant observations of knowledge transfer activities through attending meetings, workshops, and conferences; and documentary analysis of policy documents. The data were thematically analyzed by drawing on a theory-informed sociotechnical coding framework. We used a mixture of deductive and inductive methods, supported by NVivo software, to facilitate coding. RESULTS: We conducted 341 one-on-one and 116 group interviews, observed 86 meetings, and analyzed 245 documents from 36 participating provider organizations. We also conducted 51 high-level interviews with policy makers and vendors; performed 77 observations of national meetings, workshops, and conferences; and analyzed 80 national documents. Formal processes put in place by the GDE program to initiate and reinforce knowledge transfer and learning have accelerated the growth of informal knowledge networking and helped establish the foundations of a learning ecosystem. However, formal networks were most effective when supported by informal networking. The benefits of networking were enhanced (and costs reduced) by geographical proximity, shared culture and context, common technological functionality, regional and strategic alignments, and professional agendas. CONCLUSIONS: Knowledge exchange is most effective when sustained through informal networking driven by the mutual benefits of sharing knowledge and convergence between group members in their organizational and technological setting and goals. Policy interventions need to enhance incentives and reduce barriers to sharing across the ecosystem, be flexible in tailoring formal interventions to emerging needs, and promote informal knowledge sharing.

Using Blueprints to promote interorganizational knowledge transfer in digital health initiatives-a qualitative exploration of a national change program in English hospitals.

OBJECTIVE: The Global Digital Exemplar (GDE) Program is a national attempt to accelerate digital maturity in healthcare providers through promoting knowledge transfer across the English National Health Service (NHS). "Blueprints"-documents capturing implementation experience-were intended to facilitate this knowledge transfer. Here we explore how Blueprints have been conceptualized, produced, and used to promote interorganizational knowledge transfer across the NHS. MATERIALS AND METHODS: We undertook an independent national qualitative evaluation of the GDE Program. This involved collecting data using semistructured interviews with implementation staff and clinical leaders in provider organizations, nonparticipant observation of meetings, and key documents. We also attended a range of national meetings and conferences, interviewed national program managers, and analyzed a range of policy documents. Our analysis drew on sociotechnical principles, combining deductive and inductive methods. RESULTS: Data comprised 508 interviews, 163 observed meetings, and analysis of 325 documents. We found little evidence of Blueprints being adopted in the manner originally conceived by national program managers. However, they proved effective in different ways to those planned. As well as providing a helpful initial guide to a topic, we found that Blueprints served as a method of identifying relevant expertise that paved the way for subsequent discussions and richer knowledge transfers amongst provider organizations. The primary value of Blueprinting, therefore, seemed to be its role as a networking tool. Members of different organizations came together in developing, applying, and sustaining Blueprints through bilateral conversations-in some circumstances also fostering informal communities of practice. CONCLUSIONS: Blueprints may be effective in facilitating knowledge transfer among healthcare organizations, but need to be accompanied by other evolving methods, such as site visits and other networking activities, to iteratively transfer knowledge and experience.

Formative independent evaluation of a digital change programme in the English National Health Service: study protocol for a longitudinal qualitative study.

INTRODUCTION: Many countries are launching large-scale, digitally enabled change programmes as part of efforts to improve the quality, safety and efficiency of care. We have been commissioned to conduct an independent evaluation of a major national change programme, the Global Digital Exemplar (GDE) Programme, which aims to develop exemplary digital health solutions and encourage their wider adoption by creating a learning ecosystem across English National Health Service (NHS) provider organisations. METHODS AND ANALYSIS: This theoretically informed, qualitative, longitudinal formative evaluation comprises five inter-related work packages. We will conduct a combination of 12 in-depth and 24 broader qualitative case studies in GDE sites exploring digital transformation, local learning and mechanisms of spread of knowledge within the Programme and across the wider NHS. Data will be collected through a combination of semistructured interviews with managers, implementation staff (clinical and non-clinical), vendors and policymakers, plus non-participant observations of meetings, site visits, workshops and documentary analysis of strategic local and national plans. Data will be analysed through inductive and deductive methods, beginning with in-depth case study sites and testing the findings against data from the wider sample and national stakeholders. ETHICS AND DISSEMINATION: This work is commissioned as part of a national change programme and is therefore a service evaluation. We have ethical approval from the University of Edinburgh. Results will be disseminated at six monthly intervals to national policymakers, and made available via our publicly accessible website. We will also identify lessons for the management and evaluation of large-scale evolving digital health change programmes that are of international relevance.

Technological Capabilities to Assess Digital Excellence in Hospitals in High Performing Health Care Systems: International eDelphi Exercise.

BACKGROUND: Hospitals worldwide are developing ambitious digital transformation programs as part of broader efforts to create digitally advanced health care systems. However, there is as yet no consensus on how best to characterize and assess digital excellence in hospitals. OBJECTIVE: Our aim was to develop an international agreement on a defined set of technological capabilities to assess digital excellence in hospitals. METHODS: We conducted a two-stage international modified electronic Delphi (eDelphi) consensus-building exercise, which included a qualitative analysis of free-text responses. In total, 31 international health informatics experts participated, representing clinical, academic, public, and vendor organizations. RESULTS: We identified 35 technological capabilities that indicate digital excellence in hospitals. These are divided into two categories: (a) capabilities within a hospital (n=20) and (b) capabilities enabling communication with other parts of the health and social care system, and with patients and carers (n=15). The analysis of free-text responses pointed to the importance of nontechnological aspects of digitally enabled change, including social and organizational factors. Examples included an institutional culture characterized by a willingness to transform established ways of working and openness to risk-taking. The availability of a range of skills within digitization teams, including technological, project management and business expertise, and availability of resources to support hospital staff, were also highlighted. CONCLUSIONS: We have identified a set of criteria for assessing digital excellence in hospitals. Our findings highlight the need to broaden the focus from technical functionalities to wider digital transformation capabilities.

Theoretical and methodological considerations in evaluating large-scale health information technology change programmes.

BACKGROUND: Attempts to achieve digital transformation across the health service have stimulated increasingly large-scale and more complex change programmes. These encompass a growing range of functions in multiple locations across the system and may take place over extended timeframes. This calls for new approaches to evaluate these programmes. MAIN BODY: Drawing on over a decade of conducting formative and summative evaluations of health information technologies, we here build on previous work detailing evaluation challenges and ways to tackle these. Important considerations include changing organisational, economic, political, vendor and markets necessitating tracing of evolving networks, relationships, and processes; exploring mechanisms of spread; and studying selected settings in depth to understand local tensions and priorities. CONCLUSIONS: Decision-makers need to recognise that formative evaluations, if built on solid theoretical and methodological foundations, can help to mitigate risks and help to ensure that programmes have maximum chances of success.

Investigating the use of data-driven artificial intelligence in computerised decision support systems for health and social care: A systematic review.

There is growing interest in the potential of artificial intelligence to support decision-making in health and social care settings. There is, however, currently limited evidence of the effectiveness of these systems. The aim of this study was to investigate the effectiveness of artificial intelligence-based computerised decision support systems in health and social care settings. We conducted a systematic literature review to identify relevant randomised controlled trials conducted between 2013 and 2018. We searched the following databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science, Cochrane Library, ASSIA, Emerald, Health Business Fulltext Elite, ProQuest Public Health, Social Care Online, and grey literature sources. Search terms were conceptualised into three groups: artificial intelligence-related terms, computerised decision support -related terms, and terms relating to health and social care. Terms within groups were combined using the Boolean operator OR, and groups were combined using the Boolean operator AND. Two reviewers independently screened studies against the eligibility criteria and two independent reviewers extracted data on eligible studies onto a customised sheet. We assessed the quality of studies through the Critical Appraisal Skills Programme checklist for randomised controlled trials. We then conducted a narrative synthesis. We identified 68 hits of which five studies satisfied the inclusion criteria. These studies varied substantially in relation to quality, settings, outcomes, and technologies. None of the studies was conducted in social care settings, and three randomised controlled trials showed no difference in patient outcomes. Of these, one investigated the use of Bayesian triage algorithms on forced expiratory volume in 1 second (FEV1) and health-related quality of life in lung transplant patients. Another investigated the effect of image pattern recognition on neonatal development outcomes in pregnant women, and another investigated the effect of the Kalman filter technique for warfarin dosing suggestions on time in therapeutic range. The remaining two randomised controlled trials, investigating computer vision and neural networks on medication adherence and the impact of learning algorithms on assessment time of patients with gestational diabetes, showed statistically significant and clinically important differences to the control groups receiving standard care. However, these studies tended to be of low quality lacking detailed descriptions of methods and only one study used a double-blind design. Although the evidence of effectiveness of data-driven artificial intelligence to support decision-making in health and social care settings is limited, this work provides important insights on how a meaningful evidence base in this emerging field needs to be developed going forward. It is unlikely that any single overall message surrounding effectiveness will emerge - rather effectiveness of interventions is likely to be context-specific and calls for inclusion of a range of study designs to investigate mechanisms of action.

A systematic analysis of the optimization of computerized physician order entry and clinical decision support systems: A qualitative study in English hospitals.

This article analyzes the range of system optimization activities taking place over an extended period following the implementation of computerized physician order entry and clinical decision support systems. We undertook 207 qualitative semi-structured interviews, 24 rounds of non-participant observations of meetings and system use, and collected 17 organizational documents in five hospitals over three time periods between 2011 and 2016. We developed a systematic analysis of system optimization activities with eight sub-categories grouped into three main categories. This delineates the range of system optimization activities including resolving misalignments between technology and clinical practices, enhancing the adopted system, and improving user capabilities to utilize/further optimize systems. This study highlights the optimization efforts by user organizations adopting multi-user, organization-spanning information technologies. Hospitals must continue to attend to change management for an extended period (up to 5 years post-implementation) and develop a strategy for long-term system optimization including sustained user engagement, training, and broader capability development to ensure smoother and quicker realization of benefits.

NHS Scotland's Decision Support Platform: a formative qualitative evaluation.

CONTEXT: The Scottish Government has identified computerised decision support as a strategic priority in order to improve knowledge management in health and social care settings. A national programme to build a pilot Decision Support Platform was funded in 2015. AIMS: We undertook a formative evaluation of the Decision Support Platform to inform plans for its national roll-out in primary care. METHODS: We conducted a series of in-depth semistructured interviews and non-participant observations of workshops demonstrating decision support systems. Participants were policymakers and clinical opinion leaders from primary care. As the Platform was in its early stages of development at the time of data collection, we focused on exploring expectations and drivers of the pilot decision support system tested in primary care. Our methodological approach had to be tailored to changing circumstances and offered important opportunities for realising impact through ongoing formative feedback to policymakers and active engagement of key clinical stakeholders. We drew on sociotechnical principles to inform data analysis and coded qualitative data with the help of NVivo software. FINDINGS: We conducted 30 interviews and non-participant ethnographic observations of eight stakeholder engagement workshops. We observed a strong sense of support from all stakeholders for the Platform and associated plans to roll it out across NHS Scotland. Strategic drivers included the potential to facilitate integration of care, preventive care, patient self-management, shared decision-making and patient engagement through the ready availability of clinically important information. However, in order to realise these benefits, participants highlighted the need for strong national eHealth leadership to drive a coherent strategy and ensure sustained funding, system usability (which stakeholders perceived to be negatively affected by alert fatigue and integration with existing systems) and ongoing monitoring of potential unintended consequences emerging from implementations (eg, increasing clinical workloads). CONCLUSIONS AND IMPLICATIONS: In order to address potential tensions between national leadership and local usability as well as unintended consequences, there is a need to have overall national ownership to support the implementation of the Platform. Potential local tensions could be addressed through allowing a degree of local customisation of systems and tailoring of alerts, and investing in a limited number of pilots that are carefully evaluated to mitigate emerging risks early.

Anglicization of hospital information systems: Managing diversity alongside particularity.

CONTEXT: Despite widespread efforts to improve the quality and safety of healthcare through use of hospital information systems (HIS), many healthcare organizations face challenges in implementation and effective use of these applications, in particular when systems have been developed internationally (mainly in the US). Suppliers of these technologies also find it challenging to produce systems that work effectively across a range of geographical, cultural and institutional boundaries. In this paper, we seek to understand the strategies used by suppliers and adopters of HIS to overcome the challenges involved in the development and adoption of generic overseas systems. METHODS: We conducted a qualitative study, by interviewing 176 individuals (eight organizations), observing two user groups, and running a supplier focus group. We used inductive thematic analysis to assess emerging strategies in developing and implementing overseas packaged HIS in English settings. FINDINGS: The health sector in England has entered a period of potentially transformative change with many international HIS suppliers entering the market. This has provoked call for the 'Anglicization' of generic systems. This endeavor, has resulted in emergence of more or less aligned supplier and user strategies to overcome the difficulties in the process. This includes a continuous process of identification and classification of requests (by suppliers), and unification and voicing of needs (by adopters). CONCLUSIONS: The complexity of health service provision, drives calls for customization of technologies in this sector. Consequent tensions between 'standardization' and 'localization' are requiring suppliers of generic solutions to develop more sophisticated strategies as they pursue international growth of their market.

How Can Social Media Lead to Co-Production (Co-Delivery) of New Services for the Elderly Population? A Qualitative Study.

BACKGROUND: The future of health care services in the European Union faces the triple challenges of aging, fiscal restriction, and inclusion. Co-production offers ways to manage informal care resources to help them cater for the growing needs of elderly people. Social media (SM) is seen as a critical enabler for co-production. OBJECTIVE: The objective of this study was to investigate how SM-private Facebook groups, forums, Twitter, and blogging-acts as an enabler of co-production in health and care by facilitating its four underlying principles: equality, diversity, accessibility, and reciprocity. METHODS: We used normalization process theory as our theoretical framework to design this study. We conducted a qualitative study and collected data through 20 semistructured interviews and observation of the activities of 10 online groups and individuals. We then used thematic analysis and drew on principles of co-production (equality, diversity, accessibility, and reciprocity) as a deductive coding framework to analyze our findings. RESULTS: Our findings point to distinct patterns of feature use by different people involved in care of elderly people. This diversity makes possible the principles of co-production by offering equality among users, enabling diversity of use, making experiences accessible, and encouraging reciprocity in the sharing of knowledge and mutual support. We also identified that explication of common resources may lead to new forms of competition and conflicts. These conflicts require better management to enhance the coordination of the common pool of resources. CONCLUSIONS: SM uses afford new forms of organizing and collective engagement between patients, carers, and professionals, which leads to change in health and care communication and coordination.

Exploring the roots of unintended safety threats associated with the introduction of hospital ePrescribing systems and candidate avoidance and/or mitigation strategies: a qualitative study.

OBJECTIVE: Hospital electronic prescribing (ePrescribing) systems offer a wide range of patient safety benefits. Like other hospital health information technology interventions, however, they may also introduce new areas of risk. Despite recent advances in identifying these risks, the development and use of ePrescribing systems is still leading to numerous unintended consequences, which may undermine improvement and threaten patient safety. These negative consequences need to be analysed in the design, implementation and use of these systems. We therefore aimed to understand the roots of these reported threats and identify candidate avoidance/mitigation strategies. METHODS: We analysed a longitudinal, qualitative study of the implementation and adoption of ePrescribing systems in six English hospitals, each being conceptualised as a case study. Data included semistructured interviews, observations of implementation meetings and system use, and a collection of relevant documents. We analysed data first within and then across the case studies. RESULTS: Our dataset included 214 interviews, 24 observations and 18 documents. We developed a taxonomy of factors underlying unintended safety threats in: (1) suboptimal system design, including lack of support for complex medication administration regimens, lack of effective integration between different systems, and lack of effective automated decision support tools; (2) inappropriate use of systems-in particular, too much reliance on the system and introduction of workarounds; and (3) suboptimal implementation strategies resulting from partial roll-outs/dual systems and lack of appropriate training. We have identified a number of system and organisational strategies that could potentially avoid or reduce these risks. CONCLUSIONS: Imperfections in the design, implementation and use of ePrescribing systems can give rise to unintended consequences, including safety threats. Hospitals and suppliers need to implement short- and long-term strategies in terms of the technology and organisation to minimise the unintended safety risks.

Safety risks associated with the lack of integration and interfacing of hospital health information technologies: a qualitative study of hospital electronic prescribing systems in England.

BACKGROUND: Substantial sums of money are being invested worldwide in health information technology. Realising benefits and mitigating safety risks is however highly dependent on effective integration of information within systems and/or interfacing to allow information exchange across systems. As part of an English programme of research, we explored the social and technical challenges relating to integration and interfacing experienced by early adopter hospitals of standalone and hospital-wide multimodular integrated electronic prescribing (ePrescribing) systems. METHODS: We collected longitudinal qualitative data from six hospitals, which we conceptualised as case studies. We conducted 173 interviews with users, implementers and software suppliers (at up to three different times), 24 observations of system use and strategic meetings, 17 documents relating to implementation plans, and 2 whole-day expert round-table discussions. Data were thematically analysed initially within and then across cases, drawing on perspectives surrounding information infrastructures. RESULTS: We observed that integration and interfacing problems obstructed effective information transfer in both standalone and multimodular systems, resulting in threats to patient safety emerging from the lack of availability of timely information and duplicate data entry. Interfacing problems were immediately evident in some standalone systems where users had to cope with multiple log-ins, and this did not attenuate over time. Multimodular systems appeared at first sight to obviate such problems. However, with these systems, there was a perceived lack of data coherence across modules resulting in challenges in presenting a comprehensive overview of the patient record, this possibly resulting from the piecemeal implementation of modules with different functionalities. Although it was possible to access data from some primary care systems, we found poor two-way transfer of data between hospitals and primary care necessitating workarounds, which in turn led to the opportunity for new errors associated with duplicate and manual information transfer. Extending ePrescribing to include modules with other clinically important information needed to support care was still an aspiration in most sites, although some advanced multimodular systems had begun implementing this functionality. Multimodular systems were, however, seen as being difficult to interface with external systems. CONCLUSIONS: The decision to pursue a strategy of purchasing standalone systems and then interfacing these, or one of buying hospital-wide multimodular systems, is a pivotal one for hospitals in realising the vision of achieving a fully integrated digital record, and this should be predicated on a clear appreciation of the relative trade-offs between these choices. While multimodular systems offered somewhat better usability, standalone systems provided greater flexibility and opportunity for innovation, particularly in relation to interoperability with external systems and in relation to customisability to the needs of different user groups.

Sustained User Engagement in Health Information Technology: The Long Road from Implementation to System Optimization of Computerized Physician Order Entry and Clinical Decision Support Systems for Prescribing in Hospitals in England.

OBJECTIVE: To explore and understand approaches to user engagement through investigating the range of ways in which health care workers and organizations accommodated the introduction of computerized physician order entry (CPOE) and computerized decision support (CDS) for hospital prescribing. STUDY SETTING: Six hospitals in England, United Kingdom. STUDY DESIGN: Qualitative case study. DATA COLLECTION: We undertook qualitative semi-structured interviews, non-participant observations of meetings and system use, and collected organizational documents over three time periods from six hospitals. Thematic analysis was initially undertaken within individual cases, followed by cross-case comparisons. FINDINGS: We conducted 173 interviews, conducted 24 observations, and collected 17 documents between 2011 and 2015. We found that perceived individual and safety benefits among different user groups tended to facilitate engagement in some, while other less engaged groups developed resistance and unsanctioned workarounds if systems were perceived to be inadequate. We identified both the opportunity and need for sustained engagement across user groups around system enhancement (e.g., through customizing software) and the development of user competencies and effective use. CONCLUSIONS: There is an urgent need to move away from an episodic view of engagement focused on the preimplementation phase, to more continuous holistic attempts to engage with and respond to end-users.

Approaches to promoting the appropriate use of antibiotics through hospital electronic prescribing systems: a scoping review.

OBJECTIVE: To identify approaches of using stand-alone and more integrated hospital ePrescribing systems to promote and support the appropriate use of antibiotics, and identify gaps in order to inform future efforts in this area. METHODS: A systematic scoping review of the empirical literature from 1997 until 2015, searching the following databases: MEDLINE, EMBASE, Cochrane Database of Systematic Reviews, Google Scholar, Clinical Trials, International Standard Randomised Controlled Trial Number Registry, Economic Evaluation database and International Prospective Register of Systematic Reviews. Search terms related to different components of systems, hospital settings and antimicrobial stewardship. Two reviewers independently screened papers and mutually agreed papers for inclusion. We undertook an interpretive synthesis. KEY FINDINGS: We identified 143 papers. The majority of these were single-centre observational studies from North American settings with a wide range of system functionalities. Most evidence related to computerised decision support (CDS) and computerised physician order entry (CPOE) functionalities, of which many were extensively customised. We also found some limited work surrounding integration with laboratory results, pharmacy systems and organisational surveillance. Outcomes examined included healthcare professional performance, patient outcomes and health economic evaluations. We found at times conflicting conclusions surrounding effectiveness, which may be due to heterogeneity of populations, technologies and outcomes studied. Reports of unintended consequences were limited. CONCLUSIONS: Interventions are centred on CPOE and CDS, but also include additional functionality aiming to support various facets of the medicines management process. Wider organisational dimensions appear important to supporting adoption. Evaluations should consider processes, clinical, economic and safety outcomes in order to generate generalisable insights into safety, effectiveness and cost-effectiveness.