Designing for Improved Patient Experiences in Home Dialysis: Usability and User Experience Findings From User-Based Evaluation Study With Patients With Chronic Conditions.

BACKGROUND: Chronic kidney disease affects 10% of the population worldwide, and the number of patients receiving treatment for end-stage kidney disease is forecasted to increase. Therefore, there is a pressing need for innovative digital solutions that increase the efficiency of care and improve patients' quality of life. The aim of the eHealth in Home Dialysis project is to create a novel eHealth solution, called eC4Me, to facilitate predialysis and home dialysis care for patients with chronic kidney disease. OBJECTIVE: Our study aimed to evaluate the usability, user experience (UX), and patient experience (PX) of the first version of the eC4Me solution. METHODS: We used a user-based evaluation approach involving usability testing, questionnaire, and interview methods. The test sessions were conducted remotely with 10 patients with chronic kidney disease, 5 of whom had used the solution in their home environment before the tests, while the rest were using it for the first time. Thematic analysis was used to analyze user test and questionnaire data, and descriptive statistics were calculated for the UMUX (Usability Metric for User Experience) scores. RESULTS: Most usability problems were related to navigation, the use of terminology, and the presentation of health-related data. Despite usability challenges, UMUX ratings of the solution were positive overall. The results showed noteworthy variation in the expected benefits and perceived effort of using the solution. From a PX perspective, it is important that the solution supports patients' own health-related goals and fits with the needs of their everyday lives with the disease. CONCLUSIONS: A user-based evaluation is a useful and necessary part of the eHealth solution development process. Our study findings can be used to improve the usability and UX of the evaluated eC4Me solution. Patients should be actively involved in the solution development process when specifying what information is relevant for them. Traditional usability tests complemented with questionnaire and interview methods can serve as a meaningful methodological approach for gaining insight not only into usability but also into UX- and PX-related aspects of digital health solutions.

Developing eHealth for Home Dialysis: Clinicians' Needs for a Digital Patient Engagement Platform.

eHealth solutions such as digital patient engagement platforms (DPEPs) aim at enhancing communication and collaboration between patients and clinicians. From the clinicians' viewpoint, concerns exist about new information systems (IS) leading to increased workload and interoperability problems. This article aims to support the development and implementation of DPEPs from the end-users' perspective. We studied clinicians' needs for a new DPEP developed to support home dialysis (HD) care. Eight clinicians participated in remote semi-structured interviews. Clinicians had positive expectations for the new DPEP as it could provide an overall picture of patients' status, support patients' self-care, and save time during patient visits. However, they had concerns about successful implementation, changes to workflows, and integration issues. To conclude, it is important to design and agree on changes in work practices, patient care, and complex IS environments when implementing new DPEP solutions in clinics.

Associations of perceived changes in work due to digitalization and the amount of digital work with job strain among physicians: a national representative sample.

BACKGROUND: Physicians' work is often stressful. The digitalization of healthcare aims to streamline work, but not all physicians have experienced its realization. We examined associations of perceived changes in work due to digitalization and the amount of digital work with job strain among physicians. The moderating role of the length of work experience was investigated for these associations. METHODS: We used representative survey data on Finnish physicians' (N = 4271) experiences of digitalization from 2021. The independent variables included perceptions on statements about work transformations aligned with digitalization goals, and the extent that information systems and teleconsultations were utilized. Stress related to information systems (SRIS), time pressure, and psychological stress were the dependent variables. We analyzed the associations using multivariable linear and logistic regressions. RESULTS: Respondents had a mean SRIS score of 3.5 and a mean time pressure score of 3.7 on a scale of 1-5. Psychological stress was experienced by 60%. Perceptions associated with higher SRIS comprised disagreements with statements asserting that digitalization accelerates clinical encounters (b = .23 [95% CI: .16-.30]), facilitates access to patient information (b = .15 [.07-.23]), and supports decision-making (b = .11 [.05-.18]). Disagreement with accelerated clinical encounters (b = .12 [.04-.20]), and agreements with patients' more active role in care (b = .11 [.04-.19]) and interprofessional collaboration (b = .10 [.02-.18]) were opinions associated with greater time pressure. Disagreeing with supported decision-making (OR = 1.26 [1.06-1.48]) and agreeing with patients' active role (OR = 1.19 [1.02-1.40]) were associated with greater psychological stress. However, perceiving improvements in the pace of clinical encounters and access to patient information appeared to alleviate job strain. Additionally, extensive digital work was consistently linked to higher strain. Those respondents who held teleconsultations frequently and had less than 6 years of work experience reported the greatest levels of time pressure. CONCLUSIONS: Physicians seem to be strained by frequent teleconsultations and work that does not meet the goals of digitalization. Improving physicians' satisfaction with digitalization through training specific to the stage of career and system development can be crucial for their well-being. Schedules for digital tasks should be planned and allocated to prevent strain related to achieving the digitalization goals.

Physicians' Perspectives on EHR Usability: Results from Four Large Cross-Sectional Surveys from 2010 to 2021.

Usability and user experience are central quality attributes of electronic health record (EHR) systems. Usability evaluation studies typically focus on short-term use and situational usability, although feedback collected during operational use provides input for future information systems development. An abundance of studies report on physicians' dissatisfaction with the usability of their EHR systems and many show an association between poor usability and physician burnout. However, there is a scarcity of large long-term monitoring studies assessing end users' experiences with EHRs. We report on the results from four large (n=3,929-4,628) national cross-sectional usability surveys conducted among Finnish physicians in 2010, 2014, 2017, and 2021. The main finding was that the perceptions of physicians working in public health centres had changed for the better but those working in public hospitals reported similar or even more negative experiences in 2021 than in 2010-17; they rated only system responsiveness to inputs as having improved. Based on this finding, systematic research-based monitoring of EHR development from the end users' perspectives should be continued.

Patient Experience from an eHealth Perspective: A Scoping Review of Approaches and Recent Trends.

OBJECTIVES: Patients' experiences are increasingly gaining interest in multiple research fields. Researchers have applied various approaches to studying patient experience (PX); however, there is no commonly agreed-upon definition of PX. This scoping review focuses on PX from an eHealth perspective. Our aim was to: 1) describe how PX has been defined, 2) investigate which factors influencing PX and components of PX have been identified and researched, 3) explore the methods used in studying PX, and 4) find out the recent trends in PX research from an eHealth perspective. METHODS: We selected six major journals covering the fields of health informatics, PX, and nursing informatics. Using the search terms "patient experience" and technology-related terms (e.g., digital, eHealth), we searched for articles published between 2019 and 2021. From 426 articles, 44 were included in the analysis. RESULTS: Multiple concepts and meanings are used to refer to PX. Few articles include vague descriptions of the concept. Numerous eHealth factors are influencing PX, as well as components considering PX. The influencing factors were related to eHealth solutions' type and quality, and care process, when the components of PX were related to communication, remote interaction, risks and concerns, and patients' attitudes towards telehealth. Surveys were the main method used to study PX, followed by interviews. CONCLUSIONS: PX is a complex and multifaceted phenomenon, and it is described as a synonym for patient satisfaction and telehealth experiences. Further multidisciplinary research is needed to understand PX as a phenomenon and to outline a framework for the research.

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians' Work: Network Analysis Approach.

BACKGROUND: In health care, the benefits of digitalization need to outweigh the risks, but there is limited knowledge about the factors affecting this balance in the work environment of physicians. To achieve the benefits of digitalization, a more comprehensive understanding of this complex phenomenon related to the digitalization of physicians' work is needed. OBJECTIVE: The aim of this study was to examine physicians' perceptions of the effects of health care digitalization on their work and to analyze how these perceptions are associated with multiple factors related to work and digital health usage. METHODS: A representative sample of 4630 (response rate 24.46%) Finnish physicians (2960/4617, 64.11% women) was used. Statements measuring the perceived effects of digitalization on work included the patients' active role, preventive work, interprofessional cooperation, decision support, access to patient information, and faster consultations. Network analysis of the perceived effects of digitalization and factors related to work and digital health usage was conducted using mixed graphical modeling. Adjusted and standardized regression coefficients are denoted by b. Centrality statistics were examined to evaluate the relative influence of each variable in terms of node strength. RESULTS: Nearly half of physicians considered that digitalization has promoted an active role for patients in their own care (2104/4537, 46.37%) and easier access to patient information (1986/4551, 43.64%), but only 1 in 10 (445/4529, 9.82%) felt that the impact has been positive on consultation times with patients. Almost half of the respondents estimated that digitalization has neither increased nor decreased the possibilities for preventive work (2036/4506, 45.18%) and supportiveness of clinical decision support systems (1941/4458, 43.54%). When all variables were integrated into the network, the most influential variables were purpose of using health information systems, employment sector, and specialization status. However, the grade given to the electronic health record (EHR) system that was primarily used had the strongest direct links to faster consultations (b=0.32) and facilitated access to patient information (b=0.28). At least 6 months of use of the main EHR was associated with facilitated access to patient information (b=0.18). CONCLUSIONS: The results highlight the complex interdependence of multiple factors associated with the perceived effects of digitalization on physicians' work. It seems that a high-quality EHR system is critical for promoting smooth clinical practice. In addition, work-related factors may influence other factors that affect digital health success. These factors should be considered when developing and implementing new digital health technologies or services for physicians' work. The adoption of digital health is not just a technological project but a project that changes existing work practices.

Usability of information systems: Experiences of outpatient physicians, outpatient nurses, and open care social welfare professionals from three large cross-sectional surveys in Finland.

BACKGROUND: Many European countries are integrating healthcare and social welfare services; some also include joint information systems (ISs) in this process. Despite this, large national survey studies examining and comparing the experiences of the major professional groups regarding the usability of their health (HISs) and client information systems (CISs) are lacking. METHODS: We combined the responses from three national cross-sectional surveys conducted among physicians and nurses in 2017, and social welfare professionals (SWPs) in 2019 in Finland. We selected the responses of 1,826 physicians and 774 nurses working in outpatient clinics in specialized and primary care, and 669 social workers and other SWPs working in open services. The questionnaires were adjusted from a validated instrument. In this study, we analyzed 11 usability-related statements. RESULTS: The healthcare professionals (HPs) were more critical of the stability and responsiveness of their ISs than the SWPs (27-48% vs 58-65% agreed). The physicians were most dissatisfied with IS support for routine tasks (24-26% agreed). Less than half of all respondents agreed with statements concerning the ease of documentation, arrangement of fields, and terminology. While the HPs were satisfied with IS support for collaboration and information exchange between professionals in the same organization, all professional groups were dissatisfied with cross-organizational support and communication with patients and clients. Almost half of the HPs considered that HISs improve the quality of care, but 80% of the SWPs disagreed that CISs help improve the quality of services. CONCLUSIONS: Overall, the physicians, nurses, and SWPs were dissatisfied with the usability of their HISs and CISs. Based on our findings, ISs should be further developed to support routine tasks, inter- and cross-organizational collaboration, and information exchange. ISs for the integration of care and services should be designed to accommodate various professional groups' different work contexts and needs.

Social welfare professionals willing to participate in client information system development - Results from a large cross-sectional survey.

Human-centered design methods should be implemented throughout the client information system (CIS) development process to understand social welfare professionals' needs, tasks, and contexts of use. The aim of this study was to examine Finnish social welfare professionals' experiences of participating in CIS development.A national cross-sectional web-based survey on the CIS experiences of social welfare professionals (1145 respondents) was conducted in Finland in spring 2019. This study focused on statements concerning the experiences of end users with CIS development and participation. The results are reported by professional and age groups.Half (50%) of the 1145 respondents had participated in CIS development. Half (56%) knew to whom and how to send feedback to software developers, but most (87%) indicated that changes and corrections were not made according to suggestions and quickly enough. The most preferred methods of participation were telling a person in charge of information systems development about usage problems (53%) and showing developers on site how professionals work (34%); 19% were not interested in participating.Social welfare professionals are willing to participate in CIS development, but vendors and social welfare provider organizations are underutilizing this resource. Social welfare informaticists are needed to interpret the needs of end users to software developers.

Physicians' experiences of participation in healthcare IT development in Finland: willing but not able.

OBJECTIVE: To learn (1) about the kind of experiences that physicians have with participation in healthcare IT development; (2) whether physicians are interested in participating in IT development activities, and if so, how; and (3) the visions that physicians have regarding future IT systems. METHODS: A web-based questionnaire which was answered by about one-third of the working-age physicians in Finland, which is exceptionally broad and sizeable a sample. This research deals with only a small part of the entire questionnaire. The questions used for this study were both quantitative and qualitative. Statistical methods were applied to the former and content analysis to the latter. RESULTS: The responding physicians were highly critical of their IT systems, and their experiences with the current methods of participation, or rather the lack of it, were quite negative. However, a very significant proportion of the respondents were willing to contribute to IT systems development, contrary to a common assumption that clinicians are disinterested. Visioning of future systems was quite cautious, dealing mainly with usability improvements to the current systems. CONCLUSIONS: Major improvements are needed both in the usability of the systems currently in use in Finland and in the collaboration between end-users and developers. Improved methods of participation need to be developed and applied, particularly for the procurement, deployment and on-going development of commercial-off-the-shelf applications.

Finnish physicians' experiences with computer-supported patient information exchange and communication in clinical work.

Several researchers share the concern of healthcare information systems failing to support communication and collaboration in clinical practices. The objective of this paper is to investigate the current state of computer-supported patient information exchange and associated communication between clinicians. We report findings from a national survey on Finnish physicians? experiences with their currently used clinical information systems with regard to patient information documentation, retrieval, management and exchange-related tasks. The questionnaire study with 3929 physicians indicated the main concern being cross-organisational patient information delivery. In addition, physicians argued computer usage increasingly steals time and attention from caring activities and even disturbs physician?nurse collaboration. Problems in information management were particularly emphasised among those physicians working in hospitals and wards. The survey findings indicated that collaborative applications and mobile or wireless solutions have not been widely adapted in Finnish healthcare and suggested an urgent need for adopting appropriate information and communication technology applications to support information exchange and communication between physicians, and physicians and nurses.

Contextual inquiry method for user-centred clinical IT system design.

Little can be found in the literature about the applicability of field study methods, particularly contextual inquiry, in the health informatics field. This paper aims to inform and promote the use of contextual inquiry for user-oriented design of clinical information technology (IT) systems. The paper describes how the method was applied in two empirical studies to gather data about end-users' needs, as well as the use and usability of dictation solutions and electronic nursing documentation systems from the viewpoint of their end-users' in real working surroundings. Experience indicates that, compared to typical usability evaluation methods, contextual inquiry may provide valuable support for user-centred design activities: the method is suitable for increasing researchers' understanding of clinical practices, contexts of work, and end-users' interaction with numerous IT systems. However, in clinical settings there are special challenges related to recording and privacy issues, a wide variety of clinical practices and contexts of technology usage, as well as the hectic nature of clinical work.

National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

OBJECTIVE: In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. METHODS: A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. RESULTS: Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability problems and deficiencies which considerably hindered the efficiency of clinical ICT use and physician's routine work. Systems lacked the appropriate features to support typical clinical tasks, such as decision making, prevention of medical errors, and review of a patient's treatment chart. The systems also required physicians to perform fixed sequences of steps and tasks, and poorly supported the documentation and retrieval of patient data. The findings on ICT support for collaboration showed mainly negative results, aside from collaboration between co-located physicians. In addition, the study results pointed out physicians suffering from system failures and a lack of integration between the systems. CONCLUSIONS: The described study and related results are unique in several ways. A national usability study with nearly 4000 respondents had not been conducted in other countries in which healthcare technologies are widely adopted. The questionnaire study provided a generalized picture about the usability problems, however, it should be noted that there were significant differences between legacy systems in use. Previously, researchers had not approached contextual aspects of usability the context of clinical work, where numerous systems are in use. The described usability dimensions and the presented study results can be considered as the first step towards conceptualizing ICT usability in the unique setting of clinical work.

Usability of electronic nursing record systems: definition and results from an evaluation study in Finland.

Information technologies (IT) are widely used in healthcare, however, little is known about the usability of nursing information systems. This article reports an evaluation study that aimed at researching the usability of four electronic nursing record (ENR) systems and thereby providing guidelines for further IT development. For the purposes of the study the concept of usability was defined to cover the following aspects: nurse-computer interaction in working context, information exchange, and collaboration between healthcare professionals. The study utilized two usability research methods, contextual inquiry and expert review, and was conducted with 18 nurses in Finland. Study results showed that the ENR systems share several usability problems in common, most of them relating to the efficiency of use, intuitiveness, and poor fit for multi-professional needs. Nurses had mainly negative experiences on documenting practices with ENRs: documentation requires a lot of resources, patient information is hard to find, and procedures do not meet the contextual needs. These findings suggest usability problems having significant effects on nurses' documentation practices and nursing work.

Redesigning digital dictation for physicians: a user-centred approach.

The user-centred approach has proven its success in software and product development. However, in the healthcare domain, user-centred research methodology has been applied less widely. This article reports a study that employs a contextual inquiry method to study the prevailing dictation procedures and solutions in a hospital from the physician's perspective. The goal was to empirically evaluate digital dictation and the other three currently used methods for making dictations, thereby eliciting information for supporting the hospital administration in their decisions concerning the further development of a dictation solution. The research indicated a number of user requirements for a dictation solution. The main conclusions were: (1) the currently used information systems need extensive improvements and redesign; (2) the observed process of digital dictation does not seem applicable for its intended context of use; (3) for future solutions, it is important to understand that the dictation user interface cannot be standardized.