Benchmarking usability of patient portals in Estonia, Finland, Norway, and Sweden.

INTRODUCTION: Poor usability is a barrier to widespread adoption of electronic health records (EHR). Providing good usability is especially challenging in the health care context, as there is a wide variety of patient users. Usability benchmarking is an approach for improving usability by evaluating and comparing the strength and weaknesses of systems. The main purpose of this study is to benchmark usability of patient portals across countries. METHODS: A mixed-methods survey approach was applied to benchmark the national patient portals offering patient access to EHR in Estonia, Finland, Norway, and Sweden. These Nordic countries have similar public healthcare systems, and they are pioneers in offering patients access to EHR for several years. In a survey of 29,334 patients, both patients' quantitative ratings of usability and their qualitative descriptions of very positive and very negative peak experiences of portal use were collected. RESULTS: The usability scores ranged from good to fair level of usability. The narratives of very positive and very negative experiences included the benefits of the patient portals and experienced usability issues. The regression analysis of results showed that very positive and negative experiences of patient portal use explain 19-35% of the variation of usability scores in the four countries. The percentage of patients who reported very positive or very negative experiences in each country was unrelated to the usability scores across countries. CONCLUSIONS: The survey approach could be used to evaluate usability with a wide variety of users and it supported learning from comparison across the countries. The combination of quantitative and qualitative data provided an approximation of the level of the perceived usability, and identified usability issues to be improved and useful features that patients appreciate. Further work is needed to improve the comparability of the varied samples across countries.

The NORDeHEALTH 2022 Patient Survey: Cross-Sectional Study of National Patient Portal Users in Norway, Sweden, Finland, and Estonia.

BACKGROUND: Although many surveys have been conducted on patients accessing their own health records in recent years, there is a limited amount of nationwide cross-country data available on patients' views and preferences. To address this gap, an international survey of patient users was conducted in the Nordic eHealth project, NORDeHEALTH. OBJECTIVE: We aimed to investigate the sociodemographic characteristics and experiences of patients who accessed their electronic health records (EHRs) through national patient portals in Norway, Sweden, Finland, and Estonia. METHODS: A cross-sectional web-based survey was distributed using the national online health portals. The target participants were patients who accessed the national patient portals at the start of 2022 and who were aged ≥15 years. The survey included a mixture of close-ended and free-text questions about participant sociodemographics, usability experience, experiences with health care and the EHR, reasons for reading health records online, experience with errors, omissions and offense, opinions about security and privacy, and the usefulness of portal functions. In this paper, we summarized the data on participant demographics, past experience with health care, and the patient portal through descriptive statistics. RESULTS: In total, 29,334 users completed the survey, of which 9503 (32.40%) were from Norway, 13,008 (44.35%) from Sweden, 4713 (16.07%) from Finland, and 2104 (7.17%) from Estonia. National samples were comparable according to reported gender, with about two-thirds identifying as women (19,904/29,302, 67.93%). Age distributions were similar across the countries, but Finland had older users while Estonia had younger users. The highest attained education and presence of health care education varied among the national samples. In all 4 countries, patients most commonly rated their health as "fair" (11,279/29,302, 38.48%). In Estonia, participants were more often inclined to rate their health positively, whereas Norway and Sweden had the highest proportion of negative health ratings. Across the whole sample, most patients received some care in the last 2 years (25,318/29,254, 86.55%). Mental health care was more common (6214/29,254, 21.24%) than oncological care (3664/29,254, 12.52%). Overall, most patients had accessed their health record "2 to 9 times" (11,546/29,306, 39.4%), with the most frequent users residing in Sweden, where about one-third of patients accessed it "more than 20 times" (4571/13,008, 35.14%). CONCLUSIONS: This is the first large-scale international survey to compare patient users' sociodemographics and experiences with accessing their EHRs. Although the countries are in close geographic proximity and demonstrate similar advancements in giving their residents online records access, patient users in this survey differed. We will continue to investigate patients' experiences and opinions about national patient-accessible EHRs through focused analyses of the national and combined data sets from the NORDeHEALTH 2022 Patient Survey.

Patients' Experiences of a National Patient Portal and Its Usability: Cross-Sectional Survey Study.

BACKGROUND: Patient portals not only provide patients with access to electronic health records (EHRs) and other digital health services, such as prescription renewals, but they can also improve patients' self-management, engagement with health care professionals (HCPs), and care processes. However, these benefits depend on patients' willingness to use patient portals and, ultimately, their experiences with the usefulness and ease of use of the portals. OBJECTIVE: This study aimed to investigate the perceived usability of a national patient portal and the relationship of patients' very positive and very negative experiences with perceived usability. The study was aimed to be the first step in developing an approach for benchmarking the usability of patient portals in different countries. METHODS: Data were collected through a web-based survey of the My Kanta patient portal's logged-in patient users in Finland from January 24, 2022, to February 14, 2022. Respondents were asked to rate the usability of the patient portal, and the ratings were used to calculate approximations of the System Usability Scale (SUS) score. Open-ended questions asked the patients about their positive and negative experiences with the patient portal. The statistical analysis included multivariate regression, and the experience narratives were analyzed using inductive content analysis. RESULTS: Of the 1,262,708 logged-in patient users, 4719 responded to the survey, giving a response rate of 0.37%. The patient portal's usability was rated as good, with a mean SUS score of 74.3 (SD 14.0). Reporting a very positive experience with the portal was positively associated with perceived usability (ß=.51; P<.001), whereas reporting a very negative experience was negatively associated with perceived usability (ß=-1.28; P<.001). These variables explained 23% of the variation in perceived usability. The information provided and a lack of information were the most common positive and negative experiences. Furthermore, specific functionalities, such as prescription renewal and the ease of using the patient portal, were often mentioned as very positive experiences. The patients also mentioned negative emotions, such as anger and frustration, as part of their very negative experiences. CONCLUSIONS: The study offers empirical evidence about the significant role of individual experiences when patients are evaluating the usability of patient portals. The results suggest that positive and negative experiences provide relevant information that can be used for improving the patient portal's usability. Usability should be improved so that patients receive information efficiently, easily, and quickly. Respondents would also appreciate interactive features in the patient portal.