Patient Electronic Access to Final Radiology Reports: What Is the Current Standard of Practice, and Is an Embargo Period Appropriate?

Patients have a right to their medical records, and it has become commonplace for institutions to set up online portals through which patients can access their electronic health information, including radiology reports. However, institutional approaches vary on how and when such access is provided. Many institutions have advocated built-in "embargo" periods, during which radiology reports are not immediately released to patients, to give ordering clinicians the opportunity to first receive, review, and discuss the radiology report with their patients. To understand current practices, a telephone survey was conducted of 83 hospitals identified in the 2019-2020 U.S. News & World Report Best Hospitals Rankings. Of 70 respondents, 91% (64 of 70) offered online portal access. Forty-two percent of those with online access (27 of 64 respondents) reported a delay of 4 days or longer, and 52% (33 of 64 respondents) indicated that they first send reports for review by the referring clinician before releasing to the patient. This demonstrates a lack of standardized practice in prompt patient access to health records, which may soon be mandated under the final rule of the 21st Century Cures Act. This article discusses considerations and potential benefits of early access for patients, radiologists, and primary care physicians in communicating health information and providing patient-centered care. © RSNA, 2021.

Quantifying Patient Portal Use: Systematic Review of Utilization Metrics.

BACKGROUND: Use of patient portals has been associated with positive outcomes in patient engagement and satisfaction. Portal studies have also connected portal use, as well as the nature of users' interactions with portals, and the contents of their generated data to meaningful cost and quality outcomes. Incentive programs in the United States have encouraged uptake of health information technology, including patient portals, by setting standards for meaningful use of such technology. However, despite widespread interest in patient portal use and adoption, studies on patient portals differ in actual metrics used to operationalize and track utilization, leading to unsystematic and incommensurable characterizations of use. No known review has systematically assessed the measurements used to investigate patient portal utilization. OBJECTIVE: The objective of this study was to apply systematic review criteria to identify and compare methods for quantifying and reporting patient portal use. METHODS: Original studies with quantifiable metrics of portal use published in English between 2014 and the search date of October 17, 2018, were obtained from PubMed using the Medical Subject Heading term "Patient Portals" and related keyword searches. The first search round included full text review of all results to confirm a priori data charting elements of interest and suggest additional categories inductively; this round was supplemented by the retrieval of works cited in systematic reviews (based on title screening of all citations). An additional search round included broader keywords identified during the full-text review of the first round. Second round results were screened at abstract level for inclusion and confirmed by at least two raters. Included studies were analyzed for metrics related to basic use/adoption, frequency of use, duration metrics, intensity of use, and stratification of users into "super user" or high utilizers. Additional categories related to provider (including care team/administrative) use of the portal were identified inductively. Additional analyses included metrics aligned with meaningful use stage 2 (MU-2) categories employed by the US Centers for Medicare and Medicaid Services and the association between the number of portal metrics examined and the number of citations and the journal impact factor. RESULTS: Of 315 distinct search results, 87 met the inclusion criteria. Of the a priori metrics, plus provider use, most studies included either three (26 studies, 30%) or four (23 studies, 26%) metrics. Nine studies (10%) only reported the patient use/adoption metric and only one study (1%) reported all six metrics. Of the US-based studies (n=76), 18 (24%) were explicitly motivated by MU-2 compliance; 40 studies (53%) at least mentioned these incentives, but only 6 studies (8%) presented metrics from which compliance rates could be inferred. Finally, the number of metrics examined was not associated with either the number of citations or the publishing journal's impact factor. CONCLUSIONS: Portal utilization measures in the research literature can fall below established standards for "meaningful" or they can substantively exceed those standards in the type and number of utilization properties measured. Understanding how patient portal use has been defined and operationalized may encourage more consistent, well-defined, and perhaps more meaningful standards for utilization, informing future portal development.

The Causal Relationship Between Portal Usage and Self-Efficacious Health Information-Seeking Behaviors: Secondary Analysis of the Health Information National Trends Survey Data.

BACKGROUND: Patient portals have drawn much attention, as they are considered an important tool for health providers in facilitating patient engagement. However, little is known about whether the intensive use of patient portals contributes to improved management of patients' health in terms of their confidence in acquiring health information and exercising self-care. There is a lack of randomized trials with these outcomes measured both pre- and postadoption of patient portals. OBJECTIVE: The aim of this study was to examine the causal relationship between the usage of patient portals and patients' self-efficacy toward obtaining health information and performing self-care. METHODS: This study was a secondary data analysis that used data from a US national survey, the National Cancer Institute's Health Information National Trends Survey 5 Cycle 1. Patient portal usage frequency was used to define the treatment. Survey items measuring self-efficacy on a Likert-type scale were selected as the main outcomes, including patients' confidence in obtaining health information and performing self-care. To establish causality using survey data, we adopted the instrumental variables method. To determine the direction of the causal relationship in the presence of high-dimensional confounders, we further proposed a novel testing framework that employs conditional independence tests in a directed acyclic graph. The average causal effect was measured using the two-stage least squares regression method. RESULTS: We showed that frequently using patient portals improves patients' confidence in obtaining health information. The estimand of the weighted average causal effect was 0.14 (95% CI 0.06-0.23; P<.001). This means that when increasing the portal usage intensity, for instance, from 1-2 times to 3-5 times per year, the expected average increase in confidence level measured on a Likert-type scale would be 0.14. However, we could not conclusively determine the causal effect between patient portal usage and patients' confidence in exercising self-care. CONCLUSIONS: The results support the use of patient portals and encourage better support and education to patients. The proposed statistical method can be used to exploit the potential of national survey data for causal inference studies.

Using the Patient Portal Sexual Health Instrument in Surveys and Patient Questionnaires Among Sexual Minority Men in the United States: Cross-sectional Psychometric Validation Study.

BACKGROUND: Patient portal modules, including electronic personal health records, health education, and prescription refill ordering, may be leveraged to address the sexually transmitted infection (STI) burden, including HIV, among gay, bisexual, and other sexual minority men (SMM). Theoretical frameworks in the implementation sciences highlight examining constructs of innovation attributes and performance expectations as key determinants of behavioral intentions and the use of new web-based health technologies. However, behavioral intentions to use patient portals for HIV and other STI prevention and care among SMM is understudied. OBJECTIVE: The aim of this study is to develop a brief instrument for measuring attitudes focused on using patient portals for STI prevention and care among a nationwide sample of SMM. METHODS: A total of 12 items of the American Men's Internet Survey-Patient Portal Sexual Health Instrument (AMIS-PPSHI) were adapted from a previous study. Psychometric analyses of the AMIS-PPSHI items were conducted among a randomized subset of 2018 AMIS participants reporting web-based access to their health records (N=1375). Parallel analysis and inspection of eigenvalues in a principal component analysis (PCA) informed factor retention in exploratory factor analysis (EFA). After EFA, Cronbach α was used to examine the internal consistency of the scale and its subscales. Confirmatory factor analysis (CFA) was used to assess the goodness of fit of the final factor structure. We calculated the total AMIS-PPSHI scale scores for comparisons within group categories, including age, STI diagnosis history, recency of testing, serious mental illness, and anticipated health care stigma. RESULTS: The AMIS-PPSHI scale resulting from EFA consisted of 12 items and had good internal consistency (α=.84). The EFA suggested 3 subscales: sexual health engagement and awareness (α=.87), enhancing dyadic communication (α=.87), and managing sexual health care (α=.79). CFA demonstrated good fit in the 3-factor PPSHI structure: root mean square error of approximation=0.061, comparative fit index=0.964, Tucker-Lewis index=0.953, and standardized root mean square residual=0.041. The most notable differences were lower scores on the enhanced dyadic communication subscale among people living with HIV. CONCLUSIONS: PPSHI is a brief instrument with strong psychometric properties that may be adapted for use in large surveys and patient questionnaires in other settings. Scores demonstrate that patient portals are favorable web-based solutions to deliver health services focused on STI prevention and care among SMM in the United States. More attention is needed to address the privacy implications of interpersonal use of patient portals outside of traditional health settings among persons with HIV.

Capturing the Impact of Patient Portals Based on the Quadruple Aim and Benefits Evaluation Frameworks: Scoping Review.

BACKGROUND: Despite extensive and continuing research in the area of patient portals, measuring the impact of patient portals remains a convoluted process. OBJECTIVE: This study aims to explore what is known about patient portal evaluations and to provide recommendations for future endeavors. The focus is on mapping the measures used to assess the impact of patient portals on the dimensions of the Quadruple Aim (QA) framework and the Canada Health Infoway's Benefits Evaluation (BE) framework. METHODS: A scoping review was conducted using the methodological framework of Arksey and O'Malley. Reporting was guided by the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) extension for scoping reviews. A systematic and comprehensive search was conducted using the Ovid platform, and the following databases were searched: Ovid MEDLINE (R) ALL (including epub ahead of print, in-process, and other nonindexed citations), EMBASE, and PsycINFO. CINAHL on the EBSCO platform and Web of Science were searched for studies published between March 2015 and June 2020. A systematic gray literature search was conducted using the Google search engine. Extracted data were tabulated based on a coding template developed to categorize the literature into themes and areas of interest. RESULTS: A total of 96 studies were included for data extraction. The studies were categorized based on the QA dimensions, with strict adherence to the definitions for each dimension. From the patients' perspective, it was determined that most evaluations focused on benefits and barriers to access, access to test results, medication adherence, condition management, medical notes, and secure messaging. From the population perspective, the evaluations focused on the increase in population outreach, decrease in disparities related to access to care services, and improvement in quality of care. From the health care workforce perspective, the evaluations focused on the impact of patients accessing medical records, impact on workflow, impact of bidirectional secure messaging, and virtual care. From the health system perspective, the evaluations focused on decreases in no-show appointments, impact on office visits and telephone calls, impact on admission and readmission rates and emergency department visits, and impact on health care use. Overall, 77 peer-reviewed studies were mapped on the expanded version of the BE framework. The mapping was performed using subdimensions to create a more precise representation of the areas that are currently explored when studying patient portals. Most of the studies evaluated more than one subdimension. CONCLUSIONS: The QA and BE frameworks provide guidance in identifying gaps in the current literature by providing a way to show how an impact was assessed. This study highlights the need to appropriately plan how the impact will be assessed and how the findings will be translated into effective adaptations.

Adopting Patient Portals in Hospitals: Qualitative Study.

BACKGROUND: Theoretical models help to explain or predict the adoption of electronic health (eHealth) technology and illustrate the complexity of the adoption process. These models provide insights into general factors that influence the use of eHealth technology. However, they do not give hospitals much actionable knowledge on how to facilitate the adoption process. OBJECTIVE: Our study aims to provide insights into patient portal adoption processes among patients and hospital staff, including health care professionals (HCPs), managers, and administrative clerks. Studying the experiences and views of stakeholders answers the following question: How can hospitals encourage patients and HCPs to adopt a patient portal? METHODS: We conducted 22 semistructured individual and group interviews (n=69) in 12 hospitals and four focus groups with members of national and seminational organizations and patient portal suppliers (n=53). RESULTS: The effort hospitals put into adopting patient portals can be split into three themes. First, inform patients and HCPs about the portal. This communication strategy has four objectives: users should (1) know about the portal, (2) know how the portal works, (3) know that action on the portal is required, and (4) know where to find help with the portal. Second, embed the patient portal in the daily routine of HCPs and management. This involves three forms of support: (1) hospital policy, (2) management by monitoring the numbers, and (3) a structured implementation strategy that includes all staff of one department. Third, try to adjust the portal to meet patients' needs to optimize user-friendliness in two ways: (1) use patients' feedback and (2) focus on optimizing for patients with special needs (eg, low literacy and low digital skills). CONCLUSIONS: Asking stakeholders what they have learned from their efforts to stimulate patient portal use in hospitals elicited rich insights into the adoption process. These insights are missing in the theoretical models. Therefore, our findings help to translate the relatively abstract factors one finds in theoretical models to the everyday pragmatics of eHealth projects in hospitals.

The State of Evidence in Patient Portals: Umbrella Review.

BACKGROUND: Patient portals have emerged as a recognized digital health strategy. To date, research on patient portals has grown rapidly. However, there has been limited evaluation of the growing body of evidence on portal availability, use, clinical or health behavior and outcomes, and portal adoption over time. OBJECTIVE: This paper aims to comprehensively consolidate the current state of evidence on patient portals using the umbrella review methodology, introduce our approach for evaluating evidence for quantitative and qualitative findings presented in included systematic reviews, and present a knowledge translation tool that can be used to inform all stages of patient portal adoption. METHODS: For this study, a modified version of the Joanna Briggs Institute umbrella review method was used. Multiple databases were searched for systematic reviews focused on patient portals, and the final sample included 14 reviews. We conducted a meta-level synthesis of findings from quantitative, qualitative, and mixed methods primary studies reported in systematic reviews. We organized the umbrella review findings according to the Clinical Adoption Meta-Model (CAMM). Vote-counting, GRADE (Grading of Recommendations, Assessment, Development, and Evaluations), and CERQual (Confidence in the Evidence from Review of Qualitative Research) were used to assess the umbrella review evidence. RESULTS: Our knowledge translation tool summarizes the findings in the form of an evidence map. Organized by the CAMM categories, the map describes the following factors that influence portal adoption and effects over time: patient contexts, patient's interest and satisfaction, portal design, facilitators and barriers, providers' attitudes, service utilization, behavioral effects, clinical outcomes, and patient-reported outcomes. The map lists the theories and mechanisms recognized in the included portal research while identifying the need for business models and organizational theories that can inform all stages of portal adoption. Our GRADE and CERQual umbrella review evaluation resulted in the majority of evidence being rated as moderate to low, which reflects methodological issues in portal research, insufficient number of studies, or mixed results in specific focus areas. The 2 findings with a high rating of evidence were patients' interest in using portals for communication and the importance of a simple display of information in the portals. Over 40 portal features were identified in the umbrella review, with communication through secure messaging and appointment booking mentioned in all systematic reviews. CONCLUSIONS: Our umbrella review provides a meta-level synthesis to make sense of the evidence on patient portals from published systematic reviews. Unsystematic and variable reporting of portal features undermines the ability to evaluate and compare portal effects and overlooks the specific context of portal use. Research designs sensitive to the social, organizational, policy, and temporal dimensions are needed to better understand the underlying mechanisms and context that leverage the identified factors to improve portal use and effects.

Patient Portal Functionalities and Patient Outcomes Among Patients With Diabetes: Systematic Review.

BACKGROUND: Patient portal use could help improve the care and health outcomes of patients with diabetes owing to functionalities, such as appointment booking, electronic messaging (e-messaging), and repeat prescription ordering, which enable patient-centered care and improve patient self-management of the disease. OBJECTIVE: This review aimed to summarize the evidence regarding patient portal use (portals that are connected to electronic health care records) or patient portal functionality use (eg, appointment booking and e-messaging) and their reported associations with health and health care quality outcomes among adult patients with diabetes. METHODS: We searched the MEDLINE, Embase, and Scopus databases and reported the review methodology using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Three independent reviewers screened titles and abstracts, and two reviewers assessed the full texts of relevant studies and performed data extraction and quality assessments of the included studies. We used the Cochrane Collaboration Risk of Bias Tool and the National Heart, Lung and Blood Institute (NHLBI) Study Quality Assessment Tool to assess the risk of bias of the included studies. Data were summarized through narrative synthesis. RESULTS: Twelve studies were included in this review. Five studies reported overall patient portal use and its association with diabetes health and health care quality outcomes. Six studies reported e-messaging or email use-associated outcomes, and two studies reported prescription refill-associated outcomes. The reported health outcomes included the associations of patient portal use with blood pressure, low-density lipoprotein cholesterol, and BMI. Few studies reported health care utilization outcomes such as office visits, emergency department visits, and hospitalizations. A limited number of studies reported overall quality of care for patients with diabetes who used patient portals. CONCLUSIONS: The included studies mostly reported improved glycemic control outcomes for patients with diabetes who used patient portals. However, limitations of studying the effects of patient portals exist, which do not guarantee whether the outcomes reported are completely the result of patient portal use or if confounding factors exist. Randomized controlled trials and mixed-methods studies could help understand the mechanisms involved in health outcome improvements and patient portal use among patients with diabetes. TRIAL REGISTRATION: International Prospective Register of Systematic Reviews (PROSPERO) CRD42019141131; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42019141131. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/14975.

Portals of Change: How Patient Portals Will Ultimately Work for Safety Net Populations.

Despite the implementation of internet patient portals into the safety net after the introduction of the Affordable Care Act in the United States, little attention has been paid to the process of engaging vulnerable patients into these portals. The portal is a health technology tool that was developed with a mainstream, English-speaking audience in mind. Thus, there are valid concerns that such technologies will actually exacerbate health care disparities, conferring further advantages to the already advantaged. In this paper, we describe a framework for portal engagement (awareness, registration, and use) among safety net patients. We incorporate the experiences in the Los Angeles County Department of Health Services to illustrate important contextual factors for portal outreach in our safety net. Finally, we discuss considerations for moving forward with health technology in the safety net as the next version of patient portals are being developed.

Patient Portal Implementation and Uptake: Qualitative Comparative Case Study.

BACKGROUND: Giving patients access to their health information is a provincial and national goal, and it is critical to the delivery of patient-centered care. With this shift, patient portals have become more prevalent. In Alberta, the Alberta Health Services piloted a portal (MyChart). There was a need to identify factors that promoted the use of this portal. Furthermore, it was imperative to understand why there was variability in uptake within the various clinics that participated in the pilot. OBJECTIVE: This study aims to identify potential factors that could improve the uptake of MyChart from the perspectives of both users and nonusers at pilot sites. We focused on factors that promoted the use of MyChart along with related benefits and barriers to its use, with the intention that this information could be incorporated into the plan for its province-wide implementation. METHODS: A qualitative comparative case study was conducted to determine the feasibility, acceptability, and initial perceptions of users and to identify ways to increase uptake. Semistructured interviews were conducted with 56 participants (27 patients, 21 providers, 4 nonmedical staff, and 4 clinic managers) from 5 clinics. Patients were asked about the impact of MyChart on their health and health care. Providers were asked about the impact on the patient-provider relationship and workflow. Managers were asked about barriers to implementation. The interviews were recorded, transcribed verbatim, and entered into NVivo. A thematic analysis was used to analyze the data. RESULTS: Results from a comparison of factors related to uptake of MyChart in 5 clinics (2 clinics with high uptake, 1 with moderate uptake, 1 with low uptake, and 1 with no uptake) are reported. Some theoretical constructs in our study, such as intention to use, perceived value, similarity (novelty) of the technology, and patient health needs, were similar to findings published by other research teams. We also identified some new factors associated with uptake, including satisfaction or dissatisfaction with the current status quo, performance expectancy, facilitating conditions, behavioral intentions, and use behavior. All these factors had an impact on the level of uptake in each setting and created different opportunities for end users. CONCLUSIONS: There is limited research on factors that influence the uptake of patient portals. We identified some factors that were consistent with those reported by others but also several new factors that were associated with the update of MyChart, a new patient portal, in the clinics we studied. On the basis of our results, we posit that a shared understanding of the technology among patients, clinicians, and managers, along with dissatisfaction with nonportal-based communications, is foundational and must be addressed for patient portals to support improvements in care.

Impact of Patient-Clinical Team Secure Messaging on Communication Patterns and Patient Experience: Randomized Encouragement Design Trial.

BACKGROUND: Although secure messaging (SM) between patients and clinical team members is a recommended component of continuous care, uptake by patients remains relatively low. We designed a multicomponent Supported Adoption Program (SAP) to increase SM adoption among patients using the Veterans Health Administration (VHA) for primary care. OBJECTIVE: Our goals were to (1) conduct a multisite, randomized, encouragement design trial to test the effectiveness of an SAP designed to increase patient engagement with SM through VHA's online patient portal (My HealtheVet [MHV]) and (2) evaluate the impact of the SAP and patient-level SM adoption on perceived provider autonomy support and communication. Patient-reported barriers to SM adoption were also assessed. METHODS: We randomized 1195 patients at 3 VHA facilities who had MHV portal accounts but had never used SM. Half were randomized to receive the SAP, and half served as controls receiving usual care. The SAP consisted of encouragement to adopt SM via mailed educational materials, proactive SM sent to patients, and telephone-based motivational interviews. We examined differences in SM adoption rates between SAP recipients and controls at 9 months and 21 months. Follow-up telephone surveys were conducted to assess perceived provider autonomy support and self-report of telephone communication with clinical teams. RESULTS: Patients randomized to the SAP had significantly higher rates of SM adoption than the control group (101/595, 17.0% vs 40/600, 6.7%; P<.001). Most adopters in the SAP sent their first message without a motivational interview (71/101, 70.3%). The 10-percentage point difference in adoption persisted a full year after the encouragement ended (23.7%, 142/600 in the SAP group vs 13.5%, 80/595 in the control group, P<.001). We obtained follow-up survey data from 49.54% (592/1195) of the participants. SAP participants reported higher perceived provider autonomy support (5.7 vs 5.4, P=.007) and less telephone use to communicate with their provider (68.8% vs 76.0%, P=.05), compared to patients in the control group. Patient-reported barriers to SM adoption included self-efficacy (eg, not comfortable using a computer, 24%), no perceived need for SM (22%), and difficulties with portal password or login (17%). CONCLUSIONS: The multicomponent SAP was successful in increasing use of SM 10 percentage points above standard care; new SM adopters reported improved perceptions of provider autonomy support and less use of the telephone to communicate with their providers. Still, despite the encouragement and technical assistance provided through the SAP, adoption rates were lower than anticipated, reaching only 24% at 21 months (10% above controls). Common barriers to adoption such as limited perceived need for SM may be more challenging to address and require different interventions than barriers related to patient self-efficacy or technical difficulties. TRIAL REGISTRATION: ClinicalTrials.gov NCT02665468; https://clinicaltrials.gov/ct2/show/NCT02665468.

Health Care Professionals' Experiences of Patient-Professional Communication Over Patient Portals: Systematic Review of Qualitative Studies.

BACKGROUND: The popularity of web-based patient-professional communication over patient portals is constantly increasing. Good patient-professional communication is a prerequisite for high-quality care and patient centeredness. Understanding health care professionals' experiences of web-based patient-professional communication is important as they play a key role in engaging patients to use portals. More information is needed on how patient-professional communication could be supported by patient portals in health care. OBJECTIVE: This systematic review of qualitative studies aims to identify how health care professionals experience web-based patient-professional communication over the patient portals. METHODS: Abstract and full-text reviews were conducted by 2 reviewers independently. A total of 4 databases were used for the study: CINAHL (EBSCO), ProQuest (ABI/INFORM), Scopus, and PubMed. The inclusion criteria for the reviewed studies were as follows: the examination of health care professionals' experiences, reciprocal communication between patients and health care professionals, peer-reviewed scientific articles, and studies published between 2010 and 2019. The Joanna Briggs Institute's quality assessment criteria were used in the review process. A total of 13 included studies were analyzed using a thematic synthesis, which was conducted by 3 reviewers. RESULTS: A total of 6 analytical themes concerning health care professionals' experiences of web-based patient-professional communication were identified. The themes were related to health care professionals' work, change in communication over patient portals, patients' use of patient portals, the suitability of patient portals for communication, the convenience of patient portals for communication, and change in roles. CONCLUSIONS: Health care professionals' experiences contain both positive and negative insights into web-based patient-professional communication over patient portals. Most commonly, the positive experiences seem to be related to the patients and patient outcomes, such as having better patient engagement. Health care professionals also have negative experiences, for example, web-based patient-professional communication sometimes has deficiencies and has a negative impact on their workload. These negative experiences may be explained by the poor functionality of the patient portals and insufficient training and resources. To reduce health care professionals' negative experiences of web-based patient-professional communication, their experiences should be taken into account by policy makers, health care organizations, and information technology enterprises when developing patient portals. In addition, more training regarding web-based patient-professional communication and patient portals should be provided to health care professionals.

Tracing the Decisions That Shaped the Development of MyChart, an Electronic Patient Portal in Alberta, Canada: Historical Research Study.

BACKGROUND: Understanding how health organizations decide on information technology (IT) investments is imperative to ensure successful implementation and adoption. There is a high rate of failure and a tendency to downplay the complexity of implementation progression. Alberta Health Services introduced a patient portal called MyChart. Although MyChart allows patients to view appointments and selected laboratory results and to communicate with their providers, its uptake varies. OBJECTIVE: The study aimed to examine the institutional decision-making processes that shaped the development and implementation of MyChart. METHODS: A historical study was conducted based on the 7-step framework, where one engages in a rigorous archival critical analysis (including internal and external criticism) of documents and analysis of interviews. We reviewed and analyzed 423 primary and secondary sources and interviewed 10 key decision makers. RESULTS: Supportive leadership, project management, focused scope, appropriate technology and vendor selection, and quick decision making were some of the facilitators that allowed for the growth of proof of concept. The planning and implementation stages did not depend much on the technology itself but on the various actors who influenced the implementation by exerting power. The main barriers were lack of awareness about the technology, proper training, buy-in from diverse system leaders, and centralized government decision making. CONCLUSIONS: Organizational priorities and decision-making tactics influence IT investments, implementation, adoption, and outcomes. Future research could focus on improving the applicability of needs assessments and funding decisions to health care scenarios.

Patient Challenges and Needs in Comprehending Laboratory Test Results: Mixed Methods Study.

BACKGROUND: Patients are increasingly able to access their laboratory test results via patient portals. However, merely providing access does not guarantee comprehension. Patients could experience confusion when reviewing their test results. OBJECTIVE: The aim of this study is to examine the challenges and needs of patients when comprehending laboratory test results. METHODS: We conducted a web-based survey with 203 participants and a set of semistructured interviews with 13 participants. We assessed patients' perceived challenges and needs (both informational and technological needs) when they attempted to comprehend test results, factors associated with patients' perceptions, and strategies for improving the design of patient portals to communicate laboratory test results more effectively. Descriptive and correlation analysis and thematic analysis were used to analyze the survey and interview data, respectively. RESULTS: Patients face a variety of challenges and confusion when reviewing laboratory test results. To better comprehend laboratory results, patients need different types of information, which are grouped into 2 categories-generic information (eg, reference range) and personalized or contextual information (eg, treatment options, prognosis, what to do or ask next). We also found that several intrinsic factors (eg, laboratory result normality, health literacy, and technology proficiency) significantly impact people's perceptions of using portals to view and interpret laboratory results. The desired enhancements of patient portals include providing timely explanations and educational resources (eg, a health encyclopedia), increasing usability and accessibility, and incorporating artificial intelligence-based technology to provide personalized recommendations. CONCLUSIONS: Patients face significant challenges in interpreting the meaning of laboratory test results. Designers and developers of patient portals should employ user-centered approaches to improve the design of patient portals to present information in a more meaningful way.

Characteristics of Patients Using Different Patient Portal Functions and the Impact on Primary Care Service Utilization and Appointment Adherence: Retrospective Observational Study.

BACKGROUND: Patient portals are now widely available and increasingly adopted by patients and providers. Despite the growing research interest in patient portal adoption, there is a lack of follow-up studies describing the following: whether patients use portals actively; how frequently they use distinct portal functions; and, consequently, what the effects of using them are, the understanding of which is paramount to maximizing the potential of patient portals to enhance care delivery. OBJECTIVE: To investigate the characteristics of primary care patients using different patient portal functions and the impact of various portal usage behaviors on patients' primary care service utilization and appointment adherence. METHODS: A retrospective, observational study using a large dataset of 46,544 primary care patients from University of Florida Health was conducted. Patient portal users were defined as patients who adopted a portal, and adoption was defined as the status that a portal account was opened and kept activated during the study period. Then, users were further classified into different user subgroups based on their portal usage of messaging, laboratory, appointment, and medication functions. The intervention outcomes were the rates of primary care office visits categorized as arrived, telephone encounters, cancellations, and no-shows per quarter as the measures of primary care service utilization and appointment adherence. Generalized linear models with a panel difference-in-differences study design were then developed to estimate the rate ratios between the users and the matched nonusers of the four measurements with an observational window of up to 10 quarters after portal adoption. RESULTS: Interestingly, a high propensity to adopt patient portals does not necessarily imply more frequent use of portals. In particular, the number of active health problems one had was significantly negatively associated with portal adoption (odds ratios [ORs] 0.57-0.86, 95% CIs 0.51-0.94, all P<.001) but was positively associated with portal usage (ORs 1.37-1.76, 95% CIs 1.11-2.22, all P≤.01). The same was true for being enrolled in Medicare for portal adoption (OR 0.47, 95% CI 0.41-0.54, P<.001) and message usage (OR 1.44, 95% CI 1.03-2.03, P=.04). On the impact of portal usage, the effects were time-dependent and specific to the user subgroup. The most salient change was the improvement in appointment adherence, and patients who used messaging and laboratory functions more often exhibited a larger reduction in no-shows compared to other user subgroups. CONCLUSIONS: Patients differ in their portal adoption and usage behaviors, and the portal usage effects are heterogeneous and dynamic. However, there exists a lack of match in the patient portal market where patients who benefit the most from patient portals are not active portal adopters. Our findings suggest that health care delivery planners and administrators should remove the barriers of adoption for the portal beneficiaries; in addition, they should incorporate the impact of portal usage into care coordination and workflow design, ultimately aligning patients' and providers' needs and functionalities to effectively deliver patient-centric care.

Patient Portal Barriers and Group Differences: Cross-Sectional National Survey Study.

BACKGROUND: Past studies examining barriers to patient portal adoption have been conducted with a small number of patients and health care settings, limiting generalizability. OBJECTIVE: This study had the following two objectives: (1) to assess the prevalence of barriers to patient portal adoption among nonadopters and (2) to examine the association between nonadopter characteristics and reported barriers in a nationally representative sample. METHODS: Data from this study were obtained from the 2019 Health Information National Trends Survey. We calculated descriptive statistics to determine the most prevalent barriers and conducted multiple variable logistic regression analysis to examine which characteristics were associated with the reported barriers. RESULTS: The sample included 4815 individuals. Among these, 2828 individuals (58.73%) had not adopted a patient portal. Among the nonadopters (n=2828), the most prevalent barriers were patient preference for in-person communication (1810/2828, 64.00%), no perceived need for the patient portal (1385/2828, 48.97%), and lack of comfort and experience with computers (735/2828, 25.99%). Less commonly, individuals reported having no patient portal (650/2828, 22.98%), no internet access (650/2828, 22.98%), privacy concerns (594/2828, 21.00%), difficulty logging on (537/2828, 18.99%), and multiple patient portals (255/2828, 9.02%) as barriers. Men had significantly lower odds of indicating a preference for speaking directly to a provider compared with women (odds ratio [OR] 0.75, 95% CI 0.60-0.94; P=.01). Older age (OR 1.01, 95% CI 1.00-1.02; P<.001), having a chronic condition (OR 1.83, 95% CI 1.44-2.33; P<.001), and having an income lower than US $20,000 (OR 1.61, 95% CI 1.11-2.34; P=.01) were positively associated with indicating a preference for speaking directly to a provider. Hispanic individuals had significantly higher odds of indicating that they had no need for a patient portal (OR 1.59, 95% CI 1.24-2.05; P<.001) compared with non-Hispanic individuals. Older individuals (OR 1.05, 95% CI 1.04-1.06; P<.001), individuals with less than a high school diploma (OR 3.15, 95% CI 1.79-5.53; P<.001), and individuals with a household income of less than US $20,000 (OR 2.78, 95% CI 1.88-4.11; P<.001) had significantly higher odds of indicating that they were uncomfortable with a computer. CONCLUSIONS: The most common barriers to patient portal adoption are preference for in-person communication, not having a need for the patient portal, and feeling uncomfortable with computers, which are barriers that are modifiable and can be intervened upon. Patient characteristics can help predict which patients are most likely to experience certain barriers to patient portal adoption. Further research is needed to tailor implementation approaches based on patients' needs and preferences.

Effects of a Web-Based Patient Portal on Patient Satisfaction and Missed Appointment Rates: Survey Study.

BACKGROUND: Although electronic medical record (EMR)-tethered patient portals are common in other countries, they are still emerging in Canada. OBJECTIVE: We aimed to report user satisfaction and the effects of a patient portal on medical appointment attendance in a Canadian cohort of patients within our publicly funded health care system. METHODS: Two surveys were deployed, via email, at 2 weeks and 6 months following the first recorded patient portal access. Database audits of visit attendance were used to supplement and cross reference survey data. RESULTS: Between January 2016 and July 2018, 4296 patients accessed the patient portal. During the study, 28% (957/3421) consented patient portal users responded to one or more semistructured electronic surveys. Of respondents, 93% (891/957) reported that the patient portal was easy to use, 51% (492/975) reported it saved time when scheduling an appointment, and 40% (382/957) reported that they had to repeat themselves less during appointments. Respondents reported patient portal-related changes in health system use, with 48% (462/957) reporting avoiding a clinic visit and 2.7% (26/957) avoiding an emergency department visit. Across 19,968 visits in clinics where the patient portal was introduced, missed appointments were recorded in 9.5% (858/9021) of non-patient portal user visits, compared with 4.5% (493/9021) for patient portal users, representing a 53% relative reduction in no-show rates. CONCLUSIONS: Early experience with an EMR-tethered patient portal showed strong reports of positive patient experience, a self-reported decrease in health system use, and a measured decrease in missed appointment rates. Implications on the expanded use of patient portals requires more quantitative and qualitative study in Canada.

Patient Recommendations to Improve the Implementation of and Engagement With Portals in Acute Care: Hospital-Based Qualitative Study.

BACKGROUND: The inclusion of patient portals into electronic health records in the inpatient setting lags behind progress in the outpatient setting. OBJECTIVE: The aim of this study was to understand patient perceptions of using a portal during an episode of acute care and explore patient-perceived barriers and facilitators to portal use during hospitalization. METHODS: We utilized a mixed methods approach to explore patient experiences in using the portal during hospitalization. All patients received a tablet with a brief tutorial, pre- and postuse surveys, and completed in-person semistructured interviews. Qualitative data were coded using thematic analysis to iteratively develop 18 codes that were integrated into 3 themes framed as patient recommendations to hospitals to improve engagement with the portal during acute care. Themes from these qualitative data guided our approach to the analysis of quantitative data. RESULTS: We enrolled 97 participants: 53 (53/97, 55%) women, 44 (44/97, 45%) nonwhite with an average age of 48 years (19-81 years), and the average length of hospitalization was 6.4 days. A total of 47 participants (47/97, 48%) had an active portal account, 59 participants (59/97, 61%) owned a smartphone, and 79 participants (79/97, 81%) accessed the internet daily. In total, 3 overarching themes emerged from the qualitative analysis of interviews with these patients during their hospital stay: (1) hospitals should provide both access to a device and bring-your-own-device platform to access the portal; (2) hospitals should provide an orientation both on how to use the device and how to use the portal; and (3) hospitals should ensure portal content is up to date and easy to understand. CONCLUSIONS: Patients independently and consistently identified basic needs for device and portal access, education, and usability. Hospitals should prioritize these areas to enable successful implementation of inpatient portals to promote greater patient engagement during acute care. TRIAL REGISTRATION: ClinicalTrials.gov NCT00102401; https://clinicaltrials.gov/ct2/show/NCT01970852.

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development.

BACKGROUND: Web-based outpatient portals help patients engage in the management of their health by allowing them to access their medical information, schedule appointments, track their medications, and communicate with their physicians and care team members. Initial studies have shown that portal adoption positively affects health outcomes; however, early studies typically relied on survey data. Using data from health portal applications, we conducted systematic assessments of patients' use of an outpatient portal to examine how patients engage with the tool. OBJECTIVE: This study aimed to document the functionality of an outpatient portal in the context of outpatient care by mining portal usage data and to provide insights into how patients use this tool. METHODS: Using audit log files from the outpatient portal associated with the electronic health record system implemented at a large multihospital academic medical center, we investigated the behavioral traces of a study population of 2607 patients who used the portal between July 2015 and February 2019. Patient portal use was defined as having an active account and having accessed any portal function more than once during the study time frame. RESULTS: Through our analysis of audit log file data of the number and type of user interactions, we developed a taxonomy of functions and actions and computed analytic metrics, including frequency and comprehensiveness of use. We additionally documented the computational steps required to diagnose artifactual data and arrive at valid usage metrics. Of the 2607 patients in our sample, 2511 were active users of the patients portal where the median number of sessions was 94 (IQR 207). Function use was comprehensive at the patient level, while each session was instead limited to the use of one specific function. Only 17.45% (78,787/451,762) of the sessions were linked to activities involving more than one portal function. CONCLUSIONS: In discussing the full methodological choices made in our analysis, we hope to promote the replicability of our study at other institutions and contribute to the establishment of best practices that can facilitate the adoption of behavioral metrics that enable the measurement of patient engagement based on the outpatient portal use.

Features of a Patient Portal for Blood Test Results and Patient Health Engagement: Web-Based Pre-Post Experiment.

BACKGROUND: The use of patient portals for presenting health-related patient data, such as blood test results, is becoming increasingly important in health practices. Patient portals have the potential to enhance patient health engagement, but content might be misinterpreted. OBJECTIVE: This study aimed to discover whether the way of presenting blood test outcomes in an electronic patient portal is associated with patient health engagement and whether this varies across different blood test outcomes. METHODS: A 2x3 between-subjects experiment was conducted among members of the Nivel Dutch Health Care Consumer Panel. All participants read a scenario in which they were asked to imagine themselves receiving blood test results. These results differed in terms of the presented blood values (ie, normal vs partially abnormal vs all abnormal) as well as in terms of whether the results were accompanied with explanatory text and visualization. Patient health engagement was measured both before (T0) and after (T1) participants were exposed to their fictive blood test results. RESULTS: A total 487 of 900 invited members responded (response rate 54%), of whom 50.3% (245/487) were female. The average age of the participants was 52.82 years (SD 15.41 years). Patient health engagement saw either a significant decrease or a nonsignificant difference in the experimental groups after viewing the blood test results. The mean difference was smaller in the groups that received blood test results with additional text and visualization (meanT0 5.33, SE 0.08; meanT1 5.14, SE 0.09; mean difference 0.19, SE 0.08, P=.02) compared with groups that received blood test results without explanatory text and visualization (meanT0 5.19, SE 0.08; meanT1 4.55, SE 0.09; mean difference 0.64, SE 0.08, P<.001). Adding text and visualization, in particular, reduced the decline in patient health engagement in participants who received normal results or mixed results (ie, combination of normal and abnormal results). CONCLUSIONS: Adding text and visualization features can attenuate the decrease in patient health engagement in participants who receive outcomes of a blood test via a patient portal, particularly when blood test results are (partly) normal. This suggests that explanatory text and visualization can be reassuring. Future research is warranted to determine whether these results can be generalized to a patient population who receive their actual blood test results.