Satisfaction of Older Patients With Emergency Department Care: Psychometric Properties and Construct Validity of the Consumer Emergency Care Satisfaction Scale.

BACKGROUND: Patient satisfaction is an important indicator of quality of care, but its measurement remains challenging. The Consumer Emergency Care Satisfaction Scale (CECSS) was developed to measure patient satisfaction in the emergency department (ED). Although this is a valid and reliable tool, several aspects of the CECSS need to be improved, including the definition, dimension, and scoring of scales. PURPOSE: The purpose of this study was to examine the construct validity of the CECSS and make suggestions on how to improve the tool to measure overall satisfaction with ED care. METHODS: We administered 2 surveys to older adults who presented with a fall to the ED and used electronic health record data to examine construct validity of the CECSS and ceiling effects. RESULTS: Using several criteria, we improved construct validity of the CECSS, reduced ceiling effects, and standardized scoring. CONCLUSION: We addressed several methodological issues with the CECSS and provided recommendations for improvement.

Usability of a Human Factors-based Clinical Decision Support in the Emergency Department: Lessons Learned for Design and Implementation.

OBJECTIVE: To evaluate the usability and use of human factors (HF)-based clinical decision support (CDS) implemented in the emergency department (ED). BACKGROUND: Clinical decision support can improve patient safety; however, the acceptance and use of CDS has faced challenges. Following a human-centered design process, we designed a CDS to support pulmonary embolism (PE) diagnosis in the ED. We demonstrated high usability of the CDS during scenario-based usability testing. We implemented the HF-based CDS in one ED in December 2018. METHOD: We conducted a survey of ED physicians to evaluate the usability and use of the HF-based CDS. We distributed the survey via Qualtrics, a web-based survey platform. We compared the computer system usability questionnaire scores of the CDS between those collected in the usability testing to use of the CDS in the real environment. We asked physicians about their acceptance and use of the CDS, barriers to using the CDS, and areas for improvement. RESULTS: Forty-seven physicians (56%) completed the survey. Physicians agreed that diagnosing PE is a major problem and risk scores can support the PE diagnostic process. Usability of the CDS was reported as high, both in the experimental setting and the real clinical setting. However, use of the CDS was low. We identified several barriers to the CDS use in the clinical environment, in particular a lack of workflow integration. CONCLUSION: Design of CDS should be a continuous process and focus on the technology's usability in the context of the broad work system and clinician workflow.

Team Cognition in Handoffs: Relating System Factors, Team Cognition Functions and Outcomes in Two Handoff Processes.

OBJECTIVE: This study investigates how team cognition occurs in care transitions from operating room (OR) to intensive care unit (ICU). We then seek to understand how the sociotechnical system and team cognition are related. BACKGROUND: Effective handoffs are critical to ensuring patient safety and have been the subject of many improvement efforts. However, the types of team-level cognitive processing during handoffs have not been explored, nor is it clear how the sociotechnical system shapes team cognition. METHOD: We conducted this study in an academic, Level 1 trauma center in the Midwestern United States. Twenty-eight physicians (surgery, anesthesia, pediatric critical care) and nurses (OR, ICU) participated in semi-structured interviews. We performed qualitative content analysis and epistemic network analysis to understand the relationships between system factors, team cognition in handoffs and outcomes. RESULTS: Participants described three team cognition functions in handoffs-(1) information exchange, (2) assessment, and (3) planning and decision making; information exchange was mentioned most. Work system factors influenced team cognition. Inter-professional handoffs facilitated information exchange but included large teams with diverse backgrounds communicating, which can be inefficient. Intra-professional handoffs decreased team size and role diversity, which may simplify communication but increase information loss. Participants in inter-professional handoffs reflected on outcomes significantly more in relation to system factors and team cognition (p < 0.001), while participants in intra-professional handoffs discussed handoffs as a task. CONCLUSION: Handoffs include team cognition, which was influenced by work system design. Opportunities for handoff improvement include a flexibly standardized process and supportive tools/technologies. We recommend incorporating perspectives of the patient and family in future work.

Older Adult Patients and Care Partners as Knowledge Brokers in Fragmented Health Care.

OBJECTIVE: To describe older adult patients' and care partners' knowledge broker roles during emergency department (ED) visits. BACKGROUND: Older adult patients are vulnerable to communication and coordination challenges during an ED visit, which can be exacerbated by the time and resource constrained ED environment. Yet, as a constant throughout the patient journey, patients and care partners can act as an information conduit, or knowledge broker, between fragmented care systems to attain high-quality, safe care. METHODS: Participants included 14 older adult patients (≥ 65 years old) and their care partners (e.g., spouse, adult child) who presented to the ED after having experienced a fall. Human factors researchers collected observation data from patients, care partners and clinician interactions during the patient's ED visit. We used an inductive content analysis to determine the role of patients and care partners as knowledge brokers. RESULTS: We found that patients and care partners act as knowledge brokers by providing information about diagnostic testing, medications, the patient's health history, and care accommodations at the disposition location. Patients and care partners filled the role of knowledge broker proactively (i.e. offer information) and reactively (i.e. are asked to provide information by clinicians or staff), within-ED work system and across work systems (e.g., between the ED and hospital), and in anticipation of future knowledge brokering. CONCLUSION: Patients and care partners, acting as knowledge brokers, often fill gaps in communication and participate in care coordination that assists in mitigating health care fragmentation.

A Systematic Review of the Consumer Emergency Care Satisfaction Scale (CECSS).

BACKGROUND: Patient experience is receiving increasing attention in the context of patient-centered care. However, there are relatively few instruments that measure patient experience that are valid and reliable. OBJECTIVE: In this study, we systematically review the literature on the Consumer Emergency Care Satisfaction Scale (CECSS) and examine its psychometric properties. METHODS: We conducted a systematic literature search in the Cumulative Index to Nursing and Allied Health Literature, PubMed, PsycINFO, and Web of Science databases on articles that contain information on the CECSS. The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULTS: Our systematic literature search resulted in 28 articles in which the CECSS was used. CONCLUSIONS: Results of our literature review show that from a psychometric perspective, the CECSS is a valid and reliable instrument. However, the results of our study also show that the CECSS has several weaknesses. We have made recommendations to improve the CECSS.

Inpatients Sign On: An Opportunity to Engage Hospitalized Patients and Caregivers Using Inpatient Portals.

BACKGROUND: Inpatient portals are online patient portals linked to electronic health records that provide hospitalized patients and caregivers secure access to real-time clinical information and tools to enhance their communication with providers and hospital experience. OBJECTIVE: The main objective of this commentary was to provide a perspective that inpatient portals are innovative tools poised to engage patients and caregivers during hospitalization and, thus, enhance patient-centered care. RESULTS: Inpatient portals are desired by patients and caregivers and may contribute to improved recognition of their inpatient care team, knowledge of their treatment plan and overall inpatient experience. A sociotechnical systems approach is recommended to mitigate potential unintended consequences of inpatient portal use and support effective portal design, implementation and evaluation. CONCLUSIONS: This article highlights the potential of using inpatient portals to engage hospitalized patients and caregivers and proposes next steps to evaluate this emerging technology.

Scope and Influence of Electronic Health Record-Integrated Clinical Decision Support in the Emergency Department: A Systematic Review.

STUDY OBJECTIVE: As electronic health records evolve, integration of computerized clinical decision support offers the promise of sorting, collecting, and presenting this information to improve patient care. We conducted a systematic review to examine the scope and influence of electronic health record-integrated clinical decision support technologies implemented in the emergency department (ED). METHODS: A literature search was conducted in 4 databases from their inception through January 18, 2018: PubMed, Scopus, the Cumulative Index of Nursing and Allied Health, and Cochrane Central. Studies were included if they examined the effect of a decision support intervention that was implemented in a comprehensive electronic health record in the ED setting. Standardized data collection forms were developed and used to abstract study information and assess risk of bias. RESULTS: A total of 2,558 potential studies were identified after removal of duplicates. Of these, 42 met inclusion criteria. Common targets for clinical decision support intervention included medication and radiology ordering practices, as well as more comprehensive systems supporting diagnosis and treatment for specific disease entities. The majority of studies (83%) reported positive effects on outcomes studied. Most studies (76%) used a pre-post experimental design, with only 3 (7%) randomized controlled trials. CONCLUSION: Numerous studies suggest that clinical decision support interventions are effective in changing physician practice with respect to process outcomes such as guideline adherence; however, many studies are small and poorly controlled. Future studies should consider the inclusion of more specific information in regard to design choices, attempt to improve on uncontrolled before-after designs, and focus on clinically relevant outcomes wherever possible.

Role network measures to assess healthcare team adaptation to complex situations: the case of venous thromboembolism prophylaxis.

Hospitals are complex environments that rely on clinicians working together to provide appropriate care to patients. These clinical teams adapt their interactions to meet changing situational needs. Venous thromboembolism (VTE) prophylaxis is a complex process that occurs throughout a patient's hospitalisation, presenting five stages with different levels of complexity: admission, interruption, re-initiation, initiation, and transfer. The objective of our study is to understand how the VTE prophylaxis team adapts as the complexity in the process changes; we do this by using social network analysis (SNA) measures. We interviewed 45 clinicians representing 9 different cases, creating 43 role networks. The role networks were analysed using SNA measures to understand team changes between low and high complexity stages. When comparing low and high complexity stages, we found two team adaptation mechanisms: (1) relative increase in the number of people, team activities, and interactions within the team, or (2) relative increase in discussion among the team, reflected by an increase in reciprocity.   Practitioner Summary: The reason for this study was to quantify team adaptation to complexity in a process using social network analysis (SNA). The VTE prophylaxis team adapted to complexity by two different mechanisms, by increasing the roles, activities, and interactions among the team or by increasing the two-way communication and discussion throughout the team. We demonstrated the ability for SNA to identify adaptation within a team.

Interventions to prevent injuries in construction workers.

BACKGROUND: Construction workers are frequently exposed to various types of injury-inducing hazards. There are a number of injury prevention interventions, yet their effectiveness is uncertain. OBJECTIVES: To assess the effects of interventions for preventing injuries in construction workers. SEARCH METHODS: We searched the Cochrane Injuries Group's specialised register, CENTRAL (issue 3), MEDLINE, Embase and PsycINFO up to April 2017. The searches were not restricted by language or publication status. We also handsearched the reference lists of relevant papers and reviews. SELECTION CRITERIA: Randomised controlled trials, controlled before-after (CBA) studies and interrupted time-series (ITS) of all types of interventions for preventing fatal and non-fatal injuries among workers at construction sites. DATA COLLECTION AND ANALYSIS: Two review authors independently selected studies, extracted data and assessed their risk of bias. For ITS studies, we re-analysed the studies and used an initial effect, measured as the change in injury rate in the year after the intervention, as well as a sustained effect, measured as the change in time trend before and after the intervention. MAIN RESULTS: Seventeen studies (14 ITS and 3 CBA studies) met the inclusion criteria in this updated version of the review. The ITS studies evaluated the effects of: introducing or changing regulations that laid down safety and health requirements for the construction sites (nine studies), a safety campaign (two studies), a drug-free workplace programme (one study), a training programme (one study), and safety inspections (one study) on fatal and non-fatal occupational injuries. One CBA study evaluated the introduction of occupational health services such as risk assessment and health surveillance, one evaluated a training programme and one evaluated the effect of a subsidy for upgrading to safer scaffoldings. The overall risk of bias of most of the included studies was high, as it was uncertain for the ITS studies whether the intervention was independent from other changes and thus could be regarded as the main reason of change in the outcome. Therefore, we rated the quality of the evidence as very low for all comparisons.Compulsory interventionsRegulatory interventions at national or branch level may or may not have an initial effect (effect size (ES) of -0.33; 95% confidence interval (CI) -2.08 to 1.41) and may or may not have a sustained effect (ES -0.03; 95% CI -0.30 to 0.24) on fatal and non-fatal injuries (9 ITS studies) due to highly inconsistent results (I² = 98%). Inspections may or may not have an effect on non-fatal injuries (ES 0.07; 95% CI -2.83 to 2.97; 1 ITS study).Educational interventionsSafety training interventions may result in no significant reduction of non-fatal injuries (1 ITS study and 1 CBA study).Informational interventionsWe found no studies that had evaluated informational interventions alone such as campaigns for risk communication.Persuasive interventionsWe found no studies that had evaluated persuasive interventions alone such as peer feedback on workplace actions to increase acceptance of safe working methods.Facilitative interventionsMonetary subsidies to companies may lead to a greater decrease in non-fatal injuries from falls to a lower level than no subsidies (risk ratio (RR) at follow-up: 0.93; 95% CI 0.30 to 2.91 from RR 3.89 at baseline; 1 CBA study).Multifaceted interventionsA safety campaign intervention may result in an initial (ES -1.82; 95% CI -2.90 to -0.74) and sustained (ES -1.30; 95% CI -1.79 to -0.81) decrease in injuries at the company level (1 ITS study), but not at the regional level (1 ITS study). A multifaceted drug-free workplace programme at the company level may reduce non-fatal injuries in the year following implementation by -7.6 per 100 person-years (95% CI -11.2 to -4.0) and in the years thereafter by -2.0 per 100 person-years (95% CI -3.5 to -0.5) (1 ITS study). Introducing occupational health services may result in no decrease in fatal or non-fatal injuries (one CBA study). AUTHORS' CONCLUSIONS: The vast majority of interventions to adopt safety measures recommended by standard texts on safety, consultants and safety courses have not been adequately evaluated. There is very low-quality evidence that introducing regulations as such may or may not result in a decrease in fatal and non-fatal injuries. There is also very low-quality evidence that regionally oriented safety campaigns, training, inspections or the introduction of occupational health services may not reduce non-fatal injuries in construction companies. There is very low-quality evidence that company-oriented safety interventions such as a multifaceted safety campaign, a multifaceted drug workplace programme and subsidies for replacement of scaffoldings may reduce non-fatal injuries among construction workers. More studies, preferably cluster-randomised controlled trials, are needed to evaluate different strategies to increase the employers' and workers' adherence to the safety measures prescribed by regulation.

The impact of e-visits on patient access to primary care.

To improve patient access to primary care, many healthcare organizations have introduced electronic visits (e-visits) to provide patient-physician communication through secure messages. However, it remains unclear how e-visit affects physicians' operations on a daily basis and whether it would increase physicians' panel size. In this study, we consider a primary care physician who has a steady patient panel and manages patients' office and e-visits, as well as other indirect care tasks. We use queueing-based performance outcomes to evaluate the performance of care delivery. The results suggest that improved operational efficiency is achieved only when the service time of e-visits is smaller enough to compensate the effectiveness loss due to online communications. A simple approximation formula of the relationship between e-visit service time and e-visit to office visit referral ratio is provided serving as a guideline for evaluating the performance of e-visit implementation. Furthermore, based on the analysis of the impact of e-visits on physician's capacity, we conclude that it is not the more e-visits the better, and the condition for maximal panel size is investigated. Finally, the expected outcomes of implementing e-visits at Dean East Clinic are discussed.

Data collection challenges in community settings: insights from two field studies of patients with chronic disease.

PURPOSE: Collecting information about health and disease directly from patients can be fruitfully accomplished using contextual approaches, ones that combine more and less structured methods in home and community settings. This paper's purpose was to describe and illustrate a framework of the challenges of contextual data collection. METHODS: A framework is presented based on prior work in community-based participatory research and organizational science, comprised of ten types of challenges across four broader categories. Illustrations of challenges and suggestions for addressing them are drawn from two mixed method, contextual studies of patients with chronic disease in two regions of the USA. RESULTS: The first major category of challenges was concerned with the researcher-participant partnership, for example, the initial lack of mutual trust and understanding between researchers, patients, and family members. The second category concerned patient characteristics such as cognitive limitations and a busy personal schedule that created barriers to successful data collection. The third concerned research logistics and procedures such as recruitment, travel distances, and compensation. The fourth concerned scientific quality and interpretation, including issues of validity, reliability, and combining data from multiple sources. The two illustrative studies faced both common and diverse research challenges and used many different strategies to address them. CONCLUSION: Collecting less structured data from patients and others in the community is potentially very productive but requires the anticipation, avoidance, or negotiation of various challenges. Future work is necessary to better understand these challenges across different methods and settings, as well as to test and identify strategies to address them.

Perception of Physicians' Notes Among Parents of Different Health Literacy Levels.

OBJECTIVES: To explore the benefits and challenges of accessing physicians' notes during pediatric hospitalization across parents of different health literacy levels. METHODS: For this secondary analysis, we used semi-structured interviews conducted with 28 parents on their impressions of having access to their child's care team notes on a bedside table. Three researchers used thematic analysis to develop a codebook, coded interview data, and identified themes. Parent interviews and respective themes were then dichotomized into proficient or limited health literacy groups and compared. RESULTS: Nine themes were identified in this secondary analysis: 6 benefits and 3 challenges. All parents identified more benefits than challenges, including that the notes served as a recap of information and memory aid and increased autonomy, empowerment, and advocacy for their child. Both groups disliked receiving bad news in notes before face-to-face communication. Parents with proficient literacy reported that notes allowed them to check information accuracy, but that notes may not be as beneficial for parents with lower health literacy. Parents with limited literacy uniquely identified limited comprehension of medical terms but indicated that notes facilitated their understanding of their child's condition, increased their appreciation for their health care team, and decreased their anxiety, stress, and worry. CONCLUSIONS: Parents with limited health literacy uniquely reported that notes improved their understanding of their child's care and decreased (rather than increased) worry. Reducing medical terminology may be one equitable way to increase note accessibility for parents across the health literacy spectrum.

The work of adult and pediatric intensive care unit nurses.

BACKGROUND: Researchers have used various methods to describe and quantify the work of nurses. Many of these studies were focused on nursing in general care settings; therefore, less is known about the unique work nurses perform in intensive care units (ICUs). OBJECTIVES: The aim of this study was to observe adult and pediatric ICU nurses in order to quantify and compare the duration and frequency of nursing tasks across four ICUs as well as within two discrete workflows: nurse handoffs at shift change and patient interdisciplinary rounds. METHODS: A behavioral task analysis of adult and pediatric nurses was used to allow unobtrusive, real-time observation. A total of 147 hours of observation were conducted in an adult medical-surgical, a cardiac, a pediatric, and a neonatal ICU at one rural, tertiary care community teaching hospital. RESULTS: Over 75% of ICU nurses' time was spent on patient care activities. Approximately 50% of this time was spent on direct patient care, over 20% on care coordination, 28% on nonpatient care, and approximately 2% on indirect patient care activities. Variations were observed between units; for example, nurses in the two adult units spent more time using monitors and devices. A high rate and variety of tasks were also observed: Nurses performed about 125 activities per hour, averaging a switch between tasks every 29 seconds. DISCUSSION: This study provides useful information about how nurses spend their time in various ICUs. The methodology can be used in future research to examine changes in work related to, for example, implementation of health information technology.

SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients.

Healthcare practitioners, patient safety leaders, educators and researchers increasingly recognise the value of human factors/ergonomics and make use of the discipline's person-centred models of sociotechnical systems. This paper first reviews one of the most widely used healthcare human factors systems models, the Systems Engineering Initiative for Patient Safety (SEIPS) model, and then introduces an extended model, 'SEIPS 2.0'. SEIPS 2.0 incorporates three novel concepts into the original model: configuration, engagement and adaptation. The concept of configuration highlights the dynamic, hierarchical and interactive properties of sociotechnical systems, making it possible to depict how health-related performance is shaped at 'a moment in time'. Engagement conveys that various individuals and teams can perform health-related activities separately and collaboratively. Engaged individuals often include patients, family caregivers and other non-professionals. Adaptation is introduced as a feedback mechanism that explains how dynamic systems evolve in planned and unplanned ways. Key implications and future directions for human factors research in healthcare are discussed.

Post-implementation usability evaluation of a human factors-based clinical decision support for pulmonary embolism (PE) diagnosis (Dx): PE Dx Study Part 1.

While there is promise for health IT, such as Clinical Decision Support (CDS), to improve patient safety and clinician efficiency, poor usability has hindered widespread use of these tools. Human Factors (HF) principles and methods remain the gold standard for health IT design; however, there is limited information on how HF methods and principles influence CDS usability "in the wild". In this study, we explore the usability of an HF-based CDS used in the clinical environment; the CDS was designed according to a human-centered design process, which is described in Carayon et al. (2020). In this study, we interviewed 12 emergency medicine physicians, identifying 294 excerpts of barriers and facilitators of the CDS. Sixty-eight percent of excerpts related to the HF principles applied in the human-centered design of the CDS. The remaining 32% of excerpts related to 18 inductively-created categories, which highlight gaps in the CDS design process. Several barriers were related to the physical environment and organization work system elements as well as physicians' broader workflow in the emergency department (e.g., teamwork). This study expands our understanding of the usability outcomes of HF-based CDS "in the wild". We demonstrate the value of HF principles in the usability of CDS and identify areas for improvement to future human-centered design of CDS. The relationship between these usability outcomes and the HCD process is explored in an accompanying Part 2 manuscript.

Retrospective analysis of the human-centered design process used to develop a clinical decision support in the emergency department: PE Dx Study Part 2.

With the growing implementation and use of health IT such as Clinical Decision Support (CDS), there is increasing attention on the potential negative impact of these technologies on patients (e.g., medication errors) and clinicians (e.g., increased workload, decreased job satisfaction, burnout). Human-Centered Design (HCD) and Human Factors (HF) principles are recommended to improve the usability of health IT and reduce its negative impact on patients and clinicians; however, challenges persist. The objective of this study is to understand how an HCD process influences the usability of health IT. We conducted a systematic retrospective analysis of the HCD process used in the design of a CDS for pulmonary embolism diagnosis in the emergency department (ED). Guided by the usability outcomes (e.g., barriers and facilitators) of the CDS use "in the wild" (see Part 1 of this research in the accompanying manuscript), we performed deductive content analysis of 17 documents (e.g., design session transcripts) produced during the HCD process. We describe if and how the design team considered the barriers and facilitators during the HCD process. We identified 7 design outcomes of the HCD process, for instance designing a workaround and making a design change to the CDS. We identify gaps in the current HCD process and demonstrate the need for a continuous health IT design process.

Managing multiple perspectives in the collaborative design process of a team health information technology.

We need to design technologies that support the work of health care teams; designing such solutions should integrate different clinical roles. However, we know little about the actual collaboration that occurs in the design process for a team-based care solution. This study examines how multiple perspectives were managed in the design of a team health IT solution aimed at supporting clinician information needs during pediatric trauma care transitions. We focused our analysis on four co-design sessions that involved multiple clinicians caring for pediatric trauma patients. We analyzed design session transcripts using content analysis and process coding guided by Détienne's (2006) co-design framework. We expanded upon Détienne (2006) three collaborative activities to identify specific themes and processes of collaboration between care team members engaged in the design process. The themes and processes describe how team members collaborated in a team health IT design process that resulted in a highly usable technology.

Work system barriers and facilitators of a team health information technology.

Designing health IT aimed at supporting team-based care and improving patient safety is difficult. This requires a work system (i.e., SEIPS) evaluation of the technology by care team members. This study aimed to identify work system barriers and facilitators to the use of a team health IT that supports care transitions for pediatric trauma patients. We conducted an analysis on 36 interviews - representing 12 roles - collected from a scenario-based evaluation of T3. We identified eight dimensions with both barriers and facilitators in all five work system elements: person (experience), task (task performance, workload/efficiency), technology (usability, specific features of T3), environment (space, location), and organization (communication/coordination). Designing technology that meets every role's needs is challenging; in particular, when trade-offs need to be managed, e.g., additional workload for one role or divergent perspectives regarding specific features. Our results confirm the usefulness of a continuous work system approach to technology design and implementation.

Parent Perspectives on Sharing Pediatric Hospitalization Clinical Notes.

BACKGROUND AND OBJECTIVES: Federal guidelines mandate that hospitals provide patients and caregivers with free, online access to their physician's clinical notes. This study sought to identify parent perceptions of the benefits and challenges of real-time note access during their child's hospitalization and strategies to optimize note-sharing at the bedside. METHODS: This qualitative study was conducted with parents of children aged <12 years admitted to a pediatric hospitalist service in April 2019. Parents were given access to their child's admission and daily progress notes on a bedside tablet (iPad), and interviewed upon discharge. In-depth, 60-minute interviews were audio-recorded and transcribed. Two researchers developed and refined a codebook and coded data inductively and deductively with validation by a third researcher. Thematic analysis was used to identify emergent themes. RESULTS: The 28 interviewed parents described 6 benefits of having note access, which: provided a recap and improved their knowledge about their child's care plan, enhanced communication, facilitated empowerment, increased autonomy, and incited positive emotions. Potential challenges included that notes: caused confusion, hindered communication with the health care team, highlighted problems with note content, and could incite negative emotions. Parents recommended 4 strategies to support sharing: provide preemptive communication about expectations, optimize the note release process, consider parent-friendly note template modifications, and offer informational resources for parents. CONCLUSIONS: Findings provide a framework for operationalizing note-sharing with parents during hospitalization. These results have important implications for hospitals working to comply with federal regulations and researchers assessing the effects of increased information transparency in the inpatient setting.

Evaluating the Usability of an Emergency Department After Visit Summary: Staged Heuristic Evaluation.

BACKGROUND: Heuristic evaluations, while commonly used, may inadequately capture the severity of identified usability issues. In the domain of health care, usability issues can pose different levels of risk to patients. Incorporating diverse expertise (eg, clinical and patient) in the heuristic evaluation process can help assess and address potential negative impacts on patient safety that may otherwise go unnoticed. One document that should be highly usable for patients-with the potential to prevent adverse outcomes-is the after visit summary (AVS). The AVS is the document given to a patient upon discharge from the emergency department (ED), which contains instructions on how to manage symptoms, medications, and follow-up care. OBJECTIVE: This study aims to assess a multistage method for integrating diverse expertise (ie, clinical, an older adult care partner, and health IT) with human factors engineering (HFE) expertise in the usability evaluation of the patient-facing ED AVS. METHODS: We conducted a three-staged heuristic evaluation of an ED AVS using heuristics developed for use in evaluating patient-facing documentation. In stage 1, HFE experts reviewed the AVS to identify usability issues. In stage 2, 6 experts of varying expertise (ie, emergency medicine physicians, ED nurses, geriatricians, transitional care nurses, and an older adult care partner) rated each previously identified usability issue on its potential impact on patient comprehension and patient safety. Finally, in stage 3, an IT expert reviewed each usability issue to identify the likelihood of successfully addressing the issue. RESULTS: In stage 1, we identified 60 usability issues that violated a total of 108 heuristics. In stage 2, 18 additional usability issues that violated 27 heuristics were identified by the study experts. Impact ratings ranged from all experts rating the issue as "no impact" to 5 out of 6 experts rating the issue as having a "large negative impact." On average, the older adult care partner representative rated usability issues as being more significant more of the time. In stage 3, 31 usability issues were rated by an IT professional as "impossible to address," 21 as "maybe," and 24 as "can be addressed." CONCLUSIONS: Integrating diverse expertise when evaluating usability is important when patient safety is at stake. The non-HFE experts, included in stage 2 of our evaluation, identified 23% (18/78) of all the usability issues and, depending on their expertise, rated those issues as having differing impacts on patient comprehension and safety. Our findings suggest that, to conduct a comprehensive heuristic evaluation, expertise from all the contexts in which the AVS is used must be considered. Combining those findings with ratings from an IT expert, usability issues can be strategically addressed through redesign. Thus, a 3-staged heuristic evaluation method offers a framework for integrating context-specific expertise efficiently, while providing practical insights to guide human-centered design.