Perception of Physicians' Notes Among Parents of Different Health Literacy Levels.

OBJECTIVES: To explore the benefits and challenges of accessing physicians' notes during pediatric hospitalization across parents of different health literacy levels. METHODS: For this secondary analysis, we used semi-structured interviews conducted with 28 parents on their impressions of having access to their child's care team notes on a bedside table. Three researchers used thematic analysis to develop a codebook, coded interview data, and identified themes. Parent interviews and respective themes were then dichotomized into proficient or limited health literacy groups and compared. RESULTS: Nine themes were identified in this secondary analysis: 6 benefits and 3 challenges. All parents identified more benefits than challenges, including that the notes served as a recap of information and memory aid and increased autonomy, empowerment, and advocacy for their child. Both groups disliked receiving bad news in notes before face-to-face communication. Parents with proficient literacy reported that notes allowed them to check information accuracy, but that notes may not be as beneficial for parents with lower health literacy. Parents with limited literacy uniquely identified limited comprehension of medical terms but indicated that notes facilitated their understanding of their child's condition, increased their appreciation for their health care team, and decreased their anxiety, stress, and worry. CONCLUSIONS: Parents with limited health literacy uniquely reported that notes improved their understanding of their child's care and decreased (rather than increased) worry. Reducing medical terminology may be one equitable way to increase note accessibility for parents across the health literacy spectrum.

Work system barriers and facilitators of a team health information technology.

Designing health IT aimed at supporting team-based care and improving patient safety is difficult. This requires a work system (i.e., SEIPS) evaluation of the technology by care team members. This study aimed to identify work system barriers and facilitators to the use of a team health IT that supports care transitions for pediatric trauma patients. We conducted an analysis on 36 interviews - representing 12 roles - collected from a scenario-based evaluation of T3. We identified eight dimensions with both barriers and facilitators in all five work system elements: person (experience), task (task performance, workload/efficiency), technology (usability, specific features of T3), environment (space, location), and organization (communication/coordination). Designing technology that meets every role's needs is challenging; in particular, when trade-offs need to be managed, e.g., additional workload for one role or divergent perspectives regarding specific features. Our results confirm the usefulness of a continuous work system approach to technology design and implementation.

Satisfaction of Older Patients With Emergency Department Care: Psychometric Properties and Construct Validity of the Consumer Emergency Care Satisfaction Scale.

BACKGROUND: Patient satisfaction is an important indicator of quality of care, but its measurement remains challenging. The Consumer Emergency Care Satisfaction Scale (CECSS) was developed to measure patient satisfaction in the emergency department (ED). Although this is a valid and reliable tool, several aspects of the CECSS need to be improved, including the definition, dimension, and scoring of scales. PURPOSE: The purpose of this study was to examine the construct validity of the CECSS and make suggestions on how to improve the tool to measure overall satisfaction with ED care. METHODS: We administered 2 surveys to older adults who presented with a fall to the ED and used electronic health record data to examine construct validity of the CECSS and ceiling effects. RESULTS: Using several criteria, we improved construct validity of the CECSS, reduced ceiling effects, and standardized scoring. CONCLUSION: We addressed several methodological issues with the CECSS and provided recommendations for improvement.

Parent Perspectives on Sharing Pediatric Hospitalization Clinical Notes.

BACKGROUND AND OBJECTIVES: Federal guidelines mandate that hospitals provide patients and caregivers with free, online access to their physician's clinical notes. This study sought to identify parent perceptions of the benefits and challenges of real-time note access during their child's hospitalization and strategies to optimize note-sharing at the bedside. METHODS: This qualitative study was conducted with parents of children aged <12 years admitted to a pediatric hospitalist service in April 2019. Parents were given access to their child's admission and daily progress notes on a bedside tablet (iPad), and interviewed upon discharge. In-depth, 60-minute interviews were audio-recorded and transcribed. Two researchers developed and refined a codebook and coded data inductively and deductively with validation by a third researcher. Thematic analysis was used to identify emergent themes. RESULTS: The 28 interviewed parents described 6 benefits of having note access, which: provided a recap and improved their knowledge about their child's care plan, enhanced communication, facilitated empowerment, increased autonomy, and incited positive emotions. Potential challenges included that notes: caused confusion, hindered communication with the health care team, highlighted problems with note content, and could incite negative emotions. Parents recommended 4 strategies to support sharing: provide preemptive communication about expectations, optimize the note release process, consider parent-friendly note template modifications, and offer informational resources for parents. CONCLUSIONS: Findings provide a framework for operationalizing note-sharing with parents during hospitalization. These results have important implications for hospitals working to comply with federal regulations and researchers assessing the effects of increased information transparency in the inpatient setting.

Managing multiple perspectives in the collaborative design process of a team health information technology.

We need to design technologies that support the work of health care teams; designing such solutions should integrate different clinical roles. However, we know little about the actual collaboration that occurs in the design process for a team-based care solution. This study examines how multiple perspectives were managed in the design of a team health IT solution aimed at supporting clinician information needs during pediatric trauma care transitions. We focused our analysis on four co-design sessions that involved multiple clinicians caring for pediatric trauma patients. We analyzed design session transcripts using content analysis and process coding guided by Détienne's (2006) co-design framework. We expanded upon Détienne (2006) three collaborative activities to identify specific themes and processes of collaboration between care team members engaged in the design process. The themes and processes describe how team members collaborated in a team health IT design process that resulted in a highly usable technology.

Retrospective analysis of the human-centered design process used to develop a clinical decision support in the emergency department: PE Dx Study Part 2.

With the growing implementation and use of health IT such as Clinical Decision Support (CDS), there is increasing attention on the potential negative impact of these technologies on patients (e.g., medication errors) and clinicians (e.g., increased workload, decreased job satisfaction, burnout). Human-Centered Design (HCD) and Human Factors (HF) principles are recommended to improve the usability of health IT and reduce its negative impact on patients and clinicians; however, challenges persist. The objective of this study is to understand how an HCD process influences the usability of health IT. We conducted a systematic retrospective analysis of the HCD process used in the design of a CDS for pulmonary embolism diagnosis in the emergency department (ED). Guided by the usability outcomes (e.g., barriers and facilitators) of the CDS use "in the wild" (see Part 1 of this research in the accompanying manuscript), we performed deductive content analysis of 17 documents (e.g., design session transcripts) produced during the HCD process. We describe if and how the design team considered the barriers and facilitators during the HCD process. We identified 7 design outcomes of the HCD process, for instance designing a workaround and making a design change to the CDS. We identify gaps in the current HCD process and demonstrate the need for a continuous health IT design process.

Post-implementation usability evaluation of a human factors-based clinical decision support for pulmonary embolism (PE) diagnosis (Dx): PE Dx Study Part 1.

While there is promise for health IT, such as Clinical Decision Support (CDS), to improve patient safety and clinician efficiency, poor usability has hindered widespread use of these tools. Human Factors (HF) principles and methods remain the gold standard for health IT design; however, there is limited information on how HF methods and principles influence CDS usability "in the wild". In this study, we explore the usability of an HF-based CDS used in the clinical environment; the CDS was designed according to a human-centered design process, which is described in Carayon et al. (2020). In this study, we interviewed 12 emergency medicine physicians, identifying 294 excerpts of barriers and facilitators of the CDS. Sixty-eight percent of excerpts related to the HF principles applied in the human-centered design of the CDS. The remaining 32% of excerpts related to 18 inductively-created categories, which highlight gaps in the CDS design process. Several barriers were related to the physical environment and organization work system elements as well as physicians' broader workflow in the emergency department (e.g., teamwork). This study expands our understanding of the usability outcomes of HF-based CDS "in the wild". We demonstrate the value of HF principles in the usability of CDS and identify areas for improvement to future human-centered design of CDS. The relationship between these usability outcomes and the HCD process is explored in an accompanying Part 2 manuscript.

A Systematic Review of the Consumer Emergency Care Satisfaction Scale (CECSS).

BACKGROUND: Patient experience is receiving increasing attention in the context of patient-centered care. However, there are relatively few instruments that measure patient experience that are valid and reliable. OBJECTIVE: In this study, we systematically review the literature on the Consumer Emergency Care Satisfaction Scale (CECSS) and examine its psychometric properties. METHODS: We conducted a systematic literature search in the Cumulative Index to Nursing and Allied Health Literature, PubMed, PsycINFO, and Web of Science databases on articles that contain information on the CECSS. The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULTS: Our systematic literature search resulted in 28 articles in which the CECSS was used. CONCLUSIONS: Results of our literature review show that from a psychometric perspective, the CECSS is a valid and reliable instrument. However, the results of our study also show that the CECSS has several weaknesses. We have made recommendations to improve the CECSS.

Older Adult Patients and Care Partners as Knowledge Brokers in Fragmented Health Care.

OBJECTIVE: To describe older adult patients' and care partners' knowledge broker roles during emergency department (ED) visits. BACKGROUND: Older adult patients are vulnerable to communication and coordination challenges during an ED visit, which can be exacerbated by the time and resource constrained ED environment. Yet, as a constant throughout the patient journey, patients and care partners can act as an information conduit, or knowledge broker, between fragmented care systems to attain high-quality, safe care. METHODS: Participants included 14 older adult patients (≥ 65 years old) and their care partners (e.g., spouse, adult child) who presented to the ED after having experienced a fall. Human factors researchers collected observation data from patients, care partners and clinician interactions during the patient's ED visit. We used an inductive content analysis to determine the role of patients and care partners as knowledge brokers. RESULTS: We found that patients and care partners act as knowledge brokers by providing information about diagnostic testing, medications, the patient's health history, and care accommodations at the disposition location. Patients and care partners filled the role of knowledge broker proactively (i.e. offer information) and reactively (i.e. are asked to provide information by clinicians or staff), within-ED work system and across work systems (e.g., between the ED and hospital), and in anticipation of future knowledge brokering. CONCLUSION: Patients and care partners, acting as knowledge brokers, often fill gaps in communication and participate in care coordination that assists in mitigating health care fragmentation.

Human-centered design of team health IT for pediatric trauma care transitions.

BACKGROUND: As problems of acceptance, usability and workflow integration continue to emerge with health information technologies (IT), it is critical to incorporate human factors and ergonomics (HFE) methods and design principles. Human-centered design (HCD) provides an approach to integrate HFE and produce usable technologies. However, HCD has been rarely used for designing team health IT, even though team-based care is expanding. OBJECTIVE: To describe the HCD process used to develop a usable team health IT (T3 or Teamwork Transition Technology) that provides cognitive support to pediatric trauma care teams during transitions from the emergency department to the operating room and the pediatric intensive care unit. METHODS: The HCD process included seven steps in three phases of analysis, design activities and feedback. RESULTS: The HCD process involved multiple perspectives and clinical roles that were engaged in inter-related activities, leading to design requirements, i.e., goals for the technology, a set of 47 information elements, and a list of HFE design principles applied to T3. Results of the evaluation showed a high usability score for T3. CONCLUSIONS: HFE can be integrated in the HCD process through a range of methods and design principles. That design process can produce a usable technology that provides cognitive support to a large diverse team involved in pediatric trauma care transitions. Future research should continue to focus on HFE-based design of team health IT.

Scenario-Based Evaluation of Team Health Information Technology to Support Pediatric Trauma Care Transitions.

BACKGROUND: Clinicians need health information technology (IT) that better supports their work. Currently, most health IT is designed to support individuals; however, more and more often, clinicians work in cross-functional teams. Trauma is one of the leading preventable causes of children's death. Trauma care by its very nature is team based but due to the emergent nature of trauma, critical clinical information is often missed in the transition of these patients from one service or unit to another. Teamwork transition technology can help support these transitions and minimize information loss while enhancing information gathering and storage. In this study, we created a large screen technology to support shared situational awareness across multiple clinical roles and departments. OBJECTIVES: This study aimed to examine if the Teamwork Transition Technology (T3) supports teams and team cognition. METHODS: We used a scenario-based mock-up methodology with 36 clinicians and staff from the different units and departments who are involved in pediatric trauma to examine T3. RESULTS: Results of the evaluation show that most participants agreed that the technology helps achieve the goals set out in the design phase. Respondents thought that T3 organizes and presents information in a different way that was helpful to them. CONCLUSION: In this study, we examined a health IT (T3) that was designed to support teams and team cognition. The results of our evaluation show that participants agreed that T3 does support them in their work and increases their situation awareness.

Usability barriers and facilitators of a human factors engineering-based clinical decision support technology for diagnosing pulmonary embolism.

BACKGROUND: Health IT, such as clinical decision support (CDS), has the potential to improve patient safety. However, poor usability of health IT continues to be a major concern. Human factors engineering (HFE) approaches are recommended to improve the usability of health IT. Limited evidence exists on the actual impact of HFE methods and principles on the usability of health IT. OBJECTIVE: To identify and describe the usability barriers and facilitators of an HFE-based CDS prior to implementation in the emergency department (ED). METHODS: We conducted debrief interviews with 32 emergency medicine physicians as a part of a scenario-based simulation study evaluating the usability of the HFE-based CDS. We performed a deductive content analysis of the interviews using the usability criteria of Scapin and Bastien as a framework. RESULTS: We identified 271 occurrences of usability barriers (94) and facilitators (177) of the HFE-based CDS. For instance, we found a facilitator relating to the usability criteria prompting as the PE Dx helps the physician order diagnostic tests following the risk assessment. We found the most facilitators relating to the criteria, minimal actions, e.g. as the PE Dx automatically populates vitals signs (e.g., heart rate) from the chart into the CDS. The majority of the usability barriers related to the usability criteria, compatibility (i.e., workflow integration), which was not explicitly considered in the HFE design of the CDS. For example, the CDS did not support resident and attending physician teamwork in the PE diagnostic process. CONCLUSION: The systematic use of HFE principles in the design of CDS improves the usability of these technologies. In order to further reduce usability barriers, workflow integration should be explicitly considered in the design of health IT.

Workflow integration analysis of a human factors-based clinical decision support in the emergency department.

Numerous challenges with the implementation, acceptance, and use of health IT are related to poor usability and a lack of integration of the technologies into clinical workflow, and have, therefore, limited the potential of these technologies to improve patient safety. We propose a definition and conceptual model of health IT workflow integration. Using interviews of 12 emergency department (ED) physicians, we identify 134 excerpts of barriers and facilitators to workflow integration of a human factors (HF)-based clinical decision support (CDS) implemented in the ED. Using data on these 134 barriers and facilitators, we distinguish 25 components of workflow integration of the CDS, which are described according to four dimensions of workflow integration: time, flow, scope of patient journey, and level. The proposed definition and conceptual model of workflow integration can be used to inform health IT design; this is the purpose of the proposed checklist that can help to ensure consideration of workflow integration during the development of health IT.

BedsideNotes: Sharing Physicians' Notes With Parents During Hospitalization.

OBJECTIVES: Physicians increasingly share ambulatory visit notes with patients to meet new federal requirements, and evidence suggests patient experiences improve without overburdening physicians. Whether sharing inpatient notes with parents of hospitalized children yields similar outcomes is unknown. In this pilot study, we evaluated parent and physician perceptions of sharing notes with parents during hospitalization. METHODS: Parents of children aged <12 years admitted to a hospitalist service at a tertiary children's hospital in April 2019 were offered real-time access to their child's admission and daily progress notes on a bedside inpatient portal (MyChart Bedside). Upon discharge, ambulatory OpenNotes survey items assessed parent and physician (attendings and interns) perceptions of note sharing. RESULTS: In all, 25 parents and their children's discharging attending and intern physicians participated. Parents agreed that the information in notes was useful and helped them remember their child's care plan (100%), prepare for rounds (96%), and feel in control (91%). Although many physicians (34%) expressed concern that notes would confuse parents, no parent reported that notes were confusing. Some physicians perceived that they spent more time writing and/or editing notes (28%) or that their job was more difficult (15%). Satisfaction with sharing was highest among parents (100%), followed by attendings (81%) and interns (35%). CONCLUSIONS: Parents all valued having access to physicians' notes during their child's hospital stay; however, some physicians remained concerned about the potential negative consequences of sharing. Comparative effectiveness studies are needed to evaluate the effect of note sharing on outcomes for hospitalized children, families, and staff.

Stakeholder Perspectives in Anticipation of Sharing Physicians' Notes With Parents of Hospitalized Children.

OBJECTIVE: Elicit stakeholder perspectives on the anticipated benefits and challenges of sharing hospital physicians' admission and daily progress notes with parents at the bedside during their child's hospitalization and identify strategies to aid implementation of inpatient note sharing. METHODS: Five semistructured focus groups were conducted with 34 stakeholders (8 parents, 8 nurses, 5 residents, 7 hospitalists, 6 administrators) at a tertiary children's hospital from October to November 2018 to identify anticipated benefits, challenges, and implementation strategies prior to sharing inpatient physicians' notes. A facilitator guide elicited participants' perspectives about the idea of sharing notes with parents during their child's hospitalization. Three researchers used content analysis to analyze qualitative data inductively. RESULTS: Anticipated benefits of sharing inpatient notes included: Reinforcement of information, improved parental knowledge and empowerment, enhanced parent communication and partnership with providers, and increased provider accountability and documentation quality. Expected challenges included: Increased provider workload, heightened parental confusion, distress or anxiety, impaired parent relationship with providers, and compromised note quality and purpose. Suggested implementation strategies included: Setting staff and parent expectations upfront, providing tools to support parent education, and limiting shared note content and family eligibility. CONCLUSIONS: Stakeholders anticipated multiple benefits and drawbacks of sharing notes with parents during their child's hospital stay and made practical suggestions for ways to implement inpatient note sharing to promote these benefits and mitigate challenges. Findings will inform the design and implementation of an intervention to share notes using an inpatient portal and evaluation of its effect on child, parent, and healthcare team outcomes.

Provider Experiences With Offering Families Bedside Health Record Access Across a Children's Hospital.

OBJECTIVES: Evaluate provider experiences with a bedside tablet inpatient portal application given to hospitalized patients and families across a children's hospital. METHODS: In this cross-sectional study, English-speaking parents of children <12 years old and adolescents ≥12 years admitted between February and June 2017 to a 111-bed tertiary children's hospital were given an inpatient portal application (MyChart Bedside; Epic Systems Corporation, Verona, WI) on a tablet (iPad) to use during their stay. The portal included real-time vital signs, test results, medication and problem lists, a daily schedule, educational materials, and provider names and photographs. Portal use was described from electronic health record data, and provider (physician, nurse, and pharmacist) experiences were assessed from surveys. RESULTS: Of 1892 admissions given a tablet over 5 months, 1502 (79.4%) logged in to view their inpatient health record at least once during their hospital stay. No tablets were lost or stolen. Of 101 providers, 96 completed the survey (a response rate of 95%). They reported that patients and/or parents asked them questions about information they found, including laboratory results (45% of respondents), medications (13%), diagnoses (13%), and errors and/or mistakes in care (3%). Few perceived spending more time answering questions related to portal use (8%) or that it increased their workload (11%). In all, 92% of providers wanted patients and parents to continue to be able to use the portal. CONCLUSIONS: Almost 80% of hospitalized patients and parents given a tablet accessed real-time information from the inpatient health record. The portal facilitated communication about test results, diagnoses, and medications and providers overwhelmingly supported its ongoing use.

Nurses' Expectations of an Inpatient Portal for Hospitalized Patients and Caregivers.

BACKGROUND: Patient portals are intended to engage patients and enhance patient-centered care. Recent studies suggest that the information within portals could provide benefits to patients and their caregivers during hospitalization; however, few studies have examined nurse and staff expectations of portals when used in the hospital setting. OBJECTIVE: This article examines inpatient nurse and support staff expectations of a commercially available inpatient portal prior to its hospital-wide implementation. METHODS: In this cross-sectional study, nurses and support staff were surveyed 1 month prior to the implementation of an inpatient portal for patients. Items included respondent characteristics, satisfaction with online inpatient portal training, expectations of the effects of portal use on patients, caregivers, and staff, overall acceptance, and barriers to its implementation. RESULTS: Of 881 respondents, 73.0% were staff nurses, 18.4% nurse assistants, 4.3% unit coordinators, and 1.2% nurse managers. Respondents were generally satisfied with the portal information they received from online training. A majority liked the portal to some extent prior to its use (66.7%); however, they noted multiple implementation barriers, including: tablets would get lost/damaged (66.2% of respondents), patients and/or caregivers would have too many questions (48.5%), and staff would have problems integrating it into their workflow (44.7%). Respondents working on medical units had higher expectations (p < 0.001) and acceptance (p < 0.01) of the portal than those on surgical and intensive care units. Nurse managers were more positive than respondents with other job roles were (all p < 0.001). CONCLUSION: Overall, nurse and support staff had high expectations of the effects of inpatient portal use prior to its hospital-wide implementation. They thought it would benefit patients and/or their caregivers; however, they also perceived several barriers to its implementation. These results will be used in conjunction with patient and caregiver perspectives to inform future efforts to evaluate and improve upon inpatient portal implementation and dissemination across health systems.

The Design of PE Dx, a CDS to Support Pulmonary Embolism Diagnosis in the ED.

Designing and implementing clinical decision support (CDS) in health care has been challenging. Attempts have been made to design and implement CDS to support clinical procedures, but many of these CDSs have met user resistance. One possible explanation for the lack of acceptability can be the poor design of the CDS. In this study, we describe the design of PE Dx, a CDS built to support the diagnosis of pulmonary embolism (PE) in the emergency department (ED) using human factors methods.

Parent Perceptions of Real-time Access to Their Hospitalized Child's Medical Records Using an Inpatient Portal: A Qualitative Study.

BACKGROUND AND OBJECTIVES: Engaging with parents in care improves pediatric care quality and patient safety; however, parents of hospitalized children often lack the information necessary to effectively participate. To enhance engagement, some hospitals now provide parents with real-time online access to information from their child's inpatient medical record during hospitalization. Whether these "inpatient portals" provide benefits for parents of hospitalized children is unknown. Our objectives were to identify why parents used an inpatient portal application on a tablet computer during their child's hospitalization and identify their perspectives of ways to optimize the technology. METHODS: Semistructured in-person interviews were conducted with 14 parents who were given a tablet computer with a commercially available inpatient portal application for use throughout their child's hospitalization. The portal included vital signs, diagnoses, medications, laboratory test results, patients' schedule, messaging, education, and provider pictures and/or roles. Interviews were audio recorded and transcribed and continued until reaching thematic saturation. Three researchers used an inductive approach to identify emergent themes regarding why parents used the portal. RESULTS: Five themes emerged regarding parent motivations for accessing information within the portal: (1) monitoring progress, (2) feeling empowered and/or relying less on staff, (3) facilitating rounding communication and/or decision-making, (4) ensuring information accuracy and/or providing reassurance, and (5) aiding memory. Parents recommended that the hospital continue to offer the portal and expand it to allow parents to answer admission questions, provide feedback, and access doctors' daily notes. CONCLUSIONS: Providing parents with real-time clinical information during their child's hospitalization using an inpatient portal may enhance their ability to engage in caregiving tasks critical to ensuring inpatient care quality and safety.

Physician Perceptions of the Electronic Problem List in Pediatric Trauma Care.

OBJECTIVE: To describe physician perceptions of the potential goals, characteristics, and content of the electronic problem list (PL) in pediatric trauma. METHODS: We conducted 12 semistructured interviews with physicians involved in the pediatric trauma care process, including residents, fellows, and attendings from four services: emergency medicine, surgery, anesthesia, and pediatric critical care. Using qualitative content analysis, we identified PL goals, characteristics, and patient-related information from these interviews and the hospital's PL etiquette document of guideline. RESULTS: We identified five goals of the PL (to document the patient's problems, to make sense of the patient's problems, to make decisions about the care plan, to know who is involved in the patient's care, and to communicate with others), seven characteristics of the PL (completeness, efficiency, accessibility, multiple users, organized, created before arrival, and representing uncertainty), and 22 patient-related information elements (e.g., injuries, vitals). Physicians' suggested criteria for a PL varied across services with respect to goals, characteristics, and patient-related information. CONCLUSION: Physicians involved in pediatric trauma care described the electronic PL as ideally more than a list of a patient's medical diagnoses and injuries. The information elements mentioned are typically found in other parts of the patient's electronic record besides the PL, such as past medical history and labs. Future work is needed to evaluate the optimal design of the PL so that users with emergent cases, such as pediatric trauma, have access to key information related to the patient's immediate problems.