Survey of Potential Disparity Issues Among Minority Stroke Survivors in Central Brooklyn.

Medical data and information are ubiquitous due to internet availability. However, most people persist in using and trusting their healthcare professionals for health information. They are increasingly flooded with health information from diverse sources such as the internet, community-based organizations, and family or friends. It is crucial to understand where stroke patients vary in the use and trust of health information to improve their conditions. This pilot study aimed to better understand the nature of the problems confronted by stroke patients, such as the source of reliable health information, trust in the healthcare system, and technology trend awareness. African American and Afro-Caribbean stroke patients (n=64) residing in Central Brooklyn, New York, participated in a survey. The results showed that physicians remained the most highly trusted information sources for stroke patients, particularly among patients with higher education, irrespective of the available communication sources.

Navigating Infection Control Processes in a COVID-19 Only Safety-Net Hospital at the Height of the Pandemic.

Hospitals faced extraordinary challenges during the pandemic. Some of these were directly related to patient care-expanding capacities, adjusting services, and using new knowledge to save lives in a dynamically changing situation. Other challenges were regulatory. The COVID-19 pandemic significantly disrupted routine hospital infection control practices. We report the results of an interview study with 13 individuals associated with infection control in a small independent hospital. We employed the Systems Engineering Initiative for Patient Safety (SEIPS) model as a theoretical framework and as a basis to analyze data. The findings revealed how routine practices and protocols were displaced in notable ways. Due to COVID-19, clinical activities were modified, and the increased demands of regulatory reporting became laborious, and punitive if reports were late. Strategies are needed to mitigate increases in healthcare-associated infections. Our examination of the information flows, transformation, and needs shows areas in which digital tool creation and the use of a trained informatics workforce could ameliorate and automate many processes.

Cognitive and Cultural Factors That Affect General Vaccination and COVID-19 Vaccination Attitudes.

The development of COVID-19 vaccines is a major scientific accomplishment that has armed communities worldwide with powerful epidemic control tools. Yet, COVID-19 vaccination efforts in the US have been marred by persistent vaccine hesitancy. We used survey methodology to explore the impact of different cognitive and cultural factors on the public's general vaccination attitudes, attitudes towards COVID-19 vaccines, and COVID-19 vaccination status. The factors include information literacy, science literacy, attitudes towards science, interpersonal trust, public health trust, political ideology, and religiosity. The analysis suggests that attitudes towards vaccination are influenced by a multitude of factors that operate in a complex manner. General vaccination attitude was most affected by attitudes towards science and public health trust and to a lesser degree by information literacy, science literacy, and religiosity. Attitudes towards COVID-19 vaccines were most affected by public health trust and to a lesser extent by general trust, ideology and attitudes towards science. Vaccination status was most influenced by public health trust. Possible mediating effects of correlated variables in the model need to be further explored. The study underscores the importance of understanding the relationship between public health trust, literacies, and sociocultural factors.

Factors Influencing Willingness to Share Health Misinformation Videos on the Internet: Web-Based Survey.

BACKGROUND: The rapidly evolving digital environment of the social media era has increased the reach of both quality health information and misinformation. Platforms such as YouTube enable easy sharing of attractive, if not always evidence-based, videos with large personal networks and the public. Although much research has focused on characterizing health misinformation on the internet, it has not sufficiently focused on describing and measuring individuals' information competencies that build resilience. OBJECTIVE: This study aims to assess individuals' willingness to share a non-evidence-based YouTube video about strengthening the immune system; to describe types of evidence that individuals view as supportive of the claim by the video; and to relate information-sharing behavior to several information competencies, namely, information literacy, science literacy, knowledge of the immune system, interpersonal trust, and trust in health authority. METHODS: A web-based survey methodology with 150 individuals across the United States was used. Participants were asked to watch a YouTube excerpt from a morning TV show featuring a wellness pharmacy representative promoting an immunity-boosting dietary supplement produced by his company; answer questions about the video and report whether they would share it with a cousin who was frequently sick; and complete instruments pertaining to the information competencies outlined in the objectives. RESULTS: Most participants (105/150, 70%) said that they would share the video with their cousins. Their confidence in the supplement would be further boosted by a friend's recommendations, positive reviews on a crowdsourcing website, and statements of uncited effectiveness studies on the producer's website. Although all information literacy competencies analyzed in this study had a statistically significant relationship with the outcome, each competency was also highly correlated with the others. Information literacy and interpersonal trust independently predicted the largest amount of variance in the intention to share the video (17% and 16%, respectively). Interpersonal trust was negatively related to the willingness to share the video. Science literacy explained 7% of the variance. CONCLUSIONS: People are vulnerable to web-based misinformation and are likely to propagate it on the internet. Information literacy and science literacy are associated with less vulnerability to misinformation and a lower propensity to spread it. Of the two, information literacy holds a greater promise as an intervention target. Understanding the role of different kinds of trust in information sharing merits further research.

Study of EHR-mediated workflows using ethnography and process mining methods.

Rapid ethnography and data mining approaches have been used individually to study clinical workflows, but have seldom been used together to overcome the limitations inherent in either type of method. For rapid ethnography, how reliable are the findings drawn from small samples? For data mining, how accurate are the discoveries drawn from automatic analysis of big data, when compared with observable data? This paper explores the combined use of rapid ethnography and process mining, aka ethno-mining, to study and compare metrics of a typical clinical documentation task, vital signs charting. The task was performed with different electronic health records (EHRs) used in three different hospital sites. The individual methods revealed substantial discrepancies in task duration between sites. Specifically, means of 159.6(78.55), 38.2(34.9), and 431.3(283.04) seconds were captured with rapid ethnography. When process mining was used, means of 518.6(3,808), 345.5(660.6), and 119.74(210.3) seconds were found. When ethno-mining was applied instead, outliers could be identified, explained and removed. Without outliers, mean task duration was similar between sites (78.1(66.7), 72.5(78.5), and 71.7(75) seconds). Results from this work suggest that integrating rapid ethnography and data mining into a single process may provide more meaningful results than a siloed approach when studying of workflow.

Characterizing and Visualizing Display and Task Fragmentation in the Electronic Health Record: Mixed Methods Design.

BACKGROUND: The complexity of health care data and workflow presents challenges to the study of usability in electronic health records (EHRs). Display fragmentation refers to the distribution of relevant data across different screens or otherwise far apart, requiring complex navigation for the user's workflow. Task and information fragmentation also contribute to cognitive burden. OBJECTIVE: This study aims to define and analyze some of the main sources of fragmentation in EHR user interfaces (UIs); discuss relevant theoretical, historical, and practical considerations; and use granular microanalytic methods and visualization techniques to help us understand the nature of fragmentation and opportunities for EHR optimization or redesign. METHODS: Sunburst visualizations capture the EHR navigation structure, showing levels and sublevels of the navigation tree, allowing calculation of a new measure, the Display Fragmentation Index. Time belt visualizations present the sequences of subtasks and allow calculation of proportion per instance, a measure that quantifies task fragmentation. These measures can be used separately or in conjunction to compare EHRs as well as tasks and subtasks in workflows and identify opportunities for reductions in steps and fragmentation. We present an example use of the methods for comparison of 2 different EHR interfaces (commercial and composable) in which subjects apprehend the same patient case. RESULTS: Screen transitions were substantially reduced for the composable interface (from 43 to 14), whereas clicks (including scrolling) remained similar. CONCLUSIONS: These methods can aid in our understanding of UI needs under complex conditions and tasks to optimize EHR workflows and redesign.

A micro-analytic approach to understanding electronic health record navigation paths.

Clinician task performance is significantly impacted by the navigational efficiency of the system interface. Here we propose and evaluate a navigational complexity framework useful for examining differences in electronic health record (EHR) interface systems and their impact on task performance. The methodological approach includes 1) expert-based methods-specifically, representational analysis (focused on interface elements), keystroke level modeling (KLM), and cognitive walkthrough; and 2) quantitative analysis of interactive behaviors based on video-captured observations. Medication administration record (MAR) tasks completed by nurses during preoperative (PreOp) patient assessment were studied across three Mayo Clinic regional campuses and three different EHR systems. By analyzing the steps executed within the interfaces involved to complete the MAR tasks, we characterized complexities in EHR navigation. These complexities were reflected in time spent on task, click counts, and screen transitions, and were found to potentially influence nurses' performance. Two of the EHR systems, employing a single screen format, required less time to complete (mean 101.5, range 106-97 s), respectively, compared to one system employing multiple screens (176 s, 73% increase). These complexities surfaced through trade-offs in cognitive processes that could potentially influence nurses' performance. Factors such as perceptual-motor activity, visual search, and memory load impacted navigational complexity. An implication of this work is that small tractable changes in interface design can substantially improve EHR navigation, overall usability, and workflow.

A Task-Analytic Framework Comparing Preoperative Electronic Health Record-Mediated Nursing Workflow in Different Settings.

Preoperative care is a critical, yet complex, time-sensitive process. Optimization of workflow is challenging for many reasons, including a lack of standard workflow analysis methods. We sought to comprehensively characterize electronic health record-mediated preoperative nursing workflow. We employed a structured methodological framework to investigate and explain variations in the workflow. Video recording software captured 10 preoperative cases at Arizona and Florida regional referral centers. We compared the distribution of work for electronic health record tasks and off-screen tasks through quantitative analysis. Suboptimal patterns and reasons for variation were explored through qualitative analysis. Although both settings used the same electronic health record system, electronic health record tasks and off-screen tasks time distribution and patterns were notably different across two sites. Arizona nurses spent a longer time completing preoperative assessment. Electronic health record tasks occupied a higher proportion of time in Arizona, while off-screen tasks occupied a higher proportion in Florida. The contextual analysis helped to identify the variation associated with the documentation workload, preparation of the patient, and regional differences. These findings should seed hypotheses for future optimization efforts and research supporting standardization and harmonization of workflow across settings, post-electronic health record conversion.

We're Lost, But We are Making Good Time: Navigating Complex Pathways in a Patient-Order Management Task.

Patient order management (POM) is a mission-critical task for perioperative workflow. Interface complexity within different EHR systems result in poor usability, increasing documentation burden. POM interfaces were compared across two systems prior to (Cerner SurgiNet) and subsequent to an EHR conversion (Epic). Here we employ a navigational complexity framework useful for examining differences in EHR interface systems. The methodological approach includes 1) expert-based methods-specifically, functional analysis, keystroke level model (KLM) and cognitive walkthrough, and 2) quantitative analysis of observed interactive user behaviors. We found differences in relation to navigational complexity with the SurgiNet interface displaying a higher number of unused POM functions, with 12 in total whereas Epic displayed 7 total functions. As reflected in all measures, Epic facilitated a more streamlined task-focused user experience. The approach enabled us to scrutinize the impact of different EHR interfaces on task performance and usability barriers subsequent to system implementation.

EHR Conversion on the PreOp Care: A Pre-Post Workflow Comparison.

The impact of EHRs conversion on clinicians' daily work is crucial to evaluate the success of the intervention for Hospitals and to yield valuable insights into quality improvement. To assess the impact of different EHR systems on the preoperative nursing workflow, we used a structured framework combining quantitative time and motion study and qualitative cognitive analysis to characterize, visualize and explain the differences before and after an EHR conversion. The results showed that the EHR conversion brought a significant decrease in the patient case time and a reduced percentage of time using EHR. PreOp nurses spent a higher proportion of time caring for the patient, while the important tasks were completed in a more continuous pattern after the EHR conversion. The workflow variance was due to different nurse's cognitive process and the task time change was reduced because of some new interface features in the new EHR systems.

Evaluating the Quality of Health Information in a Changing Digital Ecosystem.

BACKGROUND: Critical evaluation of online health information has always been central to consumer health informatics. However, with the emergence of new Web media platforms and the ubiquity of social media, the issue has taken on a new dimension and urgency. At the same time, many established existing information quality evaluation guidelines address information characteristics other than the content (eg, authority and currency), target information creators rather than users as their main audience, or do not address information presented via novel Web technologies. OBJECTIVE: The aim of this formative study was to (1) develop a methodological approach for analyzing health-related Web pages and (2) apply it to a set of relevant Web pages. METHODS: This qualitative study analyzed 25 type 2 diabetes pages, which were derived from the results of a Google search with the keywords "diabetes," "reversal," and "natural." The coding scheme, developed via a combination of theory- and data-driven approaches, includes 5 categories from existing guidelines (resource type, information authority, validity of background information sources, objectivity, and currency) and 7 novel categories (treatment or reversal method, promises and certainty, criticisms of establishment, emotional appeal, vocabulary, rhetoric and presentation, and use of science in argumentation). The coding involves both categorical judgment and in-depth narrative characterization. On establishing satisfactory level of agreement on the narrative coding, the team coded the complete dataset of 25 pages. RESULTS: The results set included "traditional" static pages, videos, and digitized versions of printed newspapers or magazine articles. Treatments proposed by the pages included a mixture of conventional evidence-based treatments (eg, healthy balanced diet exercise) and unconventional treatments (eg, dietary supplements, optimizing gut flora). Most pages either promised or strongly implied high likelihood of complete recovery. Pages varied greatly with respect to the authors' stated background and credentials as well as the information sources they referenced or mentioned. The majority included criticisms of the traditional health care establishment. Many sold commercial products ranging from dietary supplements to books. The pages frequently used colloquial language. A significant number included emotional personal anecdotes, made positive mentions of the word cure, and included references to nature as a positive healing force. Most pages presented some biological explanations of their proposed treatments. Some of the explanations involved the level of complexity well beyond the level of an educated layperson. CONCLUSIONS: Both traditional and data-driven categories of codes used in this work yielded insights about the resources and highlighted challenges faced by their users. This exploratory study underscores the challenges of consumer health information seeking and the importance of developing support tools that would help users seek, evaluate, and analyze information in the changing digital ecosystem.

Molecular Profiling of Cohorts of Tumor Samples to Guide Clinical Development of Pembrolizumab as Monotherapy.

PURPOSE: Molecular profiling of large databases of human tumor gene expression profiles offers novel opportunities for informing decisions in clinical development programs. EXPERIMENTAL DESIGN: Gene expression profile of programmed death ligand 1 (PD-L1) was explored in a dataset of 16,000 samples, including approximately 4,000 metastatic tumors, across >25 tumor types prevalent in the United States, looking for new indications for the programmed death 1 (PD-1) inhibitor pembrolizumab. PD-L1 expression was highly concordant with several genomic signatures indicative of immune-inflamed tumor microenvironment. Prevalence of activated immune-inflamed tumors across all tumor types was explored and used to rank tumor types for potential response to pembrolizumab monotherapy. RESULTS: The analysis yielded 3 tiers of indications in which high levels of PD-L1 and immune-inflamed signatures were found in up to 40% to 60%, 20% to 40%, and 0% to 20% of tumors. Tier 1 contained novel indications known at the time of analysis to be responsive to PD-1 checkpoint blockade in the clinic (such as melanoma and non-small cell lung cancer), as well as indications not studied in the clinic previously, including microsatellite instability-high colorectal, head and neck, bladder, and triple-negative breast cancers. Complementary analysis of an Asian/Pacific cancer dataset (gastric cancer) revealed high prevalence of immune-inflamed tumors in gastric cancer. These data contributed to prioritization of these indications for clinical development of pembrolizumab as monotherapy. CONCLUSIONS: Data highlight the value of molecular profiling in identifying populations with high unmet needs with potentially favorable response characteristics and accelerating development of novel therapies for these patients.See related commentary by Mansfield and Jen, p. 1443.

Process Mining and Ethnography Study of Medication Reconciliation Tasks.

We studied the medication reconciliation (MedRec) task through analysis of computer logs and ethnographic data. Time spent by healthcare providers performing MedRec was compared between two different EHR systems used at four different regional perioperative settings. Only one of the EHRs used at two settings generated computer logs that supported automatic discovery of the MedRec task. At those two settings, 53 providers generated 383 MedRec instances. Findings from the computer logs were validated with ethnographic data, leading to the identification and removal of 47 outliers. Without outliers, one of the settings had slightly smaller mean (SD) time in seconds 67.3 (40.2) compared with the other, 92.1 (25). The difference in time metrics was statistically significant (p<.001). Reusability of an existing task-based analytic method allowed for rapid study of EHR-based workflow and task.

SITC 2018 workshop report: Immuno-Oncology Biomarkers: State of the Art.

Identification of biomarkers in cancer immunotherapy that predict therapeutic response and/or limit adverse events are a critical need in the field. To address recent progress and hurdles around cancer biomarker development and utilization, the Society for Immunotherapy of Cancer (SITC) convened a workshop, "Immuno-Oncology Biomarkers: State of the Art," on May 16-17, 2018. Topics discussed included challenges in handling biospecimens, identification and validation of new biomarkers, data sharing, and collaborating across disciplines to advance biomarker development. Panel discussions followed session presentations to help foster participant conversation and discuss future projects and collaborations. The results of the Workshop include the development of new initiatives for the SITC Biomarkers Committee.

In Search of Vital Signs: A Comparative Study of EHR Documentation.

Vital sign documentation is an essential part of perioperative workflow. Health information technology can introduce complexity into all facets of documentation and burden clinicians with high cognitive load3-4. The Mayo Clinic enterprise is in the process of documenting current EHR-mediated workflow prior to a system-wide EHR conversion. We compared and evaluated three different vital sign documentation interfaces in pre-operative nursing assessments at three different Mayo Clinic sites. The interfaces differed in their modes of interaction, organization of patient information and cognitive support. Analyses revealed that accessing displays and the organization of interface elements are often unintuitive and inefficient, creating unnecessary complexities when interacting with the system. These differences surface through interface workflow models and interactive behavior measures for accessing, logging and reviewing patient information. Different designs differentially mediate task performance, which can ultimately mitigate errors for complex cognitive tasks, risking patient safety. Identifying barriers to interface usability and bottlenecks in EHR-mediated workflow can lead to system redesigns that minimize cognitive load while improving patient safety and efficiency.

IFN-γ-related mRNA profile predicts clinical response to PD-1 blockade.

Programmed death-1-directed (PD-1-directed) immune checkpoint blockade results in durable antitumor activity in many advanced malignancies. Recent studies suggest that IFN-γ is a critical driver of programmed death ligand-1 (PD-L1) expression in cancer and host cells, and baseline intratumoral T cell infiltration may improve response likelihood to anti-PD-1 therapies, including pembrolizumab. However, whether quantifying T cell-inflamed microenvironment is a useful pan-tumor determinant of PD-1-directed therapy response has not been rigorously evaluated. Here, we analyzed gene expression profiles (GEPs) using RNA from baseline tumor samples of pembrolizumab-treated patients. We identified immune-related signatures correlating with clinical benefit using a learn-and-confirm paradigm based on data from different clinical studies of pembrolizumab, starting with a small pilot of 19 melanoma patients and eventually defining a pan-tumor T cell-inflamed GEP in 220 patients with 9 cancers. Predictive value was independently confirmed and compared with that of PD-L1 immunohistochemistry in 96 patients with head and neck squamous cell carcinoma. The T cell-inflamed GEP contained IFN-γ-responsive genes related to antigen presentation, chemokine expression, cytotoxic activity, and adaptive immune resistance, and these features were necessary, but not always sufficient, for clinical benefit. The T cell-inflamed GEP has been developed into a clinical-grade assay that is currently being evaluated in ongoing pembrolizumab trials.

Impact of an electronic handoff documentation tool on team shared mental models in pediatric critical care.

OBJECTIVE: To examine the impact of the implementation of an electronic handoff tool (the Handoff Tool) on shared mental models (SMM) within patient care teams as measured by content overlap and discrepancies in verbal handoff presentations given by different clinicians caring for the same patient. MATERIALS AND METHODS: Researchers observed, recorded, and transcribed verbal handoffs given by different members of patient care teams in a pediatric intensive care unit. The transcripts were qualitatively coded and analyzed for content overlap scores and the number of discrepancies in handoffs of different team members before and after the implementation of the tool. RESULTS: Content overlap scores did not change post-implementation. The average number of discrepancies nearly doubled following the implementation (from 0.76 discrepancies per handoff group pre-implementation to 1.17 discrepancies per handoff group post-implementation); however, this change was not statistically significant (p=0.37). Discrepancies classified as related to dosage of treatment or procedure and to patients' symptoms increased in frequency post-implementation. DISCUSSION: The results suggest that the Handoff Tool did not have the desired positive impact on SMM within patient care teams. Future electronic tools for facilitating team handoff may need longer implementation times, complementary changes to handoff process and structure, and improved designs that integrate a common core of shared information with discipline-specific records. CONCLUSION: While electronic handoff tools provide great opportunities to improve communication and facilitate the formation of shared mental models within patient care teams, further work is necessary to realize their full potential.

Systematic evaluation of immune regulation and modulation.

Cancer immunotherapies are showing promising clinical results in a variety of malignancies. Monitoring the immune as well as the tumor response following these therapies has led to significant advancements in the field. Moreover, the identification and assessment of both predictive and prognostic biomarkers has become a key component to advancing these therapies. Thus, it is critical to develop systematic approaches to monitor the immune response and to interpret the data obtained from these assays. In order to address these issues and make recommendations to the field, the Society for Immunotherapy of Cancer reconvened the Immune Biomarkers Task Force. As a part of this Task Force, Working Group 3 (WG3) consisting of multidisciplinary experts from industry, academia, and government focused on the systematic assessment of immune regulation and modulation. In this review, the tumor microenvironment, microbiome, bone marrow, and adoptively transferred T cells will be used as examples to discuss the type and timing of sample collection. In addition, potential types of measurements, assays, and analyses will be discussed for each sample. Specifically, these recommendations will focus on the unique collection and assay requirements for the analysis of various samples as well as the high-throughput assays to evaluate potential biomarkers.

Driven to distraction: The nature and apparent purpose of interruptions in critical care and implications for HIT.

OBJECTIVES: To examine the apparent purpose of interruptions in a Pediatric Intensive Care Unit and opportunities to reduce their burden with informatics solutions. MATERIALS AND METHODS: In this prospective observational study, researchers shadowed clinicians in the unit for one hour at a time, recording all interruptions participating clinicians experienced or initiated, their starting time, duration, and a short description that could help to infer their apparent purpose. All captured interruptions were classified inductively on their source and apparent purpose and on the optimal representational media for fulfilling their apparent purpose. RESULTS: The researchers observed thirty-four one-hour sessions with clinicians in the unit, including 21 nurses and 13 residents and house physicians. The physicians were interrupted on average 11.9 times per hour and interrupted others 8.8 times per hour. Nurses were interrupted 8.6 times per hour and interrupted others 5.1 times per hour. The apparent purpose of interruptions included Information Seeking and Sharing (n=259, 46.3%), Directives and Requests (n=70, 12%), Shared Decision-Making (n=49, 8.8%), Direct Patient Care (n=36, 6.4%), Social (n=71, 12.7%), Device Alarms (n=28, 5%), and Non-Clinical (n=10, 1.8%); 6.6% were not classified due to insufficient description. Of all captured interruptions, 29.5% were classified as being better served with informational displays or computer-mediated communication. CONCLUSIONS: Deeper understanding of the purpose of interruptions in critical care can help to distinguish between interruptions that require face-to-face conversation and those that can be eliminated with informatics solutions. The proposed taxonomy of interruptions and representational analysis can be used to further advance the science of interruptions in clinical care.

Using Process Mining Techniques to Study Workflows in a Pre-operative Setting.

Information technologies have transformed healthcare delivery and promise to improve efficiency and quality of care. However, in-depth analysis of EHR-mediated workflows is challenging. Our goal was to apply process mining, in combination with observational techniques, to understand EHR-based workflows. We reviewed nearly 76,000 event logs from 15 providers and supporting staff, and 142 patients in a pre-operative setting and we inspected 3 weeks of interviews and video observations. We found that on average 44 minutes were spent per patient interacting with the EHR, 55% of the time of the patient visit was spent by personnel interacting with the EHR and for over 5% of the time personnel used or reviewed paper-based artifacts. We also discovered the handover-of-care network and compared frequency of interactions between personnel. This study suggests that applying process mining in combination with observational techniques has vast potential for informing Mayo Clinic in the forthcoming EHR conversion.