A Task-Analytic Framework Comparing Preoperative Electronic Health Record-Mediated Nursing Workflow in Different Settings.

Preoperative care is a critical, yet complex, time-sensitive process. Optimization of workflow is challenging for many reasons, including a lack of standard workflow analysis methods. We sought to comprehensively characterize electronic health record-mediated preoperative nursing workflow. We employed a structured methodological framework to investigate and explain variations in the workflow. Video recording software captured 10 preoperative cases at Arizona and Florida regional referral centers. We compared the distribution of work for electronic health record tasks and off-screen tasks through quantitative analysis. Suboptimal patterns and reasons for variation were explored through qualitative analysis. Although both settings used the same electronic health record system, electronic health record tasks and off-screen tasks time distribution and patterns were notably different across two sites. Arizona nurses spent a longer time completing preoperative assessment. Electronic health record tasks occupied a higher proportion of time in Arizona, while off-screen tasks occupied a higher proportion in Florida. The contextual analysis helped to identify the variation associated with the documentation workload, preparation of the patient, and regional differences. These findings should seed hypotheses for future optimization efforts and research supporting standardization and harmonization of workflow across settings, post-electronic health record conversion.

Molecular Profiling of Cohorts of Tumor Samples to Guide Clinical Development of Pembrolizumab as Monotherapy.

PURPOSE: Molecular profiling of large databases of human tumor gene expression profiles offers novel opportunities for informing decisions in clinical development programs. EXPERIMENTAL DESIGN: Gene expression profile of programmed death ligand 1 (PD-L1) was explored in a dataset of 16,000 samples, including approximately 4,000 metastatic tumors, across >25 tumor types prevalent in the United States, looking for new indications for the programmed death 1 (PD-1) inhibitor pembrolizumab. PD-L1 expression was highly concordant with several genomic signatures indicative of immune-inflamed tumor microenvironment. Prevalence of activated immune-inflamed tumors across all tumor types was explored and used to rank tumor types for potential response to pembrolizumab monotherapy. RESULTS: The analysis yielded 3 tiers of indications in which high levels of PD-L1 and immune-inflamed signatures were found in up to 40% to 60%, 20% to 40%, and 0% to 20% of tumors. Tier 1 contained novel indications known at the time of analysis to be responsive to PD-1 checkpoint blockade in the clinic (such as melanoma and non-small cell lung cancer), as well as indications not studied in the clinic previously, including microsatellite instability-high colorectal, head and neck, bladder, and triple-negative breast cancers. Complementary analysis of an Asian/Pacific cancer dataset (gastric cancer) revealed high prevalence of immune-inflamed tumors in gastric cancer. These data contributed to prioritization of these indications for clinical development of pembrolizumab as monotherapy. CONCLUSIONS: Data highlight the value of molecular profiling in identifying populations with high unmet needs with potentially favorable response characteristics and accelerating development of novel therapies for these patients.See related commentary by Mansfield and Jen, p. 1443.

SITC 2018 workshop report: Immuno-Oncology Biomarkers: State of the Art.

Identification of biomarkers in cancer immunotherapy that predict therapeutic response and/or limit adverse events are a critical need in the field. To address recent progress and hurdles around cancer biomarker development and utilization, the Society for Immunotherapy of Cancer (SITC) convened a workshop, "Immuno-Oncology Biomarkers: State of the Art," on May 16-17, 2018. Topics discussed included challenges in handling biospecimens, identification and validation of new biomarkers, data sharing, and collaborating across disciplines to advance biomarker development. Panel discussions followed session presentations to help foster participant conversation and discuss future projects and collaborations. The results of the Workshop include the development of new initiatives for the SITC Biomarkers Committee.

IFN-γ-related mRNA profile predicts clinical response to PD-1 blockade.

Programmed death-1-directed (PD-1-directed) immune checkpoint blockade results in durable antitumor activity in many advanced malignancies. Recent studies suggest that IFN-γ is a critical driver of programmed death ligand-1 (PD-L1) expression in cancer and host cells, and baseline intratumoral T cell infiltration may improve response likelihood to anti-PD-1 therapies, including pembrolizumab. However, whether quantifying T cell-inflamed microenvironment is a useful pan-tumor determinant of PD-1-directed therapy response has not been rigorously evaluated. Here, we analyzed gene expression profiles (GEPs) using RNA from baseline tumor samples of pembrolizumab-treated patients. We identified immune-related signatures correlating with clinical benefit using a learn-and-confirm paradigm based on data from different clinical studies of pembrolizumab, starting with a small pilot of 19 melanoma patients and eventually defining a pan-tumor T cell-inflamed GEP in 220 patients with 9 cancers. Predictive value was independently confirmed and compared with that of PD-L1 immunohistochemistry in 96 patients with head and neck squamous cell carcinoma. The T cell-inflamed GEP contained IFN-γ-responsive genes related to antigen presentation, chemokine expression, cytotoxic activity, and adaptive immune resistance, and these features were necessary, but not always sufficient, for clinical benefit. The T cell-inflamed GEP has been developed into a clinical-grade assay that is currently being evaluated in ongoing pembrolizumab trials.

Systematic evaluation of immune regulation and modulation.

Cancer immunotherapies are showing promising clinical results in a variety of malignancies. Monitoring the immune as well as the tumor response following these therapies has led to significant advancements in the field. Moreover, the identification and assessment of both predictive and prognostic biomarkers has become a key component to advancing these therapies. Thus, it is critical to develop systematic approaches to monitor the immune response and to interpret the data obtained from these assays. In order to address these issues and make recommendations to the field, the Society for Immunotherapy of Cancer reconvened the Immune Biomarkers Task Force. As a part of this Task Force, Working Group 3 (WG3) consisting of multidisciplinary experts from industry, academia, and government focused on the systematic assessment of immune regulation and modulation. In this review, the tumor microenvironment, microbiome, bone marrow, and adoptively transferred T cells will be used as examples to discuss the type and timing of sample collection. In addition, potential types of measurements, assays, and analyses will be discussed for each sample. Specifically, these recommendations will focus on the unique collection and assay requirements for the analysis of various samples as well as the high-throughput assays to evaluate potential biomarkers.

Using Process Mining Techniques to Study Workflows in a Pre-operative Setting.

Information technologies have transformed healthcare delivery and promise to improve efficiency and quality of care. However, in-depth analysis of EHR-mediated workflows is challenging. Our goal was to apply process mining, in combination with observational techniques, to understand EHR-based workflows. We reviewed nearly 76,000 event logs from 15 providers and supporting staff, and 142 patients in a pre-operative setting and we inspected 3 weeks of interviews and video observations. We found that on average 44 minutes were spent per patient interacting with the EHR, 55% of the time of the patient visit was spent by personnel interacting with the EHR and for over 5% of the time personnel used or reviewed paper-based artifacts. We also discovered the handover-of-care network and compared frequency of interactions between personnel. This study suggests that applying process mining in combination with observational techniques has vast potential for informing Mayo Clinic in the forthcoming EHR conversion.

Supporting cancer patients in illness management: usability evaluation of a mobile app.

BACKGROUND: Mobile phones and tablets currently represent a significant presence in people's everyday lives. They enable access to different information and services independent of current place and time. Such widespread connectivity offers significant potential in different app areas including health care. OBJECTIVE: Our goal was to evaluate the usability of the Connect Mobile app. The mobile app enables mobile access to the Connect system, an online system that supports cancer patients in managing health-related issues. Along with symptom management, the system promotes better patient-provider communication, collaboration, and shared decision making. The Connect Mobile app enables access to the Connect system over both mobile phones and tablets. METHODS: The study consisted of usability tests of a high fidelity prototype with 7 cancer patients where the objectives were to identify existing design and functionality issues and to provide patients with a real look-and-feel of the mobile system. In addition, we conducted semistructured interviews to obtain participants' feedback about app usefulness, identify the need for new system features and design requirements, and measure the acceptance of the mobile app and its features within everyday health management. RESULTS: The study revealed a total of 27 design issues (13 for mobile apps and 14 for tablet apps), which were mapped to source events (ie, errors, requests for help, participants' concurrent feedback, and moderator observation). We also applied usability heuristics to identify violations of usability principles. The majority of violations were related to enabling ease of input, screen readability, and glanceability (15 issues), as well as supporting an appropriate match between systems and the real world (7 issues) and consistent mapping of system functions and interactions (4 issues). Feedback from participants also showed the cancer patients' requirements for support systems and how these needs are influenced by different context-related factors, such as type of access terminal (eg, desktop computer, tablet, mobile phone) and phases of illness. Based on the observed results, we proposed design and functionality recommendations that can be used for the development of mobile apps for cancer patients to support their health management process. CONCLUSIONS: Understanding and addressing users' requirements is one of the main prerequisites for developing useful and effective technology-based health interventions. The results of this study outline different user requirements related to the design of the mobile patient support app for cancer patients. The results will be used in the iterative development of the Connect Mobile app and can also inform other developers and researchers in development, integration, and evaluation of mobile health apps and services that support cancer patients in managing their health-related issues.

Longitudinal requirement for CD4+ T cell help for adenovirus vector-elicited CD8+ T cell responses.

Despite the widespread use of replication-incompetent recombinant adenovirus (Ad) vectors as candidate vaccine platforms, the mechanism by which these vectors elicit CD8(+) T cell responses remains poorly understood. Our data demonstrate that induction and maintenance of CD8(+) T cell responses by Ad vector immunization is longitudinally dependent on CD4(+) T cell help for a prolonged period. Depletion of CD4(+) T cells in wild type mice within the first 8 d following Ad immunization resulted in dramatically reduced induction of Ag-specific CD8(+) T cells, decreased T-bet and eomesodermin expression, impaired KLRG1(+) effector differentiation, and atypical expression of the memory markers CD127, CD27, and CD62L. Moreover, these CD8(+) T cells failed to protect against a lethal recombinant Listeria monocytogenes challenge. Depletion of CD4(+) T cells between weeks 1 and 4 following immunization resulted in increased contraction of memory CD8(+) T cells. These data demonstrate a prolonged temporal requirement for CD4(+) T cell help for vaccine-elicited CD8(+) T cell responses in mice. These findings have important implications in the design of vaccines aimed at eliciting CD8(+) T cell responses and may provide insight into the impaired immunogenicity of vaccines in the context of AIDS and other CD4(+) T cell immune deficiencies.

Focus and breadth of cellular immune responses elicited by a heterologous insert prime-boost vaccine regimen in rhesus monkeys.

The global sequence diversity of HIV-1 presents a daunting challenge for vaccine development. We investigated whether a heterologous insert prime-boost regimen could expand global coverage by selectively boosting cellular immune responses to conserved epitopes. Rhesus monkeys were primed and boosted with recombinant adenovirus vectors expressing homologous or heterologous HIV-1 Gag sequences that were optimized to focus responses on highly conserved epitopes. We observed comparable responses directed to specific regions of the Gag protein in all experimental groups without evidence of improved coverage or expanded breadth in the heterologous insert group. These data suggest that antigen-independent factors contribute to the immunodominance patterns of vaccine-elicited cellular immune responses.

Vitamin A deficiency impairs vaccine-elicited gastrointestinal immunity.

Vitamin A deficiency is highly prevalent in much of the developing world, where vaccination programs are of paramount importance to public health. However, the impact of vitamin A deficiency on the immunogenicity and protective efficacy of vaccines has not been defined previously. In this article, we show that the vitamin A metabolite retinoic acid is critical for trafficking of vaccine-elicited T lymphocytes to the gastrointestinal mucosa and for vaccine protective efficacy in mice. Moderate vitamin A deficiency abrogated Ag-specific T lymphocyte trafficking to the gastrointestinal tract, gastrointestinal cellular immune responses, and protection against a mucosal challenge following immunization with a recombinant adenovirus vaccine vector. Oral vitamin A supplementation as well as retinoic acid administration fully restored the mucosal immune responses and vaccine protective efficacy. These data suggest that oral vitamin A supplementation may be important for optimizing the success of vaccines against HIV-1 and other mucosal pathogens in the developing world, highlighting a critical relationship between host nutritional status and vaccine efficacy.

Multiple innate immune pathways contribute to the immunogenicity of recombinant adenovirus vaccine vectors.

The innate immune pathways that contribute to the potent immunogenicity of recombinant adenovirus (rAd) vaccine vectors remain largely undefined. Previous studies assessing innate immunity triggered by vaccine vectors have largely focused on in vitro studies involving antigen-presenting cells and on early in vivo inflammatory responses. Here, we systematically explore the Toll-like receptor (TLR) signaling requirements for the generation of cellular immune responses by intramuscular immunization with common and alternative serotype rAd vectors in mice. Antigen-specific CD8(+) T-lymphocyte responses elicited by these rAd vectors were significantly diminished in MyD88(-/-) mice but not in TRIF(-/-) or TLR3(-/-) mice, suggesting the importance of MyD88-dependent TLR signaling. However, the absence of each individual TLR resulted in minimal to no effect on vaccine-elicited cellular immune responses. Moreover, responses were not diminished in IL-1R(-/-) or IL-18R(-/-) mice. These data suggest that rAd vectors engage multiple MyD88-dependent signaling pathways, none of which are individually critical; rather, they are integrated to contribute to the potent immunogenicity of rAd vectors. Stimulation of multiple innate immune mechanisms may prove a generalizable property of potent vaccines, and this strategy could be harnessed in the development of next-generation vaccine vectors and adjuvants.

Route of adenovirus-based HIV-1 vaccine delivery impacts the phenotype and trafficking of vaccine-elicited CD8+ T lymphocytes.

Candidate HIV-1 vaccine regimens utilizing intramuscularly (i.m.) administered recombinant adenovirus (rAd)-based vectors can induce potent mucosal cellular immunity. However, the degree to which mucosal rAd vaccine routing might alter the quality and anatomic distribution of vaccine-elicited CD8(+) T lymphocytes remains unclear. We show that the route of vaccination critically impacts not only the magnitude but also the phenotype and trafficking of antigen-specific CD8(+) T lymphocytes in mice. I.m. rAd immunization induced robust local transgene expression and elicited high-frequency, polyfunctional CD8(+) T lymphocytes that trafficked broadly to both systemic and mucosal compartments. In contrast, intranasal (i.n.) rAd immunization led to similarly robust local transgene expression but generated low-frequency, monofunctional CD8(+) T lymphocytes with restricted anatomic trafficking patterns. Respiratory rAd immunization elicited systemic and mucosal CD8(+) T lymphocytes with phenotypes and trafficking properties distinct from those elicited by i.m. or i.n. rAd immunization. Our findings indicate that the anatomic microenvironment of antigen expression critically impacts the phenotype and trafficking of antigen-specific CD8(+) T lymphocytes.

Trafficking of antigen-specific CD8+ T lymphocytes to mucosal surfaces following intramuscular vaccination.

A critical goal of vaccine development for a wide variety of pathogens is the induction of potent and durable mucosal immunity. However, it has been assumed that this goal would be difficult to achieve by systemic vaccination due to the anatomic and functional distinctness of the systemic and mucosal immune systems and the resultant compartmentalization of immune responses. In this study, we show that Ag-specific CD8(+) T lymphocytes traffic efficiently to mucosal surfaces following systemic vaccination. Intramuscular immunization with recombinant adenovirus (rAd) vector-based vaccines expressing SIV Gag resulted in potent, durable, and functional CD8(+) T lymphocyte responses at multiple mucosal effector sites in both mice and rhesus monkeys. In adoptive transfer studies in mice, vaccine-elicited systemic CD8(+) T lymphocytes exhibited phenotypic plasticity, up-regulated mucosal homing integrins and chemokine receptors, and trafficked rapidly to mucosal surfaces. Moreover, the migration of systemic CD8(+) T lymphocytes to mucosal compartments accounted for the vast majority of Ag-specific mucosal CD8(+) T lymphocytes induced by systemic vaccination. Thus, i.m. vaccination can overcome immune compartmentalization and generate robust mucosal CD8(+) T lymphocyte memory. These data demonstrate that the systemic and mucosal immune systems are highly coordinated following vaccination.

Differential antigen requirements for protection against systemic and intranasal vaccinia virus challenges in mice.

The development of a subunit vaccine for smallpox represents a potential strategy to avoid the safety concerns associated with replication-competent vaccinia virus. Preclinical studies to date with subunit smallpox vaccine candidates, however, have been limited by incomplete information regarding protective antigens and the requirement for multiple boost immunizations to afford protective immunity. Here we explore the protective efficacy of replication-incompetent, recombinant adenovirus serotype 35 (rAd35) vectors expressing the vaccinia virus intracellular mature virion (IMV) antigens A27L and L1R and extracellular enveloped virion (EEV) antigens A33R and B5R in a murine vaccinia virus challenge model. A single immunization with the rAd35-L1R vector effectively protected mice against a lethal systemic vaccinia virus challenge. The rAd35-L1R vector also proved more efficacious than the combination of four rAd35 vectors expressing A27L, L1R, A33R, and B5R. Moreover, serum containing L1R-specific neutralizing antibodies afforded postexposure prophylaxis after systemic vaccinia virus infection. In contrast, the combination of rAd35-L1R and rAd35-B5R vectors was required to protect mice against a lethal intranasal vaccinia virus challenge, suggesting that both IMV- and EEV-specific immune responses are important following intranasal infection. Taken together, these data demonstrate that different protective antigens are required based on the route of vaccinia virus challenge. These studies also suggest that rAd vectors warrant further assessment as candidate subunit smallpox vaccines.

A framework for analyzing the cognitive complexity of computer-assisted clinical ordering.

Computer-assisted provider order entry is a technology that is designed to expedite medical ordering and to reduce the frequency of preventable errors. This paper presents a multifaceted cognitive methodology for the characterization of cognitive demands of a medical information system. Our investigation was informed by the distributed resources (DR) model, a novel approach designed to describe the dimensions of user interfaces that introduce unnecessary cognitive complexity. This method evaluates the relative distribution of external (system) and internal (user) representations embodied in system interaction. We conducted an expert walkthrough evaluation of a commercial order entry system, followed by a simulated clinical ordering task performed by seven clinicians. The DR model was employed to explain variation in user performance and to characterize the relationship of resource distribution and ordering errors. The analysis revealed that the configuration of resources in this ordering application placed unnecessarily heavy cognitive demands on the user, especially on those who lacked a robust conceptual model of the system. The resources model also provided some insight into clinicians' interactive strategies and patterns of associated errors. Implications for user training and interface design based on the principles of human-computer interaction in the medical domain are discussed.