HIF1α-glycolysis engages activation-induced cell death to drive IFN-γ induction in hypoxic T cells.

The role of HIF1α-glycolysis in regulating IFN-γ induction in hypoxic T cells is unknown. Given that hypoxia is a common feature in a wide array of pathophysiological contexts such as tumor and that IFN-γ is instrumental for protective immunity, it is of great significance to gain a clear idea on this. Combining pharmacological and genetic gain-of-function and loss-of-function approaches, we find that HIF1α-glycolysis controls IFN-γ induction in both human and mouse T cells activated under hypoxia. Specific deletion of HIF1α in T cells (HIF1α-/-) and glycolytic inhibition significantly abrogate IFN-γ induction. Conversely, HIF1α stabilization in T cells by hypoxia and VHL deletion (VHL-/-) promotes IFN-γ production. Mechanistically, reduced IFN-γ production in hypoxic HIF1α-/- T cells is due to attenuated activation-induced cell death but not proliferative defect. We further show that depletion of intracellular acetyl-CoA is a key metabolic underlying mechanism. Hypoxic HIF1α-/- T cells are less able to kill tumor cells, and HIF1α-/- tumor-bearing mice are not responsive to immune checkpoint blockade (ICB) therapy, indicating loss of HIF1α in T cells is a major mechanism of therapeutic resistance to ICBs. Importantly, acetate supplementation restores IFN-γ production in hypoxic HIF1α-/- T cells and re-sensitizes HIF1α-/- tumor-bearing mice to ICBs, providing an effective strategy to overcome ICB resistance. Taken together, our results highlight T cell HIF1α-anaerobic glycolysis as a principal mediator of IFN-γ induction and anti-tumor immunity. Considering that acetate supplementation (i.e., glycerol triacetate (GTA)) is approved to treat infants with Canavan disease, we envision a rapid translation of our findings, justifying further testing of GTA as a repurposed medicine for ICB resistance, a pressing unmet medical need.

Randomized controlled trial of tailored audit with feedback in VHA long-term care settings.

BACKGROUND: The Long-Term Care QUERI program supported implementation of the Life-Sustaining Treatment Decisions Initiative in US Veterans Health Administration long-term care settings. The program worked with eleven Community Living Centers (CLCs) and twelve Home-Based Primary Care (HBPC) programs to increase rates of completed templates, using audit with feedback. We distributed monthly feedback reports to site champions showing the number of Veterans with appropriate documentation. Although feedback reports are a common implementation tool, little is known about the most effective ways to design, distribute, and support them. We sought to test tailoring reports with tips using site-specific data, as well as national comparator data. METHODS: We conducted a cluster randomized controlled trial of monthly feedback reports utilizing site-tailored tips and national comparator data compared to our original feedback reports that included only graphical and numerical data. CLC and HBPC team members were invited to participate in brief surveys each quarter to determine if they had received and used the feedback reports. The outcome for CLC residents was the percent with a completed LST template any time prior to the 14th day of their stay. The outcome for HBPC residents was the percent of Veterans with a completed LST template by their second HBPC visit. RESULTS: The response rate to the survey ranged between 6.8 and 19.3% of staff members across the CLC and HBPC sites with 12.8-25.5% of survey respondents reporting that they had seen the feedback reports. The linear regression models showed no significant association between receiving the enhanced feedback reports and having a higher documentation completion rate. CONCLUSIONS: Receiving feedback reports tailored to sites by including tips based on baseline context assessments and qualitative findings, and reports showing national comparator data, did not have an impact on the number of Veterans with a completed LST template. Having a higher proportion of CLC or HBPC team members view the reports was not associated with an increase in LST template completion. These findings suggest that tailored audit with feedback may not have been effective at the program level, although the proportion of respondents who reported seeing the reports was small.

A Scalable Service to Improve Health Care Quality Through Precision Audit and Feedback: Proposal for a Randomized Controlled Trial.

BACKGROUND: Health care delivery organizations lack evidence-based strategies for using quality measurement data to improve performance. Audit and feedback (A&F), the delivery of clinical performance summaries to providers, demonstrates the potential for large effects on clinical practice but is currently implemented as a blunt one size fits most intervention. Each provider in a care setting typically receives a performance summary of identical metrics in a common format despite the growing recognition that precisionizing interventions hold significant promise in improving their impact. A precision approach to A&F prioritizes the display of information in a single metric that, for each recipient, carries the highest value for performance improvement, such as when the metric's level drops below a peer benchmark or minimum standard for the first time, thereby revealing an actionable performance gap. Furthermore, precision A&F uses an optimal message format (including framing and visual displays) based on what is known about the recipient and the intended gist meaning being communicated to improve message interpretation while reducing the cognitive processing burden. Well-established psychological principles, frameworks, and theories form a feedback intervention knowledge base to achieve precision A&F. From an informatics perspective, precision A&F requires a knowledge-based system that enables mass customization by representing knowledge configurable at the group and individual levels. OBJECTIVE: This study aims to implement and evaluate a demonstration system for precision A&F in anesthesia care and to assess the effect of precision feedback emails on care quality and outcomes in a national quality improvement consortium. METHODS: We propose to achieve our aims by conducting 3 studies: a requirements analysis and preferences elicitation study using human-centered design and conjoint analysis methods, a software service development and implementation study, and a cluster randomized controlled trial of a precision A&F service with a concurrent process evaluation. This study will be conducted with the Multicenter Perioperative Outcomes Group, a national anesthesia quality improvement consortium with >60 member hospitals in >20 US states. This study will extend the Multicenter Perioperative Outcomes Group quality improvement infrastructure by using existing data and performance measurement processes. RESULTS: The proposal was funded in September 2021 with a 4-year timeline. Data collection for Aim 1 began in March 2022. We plan for a 24-month trial timeline, with the intervention period of the trial beginning in March 2024. CONCLUSIONS: The proposed aims will collectively demonstrate a precision feedback service developed using an open-source technical infrastructure for computable knowledge management. By implementing and evaluating a demonstration system for precision feedback, we create the potential to observe the conditions under which feedback interventions are effective. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/34990.

Evaluating implementation strategies to support documentation of veterans' care preferences.

OBJECTIVE: To evaluate the effectiveness of feedback reports and feedback reports + external facilitation on completion of life-sustaining treatment (LST) note the template and durable medical orders. This quality improvement program supported the national roll-out of the Veterans Health Administration (VA) LST Decisions Initiative (LSTDI), which aims to ensure that seriously-ill veterans have care goals and LST decisions elicited and documented. DATA SOURCES: Primary data from national databases for VA nursing homes (called Community Living Centers [CLCs]) from 2018 to 2020. STUDY DESIGN: In one project, we distributed monthly feedback reports summarizing LST template completion rates to 12 sites as the sole implementation strategy. In the second involving five sites, we distributed similar feedback reports and provided robust external facilitation, which included coaching, education, and learning collaboratives. For each project, principal component analyses matched intervention to comparison sites, and interrupted time series/segmented regression analyses evaluated the differences in LSTDI template completion rates between intervention and comparison sites. DATA COLLECTION METHODS: Data were extracted from national databases in addition to interviews and surveys in a mixed-methods process evaluation. PRINCIPAL FINDINGS: LSTDI template completion rose from 0% to about 80% throughout the study period in both projects' intervention and comparison CLCs. There were small but statistically significant differences for feedback reports alone (comparison sites performed better, coefficient estimate 3.48, standard error 0.99 for the difference between groups in change in trend) and feedback reports + external facilitation (intervention sites performed better, coefficient estimate -2.38, standard error 0.72). CONCLUSIONS: Feedback reports + external facilitation was associated with a small but statistically significant improvement in outcomes compared with comparison sites. The large increases in completion rates are likely due to the well-planned national roll-out of the LSTDI. This finding suggests that when dissemination and support for widespread implementation are present and system-mandated, significant enhancements in the adoption of evidence-based practices may require more intensive support.

Dashboards in Health Care Settings: Protocol for a Scoping Review.

BACKGROUND: Health care organizations increasingly depend on business intelligence tools, including "dashboards," to capture, analyze, and present data on performance metrics. Ideally, dashboards allow users to quickly visualize actionable data to inform and optimize clinical and organizational performance. In reality, dashboards are typically embedded in complex health care organizations with massive data streams and end users with distinct needs. Thus, designing effective dashboards is a challenging task and theoretical underpinnings of health care dashboards are poorly characterized; even the concept of the dashboard remains ill-defined. Researchers, informaticists, clinical managers, and health care administrators will benefit from a clearer understanding of how dashboards have been developed, implemented, and evaluated, and how the design, end user, and context influence their uptake and effectiveness. OBJECTIVE: This scoping review first aims to survey the vast published literature of "dashboards" to describe where, why, and for whom they are used in health care settings, as well as how they are developed, implemented, and evaluated. Further, we will examine how dashboard design and content is informed by intended purpose and end users. METHODS: In July 2020, we searched MEDLINE, Embase, Web of Science, and the Cochrane Library for peer-reviewed literature using a targeted strategy developed with a research librarian and retrieved 5188 results. Following deduplication, 3306 studies were screened in duplicate for title and abstract. Any abstracts mentioning a health care dashboard were retrieved in full text and are undergoing duplicate review for eligibility. Articles will be included for data extraction and analysis if they describe the development, implementation, or evaluation of a dashboard that was successfully used in routine workflow. Articles will be excluded if they were published before 2015, the full text is unavailable, they are in a non-English language, or they describe dashboards used for public health tracking, in settings where direct patient care is not provided, or in undergraduate medical education. Any discrepancies in eligibility determination will be adjudicated by a third reviewer. We chose to focus on articles published after 2015 and those that describe dashboards that were successfully used in routine practice to identify the most recent and relevant literature to support future dashboard development in the rapidly evolving field of health care informatics. RESULTS: All articles have undergone dual review for title and abstract, with a total of 2019 articles mentioning use of a health care dashboard retrieved in full text for further review. We are currently reviewing all full-text articles in duplicate. We aim to publish findings by mid-2022. Findings will be reported following guidance from the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. CONCLUSIONS: This scoping review will provide stakeholders with an overview of existing dashboard tools, highlighting the ways in which dashboards have been developed, implemented, and evaluated in different settings and for different end user groups, and identify potential research gaps. Findings will guide efforts to design and use dashboards in the health care sector more effectively. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/34894.

Feasibility and acceptability of a toolkit-based process to implement patient-centered, immediate postpartum long-acting reversible contraception services.

BACKGROUND: National guidelines recommend that maternity systems provide patient-centered access to immediate postpartum long-acting reversible contraception (ie, insertion of an intrauterine device or implant during the delivery hospitalization). Hospitals face significant barriers to offering these services, and efforts to improve peripartum contraception care quality have met with mixed success. Implementation toolkits-packages of resources and strategies to facilitate the implementation of new services-are a promising approach for guiding clinical practice change. OBJECTIVE: This study aimed to develop a theory-informed toolkit, evaluate the feasibility of toolkit-based implementation of immediate postpartum long-acting reversible contraception care in a single site, and refine the toolkit and implementation process for future effectiveness testing. STUDY DESIGN: We conducted a single-site feasibility study of the toolkit-based implementation of immediate postpartum contraception services at a large academic medical center in 2017 to 2020. Based on previous qualitative work, we developed a theory-informed implementation toolkit. A stakeholder panel selected toolkit resources to use in a multicomponent implementation intervention at the study site. These resources included tools and strategies designed to optimize implementation conditions (ie, implementation leadership, planning, and evaluation; the financial environment; engagement of key stakeholders; patient needs; compatibility with workflow; and clinician and staff knowledge, skills, and attitudes). The implementation intervention was executed from January 2018 to April 2019. Study outcomes included implementation outcomes (ie, provider perceptions of the implementation process and implementation tools [assessed via online provider survey]) and healthcare quality outcomes (ie, trends in prenatal contraceptive counseling, trends in immediate postpartum long-acting reversible contraceptive utilization [both ascertained by institutional administrative data], and the patient experience of contraceptive care [assessed via serial, cross-sectional, online patient survey items adapted from the National Quality Forum-endorsed, validated Person-Centered Contraceptive Counseling measure]). RESULTS: In the implementation process, among 172 of 401 eligible clinicians (43%) participating in surveys, 70% were "extremely" or "somewhat" satisfied with the implementation process overall. In the prenatal contraceptive counseling, among 4960 individuals undergoing childbirth at the study site in 2019, 1789 (36.1%) had documented prenatal counseling about postpartum contraception. Documented counseling rates increased overall throughout 2019 (Q1, 12.5%; Q4, 51.0%) but varied significantly by clinic site (Q4, range 30%-79%). Immediate postpartum long-acting reversible contraception utilization increased throughout the study period (before implementation, 5.46% of deliveries; during implementation, 8.95%; after implementation, 8.58%). In the patient experience of contraceptive care, patient survey respondents (response rate, 15%-29%) were largely White (344/425 [81%]) and highly educated (309/425 [73%] with at least a 4-year college degree), reflecting the study site population. Scores were poor across settings, with modest improvements in the hospital setting from 2018 to 2020 (prenatal visits, 67%-63%; hospitalization, 45%-58%; outpatient after delivery, 69%-65%). Based on these findings, toolkit refinements included additional resources designed to routinize prenatal contraceptive counseling and support a more patient-centered experience of contraceptive care. CONCLUSION: A toolkit-based process to implement immediate postpartum long-acting reversible contraceptive services at a single academic center was associated with high acceptability but mixed healthcare quality outcomes. Toolkit resources were added to optimize counseling rates and the patient experience of contraceptive care. Future research should formally test the effectiveness of the refined toolkit in a multisite, prospective trial.

Improving diagnostic performance through feedback: the Diagnosis Learning Cycle.

BACKGROUND: Errors in reasoning are a common cause of diagnostic error. However, it is difficult to improve performance partly because providers receive little feedback on diagnostic performance. Examining means of providing consistent feedback and enabling continuous improvement may provide novel insights for diagnostic performance. METHODS: We developed a model for improving diagnostic performance through feedback using a six-step qualitative research process, including a review of existing models from within and outside of medicine, a survey, semistructured interviews with individuals working in and outside of medicine, the development of the new model, an interdisciplinary consensus meeting, and a refinement of the model. RESULTS: We applied theory and knowledge from other fields to help us conceptualise learning and comparison and translate that knowledge into an applied diagnostic context. This helped us develop a model, the Diagnosis Learning Cycle, which illustrates the need for clinicians to be given feedback about both their confidence and reasoning in a diagnosis and to be able to seamlessly compare diagnostic hypotheses and outcomes. This information would be stored in a repository to allow accessibility. Such a process would standardise diagnostic feedback and help providers learn from their practice and improve diagnostic performance. This model adds to existing models in diagnosis by including a detailed picture of diagnostic reasoning and the elements required to improve outcomes and calibration. CONCLUSION: A consistent, standard programme of feedback that includes representations of clinicians' confidence and reasoning is a common element in non-medical fields that could be applied to medicine. Adapting this approach to diagnosis in healthcare is a promising next step. This information must be stored reliably and accessed consistently. The next steps include testing the Diagnosis Learning Cycle in clinical settings.

A step toward understanding the mechanism of action of audit and feedback: a qualitative study of implementation strategies.

BACKGROUND: Audit and feedback (A&F) is a widely used implementation strategy. Understanding mechanisms of action of A&F increases the likelihood that the strategy will lead to implementation of an evidence-based practice. We therefore sought to understand one hospital's experience selecting and implementing an A&F intervention, to determine the implementation strategies that were used by staff and to specify the mechanism of action of those implementation strategies using causal pathway models, with the ultimate goal of improving acute stroke treatment practices. METHODS: We selected an A&F strategy in a hospital, initially based on implementation determinants and staff consideration of their performance on acute stroke treatment measures. After 7 months of A&F, we conducted semi-structured interviews of hospital providers and administrative staff to understand how it contributed to implementing guideline-concordant acute stroke treatment (medication named tissue plasminogen activator). We coded the interviews to identify the implementation strategies that staff used following A&F and to assess their mechanisms of action. RESULTS: We identified five implementation strategies that staff used following the feedback intervention. These included (1) creating folders containing the acute stroke treatment protocol for the emergency department, (2) educating providers about the protocol for acute stroke, (3) obtaining computed tomography imaging of stroke patients immediately upon emergency department arrival, (4) increasing access to acute stroke medical treatment in the emergency department, and (5) providing additional staff support for implementation of the protocol in the emergency department. We identified enablement, training, and environmental restructuring as mechanisms of action through which the implementation strategies acted to improve guideline-concordant and timely acute stroke treatment. CONCLUSIONS: A&F of a hospital's acute stroke treatment practices generated additional implementation strategies that acted through various mechanisms of action. Future studies should focus on how initial implementation strategies can be amplified through internal mechanisms.

Visual process maps to support implementation efforts: a case example.

BACKGROUND: Process mapping is often used in quality improvement work to examine current processes and workflow and to identify areas to intervene to improve quality. Our objective in this paper is to describe process maps as a visual means of understanding modifiable behaviors and activities, in this case example to ensure that goals of care conversations are part of admitting a veteran in long-term care settings. METHODS: We completed site visits to 6 VA nursing homes and reviewed their current admission processes. We conducted interviews to document behaviors and activities that occur when a veteran is referred to a long-term care setting, during admission, and during mandatory VA reassessments. We created visualizations of the data using process mapping approaches. Process maps for each site were created to document the admission activities for each VA nursing home and were reviewed by the research team to identify consistencies across sites and to identify potential opportunities for implementing goals of care conversations. RESULTS: We identified five consistent behaviors that take place when a veteran is referred and admitted in long-term care. These behaviors are assessing, discussing, decision-making, documenting, and re-assessing. CONCLUSIONS: Based on the process maps, it seems feasible that the LST note and order template could be completed along with other routine assessment processes. However, this will require more robust multi-disciplinary collaboration among both prescribing and non-prescribing health care providers. Completing the LST template during the current admission process would increase the likelihood that the template is completed in a timely manner, potentially alleviate the perceived time burden, and help with the provision of veteran-centered care.

A Conceptual Framework to Study the Implementation of Clinical Decision Support Systems (BEAR): Literature Review and Concept Mapping.

BACKGROUND: The implementation of clinical decision support systems (CDSSs) as an intervention to foster clinical practice change is affected by many factors. Key factors include those associated with behavioral change and those associated with technology acceptance. However, the literature regarding these subjects is fragmented and originates from two traditionally separate disciplines: implementation science and technology acceptance. OBJECTIVE: Our objective is to propose an integrated framework that bridges the gap between the behavioral change and technology acceptance aspects of the implementation of CDSSs. METHODS: We employed an iterative process to map constructs from four contributing frameworks-the Theoretical Domains Framework (TDF); the Consolidated Framework for Implementation Research (CFIR); the Human, Organization, and Technology-fit framework (HOT-fit); and the Unified Theory of Acceptance and Use of Technology (UTAUT)-and the findings of 10 literature reviews, identified through a systematic review of reviews approach. RESULTS: The resulting framework comprises 22 domains: agreement with the decision algorithm; attitudes; behavioral regulation; beliefs about capabilities; beliefs about consequences; contingencies; demographic characteristics; effort expectancy; emotions; environmental context and resources; goals; intentions; intervention characteristics; knowledge; memory, attention, and decision processes; patient-health professional relationship; patient's preferences; performance expectancy; role and identity; skills, ability, and competence; social influences; and system quality. We demonstrate the use of the framework providing examples from two research projects. CONCLUSIONS: We proposed BEAR (BEhavior and Acceptance fRamework), an integrated framework that bridges the gap between behavioral change and technology acceptance, thereby widening the view established by current models.

What was visualized? A method for describing content of performance summary displays in feedback interventions.

BACKGROUND: Visual displays such as charts and tables may significantly moderate the effects of audit and feedback interventions, but the systematic study of these intervention components will likely remain limited without a method for isolating the information content of a visual display from its form elements. The objective of this study is to introduce such a method based on an application of visualization frameworks to enable a systematic approach to answer the question, "What was visualized?" in studies of audit and feedback. METHODS: The proposed method uses 3 steps to systematically identify and describe the content of visual displays in feedback interventions: 1) identify displays, 2) classify content, and 3) identify elements. The use of a visualization framework led us to identify information content types as representations of measures (metrics or indicators), ascribees (feedback recipients and comparators), performance levels, and time intervals. We illustrate the proposed method in a series of 3 content analyses, one for each step, to identify visual displays and their information content in published example performance summaries. RESULTS: We analyzed a convenience sample of 44 published studies of audit and feedback. Through each step, two coders had good agreement. We identified 42 visual displays of performance, containing 6 unique combinations of content types. What was visualized most commonly in the sample was performance levels across a recipient and comparators (i.e. ascribees) for a single measure and single time interval (n = 16). Content types varied in their inclusion of measures, ascribees, and time intervals. CONCLUSIONS: The proposed method appears to be feasible to use as a systematic approach to describing visual displays of performance. The key implication of the method is that it offers more granular and consistent description for empirical, theoretical, and design studies about the information content of feedback interventions.

Designing clinical practice feedback reports: three steps illustrated in Veterans Health Affairs long-term care facilities and programs.

BACKGROUND: User-centered design (UCD) methods are well-established techniques for creating useful artifacts, but few studies illustrate their application to clinical feedback reports. When used as an implementation strategy, the content of feedback reports depends on a foundational audit process involving performance measures and data, but these important relationships have not been adequately described. Better guidance on UCD methods for designing feedback reports is needed. Our objective is to describe the feedback report design method for refining the content of prototype reports. METHODS: We propose a three-step feedback report design method (refinement of measures, data, and display). The three steps follow dependencies such that refinement of measures can require changes to data, which in turn may require changes to the display. We believe this method can be used effectively with a broad range of UCD techniques. RESULTS: We illustrate the three-step method as used in implementation of goals of care conversations in long-term care settings in the U.S. Veterans Health Administration. Using iterative usability testing, feedback report content evolved over cycles of the three steps. Following the steps in the proposed method through 12 iterations with 13 participants, we improved the usability of the feedback reports. CONCLUSIONS: UCD methods can improve feedback report content through an iterative process. When designing feedback reports, refining measures, data, and display may enable report designers to improve the user centeredness of feedback reports.

Designing Tailored Displays for Clinical Practice Feedback: Developing Requirements with User Stories.

Improving visualizations in clinical quality reports and dashboards may improve the visualization influence on clinical practice. Tailored displays could accommodate individual and situational differences, but these diplays introduce complex requirements across healthcare professionals and teams. We applied user stories, a method for managing complex software requirements, to a user-centered design process for tailored visual displays about postpartum contraception care. We mapped user stories to tailored displays to identify the quantity of displays that were supported by each user story. We developed 9 tailored displays and 11 user stories. Displays varied in their mappings to user stories (mean 5, max 9, min 0), revealing differences in healthcare professionals and teams preferences and information needs. User stories and user-centered design may be useful for healthcare organizations to manage complex requirements of tailored displays in clinical practice feedback.

Clinical performance comparators in audit and feedback: a review of theory and evidence.

BACKGROUND: Audit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator. METHODS: We described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis. RESULTS: We found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies. CONCLUSION: Clinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

Complexities, variations, and errors of numbering within clinical notes: the potential impact on information extraction and cohort-identification.

BACKGROUND: Numbers and numerical concepts appear frequently in free text clinical notes from electronic health records. Knowledge of the frequent lexical variations of these numerical concepts, and their accurate identification, is important for many information extraction tasks. This paper describes an analysis of the variation in how numbers and numerical concepts are represented in clinical notes. METHODS: We used an inverted index of approximately 100 million notes to obtain the frequency of various permutations of numbers and numerical concepts, including the use of Roman numerals, numbers spelled as English words, and invalid dates, among others. Overall, twelve types of lexical variants were analyzed. RESULTS: We found substantial variation in how these concepts were represented in the notes, including multiple data quality issues. We also demonstrate that not considering these variations could have substantial real-world implications for cohort identification tasks, with one case missing > 80% of potential patients. CONCLUSIONS: Numbering within clinical notes can be variable, and not taking these variations into account could result in missing or inaccurate information for natural language processing and information retrieval tasks.

Understanding determinants of acute stroke thrombolysis using the tailored implementation for chronic diseases framework: a qualitative study.

BACKGROUND: The Tailored Implementation in Chronic Disease (TICD) framework is a comprehensive framework describing the determinants of implementation success that has been used extensively in primary care settings. We explored the utility of the TICD to identify determinants of practice in an acute setting, namely guideline concordant acute stroke thrombolysis in a low-resourced, predominately minority serving, large, Emergency Department (ED). METHODS: Through workshops and expert review, we developed an interview guide informed by the TICD framework. We then conducted semi-structured interviews with data collected through written transcripts, audio transcripts or interviewer notes based on participant availability. Three independent coders then performed a content analysis using template analysis, but open to new determinants that arose from the data, into the TICD framework. RESULTS: We performed a total of 15 semi-structured interviews with ED acute stroke providers including medical technicians, nurses, and physicians. We found that guideline factors, individual health professional factors, and patient factors domains were barriers to guideline concordant acute stroke thrombolysis. The domain professional interactions was a facilitator to treatment. We identified three determinants, healthcare professional burnout, health care professional turnover and surrogate decision making, that are not part of the TICD framework. CONCLUSIONS: Most determinants of acute stroke thrombolysis are included within the TICD framework. Inclusion of healthcare professional burnout, healthcare professional turnover and surrogate decision making may assist in expanding the TICD to time-sensitive ED conditions. Further work is needed to confirm this finding and to establish whether the TICD is applicable for use in non-time sensitive ED conditions. Interventions that address guideline, individual health professional and patient factors may improve guideline concordant acute stroke thrombolysis.

Stroke Ready: a multi-level program that combines implementation science and community-based participatory research approaches to increase acute stroke treatment: protocol for a stepped wedge trial.

BACKGROUND: Post-stroke disability is common, costly, and projected to increase. Acute stroke treatments can substantially reduce post-stroke disability, but few patients take advantage of these cost-effective treatments. Practical, cost-efficient, and sustainable interventions to address underutilized acute stroke treatments are currently lacking. In this context, we present the Stroke Ready project, a stepped wedge design, multi-level intervention that combines implementation science and community-based participatory research approaches to increase acute stroke treatments in the predominately African American community of Flint, Michigan, USA. METHODS: Guided by the Tailored Implementation of Chronic Disease (TICD) framework, we begin with optimization of acute stroke care in emergency departments, with particular attention given to our safety-net hospital partners. Then, we move to a community-wide, multi-faceted, stroke preparedness intervention, with workshops led by peer educators, over 2 years. Measures of engagement of the safety-net hospital and the feasibility and sustainability of the implementation strategy as well as community intervention reach, dose delivered, and satisfaction will be collected. The primary outcome is acute stroke treatment rates, which includes both intravenous tissue plasminogen activator, and endovascular treatment. The co-secondary outcomes are intravenous tissue plasminogen activator treatment rates and the proportion of stroke patients who arrive by ambulance. DISCUSSION: If successful, Stroke Ready will increase acute stroke treatment rates through emergency department and community level interventions. The stepped wedge design and process evaluation will provide insight into how Stroke Ready works and where it might work best. By exploring the relative effectiveness of the emergency department optimization and the community intervention, we will inform hospitals and communities as they determine how best to use their resources to optimize acute stroke care. TRIAL REGISTRATION: ClinicalTrials.gov Trial Identifier NCT03645590 .

Comparing a Mobile Decision Support System Versus the Use of Printed Materials for the Implementation of an Evidence-Based Recommendation: Protocol for a Qualitative Evaluation.

BACKGROUND: The distribution of printed materials is the most frequently used strategy to disseminate and implement clinical practice guidelines, although several studies have shown that the effectiveness of this approach is modest at best. Nevertheless, there is insufficient evidence to support the use of other strategies. Recent research has shown that the use of computerized decision support presents a promising approach to address some aspects of this problem. OBJECTIVE: The aim of this study is to provide qualitative evidence on the potential effect of mobile decision support systems to facilitate the implementation of evidence-based recommendations included in clinical practice guidelines. METHODS: We will conduct a qualitative study with two arms to compare the experience of primary care physicians while they try to implement an evidence-based recommendation in their clinical practice. In the first arm, we will provide participants with a printout of the guideline article containing the recommendation, while in the second arm, we will provide participants with a mobile app developed after formalizing the recommendation text into a clinical algorithm. Data will be collected using semistructured and open interviews to explore aspects of behavioral change and technology acceptance involved in the implementation process. The analysis will be comprised of two phases. During the first phase, we will conduct a template analysis to identify barriers and facilitators in each scenario. Then, during the second phase, we will contrast the findings from each arm to propose hypotheses about the potential impact of the system. RESULTS: We have formalized the narrative in the recommendation into a clinical algorithm and have developed a mobile app. Data collection is expected to occur during 2018, with the first phase of analysis running in parallel. The second phase is scheduled to conclude in July 2019. CONCLUSIONS: Our study will further the understanding of the role of mobile decision support systems in the implementation of clinical practice guidelines. Furthermore, we will provide qualitative evidence to aid decisions made by low- and middle-income countries' ministries of health about investments in these technologies.