Virtual Peer-to-Peer Learning to Enhance and Accelerate the Health System Response to COVID-19: The HHS ASPR Project ECHO COVID-19 Clinical Rounds Initiative.

Tasked with identifying digital health solutions to support dynamic learning health systems and their response to COVID-19, the US Department of Health and Human Services Office of the Assistant Secretary for Preparedness and Response partnered with the University of New Mexico's Project ECHO and more than 2 dozen other organizations and agencies to create a real-time virtual peer-to-peer clinical education opportunity: the COVID-19 Clinical Rounds Initiative. Focused on 3 "pressure points" in the COVID-19 continuum of care-(1) the out-of-hospital and/or emergency medical services setting, (2) emergency departments, and (3) inpatient critical care environments-the initiative has created a massive peer-to-peer learning network for real-time information sharing, engaging participants in all 50 US states and more than 100 countries. One hundred twenty-five learning sessions had been conducted between March 24, 2020 and February 25, 2021, delivering more than 58,000 total learner-hours of contact in the first 11 months of operation.

Burnout, Compassion Fatigue, and the Long Haul of Caring for Long COVID.

The current landscape of clinician burnout is prompting the need for our health care system to revise its approach toward complex conditions such as long coronavirus disease (COVID), myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS), and other postinfectious fatiguing illnesses (PIFIs). We discuss our efforts here at Family Health Center of San Diego (FHCSD) to help share insight and glean perspective from clinicians who have participated in our Centers for Disease Control and Prevention (CDC)-funded 3-year continuing professional development initiative. The Long COVID and Fatiguing Illness Recovery Program uses multidisciplinary team-based case consultation and peer-to-peer sharing of emerging best and promising practices (ie, teleECHO [Extension for Community Healthcare Outcomes]) to support the management of complex cases associated with long COVID, ME/CFS, and other PIFIs. We believe that this perspective captures a key moment in the trajectory of postpandemic clinician burnout and prompts further reflection and action from the health care system to improve clinician- and patient-level outcomes related to the care of patients with postinfectious fatiguing illnesses.

Large-Scale Telemedicine Implementation for Outpatient Clinicians: Results From a Pandemic-Adapted Learning Collaborative.

Learning collaboratives are seldom used outside of health care quality improvement. We describe a condensed, 10-week learning collaborative ("Telemedicine Hack") that facilitated telemedicine implementation for outpatient clinicians early in the COVID-19 pandemic. Live attendance averaged 1688 participants per session. Of 1005 baseline survey respondents, 57% were clinicians with one-third identifying as from a racial/ethnic minoritized group. Practice characteristics included primary care (71%), rural settings (51%), and community health centers (28%). Of three surveys, a high of 438 (81%) of 540 clinicians had billed ≥1 video-based telemedicine visit. Our learning collaborative "sprint" is a promising model for scaling knowledge during emergencies and addressing health inequities.

A technology-enabled multi-disciplinary team-based care model for the management of Long COVID and other fatiguing illnesses within a federally qualified health center: protocol for a two-arm, single-blind, pragmatic, quality improvement professional cluster randomized controlled trial.

BACKGROUND: The clinical burden of Long COVID, myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS), and other post-infectious fatiguing illnesses (PIFI) is increasing. There is a critical need to advance understanding of the effectiveness and sustainability of innovative approaches to clinical care of patients having these conditions. METHODS: We aim to assess the effectiveness of a Long COVID and Fatiguing Illness Recovery Program (LC&FIRP) in a two-arm, single-blind, pragmatic, quality improvement, professional cluster, randomized controlled trial in which 20 consenting clinicians across primary care clinics in a Federally Qualified Health Center system in San Diego, CA, will be randomized at a ratio of 1:1 to either participate in (1) weekly multi-disciplinary team-based case consultation and peer-to-peer sharing of emerging best practices (i.e., teleECHO (Extension for Community Healthcare Outcomes)) with monthly interactive webinars and quarterly short courses or (2) monthly interactive webinars and quarterly short courses alone (a control group); 856 patients will be assigned to participating clinicians (42 patients per clinician). Patient outcomes will be evaluated according to the study arm of their respective clinicians. Quantitative and qualitative outcomes will be measured at 3- and 6-months post-baseline for clinicians and every 3-months post assignment to a participating clinician for patients. The primary patient outcome is change in physical function measured using the Patient-Reported Outcomes Measurement Information System (PROMIS)-29. Analyses of differences in outcomes at both the patient and clinician levels will include a linear mixed model to compare change in outcomes from baseline to each post-baseline assessment between the randomized study arms. A concurrent prospective cohort study will compare the LC&FIRP patient population to the population enrolled in a university health system. Longitudinal data analysis approaches will allow us to examine differences in outcomes between cohorts. DISCUSSION: We hypothesize that weekly teleECHO sessions with monthly interactive webinars and quarterly short courses will significantly improve clinician- and patient-level outcomes compared to the control group. This study will provide much needed evidence on the effectiveness of a technology-enabled multi-disciplinary team-based care model for the management of Long COVID, ME/CFS, and other PIFI within a federally qualified health center. TRIAL REGISTRATION: ClinicalTrials.gov, NCT05167227 . Registered on December 22, 2021.

Appreciative inquiry and the co-creation of an evaluation framework for Extension for Community Healthcare Outcomes (ECHO) implementation: a two-country experience.

Persistent gaps exist in healthcare workers' capacity to address HIV and tuberculosis in Asia and Africa due to constraints in resources and knowledge. Project ECHO (Extension for Community Healthcare Outcomes) leverages video-enabled technology to build workforce capacity and promote collaboration through mentorship and case-based learning. To understand current perceptions of ECHO participants and develop a comprehensive evaluation framework for ECHO implementation, we utilized modified appreciative inquiry guided focus group discussions (FGD) in India and Tanzania and called it SCORE (Strengths, Challenges, Opportunities, Results, and Evaluation). Content and thematic analysis of transcripts from FGDs and key-informant interviews triangulated perceptions of diverse stakeholders about ECHO implementation and identified key elements for development of the framework. The perceived strengths (S) were capacity building and establishing communities of practice. The perceived challenges (C) included securing resources, engaging leadership, and building systems for monitoring impact. Improved internet connectivity, addressing logistical challenges, encouraging session interactivity, and having strategic scale-up plans were perceived opportunities (O). Additionally, gathering measurable results (R) led to development of a comprehensive evaluation (E) framework. Contextualizing and facilitating SCORE with qualitative analysis of findings 6-12 months post-ECHO implementation may serve as a best practice to assess mid-course corrections to improve ECHO implementation quality.

Facilitating Real-Time, Multidirectional Learning for Clinicians in a Low-Evidence Pandemic Response.

As COVID-19 was declared a health emergency in March 2020, there was immense demand for information about the novel pathogen. This paper examines the clinician-reported impact of Project ECHO COVID-19 Clinical Rounds on clinician learning. Primary sources of study data were Continuing Medical Education (CME) Surveys for each session from the dates of March 24, 2020 to July 30, 2020 and impact surveys conducted in November 2020, which sought to understand participants' overall assessment of sessions. Quantitative analyses included descriptive statistics and Mann-Whitney testing. Qualitative data were analyzed through inductive thematic analysis. Clinicians rated their knowledge after each session as significantly higher than before that session. 75.8% of clinicians reported they would 'definitely' or 'probably' use content gleaned from each attended session and clinicians reported specific clinical and operational changes made as a direct result of sessions. 94.6% of respondents reported that COVID-19 Clinical Rounds helped them provide better care to patients. 89% of respondents indicated they 'strongly agree' that they would join ECHO calls again.COVID-19 Clinical Rounds offers a promising model for the establishment of dynamic peer-to-peer tele-mentoring communities for low or no-notice response where scientifically tested or clinically verified practice evidence is limited.

A Protocol for a Comprehensive Monitoring and Evaluation Framework With a Compendium of Tools to Assess Quality of Project ECHO (Extension for Community Healthcare Outcomes) Implementation Using Mixed Methods, Developmental Evaluation Design.

Introduction: The United States Centers for Disease Control and Prevention (CDC), through U.S. President's Emergency Plan for AIDS Relief (PEPFAR), supports a third of all people receiving HIV care globally. CDC works with local partners to improve methods to find, treat, and prevent HIV and tuberculosis. However, a shortage of trained medical professionals has impeded efforts to control the HIV epidemic in Sub-Saharan Africa and Asia. The Project Extension for Community Healthcare Outcomes (ECHOTM) model expands capacity to manage complex diseases, share knowledge, disseminate best practices, and build communities of practice. This manuscript describes a practical protocol for an evaluation framework and toolkit to assess ECHO implementation. Methods and Analysis: This mixed methods, developmental evaluation design uses an appreciative inquiry approach, and includes a survey, focus group discussion, semi-structured key informant interviews, and readiness assessments. In addition, ECHO session content will be objectively reviewed for accuracy, content validity, delivery, appropriateness, and consistency with current guidelines. Finally, we offer a mechanism to triangulate data sources to assess acceptability and feasibility of the evaluation framework and compendium of monitoring and evaluation tools. Expected impact of the study on public health: This protocol offers a unique approach to engage diverse group of stakeholders using an appreciative inquiry process to co-create a comprehensive evaluation framework and a compendium of assessment tools. This evaluation framework utilizes mixed methods (quantitative and qualitative data collection tools), was pilot tested in Tanzania, and has the potential for contextualized use in other countries who plan to evaluate their Project ECHO implementation.

Project ECHO: A Telementoring Network Model for Continuing Professional Development.

INTRODUCTION: A major challenge with current systems of CME is the inability to translate the explosive growth in health care knowledge into daily practice. Project ECHO (Extension for Community Healthcare Outcomes) is a telementoring network designed for continuing professional development (CPD) and improving patient outcomes. The purpose of this article was to describe how the model has complied with recommendations from several authoritative reports about redesigning and enhancing CPD. METHODS: This model links primary care clinicians through a knowledge network with an interprofessional team of specialists from an academic medical center who provide telementoring and ongoing education enabling community clinicians to treat patients with a variety of complex conditions. Knowledge and skills are shared during weekly condition-specific videoconferences. RESULTS: The model exemplifies learning as described in the seven levels of CPD by Moore (participation, satisfaction, learning, competence, performance, patient, and community health). The model is also aligned with recommendations from four national reports intended to redesign knowledge transfer in improving health care. Efforts in learning sessions focus on information that is relevant to practice, focus on evidence, education methodology, tailoring of recommendations to individual needs and community resources, and interprofessionalism. DISCUSSION: Project ECHO serves as a telementoring network model of CPD that aligns with current best practice recommendations for CME. This transformative initiative has the potential to serve as a leading model for larger scale CPD, nationally and globally, to enhance access to care, improve quality, and reduce cost.

Patient and Other Stakeholder Engagement in Patient-Centered Outcomes Research Institute Funded Studies of Patients with Kidney Diseases.

Including target populations in the design and implementation of research trials has been one response to the growing health disparities endemic to our health care system, as well as an aid to study generalizability. One type of community-based participatory research is "Patient Centered-Research", in which patient perspectives on the germane research questions and methodologies are incorporated into the study. The Patient-Centered Outcomes Research Institute (PCORI) has mandated that meaningful patient and stakeholder engagement be incorporated into all applications. As of March 2015, PCORI funded seven clinically-focused studies of patients with kidney disease. The goal of this paper is to synthesize the experiences of these studies to gain an understanding of how meaningful patient and stakeholder engagement can occur in clinical research of kidney diseases, and what the key barriers are to its implementation. Our collective experience suggests that successful implementation of a patient- and stakeholder-engaged research paradigm involves: (1) defining the roles and process for the incorporation of input; (2) identifying the particular patients and other stakeholders; (3) engaging patients and other stakeholders so they appreciate the value of their own participation and have personal investment in the research process; and (4) overcoming barriers and challenges that arise and threaten the productivity of the collaboration. It is our hope that the experiences of these studies will further interest and capacity for incorporating patient and stakeholder perspectives in research of kidney diseases.