"We're sinking": a qualitative interview-based study on stakeholder perceptions of structural and process limitations to the Canadian healthcare system.

BACKGROUND: Despite longstanding efforts and calls for reform, Canada's incremental approach to healthcare changes has left the country lagging behind other OECD nations. Reform to the Canadian healthcare system is essential to develop a higher performing system. This study sought to gain a deeper understanding of the views of Canadian stakeholders on structural and process deficiencies and strategies to improve the Canadian healthcare system substantially and meaningfully. METHODS: We conducted individual, ~ 45-minute, semi-structured virtual interviews from May 2022 to August 2022. Using existing contacts and snowball sampling, we targeted one man and one woman from five regions in Canada across four stakeholder groups: (1) public citizens; (2) healthcare leaders; (3) academics; and (4) political decision makers. Interviews centered on participants' perceptions of the state of the current healthcare system, including areas where major improvements are required, and strategies to achieve suggested enhancements; Donabedian's Model (i.e., structure, process, outcomes) was the guiding conceptual framework. Interviews were audio-recorded, transcribed verbatim, and de-identified, and inductive thematic analysis was performed independently and in duplicate according to published methods. RESULTS: The data from 31 interviews with 13 (41.9%) public citizens, 10 (32.3%) healthcare leaders, 4 (12.9%) academics, and 4 (12.9%) political decision makers resulted in three themes related to the structure of the healthcare system (1. system reactivity; 2. linkage with the Canadian identity; and 3. political and funding structures), three themes related to healthcare processes (1. staffing shortages; 2. inefficient care; and 3. inconsistent care), and three strategies to improve short- and long-term population health outcomes (1. delineating roles and revising incentives; 2. enhanced health literacy; 3. interdisciplinary and patient-centred care). CONCLUSION: Canadians in our sample identified important structural and process limitations to the Canadian healthcare system. Meaningful reforms are needed and will require addressing the link between the Canadian identity and our healthcare system to facilitate effective development and implementation of strategies to improve population health outcomes.

Estimating additional health and social costs in eating disorder care for young people during the COVID-19 pandemic: implications for surveillance and system transformation.

BACKGROUND: The impact of the COVID-19 pandemic on young people with eating disorders (EDs) and their families was profound, with surging rates of hospitalizations and referrals reported internationally. This paper provides an account of the additional health and social costs of ED care for young people living in Canada incurred during the COVID-19 pandemic, drawing attention to the available data to inform these estimates while noting gaps in data capacities to account for a full view of the ED system of care. METHODS: Three methodologies were used to capture costs: (1) provincial administrative data holdings available at the Canadian Institute of Health Information (CIHI) were used by Deloitte Access Economics to conduct analyses on costs related to hospitalizations, emergency room visits, outpatient visits with physicians and loss of well-being from being on a waitlist. These were examined across three fiscal years (April 1 to March 31, 2019-2022) to compare costs from one year before to two years after the onset of the pandemic, (2) data collected on support-based community ED organizations and, (3) costs identified by young people, caregivers and health care professionals. RESULTS: Estimates of additional health care costs and social costs arising from ED care waitlists were estimated to have increased by 21% across the two years after the onset of the pandemic and is likely to represent an underestimate of costs. Costs related to some standard ED care services (e.g. day treatment programs) and support-based community ED organizations that saw a 118% increase in services during this time, are some examples of costs not captured in the current cost estimate. CONCLUSIONS: This paper provides a first account of the additional health and social ED care costs associated with the pandemic, which indicate at minimum, a 21% increase. The results invite discussion for more investments in ED services for young people in Canada, as it is unclear if needs are expected to remain elevated. We suggest a call for a national surveillance strategy to improve data holdings to aid in managing services and informing policy. A robust strategy could open the door for much-needed, data-informed, system transformation efforts that can improve ED care for youth, families and clinicians.

The impact of the COVID-19 pandemic on young people with eating disorders and their families was profound, incurring substantial costs to youth, families, health professionals, eating disorder systems of care, and society. This study looks to draw on available data in Canada to estimate the additional health and social costs experienced during the pandemic. Using available national data holdings on eating disorder health system use, survey and discussion groups with individuals who provided or received eating disorder care during the pandemic, and data from support-based community eating disorder organizations, we attempted to capture the fulsomeness of these costs and demonstrate gaps that are likely leading to an incomplete picture. Available data across Canada on hospitalizations, emergency room visits, outpatient visits and loss of wellbeing while on a waitlist were looked at across three fiscal years (April 2019 to March 2022). Overall, an average increase of 21% of additional health care and social costs was seen across the two years after the onset of the pandemic, although this is considered an underestimation. Additional costs such as those for other standard eating disorder treatment options (e.g. day treatment programs) were not captured in these estimates. Additionally, costs related to services received through support-based community eating disorder organizations that saw a 118% increase in services during the pandemic, and private services (e.g. psychologist, dietitian) are some further examples of costs not captured in the current cost estimate. The results of this study highlight that needs and costs related to ED care rose during the pandemic and provides the first account of by how much. Given data limitations, there is a need to revisit national surveillance strategies for eating disorders to help increase accuracy of these estimates and aid in managing services and informing policies related to eating disorder care.

A mapping review of interventions to address patients who frequently seek care in the emergency department.

BACKGROUND: The high utilization of acute care services, particularly emergency departments (ED), continues to be a significant concern for healthcare providers. Numerous approaches have been studied to meet the care needs of patients who frequently seek care in the ED; however, there is no comprehensive review of the current literature base. As such, a current understanding of the interventions initiated within the ED to address the needs of frequent users is required. This mapping review had three objectives: identify the characteristics associated with the need to frequently seek care in the ED; identify interventions implemented to address the needs of this population; and identify gaps in the current evidence base. METHODS: A knowledge map was created by scoping the literature to identify characteristics associated with frequent ED use and interventions implemented to address frequent use. Then, a literature search was conducted to determine what has been implemented by EDs to reduce frequent ED use. The literature was searched from 2013 to January 2023. MeSH terms and keywords were used to identify relevant studies. Studies implementing an intervention for those with characteristics associated with frequent ED use and reporting on ED use were included. RESULTS: Twenty-three (23) controlled trials and 35 observational studies were included. The most common populations were older adults, those with chronic conditions, and generic "frequent users". No studies assessed Indigenous Peoples or racial minorities, and few assessed patients with a disability or patients experiencing homelessness. The most common interventions were referrals, care plans, case management, care coordination, and follow-up phone calls. Most studies reported ED revisits, hospitalization, costs, length-of-stay, or outpatient utilization. Few assessed patient or staff perspectives. About one-third of studies (n = 24) reported significant reductions in ED revisits. CONCLUSIONS: Similar interventions, mainly focused on care coordination and planning, have been implemented to address frequent use of the ED. There are still significant gaps in the populations that have been studied. Efforts now must be undertaken to study more diverse populations whose care needs are not being met elsewhere and thus frequent the ED often.

Strategies for improving ED-related outcomes of older adults who seek care in emergency departments: a systematic review.

BACKGROUND: Despite constituting 14% of the general population, older adults make up almost a quarter of all emergency department (ED) visits. These visits often do not adequately address patient needs, with nearly 80% of older patients discharged from the ED carrying at least one unattended health concern. Many interventions have been implemented and tested in the ED to care for older adults, which have not been recently synthesized. METHODS: A systematic review was conducted to identify interventions initiated in the ED to address the needs of older adults. Embase, MEDLINE, CINAHL, Cochrane CENTRAL, the Cochrane Database of Systematic Reviews, and grey literature were searched from January 2013 to January 18, 2023. Comparative studies assessing interventions for older adults in the ED were included. The quality of controlled trials was assessed with the Cochrane risk-of-bias tool for randomized trials, and the quality of observational studies was assessed with the risk of bias in non-randomized studies of interventions tool. Due to heterogeneity, meta-analysis was not possible. RESULTS: Sixteen studies were included, assessing 12 different types of interventions. Overall study quality was low to moderate: 10 studies had a high risk of bias, 5 had a moderate risk of bias, and only 1 had a low risk of bias. Follow-up telephone calls, referrals, geriatric assessment, pharmacist-led interventions, physical therapy services, care plans, education, case management, home visits, care transition interventions, a geriatric ED, and care coordination were assessed, many of which were combined to create multi-faceted interventions. Care coordination with additional support and early assessment and intervention were the only two interventions that consistently reported improved outcomes. Most studies did not report significant improvements in ED revisits, hospitalization, time spent in the ED, costs, or outpatient utilization. Two studies reported on patient perspectives. CONCLUSION: Few interventions demonstrate promise in reducing ED revisits for older adults, and this review identified significant gaps in understanding other outcomes, patient perspectives, and the effectiveness in addressing underlying health needs. This could suggest, therefore, that most revisits in this population are unavoidable manifestations of frailty and disease trajectory. Efforts to improve older patients' needs should focus on interventions initiated outside the ED.

Early observations of Tier-3 drug shortages on purchasing trends across Canada: A cross-sectional analysis of 3 case-example drugs.

BACKGROUND: To curb the growing impact of drug shortages, Health Canada developed the Tiered Notification and Communication Framework which assigns potential shortages a corresponding tiered status. Tier-3 is assigned to shortages with the greatest potential impact on the healthcare system. This study aims to describe drug purchasing trends in response to Tier-3 shortages using three case-examples. METHODS: We conducted a time-series analysis of monthly purchasing data for three out of 17 Tier-3 drug shortages (hydralazine, sarilumab, and medroxyprogesterone acetate) with publicly available reports in July 2021 and available IQVIA MIDAS data from January 2016 to December 2021. We assessed percent changes in purchasing at 1-, 3-, and 6-months after the onset of each Tier-3 drug shortage and interventional ARIMA modelling was used to assess the statistical significance. RESULTS: Medroxyprogesterone acetate experienced a significant shift (p = 0.0370) in purchasing following its shortage, and the 1-, 3-, and 6-month percent changes were +14.9%, +6.8% and -3.1%, respectively. Hydralazine and sarilumab did not show a significant shift. The 1-, 3-, and 6-month percent changes for hydralazine were +15.5%, +10.2%, and +9.6% respectively and +25.2%, +45.1% and +39.2 for sarilumab. CONCLUSIONS: These results indicate that drugs assigned a Tier-3 status may not show declines in purchasing in the months following status assignment, which may be due to policy responses following the assignment. However, more insight is needed into the mechanisms through which these policy measures impact shortages and whether they are functioning as intended.

Federal and Provincial Governments Need To Be Transparent about Trade-Offs When They Buy Healthcare.

Spending on healthcare is carefully scrutinized by the public, the media and academics because the amounts are so large and represent a very significant proportion of provincial budgets. Some quarters are calling for increases in spending, whereas others are focused on restraint owing to perceived inefficiencies and ineffectiveness. The debate over healthcare spending has continued for decades and is likely to heat up as new provincial labour agreements have locked in annual healthcare spending increases of at least five percent for 2023 (BC Nurses' Union 2023; ONA 2023).

Value-Based Healthcare: Is It Just Another Buzzword?

The concept of value-based healthcare has been gaining traction, with several issues of Healthcare Policy discussing the agenda and highlighting pockets of excellence. However, we currently have no shared common goal that would define value-based healthcare. Furthermore, we have major limitations in measuring both the cost and benefit components of the concept of value, irrespective of the definition. It is time to make progress, which will include a recognition of the need to engage the public in a discussion around the values of the Canadian healthcare system and the federal government taking a hands-on role for the accountability of value as an outcome.

A North Star Vision: Results from a Deliberative Dialogue to Identify Policy Strategies to Improve Value in Healthcare.

We hosted a deliberative dialogue with citizens (n = 3), policy researchers (n = 3), government decision makers (n = 3) and health system leaders (n = 3) to identify evidence-informed policy options to improve the value of Canadian healthcare. The analysis resulted in three themes: (1) the need for a vision to guide reforms, (2) community-based care and (3) community-engaged care. Results suggest the need for a new paradigm: community-focused health systems. Such a paradigm could serve as a North Star guiding healthcare transformation, improving value by aligning citizen and healthcare system goals, prioritizing spending on services that address the social determinants of health and improving quality and equity.

Action, Accountability and Transparency for Indigenous Health Systems Safety.

Anti-Indigenous racism is prevalent in Canada, especially within healthcare systems. Consequences are catastrophic, including deaths of Indigenous patients. Systems change and critical education guided by the Indigenous Peoples and research into how racism operates within healthcare settings are needed. In Alberta, promising initiatives are under way, including a First Nations-led initiative identifying racism and colonialism as key health determinants, novel experiential education, transformative education for senior health leaders and reframing health system measures to reflect Indigenous Peoples' perspectives. The time is now for comprehensive action toward eliminating racism within healthcare systems and fostering Indigenous health systems safety. Indigenous lives depend on it.

Unscheduled general surgery has higher costs for older adults.

BACKGROUND: With health care costs increasing, the cost of caring for older adults is rising. Understanding the costs of surgical care for older adults is crucial in planning for health care services. We hypothesize that increasing age predicts increasing surgical inpatient costs. METHODS: We conducted a retrospective analysis of general surgical inpatient costs at 4 hospitals over 2 fiscal years. We assessed the cost and number of procedures by age, procedure, hospital, cost category and surgical urgency. Costs were compared between surgical risk profile, urgency and age. Cost differences of 10% or more were considered clinically important. RESULTS: We examined the surgical inpatient costs for 12 070 procedures, representing 84% of all admissions in the region. The average cost was $4351 for scheduled admissions and $4054 for unscheduled admissions. Only unscheduled admissions resulted in higher costs in older age groups, more than doubling in patients aged 80 years and older undergoing low- and moderate-risk unscheduled surgery. The higher costs for older adults was primarily because of higher postoperative costs. In addition, the screening of candidates for elective surgery may have resulted in preoperative medical optimization leading to decreased admission costs. CONCLUSION: Older adults requiring surgery incur increased costs only if admitted for emergency surgery. The cost increase associated with unscheduled admissions was primarily for increased postoperative costs. Innovative programs to reduce costs for postoperative care for older adults undergoing emergency surgery should be investigated.

The Building Emotional Awareness and Mental health (BEAM) program developed with a community partner for mothers of infants: protocol for a feasibility randomized controlled trial.

BACKGROUND: Drastic increases in the rates of maternal depression and anxiety have been reported since the COVID-19 pandemic began. Most programs aim to improve maternal mental health or parenting skills separately, despite it being more effective to target both concurrently. The Building Emotional Awareness and Mental health (BEAM) program was developed to address this gap. BEAM is a mobile health program aiming to mitigate the impacts of pandemic stress on family well-being. Since many family agencies lack infrastructure and personnel to adequately treat maternal mental health concerns, a partnership will occur with Family Dynamics (a local family agency) to address this unmet need. The study's objective is to examine the feasibility of the BEAM program when delivered with a community partner to inform a larger randomized controlled trial (RCT). METHODS: A pilot RCT will be conducted with mothers who have depression and/or anxiety with a child 6-18 months old living in Manitoba, Canada. Mothers will be randomized to the 10 weeks of the BEAM program or a standard of care (i.e., MoodMission). Back-end App data (collected via Google Analytics and Firebase) will be used to examine feasibility, engagement, and accessibility of the BEAM program; cost-effectiveness will also be examined. Implementation elements (e.g., maternal depression [Patient Health Questionnaire-9] and anxiety [Generalized Anxiety Disorder-7]) will be piloted to estimate the effect size and variance for future sample size calculations. DISCUSSION: In partnership with a local family agency, BEAM holds the potential to promote maternal-child health via a cost-effective and an easily accessible program designed to scale. Results will provide insight into the feasibility of the BEAM program and will inform future RCTs. TRIAL REGISTRATION {2A}: This trial was retrospectively registered with ClinicalTrial.gov ( NCT05398107 ) on May 31st, 2022.

Uptake and Spending on Biosimilar Infliximab and Etanercept After New Start and Switching Policies in Canada: An Interrupted Time Series Analysis.

OBJECTIVE: Uptake of biosimilars has been suboptimal in North America. This study was undertaken to quantify the impact of various policy interventions (namely, new start and switching policies) on uptake and spending on biosimilar infliximab and etanercept in British Columbia (BC), Canada. METHODS: We used administrative claims data to identify BC residents ≥18 years of age with rheumatoid arthritis, ankylosing spondylitis, psoriatic arthritis, and/or plaque psoriasis who qualified for public drug coverage from January 2013 to November 2020. Using interrupted time series analysis, we studied the change in proportion spent on and prescriptions dispensed of biosimilar infliximab and etanercept out of the total amount per agent after new start and biosimilar switching policies were implemented. RESULTS: Our study included 208,984 individuals living with rheumatoid arthritis, ankylosing spondylitis, plaque psoriasis, and/or psoriatic arthritis, corresponding to 5,884 patients taking infliximab and etanercept. After the new start policy, we detected a small gradual increase in the proportion of dispensed biosimilar etanercept prescriptions of 0.65% per month (95% confidence interval [95% CI] 0.44, 0.85). The trend related to the proportion of total spending on biosimilar etanercept also increased (0.51% [95% CI 0.28, 0.73]). After the switching policy, there was a sustained increase in the proportion of dispensed biosimilar etanercept and infliximab prescriptions of 76.98% (95% CI 75.56, 78.41) and 58.43% (95% CI 52.11, 64.75), respectively. Similarly, there was a persistent increase in monthly spending on biosimilar etanercept and infliximab of 78.22% (95% CI 76.65, 79.79) and 71.23% (95% CI 66.82, 75.65), respectively. CONCLUSION: We found that mandatory switching policies were much more effective than new starting policies for increasing the use of biosimilar medications.

Academic Productivity of Equity-Deserving Physician Scholars During COVID-19: A Scoping Review.

PURPOSE: The COVID-19 pandemic presented new barriers and exacerbated existing inequities for physician scholars. While COVID-19's impact on academic productivity among women has received attention, the pandemic may have posed additional challenges for scholars from a wider range of equity-deserving groups, including those who hold multiple equity-deserving identities. To examine this concern, the authors conducted a scoping review of the literature through an intersectionality lens. METHOD: The authors searched peer-reviewed literature published March 1, 2020, to December 16, 2021, in Ovid MEDLINE, Ovid Embase, and PubMed. The authors excluded studies not written in English and/or outside of academic medicine. From included studies, they extracted data regarding descriptions of how COVID-19 impacted academic productivity of equity-deserving physician scholars, analyses on the pandemic's reported impact on productivity of physician scholars from equity-deserving groups, and strategies provided to reduce the impact of the COVID-19 pandemic on academic productivity of physician scholars from equity-deserving groups. RESULTS: Of 11,587 unique articles, 44 met inclusion criteria, including 15 nonempirical studies and 29 empirical studies (22 bibliometrics studies, 6 surveys, and 1 qualitative study). All included articles focused on the gendered impact of the pandemic on academic productivity. The majority of their recommendations focused on how to alleviate the burden of the pandemic on women, particularly those in the early stages of their career and/or with children, without consideration of scholars who hold multiple and intersecting identities from a wider range of equity-deserving groups. CONCLUSIONS: Findings indicate a lack of published literature on the pandemic's impact on physician scholars from equity-deserving groups, including a lack of consideration of physician scholars who experience multiple forms of discrimination. Well-intentioned measures by academic institutions to reduce the impact on scholars may inadvertently risk reproducing and sustaining inequities that equity-deserving scholars faced during the pandemic.

Risk of transmission of respiratory viruses during aerosol-generating medical procedures (AGMPs) revisited in the COVID-19 pandemic: a systematic review.

BACKGROUND: In many jurisdictions healthcare workers (HCWs) are using respirators for aerosol-generating medical procedures (AGMPs) performed on adult and pediatric populations with all suspect/confirmed viral respiratory infections (VRIs). This systematic review assessed the risk of VRIs to HCWs in the presence of AGMPs, the role respirators versus medical/surgical masks have on reducing that risk, and if the risk to HCWs during AGMPs differed when caring for adult or pediatric patient populations. MAIN TEXT: We searched MEDLINE, EMBASE, Cochrane Central, Cochrane SR, CINAHL, COVID-19 specific resources, and MedRxiv for English and French articles from database inception to September 9, 2021. Independent reviewers screened abstracts using pre-defined criteria, reviewed full-text articles, selected relevant studies, abstracted data, and conducted quality assessments of all studies using the ROBINS-I risk of bias tool. Disagreements were resolved by consensus. Thirty-eight studies were included; 23 studies on COVID-19, 10 on SARS, and 5 on MERS/ influenza/other respiratory viruses. Two of the 16 studies which assessed associations found that HCWs were 1.7 to 2.5 times more likely to contract COVID-19 after exposure to AGMPs vs. not exposed to AGMPs. Eight studies reported statistically significant associations for nine specific AGMPs and transmission of SARS to HCWS. Intubation was consistently associated with an increased risk of SARS. HCWs were more likely (OR 2.05, 95% CI 1.2-3.4) to contract human coronaviruses when exposed to an AGMP in one study. There were no reported associations between AGMP exposure and transmission of influenza or in a single study on MERS. There was limited evidence supporting the use of a respirator over a medical/surgical mask during an AGMP to reduce the risk of viral transmission. One study described outcomes of HCWs exposed to a pediatric patient during intubation. CONCLUSION: Exposure to an AGMP may increase the risk of transmission of COVID-19, SARS, and human coronaviruses to HCWs, however the evidence base is heterogenous and prone to confounding, particularly related to COVID-19. There continues to be a significant research gap in the epidemiology of the risk of VRIs among HCWs during AGMPs, particularly for pediatric patients. Further evidence is needed regarding what constitutes an AGMP.

The lived experience by patients and family members of extracorporeal membrane oxygenation: A qualitative study.

OBJECTIVE: To examine the lived experience of extracorporeal membrane oxygenation (ECMO) by patients and their families, and their relationship with intensive care clinicians. RESEARCH METHODOLOGY: Semi-structured interviews were conducted with six patients who had received ECMO and with four of their family members. The data were analysed narratively using a constant comparative method. SETTING: Patients were treated at a major acute care hospital in British Columbia between 2014 and 2021. ECMO was used either as a bridge to recovery or to organ transplant. Four had family members bedside throughout, while two had virtual visits due to COVID-19 infection control measures. FINDINGS: ECMO was experienced through a triad of relationships between the patient, key family members and key clinicians. The strength, directionality and focus of these relationships shifted during therapy and realigned once ECMO was removed. The largest shift involved family members. Post-ECMO, patients relied almost entirely on spouses, adult children and clinical team members to reconstruct their experience. The connection between families and clinical team members was limited and changed little. CONCLUSIONS: The lived experience of ECMO was complex in ways yet to be comprehensively reported in the literature. This technology had particular impact on family members when ECMO was used as a bridge to transplant and where run times extended to multiple weeks. COVID-19 infection control restrictions further complicated how this technology was experienced. Findings from this study highlight the importance of intensive care nurses recognising the critical role family members play as witnesses whose experiences later allow patients to make sense of their journey post-discharge.

A multi-step approach to developing a health system evaluation framework for community-based health care.

BACKGROUND: Community-based health care (CBHC) is a shift towards healthcare integration and community services closer to home. Variation in system approaches harkens the need for a conceptual framework to evaluate outcomes and impacts. We set out to develop a CBHC-specific evaluation framework in the context of a provincial ministry of health planning process in Canada. METHODS: A multi-step approach was used to develop the CBHC evaluation framework. Modified Delphi informed conceptualization and prioritization of indicators. Formative research identified evaluation framework elements (triple aim, global measures, and impact), health system levels (tiers), and potential CBHC indicators (n = 461). Two Delphi rounds were held. Round 1, panelists independently ranked indicators on CBHC relevance and health system tiering. Results were analyzed by coding agreement/disagreement frequency and central tendency measures. Round 2, a consensus meeting was used to discuss disagreement, identify Tier 1 indicators and concepts, and define indicators not relevant to CBHC (Tier 4). Post-Delphi, indicators and concepts were refined, Tier 1 concepts mapped to the evaluation framework, and indicator narratives developed. Three stakeholder consultations (scientific, government, and public/patient communities) were held for endorsement and recommendation. RESULTS: Round 1 Delphi results showed agreement for 300 and disagreement for 161 indicators. Round 2 consensus resulted in 103 top tier indicators (Tier 1 = 19, Tier 2 = 84), 358 bottom Tier 3 and 4 indicators, non-CBHC measure definitions, and eight Tier 1 indicator concepts-Mortality/Suicide; Quality of Life, and Patient Reported Outcome Measures; Global Patient Reported Experience Measures; Cost of Care, Access to Integrated Primary Care; Avoidable Emergency Department Use; Avoidable Hospitalization; and E-health Penetration. Post Delphi results refined Tier 3 (n = 289) and 4 (n = 69) indicators, and identified 18 Tier 2 and 3 concepts. When mapped to the evaluation framework, Tier 1 concepts showed full coverage across the elements. 'Indicator narratives' depicted systemness and integration for evaluating CBHC. Stakeholder consultations affirmed endorsement of the approach and evaluation framework; refined concepts; and provided key considerations to further operationalize and contextualize indicators, and evaluate CBHC as a health system approach. CONCLUSIONS: This research produced a novel evaluation framework to conceptualize and evaluate CBHC initiatives. The evaluation framework revealed the importance of a health system approach for evaluating CBHC.