Data envelopment analysis to evaluate the efficiency of tobacco treatment programs in the NCI Moonshot Cancer Center Cessation Initiative.

BACKGROUND: The Cancer Center Cessation Initiative (C3I) is a National Cancer Institute (NCI) Cancer Moonshot Program that supports NCI-designated cancer centers developing tobacco treatment programs for oncology patients who smoke. C3I-funded centers implement evidence-based programs that offer various smoking cessation treatment components (e.g., counseling, Quitline referrals, access to medications). While evaluation of implementation outcomes in C3I is guided by evaluation of reach and effectiveness (via RE-AIM), little is known about technical efficiency-i.e., how inputs (e.g., program costs, staff time) influence implementation outcomes (e.g., reach, effectiveness). This study demonstrates the application of data envelopment analysis (DEA) as an implementation science tool to evaluate technical efficiency of C3I programs and advance prioritization of implementation resources. METHODS: DEA is a linear programming technique widely used in economics and engineering for assessing relative performance of production units. Using data from 16 C3I-funded centers reported in 2020, we applied input-oriented DEA to model technical efficiency (i.e., proportion of observed outcomes to benchmarked outcomes for given input levels). The primary models used the constant returns-to-scale specification and featured cost-per-participant, total full-time equivalent (FTE) effort, and tobacco treatment specialist effort as model inputs and reach and effectiveness (quit rates) as outcomes. RESULTS: In the DEA model featuring cost-per-participant (input) and reach/effectiveness (outcomes), average constant returns-to-scale technical efficiency was 25.66 (SD = 24.56). When stratified by program characteristics, technical efficiency was higher among programs in cohort 1 (M = 29.15, SD = 28.65, n = 11) vs. cohort 2 (M = 17.99, SD = 10.16, n = 5), with point-of-care (M = 33.90, SD = 28.63, n = 9) vs. no point-of-care services (M = 15.59, SD = 14.31, n = 7), larger (M = 33.63, SD = 30.38, n = 8) vs. smaller center size (M = 17.70, SD = 15.00, n = 8), and higher (M = 29.65, SD = 30.99, n = 8) vs. lower smoking prevalence (M = 21.67, SD = 17.21, n = 8). CONCLUSION: Most C3I programs assessed were technically inefficient relative to the most efficient center benchmark and may be improved by optimizing the use of inputs (e.g., cost-per-participant) relative to program outcomes (e.g., reach, effectiveness). This study demonstrates the appropriateness and feasibility of using DEA to evaluate the relative performance of evidence-based programs.

Integrating Tobacco Treatment Into Oncology Care: Reach and Effectiveness of Evidence-Based Tobacco Treatment Across National Cancer Institute-Designated Cancer Centers.

PURPOSE: Quitting smoking improves patients' clinical outcomes, yet smoking is not commonly addressed as part of cancer care. The Cancer Center Cessation Initiative (C3I) supports National Cancer Institute-designated cancer centers to integrate tobacco treatment programs (TTPs) into routine cancer care. C3I centers vary in size, implementation strategies used, and treatment approaches. We examined associations of these contextual factors with treatment reach and smoking cessation effectiveness. METHODS: This cross-sectional study used survey data from 28 C3I centers that reported tobacco treatment data during the first 6 months of 2021. Primary outcomes of interest were treatment reach (reach)-the proportion of patients identified as currently smoking who received at least one evidence-based tobacco treatment component (eg, counseling and pharmacotherapy)-and smoking cessation effectiveness (effectiveness)-the proportion of patients reporting 7-day point prevalence abstinence at 6-month follow-up. Center-level differences in reach and effectiveness were examined by center characteristics, implementation strategies, and tobacco treatment components. RESULTS: Of the total 692,662 unique patients seen, 44,437 reported current smoking. Across centers, a median of 96% of patients were screened for tobacco use, median smoking prevalence was 7.4%, median reach was 15.4%, and median effectiveness was 18.4%. Center-level characteristics associated with higher reach included higher smoking prevalence, use of center-wide TTP, and lower patient-to-tobacco treatment specialist ratio. Higher effectiveness was observed at centers that served a larger overall population and population of patients who smoke, reported a higher smoking prevalence, and/or offered electronic health record referrals via a closed-loop system. CONCLUSION: Whole-center TTP implementation among inpatients and outpatients, and increasing staff-to-patient ratios may improve TTP reach. Designating personnel with tobacco treatment expertise and resources to increase tobacco treatment dose or intensity may improve smoking cessation effectiveness.

An Evaluation of the Process and Quality Improvement Measures of the University of Virginia Cancer Center Tobacco Treatment Program.

Tobacco use after a cancer diagnosis can increase risk of disease recurrence, increase the likelihood of a second primary cancer, and negatively impact treatment efficacy. The implementation of system-wide comprehensive tobacco cessation in the oncology setting has historically been low, with over half of cancer clinicians reporting that they do not treat or provide a referral to cessation resources. This quality improvement study evaluated the procedures for assessing and documenting tobacco use among cancer survivors and referring current smokers to cessation resources at the University of Virginia Cancer Center. Process mapping revealed 20 gaps across two major domains: electronic health record (EHR), and personnel barriers. The top identified priority was inconsistent documentation of tobacco use status as it impacted several downstream gaps. Eleven of the 20 gaps were deemed a high priority, and all were addressed during the implementation of the resulting Tobacco Treatment Program. Prioritized gaps were addressed using a combination of provider training, modifications to clinical workflow, and EHR modifications. Since implementation of solutions, the number of unique survivors receiving cessation treatment has increased from 284 survivors receiving cessation support during Year 1 of the initiative to 487 in Year 3. The resulting Tobacco Treatment Program provides a systematic, personalized, and sustainable comprehensive cessation program that optimizes the multifaceted workflow of the Cancer Center and has the potential to reduce tobacco use in a population most in need of cessation support.