Participant Assessment of an Alternative Flexible Congregate Nutrition Meal Program for Older Adults.

Congregate Nutrition Services have long been a pillar of public health assistance, championing the independence and community engagement of older Americans. The advent of COVID-19, however, restricted access to these services due to the closure of physical locations. In response, Lanakila Meals on Wheels initiated a virtual congregate meal program, Kupuna U, in collaboration with community partners in Honolulu County. The program combined grab-and-go or home-delivered meals with virtual and in-person classes to improve both nutrition and socialization for older adults. This study aimed to capture participant feedback to assess and enhance the Kupuna U program, developing it as a flexible and scalable congregate meal solution applicable nationwide. Five focus group discussions were conducted with program participants (n = 34). The majority of participants were female (74%), Asian (73%), and living alone (56%). Participants found the program beneficial, enhancing their nutrition, social engagement, and learning experiences on various topics tailored for older adults. Supportive staff played a crucial role in motivating participants to stay engaged. Participants also identified potential enhancements to the program, including more activities and courses, expanded hours, additional in-person options at various locations, and culturally tailored meals.

Stroke Prevention and Management in Rural Georgia: Evaluating the Effectiveness of a Community Paramedicine Program.

CONTEXT: Stroke remains a major public health concern in the state of Georgia with high mortality, disproportionately affecting rural and socioeconomically disadvantaged communities. Georgia's age-standardized stroke death rate is 10.8% higher than the national average, and related comorbidities remain elevated in adult Georgians, contributing to higher stroke prevalence. PROGRAM: The Georgia Department of Public Health piloted a Community Paramedicine (CP) program in 2 rural counties to improve stroke management, readmissions, and mortality. Various supportive interventions to address barriers to chronic disease management were provided by a local emergency medical service agency for 90 days. This study aims to evaluate the effectiveness of the CP care delivery model in improving stroke outcomes among high-risk individuals. IMPLEMENTATION: CP leverages emergency medical service infrastructure to provide community health services such as home visits, telemedicine, care coordination, education, and access to social support services. The Georgia Hospital Discharge data and Georgia death records were used to measure stroke rehospitalization and deaths at 30, 60, and 90 days post-discharge for stroke. We compared the health outcomes of high-risk individuals who participated in the CP program to those who did not. EVALUATION: Multivariable analysis suggested a reduction in stroke mortality rates among the intervention groups in both counties. DISCUSSION: The CP program demonstrated effectiveness in assisting patients with managing risk factors through medication adherence for conditions such as hypertension, hypercholesterolemia, and diabetes.

Evaluation of a Cardiovascular Disease/Diabetes Mellitus Expansion Program for Community Health Workers Employed by Rhode Island Community Health Teams.

CONTEXT: The integration of certified community health workers (CCHWs) with specialty chronic disease training into clinical care teams has demonstrated improvements in chronic disease quality of care, management, and outcomes. PROGRAM: Rhode Island Department of Health's Diabetes, Heart Disease, and Stroke Program expanded the roles of CCHWs employed by Community Health Teams for chronic disease with a focus on cardiovascular disease (CVD) and diabetes mellitus (DM) from 2020 to 2023. Rhode Island Department of Health's Diabetes, Heart Disease, and Stroke Program sought to determine whether patient health behaviors and clinical outcomes improved with specialty trained CCHW support. IMPLEMENTATION: Community Health Teams identified high-risk or rising-risk patients with hypertension, high cholesterol, and/or diabetes. During an infrastructure phase, patients were assigned a CCHW who had not received CVD/DM specialty training. During a performance phase, a separate cohort of patients was assigned a CVD/DM specialty-trained CCHW. In each phase, patients were seen by the CCHWs at least twice and completed baseline and follow-up health assessments. The trained CCHWs utilized the baseline assessment to offer health coaching specific to the patient's chronic disease-related needs. EVALUATION: Improvements in blood pressure readings and cholesterol were observed at an individual level for CVD patients. However, a significant difference was not observed for hypertension or high cholesterol when comparing phases. Individual-level results indicated improved HbA1c values for DM patients; however, the differences in clinical values were not significant. Although there were no significant differences for clinical values between the phases, the proportion of patients who reported confidence in managing their condition(s) increased from baseline to follow-up for both phases. DISCUSSION: It cannot be concluded that specialty-trained CCHWs have significant impact on patient behaviors and clinical outcomes. However, overall CCHW intervention did result in improved self-efficacy in patients to manage their chronic conditions. Further evaluation is needed to understand what factors led to improved patient confidence levels.

Outcome Evaluation of a Public Health Intervention on Cardiovascular Disease (CVD) Prevention Among Women Aged 40-64 with Low Incomes in Nebraska.

OBJECTIVES: To evaluate the effectiveness of the program interventions on cardiovascular disease in Nebraska women who are low income and have no health insurance. DESIGN: This evaluation used pre- and post-comparison approach. Paired t test and McNemar's test were used to examine the changes after the program interventions. PARTICIPANTS: Nebraska women aged 40 to 64 years, without health insurance, and with household incomes up to 225% Federal Poverty Level. SETTING AND INTERVENTION: A network of community-clinical linkages in which medical providers provided preventive screening services and risk reduction counseling in clinical settings and community health workers provided lifestyle interventions in community settings either over the phone or in person. MAIN OUTCOME MEASURE: The data included weight, blood pressure measures, self-blood pressure monitoring and management, total cholesterol, fasting glucose or A1C, smoking status, nutrition, and physical activities. RESULTS: Among 2649 participants, 82.2% were overweight, 50.3% had hypertension, 52.7% had high cholesterol, 20.7% had diabetes, 22.5% were current smokers, and 56.4% had more than 1 risk factor. A total of 1312 participants (57.3%) participated in at least 1 lifestyle intervention session, and among them, 65.8% completed at least 3 sessions. Paired t test and McNemar's test indicated significant improvement in hypertension control and self-management; a significant amount of weight loss with 24.1% losing at least 5 pounds; and an increase in healthy eating and physical activity. CONCLUSIONS: These participants benefited from the Nebraska program. Utilizing a statewide clinical network and participating in lifestyle interventions through local health departments, participants improved some chronic health conditions and decreased their risks of developing cardiovascular diseases.

Virtual Expansion of the YMCA's Blood Pressure Self-Monitoring (BPSM) Program: Using Telehealth to Adapt an Evidence-Based Program to Reach Rural Communities in South Carolina.

CONTEXT: Disparities in cardiovascular disease prevalence and death exist among South Carolina's rural residents. Blood pressure self-monitoring (BPSM), where individuals measure their own blood pressure outside of the clinical environment, coupled with additional support, is an evidence-based, cost-effective strategy that is underutilized at large. PROGRAM: The YMCA's BPSM program is an evidence-based, 4-month program that includes 2 individualized office hours with a Healthy Heart Ambassador and 4 nutrition education sessions per month. Participants are provided with a blood pressure cuff and notebook to track their blood pressure at home in between sessions. IMPLEMENTATION: The SC Department of Health and Environmental Control partnered with the SC Alliance of YMCAs to expand the YMCA's BPSM program virtually. The traditional program was adapted to allow for virtual participant encounters. To target rural communities, partnerships were leveraged or established with rural health centers, federally qualified health centers, free medical clinics, and other state health department regions for participant referrals into the program. EVALUATION: A developmental evaluation design was utilized to monitor the virtual adaptation of the YMCA's BPSM program from April 2021 to May 2023. At the end of the project, 10 referral sources were identified to refer participants to the program. In total, 253 participants were referred to the program, 126 participants enrolled into the program, and 52 participants completed the program. Completers of the virtual program were successful in improving their blood pressure. DISCUSSION: Successes of the virtual program were not without challenges. Lessons learned from the virtual expansion of this program included ensuring participants' readiness to engage in a 4-month program, assessing participants' digital literacy, and considering broadband access in rural areas. Improvements in blood pressure and the program's reach demonstrate merit in continuing to scale the virtual adaptation of this program; however, contextual and structural factors should be considered.

Child Care Center Staff Readiness to Change in an Early Childhood Obesity Prevention Program.

CONTEXT: The childcare center (CCC) setting has the potential to be a strong foundation that supports the introduction of sustainable healthy lifestyle behaviors to prevent childhood obesity. It is important to assess barriers and facilitators to healthy weight development initiatives via program evaluation, including measuring CCC staff readiness to change. OBJECTIVE: The overall goal of this study was to assess the readiness level over 1 school year among CCC staff who participated in "Healthy Caregivers-Healthy Children" (HC2), a cluster randomized controlled trial that evaluated the effectiveness of a childhood obesity prevention program from 2015 to 2018 in 24 low-income, racially/ethnically diverse centers. A secondary outcome was to assess how a CCC's stage of readiness to change was associated with CCC nutrition and physical activity environment, measured via the Environment and Policy Assessment and Observation (EPAO) tool. DESIGN: Mixed-models analysis with the CCC as the random effect assessed the impact of readiness to change over time on EPAO outcomes. PARTICIPANTS: Eighty-eight CCC teachers and support staff completed the HC2 readiness to change survey in August 2015 and 68 in August 2016. Only teachers and staff randomized to the treatment arm of the trial were included. MAIN OUTCOME: Readiness to change and the EPAO. RESULTS: Results showed the majority of CCC staff in advanced stages of readiness to change at both time points. For every increase in readiness to change stage over 1 year (eg, precontemplation to contemplation), there was a 0.28 increase in EPAO nutrition scores (95% confidence interval [CI], 0.04-0.53; P = .02) and a 0.52 increase in PA score (95% CI, 0.09-0.95; P = .02). CONCLUSIONS: This analysis highlights the importance between CCC staff readiness to change and the CCC environment to support healthy weight development. Future similar efforts can include consistent support for CCC staff who may not be ready for change to support successful outcomes.

Implementation and evaluation of a national quality improvement initiative in cancer surgery.

BACKGROUND: In 2017, the Canadian Partnership Against Cancer, a Canadian federally sponsored organisation, initiated a national multijurisdictional quality improvement (QI) initiative to maximise the use of synoptic data to drive cancer system improvements, known as the Evidence for Surgical Synoptic Quality Improvement Programme. The goal of our study was to evaluate the outcomes, determinants and learning of this nationally led initiative across six jurisdictions in Canada, integrating a mix of cancer surgery disease sites and clinicians. METHODS: A mixed-methods evaluation (surveys, semistructured interviews and focus groups) of this initiative was focused on the ability of each jurisdiction to use synoptic reporting data to successfully implement and sustain QI projects to beyond the completion of the initiative and the lessons learnt in the process. Resources provided to the jurisdictions included operational funding, training in QI methodology, national forums, expert coaches, and ad hoc monitoring and support. The programme emphasised foundational concepts of the QI process including data literacy, audit and feedback reports, communities of practice (CoP) and positive deviance methodology. RESULTS: 101 CoP meetings were held and 337 clinicians received feedback reports. There were 23 projects, and 22 of 23 (95%) showed improvements with 15 of 23 (65%) achieving the proposed targets. Enablers of effective data utilisation/feedback reports for QI included the need for clinicians to trust the data, have comparative data for feedback, and the engagement of both data scientists and clinicians in designing feedback reports. Enablers of sustainability of QI within each jurisdiction included QI training for clinicians, the ability to continue CoP meetings, executive and broad stakeholder engagement, and the ability to use pre-existing organisational infrastructures and processes. Barriers to continue QI work included lack of funding for core team members, lack of automated data collection processes and lack of clinician incentives (financial and other). CONCLUSION: Success and sustainability in data-driven QI in cancer surgery require skills in QI methodology, data literacy and feedback, dedicated supportive personnel and an environment that promotes the process of collective learning and shared accountability. Building these capabilities in jurisdictional teams, tailoring interventions to facility contexts and strong leadership engagement will create the capacity for continued success in QI for cancer surgery.

Adolescent health and well-being check-up programme in three African cities (Y-Check): protocol for a multimethod, prospective, hybrid implementation-effectiveness study.

BACKGROUND: During adolescence, behaviours are initiated that will have substantial impacts on the individual's short-term and long-term health and well-being. However, adolescents rarely have regular contact with health services, and available services are not always appropriate for their needs. We co-developed with adolescents a health and well-being check-up programme (Y-Check). This paper describes the methods to evaluate the feasibility, acceptability, short-term effects and cost-effectiveness of Y-Check in three African cities. METHOD: This is a multi-country prospective intervention study, with a mixed-method process evaluation. The intervention involves screening, on-the-spot care and referral of adolescents through health and well-being check-up visits. In each city, 2000 adolescents will be recruited in schools or community venues. Adolescents will be followed-up at 4 months. The study will assess the effects of Y-Check on knowledge and behaviours, as well as clinical outcomes and costs. Process and economic evaluations will investigate acceptability, feasibility, uptake, fidelity and cost effectiveness. ETHICS AND DISSEMINATION: Approval has been received from the WHO (WHO/ERC Protocol ID Number ERC.0003778); Ghana Health Service (Protocol ID Number GHS-ERC: 027/07/22), the United Republic of Tanzania National Institute for Medical Research (Clearance No. NIMR/HQ/R.8a/Vol.IX/4199), the Medical Research Council of Zimbabwe (Approval Number MRCZ/A/2766) and the LSHTM (Approval Numbers 26 395 and 28312). Consent and disclosure are addressed in the paper. Results will be published in three country-specific peer-reviewed journal publications, and one multicountry publication; and disseminated through videos, briefs and webinars. Data will be placed into an open access repository. Data will be deidentified and anonymised. TRIAL REGISTRATION NUMBER: NCT06090006.

Long-Term Efficacy of a Mobile Mental Wellness Program: Prospective Single-Arm Study.

BACKGROUND: Rising rates of psychological distress (symptoms of depression, anxiety, and stress) among adults in the United States necessitate effective mental wellness interventions. Despite the prevalence of smartphone app-based programs, research on their efficacy is limited, with only 14% showing clinically validated evidence. Our study evaluates Noom Mood, a commercially available smartphone-based app that uses cognitive behavioral therapy and mindfulness-based programming. In this study, we address gaps in the existing literature by examining postintervention outcomes and the broader impact on mental wellness. OBJECTIVE: Noom Mood is a smartphone-based mental wellness program designed to be used by the general population. This prospective study evaluates the efficacy and postintervention outcomes of Noom Mood. We aim to address the rising psychological distress among adults in the United States. METHODS: A 1-arm study design was used, with participants having access to the Noom Mood program for 16 weeks (N=273). Surveys were conducted at baseline, week 4, week 8, week 12, week 16, and week 32 (16 weeks' postprogram follow-up). This study assessed a range of mental health outcomes, including anxiety symptoms, depressive symptoms, perceived stress, well-being, quality of life, coping, emotion regulation, sleep, and workplace productivity (absenteeism or presenteeism). RESULTS: The mean age of participants was 40.5 (SD 11.7) years. Statistically significant improvements in anxiety symptoms, depressive symptoms, and perceived stress were observed by week 4 and maintained through the 16-week intervention and the 32-week follow-up. The largest changes were observed in the first 4 weeks (29% lower, 25% lower, and 15% lower for anxiety symptoms, depressive symptoms, and perceived stress, respectively), and only small improvements were observed afterward. Reductions in clinically relevant anxiety (7-item generalized anxiety disorder scale) and depression (8-item Patient Health Questionnaire depression scale) criteria were also maintained from program initiation through the 16-week intervention and the 32-week follow-up. Work productivity also showed statistically significant results, with participants gaining 2.57 productive work days from baseline at 16 weeks, and remaining relatively stable (2.23 productive work days gained) at follow-up (32 weeks). Additionally, effects across all coping, sleep disturbance (23% lower at 32 weeks), and emotion dysregulation variables exhibited positive and significant trends at all time points (15% higher, 23% lower, and 25% higher respectively at 32 weeks). CONCLUSIONS: This study contributes insights into the promising positive impact of Noom Mood on mental health and well-being outcomes, extending beyond the intervention phase. Though more rigorous studies are necessary to understand the mechanism of action at play, this exploratory study addresses critical gaps in the literature, highlighting the potential of smartphone-based mental wellness programs to lessen barriers to mental health support and improve diverse dimensions of well-being. Future research should explore the scalability, feasibility, and long-term adherence of such interventions across diverse populations.

Case study in using value stream mapping in online graduate education.

Given the rise in demand for online, graduate degree programs there is a need to guide program planning and evaluation professionals within institutions of higher education to utilize continuous quality improvement (CQI) strategies. Using principles of design thinking and CQI, the purpose of this case study was to describe a CQI project that sought to develop a better understanding of adult students' experience progressing through their plan of study in an online doctoral program. As part of the CQI project, value stream mapping (VSM) was used to gain visibility and perspective on the actions required by faculty and staff to guide students through their plan of study. The VSM process provided information that led to conversations that furthered the CQI efforts and led to changes in the adult education program that would benefit all students. Improvement processes that lead to better quality and more positive experiences for users are valuable. This case study demonstrates the processes, challenges, lessons, and future directions in the use of VSM to better understand online graduate programs designed for adult learners.

Developing evaluation measures for health departments sharing and linking HIV and STI surveillance data.

Enhancing data sharing, quality, and use across siloed HIV and STI programs is critical for national and global initiatives to reduce new HIV infections and improve the health of people with HIV. As part of the Enhancing Linkage of STI and HIV Surveillance Data in the Ryan White HIV/AIDS Program initiative, four health departments (HDs) in the U.S. received technical assistance to better share and link their HIV and STI surveillance data. The process used to develop evaluation measures assessing implementation and outcomes of linking HIV and STI data systems involved six steps: 1) measure selection and development, 2) review and refinement, 3) testing, 4) implementation and data collection, 5) data quality review and feedback, and 6) dissemination. Findings from pilot testing warranted slight adaptations, including starting with a core set of measures and progressively scaling up. Early findings showed improvements in data quality over time. Lessons learned included identifying and engaging key stakeholders early; developing resources to assist HDs; and considering measure development as iterative processes requiring periodic review and reassessment to ensure continued utility. These findings can guide programs and evaluations, especially those linking data across multiple systems, in developing measures to track implementation and outcomes over time.

How effective is nutrition training for staff running after school programs in improving quality of food purchased and meal practices? A program evaluation.

OBJECTIVES / PURPOSE: After school programs represents a setting for promoting healthy dietary habits. The aim of this study was to evaluate how effective the after school program staff perceived nutrition training aiming to improve quality of food purchased and meal practices. We further aimed to assess the changes in purchase of primarily fish and fish products, whole grains and fruit and vegetables, by collecting receipts from food purchase before and after the intervention. RESULTS: This is a mixed methods study. Group interviews with after school staff were carried out and the data was analyzed deductively according to the RE-AIM framework. Receipts from food purchase were collected. Findings from the qualitative interviews indicated that the intervention had been a positive experience for the staff and suggested a new way of working with promoting healthy foods in after school program units. Although there were some challenges reported, the staff made necessary adjustments to make the changes possible to sustain over time. Findings from the receipts support the changes reported by the staff. These showed increased purchase of vegetables, fish, and whole grain in all four after school program units. After school programs in similar settings may expand on these findings to improve the students' dietary habits.

Fall Tailoring Interventions for Patient Safety Brazil Program: an evaluability study in a teaching hospital.

OBJECTIVES: to present the theoretical model, logic model, and the analysis and judgment matrix of the Fall TIPS Brazil Program. METHODS: a qualitative, participatory research approach, in the form of an evaluability study, encompassing the phases (1) problem analysis; (2) program design, development, and adaptation to the Brazilian context; (3) program dissemination. Data were collected through document analysis and workshops. RESULTS: through document analysis, workshops with stakeholders from the participating institution, and validation with key informants, it was possible to identify the program's objectives, expected outcomes, and the target audience. This allowed the construction of theoretical and logic models and, through evaluative questions, the identification of indicators for the evaluation of the Fall TIPS Brazil Program. FINAL CONSIDERATIONS: this study has provided insights into the Fall TIPS program, the topic of hospital fall prevention, and the proposed models and indicators can be employed in the implementation and future evaluative processes of the program.

Making it relevant: A codesign and cultural acceptability study of Be Real's BodyKind Ireland body image programme for older adolescents.

Body image is an established public health concern and there is a pressing need for evidence-informed universal programmes for older adolescents. To ensure high standard, quality programmes, there have been calls to adapt existing programmes to different contexts in ways that ensure materials are relevant, but still aligned with their theoretical foundations. This study outlines the cultural adaptation of the BodyKind programme in Ireland, which was initially developed in the USA, to address an unmet need to provide an inclusive, strengths-focused, school-based body image intervention for older adolescents. After receiving BodyKind, codesign workshops were conducted with 12 adolescents aged 15-16 years, who provided feedback and designed content (examples/scenarios) to increase the programme's relevance for adolescents. Feedback on cultural appropriateness of programme materials were obtained via interviews with six female post-primary teachers and one mental health clinician. Qualitative data were analysed using thematic analysis. BodyKind was perceived as highly acceptable by stakeholders who offered suggestions for programme refinement. Themes included 1.) Programme acceptability, 2.) Implementation considerations, 3.) Programme refinement. This study used multi-stakeholder feedback to engage in cultural adaptation of BodyKind prior to further evaluation, thereby informing efforts to implement sustainable and scalable programmes in schools.

Position statement of the GMA committee "teaching evaluation".

The evaluation of teaching can be an essential driver for curriculum development. Instruments for teaching evaluation are not only used for the purpose of quality assurance but also in the context of medical education research. Therefore, they must meet the common requirements for reliability and validity. This position paper from the GMA Teaching Evaluation Committee discusses strategic and methodological aspects of evaluation in the context of undergraduate medical education and related courses; and formulates recommendations for the further development of evaluation. First, a four-step approach to the design and implementation of evaluations is presented, then methodological and practical aspects are discussed in more detail. The focus here is on target and confounding variables, survey instruments as well as aspects of implementation and data protection. Finally, possible consequences from evaluation data for the four dimensions of teaching quality (structural and procedural aspects, teachers and outcomes) are discussed.

Technical Assistance for Systemic Change: Lessons Learned From a National Technical Assistance Center.

Despite the millions of dollars awarded annually by the United States Department of Education to build implementation capacity through technical assistance (TA), data on TA effectiveness are severely lacking. Foundational to the operationalization and consistent research on TA effectiveness is the development and use of standardized TA core competencies, practices, and structures. Despite advances toward a consistent definition of TA, a gap still exists in understanding how these competencies are used within an operationalized set of TA practices to produce targeted outcomes at both individual and organizational levels to facilitate implementation of evidence-based practices. The current article describes key insights derived from the evaluation of an operationalized set of TA practices used by a nationally funded TA center, the State Implementation & Scaling Up of Evidence Based Practices (SISEP) Center. The TA provided by the Center supports the uptake of evidence-based practices in K-12 education for students with disabilities. Lessons learned include: (1) the need to understand the complexities and dependencies of operationalizing TA both longitudinally and at multiple levels of the system (state, regional, local); (2) the relative importance of building general and innovation-specific capacity for implementation success; (3) the value of using a co-design and participatory approach for effective TA delivery; (4) the need to develop TA providers' educational and implementation fluency across areas and levels of the system receiving TA; and (5) the need to ensure coordination and alignment of TA providers from different centers. Gaining an understanding into optimal TA practices will not only provide clarity of definition fundamental to TA research, but it will also inform the conceptual framing and practice of TA.

An integrative review of parent education approaches in sport: Considerations for program planning and evaluation.

In recent years, there has been an increase in the delivery and evaluation of parent education programs within youth sport. Subsequently, some recent reviews of these programs have been conducted. However, one consistent issue across many of the programs and associated review papers is the lack of an appropriate evaluation framework to guide the planning or associated reporting of the outcomes of the interventions. This has limited understanding of the overall impact of sport parenting interventions. Thus, the purposes of the current study were as follows: (a) to identify commonalities in the reporting and evaluation of parent education programs; (b) to identify gaps in the reporting and evaluation of parent education programs; (c) to draw these insights together to provide suggestions regarding how the RE-AIM could be used to enhance planning and evaluation of evidence-based programs for parent education in sport. Specifically, utilizing the RE-AIM framework to provide insights into pertinent evaluation metrics, this integrative review aimed to identify commonalities and gaps in the reporting of parent education programs. The RE-AIM framework considers the essential elements to assess the external and internal validity of interventions through five dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance (Am J Public Health. 1999;89(9):1322-1327). Subsequently, the review aimed to provide suggestions regarding strategies to enhance the planning and evaluation of evidence-based programs for parent education in sport. Overall, the analysis demonstrated that most studies presented some pertinent evaluation information related to the RE-AIM framework, such as the number of participants and contacts made, the measures used, and the program level. However, the studies also lacked information on participant exclusion criteria, the method used to select the delivery agent (e.g., parents engaged in the program), and cost measures. Overall, the current study identified various areas where programs could be enhanced, specifically related to reporting procedural elements (e.g., program design, target population, and costs) pertaining to the implementation of parent education programs.

Beyond the average effect of the innovation subsidies: Using case selection via matching to break impasse in delivering useful advice to policy makers.

Experts and stakeholders promote the combined use of counterfactual and theory-based approaches in program evaluation. We illustrated combined application of these two approaches in a single evaluation study of innovation subsidies, using "case selection via matching" and follow-up in-depth interviews. We conducted interviews in contrasting pairs of companies-one successful and one unsuccessful-which were otherwise similar on a defined set of covariates. Our procedure helped to reveal factors, which might be overlooked or simply not available in data at hand and hence not accounted for in analyses of the intervention effects. As such it extends beyond the average effect estimate to highlight causes of an intervention success or failure.

Evaluation of primary-level credit environment, indicator system and empirical analysis: A case study of credit construction in China county and district.

Townships (towns, streets) represent the foundational layer of China's administrative structure, and the quality of their credit environment is crucial for underpinning the development of a primary-level social credit system. This initiative aims to accelerate the establishment of the social credit system and cultivate a trustworthy economic and social environment. Starting from the three major fields of government, business and society, and focusing on integrity culture and credit innovation, the article proposes an innovative evaluation framework for primary-level credit environment and it can become a point of reference as a policy tool in international evaluation programs. Using clustering and the coefficient of variation methods, we quantitatively refine our indicator system, establishing a set of criteria to assess the primary-level credit environment. We incorporate hierarchical analysis, the entropy weight method, and machine learning models to conduct a comprehensive evaluation of the credit environments within 24 townships (towns, streets) of Fuyang District in Hangzhou City for the year 2023. The findings underscore the need for a realistic appraisal of the current state and deficiencies of the primary-level credit environment. We advocate for the bolstering of credit development within governmental, business, and societal realms. It's imperative to leverage the normative influence of honesty and integrity culture, enhance the breadth and application of credit innovations, and thereby foster the high-quality growth of the primary-level social credit system.