Assessing the Feasibility of Partnering with a Home Visiting Program for Early Childhood Obesity Prevention.

PURPOSE: Little empirical data exists evaluating the feasibility of partnering with established home visiting programs to implement early childhood obesity prevention programs, despite the recommendation to do so. To inform this gap, we evaluated the feasibility of collecting anthropometric measurements of children by home visitors across multiple sites, and the alignment of these measurements with children in need, including with adverse family experiences (AFEs) given emerging evidence suggests an association with childhood obesity. DESCRIPTION: Our proof-of-concept study included primary data collection of child anthropometric measurements through an established home visiting program in four states. This sample included 248 children ages 6 months to 5 years. ASSESSMENT: In the sample, 37.1% of the children had overweight or obesity, 50% were female, 64.2% Hispanic/Latinx, 15.8% non-Hispanic Black, and 42.3% from rural/small towns. Households included substantial needs: 87.1% were low income, 73.8% low education, and 59.3% underemployment. Regarding AFEs, 38.3% of the children had at least one, with the most common being mothers who were treated violently. A multivariable model revealed community type, not AFEs, was significantly associated with overweight/obesity status, suggesting children in suburban and especially rural/small town residences (odds ratio 5.11; 95% CI [1.59, 16.39]) could be priority populations for childhood obesity prevention programs. CONCLUSION: Findings of this multi-site study inform the feasibility of partnering with home visiting programs to reach and measure a diverse sample of children and families in need of childhood obesity prevention.

Provider Attitudes and Self-Efficacy When Delivering a Child Sexual Abuse Prevention Module: An Exploratory Study.

BACKGROUND: As constant figures in children's lives, parents are key in protecting children from sexual abuse. One barrier to reaching parents is that the topic can be difficult to broach and is sensitive in nature. Such barriers can interfere with implementation and fidelity of evidence-based prevention strategies that are focused on reducing rates of childhood sexual abuse (CSA). AIMS: In this exploratory study, we examine provider attitudes about delivering CSA-specific content in an evidence-based prevention module and their self-efficacy. METHOD: Thirty-three providers participated in three surveys: prior to a skills-oriented training on how to deliver the CSA prevention module (pretraining), immediately posttraining, and 6 months posttraining. Changes in self-reported willingness to deliver content, beliefs about parents' role in CSA prevention, and confidence about their ability to deliver content were assessed over time. Open-ended questions were coded thematically to reinforce quantitative findings. RESULTS: Prior to training, providers were worried that parents would respond negatively to CSA content and were concerned about their comfort level discussing victimization and sexual development. Findings suggest that skill-oriented training and provision scripts effectively supported providers and improved confidence in delivering CSA prevention content. DISCUSSION: Provider self-efficacy is an important element of implementation fidelity. This exploratory study demonstrated that, though providers may approach CSA content with wariness and trepidation, adequate skills-oriented training can reduce negative attitudes and increase perceived efficacy in the actual delivery of CSA content that persists through implementation. CONCLUSION: Skills-based training can significantly enhance fidelity in the delivery of difficult content included in parent-focused preventative interventions.

Changing the home visiting research paradigm: models' perspectives on behavioral pathways and intervention techniques to promote good birth outcomes.

BACKGROUND: The US is scaling up evidence-based home visiting to promote health equity in expectant families and families with young children. Persistently small average effects for full models argue for a new research paradigm to understand what interventions within models work best, for which families, in which contexts, why, and how. Historically, the complexity and proprietary nature of most evidence-based models have been barriers to such research. To address this, stakeholders are building the Precision Paradigm, a common framework and language to define and test interventions and their mediators and moderators. This observational study used portions of an early version of the Precision Paradigm to describe models' intended behavioral pathways to good birth outcomes and their stance on home visitors' use of specific intervention technique categories to promote families' progress along intended pathways. METHODS: Five evidence-based home visiting models participated. Model representatives independently completed three structured surveys focused on 41 potential behavioral pathways to good birth outcomes, and 23 behavior change technique categories. Survey data were used to describe and compare models' intended behavioral pathways, explicit endorsement of behavior change technique categories, expectations for home visitors' relative emphasis in using endorsed technique categories, and consistency in endorsing technique categories across intended pathways. RESULTS: Models differed substantially in nearly all respects: their intended pathways to good birth outcomes (range 16-41); the number of technique categories they endorsed in any intended pathway (range 12-23); the mean number of technique categories they endorsed per intended pathway (range 1.5-20.0); and their consistency in endorsing technique categories across intended pathways (22%-100% consistency). Models were similar in rating nearly all behavior change technique categories as at least compatible with their model, even if not explicitly endorsed. CONCLUSIONS: Models successfully used components of the Precision Paradigm to define and differentiate their intended behavioral pathways and their expectations for home visitors' use of specific technique categories to promote family progress on intended pathways. Use of the Precision Paradigm can accelerate innovative cross-model research to describe current models and to learn which interventions within home visiting work best for which families, in which contexts, why and how.

Perinatal Mental Health Support and Early Childhood Home Visitation During COVID-19.

COVID-19 has disrupted many of the preventive service sectors designed to serve mothers at-risk for developing postpartum depression, forcing a rapid transition to telehealth-based modes of delivery. The purpose of this study was to explore differences in early childhood home visitation service provision (enrollment and depression screening) among mothers receiving home visitation services prior to and after the onset of the COVID-19 pandemic. Additional factors related to receipt of virtual home visitation services, family risk factors, and the maternal depressive symptoms were examined. Linear and logistic regression were utilized to examine whether there were differences in family risk factors, the percentage of mothers being screened for depression and maternal depressive symptoms, and associations between risk factors and positive depression screenings, while accounting for clustering by site. Samples compared outcomes for families enrolled during the pre-pandemic period (defined as March 16th to July 27th, 2019, n = 4,743) and the post-pandemic period (defined as March 16th to July 27th, 2020, n = 2,049). Families enrolled after the onset of the pandemic were significantly less likely to be impacted by housing instability, have a child with a disability, or be involved with the military, but more likely to have a history of child abuse or neglect. Fewer mothers were screened for depression during the pandemic and maternal report of depressive symptoms decreased. Virtual home visitation is currently attracting some groups of mothers who are experiencing fewer stressors, which may place them at decreased risk for exhibiting depressive symptoms. There may be aspects of the virtual depression screening experience that make detection more difficult. As a result, many mothers at risk for maternal depression may not receive adequate prevention services.

Social Determinants of Health Discussed with Mothers During Personal Visits Before and During the COVID-19 Pandemic.

Purpose: This report describes the social determinants of health (SDOH) discussed during personal visits at the time leading up to and during the first 4 months of the pandemic from families across the United States. Methods: This is a secondary analysis from a cluster randomized trial that embeds Healthy Eating and Active Living Taught at Home within Parents as Teachers (PAT). PAT is a national organization serving families prenatal through kindergarten, delivered by parent educators. After parent educators complete visits with mothers in the trial, they complete brief surveys including the question "Did issues with any of these come up during the visit?" with yes/no options for "Transportation," "Housing," "Food insecurity," "Childcare," "Financial constraint," or "Other." Results: Among the 60 mothers with visit records in the months before and during (March-July 2020) COVID-19, 55% identified as Hispanic or Latino and 52% reported food insecurity at baseline. During COVID-19, financial constraints and other SDOH were as common as they were before COVID-19; childcare issues were discussed less frequently and food security was discussed more frequently. When comparing the number of SDOH parent educators reported discussing with mothers in visits that took place before COVID-19 with the number of SDOH discussed in visits during COVID-19, the number of SDOH increased for 41% for mothers identifying as Hispanic or Latino and only 8% for non-Hispanic or Latino mothers. Conclusions: This study can help build an understanding of how COVID-19 is impacting families, and how these impacts may be inequitable. Clinical Trial Registration Number: NCT03758638.

Caregiver experiences of developmental screening.

BACKGROUND: The American Academy of Pediatrics (AAP) has called for a universal system of developmental screening and surveillance to enhance early detection and intervention for children. While the need and potential impact of universal screening is well documented, recent reports show that screening rates have not reached expected goals and gaps remain in terms of effective follow-up and referral to early intervention (EI) services. Few studies have explored parent and child experiences of developmental screening, which would aid researchers, practitioners and policymakers in improving early detection and referral to EI. The purpose of this qualitative study was to understand the experiences of caregivers and children who received developmental screening across different service sectors, including the type of screening received, location of screening, experiences during the screening process and the follow-up interventions received following screening. METHODS: Individual interviews were conducted with 31 caregivers. A descriptive qualitative design allowed for the exploration of caregiver experiences with developmental screening. Thematic analysis was utilized to categorize caregiver reflections prior to, during and following developmental screening events. RESULTS: Analysis revealed five themes that described caregivers' experiences with screening and assessment for their child: (1) parent's goals of screening; (2) screening preparation and support; (3) parent/child response to screening; (4) result reporting and follow-up; (5) overall satisfaction with screening process. Each theme was composed of several subthemes. CONCLUSIONS: Caregivers see the importance of developmental screening, caregivers and children respond well to screening delivered by various providers in multiple settings and caregivers find the information gleaned from screening events important in planning for their child's developmental trajectory. Key places where improvements can be made to further bolster parental engagement and satisfaction include screening preparation and follow-up.

Collecting Early Childhood Obesity Measurements Through a Home Visiting Program: A Proof-of-Concept Study.

Community-based home visiting programs are recommended vehicles for early life-course interventions to prevent childhood obesity. We developed and implemented a proof-of-concept protocol for collecting child weight and length or height data for children aged 6 months to 5 years through Parents as Teachers (PAT) affiliates that were geographically dispersed throughout the United States. We implemented our protocol with 1 affiliate in each of 4 states. We assessed formative measures of the implementation from parent educators and site leaders and reviewed delivery process measures. Findings suggest that collecting data on child measurements through an existing home visiting program is 1) feasible (91% of estimated measurements achieved); 2) does not require much time (median, 0.5 hours spent per child); 3) is a positive experience for families (71% of parent educators indicated that families enjoyed the experience); and 4) is fairly accurate (82% of collected data met eligibility and quality standards).

Modification to a systematically braided parent-support curriculum: Results from a feasibility pilot.

OBJECTIVES: There are a variety of parent-support programs designed to improve parenting and, thereby,the safety and well-being of children. Providers trained in multiple programs are likely to select components of interventions they feel will meet the needs of the families they serve leaving out aspects they deem unnecessary orredundant. In so doing, the fidelity of the evidence-based program is at risk. A potential solution is systematic braiding in which evidence-based programs are combined such that the fidelity to each original model and its implementation are maintained. METHODS: Drawing on qualitative feedback from a prior iteration, this paper discusses results of a feasibility and acceptability pilot of a modified version of the systematically braided Parents as Teachers and SafeCare at Home (PATSCH) curriculum This modification removed a provider-perceived "redundant" portion from the original PATSCH curriculum. A pre-post design (N=18) was used to evaluate the efficacy of the modified curriculum. RESULTS: Significant improvements were seen in trained parent behaviors surrounding home safety and child health. There was also improvement in self-reported parenting behaviors, the portion of the braided curriculum removed, suggesting that the PAT curriculum adequately teaches these skills. Providers and parents were highly satisfied with themodified curriculum. CONCLUSIONS: If a curriculum is modified to reflect provider and parent preferences, then the potential for delivery without fidelity is minimized.

Disseminating and implementing a lifestyle-based healthy weight program for mothers in a national organization: a study protocol for a cluster randomized trial.

BACKGROUND: Excessive weight gain among young adult women age 18-45 years is an alarming and overlooked trend that must be addressed to reverse the epidemics of obesity and chronic disease. During this vulnerable period, women tend to gain disproportionally large amounts of weight compared to men and to other life periods. Healthy Eating and Active Living Taught at Home (HEALTH) is a lifestyle modification intervention developed in partnership with Parents as Teachers (PAT), a national home visiting, community-based organization with significant reach in this population. HEALTH prevented weight gain, promoted sustained weight loss, and reduced waist circumference. PAT provides parent-child education and services free of charge to nearly 170,000 families through up to 25 free home visits per year until the child enters kindergarten. METHODS: This study extends effectiveness findings with a pragmatic cluster randomized controlled trial to evaluate dissemination and implementation (D&I) of HEALTH across three levels (mother, parent educator, PAT site). The trial will evaluate the effect of HEALTH and the HEALTH training curriculum (implementation strategy) on weight among mothers with overweight and obesity across the USA (N = 252 HEALTH; N = 252 usual care). Parent educators from 28 existing PAT sites (14 HEALTH, 14 usual care) will receive the HEALTH training curriculum through PAT National Center, using PAT's existing training infrastructure, as a continuing education opportunity. An extensive evaluation, guided by RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance), will determine implementation outcomes (acceptability, adoption, appropriateness, feasibility, fidelity, and adaptation) at the parent educator level. The Conceptual Framework for Implementation Research will characterize determinants that influence HEALTH D&I at three levels: mother, parent educator, and PAT site to enhance external validity (reach and maintenance). DISCUSSION: Embedding intervention content within existing delivery channels can help expand the reach of evidence-based interventions. Interventions, which have been adapted, can still be effective even if the effect is reduced and can still achieve population impact by reaching a broader set of the population. The current study will build on this to test not only the effectiveness of HEALTH in real-world PAT implementation nationwide, but also elements critical to D&I, implementation outcomes, and the context for implementation. TRIAL REGISTRATION: https://ClinicalTrials.gov , NCT03758638 . Registered 29 November 2018.

Phase II Study of Crizotinib in East Asian Patients With ROS1-Positive Advanced Non-Small-Cell Lung Cancer.

Purpose Approximately 1% to 2% of non-small-cell lung cancers (NSCLCs) harbor a c-ros oncogene 1 ( ROS1) rearrangement. Crizotinib, an inhibitor of anaplastic lymphoma kinase (ALK), ROS1, and MET, has shown marked antitumor activity in a small expansion cohort of patients with ROS1-positive advanced NSCLC from an ongoing phase I study. We assessed the efficacy and safety of crizotinib in the largest cohort of patients with ROS1-positive advanced NSCLC. Patients and Methods This phase II, open-label, single-arm trial enrolled East Asian patients with ROS1-positive (assessed through validated AmoyDx assay [Amoy Diagnostics, Xiamen, China] at three regional laboratories) advanced NSCLC who had received three or fewer lines of prior systemic therapies. Patients were to receive oral crizotinib at a starting dose of 250 mg twice daily and continued treatment until Response Evaluation Criteria in Solid Tumors (RECIST) version 1.1-defined progression (by independent radiology review [IRR]), unacceptable toxicity, or withdrawal of consent. The primary end point was objective response rate (ORR) by IRR. Results In the efficacy and safety analyses, 127 patients were included, with 49.6% still receiving treatment at data cutoff. ORR by IRR was 71.7% (95% CI, 63.0% to 79.3%), with 17 complete responses and 74 partial responses. ORRs were similar irrespective of the number of prior lines of therapy, and responses were durable (median duration of response, 19.7 months; 95% CI, 14.1 months to not reached). Median progression-free survival by IRR was 15.9 months (95% CI, 12.9 to 24.0 months). No new safety signals associated with crizotinib were reported. Conclusion This study demonstrated clinically meaningful benefit and durable responses with crizotinib in East Asian patients with ROS1-positive advanced NSCLC. Crizotinib was generally well tolerated, with a safety profile consistent with previous reports.

Braiding Two Evidence-based Programs for Families at-risk: Results of a Cluster Randomized Trial.

Child maltreatment is a significant public health problem best addressed through evidence-based parent-support programs. There is a wide range of programs with different strengths offering a variety of options for families. Choosing one single evidence-based program often limits the range of services available to meet the unique needs of families. This paper presents findings from a study to examine the systematic braiding of two evidence-based programs, Parents as Teachers and SafeCare at Home (PATSCH), with the goal to provide a more robust intervention for higher risk families. A cluster randomized effectiveness trial was conducted to examine if PATSCH improved parenting behaviors known to decrease the risk for child maltreatment compared to Parents as Teachers (PAT) Alone. Parents (N= 159; 92 PAT Alone; 67 PATSCH) were enrolled to complete a baseline, 6-month and 12-month assessment. Results indicate the groups did not differ on number of environmental hazards in the home, parents' health care decision-making abilities, child abuse potential, and physical assault over time. However, with regard to the potential for child abuse, the PATSCH group showed a decrease in nonviolence discipline and increase in psychological aggression compared to the PAT group. Further research is needed to better examine this concept and its implications for the field.

Operationalizing Population Health Management in Practice.

We synthesized practitioner perspectives on how to integrate a community-based program into a healthcare system. Three focus groups and four in-depth interviews in Greene County, Missouri addressed: the population served, collaborations, service delivery design, training, data collection, and funding. Participants identified the following: integration as a way to increase population health outcomes through mutually beneficial partnerships; education and awareness of community-based resources; coordination of services to avoid duplication and maximize niche skills; smooth transitions across programs; and information sharing.

Using frameworks to diagram value in complex policy and environmental interventions to prevent childhood obesity.

BACKGROUND: To date, few tools assist policy makers and practitioners in understanding and conveying the implementation costs, potential impacts, and value of policy and environmental changes to address healthy eating, active living, and childhood obesity. For the Evaluation of Healthy Kids, Healthy Communities (HKHC), evaluators considered inputs (resources and investments) that generate costs and savings as well as benefits and harms related to social, economic, environmental, and health-related outcomes in their assessment of 49 HKHC community partnerships funded from 2009 to 2014. METHODS: Using data collected through individual and group interviews and an online performance monitoring system, evaluators created a socioecological framework to assess investments, resources, costs, savings, benefits, and harms at the individual, organizational, community, and societal levels. Evaluators customized frameworks for 6 focal strategies: active transportation, parks and play spaces, child care physical activity standards, corner stores, farmers' markets, and child care nutrition standards. RESULTS: To illustrate the Value Frameworks, this brief highlights the 38 HKHC communities implementing at least 1 active transportation strategy. Evaluators populated this conceptual Value Framework with themes from the strategy-specific inputs and outputs. The range of factors corresponding to the implementation and impact of the HKHC community partnerships are highlighted along with the inputs and outputs. CONCLUSIONS: The Value Frameworks helped evaluators identify gaps in current analysis models (ie, benefit-cost analysis, cost-effectiveness analysis) as well as paint a more complete picture of value for potential obesity prevention strategies. These frameworks provide a comprehensive understanding of investments needed, proposed costs and savings, and potential benefits and harms associated with economic, social, environmental, and health outcomes. This framing also allowed evaluators to demonstrate the interdependence of each socioecological level on the others in these multicomponent interventions. This model can be used by practitioners and community leaders to assess realistic and sustainable strategies to combat childhood obesity.

Evaluating the implementation and impact of policy, practice, and environmental changes to prevent childhood obesity in 49 diverse communities.

BACKGROUND: The purpose of this article is to assess and understand the intervention reach, dose, and impact of policy, practice, and environmental changes implemented by the 49 Healthy Kids, Healthy Communities (HKHC) community partnerships across the United States and in Puerto Rico. These partnerships planned and implemented healthy eating and active living policy, system, and environmental interventions to support healthier communities for children and families, with special emphasis on reaching children at highest risk for obesity. METHODS: Using a mixed-methods, participatory evaluation design, investigators analyzed multiple qualitative and quantitative data sources collected during the HKHC initiative from 2009 to 2014. Evaluators used an inductive approach to develop indicators to assess intervention reach, dose, and impact for 6 cross-site strategies, including corner stores, farmers' markets, child care nutrition standards, child care physical activity standards, active transportation, and parks and play spaces. RESULTS: Across HKHC community partnerships, 4261 policy, practice, or environmental changes occurred in 1536 intervention settings. Several trends emerged from the data related to how different levels of intervention (ie, community-level, setting-level, and within-setting), the size and access to intervention settings, the stage of implementation, and the sociodemographic composition of the intervention settings play important roles in the way policy, practice, and environmental changes "count" toward intervention reach, dose, and impact. CONCLUSIONS: This exploratory analysis provided a method and typology for increasing understanding in the field related to the reach, dose, and impact of policy, practice, and environmental changes promoting healthy eating and active living in order to reduce childhood overweight and obesity.

Applying a mixed-methods evaluation to Healthy Kids, Healthy Communities.

From 2008 to 2014, the Healthy Kids, Healthy Communities (HKHC) national program funded 49 communities across the United States and Puerto Rico to implement healthy eating and active living policy, system, and environmental changes to support healthier communities for children and families, with special emphasis on reaching children at highest risk for obesity on the basis of race, ethnicity, income, or geographic location. Evaluators designed a mixed-methods evaluation to capture the complexity of the HKHC projects, understand implementation, and document perceived and actual impacts of these efforts. Eight complementary evaluation methods addressed 4 primary aims seeking to (1) coordinate data collection for the evaluation through the web-based project management system (HKHC Community Dashboard) and provide training and technical assistance for use of this system; (2) guide data collection and analysis through use of the Assessment and Evaluation Toolkit; (3) conduct a quantitative cross-site impact evaluation among a subset of community partnership sites; and (4) conduct a qualitative cross-site process and impact evaluation among all 49 community partnership sites. Evaluators identified successes and challenges in relation to the following methods: an online performance-monitoring HKHC Community Dashboard system, environmental audits, direct observations, individual and group interviews, partnership and community capacity surveys, group model building, photographs and videos, and secondary data sources (surveillance data and record review). Several themes emerged, including the value of systems approaches, the need for capacity building for evaluation, the value of focusing on upstream and downstream outcomes, and the importance of practical approaches for dissemination. The mixed-methods evaluation of HKHC advances evaluation science related to community-based efforts for addressing childhood obesity in complex community settings. The findings are likely to provide practice-relevant evidence for public health.

Partnership and community capacity characteristics in 49 sites implementing healthy eating and active living interventions.

BACKGROUND: One component of the Evaluation of Healthy Kids, Healthy Communities, funded by the Robert Wood Johnson Foundation, was to assess partnership and community capacity characteristics of 49 cross-sector, multidisciplinary community demonstration projects to increase healthy eating and active living as well as to prevent and reduce childhood obesity. METHODS: From December 2012 to December 2013, an 82-item partnership and community capacity survey instrument assessed perspectives of community partnership members and community representatives from 48 of the 49 communities on the structure and function of their partnerships and the capacity of the community to create change. Through factor analysis and descriptive statistics, the evaluators described common characteristics of the partnerships, their leadership, and their relationships to the broader communities. RESULTS: A total of 603 individuals responded from 48 of the 49 partnerships. Evaluators identified 15 components, or factors that were broken into a themes, including leadership, partnership structure, relationship with partners, partnership capacity, political influence of partnership, and perceptions of partnership's involvement with the community and community members. CONCLUSIONS: Survey respondents perceived the Healthy Kids, Healthy Communities partnerships to have the capacity to ensure the partnerships' effectiveness in forming and growing their structures and functions, collaborating to implement policy and environmental change, and planning for sustainability.

Systems thinking in 49 communities related to healthy eating, active living, and childhood obesity.

BACKGROUND: Community partnerships to promote healthy eating and active living in order to prevent childhood obesity face a number of challenges. Systems science tools combined with group model-building techniques offer promising methods that use transdisciplinary team-based approaches to improve understanding of the complexity of the obesity epidemic. This article presents evaluation methods and findings from 49 Healthy Kids, Healthy Communities sites funded to implement policy, system, and environmental changes from 2008 to 2014. METHODS: Through half-day group model-building sessions conducted as part of evaluation site visits to each community between 2010 and 2013, a total of 50 causal loop diagrams were produced for 49 communities (1 community had 2 causal loop diagrams representing different geographic regions). The analysis focused on the following evaluation questions: (1) What were the most prominent variables in the causal loop diagrams across communities? (2) What were the major feedback structures across communities? (3) What implications from the synthesized causal loop diagram can be translated to policy makers, practitioners, evaluators, funders, and other community representatives? RESULTS: A total of 590 individuals participated with an average of 12 participants per session. Participants' causal loop diagrams included a total of 227 unique variables in the following major subsystems: healthy eating policies and environments, active living policies and environments, health and health behaviors, partnership and community capacity, and social determinants. In a synthesized causal loop diagram representing variables identified by at least 20% of the communities, many feedback structures emerged and several themes are highlighted with respect to implications for policy and practice as well as assessment and evaluation. CONCLUSIONS: The application of systems thinking tools combined with group model-building techniques creates opportunities to define and characterize complex systems in a manner that draws on the authentic voice of residents and community partners.

HKHC Community Dashboard: design, development, and function of a Web-based performance monitoring system.

BACKGROUND: As part of Robert Wood Johnson Foundation's Healthy Kids, Healthy Communities (HKHC) national grant program, a technical assistance team designed the HKHC Community Dashboard, an online progress documentation and networking system. The Dashboard was central to HKHC's multimethod program evaluation and became a communication interface for grantees and technical assistance providers. METHODS: The Dashboard was designed through an iterative process of identifying needs and priorities; designing the user experience, technical development, and usability testing; and applying visual design. The system was created with an open-source content management system and support for building an online community of users. The site developer trained technical assistance providers at the national program office and evaluators, who subsequently trained all 49 grantees. Evaluators provided support for Dashboard users and populated the site with the bulk of its uploaded tools and resource documents. The system tracked progress through an interactive work plan template, regular documentation by local staff and partners, and data coding and analysis by the evaluation team. Other features included the ability to broadcast information to Dashboard users via e-mail, event calendars, discussion forums, private messaging, a resource clearinghouse, a technical assistance diary, and real-time progress reports. RESULTS: The average number of Dashboard posts was 694 per grantee during the grant period. Technical assistance providers and grantees uploaded a total of 1304 resource documents. The Dashboard functions with the highest grantee satisfaction were its interfaces for sharing and progress documentation. A majority of Dashboard users (69%) indicated a preference for continued access to the Dashboard's uploaded resource documents. CONCLUSIONS: The Dashboard was a useful and innovative tool for participatory evaluation of a large national grant program. While progress documentation added some burden to local project staff, the system proved to be a useful resource-sharing technology.

Behavior-over-time graphs: assessing perceived trends in healthy eating and active living environments and behaviors across 49 communities.

CONTEXT: In the evaluation of the Healthy Kids, Healthy Communities initiative, investigators implemented Group Model Building (GMB) to promote systems thinking at the community level. As part of the GMB sessions held in each community partnership, participants created behavior-over-time graphs (BOTGs) to characterize their perceptions of changes over time related to policies, environments, collaborations, and social determinants in their community related to healthy eating, active living, and childhood obesity. OBJECTIVE: To describe the process of coding BOTGs and their trends. DESIGN: Descriptive study of trends among BOTGs from 11 domains (eg, active living environments, social determinants of health, funding) and relevant categories and subcategories based on the graphed variables. In addition, BOTGs were distinguished by whether the variables were positively (eg, access to healthy foods) or negatively (eg, screen time) associated with health. SETTING: The GMB sessions were held in 49 community partnerships across the United States. PARTICIPANTS: Participants in the GMB sessions (n = 590; n = 5-21 per session) included key individuals engaged in or impacted by the policy, system, or environmental changes occurring in the community. MAIN OUTCOME MEASURES: Thirty codes were developed to describe the direction (increasing, decreasing, stable) and shape (linear, reinforcing, balancing, or oscillating) of trends from 1660 graphs. RESULTS: The patterns of trends varied by domain. For example, among variables positively associated with health, the prevalence of reinforcing increasing trends was highest for active living and healthy eating environments (37.4% and 29.3%, respectively), partnership and community capacity (38.8%), and policies (30.2%). Examination of trends of specific variables suggested both convergence (eg, for cost of healthy foods) and divergence (eg, for farmers' markets) of trends across partnerships. CONCLUSIONS: Behavior-over-time graphs provide a unique data source for understanding community-level trends and, when combined with causal maps and computer modeling, can yield insights about prevention strategies to address childhood obesity.

Increasing community capacity for participatory evaluation of healthy eating and active living strategies through direct observations and environmental audits.

BACKGROUND: Local partnerships from the Healthy Kids, Healthy Communities initiative elected to participate in enhanced evaluation trainings to collect data through environmental audits and direct observations as well as to build their evaluation capacity. METHODS: Environmental audit and direct observation tools and protocols were adapted for the relevant healthy eating and active living policy and environmental change approaches being conducted by the Healthy Kids, Healthy Communities partnerships. Customized trainings were conducted by the evaluation team to increase capacity and understanding for evaluation activities. RESULTS: A total of 87 trainings were conducted by the evaluation team in 31 Healthy Kids, Healthy Communities community partnerships. Data were collected for a total of 41 environmental audits and 17 direct observations. Community case examples illustrate how these trainings developed evaluation capacity. For instance, youth from one community presented environmental audit findings to local elected officials. CONCLUSIONS: The 31 partnerships participating in the community-based evaluation efforts resulted in 164 individuals trained in collecting context-specific data to assess the impact of healthy eating and active living policy and environmental strategies designed to create community change.