Psychometric Evidence of the Attitudes Toward Food Scale for Native Hawaiians.

Many efforts are being made to promote healthy eating habits and nutrition among Native Hawaiian communities by cultivating positive attitudes toward healthy foods. However, there are limited quantitative scales that have been psychometrically validated with Native Hawaiian communities. This paper examines evidence on the reliability and validity of the Attitudes Toward Food (ATF) scale used with 68 Native Hawaiian adults from Waimanalo who are participating in a backyard aquaponics intervention called Mini Ahupua'a for Lifestyle and Mea'ai through Aquaponics (MALAMA). Exploratory factor analysis (EFA) and internal consistency reliability analysis were conducted to examine the underlying constructs of the ATF scale. Cognitive interviews with 3 MALAMA participants were also conducted to analyze how participants understood, processed, and responded to the scale. Findings from the cognitive interviews provided response-process evidence of validity and acceptability. Findings from the EFA revealed 2 factors. Factor 1 contained items that discussed confidence in preparing and using healthy foods. Factor 2 contained items that involved the consumption of healthy foods. The reliability analysis suggested that the 2 factors of the ATF scale are internally consistent (Cronbach's alpha = 0.79 and 0.71, respectively). Taken together, the evidence provides provisional support for the validity and reliability of the instrument for measuring attitudes among Native Hawaiians from Waimanalo. The ATF scale may be useful for similar health and nutritional programs for Native Hawaiians in Hawai'i. Future studies with larger samples and diverse sources of validity evidence may provide additional support of the scale's validity.

Issues of rigor and feasibility when observing the quality of program implementation: a case study.

Program evaluators have paid little attention in the literature to the manner in which measuring the quality of implementation with observations requires tradeoffs between rigor (reliability and validity) and program evaluation feasibility. We present a case example of how we addressed rigor in light of feasibility concerns when developing and conducting observations for measuring the quality of implementation of a small education professional development program. We discuss the results of meta-evaluative analyses of the reliability of the quality observations, and we present conclusions about conducting observations in a rigorous and feasible manner. The results show that the feasibility constraints that we faced did not notably reduce the rigor of our methods.