Accuracy of energy and nutrient intake estimation versus observed intake using 4 technology-assisted dietary assessment methods: a randomized crossover feeding study.

BACKGROUND: Technology-assisted 24-h dietary recalls (24HRs) have been widely adopted in population nutrition surveillance. Evaluations of 24HRs inform improvements, but direct comparisons of 24HR methods for accuracy in reference to a measure of true intake are rarely undertaken in a single study population. OBJECTIVES: To compare the accuracy of energy and nutrient intake estimation of 4 technology-assisted dietary assessment methods relative to true intake across breakfast, lunch, and dinner. METHODS: In a controlled feeding study with a crossover design, 152 participants [55% women; mean age 32 y, standard deviation (SD) 11; mean body mass index 26 kg/m2, SD 5] were randomized to 1 of 3 separate feeding days to consume breakfast, lunch, and dinner, with unobtrusive weighing of foods and beverages consumed. Participants undertook a 24HR the following day [Automated Self-Administered Dietary Assessment Tool-Australia (ASA24); Intake24-Australia; mobile Food Record-Trained Analyst (mFR-TA); or Image-Assisted Interviewer-Administered 24-hour recall (IA-24HR)]. When assigned to IA-24HR, participants referred to images captured of their meals using the mobile Food Record (mFR) app. True and estimated energy and nutrient intakes were compared, and differences among methods were assessed using linear mixed models. RESULTS: The mean difference between true and estimated energy intake as a percentage of true intake was 5.4% (95% CI: 0.6, 10.2%) using ASA24, 1.7% (95% CI: -2.9, 6.3%) using Intake24, 1.3% (95% CI: -1.1, 3.8%) using mFR-TA, and 15.0% (95% CI: 11.6, 18.3%) using IA-24HR. The variances of estimated and true energy intakes were statistically significantly different for all methods (P < 0.01) except Intake24 (P = 0.1). Differential accuracy in nutrient estimation was present among the methods. CONCLUSIONS: Under controlled conditions, Intake24, ASA24, and mFR-TA estimated average energy and nutrient intakes with reasonable validity, but intake distributions were estimated accurately by Intake24 only (energy and protein). This study may inform considerations regarding instruments of choice in future population surveillance. This trial was registered at Australian New Zealand Clinical Trials Registry as ACTRN12621000209897.

Integration of USDA Food Classification System and Food Composition Database for Image-Based Dietary Assessment among Individuals Using Insulin.

New imaging technologies to identify food can reduce the reporting burden of participants but heavily rely on the quality of the food image databases to which they are linked to accurately identify food images. The objective of this study was to develop methods to create a food image database based on the most commonly consumed U.S. foods and those contributing the most to energy. The objective included using a systematic classification structure for foods based on the standardized United States Department of Agriculture (USDA) What We Eat in America (WWEIA) food classification system that can ultimately be used to link food images to a nutrition composition database, the USDA Food and Nutrient Database for Dietary Studies (FNDDS). The food image database was built using images mined from the web that were fitted with bounding boxes, identified, annotated, and then organized according to classifications aligning with USDA WWEIA. The images were classified by food category and subcategory and then assigned a corresponding USDA food code within the USDA's FNDDS in order to systematically organize the food images and facilitate a linkage to nutrient composition. The resulting food image database can be used in food identification and dietary assessment.

Image-based assessment of plant disease progression identifies new genetic loci for resistance to Ralstonia solanacearum in tomato.

A major challenge in global crop production is mitigating yield loss due to plant diseases. One of the best strategies to control these losses is through breeding for disease resistance. One barrier to the identification of resistance genes is the quantification of disease severity, which is typically based on the determination of a subjective score by a human observer. We hypothesized that image-based, non-destructive measurements of plant morphology over an extended period after pathogen infection would capture subtle quantitative differences between genotypes, and thus enable identification of new disease resistance loci. To test this, we inoculated a genetically diverse biparental mapping population of tomato (Solanum lycopersicum) with Ralstonia solanacearum, a soilborne pathogen that causes bacterial wilt disease. We acquired over 40 000 time-series images of disease progression in this population, and developed an image analysis pipeline providing a suite of 10 traits to quantify bacterial wilt disease based on plant shape and size. Quantitative trait locus (QTL) analyses using image-based phenotyping for single and multi-traits identified QTLs that were both unique and shared compared with those identified by human assessment of wilting, and could detect QTLs earlier than human assessment. Expanding the phenotypic space of disease with image-based, non-destructive phenotyping both allowed earlier detection and identified new genetic components of resistance.

Joint temporal dietary and physical activity patterns: associations with health status indicators and chronic diseases.

BACKGROUND: Diet and physical activity (PA) are independent risk factors for obesity and chronic diseases including type 2 diabetes mellitus (T2DM) and metabolic syndrome (MetS). The temporal sequence of these exposures may be used to create patterns with relations to health status indicators. OBJECTIVES: The objectives were to create clusters of joint temporal dietary and PA patterns (JTDPAPs) and to determine their association with health status indicators including BMI, waist circumference (WC), fasting plasma glucose, glycated hemoglobin, triglycerides, HDL cholesterol, total cholesterol, blood pressure, and disease status including obesity, T2DM, and MetS in US adults. METHODS: A 24-h dietary recall and random day of accelerometer data of 1836 participants from the cross-sectional NHANES 2003-2006 data were used to create JTDPAP clusters by constrained dynamic time warping, coupled with a kernel k-means clustering algorithm. Multivariate regression models determined associations between the 4 JTDPAP clusters and health and disease status indicators, controlling for potential confounders and adjusting for multiple comparisons. RESULTS: A JTDPAP cluster with proportionally equivalent energy consumed at 2 main eating occasions reaching ≤1600 and ≤2200 kcal from 11:00 to 13:00 and from 17:00 to 20:00, respectively, and the highest PA counts among 4 clusters from 08:00 to 20:00, was associated with significantly lower BMI (P < 0.0001), WC (P = 0.0001), total cholesterol (P = 0.02), and odds of obesity (OR: 0.2; 95% CI: 0.1, 0.5) than a JTDPAP cluster with proportionally equivalent energy consumed reaching ≤1600 and ≤1800 kcal from 11:00 to 14:00 and from 17:00 to 21:00, respectively, and high PA counts from 09:00 to 12:00. CONCLUSIONS: The joint temporally patterned sequence of diet and PA can be used to cluster individuals with meaningful associations to BMI, WC, total cholesterol, and obesity. Temporal patterns hold promise for future development of lifestyle patterns that integrate additional temporal and contextual activities.

Accuracy and Cost-effectiveness of Technology-Assisted Dietary Assessment Comparing the Automated Self-administered Dietary Assessment Tool, Intake24, and an Image-Assisted Mobile Food Record 24-Hour Recall Relative to Observed Intake: Protocol for a Randomized Crossover Feeding Study.

BACKGROUND: The assessment of dietary intake underpins population nutrition surveillance and nutritional epidemiology and is essential to inform effective public health policies and programs. Technological advances in dietary assessment that use images and automated methods have the potential to improve accuracy, respondent burden, and cost; however, they need to be evaluated to inform large-scale use. OBJECTIVE: The aim of this study is to compare the accuracy, acceptability, and cost-effectiveness of 3 technology-assisted 24-hour dietary recall (24HR) methods relative to observed intake across 3 meals. METHODS: Using a controlled feeding study design, 24HR data collected using 3 methods will be obtained for comparison with observed intake. A total of 150 healthy adults, aged 18 to 70 years, will be recruited and will complete web-based demographic and psychosocial questionnaires and cognitive tests. Participants will attend a university study center on 3 separate days to consume breakfast, lunch, and dinner, with unobtrusive documentation of the foods and beverages consumed and their amounts. Following each feeding day, participants will complete a 24HR process using 1 of 3 methods: the Automated Self-Administered Dietary Assessment Tool, Intake24, or the Image-Assisted mobile Food Record 24-Hour Recall. The sequence of the 3 methods will be randomized, with each participant exposed to each method approximately 1 week apart. Acceptability and the preferred 24HR method will be assessed using a questionnaire. Estimates of energy, nutrient, and food group intake and portion sizes from each 24HR method will be compared with the observed intake for each day. Linear mixed models will be used, with 24HR method and method order as fixed effects, to assess differences in the 24HR methods. Reporting bias will be assessed by examining the ratios of reported 24HR intake to observed intake. Food and beverage omission and intrusion rates will be calculated, and differences by 24HR method will be assessed using chi-square tests. Psychosocial, demographic, and cognitive factors associated with energy misestimation will be evaluated using chi-square tests and multivariable logistic regression. The financial costs, time costs, and cost-effectiveness of each 24HR method will be assessed and compared using repeated measures analysis of variance tests. RESULTS: Participant recruitment commenced in March 2021 and is planned to be completed by the end of 2021. CONCLUSIONS: This protocol outlines the methodology of a study that will evaluate the accuracy, acceptability, and cost-effectiveness of 3 technology-enabled dietary assessment methods. This will inform the selection of dietary assessment methods in future studies on nutrition surveillance and epidemiology. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12621000209897; https://tinyurl.com/2p9fpf2s. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/32891.

Dietary Aspects to Incorporate in the Creation of a Mobile Image-Based Dietary Assessment Tool to Manage and Improve Diabetes.

Diabetes is the seventh leading cause of death in United States. Dietary intake and behaviors are essential components of diabetes management. Growing evidence suggests dietary components beyond carbohydrates may critically impact glycemic control. Assessment tools on mobile platforms have the ability to capture multiple aspects of dietary behavior in real-time throughout the day to inform and improve diabetes management and insulin dosing. The objective of this narrative review was to summarize evidence related to dietary behaviors and composition to inform a mobile image-based dietary assessment tool for managing glycemic control of both diabetes types (type 1 and type 2 diabetes). This review investigated the following topics amongst those with diabetes: (1) the role of time of eating occasion on indicators of glycemic control; and (2) the role of macronutrient composition of meals on indicators of glycemic control. A search for articles published after 2000 was completed in PubMed with the following sets of keywords "diabetes/diabetes management/diabetes prevention/diabetes risk", "dietary behavior/eating patterns/temporal/meal timing/meal frequency", and "macronutrient composition/glycemic index". Results showed eating behaviors and meal macronutrient composition may affect glycemic control. Specifically, breakfast skipping, late eating and frequent meal consumption might be associated with poor glycemic control while macronutrient composition and order of the meal could also affect glycemic control. These factors should be considered in designing a dietary assessment tool, which may optimize diabetes management to reduce the burden of this disease.

Image-Based Dietary Assessment and Tailored Feedback Using Mobile Technology: Mediating Behavior Change in Young Adults.

Assessing the implementation of nutrition interventions is important to identify characteristics and dietary patterns of individuals who benefit most. The aim was to report on young adults' experiences of receiving dietary feedback text messaging intervention. Diet was captured using an image-based 4-day mobile food recordTM application (mFRTM) and assessed to formulate two tailored feedback text messages on fruit and vegetables and energy-dense nutrient-poor (EDNP) foods and beverages. At 6-months 143 participants completed a second mFRTM and a questionnaire evaluating the dietary feedback. Participants who agreed the text messages made them think about how much vegetables they ate were more likely to increase their intake by at least half a serve than those who disagreed [odds ratio (OR) = 4.28, 95% Confidence Interval (CI): 1.76 to 10.39]. Those who agreed the text messages made them think about how much EDNP foods they ate, were twice as likely to decrease their intake by over half a serve (OR = 2.39, 95%CI: 1.12 to 5.25) than those who disagreed. Undertaking detailed dietary assessment ensured the tailored feedback was constructive and relevant. Personal contemplation about vegetable and EDNP food intake appears to be a mediator of dietary change in young adults.

Technology-Based Dietary Assessment in Youth with and Without Developmental Disabilities.

Obesity prevalence is higher in children with developmental disabilities as compared to their typically developing peers. Research on dietary intake assessment methods in this vulnerable population is lacking. The objectives of this study were to assess the feasibility, acceptability, and compare the nutrient intakes of two technology-based dietary assessment methods in children with-and-without developmental disabilities. This cross-sectional feasibility study was an added aim to a larger pilot study. Children (n = 12; 8⁻18 years) diagnosed with spina bifida, Down syndrome, or without disability were recruited from the larger study sample, stratified by diagnosis. Participants were asked to complete six days of a mobile food record (mFR™), a 24-h dietary recall via FaceTime® (24 HR-FT), and a post-study survey. Analysis included descriptive statistics for survey results and a paired samples t-test for nutrient intakes. All participants successfully completed six days of dietary assessment using both methods and acceptability was high. Energy (kcal) and protein (g) intake was significantly higher for the mFR™ as compared to the 24 HR-FT (p = 0.041; p = 0.014, respectively). Each method had strengths and weaknesses. The two technology-based dietary assessment tools were well accepted and when combined could increase accuracy of self-reported dietary assessment in children with-and-without disability.

Context Based Image Analysis With Application in Dietary Assessment and Evaluation.

Dietary assessment is essential for understanding the link between diet and health. We develop a context based image analysis system for dietary assessment to automatically segment, identify and quantify food items from images. In this paper, we describe image segmentation and object classification methods used in our system to detect and identify food items. We then use context information to refine the classification results. We define contextual dietary information as the data that is not directly produced by the visual appearance of an object in the image, but yields information about a user's diet or can be used for diet planning. We integrate contextual dietary information that a user supplies to the system either explicitly or implicitly to correct potential misclassifications. We evaluate our models using food image datasets collected during dietary assessment studies from natural eating events.

Characterizing Early Adolescent Plate Waste Using the Mobile Food Record.

This study aimed to assess the amount of plate waste and how plate waste was disposed by early adolescent girls using a mobile food record (mFR). Participants were girls nine to thirteen years residing in O'ahu, Hawai'i (n = 93). Foods selected and leftover were estimated using a three day mFR. Each leftover food was then classified as thrown into the trash, fed to a pet, eaten later, or other (e.g., composted). Repeated measures analyses of variance (ANOVA) were conducted and Tukey's post-hoc test were used to adjust for multiple comparisons between times (breakfast, lunch, dinner, and snack) on leftover food and leftover food thrown into the trash. The percentage of food leftover and thrown into the trash was highest at lunch. The percentage of protein, grain, vegetables, fruit, and dairy leftover at lunch were unexpectedly low compared to previous studies. The median for percentage of food thrown into the trash at lunch was <5% for all food groups, and was consistently low across the day (<10%). Average energy intake was 436 kcal (±216) at lunch, and 80% of caregivers reported total household income as ≥$70,000. Studies in real-time using technology over full days may better quantify plate waste among adolescents.

Dietary Assessment of domoic acid Exposure: What can be learned from traditional methods and new applications for a technology assisted device.

Three Tribal Nations in the Pacific Northwest United States comprise the members of the CoASTAL cohort. These populations may be at risk for neurobehavioral impairment, i.e., amnesic shellfish poisoning, from shellfish consumption as a result of repeated, low-level domoic acid (DA) exposure present in local clams. Previous work with this cohort confirmed a high proportion of clam consumers with varying levels of potential exposure over time. Since clams are an episodically consumed food, traditional dietary records do not fully capture exposure. Frequency questionnaires can capture accumulated doses over time and this data can be used to examine dose-response relationships with periodic studies of memory and learning. However, frequency questionnaires cannot be used to assess consumption and memory response in real time. To address this shortcoming, a modified technology assisted dietary assessment (TADA) iPod application was developed to capture images of the clam meal, sourcing data, and associated memory functioning within 24 hours and seven days after consumption. This methodology was piloted with razor clam meals consumed by members from the CoASTAL cohort. Preliminary findings suggest that the TADA iPod application is potentially useful in collecting real-time data with respect to razor clam consumption, as well as one day and seven day memory outcome data. This technology holds promise for addressing the challenges of other HAB related dietary exposure outcome studies.

Dietary assessment of domoic acid exposure: What can be learned from traditional methods and new applications for a technology assisted device.

Three Tribal Nations in the Pacific Northwest United States comprise the members of the CoASTAL cohort. These populations may be at risk for neurobehavioral impairment, i.e., amnesic shellfish poisoning, from shellfish consumption resulting in repeated, low-level domoic acid (DA) exposure. Previous work with this cohort confirmed a high proportion of clam consumers with varying levels of potential exposure over time. Since clams are an episodically consumed food, traditional dietary records do not fully capture exposure. Frequency questionnaires can capture accumulated doses over time and this data can be used to examine dose-response relationships with periodic studies of memory and learning. However, frequency questionnaires cannot be used to assess consumption and memory response in real time. To address this shortcoming, a modified technology assisted dietary assessment (TADA) iPod application was developed to capture images of the clam meal, sourcing data, and associated memory functioning within 24h and seven days after consumption. This methodology was piloted with razor clam meals consumed by members from the CoASTAL cohort. Preliminary findings suggest that the TADA iPod application is potentially useful in collecting real-time data with respect to razor clam consumption, as well as one day and seven day memory outcome data. This technology holds promise for addressing the challenges of other HAB related dietary exposure outcome studies.

A Mobile Food Record For Integrated Dietary Assessment.

This paper presents an integrated dietary assessment system based on food image analysis that uses mobile devices or smartphones. We describe two components of our integrated system: a mobile application and an image-based food nutrient database that is connected to the mobile application. An easy-to-use mobile application user interface is described that was designed based on user preferences as well as the requirements of the image analysis methods. The user interface is validated by user feedback collected from several studies. Food nutrient and image databases are also described which facilitates image-based dietary assessment and enable dietitians and other healthcare professionals to monitor patients dietary intake in real-time. The system has been tested and validated in several user studies involving more than 500 users who took more than 60,000 food images under controlled and community-dwelling conditions.

A Novel Dietary Assessment Method to Measure a Healthy and Sustainable Diet Using the Mobile Food Record: Protocol and Methodology.

The world-wide rise in obesity parallels growing concerns of global warming and depleting natural resources. These issues are often considered separately but there may be considerable benefit to raising awareness of the impact of dietary behaviours and practices on the food supply. Australians have diets inconsistent with recommendations, typically low in fruit and vegetables and high in energy-dense nutrient-poor foods and beverages (EDNP). These EDNP foods are often highly processed and packaged, negatively influencing both health and the environment. This paper describes a proposed dietary assessment method to measure healthy and sustainable dietary behaviours using 4-days of food and beverage images from the mobile food record (mFR) application. The mFR images will be assessed for serves of fruit and vegetables (including seasonality), dairy, eggs and red meat, poultry and fish, ultra-processed EDNP foods, individually packaged foods, and plate waste. A prediction model for a Healthy and Sustainable Diet Index will be developed and tested for validity and reliability. The use of the mFR to assess adherence to a healthy and sustainable diet is a novel and innovative approach to dietary assessment and will have application in population monitoring, guiding intervention development, educating consumers, health professionals and policy makers, and influencing dietary recommendations.

Multiple hypotheses image segmentation and classification with application to dietary assessment.

We propose a method for dietary assessment to automatically identify and locate food in a variety of images captured during controlled and natural eating events. Two concepts are combined to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on global and local features; and perceptually similar object classes can be used to assess the accuracy of image segmentation. These ideas are implemented by generating multiple segmentations of an image to select stable segmentations based on the classifier's confidence score assigned to each segmented image region. Automatic segmented regions are classified using a multichannel feature classification system. For each segmented region, multiple feature spaces are formed. Feature vectors in each of the feature spaces are individually classified. The final decision is obtained by combining class decisions from individual feature spaces using decision rules. We show improved accuracy of segmenting food images with classifier feedback.

A Mobile Phone User Interface for Image-Based Dietary Assessment.

Many chronic diseases, including obesity and cancer, are related to diet. Such diseases may be prevented and/or successfully treated by accurately monitoring and assessing food and beverage intakes. Existing dietary assessment methods such as the 24-hour dietary recall and the food frequency questionnaire, are burdensome and not generally accurate. In this paper, we present a user interface for a mobile telephone food record that relies on taking images, using the built-in camera, as the primary method of recording. We describe the design and implementation of this user interface while stressing the solutions we devised to meet the requirements imposed by the image analysis process, yet keeping the user interface easy to use.

Image Enhancement and Quality Measures for Dietary Assessment Using Mobile Devices.

Measuring accurate dietary intake is considered to be an open research problem in the nutrition and health fields. We are developing a system, known as the mobile device food record (mdFR), to automatically identify and quantify foods and beverages consumed based on analyzing meal images captured with a mobile device. The mdFR makes use of a fiducial marker and other contextual information to calibrate the imaging system so that accurate amounts of food can be estimated from the scene. Food identification is a difficult problem since foods can dramatically vary in appearance. Such variations may arise not only from non-rigid deformations and intra-class variability in shape, texture, color and other visual properties, but also from changes in illumination and viewpoint. To address the color consistency problem, this paper describes illumination quality assessment methods implemented on a mobile device and three post color correction methods.

Multilevel Segmentation for Food Classification in Dietary Assessment.

Given a dataset of images, we seek to automatically identify and locate perceptually similar objects. We combine two ideas to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on global and local features; and perceptually similar object classes can be used to assess the accuracy of image segmentation. These ideas are implemented by generating multiple segmentations of each image and then learning the object class by combining different segmentations to generate optimal segmentation. We demonstrate that the proposed method can be used as part of a new dietary assessment tool to automatically identify and locate the foods in a variety of food images captured during different user studies.

Segmentation Assisted Food Classification for Dietary Assessment.

Accurate methods and tools to assess food and nutrient intake are essential for the association between diet and health. Preliminary studies have indicated that the use of a mobile device with a built-in camera to obtain images of the food consumed may provide a less burdensome and more accurate method for dietary assessment. We are developing methods to identify food items using a single image acquired from the mobile device. Our goal is to automatically determine the regions in an image where a particular food is located (segmentation) and correctly identify the food type based on its features (classification or food labeling). Images of foods are segmented using Normalized Cuts based on intensity and color. Color and texture features are extracted from each segmented food region. Classification decisions for each segmented region are made using support vector machine methods. The segmentation of each food region is refined based on feedback from the output of classifier to provide more accurate estimation of the quantity of food consumed.

Volume Estimation Using Food Specific Shape Templates in Mobile Image-Based Dietary Assessment.

As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient intakes. Given the ubiquity of mobile devices with built-in cameras, one possible means of improving dietary assessment is through photographing foods and inputting these images into a system that can determine the nutrient content of foods in the images. One of the critical issues in such the image-based dietary assessment tool is the accurate and consistent estimation of food portion sizes. The objective of our study is to automatically estimate food volumes through the use of food specific shape templates. In our system, users capture food images using a mobile phone camera. Based on information (i.e., food name and code) determined through food segmentation and classification of the food images, our system choose a particular food template shape corresponding to each segmented food. Finally, our system reconstructs the three-dimensional properties of the food shape from a single image by extracting feature points in order to size the food shape template. By employing this template-based approach, our system automatically estimates food portion size, providing a consistent method for estimation food volume.