Assessment in community settings: Is there any role for individual competency-based assessment?

BACKGROUND: Oral forms of assessment remain a common part of competency-based assessment systems, yet their feasibility is being challenged. The focus on individual competence is problematic given the need to prepare health professionals for teamwork. The present study aimed to investigate how the assessment of collective competence compares to individual assessment, and to explore whether there is a need for individual assessment at all in community or population-based practice. METHODS: A behavioural-based interview assessment was developed and trialled and correlated to performance as a team on placement. Correlation between student performance on individual behavioural-based interview and teamwork artefacts was assessed using Spearman rho. Differences between performance on individual oral assessment and team performance on artefacts at the cohort level was determined using the Mann-Whitney U-test. Bland-Altman analysis was completed to analyse agreement between performance on the individual oral assessment and team performance at the student level. RESULTS: Students were final year nutrition and dietetics students from 2020, 2021 and 2022 years (total sample = 216) from one Australian university. There was a difference in performance between assessment types in each year and as a total cohort (p < 0.001) with students performing better in teamwork. There was no correlation between individual oral interview and team performance across all years. The results of the Bland-Altman analysis showed little agreement between the two assessment tasks. CONCLUSIONS: Assessment of teamwork performance as part of a program of assessment is essential. More valid and reliable tools are needed to assess collective competence.

Exploring Australian night shift workers' food experiences within and outside of the workplace: a qualitative photovoice study.

OBJECTIVE: Night shift workers are at a 20 to 40 % increased risk of metabolic diseases, which may be associated with their disrupted eating patterns. This qualitative study explores factors that influence night shift workers' eating habits, within and outside of the workplace, to identify target areas for health promotion strategies. PARTICIPANTS AND SETTING: Eligible participants resided in Australia, working at least three overnight shifts per month. DESIGN: The photovoice method was used, whereby participants were asked to take photos that represent their typical eating habits. These photos were incorporated as prompts in a semi-structured interview, which explored factors influencing eating habits on night shifts and days-off and perceptions and enablers to healthy eating. RESULTS: Ten participants completed the study. Thematic analysis generated four main themes, which were mapped onto the Social Ecological Model (SE Model). Aligned with the SE Model, our results show night shift workers' eating habits are influenced by intrapersonal, interpersonal and (work) organisational levels. Participants reported that at work, appropriate food preparation facilities are required to enable healthy food choices. Poor shift work rostering leads to prolonged fatigue on days-off, limiting their ability and motivation to engage in healthy eating. Consequently, night shift workers seem to require additional supports from their social networks and enhanced food literacy skills, in order to adopt/ maintain healthy eating behaviours. CONCLUSIONS: Night shift work creates individual and environmental barriers to healthy eating, which are present during and outside of work. Health promotion strategies for this population should include multiple approaches to address these barriers.

Food security definition, measures and advocacy priorities in high-income countries: a Delphi consensus study.

OBJECTIVE: To establish an international consensus on the definition of food security, measures and advocacy priorities in high-income countries. DESIGN: A two-round online Delphi survey with closing in March 2020 and December 2021. Consensus was set a priori at 75 %. Qualitative data were synthesised and priorities were ranked. SETTING: High-income countries. PARTICIPANTS: Household food security experts in academia, government and non-government organisations who had published in the last 5 years. RESULTS: Up to thirty-two participants from fourteen high-income countries responded to the Delphi with a 25 % response rate in Round 1 and a 38 % response rate in Round 2. Consensus was reached on the technical food security definition and its dimensions. Consensus was not reached on a definition suitable for the general public. All participants agreed that food security monitoring systems provide valuable data for in-country decision-making. Favoured interventions were those that focused on upstream social policy influencing income. Respondents agreed that both national and local community level strategies were required to ameliorate food insecurity, reinforcing the complexity of the problem. CONCLUSIONS: This study furthers the conceptual understanding of the commonly used definition of food security and its constituent dimensions. Strong advocacy is needed to ensure food security monitoring, policy and mitigation strategies are implemented. The consensus on the importance of prioritising actions that address the underlying determinants of household food security by experts in the field from across wealthy nations provides evidence to focus advocacy efforts and generate public debate.

Harnessing community expertise in understanding food insecurity to inform responses in a local government area in Victoria, Australia: a mixed methods photovoice study.

BACKGROUND: Local food systems which support affordable, equitable, accessible, and sustainable food are important to enhance food access and reduce food insecurity. Cardinia Shire Council, a local government in Victoria, Australia has developed and endorsed a 'Community Food Strategy' to support their local food system and food security. This study aimed to explore local government community member perspectives regarding food access within their local food environment, and suggested areas to be addressed to better support access. METHODS: A sequential mixed methods photovoice methodology was implemented. Participants aged over 18 years, who resided in Cardinia Shire, completed an online quantitative survey to explore demographics, food access and food security status and severity (18-item USDA Household Food Security Survey Module). The qualitative photovoice method was used, whereby participants were asked to take photographs that represent their experiences of food access. These photographs were used as prompts in a semi-structured interview Interview data were thematically analysed. RESULTS: Seventeen participants completed the study, of which five participants experienced varied severity levels of food insecurity. From the photovoice interviews four themes were developed: 1) Food: a connector to self, people and place, 2) Influencers of food access and triggers for food insecurity, 3) Savvy food literacy skills to support access to food, 4) Consequences of and struggles with food insecurity. Participants suggested recommendations for action to support future food access in their community. CONCLUSIONS: While food choice is influenced by a range of determinants, the local food environment greatly impacts both food access and food choice. A supportive local food system which promotes inclusion of a community voice, community connectedness, food literacy and physical and economic access to local produce is crucial to support food security.

Exploration of the food environment in different socioeconomic areas in Hong Kong and Singapore: a cross-sectional case study.

This study explored the local food environment of Hong Kong and Singapore using a qualitative case study approach to inform future upstream public health nutrition policies. Food outlets that provide food to be eaten in the home were mapped in selected areas of high and low socioeconomic status (SES) of Hong Kong and Singapore. Food outlet density relative to land area was determined. In both countries, lower SES areas surveyed were shown to have higher food outlet density while higher SES areas had fewer but larger food outlets. In Hong Kong, both SES areas reported similar proportions of healthy and unhealthy food outlets.This study highlights the accessibility of food outlet types through their geographical location and density. Future research assessing the differences in eating culture between these two countries should be considered alongside this study's findings, to investigate strategies influencing the food environment in order to promote healthier eating habits.

A structured expert judgement elicitation approach: how can it inform sound intervention decision-making to support household food security?

OBJECTIVE: To examine structured expert judgement (SEJ) elicitation as a method to provide robust, defensible data for three determinants of household food security (food cost, household disposable income and physical access) for quantifying a proof-of-concept integrating decision support system for food security. DESIGN: SEJ elicitation is a validated method for obtaining unavailable data, but its use in household food security in high-income countries is novel. Investigate Discuss Estimate Aggregate (IDEA) elicitation protocol was implemented, including quantitative and qualitative elements. Using specific questions related to three determinants, food security experts were encouraged to Investigate - estimate individual first-round responses to these questions, Discuss - with each other evidence on the reasoning and logic of their estimates, Estimate - second-round responses, following which these judgements were combined using mathematical Aggregation. SETTING: Victoria, Australia. PARTICIPANTS: Five experts with a range of expertise in the area of household food insecurity participated in the SEJ elicitation process. RESULTS: The experts' ability to provide reliable estimates was tested and informed the aggregation of the collection of individual estimates into a single quantity of interest for use in decision support. The results of the quantitative elicitation show the impact of combinations of varying household income, food cost and physical access on household food security status and severity and is supported by the experts reasoning during elicitation. CONCLUSION: This research provides insight to the application of SEJ where elicited data can inform and support intervention decision-making specific to household food security, especially where evidence is absent or of poor quality.

How do students offer value to organisations through work integrated learning? A qualitative study using Social Exchange Theory.

Learning through work is a common feature of preparing health professionals for practice. Current understandings of work-integrated learning or a 'work-based placement', focus on students being consumers of experiences rather than providing a reciprocal benefit to the organisation in which they are placed. More nuanced understanding of the ways that students can offer value to organisations may provide new opportunities and increased capacity for workplace learning. This study drew on Social Exchange Theory to explore the perceived value and benefits of work-integrated learning experiences to the organisations in which students are placed. The focus was on population health placements undertaken by dietetics students at a large Australian university. An interpretive approach was employed with interviews with placement educators and document analysis of student-generated products from their placement. Seventeen of 20 eligible placement educators were interviewed, with interview data coded using thematic framework analysis. These data were supported with document analysis of student scientific posters completed as part of assessment to develop themes which were interpreted with social exchange theory. Three themes were identified: (1) students add to the organisation's capacity, (2) benefits outweigh time cost of planning and supervising and (3) explicitly valuing students for their contributions may build trust and further potentiate bi-directional benefits. Results suggest that student placements can add value to organisations. This reciprocity of benefits should be communicated to all stakeholders involved in the university-community collaboration, including students. Social exchange theory sensitised researchers to nuanced findings that may support the translation of these study findings to other student work-integrated learning settings.

Using unfolding case studies to better prepare the public health nutrition workforce to address the social determinants of health.

OBJECTIVE: The public health nutrition workforce has been reported to be underprepared for practice. The present study aimed to test the ability of an unfolding case study approach to support the public health nutrition workforce for the workplace, with a focus on improved access to nutritious food. DESIGN: Two unfolding case studies were trialled with undergraduate students in two-hour workshops to enhance their capability to address access to nutritious food as a social determinant of health. The approach provided information about the case using a staged approach that supported learners to review and reply to information and then continue this process as the case became increasingly complex. SETTING: Melbourne, Australia.ParticipantsThirty-eight undergraduate nutrition and dietetics students. RESULTS: The analysis revealed that the unfolding case study approach provided a place to challenge and deepen knowledge and think about the application of theory. As the cases developed and became more challenging, students were supported to consider appropriate approaches and recognised the constant evolution and dynamic nature of practice. CONCLUSIONS: This learning activity challenged students and supported deep learning about possible solutions. It may also be useful at a graduate level and for continuous education of nutritionists and/or dietitians to empower the workforce to address the social determinants of health, rather than just acknowledging them as a set of barriers that prevent people and communities from achieving optimal health. Further work is required to investigate how unfolding case studies in curricula shape preparedness for practice of public health nutrition.

Preliminary validation and piloting of a comprehensive measure of household food security in Australia.

OBJECTIVE: To investigate the psychometric properties, validity and reliability of a newly developed measure of food insecurity, the Household Food and Nutrition Security Survey (HFNSS), among an Australian population. DESIGN: Cross-sectional study. SETTING: Metropolitan areas of Melbourne, Australia, identified as very high, high or medium vulnerability in the 2008 Vulnerability Assessment for Mortgage, Petrol and Inflation Risks and Expenditure index. SUBJECTS: A convenience sample of 134 adults (117 females and fifteen males, aged over 18 years). RESULTS: Rasch modelling and factor analysis identified four items for exclusion. The remaining items yielded excellent reliability among the current sample and assessed three underlying components: the adult experience of food insecurity (component one), initial/periodic changes to children's food intakes (component two) and progressive/persistent decreases in children's food intakes (component three). Compared with the widely used US Department of Agriculture Food Security Survey Module, the HFNSS identified a significantly higher proportion of food insecurity; this is likely due to the HFNSS's identification of food insecurity due to reasons other than (and including) limited financial access. CONCLUSIONS: The HFNSS may be a valid and reliable tool for the assessment of food insecurity among the Australian population and provides a means of assessing multiple barriers to food security beyond poor financial access (which has been identified as a limitation of other existing tools). Future research should explore the validity and reliability of the tool among a more representative sample, as well as specifically among vulnerable population subgroups.

Are low-to-middle-income households experiencing food insecurity in Victoria, Australia? An examination of the Victorian Population Health Survey, 2006-2009.

Food insecurity affects health and wellbeing. Little is known about the relationship between food insecurity across income levels. This study aims to investigate the prevalence and frequency of food insecurity in low-to-middle-income Victorian households over time and identify factors associated with food insecurity in these households. Prevalence and frequency of food insecurity was analysed across household income levels using data from the cross-sectional 2006-09 Victorian Population Health Surveys (VPHS). Respondents were categorised as food insecure, if in the last 12 months they had run out of food and were unable to afford to buy more. Multivariable logistic regression was used to describe factors associated with food insecurity in low-to-middle-income households (A$40000-$80000 in 2008). Between 4.9 and 5.5% for total survey populations and 3.9-4.8% in low-to-middle-income respondents were food insecure. Food insecurity was associated with limited help from friends, home ownership status, inability to raise money in an emergency and cost of some foods. Food insecurity exists in households beyond those on a very low income. Understanding the extent and implications of household food insecurity across all income groups in Australia will inform effective and appropriate public health responses.

Impact of the Social Café Meals program: a qualitative investigation.

Social Café Meals Programs aim to reduce food insecurity and social exclusion by providing participants access to subsidised meals in mainstream local cafés. This study aimed to explore the program's ability to address social exclusion and food insecurity and the impact of the program on the community. A qualitative evaluation approach was utilised whereby in-depth interviews were conducted with café owners, café staff and current program members of two Social Café Meals Programs operating in the south-eastern suburbs of Melbourne. Twelve program members and six café staff completed an in-depth interview at the local cafés. Data were analysed using a thematic analysis approach focusing on the lived experience of the café owners, staff and program members. Four key themes were identified. The program (i) improved food access for vulnerable groups and (ii) created community cohesiveness. (iii) The café environment was important in facilitating program use by community members. (iv) Café owners felt rewarded for their community contribution via the program. Social Café Meals Programs may provide a solution to improving food security and reducing social exclusion and may be considered as a strategy for improving nutrition and social health for at-risk and vulnerable groups.

The role of collective impact in improving nutrition. A scoping review.

BACKGROUND: Collective impact is gaining traction to improve population health outcomes. This study aimed to determine where and how collective impact is being used in nutrition and describe current understandings of its impacts or results on health or nutrition outcomes. METHODS: A systematic scoping review was undertaken with four databases ('CINAHL Plus', 'Sociological Abstracts', 'PsychInfo', and 'OVID Medline') using the search term 'Collective Impact' from 2011 up to November 2022. All studies were screened independently by two authors. Data were extracted and synthesised narratively. RESULTS: A total of 712 different documents were identified, with four studies included in the synthesis. Collective impact approaches focussed on breastfeeding, reducing sugar-sweetened beverage consumption, increasing access to healthy food, and obesity. Across the four included studies, promising results in improving health and nutrition were reported. CONCLUSION: Evaluating and reporting on the outcomes of collective impact initiatives in nutrition using robust methods is needed.

Conceptualizing weight management for night shift workers: A mixed-methods systematic review.

Shift workers have an increased risk of obesity and metabolic conditions. This mixed-methods systematic literature review on night shift workers aimed to: (1) identify barriers/enablers of weight management; (2) examine effectiveness of weight management interventions; and (3) determine whether interventions addressed enablers/barriers. Six databases were searched, articles screened by title/abstract, followed by full-text review, and quality assessment. Eligible qualitative studies documented experiences of behaviors related to weight change. Eligible quantitative studies were behavior change interventions with weight/body mass index outcomes. A thematic synthesis was undertaken for qualitative studies using the social-ecological model (SEM). Interventions were synthesized narratively including: weight/body composition change; components mapped by behavior change taxonomy; and SEM. A synthesis was undertaken to identify if interventions addressed perceived enablers/barriers. Eight qualitative (n = 169 participants) and 12 quantitative studies (n = 1142 participants) were included. Barriers predominated discussions: intrapersonal (time, fatigue, stress); interpersonal (work routines/cultural norms); organizational (fatigue, lack of: routine, healthy food options, breaks/predictable work); community (lack of healthy food options). The primary outcome for interventions was not weight loss and most did not address many identified enablers/barriers. One intervention reported a clinically significant weight loss result. Weight loss interventions that address barriers/enablers at multiple SEM levels are needed.

Evaluation of the "Shifting Weight using Intermittent Fasting in night-shift workers" weight loss interventions: a mixed-methods protocol.

Introduction: Shift workers are at a greater risk for obesity-related conditions. The impacts of working at night presents a challenge for designing effective dietary weight-loss interventions for this population group. The Shifting Weight using Intermittent Fasting in night-shift workers (SWIFt) study is a world-first, randomized controlled trial that compares three weight-loss interventions. While the trial will evaluate the effectiveness of weight-loss outcomes, this mixed-methods evaluation aims to explore for who weight-loss outcomes are achieved and what factors (intervention features, individual, social, organisational and wider environmental) contribute to this. Methods: A convergent, mixed-methods evaluation design was chosen where quantitative and qualitative data collection occurs concurrently, analyzed separately, and converged in a final synthesis. Quantitative measures include participant engagement assessed via: dietary consult attendance, fulfillment of dietary goals, dietary energy intake, adherence to self-monitoring, and rates for participant drop-out; analyzed for frequency and proportions. Regression models will determine associations between engagement measures, participant characteristics (sex, age, ethnicity, occupation, shift type, night-shifts per week, years in night shift), intervention group, and weight change. Qualitative measures include semi-structured interviews with participants at baseline, 24-weeks, and 18-months, and fortnightly audio-diaries during the 24-week intervention. Interviews/diaries will be transcribed verbatim and analyzed using five-step thematic framework analysis in NVivo. Results from the quantitative and qualitative data will be integrated via table and narrative form to interrogate the validity of conclusions. Discussion: The SWIFt study is a world-first trial that compares the effectiveness of three weight-loss interventions for night shift workers. This mixed-methods evaluation aims to further explore the effectiveness of the interventions. The evaluation will determine for who the SWIFt interventions work best for, what intervention features are important, and what external factors need to be addressed to strengthen an approach. The findings will be useful for tailoring future scalability of dietary weight-loss interventions for night-shift workers.Clinical trial registration: This evaluation is based on the SWIFt trial registered with the Australian New Zealand Clinical Trials Registry [ACTRN 12619001035112].

Conceptualisation, experiences and suggestions for improvement of food security amongst Aboriginal and Torres Strait Islander parents and carers in remote Australian communities.

This study aimed to determine perceptions of the lived experience of food insecurity and suggestions to improve food security in four remote Aboriginal communities in the Northern Territory, and Queensland. Participants were Aboriginal and/or Torres Strait Islander pregnant and breastfeeding women, and parents/carers of children aged six months to five years. Semi-structured interviews (n=17) were conducted between June-July 2021 and the data thematically analysed using a four stage process. No specific term was used by participants to describe being either food secure or insecure. Descriptions of food security were centred in food sharing, food sufficiency, and family activities. Elements describing food insecurity were physical pain and emotional stress, adults going without food, seeking family help and managing without food until payday. Factors contributing to food insecurity were reported to be: (i) Low income and unemployment, (ii) Cost of living remotely, (iii) Resource sharing, and (iv) Impact of spending on harmful commodities and activities. Three themes were conceptualised: (1) Cultural practices buffer food insecurity, (2) Coping with food insecurity, (3) People accept a degree of food insecurity as normal. Findings suggest Aboriginal and Torres Strait Islander cultural practices such as sharing food buffer episodic food insecurity and constitute 'cultural food security'. Despite use of cultural practices (e.g., procuring traditional food) and generic coping strategies, regular episodes of food insecurity often aligned with the off week of social assistance payments. Household energy (electricity) security was coupled to food security. Suggestions for improving food security included better transport and food access, extending electricity rebates, increases in the regularity of social assistance payments, and computer access and training in budgeting. Policies to advance food security should embody deeper Aboriginal and Torres Strait Islander descriptions and experiences. Community-derived policy suggestions which aim to increase access to adequate, regular, stable household income are likely to succeed.

Exploring the impacts of a fresh produce market program: a realist economic evaluation.

OBJECTIVE: To determine the contexts under which a fresh food market program is cost-effective in improving dignified access to nutritious food for food-insecure individuals. METHODS: A realist economic evaluation was employed. Purported cost related theories about how the program may function, known as context-mechanism-outcome configurations were developed. In-depth interviews with key stakeholders (program developers, funder, local food relief agencies, volunteers) involved in the program (n=19) as well Photovoice with focus groups with market attendees (n=8) were conducted and coded for contexts, mechanisms and outcomes. A cost-effectiveness analysis of the program was calculated whereby the cost inputs associated with operating the program were compared to the quantity and value of produce distributed. Alternative cost scenarios were evaluated in a sensitivity analysis. The cost-effectiveness analysis was used together with qualitative data to refine theory. RESULTS: Food insecure individuals attending a partnership fresh food market with a small fee, experienced improved, yet infrequent access to nutritious food through community connections and support a more dignified, viable access to fresh nutritious food. CONCLUSIONS: Food relief should consider alternative models. IMPLICATIONS FOR PUBLIC HEALTH: More dignified food relief programs that support local connections may be part of the solution to addressing food insecurity.

Food insecurity during COVID-19: An Australian university experience.

The aim of this study was to describe the prevalence, severity, coping strategies and precipitating factors of food insecurity in university students in a large multi-campus Australian university during the COVID-19 lockdown in 2020, in context of providing information to inform institutional support. This was a cross-sectional analysis which was part of a larger university-led research project, the Thrive@Home study conducted at Monash University during the COVID-19 pandemic. The main outcome measures included: Sociodemographic characteristics, PROMIS anxiety, PROMIS depression and the six-item US Department of Agriculture Household Food Security Survey Module. All variables were reported according to the four levels of food security status (high (H), marginal (M), low (L) and very low (VL)). Chi-squared tests were used to compare all categorical variables including demographic, mental health and food security status. A multivariable regression was conducted between food security status and mental health variables. Overall, n = 1315 students were included in the analysis. Of which, 5% were classified as having VL food security, 13% L, 14% M and 68% H. As food security worsened the likelihood of being unemployed looking for work, living alone and deteriorating physical health, diet quality and mental health increased. As food security status deteriorated the prevalence of needing to ask family or friends for food, shopping at multiple outlets for discounts, accessing emergency food relief, subsidised meals and financial assistance from organisations increased (p < 0.002). In regression models adjusting for covariates, depression (b (95%CI): VL = 7.2(4.1-10.3), L = 3.7(1.7-5.7), M = 2.0(0.1-3.8)) and anxiety (VL = 7.4(4.5-10.4), L = 3.5(1.5-5.4) and M = 2.0(0.3-3.8)) were positively associated with worsening food security. Food insecurity during COVID-19 was associated with worsening mental health. This paper provides targets for future university-led initiatives to promote student food security and supporting better access to physical and mental health services.

Nurturing children's development through healthy eating and active living: Time for policies to support effective interventions in the context of responsive emotional support and early learning.

Fostering the growth, development, health, and wellbeing of children is a global priority. The early childhood period presents a critical window to influence lifelong trajectories, however urgent multisectoral action is needed to ensure that families are adequately supported to nurture their children's growth and development. With a shared vision to give every child the best start in life, thus helping them reach their full developmental potential, we have formed the International Healthy Eating Active Living Matters (HEALing Matters) Alliance. Together, we form a global network of academics and practitioners working across child health and development, and who are dedicated to improving health equity for children and their families. Our goal is to ensure that all families are free from structural inequality and oppression and are empowered to nurture their children's growth and development through healthy eating and physical activity within the context of responsive emotional support, safety and security, and opportunities for early learning. To date, there have been disparate approaches to promoting these objectives across the health, community service, and education sectors. The crucial importance of our collective work is to bring these priorities for early childhood together through multisectoral interventions, and in so doing tackle head on siloed approaches. In this Policy paper, we draw upon extensive research and call for collective action to promote equity and foster positive developmental trajectories for all children. We call for the delivery of evidence-based programs, policies, and services that are co-designed to meet the needs of all children and families and address structural and systemic inequalities. Moving beyond the "what" is needed to foster the best start to life for all children, we provide recommendations of "how" we can do this. Such collective impact will facilitate intergenerational progression that builds human capital in future generations.

For whom and under what circumstances do nutrition-education cooking interventions work: a realist synthesis.

OBJECTIVE: To explore for whom and under what circumstances nutrition-education cooking interventions affect nutrition outcomes in adults. METHODS: A realist synthesis was undertaken. The CINAHL, Ovid Medline, Scopus, and Web of Science databases were searched for literature published between 1980 and 2019, using the terms "cook" and "intervention" and their synonyms; 5759 articles were identified. Grey literature was sourced for further additional program context. A total of 23 articles (n = 11 programs) met inclusion criteria for analysis. Program data were coded in duplicate for context, outcome, and mechanism configurations, and used to build a refined program theory. RESULTS: Nutrition-education cooking interventions targeted at low-socioeconomic-status and marginalized populations produced a range of positive nutrition outcomes. Outcomes were observed when the program involved hands-on cooking and a skilled facilitator coupled with individual self-efficacy, knowledge gain, family support, and an expectation of positive health outcomes. CONCLUSION: These findings highlight key program components to achieve improvements in nutrition and important recommendations for nutrition-education cooking interventions.

The Value of Programmatic Assessment in Supporting Educators and Students to Succeed: A Qualitative Evaluation.

BACKGROUND: Programmatic assessment has been proposed as the way forward for competency-based assessment, yet there is a dearth of literature describing the implementation and evaluation of programmatic assessment approaches. OBJECTIVE: To evaluate the implementation of a programmatic assessment and explore its ability to support students and assessors. DESIGN: A qualitative evaluation of programmatic assessment was employed. PARTICIPANTS/SETTING: Interviews with graduates (n = 8) and preceptors (n = 12) together with focus groups with faculty assessors (n = 9) from the one Australian university explored experiences of the programmatic approach, role of assessment in learning, and defensibility of assessment decisions in determining competence. ANALYSIS PERFORMED: Data were analyzed into key themes using framework analysis. RESULTS: The programmatic assessment increased confidence in defensibility of assessment decisions, reduced emotional burden of assessment, increased value of assessment, and identified and remediated at-risk students earlier when philosophical and practice shifts in approaches to assessment were embraced. CONCLUSIONS: Programmatic assessment supports a holistic approach to competency development and assessment and has multiple benefits for learners and assessors.