Assessing community readiness to reduce consumption of sugary drinks in remote Aboriginal and Torres Strait Islander communities: A useful tool for evaluation and co-design.

ISSUE ADDRESSED: There is a need for culturally appropriate methods in the implementation and evaluation of Aboriginal and Torres Strait Islander health programs. A group of Indigenous and non-Indigenous practitioners culturally adapted and applied the Tri-Ethnic Research Centre's Community Readiness Tool (CRT) to evaluate change in community readiness and reflect on its appropriateness. METHODS: Aboriginal community-controlled health service staff informed the cultural adaptation of the standard CRT. The adapted CRT was then used at baseline and 12-month follow-up in three remote communities in the Cape York region, Queensland, Australia. Program implementation occurred within a pilot project aiming to influence availability of drinking water and sugary drinks. RESULTS: The adapted CRT was found to be feasible and useful. Overall mean readiness scores increased in two communities, with no change in the third community. CRT interview data were used to develop community action plans with key stakeholders that were tailored to communities' stage of readiness. Considerations for future application of the CRT were the importance of having a pre-defined issue, time and resource-intensiveness of the process, and need to review appropriateness prior to implementation in other regions. CONCLUSION: The adapted CRT was valuable for evaluating the project and co-designing strategies with stakeholders, and holds potential for further applications in health promotion in remote Aboriginal and Torres Strait Islander communities. SO WHAT?: This project identified benefits of CRT application not reported elsewhere. The adapted CRT adds a practical method to the toolkits of health promotors and evaluators for working in partnership with Aboriginal and Torres Strait Islander communities to address priority concerns.

Indigenous Social Enterprises and Health and Wellbeing: A Scoping Review and Conceptual Framework.

Indigenous people and communities are establishing social enterprises to address social disadvantage and overcome health inequities in their communities. This review sought to characterize the spectrum of Indigenous social enterprises in Australia, New Zealand, Canada, and the United States to identify the operational models and cultural values that underpin them and their impact on Indigenous health and wellbeing. The scoping review followed Arksey and O'Malley's six-stage methodological framework with recommended enhancements by Levac et al. underpinned by Indigenous Standpoint Theory, and an Indigenous advisory group to provide cultural oversight and direction. Of the 589 documents screened 115 documents were included in the review. A conceptual framework of seven different operational models of Indigenous social enterprises was developed based on differing levels of Indigenous ownership, control, and management: (1) individual, (2) collective, (3) delegative, (4) developmental, (5) supportive, (6) prescriptive and (7) paternalistic. Models with 100% Indigenous ownership and control were more likely to contribute to improved health and wellbeing by increasing self-determination and strengthening culture and promoting healing than others. Indigenous social enterprises could offer a more holistic and sustainable approach to health equity and health promotion than the siloed, programmatic model common in public health policy.

Changing Primary School Children's Engagement in Active School Travel Using Safe Routes to School Interventions: A Rapid Realist Review.

Safe Routes to School (SR2S) interventions have been implemented in many economically developed countries to improve children's engagement in Active School Travel (AST). Evaluations have highlighted inconsistencies in SR2S intervention outcomes, raising questions as to how, why, and under what contextual conditions these interventions work. This review used a Rapid Realist Review (RRR) methodology to build, test, and refine an overarching program theory that unpicks the contextual factors and underlying mechanisms influencing children's engagement in AST. From the 45 included documents, 16 refined Context-Mechanism-Outcome Configurations (CMOCs) were developed and clustered into three partial program theories (i.e., implementor/implementation, child, and parent), with the associated mechanisms of: (1) School Reliance; (2) School Priority; (3) Fun; (4) Pride; (5) Perceived Safety; (6) Distrust; (7) Convenience; (8) Perceived Capabilities; and (9) Reassurance. The overarching program theory delineates the pathways between intervention implementation, children's motivation, parental decision-making, and children's engagement in AST. The findings suggest SR2S interventions can motivate children to engage in AST, but whether this motivation is translated into engagement is determined by parental decision-making. This review is novel for highlighting that many of the factors influencing parental decision-making are contextually driven and appear to be unaddressed by the current suite of SR2S intervention strategies. The review additionally highlights the complexity of parental perceptions of safety, with the traffic and the road environment shaping only part of this multidimensional mechanism. Practitioners and policymakers need to tailor SR2S interventions to local contexts to better influence parental decision-making for children's engagement in AST.

Built Environment Features and Cardiometabolic Mortality and Morbidity in Remote Indigenous Communities in the Northern Territory, Australia.

Indigenous Australians experience poorer health than non-Indigenous Australians, with cardiometabolic diseases (CMD) being the leading causes of morbidity and mortality. Built environmental (BE) features are known to shape cardiometabolic health in urban contexts, yet little research has assessed such relationships for remote-dwelling Indigenous Australians. This study assessed associations between BE features and CMD-related morbidity and mortality in a large sample of remote Indigenous Australian communities in the Northern Territory (NT). CMD-related morbidity and mortality data were extracted from NT government health databases for 120 remote Indigenous Australian communities for the period 1 January 2010 to 31 December 2015. BE features were extracted from Serviced Land Availability Programme (SLAP) maps. Associations were estimated using negative binomial regression analysis. Univariable analysis revealed protective effects on all-cause mortality for the BE features of Education, Health, Disused Buildings, and Oval, and on CMD-related emergency department admissions for the BE feature Accommodation. Incidence rate ratios (IRR's) were greater, however, for the BE features Infrastructure Transport and Infrastructure Shelter. Geographic Isolation was associated with elevated mortality-related IRR's. Multivariable regression did not yield consistent associations between BE features and CMD outcomes, other than negative relationships for Indigenous Location-level median age and Geographic Isolation. This study indicates that relationships between BE features and health outcomes in urban populations do not extend to remote Indigenous Australian communities. This may reflect an overwhelming impact of broader social inequity, limited correspondence of BE measures with remote-dwelling Indigenous contexts, or a 'tipping point' of collective BE influences affecting health more than singular BE features.

Evaluation approaches, tools and aspects of implementation used in pharmacist interventions in residential aged care facilities: A scoping review.

BACKGROUND: The medication expertise of pharmacists is widely acknowledged and there is ongoing interest in their potential role to reduce medication-related harm amongst residents living in residential aged care facilities (RACFs). An increased understanding of how these interventions are evaluated could support adoption of these interventions in the real world. OBJECTIVE: To systematically explore the application of evaluation approaches, evaluation tools and aspects of implementation (implementation factors i.e. barriers and facilitators, and assessing implementation fidelity) used in pharmacist intervention in RACF peer-reviewed literature. METHODS: A search strategy was applied to MEDLINE, CINAHL, Cochrane Library and Web of Science databases for publications between 1 January 2000 and 27 August 2020 based on defined inclusion and exclusion criteria. Articles that reported on evaluated pharmacist interventions impacting residents in RACFs or which outlined study participant perspectives in relation to these interventions were included. RESULTS: 2003 published articles were identified, out of which 56 articles met the inclusion criteria. Fifty-three articles reported on outcome evaluations. Four articles used evaluation guidance with 1 article explicitly guided by an evaluation framework. Relationships, trust and respect between pharmacists and RACF health care team members were one of the most reported factors influencing intervention success. None of the 56 articles used a theory or model, assessed implementation fidelity or employed a logic model. CONCLUSIONS: To date there appears to be sparse utilisation of available evaluation approaches, evaluation tools and implementation aspects in pharmacist intervention in RACF peer-reviewed literature. By embracing these evaluation approaches, evaluation tools and aspects of implementation, pharmacy practice researchers have an opportunity to contribute to evaluation research in RACFs and beyond.

Association of Built Environmental Features with Rates of Infectious Diseases in Remote Indigenous Communities in the Northern Territory, Australia.

The health of Indigenous Australians is far poorer than non-Indigenous Australians, including an excess burden of infectious diseases. The health effect of built environmental (BE) features on Indigenous communities receives little attention. This study's objective was to determine associations between BE features and infectious disease incidence rates in remote Indigenous communities in the Northern Territory (NT), Australia. Remote Indigenous communities (n = 110) were spatially joined to 93 Indigenous Locations (ILOC). Outcomes data were extracted (NT Notifiable Diseases System) and expressed as ILOC-specific incidence rates. Counts of buildings were extracted from community asset maps and grouped by function. Age-adjusted infectious disease rates were dichotomised, and bivariate binomial regression used to determine the relationships between BE variables and infectious disease. Infrastructure Shelter BE features were universally associated with significantly elevated disease outcomes (relative risk 1.67 to 2.03). Significant associations were observed for Services, Arena, Community, Childcare, Oval, and Sports and recreation BE features. BE groupings associated with disease outcomes were those with communal and/or social design intent or use. Comparable BE groupings without this intent or use did not associate with disease outcomes. While discouraging use of communal BE features during infectious disease outbreaks is a conceptually valid countermeasure, communal activities have additional health benefits themselves, and infectious disease transmission could instead be reduced through repairs to infrastructure, and more infrastructure. This is the first study to examine these associations simultaneously in more than a handful of remote Indigenous communities to illustrate community-level rather than aggregated population-level associations.

Defining collective capability in Australian evaluations that are conducted by, for and with Indigenous peoples for health programmes, policies and services: a concept analysis protocol.

INTRODUCTION: Indigenist evaluation is emergent in Australia; the premise of which is that evaluations are undertaken for Indigenous, by Indigenous and with Indigenous people. This provides opportunities to develop new models and approaches. Exploring a collective capability approach could be one way to inform an Indigenist evaluation methodology. Collective capability suggests that a base of skills and knowledges exist, and when these assets come together, empowerment and agency emerge. However, collective capability requires defining as it is not common terminology in population health or evaluation. Our aim is to define the concept of collective capability in Indigenist evaluation in Australia from an Australian Indigenous standpoint. METHODS AND ANALYSIS: A modified Rodgers' evolutionary concept analysis will be used to define collective capability in an Australian Indigenous evaluation context, and to systematically review and synthesise the literature. Approximately 20 qualitative interviews with Aboriginal and Torres Strait Islander knowledge holders will clarify the meaning of collective capability and inform appropriate search strategy terms with a consensus process then used to code the literature. We will then systematically collate, synthesise and analyse the literature to identify exemplars or models of collective capability from the literature. ETHICS AND DISSEMINATION: The protocol has approval from the Australian Institute of Aboriginal and Torres Strait Islander Studies Ethics Committee, approval no. EO239-20210114. All knowledge holders will provide written consent to participate in the research. This protocol provides a process to developing a concept, and will form the basis of a new framework and assessment tool for Indigenist evaluation practice. The concept analysis will establish definitions, characteristics and attributes of collective capability. Findings will be disseminated through a peer-reviewed journal, conference presentations, the project advisory group, the Thiitu Tharrmay reference group and Aboriginal and Torres Strait Islander community partners supporting the project.

Prioritizing Built Environmental Factors to Tackle Chronic and Infectious Diseases in Remote Northern Territory (NT) Communities of Australia: A Concept Mapping Study.

High prevalence of chronic and infectious diseases in Indigenous populations is a major public health concern both in global and Australian contexts. Limited research has examined the role of built environments in relation to Indigenous health in remote Australia. This study engaged stakeholders to understand their perceptions of the influence of built environmental factors on chronic and infectious diseases in remote Northern Territory (NT) communities. A preliminary set of 1120 built environmental indicators were systematically identified and classified using an Indigenous Indicator Classification System. The public and environmental health workforce was engaged to consolidate the classified indicators (n = 84), and then sort and rate the consolidated indicators based on their experience with living and working in remote NT communities. Sorting of the indicators resulted in a concept map with nine built environmental domains. Essential services and Facilities for health/safety were the highest ranked domains for both chronic and infectious diseases. Within these domains, adequate housing infrastructure, water supply, drainage system, reliable sewerage and power infrastructure, and access to health services were identified as the most important contributors to the development of these diseases. The findings highlight the features of community environments amenable to public health and social policy actions that could be targeted to help reduce prevalence of chronic and infectious diseases.

Identifying Environmental Determinants Relevant to Health and Wellbeing in Remote Australian Indigenous Communities: A Scoping Review of Grey Literature.

The high prevalence of preventable infectious and chronic diseases in Australian Indigenous populations is a major public health concern. Existing research has rarely examined the role of built and socio-political environmental factors relating to remote Indigenous health and wellbeing. This research identified built and socio-political environmental indicators from publicly available grey literature documents locally-relevant to remote Indigenous communities in the Northern Territory (NT), Australia. Existing planning documents with evidence of community input were used to reduce the response burden on Indigenous communities. A scoping review of community-focused planning documents resulted in the identification of 1120 built and 2215 socio-political environmental indicators. Indicators were systematically classified using an Indigenous indicator classification system (IICS). Applying the IICS yielded indicators prominently featuring the "community infrastructure" domain within the built environment, and the "community capacity" domain within the socio-political environment. This research demonstrates the utility of utilizing existing planning documents and a culturally appropriate systematic classification system to consolidate environmental determinants that influence health and disease occurrence. The findings also support understanding of which features of community-level built and socio-political environments amenable to public health and social policy actions might be targeted to help reduce the prevalence of infectious and chronic diseases in Indigenous communities.

How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? Learning from experts in the field.

BACKGROUND: Research funders in Canada and abroad have made substantial investments in supporting collaborative research approaches to generating and translating knowledge as it is believed to increase knowledge use. Canadian health research funders have advocated for the use of integrated knowledge translation (IKT) in health research, however, there is limited research around how IKT compares to other collaborative research approaches. Our objective was to better understand how IKT compares with engaged scholarship, Mode 2 research, co-production and participatory research by identifying the differences and similarities among them in order to provide conceptual clarity and reduce researcher and knowledge user confusion about these common approaches. METHODS: We employed a qualitative descriptive method using interview data to better understand experts' perspectives and experiences on collaborative research approaches. Participants' responses were analysed through thematic analysis to elicit core themes. The analysis was centred around the concept of IKT, as it is the most recent approach; IKT was then compared and contrasted with engaged scholarship, Mode 2 research, co-production and participatory research. As this was an iterative process, data triangulation and member-checking were conducted with participants to ensure accuracy of the emergent themes and analysis process. RESULTS: Differences were noted in the orientation (i.e. original purpose), historical roots (i.e. disciplinary origin) and partnership/engagement (i.e. role of partners etc.). Similarities among the approaches included (1) true partnerships rather than simple engagement, (2) focus on essential components and processes rather than labels, (3) collaborative research orientations rather than research methods, (4) core values and principles, and (5) extensive time and financial investment. Core values and principles among the approaches included co-creation, reciprocity, trust, fostering relationships, respect, co-learning, active participation, and shared decision-making in the generation and application of knowledge. All approaches require extensive time and financial investment to develop and maintain true partnerships. CONCLUSIONS: This qualitative study is the first to systematically synthesise experts' perspectives and experiences in a comparison of collaborative research approaches. This work contributes to developing a shared understanding of collaborative research approaches to facilitate conceptual clarity in use, reporting, indexing and communication among researchers, trainees, knowledge users and stakeholders to advance IKT and implementation science.

Built Environments and Cardiometabolic Morbidity and Mortality in Remote Indigenous Communities in the Northern Territory, Australia.

The health of Indigenous Australians is dramatically poorer than that of the non-Indigenous population. Amelioration of these differences has proven difficult. In part, this is attributable to a conceptualisation which approaches health disparities from the perspective of individual-level health behaviours, less so the environmental conditions that shape collective health behaviours. This ecological study investigated associations between the built environment and cardiometabolic mortality and morbidity in 123 remote Indigenous communities representing 104 Indigenous locations (ILOC) as defined by the Australian Bureau of Statistics. The presence of infrastructure and/or community buildings was used to create a cumulative exposure score (CES). Records of cardiometabolic-related deaths and health service interactions for the period 2010-2015 were sourced from government department records. A quasi-Poisson regression model was used to assess the associations between built environment "healthfulness" (CES, dichotomised) and cardiometabolic-related outcomes. Low relative to high CES was associated with greater rates of cardiometabolic-related morbidity for two of three morbidity measures (relative risk (RR) 2.41-2.54). Cardiometabolic-related mortality was markedly greater (RR 4.56, 95% confidence interval (CI), 1.74-11.93) for low-CES ILOCs. A lesser extent of "healthful" building types and infrastructure is associated with greater cardiometabolic-related morbidity and mortality in remote Indigenous locations. Attention to environments stands to improve remote Indigenous health.

Strategies to support culturally safe health and wellbeing evaluations in Indigenous settings in Australia and New Zealand: a concept mapping study.

BACKGROUND: In recent decades, financial investment has been made in health-related programs and services to overcome inequities and improve Indigenous people's wellbeing in Australia and New Zealand. Despite policies aiming to 'close the gap', limited evaluation evidence has informed evidence-based policy and practice. Indigenous leaders have called for evaluation stakeholders to align their practices with Indigenous approaches. METHODS: This study aimed to strengthen culturally safe evaluation practice in Indigenous settings by engaging evaluation stakeholders, in both countries, in a participatory concept mapping study. Concept maps for each country were generated from multi-dimensional scaling and hierarchical cluster analysis. RESULTS: The 12-cluster Australia map identifies four cluster regions: An Evaluation Approach that Honours Community; Respect and Reciprocity; Core Heart of the Evaluation; and Cultural Integrity of the Evaluation. The 11-cluster New Zealand map identifies four cluster regions: Authentic Evaluation Practice; Building Maori Evaluation Expertise; Integrity in Maori Evaluation; and Putting Community First. Both maps highlight the importance of cultural integrity in evaluation. Differences include the distinctiveness of the 'Respecting Language Protocols' concept in the Australia map in contrast to language being embedded within the cluster of 'Knowing Yourself as an Evaluator in a Maori Evaluation Context' in the New Zealand map. Participant ratings highlight the importance of all clusters with some relatively more difficult to achieve, in practice. Notably, the 'Funding Responsive to Community Needs and Priorities' and 'Translating Evaluation Findings to Benefit Community' clusters were rated the least achievable, in Australia. The 'Conduct of the Evaluation' and the 'Prioritising Maori Interests' clusters were rated as least achievable in New Zealand. In both countries, clusters of strategies related to commissioning were deemed least achievable. CONCLUSIONS: The results suggest that the commissioning of evaluation is crucial as it sets the stage for whether evaluations: reflect Indigenous interests, are planned in ways that align with Indigenous ways of working and are translated to benefit Indigenous communities Identified strategies align with health promotion principles and relational accountability values of Indigenous approaches to research. These findings may be relevant to the commissioning and conduct of Indigenous health program evaluations in developed nations.

Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study.

OBJECTIVE: The mixed methods appraisal tool (MMAT) was developed for critically appraising different study designs. This study aimed to improve the content validity of three of the five categories of studies in the MMAT by identifying relevant methodological criteria for appraising the quality of qualitative, survey, and mixed methods studies. STUDY DESIGN AND SETTING: First, we performed a literature review to identify critical appraisal tools and extract methodological criteria. Second, we conducted a two-round modified e-Delphi technique. We asked three method-specific panels of experts to rate the relevance of each criterion on a five-point Likert scale. RESULTS: A total of 383 criteria were extracted from 18 critical appraisal tools and a literature review on the quality of mixed methods studies, and 60 were retained. In the first and second rounds of the e-Delphi, 73 and 56 experts participated, respectively. Consensus was reached for six qualitative criteria, eight survey criteria, and seven mixed methods criteria. These results led to modifications of eight of the 11 MMAT (version 2011) criteria. Specifically, we reformulated two criteria, replaced four, and removed two. Moreover, we added six new criteria. CONCLUSION: Results of this study led to improve the content validity of this tool, revise it, and propose a new version (MMAT version 2018).

Predictors of Quality of Life in Montreal, Canada: A Longitudinal Study.

This study sought to assess factors associated with quality of life (QoL), and predictive of improvements in QoL over time, in a population-based cohort study. A 4-year longitudinal survey was administered to 2433 individuals at the study baseline; of these, 1828 individuals participated in Wave 2, and 1303 participated in Wave 3. QoL was measured by the Satisfaction with Life Domains Scale. Thirty-two variables were correlated with baseline QoL and together explained 58.2% of the variance. Eleven variables were independent predictors of improvement in QoL over time. Among these variables, social support and stress/coping showed the strongest association with QoL, and neighbourhood characteristics had an additional influence. Multidimensional modelling of a broad spectrum of the factors related to QoL enabled situating mental health and well-being in an ecological system with attendant implications for public health and social policy intervention to facilitate improvement of QoL in the population.

Stigma reduction in relation to HIV test uptake in low- and middle-income countries: a realist review.

BACKGROUND: This realist review was conducted to understand how stigma is reduced in relation to HIV test uptake in low- and middle-income countries (LMICs). METHODS: A systematic search of eight databases resulted in 34 articles considered for synthesis. Data synthesis was guided by a preliminary programme theory and included coding the meaning units to develop themes or intervention pathways that corresponded to context-mechanism-outcome configurations. RESULTS: We found that the interventions produced an effect through two pathways: (a) knowledge leads to changes in stigmatizing attitudes and increases in HIV test uptake and (b) knowledge and attitudes lead to changes in stigmatizing behaviours and lead to HIV test uptake. We also found one competing pathway that illustrated the direct impact of knowledge on HIV test uptake without changing stigmatizing attitudes and behaviour. The identified pathways were found to be influenced by some structural factors (e.g., anti-homosexuality laws, country-specific HIV testing programmes and policies), community factors (e.g., traditional beliefs and practices, sexual taboos and prevalence of intimate partner violence) and target-population characteristics (e.g., age, income and urban-rural residence). CONCLUSIONS: The pathways and underlying mechanisms support the adaptation of intervention strategies in terms of social context and the target population in LMICs.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 2: methods for question formulation, searching, and protocol development for qualitative evidence synthesis.

This paper updates previous Cochrane guidance on question formulation, searching, and protocol development, reflecting recent developments in methods for conducting qualitative evidence syntheses to inform Cochrane intervention reviews. Examples are used to illustrate how decisions about boundaries for a review are formed via an iterative process of constructing lines of inquiry and mapping the available information to ascertain whether evidence exists to answer questions related to effectiveness, implementation, feasibility, appropriateness, economic evidence, and equity. The process of question formulation allows reviewers to situate the topic in relation to how it informs and explains effectiveness, using the criterion of meaningfulness, appropriateness, feasibility, and implementation. Questions related to complex questions and interventions can be structured by drawing on an increasingly wide range of question frameworks. Logic models and theoretical frameworks are useful tools for conceptually mapping the literature to illustrate the complexity of the phenomenon of interest. Furthermore, protocol development may require iterative question formulation and searching. Consequently, the final protocol may function as a guide rather than a prescriptive route map, particularly in qualitative reviews that ask more exploratory and open-ended questions.

Engagement of stakeholders in the development of a Theory of Change for handwashing and sanitation behaviour change.

A Theory of Change (ToC) is an approach to map programmes aimed at inducing change in a specific context, with the goal of increasing their impact. We applied this approach to the specific case of handwashing and sanitation practices in low- and middle-income countries and developed a ToC as part of a systematic review exercise. Different existing sources of information were used to inform the initial draft of the ToC. In addition, stakeholder involvement occurred and peer review took place. Our stakeholders included methodological (ToC/quantitative and qualitative research) and content experts (WASH (Water, Sanitation, Hygiene)/behaviour change), as well as end-users/practitioners, policy-makers and donors. In conclusion, the development of a ToC, and the involvement of stakeholders in its development, was critical in terms of understanding the context in which the promotional programmes are being implemented. We recommend ToC developers to work with stakeholders to create a ToC relevant for practice.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing.