Injury Prevention Training in Girls' and Women's Elite Football in Denmark: A Survey of Practices and Perceptions.

Through a national cross-sectional survey, the present study investigated the use and content of injury prevention training (IPT), and associated attitudes and beliefs, involving stakeholders in Danish girls' and women's elite football (U14, U16, U18, and Danish Women's League teams). A total of 168 stakeholders (coaches, physical performance coaches, physiotherapists, medical doctors, and club management) from 18 Danish elite clubs were invited to participate. Of these, 158 were eligible to participate, and 110 participants (69.6% response rate) provided 191 valid survey responses, as some provided more than one response due to multiple affiliations within the same club. The use of IPT ranged from 91.1% to 100% across team levels, with approximately 50% reporting up to 1-2 h/week. Interestingly, only 52.9%-72.7% of the responses indicated use of an evidence-based IPT program, with lowest adoption at the U14 and Danish Women's League teams. The FIFA 11+ was the most used evidence-based IPT program. The majority of the participants (>72%) had positive perceptions regarding IPT impact on injury reduction. These findings indicate that, while IPT is broadly used across Danish girls' and women's elite football teams, the implementation of evidence-based IPT programs varies, with lower adoption of these programs among the youngest and senior elite teams. Hence, there is a need to enhance integration of IPT programs proven effective in girls' and women's elite football. Notably, stakeholders expressed positive perceptions regarding the impact of IPT on injury reduction, which provides valuable support for future efforts to strengthen IPT in football practice.

Application of the Medical Research Council guidance for complex interventions in the development of VIeSA, an intervention to support healthy ageing among community-dwelling older adults.

BACKGROUND: The ageing population, coupled with the desire to age-in-place, highlight the need for programs that target health promotion as a means of maintaining functional ability, autonomy, and independence among community-dwelling older adults. This paper describes the development of the VIeSA intervention, which aimed to model a healthy ageing trajectory, including the identification of the necessary tools and methods, that would allow people older people, in partnership with health and social care professionals, to define personal health-related goals and the actions to achieve them. A key element of the intervention development was the creation of a support tool intended to assist this process. METHODS: The UK Medical Research Council (MRC) guidance on developing and evaluating complex interventions was applied in the development of the intervention and of the support tool. A participatory approach was selected, with stakeholders engaged on different occasions to allow the refinement of the intervention and of the support tool. Following the steps and suggested actions in the MRC development phase, the development process was conducted by identifying (1) the evidence base and (2) the theoretical framework and (3) by modelling the process and outcomes of the intervention. RESULTS: Following a literature review on effective interventions for functional ability, draft 1 of the support tool was designed. Focus groups with stakeholders provided feedback on this draft allowing for its refinement in terms of content, language use, and structure (draft 2). A review of the approaches for health promotion delivery led to further additions to the tool (draft 3) and informed the content of the training of health and social care professionals. After their training, professionals provided feedback on the acceptability, appropriateness, and feasibility of different elements of the intervention. Results suggested that no further major refinement to the intervention or support tool was necessary. CONCLUSIONS: The design and development of the VIeSA intervention using the MRC guidance allowed for a clarity of direction, an optimised content in terms of usefulness and accessibility for all concerned stakeholders, and greater opportunities for its implementation and uptake.

Participatory methods used in the evaluation of medical devices: a comparison of focus groups, interviews, and a survey.

BACKGROUND: Stakeholder engagement in evaluation of medical devices is crucial for aligning devices with stakeholders' views, needs, and values. Methods for these engagements have however not been compared to analyse their relative merits for medical device evaluation. Therefore, we systematically compared these three methods in terms of themes, interaction, and time-investment. METHODS: We compared focus groups, interviews, and an online survey in a case-study on minimally invasive endoscopy-guided surgery for patients with intracerebral haemorrhage. The focus groups and interviews featured two rounds, one explorative focussing on individual perspectives, and one interactive focussing on the exchange of perspectives between participants. The comparison between methods was made in terms of number and content of themes, how participants interact, and hours invested by all researchers. RESULTS: The focus groups generated 34 themes, the interviews 58, and the survey 42. Various improvements for the assessment of the surgical procedure were only discussed in the interviews. In focus groups, participants were inclined to emphasise agreement and support, whereas the interviews consisted of questions and answers. The total time investment for researchers of focus groups was 95 h, of interviews 315 h, and survey 81 h. CONCLUSIONS: Within the context of medical device evaluation, interviews appeared to be the most appropriate method for understanding stakeholder views since they provide a scope and depth of information that is not generated by other methods. Focus groups were useful to rapidly bring views together. Surveys enabled a quick exploration. Researchers should account for these methodological differences and select the method that is suitable for their research aim.

Identifying, categorising, and mapping actors involved in resilience in healthcare: a qualitative stakeholder analysis.

BACKGROUND: Resilience in healthcare is the capacity to adapt to challenges and changes to maintain high-quality care across system levels. While healthcare system stakeholders such as patients, informal carers, healthcare professionals and service managers have all come to be acknowledged as important co-creators of resilient healthcare, our knowledge and understanding of who, how, and in which contexts different stakeholders come to facilitate and support resilience is still lacking. This study addresses gaps in the research by conducting a stakeholder analysis to identify and categorise the stakeholders that are key to facilitating and sustaining resilience in healthcare, and to investigate stakeholder relationships relevant for the enactment of resilient healthcare systems. METHODS: The stakeholder analysis was conducted using a sample of 19 empirical research projects. A narrative summary was written for 14 of the projects, based on publicly available material. In addition, 16 individual interviews were undertaken with researchers from the same sample of 19 projects. The 16 interview transcripts and 14 narratives made up the data material of the study. Application of stakeholder analysis methods was done in three steps: a) identification of stakeholders; b) differentiation and categorisation of stakeholders using an interest/influence grid; and c) investigation and mapping of stakeholder relationships using an actor-linkage matrix. RESULTS: Identified stakeholders were Patients, Family Carers, Healthcare Professionals, Ward/Unit Managers, Service or Case Managers, Regulatory Investigators, Policy Makers, and Other Service Providers. All identified stakeholders were categorised as either 'Subjects', 'Players', or 'Context Setters' according to their level of interest in and influence on resilient healthcare. Stakeholder relationships were mapped according to the degree and type of contact between the various groups of stakeholders involved in facilitating resilient healthcare, ranging from 'Not linked' to 'Fully linked'. CONCLUSION: Family carers and healthcare professionals were found to be the most active groups of stakeholders in the enactment of healthcare system resilience. Patients, managers, and policy makers also contribute to resilience to various degrees. Relationships between stakeholder groups are largely characterised by communication and coordination, in addition to formal collaborations where diverse actors work together to achieve common goals.

External inspection approaches and involvement of stakeholders' views in inspection following serious incidents - a qualitative mixed methods study from the perspectives of regulatory inspectors.

OBJECTIVE: The objective was to gain knowledge about how external inspections following serious incidents are played out in a Norwegian hospital context from the perspective of the inspectors, and whether stakeholders' views are involved in the inspection. METHODS: Based on a qualitative mixed methods design, 10 government bureaucrats and inspectors situated at the National Board of Health Supervision and three County Governors in Norway, were strategically recruited, and individual semi-structured interviews were conducted. Key official government documents were selected, collected, and thematically analyzed along with the interview data. RESULTS: Our findings overall demonstrate two overarching themes: Theme (1) Perspectives on different external inspection approaches of responding and involving stakeholders in external inspection following serious incidents, Theme (2) Inspectors' internal work practices versus external expectations. Documents and all participants reported a development towards new approaches in external inspection, with more policies and regulatory attention to sensible involvement of stakeholders. Involvement and interaction with patients and informal caregivers could potentially inform the case complexity and the inspector's decision-making process. However, stakeholder involvement was sometimes complex and challenging due to e.g., difficult communication and interaction with patients and/or informal caregivers, due to resource demands and/or the inspector's lack of experience and/or relevant competence, different perceptions of the principle of sound professional practice, quality, and safety. The inspectors considered balancing the formal objectives and expectations, with the expectations of the public and different stakeholders (i.e. hospitals, patients and/or informal caregivers) a challenging part of their job. This balance was seen as an important part of the continuous development of ensuring public trust and legitimacy in external inspection processes. CONCLUSIONS AND IMPLICATIONS: Our study suggests that the regulatory system of external inspection and its available approaches of responding to a serious incident in the Norwegian setting is currently not designed to accommodate the complexity of needs from stakeholders at the levels of hospital organizations, patients, and informal caregivers altogether. Further studies should direct attention to how the wider system of accountability structures may support the internal work practices in the regulatory system, to better algin its formal objectives with expectations of the public.

Navigating the path towards successful implementation of the EU HTA Regulation: key takeaways from the 2023 Spring Convention of the European Access Academy.

BACKGROUND: The European Regulation on Health Technology Assessment (EU HTA R), effective since January 2022, aims to harmonize and improve the efficiency of common HTA across Member States (MS), with a phased implementation from January 2025. At "midterms" of the preparation phase for the implementation of the Regulation our aim was to identify and prioritize tangible action points to move forward. METHODS: During the 2023 Spring Convention of the European Access Academy (EAA), participants from different nationalities and stakeholder backgrounds discussed readiness and remaining challenges for the Regulation's implementation and identified and prioritized action points. For this purpose, participants were assigned to four working groups: (i) Health Policy Challenges, (ii) Stakeholder Readiness, (iii) Approach to Uncertainty and (iv) Challenges regarding Methodology. Top four action points for each working group were identified and subsequently ranked by all participants during the final plenary session. RESULTS: Overall "readiness" for the Regulation was perceived as neutral. Prioritized action points included the following: Health Policy, i.e. assess adjustability of MS laws and health policy processes; Stakeholders, i.e. capacity building; Uncertainty, i.e. implement HTA guidelines as living documents; Methodology, i.e. clarify the Population, Intervention, Comparator(s), Outcomes (PICO) identification process. CONCLUSIONS: At "midterms" of the preparation phase, the focus for the months to come is on executing the tangible action points identified at EAA's Spring Convention. All action points centre around three overarching themes: harmonization and standardization, capacity building and collaboration, uncertainty management and robust data. These themes will ultimately determine the success of the EU HTA R in the long run.

Improving Agri-environmental Schemes: Suggestions from Farmers and Nature Managers in a Central European Region.

Agri-environmental schemes (AES) are important policy instruments within the Common Agricultural Policy (CAP) of the European Union for environmental protection. Due to the voluntary nature of AES, their attractiveness to farmers and stakeholders involved in nature management and protection (nature managers) is essential for high participation levels. This study aims to assess farmers' and nature managers' ideas to improve agri-environmental schemes. We analyzed suggestions of 825 farmers and 118 nature managers for improvements of AES collected in a large-scale survey in Bavaria, Germany. A content analysis was applied to categorize and compare suggestions by farmers (differentiated into two groups through a cluster analysis) and nature managers. The results reveal that stakeholders were highly willing to share ideas and made detailed suggestions for improvements and individual measures. They were aware of the importance of protecting nature and promoting biodiversity in agricultural landscapes and acknowledged the necessity of (financial) support programs. Farmers placed more emphasis on the practicability and profitability of measures on arable land, while nature managers tended to propose policy-related ideas focusing on nature protection, biodiversity, and specific species. Among farmers, suggestions differed with farm characteristics such as the operation mode (full-time, part-time). These findings can support the design of future AES, accounting for different background situations and thereby increasing acceptability. This includes considering perspectives from different stakeholder groups and creating regionally adapted programs with varying levels of flexibility and practicability.

Leveraging Single-Case Experimental Designs to Promote Personalized Psychological Treatment: Step-by-Step Implementation Protocol with Stakeholder Involvement of an Outpatient Clinic for Personalized Psychotherapy.

Our objective is to implement a single-case experimental design (SCED) infrastructure in combination with experience-sampling methods (ESM) into the standard diagnostic procedure of a German outpatient research and training clinic. Building on the idea of routine outcome monitoring, the SCED infrastructure introduces intensive longitudinal data collection, individual effectiveness measures, and the opportunity for systematic manipulation to push personalization efforts further. It aims to empower psychotherapists and patients to evaluate their own treatment (idiographic perspective) and to enable researchers to analyze open questions of personalized psychotherapy (nomothetic perspective). Organized around the principles of agile research, we plan to develop, implement, and evaluate the SCED infrastructure in six successive studies with continuous stakeholder involvement: In the project development phase, the business model for the SCED infrastructure is developed that describes its vision in consideration of the context (Study 1). Also, the infrastructure's prototype is specified, encompassing the SCED procedure, ESM protocol, and ESM survey (Study 2 and 3). During the optimization phase, feasibility and acceptability are tested and the infrastructure is adapted accordingly (Study 4). The evaluation phase includes a pilot implementation study to assess implementation outcomes (Study 5), followed by actual implementation using a within-institution A-B design (Study 6). The sustainability phase involves continuous monitoring and improvement. We discuss to what extent the generated data could be used to address current questions of personalized psychotherapy research. Anticipated barriers and limitations during the implementation processes are outlined.

Scoping review: multiple stakeholders and child asthma management interventions.

OBJECTIVE: This study reviewed research to identify interventions aimed at improving asthma management among children by educating parents and other professionals. DATA SOURCES: PubMed, Medline, and Embase databases were utilized. STUDY SELECTIONS: Three databases were searched for child asthma management interventions published between 2012-2022 in English. Search terms included children, asthma, intervention(s), community pediatrics, coaches, schools, and stakeholders. Inclusion criteria were being an experimental study focused on children with asthma (birth-18 years), including stakeholder involvement, education, and a community focus. The search yielded 153 articles; nine were reviewed. RESULTS: In general, stakeholders developed programs that resulted in improvements in asthma symptoms, knowledge of asthma management, perceptions of health care, and decreased emergency health care visits. Successful interventions involved education about asthma management, providing medications, and partnerships with school staff, healthcare teams, and community members. Effective coordination and communication contributed to successful program implementation. Using technology for asthma management education was effective in tracking access to care and facilitated the delivery of medications. CONCLUSION: The findings indicate that interventions were effective in improving child asthma management. Stakeholder partnerships were critical to the effectiveness of interventions. Marketing the intervention and encouraging communication with parents also fostered success. Being able to assess the home environment and staying in contact with parents were barriers to these interventions. Conducting randomized controlled trials using the interventions found effective in these studies to assess change in symptoms and emergency care visits over time would yield important information about their long-term success and cost for implementation.

Design and implementation of the participatory German network for translational dementia care research (TaNDem): A mixed-method study on the perspectives of healthcare providers and dementia researchers in dementia care research.

BACKGROUND: Currently, there is a lack of interaction between research and healthcare practice. As a result, research findings reach healthcare practice only late, and topics relevant to practice are often not known in research. Involving people living with dementia (PlwD), their relatives and healthcare providers in dementia care research can accelerate this process. For inclusion, firm and reliable structures are needed, which are to be established with the help of the Translational Network for Dementia Care Research in Germany. However, there is only limited knowledge about the priorities, expectations and conditions of stakeholders (healthcare providers and dementia researchers) for such cooperation within a network. OBJECTIVES: The aim is to gather stakeholders' views on (i) future research topics to be addressed within the dementia care research network, (ii) the nature of collaboration within the network and (iii) the facilitating and hindering factors for establishing such a network. METHODS: Within an exploratory sequential mixed-method study, we interviewed 87 stakeholders within eleven semistructured focus group interviews. The interviews were transcribed, pseudonymized and analyzed using qualitative content analysis. The qualitative data were analyzed with MAXQDA. Based on the qualitative results found in the focus group interviews, a supplementary online questionnaire was developed to prioritise and rank these findings afterwards. RESULTS: Stakeholders prioritized a comprehensible transfer of research results into practice, increased involvement of PlwD and their relatives (additionally marginalized groups such as people with a migrant background) in research and exchange between researchers. Cooperation should preferably occur in a regional context with local contacts, and the latest research results should be made available via an online database. The stakeholders' time, finances and human resources should be considered. CONCLUSION: Stakeholders have partly similar preferences and goals for cooperation and involvement, emphasizing that such interaction in a network offers the possibility of long-term, effective collaboration and added value for practice and research. PATIENT OR PUBLIC CONTRIBUTION: For this study, dementia healthcare providers and dementia care researchers were asked about their perspectives. Their involvement is further elucidated in the manuscript text.

Stakeholder perspectives on the preferred service ecosystem for senior citizens living at home: a qualitative interview study.

BACKGROUND: Most senior citizens want to live independently at home as long as possible. The World Health Organization recommends an age-friendly community approach by transforming the service ecosystem for senior citizens and basing it on the question "What matters to you?". However, there is limited research-based knowledge to determine the characteristics of the preferred service ecosystem from the perspectives of multiple stakeholders. Therefore, the aim of the study was to gain a deeper understanding of multiple stakeholder perspectives on the preferred service ecosystem for senior citizens living at home. METHODS: Four stakeholder groups (n = 57) from a Norwegian municipality participated in an interview study in 2019 and 2020: senior citizens, carers, healthcare professionals, and managers. Data were analysed according to qualitative content analysis. RESULTS: Overall, there was considerable correspondence between the four stakeholder groups' perspectives on the preferred service ecosystem for senior citizens. Six themes were developed: (1) "self-reliance - living independently at home as long as possible"; (2) "remaining active and social within the community"; (3) "support for living at home as long as possible"; (4) "accessible information and services"; (5) "continuity of services"; and (6) "compassionate and competent healthcare professionals". CONCLUSIONS: In order to adapt and meet changing needs, the preferred service ecosystem should support senior citizens' autonomy through interpersonal relationships and involvement. Healthcare managers and decision makers should consider a broader range of practical and social support services. Municipalities should plan for and develop age-friendly infrastructures, while healthcare professionals should rely on their compassion and competence to meet senior citizens' needs.

Perspectives on consciousness in patients with disorders of consciousness from brain injury: group concept mapping study across clinic, research, and families.

BACKGROUND: An effective healthcare system depends on clinic, research, and patient/relatives interactions. Such interactions may at their core be challenged by misalignments of concepts and the practices that constitute them. The concept of consciousness and what is experienced and understood as signs of consciousness in patients with severe acquired brain injury is one of these potential areas of misalignment. Different perspectives and experiences of consciousness are challenging the delivery of care and the high-stake decision-making process on the potential withdrawal of treatment. The enhanced uncertainties call for reflections on how key stakeholders perceive and identify consciousness in current clinical encounters and practice. METHODS: The study empirically explores the actual experiences and conceptions of consciousness concerning patients with disorders of consciousness (DoC) from the perspectives of researchers, health professionals, and relatives of patients, to understand the challenges of the diversity of understandings of consciousness. Engaging the stakeholders by employing Group Concept Mapping methodology, the study developed a situated conceptual map, which reflects nuances and the importance of perspectives on and signs of consciousness. RESULTS: Twenty-seven participants contributed to the generation of ideas, 14 took part in the structuring of statements and 10 took part in the validation meeting to interpret the cluster rating map. A total of 85 unique statements were identified and organized into six clusters: (1) Presence, (2) Intentional Activity, (3) Experience of self, (4) Participation in Social Interaction, (5) (Repeated) Response, and (6) Unspecific Reaction. The conceptual mapping demonstrates an extensive overlap in perspectives on consciousness among participants, prioritizing signs that are observable at the bedside. CONCLUSIONS: The study provides a first step toward a future framework for the difficult process of decision-making concerning a segment of patients with DoC. The study highlights the importance of repeatable signs of consciousness observed at the bedside and the patient's ability to participate in social interactions, while also considering the importance of non-clinically observable signs of consciousness.

Health technology assessment 2025 and beyond: lifecycle approaches to promote engagement and efficiency in health technology assessment.

Lifecycle considerations have always been part of health technology assessment (HTA). However, the concept of taking a fuller, more holistic "lifecycle approach" is gaining interest in the HTA community. The 2022 HTAi Global Policy Forum (GPF) discussed how adopting a lifecycle approach could promote stakeholder engagement and robust evidence generation, and whether it could enhance information sharing and transparency across stakeholder groups. This article summarizes the discussions held at the 2022 HTAi GPF and subsequent HTAi Annual Meeting panel session that debated some of the key challenges and opportunities, with particular focus on the pre- and postmarket and disinvestment phase activities. Core themes and recommendations identified that collaboration and patient involvement are happening but still needs to be strengthened, and moving to disease-based approaches may help, although individual contexts still need to be considered. Appropriately developed and mandated core outcome sets may help with information sharing and efficiency in all lifecycle activities. Further, methods for the appropriate use of big data and digital data collection should be developed and driven by the HTA community. The value of lifecycle activities should be reviewed; in particular, scientific advice appears valuable, but the magnitude of effect is somewhat unknown due to the challenges around the confidential nature of these activities. Not all lifecycle activities can be conducted for every technology, and while there is a move away from disinvestment phase activities, more structured prioritization criteria are required. This article ends with suggested next steps to bring forward some of the priority recommendations.

Does patient and public involvement impact public health decision-making? A 10 year retrospective analysis of public consultation in Brazil.

BACKGROUND:  The aim of this work is to characterize the processes associated with patient and public involvement (PPI) in the form of public consultations (PC) during the first 10 years of operation of the National Committee for Health Technology Incorporation in the Unified Health System (Conitec) of Brazil, and to identify factors associated with changes in Conitec's recommendations following these PC. METHODS:  This cross-sectional study analysed all processes related to the adoption of technologies that took place in Brazil between 2012 and 2021 based on technical reports and self-reported information collected from PC participants. A multiple logistic regression model identified factors associated with changes in Conitec's recommendations following PC. RESULTS:  A total of 479 technical reports were published, of which 83% (n = 400) were submitted to PC. Demands were made mainly by applicants from the government (n = 262; 55%), regarding the adoption of medicines (n = 366; 76%), in which context neoplasms and infectious diseases were the most frequent indications (n = 66; 14% for each). A total of 264 (55%) processes resulted in a final recommendation in favour of introducing the technology. Over the period of 10 years, 196 483 contributions were received in response to PC. The largest volume of contributions was made by patients and their families or representatives (n = 99 082; 50%), females (122 895; 67%), white individuals (129 165; 71%) and individuals between the ages of 25 and 59 years (145 364; 80%). Alteration of the preliminary recommendation occurred in 13% (n = 53) of the PC, with a higher proportion of recommendations being altered from 2017 onwards. Increased participation by patients had a significant impact on the alteration of the preliminary recommendation (odds ratio 3.87, 95% CI 1.33-13.35, p = 0.02). CONCLUSIONS: Increased engagement of patients and their families and caregivers in PC was associated with changing the preliminary recommendation of Conitec about the adoption of technologies into the public health system in Brazil.

Development, Implementation, and Evaluation of an e-Learning in Integrative Oncology for Physicians and Students Involving Experts and Learners: Experiences and Recommendations.

In this project, an e-Learning program for complementary and integrative medicine in oncology was systematically developed, implemented, and evaluated in a stepwise procedure. Learning objectives and content were defined within the KOKON project network, considering the educational competencies for integrative oncology. To design a valuable e-Learning, experts were involved in all relevant steps of the process, as well as stakeholders from various target groups (undergraduates: medicine students, postgraduates: oncology physicians). We used mixed methods including quantitative surveys, progress tests, and qualitative focus groups. The developed e-Learning program led to a significant measurable knowledge gain about complementary and integrative medicine. In parallel, physicians and students were subjectively satisfied with the training. For the majority of e-Learning elements, the needs of both target groups are comparable. Furthermore, both groups emphasized the value of formative assessment tools for gaining knowledge. From the various surveys and experiences collected in this project, we derive recommendations for others developing e-Learning programs.

Methods for Early Assessment of the Societal Value of Health Technologies: A Scoping Review and Proposal for Classification.

OBJECTIVES: Early assessments of health technologies help to better align and integrate their development and assessment. Such assessments can take many forms and serve different purposes, hampering users in their selection of the most appropriate method for a specific goal. The aim of this scoping review was to structure the large set of methods according to their specific goal. METHODS: A scoping review was conducted using PubMed and reference lists of retrieved articles, to identify review studies with a methodological focus. From the included reviews, all individual methods were listed. Based on additional literature and examples, we extracted the specific goal of each method. All goals were clustered to derive a set of subclasses and methods were grouped into these subclasses. RESULTS: Of the 404 screened, 5 reviews were included, and 1 was added when searching reference lists. The reviews described 56 methods, of which 43 (77%) were included and classified as methods to (1) explore the nature and magnitude of the problem, (2) estimate the nature and magnitude of the expected (societal) value, (3) identify conditions for the potential value to materialize, and (4) help develop and design the type of research that is needed. CONCLUSIONS: The wide range of methods for exploring the societal value of health technologies at an early stage of development can be subdivided into a limited number of classes, distinguishing methods according to their specific objective. This facilitates selection of appropriate methods, depending on the specific needs and aims.

Prioritising child health and maternity evidence-based interventions or service models: a stakeholder-driven process.

AIM: A UK programme, led by the National Institute for Health Research (NIHR) ( https://www.nihr.ac.uk ) and coordinated by Applied Research Collaborations (ARC), ( https://www.nihr.ac.uk/explore-nihr/support/collaborating-in-applied-health-research.htm ) aimed to identify and select evidence-based, implementation-ready service innovations for evaluation. The programme focused on seven areas of health provision. We report on a prioritisation process designed to identify and assess innovations in one of these areas: child and maternal health (CH&M). METHODS: We developed a three-stage, online, stakeholder driven process to 1) identify, 2) assess and prioritise and 3) select evidence-based interventions or service models, using crowdsourcing to identify projects and the APEASE criteria to assess and select projects. A brief evidence review was conducted for all initial suggestions to identify those with the largest evidence-base to take forward for ranking by stakeholders. Stakeholder workshops considered and ranked these suggestions using the APEASE criteria. We then conducted in-depth evidence reviews for the highest ranked suggestions. The Project Management Group and Advisory Board used these reviews and the APEASE criteria to select the final projects. RESULTS: We received 32 initial suggestions from a range of clinicians, practitioners and researchers. Fourteen of the most evidence-based suggestions were considered and ranked at four themed stakeholder workshops. Nine suggestions were ranked for further in-depth evidence review and a final four projects were selected for implementation evaluation using the APEASE criteria. These were: 1. Maternal Mental Health Services Multidisciplinary Teams 2. Early years tooth brushing programme 3. Trauma-focused CBT for young people in care and 4. Independent Domestic Violence Advisors in maternity settings. Feedback from participants suggested that having public representatives participating in all stakeholder meetings, rather than being consulted separately, focused discussions clearly on patient benefit rather than research aims. CONCLUSIONS: The stakeholder-driven process achieved its aim of identifying, prioritising and assessing and selecting, evidence-based projects for wider implementation and evaluation. The concurrent process could be adapted by other researchers or policy makers.

Translating qualitative data into intervention content using the Theoretical Domains Framework and stakeholder co-design: a worked example from a study of cervical screening attendance in older women.

BACKGROUND: Previous screening interventions have demonstrated a series of features related to social determinants which have increased uptake in targeted populations, including the assessment of health beliefs and barriers to screening attendance as part of intervention development. Many studies cite the use of theory to identify methods of behaviour change, but fail to describe in detail how theoretical constructs are transformed into intervention content. The aim of this study was to use data from a qualitative exploration of cervical screening in women over 50 in the UK as the basis of intervention co-design with stakeholders using behavioural change frameworks. We describe the identification of behavioural mechanisms from qualitative data, and how these were used to develop content for a service-user leaflet and a video animation for practitioner training. The interventions aimed to encourage sustained commitment to cervical screening among women over 50, and to increase sensitivity to age-related problems in screening among primary care practitioners. METHODS: Secondary coding of a qualitative data set to extract barriers and facilitators of cervical screening attendance. Barrier and facilitator statements were categorised using the Theoretical Domains Framework (TDF) to identify relevant behaviour change techniques (BCTs). Key TDF domains and associated BCTs were presented in stakeholder focus groups to guide the design of intervention content and mode of delivery. RESULTS: Behavioural determinants relating to attendance clustered under three domains: beliefs about consequences, emotion and social influences, which mapped to three BCTs respectively: (1) persuasive communication/information provision; (2) stress management; (3) role modelling and encouragement. Service-user stakeholders translated these into three pragmatic intervention components: (i) addressing unanswered questions, (ii) problem-solving practitioner challenges and (iii) peer group communication. Based on (ii), practitioner stakeholders developed a call to action in three areas - clinical networking, history-taking, and flexibility in screening processes. APEASE informed modes of delivery (a service-user leaflet and a cartoon animation for practitioners). CONCLUSION: The application of the TDF to qualitative data can provide an auditable protocol for the translation of qualitative data into intervention content.

Deliberative processes in decision making informed by health technology assessment in Latin America.

OBJECTIVE: The objective of Health Technology Assessment International's 6th Latin America Policy Form, held in 2021, was to explore the implementation of deliberative processes in the framework of health technology assessment (HTA) and how agencies in the region could involve stakeholders in this process. METHODS: This paper is based on a preparatory survey, a background document, and the deliberative work of participants at the virtual Forum conducted in 2021. There were ninety-one participants in the open session and fifty-two in the closed sessions, representing twelve countries and diverse areas of the health sector. RESULTS: While there are mechanisms in most countries in Latin America to consider stakeholder involvement to some degree, it remains reduced or limited to a consultative role, making true participative involvement rare. There are significant barriers and structural and contextual limitations that have impeded or slowed progress toward deliberative processes. Relatively low levels of institutionalization and knowledge about HTA, as well as the lack of trust among stakeholders are important challenges. This situation has impacted health systems by diminishing the legitimacy of decisions and the very structures and processes of HTA. CONCLUSION: The Forum's broad group of participants identified barriers, facilitators, and recommendations to improve the use of deliberative processes in Latin America to foster improved fairness and reasonableness in HTA and decision making.

Status of the health information system in Ireland and its fitness to support health system performance assessment: a multimethod assessment based on stakeholder involvement.

BACKGROUND: Between 2019 and 2021, the first Irish health system performance assessment (HSPA) framework was developed. As routinely collected health data are necessary to continuously populate indicators of an HSPA framework, a purpose-driven assessment of the health information system (HIS) in Ireland and its fitness to support the implementation of an HSPA framework was conducted. This study reports on the status of the Irish HIS through a multimethod assessment based on continuous broad stakeholder involvement. METHODS: Between May and November 2020, over 50 informants were engaged in individual and group interviews and stakeholder consultation workshops as part of the HIS assessment process. Descriptive themes and high-level data availability heatmaps were derived from interview and workshop data using thematic analysis. Indicator "passports" for the HSPA framework were populated during stakeholder consultation workshops and analysed using univariate descriptive statistics. RESULTS: The HIS in Ireland was able to provide administrative, survey and registry-based data for public sector acute care services, focusing on structure, process and output metrics. Significant data availability gaps, most notably from primary care, private hospitals and community care, were reported, with little availability of electronic health record and people-reported data. Data on outcome metrics were mostly missing, as were linkage possibilities across datasets for care pathway monitoring. The COVID-19 pandemic highlighted the national HIS's shortcomings but also the capacity for rapid development and improvement. CONCLUSIONS: A tailor-made assessment of the HIS in Ireland, involving a broad set of relevant stakeholders, revealed strengths, weaknesses and areas for improvement in the Irish health data landscape. It also contributed to the development of a national HSPA framework and momentum to further strengthen data infrastructure and governance, while working towards a more data-driven and person-centred healthcare system. This work demonstrates the utility of an inclusive HIS assessment process and is applicable beyond Ireland, where this case study was conducted.