What is in it for me? Norwegian radiographers and radiation therapists' experiences from obtaining a master's degree.

INTRODUCTION: Radiographers and radiation therapists are essential in providing patients with high-quality diagnostic imaging or therapeutic services. Therefore, radiographers and radiation therapists must get involved in evidence-based practice and research. Even though many radiographers and radiation therapists obtain their master's degrees, little is known about how this degree affects clinical practice or personal and professional growth. We aimed to fill this knowledge gap by investigating Norwegian radiographers' and radiation therapists' experiences when deciding to undertake and complete a master's degree and exploring the impact of the master's degree in clinical practice. METHODS: Semi-structured interviews were conducted and transcribed verbatim. The interview guide covered five broad areas: 1) the process of achieving a master's degree, 2) the work situation, 3) the value of competencies, 4) the use of competencies and 5) expectations. Data were analyzed using inductive content analysis. RESULTS: The analysis included seven participants (four diagnostic radiographers and three radiation therapists) working at six different departments of varying sizes across Norway. Four main categories emerged from the analysis, of which the categories: Motivation and Management support, were categorized into the theme experiences pre-graduation, whereas the categories Personal gain and Application of skills were categorized into the theme experiences pre-graduation. The fifth category Perception of pioneering embraces both themes. CONCLUSION: Participants reported great motivation and personal gain, but challenges in management and application of skills post-graduation. The participants perceived themselves as pioneers, as there is a lack of experience with radiographers and radiation therapists undertaking master studies, hence no culture and systems for professional development are established. IMPLICATIONS FOR PRACTICE: There is a need for professional development and research culture in the Norwegian Departments of Radiology and Radiation therapy. Radiographers and radiation therapists must take the initiative to establish such. Further research should investigate managers' attitudes and perceptions toward radiographers' master's competencies in the clinic.

The value of referral information and assessment - a cross sectional study of radiographers' perceptions.

BACKGROUND: Radiology professionals are frequently confronted with referrals containing insufficient clinical information, which hinders delivery of safe and quality medical imaging services. There is however lack of knowledge on why and how referral information is important for radiographers in clinical practice. This study explores what purposes referral information is used/ useful for the radiographers, and the benefits of involving them in assessing referrals. METHODS: A cross sectional study was conducted of radiographers recruited through the International Society of Radiographers and Radiological Technologists (ISRRT) networks. A questionnaire was developed and distributed consisting of 5-point Likert scale questions on a) use/usefulness of referral information for 12 listed purposes and b) the benefits of radiographers assessing referrals for 8 possible reasons. The questionnaire was validated using a test-retest reliability analysis. Kappa values ≥0.6 were accepted. SPSS software was used for data analysis and chi-square tests to determine associations between using referral information and background variables. RESULTS: Total respondents were 279 (n = 233 currently in clinical practice and n = 46 in other positions). The participants in clinical practice ranked high all 12 listed purposes for use of referral information, and all except one received ≥60% 'frequent'/'very frequent' responses. Use for patient identification purposes received the highest score (97% 'frequently'/'very frequently' responses), followed by ensuring imaging of the correct body region (79% 'very frequently' responses). Radiographers not currently working in clinical practice ranked the 'usefulness' of listed items similarly. Significant associations between frequent use of referral information and education level were not observed, and only three items were significantly associated with modality of practice. All items on benefits of radiographers assessing referrals received ≥75% 'agree'/'strongly agree' scores. The items ranked highest were promotes radiographers' professional responsibility and improves collaboration with radiologists and referring clinicians, with 72 and 67% strongly agreed responses, respectively. CONCLUSION: Radiographers use referral information frequently for several purposes. The referral information is needed for justifying and optimising radiological procedures, hence crucial for ensuring patient safety and high-quality services. This further emphasis why radiographers perceive several benefits of being involved in assessing the referral information.

Radiographers' actions and challenges when confronted with inappropriate radiology referrals.

OBJECTIVES: To explore radiographers' actions toward inappropriate referrals and hindrances to assessing referrals. METHODS: An online survey was distributed to radiographers via the International Society of Radiographers and Radiological Technologists (ISRRT) networks. The questionnaire consisted of 5-point Likert scale questions on radiographers' actions to supplement referral information, actions for unjustified referrals and hindrances to referral assessment. The questionnaire was validated using a test-retest reliability analysis. Kappa values ≥ 0.6 were accepted. SPSS software was used for data analysis and chi-square tests to compare subgroups. RESULTS: Total responses received were 279. The most reported actions to supplement missing referral information were to ask the patient or relative, examine the body region of concern and check medical records (73%, 70%, 67%, responded often/always, respectively). The actions when confronted with unjustified referrals were reported equally to consult the radiologist, referring clinician and radiographer (69-68% often/always responses). The hindering factors ranked high (agreed/strongly agreed responses) pertained to inadequate information in referral forms (83%), ineffective communication among healthcare professionals (79%), lack of training (70%) and allocated time (61%). Statistically significant associations were observed for a few actions and hindrances with education level, modality of practice and responsibility to screen imaging referrals. CONCLUSION: Radiographers consult colleagues about suspected unjustified referrals. Effective communication pathways, training and time allocation to improve radiographers' skills to assess referrals may enhance appropriate imaging and delivery of quality patient care. KEY POINTS: • Radiographers' actions of supplementing missing information in radiology referrals facilitate provision of high-quality health services. • Radiographers' strategy when confronted with inappropriate referrals is to consult radiologists and referring clinicians. • Better inter-professional communication and organisation of tasks can facilitate radiographers' participation in referral assessment to ensure appropriate imaging.

Ethical impact of suboptimal referrals on delivery of care in radiology department.

The referral is the key source of information that enables radiologists and radiographers to provide quality services. However, the frequency of suboptimal referrals is widely reported. This research reviews the literature to illuminate the challenges suboptimal referrals present to the delivery of care in radiology departments. The concept of suboptimal referral includes information, that is; missing, insufficient, inconsistent, misleading, hard to interpret or wrong. The research uses the four ethical principles of non-maleficence, beneficence, Autonomy and Justice as an analytic framework.Suboptimal referrals can cause harm by hindering safe contrast-media administration, proper radiation protection by justification of procedures, and compassionate patient care. Suboptimal referrals also hinder promoting patient benefits from the correct choice of imaging modality and protocol, an optimal performed examination, and an accurate radiology report. Additionally, patient autonomy is compromised from the lack of information needed to facilitate benefit-risk communication. Finally, suboptimal referrals challenge justice based on lack of reasonable patient prioritising and the unfairness caused by unnecessary examinations.These findings illuminate how suboptimal referrals can inhibit good health and well-being for patients in relation to safety, missed opportunities, patient anxiety and dissatisfaction. The ethical challenges identified calls for solutions. Referral-decision support tools and artificial intelligence may improve referral quality, when implemented. Strategies addressing efforts of radiology professionals are inevitable, including gatekeeping, shared decision-making and inter-professional communication; thereby raising awareness of the importance of good referral quality and promoting commitment to ethical professional conduct.

Health care personnel's perception of guideline implementation for musculoskeletal imaging: a process evaluation.

BACKGROUND: The increasing complexity and variability in radiology have significantly fueled the need for guidelines. There are many methods for disseminating and implementing guidelines however; and obtaining lasting changes has been difficult. Implementation outcome is usually measured in a decrease in unwarranted examinations, and qualitative data are rarely used. This study's aim was to evaluate a guideline implementation process and identify factors influencing implementation outcome using qualitative data. METHODS: Seven general practitioners and five radiological personnel from a Norwegian county participated in four focus group interviews in 2019. The data were analyzed using qualitative content analysis, where some categories were predetermined, while most were drawn from the data. RESULTS: Four main categories were developed from the data material. 1) Successful/unsuccessful parts of the implementation, 2) perceived changes/lack of changes after the implementation, 3) environment-related factors that affected guideline use, and 4) User related factors that affect guideline use. CONCLUSIONS: Our findings show that clinical guideline implementation is difficult, despite the implementation strategy being tailored to the target groups. Several environment- and user-related factors contributed to the lack of changes experienced in practice for both general practitioners and radiological personnel.

Impact of mobile radiography services in nursing homes on the utilisation of diagnostic imaging procedures.

BACKGROUND: In the last decade, mobile radiography services have been introduced in nursing homes in several countries. Earlier research found an underutilisation of diagnostic imaging among nursing home residents. However, the effects of introducing mobile radiography services on the use of diagnostic imaging are unknown. The purpose of this study was to determine the utilisation of diagnostic imaging among nursing home residents and if there are any differences between hospitals with and without a mobile radiography service. METHODS: Data for 2015 were collected from the radiological information systems of 11 hospitals. The data included information on the anatomical region/organ/organ system, modality, and information on where the examination took place. Using nursing home beds as a proxy for nursing home residents' differences in the use of diagnostic imaging in areas with hospitals with and without mobile radiography services were analysed. The chi-squared test was used to compare the areas. RESULTS: From 11,066 examinations of nursing home residents, 87% were plain radiographs, 8% were CT scans, and 4% were ultrasound examinations. In areas with mobile radiography services, there was a significantly higher proportion of diagnostic imaging used per nursing home bed, 50% per bed compared to 36% per bed in areas without; p = < 0.001. Furthermore, in areas with mobile radiography services, there was a significantly lower proportion of CT and ultrasound used per nursing home bed, 2.5 and 1.4% respectively per bed compared to 4.7 and 2.2% respectively per bed in areas without; p = < 0.001. CONCLUSIONS: This study demonstrate a lower use of radiology by nursing home residents compared to the general population, and indicates that mobile radiography services increase the level closer to the user rate in the general population. The proportions of plain radiographs are significantly higher in areas with a mobile radiography service, while the proportion of more advanced imaging techniques such as CT and ultrasound are lower. The higher use of diagnostic imaging is most likely appropriate because of higher morbidity and lower use of diagnostic imaging among nursing home residents, compared to the general population. Further research is necessary on how to improve diagnostic imaging services for nursing home residents.

Methods Assessing Sociocultural Aspects of Health Technologies: Results of a Literature Review.

OBJECTIVES: Social and cultural aspects are rarely assessed in health technology assessments (HTA), despite being part of most HTA definitions. One hypothesis for the reason why they are hardly considered in HTA is that we lack relevant assessment methods. Accordingly, this review aims at providing an overview of methodological approaches to address social and cultural aspects related to health technologies in HTA. METHODS: We conducted a comprehensive literature search by searching fourteen databases and a hand-search of two pertinent journals. Additionally, we sent a query to all member agencies of the International Network of Agencies for Health Technology Assessment (INAHTA) asking them for methods they use to assess social and cultural aspects. RESULTS: A total of 125 publications met our inclusion criteria. We grouped the methodological approaches into checklists for experts, literature reviews, stakeholder participatory approaches, primary data collection methods, and combinations of methodological approaches. CONCLUSIONS: There is a wide variety of methods available for assessing social and cultural aspects of health technologies, some of which have been applied in HTA. The presented overview of the different approaches and their merits can facilitate the assessment of these aspects, and improve the knowledge regarding (potential) success and failure of the implementation of a health technology.

Development and conduction of an active re-implementation of the Norwegian musculoskeletal guidelines.

OBJECTIVE: Significant geographical variations in the use of diagnostic imaging have been demonstrated in Norway and elsewhere. Non-traumatic musculoskeletal conditions is one area where this has been demonstrated. A national musculoskeletal guideline was implemented in response by online publishing and postal dissemination in Norway in 2014 by national policy makers. The objective of our study was to develop and conduct an intervention as an active re-implementation of this guideline in one Norwegian county to investigate and facilitate guideline adherence. The development and implementation process is reported here, to facilitate understanding of the future evaluation results of this study. RESULTS: The consolidated framework for implementation research guided the intervention development and implementation. The implementation development was also based on earlier reported success factors in combination with interviews with general practitioners and radiologists regarding facilitators and barriers to guideline adherence. A combined implementation strategy was developed, including educational meetings, shortening of the guideline and easier access. All the aspects of the implementation strategy were adapted towards general practitioners, radiological personnel and the Norwegian Labor and Welfare Administration. Sixteen educational meetings were held, and six educational videos were made for those unable to attend, or where meetings could not be held.

Barriers and facilitators for guideline adherence in diagnostic imaging: an explorative study of GPs' and radiologists' perspectives.

BACKGROUND: Diagnostic imaging has been a part of medicine for the last century. It has been difficult to implement guidelines in this field, and unwarranted imaging has been a frequent problem. Some work has been done to explain these phenomena separately. Identifying the barriers to and facilitators of guideline use has been one strategy. The aim of this study is to offer a more comprehensive explanation of deviations from the guideline by studying the two phenomena together. METHODS: Eight general practitioners and 10 radiologists from two counties in Norway agreed to semi-structured interviews. Topics covered in the interviews were knowledge of the guideline, barriers to and facilitators of guideline use, implementation of guidelines and factors that influence unwarranted imaging. RESULTS: Several barriers to and facilitators of guideline use were identified. Among these are lack of time, pressure from patients, and guidelines being too long, rigid or unclear. Facilitators of guideline use were easy accessibility and having the guidelines adapted to the target group. Some of the factors that influence unwarranted imaging are lack of time, pressure from patients and availability of imaging services. CONCLUSION: There are similarities between the perceived barriers for guideline adherence and the perceived factors that influence unwarranted imaging. There may be a few reasons that explains the deviation from guidelines, and the amount of unwarranted imaging.

Managers' experience of success criteria and barriers to implementing mobile radiography services in nursing homes in Norway: a qualitative study.

BACKGROUND: In order to meet the future challenges posed by ageing populations, new technology, telemedicine and a more personalized healthcare system are needed. Earlier research has shown mobile radiography services to be highly beneficial for nursing home residents in addition to being cost-effective. Despite the benefits, mobile radiography services are uncommon in Europe and Norway. The purpose of this study was to explore success criteria and barriers in the process of implementing mobile radiography services, from the point of view of the hospital and municipal managers. METHODS: Eleven semi-structured interviews were conducted with managers from five hospitals and six municipalities in Norway where mobile radiography services had been implemented. Core issues in the interview guide were barriers and facilitators in the different phases of implementation. The framework method for thematic analysis was used for analysing the data inductively in a research team. RESULTS: Five main categories were developed through the success criteria and barriers experienced by the participants: national health policy, regional and municipal policy and conditions, inter-organizational implementation projects, experienced outcome, and professional skills and personal characteristics. The categories were allocated into three higher-order classifications: macro, meso and micro levels. The main barriers experienced by the managers were financial, procedural and structural. In particular, the reimbursement system, lack of management across healthcare levels and the lack of compatible information systems acted as barriers. The main facilitators were external funding, enthusiastic individuals in the organizations and good collaboration between hospitals and municipalities. CONCLUSIONS: The managers experienced financial, structural and procedural barriers. The main success criteria in the process were external funding, and the support and engagement from the individuals in the organizations. This commitment was mainly facilitated by the intuitive appeal of mobile radiography. Changes in healthcare management and in the financial system might facilitate services across healthcare levels. In addition, compatible information systems across healthcare levels are needed in order to facilitate the use of new technology and mobile services.

STAKEHOLDER INVOLVEMENT THROUGHOUT HEALTH TECHNOLOGY ASSESSMENT: AN EXAMPLE FROM PALLIATIVE CARE.

OBJECTIVES: Internationally, funders require stakeholder involvement throughout health technology assessment (HTA). We report successes, challenges, and lessons learned from extensive stakeholder involvement throughout a palliative care case study that demonstrates new concepts and methods for HTA. METHODS: A 5-step "INTEGRATE-HTA Model" developed within the INTEGRATE-HTA project guided the case study. Using convenience or purposive sampling or directly / indirectly identifying and approaching individuals / groups, stakeholders participated in qualitative research or consultation meetings. During scoping, 132 stakeholders, aged ≥ 18 years in seven countries (England, Italy, Germany, The Netherlands, Norway, Lithuania, and Poland), highlighted key issues in palliative care that assisted identification of the intervention and comparator. Subsequently stakeholders in four countries participated in face-face, telephone and / or video Skype meetings to inform evidence collection and / or review assessment results. An applicability assessment to identify contextual and implementation barriers and enablers for the case study findings involved twelve professionals in the three countries. Finally, thirteen stakeholders participated in a mock decision-making meeting in England. RESULTS: Views about the best methods of stakeholder involvement vary internationally. Stakeholders make valuable contributions in all stages of HTA; assisting decision making about interventions, comparators, research questions; providing evidence and insights into findings, gap analyses and applicability assessments. Key challenges exist regarding inclusivity, time, and resource use. CONCLUSION: Stakeholder involvement is feasible and worthwhile throughout HTA, sometimes providing unique insights. Various methods can be used to include stakeholders, although challenges exist. Recognition of stakeholder expertise and further guidance about stakeholder consultation methods is needed.

COMPREHENSIVE ASSESSMENT OF COMPLEX TECHNOLOGIES: INTEGRATING VARIOUS ASPECTS IN HEALTH TECHNOLOGY ASSESSMENT.

OBJECTIVES: Despite recent development of health technology assessment (HTA) methods, there are still methodological gaps for the assessment of complex health technologies. The INTEGRATE-HTA guidance for effectiveness, economic, ethical, socio-cultural, and legal aspects, deals with challenges when assessing complex technologies, such as heterogeneous study designs, multiple stakeholder perspectives, and unpredictable outcomes. The objective of this article is to outline this guidance and describe the added value of integrating these assessment aspects. METHODS: Different methods were used to develop the various parts of the guidance, but all draw on existing, published knowledge and were supported by stakeholder involvement. The guidance was modified after application in a case study and in response to feedback from internal and external reviewers. RESULTS: The guidance consists of five parts, addressing five core aspects of HTA, all presenting stepwise approaches based on the assessment of complexity, context, and stakeholder involvement. The guidance on effectiveness, health economics and ethics aspects focus on helping users choose appropriate, or further develop, existing methods. The recommendations are based on existing methods' applicability for dealing with problems arising with complex interventions. The guidance offers new frameworks to identify socio-cultural and legal issues, along with overviews of relevant methods and sources. CONCLUSIONS: The INTEGRATE-HTA guidance outlines a wide range of methods and facilitates appropriate choices among them. The guidance enables understanding of how complexity matters for HTA and brings together assessments from disciplines, such as epidemiology, economics, ethics, law, and social theory. This indicates relevance for a broad range of technologies.

Mobile radiography services in nursing homes: a systematic review of residents' and societal outcomes.

BACKGROUND: Demographic changes are leading to an ageing population in Europe, and predict an increase in the number of nursing home residents over the next 30 years. Nursing home residents need specialised healthcare services such as radiology due to both chronic and acute illnesses. Mobile radiography, x-ray examinations performed in the nursing homes, may be a good way of providing services to this population. The aim of this systematic review was to identify the outcomes of mobile radiography services for nursing home residents and society. METHODS: A systematic review based on searches in the Medline, Cochrane, PubMed, Embase and Svemed + databases was performed. Titles and abstracts were screened according to a predefined set of inclusion criteria: empirical studies in the geriatric population, and reports of mobile radiography services in a clinical setting. All publications were quality appraised using MMAT or CASP appraisal tools. Data were extracted using a summary table and results were narratively synthesised. RESULTS: Ten publications were included. Three overarching outcomes were identified: 1) reduced number of hospitalisations and outpatient examinations or treatments, 2) reduced number of transfers between nursing homes and hospitals and 3) increased access to x-ray examinations. These outcomes were interlinked with the more specific outcomes for residents and society reported in the literature. For residents there was a reduction in burdensome transfers and waiting time and adequate treatment and care increased. For society, released resources could be used more efficiently, and overall costs were reduced substantially. CONCLUSIONS: This review indicates that mobile radiography services for nursing home residents in the western world are of comparable quality to hospital-based examinations and have clear potential benefits. Mobile radiography reduced transfers to and from hospital, increased the number of examinations carried out and facilitated timely diagnosis and access to treatments. Further research is needed to formally evaluate potential improvements in care quality and cost-effectiveness.

Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework.

BACKGROUND: The effectiveness of complex interventions, as well as their success in reaching relevant populations, is critically influenced by their implementation in a given context. Current conceptual frameworks often fail to address context and implementation in an integrated way and, where addressed, they tend to focus on organisational context and are mostly concerned with specific health fields. Our objective was to develop a framework to facilitate the structured and comprehensive conceptualisation and assessment of context and implementation of complex interventions. METHODS: The Context and Implementation of Complex Interventions (CICI) framework was developed in an iterative manner and underwent extensive application. An initial framework based on a scoping review was tested in rapid assessments, revealing inconsistencies with respect to the underlying concepts. Thus, pragmatic utility concept analysis was undertaken to advance the concepts of context and implementation. Based on these findings, the framework was revised and applied in several systematic reviews, one health technology assessment (HTA) and one applicability assessment of very different complex interventions. Lessons learnt from these applications and from peer review were incorporated, resulting in the CICI framework. RESULTS: The CICI framework comprises three dimensions-context, implementation and setting-which interact with one another and with the intervention dimension. Context comprises seven domains (i.e., geographical, epidemiological, socio-cultural, socio-economic, ethical, legal, political); implementation consists of five domains (i.e., implementation theory, process, strategies, agents and outcomes); setting refers to the specific physical location, in which the intervention is put into practise. The intervention and the way it is implemented in a given setting and context can occur on a micro, meso and macro level. Tools to operationalise the framework comprise a checklist, data extraction tools for qualitative and quantitative reviews and a consultation guide for applicability assessments. CONCLUSIONS: The CICI framework addresses and graphically presents context, implementation and setting in an integrated way. It aims at simplifying and structuring complexity in order to advance our understanding of whether and how interventions work. The framework can be applied in systematic reviews and HTA as well as primary research and facilitate communication among teams of researchers and with various stakeholders.

Mobile X-ray service for nursing homes. / Mobil røntgentjeneste ved sykehjem.

BACKGROUND: Transport to a radiology department can be a strain on nursing home patients, leading to less use of diagnostic imaging. The purpose of this study was to examine the use and benefit of a mobile X-ray service that enables imaging at nursing homes. MATERIAL AND METHOD: In connection with 300 of a total of 326 referrals to a mobile X-ray service in Vestfold County in the period March to September 2015, 66 doctors at 33 nursing homes completed a questionnaire on the options patients would have had in the absence of the mobile service. A hundred of these referrals were followed up one to two weeks later with a further questionnaire on the implications of the X-ray scan for diagnosis, treatment and nursing. Eighty-seven questionnaires were completed. RESULTS: In 219 cases (73 %), the patients would have been sent to a hospital radiology department if the mobile X-ray service had not been available. In 60 cases (20 %) the patients would not have had an X-ray examination. In the follow-up, doctors answered that the X-rays had yielded new diagnostic information in 81 cases (95 %), that 71 (83 %) of the X-ray results had had implications for further treatment and that 29 (34 %) had helped patients avoid hospitalisation. In 77 cases (89 %), the X-rays enabled important information to be given to patients and their families. CONCLUSION: A mobile X-ray service makes it possible to avoid transports that place a strain on patients and to provide necessary diagnoses for patients who would not otherwise have been examined.

Lay and professional stakeholder involvement in scoping palliative care issues: Methods used in seven European countries.

BACKGROUND: Stakeholders are people with an interest in a topic. Internationally, stakeholder involvement in palliative care research and health technology assessment requires development. Stakeholder involvement adds value throughout research (from prioritising topics to disseminating findings). Philosophies and understandings about the best ways to involve stakeholders in research differ internationally. Stakeholder involvement took place in seven countries (England, Germany, Italy, Lithuania, the Netherlands, Norway and Poland). Findings informed a project that developed concepts and methods for health technology assessment and applied these to evaluate models of palliative care service delivery. AIMS: To report on stakeholder involvement in the INTEGRATE-HTA project and how issues identified informed project development. DESIGN: Using stakeholder consultation or a qualitative research design, as appropriate locally, stakeholders in seven countries acted as 'advisors' to aid researchers' decision making. Thematic analysis was used to identify key issues across countries. SETTING/PARTICIPANTS: A total of 132 stakeholders (82 professionals and 50 'lay' people) aged ⩾18 participated in individual face-to-face or telephone interviews, consultation meetings or focus groups. RESULTS: Different stakeholder involvement methods were used successfully to identify key issues in palliative care. A total of 23 issues common to three or more countries informed decisions about the intervention and comparator of interest, sub questions and specific assessments within the health technology assessment. CONCLUSION: Stakeholders, including patients and families undergoing palliative care, can inform project decision making using various involvement methods according to the local context. Researchers should consider local understandings about stakeholder involvement as views of appropriate and feasible methods vary. Methods for stakeholder involvement, especially consultation, need further development.

The development of PubMed search strategies for patient preferences for treatment outcomes.

BACKGROUND: The importance of respecting patients' preferences when making treatment decisions is increasingly recognized. Efficiently retrieving papers from the scientific literature reporting on the presence and nature of such preferences can help to achieve this goal. The objective of this study was to create a search filter for PubMed to help retrieve evidence on patient preferences for treatment outcomes. METHODS: A total of 27 journals were hand-searched for articles on patient preferences for treatment outcomes published in 2011. Selected articles served as a reference set. To develop optimal search strategies to retrieve this set, all articles in the reference set were randomly split into a development and a validation set. MeSH-terms and keywords retrieved using PubReMiner were tested individually and as combinations in PubMed and evaluated for retrieval performance (e.g. sensitivity (Se) and specificity (Sp)). RESULTS: Of 8238 articles, 22 were considered to report empirical evidence on patient preferences for specific treatment outcomes. The best search filters reached Se of 100 % [95 % CI 100-100] with Sp of 95 % [94-95 %] and Sp of 97 % [97-98 %] with 75 % Se [74-76 %]. In the validation set these queries reached values of Se of 90 % [89-91 %] with Sp 94 % [93-95 %] and Se of 80 % [79-81 %] with Sp of 97 % [96-96 %], respectively. CONCLUSIONS: Narrow and broad search queries were developed which can help in retrieving literature on patient preferences for treatment outcomes. Identifying such evidence may in turn enhance the incorporation of patient preferences in clinical decision making and health technology assessment.

Complex health care interventions: Characteristics relevant for ethical analysis in health technology assessment.

Complexity entails methodological challenges in assessing health care interventions. In order to address these challenges, a series of characteristics of complexity have been identified in the Health Technology Assessment (HTA) literature. These characteristics are primarily identified and developed to facilitate effectiveness, safety, and cost-effectiveness analysis. However, ethics is also a constitutive part of HTA, and it is not given that the conceptions of complexity that appears relevant for effectiveness, safety, and cost-effectiveness analysis are also relevant and directly applicable for ethical analysis in HTA. The objective of this article is therefore to identify and elaborate a set of key characteristics of complex health care interventions relevant for addressing ethical aspects in HTA. We start by investigating the relevance of the characteristics of complex interventions, as defined in the HTA literature. Most aspects of complexity found to be important when assessing effectiveness, safety, and efficiency turn out also to be relevant when assessing ethical issues of a given health technology. However, the importance and relevance of the complexity characteristics may differ when addressing ethical issues rather than effectiveness. Moreover, the moral challenges of a health care intervention may themselves contribute to the complexity. After identifying and analysing existing conceptions of complexity, we synthesise a set of five key characteristics of complexity for addressing ethical aspects in HTA: 1) multiple and changing perspectives, 2) indeterminate phenomena, 3) uncertain causality, 4) unpredictable outcome, and 5) ethical complexity. This may serve as an analytic tool in addressing ethical issues in HTA of complex interventions.

Ethical analysis in HTA of complex health interventions.

BACKGROUND: In the field of health technology assessment (HTA), there are several approaches that can be used for ethical analysis. However, there is a scarcity of literature that critically evaluates and compares the strength and weaknesses of these approaches when they are applied in practice. In this paper, we analyse the applicability of some selected approaches for addressing ethical issues in HTA in the field of complex health interventions. Complex health interventions have been the focus of methodological attention in HTA. However, the potential methodological challenges for ethical analysis are as yet unknown. METHODS: Six of the most frequently described and applied ethical approaches in HTA were critically assessed against a set of five characteristics of complex health interventions: multiple and changing perspectives, indeterminate phenomena, uncertain causality, unpredictable outcomes, and ethical complexity. The assessments are based on literature and the authors' experiences of developing, applying and assessing the approaches. RESULTS: The Interactive, participatory HTA approach is by its nature and flexibility, applicable across most complexity characteristics. Wide Reflective Equilibrium is also flexible and its openness to different perspectives makes it better suited for complex health interventions than more rigid conventional approaches, such as Principlism and Casuistry. Approaches developed for HTA purposes are fairly applicable for complex health interventions, which one could expect because they include various ethical perspectives, such as the HTA Core Model® and the Socratic approach. CONCLUSION: This study shows how the applicability for addressing ethical issues in HTA of complex health interventions differs between the selected ethical approaches. Knowledge about these differences may be helpful when choosing and applying an approach for ethical analyses in HTA. We believe that the study contributes to increasing awareness and interest of the ethical aspects of complex health interventions in general.