Response shift in coronary artery disease.

PURPOSE: Patients with coronary artery disease (CAD) experience significant angina symptoms and lifestyle changes. Revascularization procedures can result in better patient-reported outcomes (PROs) than optimal medical therapy (OMT) alone. This study evaluates the impact of response shift (RS) on changes in PROs of patients with CAD across treatment strategies. METHODS: Data were from patients with CAD in the Alberta Provincial Project on Outcome Assessment in Coronary Heart Disease (APPROACH) registry who completed the 16-item Canadian version of the Seattle Angina Questionnaire at 2 weeks and 1 year following a coronary angiogram. Multi-group confirmatory factor analysis (MG-CFA) was used to assess measurement invariance across treatment groups at week 2. Longitudinal MG-CFA was used to test for RS according to receipt of coronary artery bypass grafting (CABG), percutaneous coronary intervention (PCI), or optimal medical therapy (OMT) alone. RESULTS: Of the 3116 patients included in the analysis, 443 (14.2%) received CABG, 2049(65.8%) PCI, and the remainder OMT alone. The MG-CFA revealed a partial-strong invariance across the treatment groups at 2 weeks (CFI = 0.98, RMSEA [90% CI] = 0.05 [0.03, 0.06]). Recalibration RS was detected on the Angina Symptoms and Burden subscale and its magnitude in the OMT, PCI, and CABG groups were 0.32, 0.28, and 0.53, respectively. After adjusting for RS effects, the estimated target changes were largest in the CABG group and negligible in the OMT group. CONCLUSION: Adjusting for RS is recommended in studies that use SAQ-CAN to assess changes in patients with CAD who have received revascularization versus OMT alone.

A protocol for the formative evaluation of the implementation of patient-reported outcome measures in child and adolescent mental health services as part of a learning health system.

BACKGROUND: Mental health conditions affect one in seven young people and research suggests that current mental health services are not meeting the needs of most children and youth. Learning health systems are an approach to enhancing services through rapid, routinized cycles of continuous learning and improvement. Patient-reported outcome measures provide a key data source for learning health systems. They have also been shown to improve outcomes for patients when integrated into routine clinical care. However, implementing these measures into health systems is a challenging process. This paper describes a protocol for a formative evaluation of the implementation of patient-reported measures in a newly operational child and adolescent mental health centre in Calgary, Canada. The purpose is to optimize the collection and use of patient-reported outcome measures. Our specific objectives are to assess the implementation progress, identify barriers and facilitators to implementation, and explore patient, caregivers and clinician experiences of using these measures in routine clinical care. METHODS: This study is a mixed-methods, formative evaluation using the Consolidated Framework for Implementation Research. Participants include patients and caregivers who have used the centre's services, as well as leadership, clinical and support staff at the centre. Focus groups and semi-structured interviews will be conducted to assess barriers and facilitators to the implementation and sustainability of the use of patient-reported outcome measures, as well as individuals' experiences with using these measures within clinical care. The data generated by the patient-reported measures over the first five months of the centre's operation will be analyzed to understand implementation progress, as well as validity of the chosen measures for the centres' population. DISCUSSION: The findings of this evaluation will help to identify and address the factors that are affecting the successful implementation of patient-reported measures at the centre. They will inform the co-design of strategies to improve implementation with key stakeholders, which include patients, clinical staff, and leadership at the centre. To our knowledge, this is the first study of the implementation of patient-reported outcome measures in child and adolescent mental health services and our findings can be used to enhance future implementation efforts in similar settings.

Co-building a training programme to facilitate patient, family and community partnership on research grants: A patient-oriented research project.

INTRODUCTION: Patient engagement in patient-oriented research (POR) is described as patients collaborating as active and equal research team members (patient research partners [PRPs]) on the health research projects and activities that matter to them. The Canadian Institutes of Health Research (CIHR), Canada's federal funding agency for health research, asks that patients be included as partners early, often and at as many stages of the health research process as possible. The objective of this POR project was to co-build an interactive, hands-on training programme that could support PRPs in understanding the processes, logistics and roles of CIHR grant funding applications. We also conducted a patient engagement evaluation, capturing the experiences of the PRPs in co-building the training programme. METHODS: This multiphased POR study included a Working Group of seven PRPs with diverse health and health research experiences and two staff members from the Patient Engagement Team. Seven Working Group sessions were held over the 3-month period from June to August 2021. The Working Group worked synchronously (meeting weekly online via Zoom) as well as asynchronously. A patient engagement evaluation was conducted after the conclusion of the Working Group sessions using a validated survey and semi-structured interviews. Survey data were analysed descriptively and interview data were analysed thematically. RESULTS: The Working Group co-built and co-delivered the training programme about the CIHR grant application process for PRPs and researchers in five webinars and workshops. For the evaluation of patient engagement within the Working Group, five out of seven PRPs completed the survey and four participated in interviews. From the survey, most PRPs agreed/strongly agreed to having communication and supports to engage in the Working Group. The main themes identified from the interviews were working together-communication and supports; motivations for joining and staying; challenges to contributing; and impact of the Working Group. CONCLUSION: This training programme supports and builds capacity for PRPs to understand the grant application process and offers ways by which they can highlight the unique experience and contribution they can bring to each project. Our co-build process presents an example and highlights the need for inclusive approaches, flexibility and individual thinking and application. PATIENT OR PUBLIC CONTRIBUTION: The objective of this project was to identify the aspects of the CIHR grant funding application that were elemental to having PRPs join grant funding applications and subsequently funded projects, in more active and meaningful roles, and then to co-build a training programme that could support PRPs to do so. We used the CIHR SPOR Patient Engagement Framework, and included time and trust, in our patient engagement approaches to building a mutually respectful and reciprocal co-learning space. Our Working Group included seven PRPs who contributed to the development of a training programme. We suggest that our patient engagement and partnership approaches, or elements of, could serve as a useful resource for co-building more PRP-centred learning programmes and tools going forward.

Health related quality of life during dialysis modality transitions: a qualitative study.

BACKGROUND: Modality transitions represent a period of significant change that can impact health related quality of life (HRQoL). We explored the HRQoL of adults transitioning to new or different dialysis modalities. METHODS: We recruited eligible adults (≥ 18) transitioning to dialysis from pre-dialysis or undertaking a dialysis modality change between July and September 2017. Nineteen participants (9 incident and 10 prevalent dialysis patients) completed the KDQOL-36 survey at time of transition and three months later. Fifteen participants undertook a semi-structured interview at three months. Qualitative data were thematically analyzed. RESULTS: Four themes and five sub-themes were identified: adapting to new circumstances (tackling change, accepting change), adjusting together, trading off, and challenges of chronicity (the impact of dialysis, living with a complex disease, planning with uncertainty). From the first day of dialysis treatment to the third month on a new dialysis therapy, all five HRQoL domains from the KDQOL-36 (symptoms, effects, burden, overall PCS, and overall MCS) improved in our sample (i.e., those who remained on the modality). CONCLUSIONS: Dialysis transitions negatively impact the HRQoL of people with kidney disease in various ways. Future work should focus on how to best support people during this time.

Uptake of pediatric patient-reported outcome and experience measures and challenges associated with their implementation in Alberta: a mixed-methods study.

BACKGROUND: Implementing Patient-reported Outcome Measures (PROMs) and Patient-reported Experience Measures (PREMs) is an effective way to deliver patient- and family-centered care (PFCC). Although Alberta Health Services (AHS) is Canada's largest and fully integrated health system, PROMs and PREMs are yet to be routinely integrated into the pediatric healthcare system. This study addresses this gap by investigating the current uptake, barriers, and enablers for integrating PROMs and PREMs in Alberta's pediatric healthcare system. METHODS: Pediatric clinicians and academic researchers with experience using PROMs and PREMs were invited to complete a quantitative survey. Additionally, key stakeholders were qualitatively interviewed to understand current challenges in implementing pediatric PROMs and PREMs within AHS. Quantitative data gathered from 22 participants were descriptively analyzed, and qualitative data from 14 participants were thematically analyzed. RESULTS: Participants identified 33 PROMs and 6 PREMs showing diversity in the types of pediatric PROMs and PREMs currently being used in Alberta and their mode of administration. The qualitatively identified challenges were associated with patients, family caregivers, and clinicians. The absence of system-level support, such as integration within electronic medical records, is considered a significant system-level challenge. CONCLUSIONS: The significant variation in the types of PROMs and PREMs used, the rationale for their use, and their mode of administration demonstrate the diverse and sporadic use of these measures in Alberta. These findings highlight the need for province-wide uniform implementation of pediatric PROMs and PREMs in Alberta. Our results could benefit healthcare organizations in developing evidence-based PROM and PREM implementation strategies in pediatrics.

Measurement invariance of the Seattle Angina Questionnaire in coronary artery disease.

PURPOSE: The Seattle Angina Questionnaire (SAQ) is a widely used patient-reported measure of health status in patients with coronary artery disease. Comparisons of SAQ scores amongst population groups and over time rely on the assumption that its factorial structure is invariant. This study evaluates the measurement invariance of the SAQ across different demographic and clinical groups and over time. METHODS: Data were obtained from the Alberta Provincial Project on Outcome Assessment in Coronary Heart Disease registry, a registry of patients who received coronary angiogram in Alberta, Canada. The study cohort consists of adult patients who completed the paper-based version of the 16-item Canadian version of the SAQ (SAQ-CAN) 2 weeks and 1-year post-coronary angiogram between 2009 and 2016. Multi-group confirmatory factor analysis was used to assess configural, weak, strong, and strict measurement invariance across age groups, sex, angina type, treatment, and over time. Model fit was assessed using the comparative fit index and root mean square error of approximation. RESULTS: Of the 8101 patients included in these analysis, 1300 (16.1%) were at least 75 years old, while 1755 (21.7%) were female, 5154 (63.6%) were diagnosed with acute coronary syndrome, 1177 (14.5%) received coronary artery bypass graft treatment, and 3279 had complete data on the SAQ-CAN at both occasions. There was evidence of strict invariance across age, sex, and angina type, and treatment groups, but partial strict invariance was established over time. CONCLUSION: SAQ-CAN can be used to compare the health status of coronary artery disease patients across population groups and over time.

Codesigning person-centred quality indicators with diverse communities: A qualitative patient engagement study.

INTRODUCTION: Effective engagement of underrepresented communities in health research and policy remains a challenge due to barriers that hinder participation. Our study had two objectives: (1) identify themes of person-centred care (PCC) from perspectives of diverse patients/caregivers that would inform the development of person-centred quality indicators (PC-QIs) for evaluating the quality of PCC and initiatives to improve PCC and (2) explore innovative participatory approaches to engage ethnocultural communities in qualitative research. METHODS: Drawing on participatory action research methods, we partnered with a community-based organization to train six 'Community Brokers' from the Chinese, Filipino, South Asian, Latino-Hispanic, East African and Syrian communities, who were engaged throughout the study. We also partnered with the provincial health organization to engage their Patient and Family Advisory, who represented further aspects of diversity. We conducted focus group discussions with patients/caregivers to obtain their perspectives on their values, preferences and needs regarding PCC. We identified themes through our study and engaged provincial stakeholders to prioritize these themes for informing the development of PC-QIs and codesign initiatives for improving PCC. RESULTS: Eight focus groups were conducted with 66 diverse participants. Ethnocultural communities highlighted themes related to access and cost of care, language barriers and culture, while the Patient and Family Advisory emphasized patient and caregiver engagement. Together with provincial stakeholders, initiatives were identified to improve PCC, such as codesigning innovative models of training and evaluation of healthcare providers. CONCLUSION: Incorporating patient and community voices requires addressing issues related to equity and understanding barriers to effective and meaningful engagement. PATIENT OR PUBLIC CONTRIBUTION: Patient and public engagement was central to our research study. This included partnership with a community-based organization, with a broad network of ethnocultural communities, as well as the provincial health service delivery organization, who both facilitated the ongoing engagement of diverse patients/caregiver communities throughout our study including designing the study, recruiting participants, collecting and organizing data, interpreting findings and mobilizing knowledge. Drawing from participatory action research methods, patients and the public were involved in the codesign of the PC-QIs and initiatives to improve PCC in the province based on the findings from our study.

Including the voice of paediatric patients: Cocreation of an engagement game.

BACKGROUND: Engaging patients in health care, research and policy is essential to improving patient-important health outcomes and the quality of care. Although the importance of patient engagement is increasingly acknowledged, clinicians and researchers still find it difficult to engage patients, especially paediatric patients. To facilitate the engagement of children and adolescents in health care, the aim of this project is to develop an engagement game. METHODS: A user-centred design was used to develop a patient engagement game in three steps: (1) identification of important themes for adolescents regarding their illness, treatment and hospital care, (2) evaluation of the draft version of the game and (3) testing usability in clinical practice. Adolescents (12-18 years) were engaged in all steps of the development process through focus groups, interviews or a workshop. These were audio-recorded, transcribed verbatim and analysed in MAXQDA. RESULTS: (1) The important themes for adolescents (N = 15) were included: visiting the hospital, participating, disease and treatment, social environment, feelings, dealing with staff, acceptation, autonomy, disclosure and chronically ill peers. (2) Then, based on these themes, the engagement game was developed and the draft version was evaluated by 13 adolescents. Based on their feedback, changes were made to the game (e.g., adjusting the images and changing the game rules). (3) Regarding usability, the pilot version was evaluated positively. The game helped adolescents to give their opinion. Based on the feedback of adolescents, some last adjustments (e.g., changing colours and adding a game board) were made, which led to the final version of the game, All Voices Count. CONCLUSIONS: Working together with adolescents, All Voices Count, a patient engagement game was developed. This game provides clinicians with a tool that supports shared decision-making to address adolescents' wishes and needs. PATIENT OR PUBLIC CONTRIBUTION: Paediatric patients, clinicians, researchers, youth panel of Fonds NutsOhra and patient associations (Patient Alliance for Rare and Genetic Diseases, Dutch Childhood Cancer Organization) were involved in all phases of the development of the patient engagement game-from writing the project plan to the final version of the game.

A multi-step approach to developing a health system evaluation framework for community-based health care.

BACKGROUND: Community-based health care (CBHC) is a shift towards healthcare integration and community services closer to home. Variation in system approaches harkens the need for a conceptual framework to evaluate outcomes and impacts. We set out to develop a CBHC-specific evaluation framework in the context of a provincial ministry of health planning process in Canada. METHODS: A multi-step approach was used to develop the CBHC evaluation framework. Modified Delphi informed conceptualization and prioritization of indicators. Formative research identified evaluation framework elements (triple aim, global measures, and impact), health system levels (tiers), and potential CBHC indicators (n = 461). Two Delphi rounds were held. Round 1, panelists independently ranked indicators on CBHC relevance and health system tiering. Results were analyzed by coding agreement/disagreement frequency and central tendency measures. Round 2, a consensus meeting was used to discuss disagreement, identify Tier 1 indicators and concepts, and define indicators not relevant to CBHC (Tier 4). Post-Delphi, indicators and concepts were refined, Tier 1 concepts mapped to the evaluation framework, and indicator narratives developed. Three stakeholder consultations (scientific, government, and public/patient communities) were held for endorsement and recommendation. RESULTS: Round 1 Delphi results showed agreement for 300 and disagreement for 161 indicators. Round 2 consensus resulted in 103 top tier indicators (Tier 1 = 19, Tier 2 = 84), 358 bottom Tier 3 and 4 indicators, non-CBHC measure definitions, and eight Tier 1 indicator concepts-Mortality/Suicide; Quality of Life, and Patient Reported Outcome Measures; Global Patient Reported Experience Measures; Cost of Care, Access to Integrated Primary Care; Avoidable Emergency Department Use; Avoidable Hospitalization; and E-health Penetration. Post Delphi results refined Tier 3 (n = 289) and 4 (n = 69) indicators, and identified 18 Tier 2 and 3 concepts. When mapped to the evaluation framework, Tier 1 concepts showed full coverage across the elements. 'Indicator narratives' depicted systemness and integration for evaluating CBHC. Stakeholder consultations affirmed endorsement of the approach and evaluation framework; refined concepts; and provided key considerations to further operationalize and contextualize indicators, and evaluate CBHC as a health system approach. CONCLUSIONS: This research produced a novel evaluation framework to conceptualize and evaluate CBHC initiatives. The evaluation framework revealed the importance of a health system approach for evaluating CBHC.

Using implementation science to inform the integration of electronic patient-reported experience measures (ePREMs) into healthcare quality improvement: description of a theory-based application in primary care.

BACKGROUND: Collecting and monitoring the information from patients through patient-reported experience measures (PREMs) about the quality of care they receive is important for tracking changes in healthcare quality, stimulate innovation, and enhance person-centred care. The objective of this theoretical paper is to discuss the use of implementation science theories, models, and frameworks to inform and evaluate the integration of the electronic collection of PREMs (ePREMs) in healthcare quality improvement for primary care in Canada. METHODS: To assess potential knowledge-to-practice gaps in implementing ePREMs in primary care in Alberta, the overarching implementation model that will be used is the Knowledge to Action Cycle. An integrated knowledge translation approach will ensure ongoing engagement of key stakeholders (e.g. primary care providers, patients) throughout the study. ePREM implementation will be informed by the identification of barriers and facilitators to implementation using the Consolidated Framework for Implementation Research (CFIR). The CFIR brings an organizational perspective providing an opportunity to explore the intervention characteristics, the context of implementation, individual factors, and the processes that influence implementation of ePREMs in healthcare. Identified barriers and facilitators to ePREM implementation will be mapped to evidence-based implementation strategies and prioritized by stakeholders. The RE-AIM framework will be used to guide the evaluation of ePREM implementation outcomes after six months of implementation by assessing Reach, Effectiveness, Adoption, Implementation, and Maintenance (sustainability). DISCUSSION: Consultations with stakeholders affirm the importance of using integrated knowledge translation approaches and the need to better understand how to integrate ePREMs in primary care. Using an implementations science approach, this study can provide guidance for mitigating important ePREM implementation challenges and promote the successful uptake and use of ePREMs for quality improvement in healthcare.

Sexual Activity After Acute Coronary Syndrome: A Qualitative Approach to Patient and Partner Experiences.

BACKGROUND: Little is known about how best to support both patients and their partners in the reengagement of sexual activity (SA) after acute coronary syndrome (ACS), with sparse direct data from the partner on their needs and concerns in the area of SA support. OBJECTIVES: We undertook a qualitative study to address this gap in the literature through 3 objectives from a patient and partner perspective: (1) to characterize the experience of reengaging in SA post ACS, (2) to identify needs and priorities in the area of SA support post ACS, and (3) to determine whether cardiac rehabilitation (CR) could be an acceptable point of intervention for SA support. METHODS: Semistructured qualitative interviews were conducted with 6 male patients who were post ACS and their partners (age range, 47-81 years). Patients were criterion sampled from the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease database. Inductive thematic data analysis was conducted. RESULTS: Four themes were identified: "importance," "support received," "on their own," and "wanting support." Couples reaffirmed the importance of SA pre and post ACS, reported SA support as currently insufficient but articulated ways it could be improved, and reported CR as a current source of SA support but thought there could be room for improvement on the content and delivery of such information. CONCLUSIONS: This study illustrates the potential value of promoting SA support for both patients who are post ACS and their partners and reports that SA support provided at CR would be viewed as important, needed, and acceptable.

Psychometric evaluation of a Canadian version of the Seattle Angina Questionnaire (SAQ-CAN).

BACKGROUND: The Seattle Angina Questionnaire (SAQ) is a widely-used patient-reported outcomes measure in patients with heart disease. This study assesses the validity and reliability of the SAQ in a Canadian cohort of individuals with stable angina. METHODS AND RESULTS: Data are from the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease (APPROACH) registry, a population-based registry of patients who received cardiac catheterization in Alberta, Canada. The cohort consists of 4052 patients undergoing cardiac catheterization for stable angina and completed the SAQ within 2 weeks. Exploratory factor analysis and confirmatory factor analysis (CFA) were used to assess the factorial structure of the SAQ. Internal and test-retest reliabilities of a new measure (i.e., SAQ-CAN) was measured using Cronbach α and intraclass correlation coefficient, respectively. CFA model fit was assessed using the root mean square error of approximation (RMSEA) and comparative fit index (CFI). Construct validity of the SAQ-CAN was assessed in relation to Hospital Anxiety and Depression Scales (HADS), Euro Quality of life 5 dimension (EQ5D), and original SAQ. Of the 4052 patients included in this analysis, 3281 (80.97%) were younger than 75 years old, while 3239 (79.94%) were male. Both exploratory and confirmatory factor analyses revealed a four-factorial structure consisting of 16 items that provided a better fit to the data (RMSEA = 0.049 [90% CI = (0.047, 0.052)]; CFI = 0.975). The 16-item SAQ demonstrated good to excellent internal reliability (Cronbach's α range from 0.77 to 0.90), moderate to strong correlation with the Original SAQ and EQ5D but negligible correlations with HADS. CONCLUSION: The SAQ-CAN has acceptable psychometric properties that are comparable to the original SAQ. We recommend its use for assessing coronary health outcomes in Canadian patients with Coronary Artery Disease.

Patient-reported outcome measures within pediatric solid organ transplantation: A systematic review.

Subjective evaluation of medical care and disease outcomes from patients' perspectives has become increasingly important. Patient-reported outcome measures (PROMs) play a prominent role in engaging patients, capturing their experiences and improving patient care. This systematic review sought to identify PROMs that are used in the field of pediatric solid organ transplantation, with the aim to inform the implementation of PROMs into clinical practice for this population. A systematic review of English language, peer-reviewed articles was performed on key health science databases to identify publications using PROMs in pediatric solid organ transplantation. The search yielded 3670 articles, with a final data set of 62 articles that included 47 different PROMs. The three most frequently used PROMs included the following: (a) PedsQL™ Generic Core Scales (n = 25); (b) Children's Depression Inventory (n = 6); and (c) Child Health Questionnaire (n = 6). Of the 47 PROMs, 42 were generic and five were disease-specific; only six PROMS had a documented psychometric evaluation within a pediatric solid organ transplant population. This review outlines the attributes of the instruments (eg, domains captured), as well as the psychometric properties of those evaluated. PROMs are increasingly used in the field of pediatric transplantation; however, there are limited details in the current literature about their conceptual underpinnings and psychometric properties. This review highlights the need for additional psychometric evaluation of identified measures to establish the necessary foundation to inform the implementation of PROMs into clinical care for pediatric solid organ transplant patients.

How to practice person-centred care: A conceptual framework.

BACKGROUND: Globally, health-care systems and organizations are looking to improve health system performance through the implementation of a person-centred care (PCC) model. While numerous conceptual frameworks for PCC exist, a gap remains in practical guidance on PCC implementation. METHODS: Based on a narrative review of the PCC literature, a generic conceptual framework was developed in collaboration with a patient partner, which synthesizes evidence, recommendations and best practice from existing frameworks and implementation case studies. The Donabedian model for health-care improvement was used to classify PCC domains into the categories of "Structure," "Process" and "Outcome" for health-care quality improvement. DISCUSSION: The framework emphasizes the structural domain, which relates to the health-care system or context in which care is delivered, providing the foundation for PCC, and influencing the processes and outcomes of care. Structural domains identified include: the creation of a PCC culture across the continuum of care; co-designing educational programs, as well as health promotion and prevention programs with patients; providing a supportive and accommodating environment; and developing and integrating structures to support health information technology and to measure and monitor PCC performance. Process domains describe the importance of cultivating communication and respectful and compassionate care; engaging patients in managing their care; and integration of care. Outcome domains identified include: access to care and Patient-Reported Outcomes. CONCLUSION: This conceptual framework provides a step-wise roadmap to guide health-care systems and organizations in the provision PCC across various health-care sectors.

The use of cognitive interviews to revise the Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM).

PURPOSE: The "Quality of Trauma Care Patient-Reported Experience Measure" is the first measure of patient experiences with overall injury care. The objective of this study was to use cognitive interviews to inform revision of the measure into a parsimonious set of items that function as intended, in preparation for multicenter testing. METHODS: Concurrent and retrospective cognitive interviews with injured patients (n = 17) and family members (n = 13) using semi-structured interview guides. Responses were analyzed using thematic analysis. RESULTS: Six broad themes were identified and guided revisions: (1) participants did not have the information to answer items (n = 9); (2) items were ambiguous or were inconsistently interpreted (n = 13); (3) items did not measure the intended constructs (n = 6); (4) items included assumptions about healthcare processes (n = 4); (5) items measured non-priority aspects of injury care (n = 8); and (6) items were redundant (n = 5). Two issues resulted in key conceptual and content changes: participants' difficulty to evaluate pre-hospital, emergency department, and intensive care unit services due to recall issues and the challenge to evaluate the effectiveness and equity of care. In total, 39 items were deleted, 28 new items developed, and the final instrument included 63 items. CONCLUSIONS: Our results informed changes to item content, format, and response options. This study highlights key issues to consider when incorporating patient/family perspectives into quality measurement, most notably, that few participants can assess the quality of care in the pre-hospital and emergency department phases of care and that novel methods are needed to evaluate the effectiveness and equity of care.

Training clinicians in how to use patient-reported outcome measures in routine clinical practice.

INTRODUCTION: Patient-reported outcome measures (PROs) were originally developed for comparing groups of people in clinical trials and population studies, and the results were used to support treatment recommendations or inform health policy, but there was not direct benefit for the participants providing PROs data. However, as the experience in using those measures increased, it became obvious the clinical value in using individual patient PROs profiles in daily practice to identify/monitor symptoms, evaluate treatment outcomes and support shared decision-making. A key issue limiting successful implementation is clinicians' lack of knowledge on how to effectively utilize PROs data in their clinical encounters. METHODS: Using a change management theoretical framework, this paper describes the development and implementation of three programs for training clinicians to effectively use PRO data in routine practice. The training programs are in three diverse clinical areas (adult oncology, lung transplant and paediatrics), in three countries with different healthcare systems, thus providing a rare opportunity to pull out common approaches whilst recognizing specific settings. For each program, we describe the clinical and organizational setting, the program planning and development, the content of the training session with supporting material, subsequent monitoring of PROs use and evidence of adoption. The common successful components and practical steps are identified, leading to discussion and future recommendations. RESULTS: The results of the three training programs are described as the implementation. In the oncology program, PRO data have been developed and are currently evaluated; in the lung transplant program, PRO data are used in daily practice and the integration with electronic patient records is under development; and in the paediatric program, PRO data are fully implemented with around 7,600 consultations since the start of the implementation. CONCLUSION: Adult learning programs teaching clinicians how to use and act on PROs in clinical practice are a key steps in supporting patient engagement and participation in shared decision-making. Researchers and clinicians from different clinical areas should collaborate to share ideas, develop guidelines and promote good practice in patient-centred care.

Development and evaluation of evidence-informed quality indicators for adult injury care.

OBJECTIVE: To develop and evaluate evidence-informed quality indicators of adult injury care. BACKGROUND: Injury is a leading cause of morbidity and mortality, but there is a lack of consensus regarding how to evaluate injury care. METHODS: Using a modification of the RAND/UCLA Appropriateness Methodology, a panel of 19 injury and quality of care experts serially rated and revised quality indicators identified from a systematic review of the literature and international audit of trauma center quality improvement practices. The quality indicators developed by the panel were sent to 133 verified trauma centers in the United States, Canada, Australia, and New Zealand for evaluation. RESULTS: A total of 84 quality indicators were rated and revised by the expert panel over 4 rounds of review producing 31 quality indicators of structure (n=5), process (n=21), and outcome (n=5), designed to assess the safety (n=8), effectiveness (n=17), efficiency (n=6), timeliness (n=16), equity (n=2), and patient-centeredness (n=1) of injury care spanning prehospital (n=8), hospital (n=19), and posthospital (n=2) care and secondary injury prevention (n=1). A total of 101 trauma centers (76% response rate) rated the indicators (1=strong disagreement, 9=strong agreement) as targeting important health improvements (median score 9, interquartile range [IQR] 8-9), easy to interpret (median score 8, IQR 8-9), easy to implement (median score 8, IQR 7-8), and globally good indicators (median score 8, IQR 8-9). CONCLUSIONS: Thirty-one evidence-informed quality indicators of adult injury care were developed, shown to have content validity, and can be used as performance measures to guide injury care quality improvement practices.

Enhancing informed consent through multimedia tools in pediatric spinal surgery: a comprehensive review.

Pediatric spine surgery is a high complexity procedure that can carry risks ranging from pain to neurological damage, and even death. This comprehensive mini review explores current best practice obtaining valid and meaningful informed consent (IC) prior to pediatric spinal surgery, including modalities that support effective comprehension and understanding. An evaluation of the literature was performed to explore understanding of surgical IC by patients or their guardians and the role of multimedia tools as a possible facilitator. The evidence discussed throughout this review, based on legal and ethical perspectives, reveals challenges faced by patients and guardians in achieving comprehension and understanding, especially when facing stressful medical situations. In this context, the introduction of multimedia tools emerges as a patient-centered strategy to help improve comprehension and decrease pre-operative uncertainty. This review highlights the need for a tailored approach in obtaining IC for pediatric patients and suggests a potential role of shared decision-making (SDM) in the surgical discussion process.

A scoping review of decision-making tools to support substitute decision-makers for adults with impaired capacity.

BACKGROUND: Substitute decision-makers (SDMs) make decisions that honor medical, personal, and end-of-life wishes for older adults who have lost capacity, including those with dementia. However, SDMs often lack support, information, and problem-solving tools required to make decisions and can suffer with negative emotional, relationship, and financial impacts. The need for adaptable supports has been identified in prior meta-analyses. This scoping review identifies evidence-based decision-making resources/tools for SDMs, outlines domains of support, and determines resource/tool effectiveness and/or efficacy. METHODS: The scoping review used the search strategy: Population-SDMs for older adults who have lost decision-making capacity; Concept-supports, resources, tools, and interventions; Context-any context where a decision is made on behalf of an adult (>25 years). Databases included MEDLINE, Embase, CINAHL, PsycINFO, and Abstracts in Social Gerontology and SocIndex. Tools were scored by members on the research team, including patient partners, based on domains of need previously identified in prior meta-analyses. RESULTS: Two reviewers independently screened 5279 citations. Articles included studies that evaluated a resource/tool that helped a family/friend/caregiver SDMs outside of an ICU setting. 828 articles proceeded onto full-text screening, and 25 articles were included for data extraction. The seventeen tools identified focused on different time points/decisions in the dementia trajectory, and no single tool encompassed all the domains of caregiver decision-making needs. CONCLUSION: Existing tools may not comprehensively support caregiver needs. However, combining tools into a toolkit and considering their application relevant to the caregiver's journey may start to address the gap in current supports.

Measuring the Impact of Patient Engagement in Health Research: An Exploratory Study Using Multiple Survey Tools.

Background: Studies report various ways in which patients are involved in research design and conduct. Limited studies explore the influence of patient engagement (PE) at each research stage in qualitative research from the perspectives of all stakeholders. Methods: We established two small research groups, a Patient Researcher-Led Group and an Academic Researcher-Led Group. We recruited patient research partners (PRP; n = 5), researchers (n = 5), and clinicians (n = 4) to design and conduct qualitative research aimed at identifying candidate attributes related to patient preferences for tapering biologic treatments in inflammatory bowel disease. We administered surveys before starting, two months into, and post-project work. The surveys contained items from three PE evaluation tools. We assessed the two groups regarding the influence and impact each stakeholder had during the different research stages. Results: PRPs had a moderate or a great deal of influence on the critical research activities across the research stages. They indicated moderate/very/extremely meaningful engagement and agreed/strongly agreed impact of PE. PRPs helped operationalize the research question; design the study and approach; develop study materials; recruit participants; and collect and interpret the data. Conclusion: The three tools together provide deeper insight into the influence of PE at each research stage. Lessons learnt from this study suggest that PE can impact many aspects of research including the design, process, and approach in the context of qualitative research, increasing the patient-centeredness of the study. More comprehensive validated tools are required that work with a more diverse subject pool and in other contexts.