Attribute Development in Health-Related Discrete Choice Experiments: A Systematic Review of Qualitative Methods and Techniques to Inform Quantitative Instruments.

OBJECTIVES: This review sought to identify the qualitative methods and techniques that researchers have used in the past decade to develop attributes and inform health-related discrete choice experiments (DCEs) surveys from a patient perspective. METHODS: The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines for reporting systematic reviews. An adapted appraisal tool following guidelines for reporting qualitative research for quantitative instruments and criteria for attribute development in DCEs was applied for quality assessment and data extraction. A narrative approach was used to synthesize data. This examination included consideration of issues pertaining to sampling, data collection, data analysis, attribute list reduction, wording, methodological adaptations to capture patient preferences, and testing the pre-experimental design decisions of the DCE survey. RESULTS: Of 8505 articles identified for abstract screening, 680 were included for full-text screening, 36 of which met the inclusion criteria. Practices to improve methodological robustness included pre-data collection materials to inform instruments, data collection methods specific for decision-making scenarios, purposeful selection of data analysis methods to address the research question, and participants' involvement in reducing the list of attributes. Examples of methodological adaptations for patients were noted. CONCLUSIONS: DCEs have the potential to become a mixed-method approach in which the qualitative phase informs a reduced list of attributes for a survey, serves the predesign decisions of the experiment by testing trade-offs, overlapping, understandability, face, and content validity and provides explanations of the quantitative results. Establishing guidelines for using qualitative methods for DCE attribute development may help to broadly enhance the methodological robustness of DCEs.

Prioritising deteriorating patients using time-to-event analysis: prediction model development and internal-external validation.

BACKGROUND: Binary classification models are frequently used to predict clinical deterioration, however they ignore information on the timing of events. An alternative is to apply time-to-event models, augmenting clinical workflows by ranking patients by predicted risks. This study examines how and why time-to-event modelling of vital signs data can help prioritise deterioration assessments using lift curves, and develops a prediction model to stratify acute care inpatients by risk of clinical deterioration. METHODS: We developed and validated a Cox regression for time to in-hospital mortality. The model used time-varying covariates to estimate the risk of clinical deterioration. Adult inpatient medical records from 5 Australian hospitals between 1 January 2019 and 31 December 2020 were used for model development and validation. Model discrimination and calibration were assessed using internal-external cross validation. A discrete-time logistic regression model predicting death within 24 h with the same covariates was used as a comparator to the Cox regression model to estimate differences in predictive performance between the binary and time-to-event outcome modelling approaches. RESULTS: Our data contained 150,342 admissions and 1016 deaths. Model discrimination was higher for Cox regression than for discrete-time logistic regression, with cross-validated AUCs of 0.96 and 0.93, respectively, for mortality predictions within 24 h, declining to 0.93 and 0.88, respectively, for mortality predictions within 1 week. Calibration plots showed that calibration varied by hospital, but this can be mitigated by ranking patients by predicted risks. CONCLUSION: Time-varying covariate Cox models can be powerful tools for triaging patients, which may lead to more efficient and effective care in time-poor environments when the times between observations are highly variable.

Implementing neurodevelopmental follow-up care for children with congenital heart disease: A scoping review with evidence mapping.

AIM: To identify and map evidence describing components of neurodevelopmental follow-up care for children with congenital heart disease (CHD). METHOD: This was a scoping review of studies reporting components of neurodevelopmental follow-up programmes/pathways for children with CHD. Eligible publications were identified through database searches, citation tracking, and expert recommendations. Two independent reviewers screened studies and extracted data. An evidence matrix was developed to visualize common characteristics of care pathways. Qualitative content analysis identified implementation barriers and enablers. RESULTS: The review included 33 studies. Twenty-one described individual care pathways across the USA (n = 14), Canada (n = 4), Australia (n = 2), and France (n = 1). The remainder reported surveys of clinical practice across multiple geographical regions. While heterogeneity in care existed across studies, common attributes included enrolment of children at high-risk of neurodevelopmental delay; centralized clinics in children's hospitals; referral before discharge; periodic follow-up at fixed ages; standardized developmental assessment; and involvement of multidisciplinary teams. Implementation barriers included service cost/resourcing, patient burden, and lack of knowledge/awareness. Multi-level stakeholder engagement and integration with other services were key drivers of success. INTERPRETATION: Defining components of effective neurodevelopmental follow-up programmes and care pathways, along with enhancing and expanding guideline-based care across regions and into new contexts, should continue to be priorities. WHAT THIS PAPER ADDS: Twenty-two different neurodevelopmental follow-up care pathways/programmes were published, originating from four countries. Twelve additional publications described broad practices for neurodevelopmental follow-up across regions Common attributes across eligibility, service structure, assessment processes, and care providers were noted. Studies reported programme acceptability, uptake, cost, and effectiveness. Implementation barriers included service cost/resourcing, patient burden, and lack of knowledge/awareness.

Impact of a prospective feedback loop aimed at reducing non-beneficial treatments in older people admitted to hospital and potentially nearing the end of life. A cluster stepped-wedge randomised controlled trial.

OBJECTIVES: To investigate if a prospective feedback loop that flags older patients at risk of death can reduce non-beneficial treatment at end of life. DESIGN: Prospective stepped-wedge cluster randomised trial with usual care and intervention phases. SETTING: Three large tertiary public hospitals in south-east Queensland, Australia. PARTICIPANTS: 14 clinical teams were recruited across the three hospitals. Teams were recruited based on a consistent history of admitting patients aged 75+ years, and needed a nominated lead specialist consultant. Under the care of these teams, there were 4,268 patients (median age 84 years) who were potentially near the end of life and flagged at risk of non-beneficial treatment. INTERVENTION: The intervention notified clinicians of patients under their care determined as at-risk of non-beneficial treatment. There were two notification flags: a real-time notification and an email sent to clinicians about the at-risk patients at the end of each screening day. The nudge intervention ran for 16-35 weeks across the three hospitals. MAIN OUTCOME MEASURES: The primary outcome was the proportion of patients with one or more intensive care unit (ICU) admissions. The secondary outcomes examined times from patients being flagged at-risk. RESULTS: There was no improvement in the primary outcome of reduced ICU admissions (mean probability difference [intervention minus usual care] = -0.01, 95% confidence interval -0.08 to 0.01). There were no differences for the times to death, discharge, or medical emergency call. There was a reduction in the probability of re-admission to hospital during the intervention phase (mean probability difference -0.08, 95% confidence interval -0.13 to -0.03). CONCLUSIONS: This nudge intervention was not sufficient to reduce the trial's non-beneficial treatment outcomes in older hospital patients. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry, ACTRN12619000675123 (registered 6 May 2019).

Preventing hospital falls: feasibility of care workforce redesign to optimise patient falls education.

OBJECTIVE: To examine the feasibility of using allied health assistants to deliver patient falls prevention education within 48 h after hospital admission. DESIGN AND SETTING: Feasibility study with hospital patients randomly allocated to usual care or usual care plus additional patient falls prevention education delivered by supervised allied health assistants using an evidence-based scripted conversation and educational pamphlet. PARTICIPANTS: (i) allied health assistants and (ii) patients admitted to participating hospital wards over a 20-week period. OUTCOMES: (i) feasibility of allied health assistant delivery of patient education; (ii) hospital falls per 1,000 bed days; (iii) injurious falls; (iv) number of falls requiring transfer to an acute medical facility. RESULTS: 541 patients participated (median age 81 years); 270 control group and 271 experimental group. Allied health assistants (n = 12) delivered scripted education sessions to 254 patients in the experimental group, 97% within 24 h after admission. There were 32 falls in the control group and 22 in the experimental group. The falls rate was 8.07 falls per 1,000 bed days in the control group and 5.69 falls per 1,000 bed days for the experimental group (incidence rate ratio = 0.66 (95% CI 0.32, 1.36; P = 0.26)). There were 2.02 injurious falls per 1,000 bed days for the control group and 1.03 for the experimental group. Nine falls (7 control, 2 experimental) required transfer to an acute facility. No adverse events were attributable to the experimental group intervention. CONCLUSIONS: It is feasible and of benefit to supplement usual care with patient education delivered by allied health assistants.

Rasch validation of the short form (8 item) PC-QoL questionnaire and applicability of use as a health state classification system for a new preference-based measure.

BACKGROUND: The parent-proxy paediatric chronic cough quality of life questionnaire (PC-QoL) is a commonly used measure of spillover quality of life in parents of children with chronic cough. To date, spillover health utility in these parents is not routinely estimated largely due to the lack of a suitable instrument. Their perspective is not included in economic evaluations of interventions for their children. We explored developing a health state classification system based on the PC-QoL for measuring health utility spill over in this population. METHODS: This study included PC-QoL 8-item responses of 653 parents participating in a prospective cohort study about paediatric chronic cough. Exploratory factor analysis (EFA) and Rasch analysis were used to examine dimensionality and select potential items and level structure. RESULTS: EFA indicated that the PC-QoL had one underlying domain. Rasch analysis indicated threshold disordering in all items which improved when items were collapsed from seven to four levels. Two demonstrated differential item functioning (DIF) by diagnosis or ethnicity and were excluded from the final scale. This scale satisfied Rasch assumptions of local independence and unidimensionality and demonstrated acceptable fit to the Rasch model. It was presented to and modified by an expert panel and a consumer panel. The resulting classification system had six items, each with four levels. DISCUSSION: The PC-QoL can conform to a Rasch model with minor modifications. It may be a good basis for the classification system of a child cough-specific PBM. A valuation study is required to estimate preference weights for each item and to estimate health utility in parents of children with chronic cough.

A scoping review of fall-risk screening tools in the Emergency Department for future falls in older adults.

Background Approximately one third of adults over the age of 65 experience falls annually, with half resulting in injury. Peak bodies have recommended the use of fall-risk screening tools in the emergency department (ED) to identify patients requiring in-depth assessment and potential fall-prevention intervention. This study aimed to examine the scope of published studies on fall-risk screening tools used in the ED, and evidence of associations between screening and future falls. Summary PubMed, Embase and CINAHL were searched for peer-reviewed journal articles published since 2012 that examined one or more screening tools to identify patient-level fall risk. Eligible studies described fall-risk tools applied in the ED. Data extracted included sample information, variables measured and statistical analysis. Sixteen studies published since 2012 were included after full-text review. Fourteen unique screening tools were found. Eight tools were fall-risk screening tools, one tool was a functional screening tool, one tool was a frailty screening tool, two tools were rapid physical tests, one tool was a trauma triage tool, and one tool was a component of a health-related quality of life measure. Studies that evaluated prognostic performance (n = 11) generally reported sensitivity higher than specificity. Previous falls (n = 10) and high-risk medications (n = 6) were consistently associated with future falls. Augmentation with additional variables from the electronic medical record (EMR) improved screening tool prognostic performance in one study. Key Messages Current evidence on the association between the use of fall-risk screening tools in the ED for future falls consistently identifies previous falls and high-risk medications as associated with future falls. Comparison between tools is difficult due to different evaluation methods and different covariates measured. Augmentation of fall-risk screening using the EMR in the ED requires further investigation.

Process evaluation of a tailored nudge intervention to promote appropriate care and treatment of older patients at the end-of-life.

BACKGROUND: Non-beneficial treatment affects a considerable proportion of older people in hospital, and some will choose to decline invasive treatments when they are approaching the end of their life. The Intervention for Appropriate Care and Treatment (InterACT) intervention was a 12-month stepped wedge randomised controlled trial with an embedded process evaluation in three hospitals in Brisbane, Australia. The aim was to increase appropriate care and treatment decisions for older people at the end-of-life, through implementing a nudge intervention in the form of a prospective feedback loop. However, the trial results indicated that the expected practice change did not occur. The process evaluation aimed to assess implementation using the Consolidated Framework for Implementation Research, identify barriers and enablers to implementation and provide insights into the lack of effect of the InterACT intervention. METHODS: Qualitative data collection involved 38 semi-structured interviews with participating clinicians, members of the executive advisory groups overseeing the intervention at a site level, clinical auditors, and project leads. Online interviews were conducted at two times: implementation onset and completion. Data were coded to the Consolidated Framework for Implementation Research and deductively analysed. RESULTS: Overall, clinicians felt the premise and clinical reasoning behind InterACT were strong and could improve patient management. However, several prominent barriers affected implementation. These related to the potency of the nudge intervention and its integration into routine clinical practice, clinician beliefs and perceived self-efficacy, and wider contextual factors at the health system level. CONCLUSIONS: An intervention designed to change clinical practice for patients at or near to end-of-life did not have the intended effect. Future interventions targeting this area of care should consider using multi-component strategies that address the identified barriers to implementation and clinician change of practice. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry (ANZCTR), ACTRN12619000675123p (approved 06/05/2019).

Navigating the challenges of imposter participants in online qualitative research: lessons learned from a paediatric health services study.

BACKGROUND: The growth in online qualitative research and data collection provides several advantages for health service researchers and participants, including convenience and extended geographic reach. However, these online processes can also present unexpected challenges, including instances of participant fraud or scam behaviour. This study describes an incident of participant fraud identified during online focus group discussions and interviews for a PhD health services research project on paediatric neurodevelopmental care. METHODS: We aimed to recruit carers of Australian children with neurodevelopmental disorders. Potential participants were recruited via a publicly available social media advert on Facebook offering $50 AUD compensation. Those who expressed interest via email (n = 254) were sent a pre-interview Qualtrics survey to complete. We identified imposters at an early stage via inconsistencies in their self-reported geographical location and that captured by the survey as well as recognition of suspicious actions before, during and after focus group discussions and interviews. RESULTS: Interest in participation was unexpectedly high. We determined that all potential participants were likely imposters, posing as multiple individuals and using different IP addresses across Nigeria, Australia, and the United States. In doing so, we were able to characterise several "red flags" for identifying imposter participants, particularly those posing as multiple individuals. These comprise a combination of factors including large volumes and strange timings of email responses, unlikely demographic characteristics, short or vague interviews, a preference for nonvisual participation, fixation on monetary compensation, and inconsistencies in reported geographical location. Additionally, we propose several strategies to combat this issue such as providing proof of location or eligibility during recruitment and data collection, examining email and consent form patterns, and comparing demographic data with regional statistics. CONCLUSIONS: The emergent risk of imposter participants is an important consideration for those seeking to conduct health services research using qualitative approaches in online environments. Methodological design choices intended to improve equity and access for the target population may have an unintended consequence of improving access for fraudulent actors unless appropriate risk mitigation strategies are also employed. Lessons learned from this experience are likely to be valuable for novice health service researchers involved in online focus group discussions and interviews.

Clinician perspectives and recommendations regarding design of clinical prediction models for deteriorating patients in acute care.

BACKGROUND: Successful deployment of clinical prediction models for clinical deterioration relates not only to predictive performance but to integration into the decision making process. Models may demonstrate good discrimination and calibration, but fail to match the needs of practising acute care clinicians who receive, interpret, and act upon model outputs or alerts. We sought to understand how prediction models for clinical deterioration, also known as early warning scores (EWS), influence the decision-making of clinicians who regularly use them and elicit their perspectives on model design to guide future deterioration model development and implementation. METHODS: Nurses and doctors who regularly receive or respond to EWS alerts in two digital metropolitan hospitals were interviewed for up to one hour between February 2022 and March 2023 using semi-structured formats. We grouped interview data into sub-themes and then into general themes using reflexive thematic analysis. Themes were then mapped to a model of clinical decision making using deductive framework mapping to develop a set of practical recommendations for future deterioration model development and deployment. RESULTS: Fifteen nurses (n = 8) and doctors (n = 7) were interviewed for a mean duration of 42 min. Participants emphasised the importance of using predictive tools for supporting rather than supplanting critical thinking, avoiding over-protocolising care, incorporating important contextual information and focusing on how clinicians generate, test, and select diagnostic hypotheses when managing deteriorating patients. These themes were incorporated into a conceptual model which informed recommendations that clinical deterioration prediction models demonstrate transparency and interactivity, generate outputs tailored to the tasks and responsibilities of end-users, avoid priming clinicians with potential diagnoses before patients were physically assessed, and support the process of deciding upon subsequent management. CONCLUSIONS: Prediction models for deteriorating inpatients may be more impactful if they are designed in accordance with the decision-making processes of acute care clinicians. Models should produce actionable outputs that assist with, rather than supplant, critical thinking.