Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions.

In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to enhance the beneficial effects of ROM and feedback. In this article, we summarize trends and recent advances in the research on this topic and identify several essential directions for the field in the short to medium term. We anticipate a broadening of research from the focus on average effects to greater specificity around what kinds of feedback, provided at what time, to which individuals, in what settings, are most beneficial. We also propose that the field needs to focus on issues of health equity, ensuring that ROM can be a vehicle for increased wellbeing for those who need it most. The complexity of mental healthcare systems means that there may be multiple viable measurement solutions with varying costs and benefits to diverse stakeholders in different treatment contexts, and research is needed to identify the most influential components in each of these contexts.

Procedure-based assessment for laparoscopic cholecystectomy can replace global rating scales.

INTRODUCTION: Global rating scales (GRSs) such as the Objective Structured Assessment of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Surgery (GOALS) are assessment methods for surgical procedures. The aim of this study was to establish construct validity of Procedure-Based Assessment (PBA) and to compare PBA with GRSs for laparoscopic cholecystectomy. MATERIAL AND METHODS: OSATS and GOALS GRSs were compared with PBA in their ability to discriminate between levels of performance between trainees who can perform the procedure independently and those who cannot. Three groups were formed based on the number of procedures performed by the trainee: novice (1-10), intermediate (11-20) and experienced (>20). Differences between groups were assessed using the Kruskal-Wallis and Mann-Whitney U tests. RESULTS: Increasing experience correlated significantly with higher GRSs and PBA scores (all p < .001). Scores of novice and intermediate groups overlapped substantially on the OSATS (p = .1) and GOALS (p = .1), while the PBA discriminated between these groups (p = .03). The median score in the experienced group was higher with less dispersion for PBA (97.2[85.3-100]) compared to OSATS (82.1[60.7-100]) and GOALS (80[60-100]). CONCLUSION: For assessing skill level or the capability of performing a laparoscopic cholecystectomy independently, PBA has a higher discriminative ability compared to the GRSs.

Cost-effectiveness of feedback-informed psychological treatment: Evidence from the IAPT-FIT trial.

BACKGROUND: Feedback-informed treatment (FIT) involves using computerized routine outcome monitoring technology to alert therapists to cases that are not responding well to psychotherapy, prompting them to identify and resolve obstacles to improvement. In this study, we present the first health economic evaluation of FIT, compared to usual care, to enable decision makers to judge whether this approach represents a good investment for health systems. METHODS: This randomised controlled trial included 2233 patients clustered within 77 therapists who were randomly assigned to a FIT group (n = 1176) or a usual care control group (n = 1057). Treatment response was monitored using patient-reported depression (PHQ-9) and anxiety (GAD-7) measures. Therapists in the FIT group had access to a computerized algorithm that alerted them to cases that were "not on track", compared to normative clinical data. Health service costs included the cost of training therapists to use FIT and the cost of therapy sessions in each arm. The incremental cost-effectiveness of FIT was assessed relative to usual care, using multilevel modelling. RESULTS: FIT was associated with an increased probability of reliable symptomatic improvement by 8.09 percentage points (95% CI: 4.16%-12.03%) which was statistically significant. The incremental cost of FIT was £15.17 (95% CI: £6.95 to £37.29) per patient and was not statistically significant. The incremental cost-effectiveness ratio (ICER) per additional case of reliable improvement was £187.4 (95% CI: £126.7 to £501.5); this confidence interval shows that the relative cost-effectiveness is between FIT being a dominant strategy (i.e. more effective and also cost-saving) to FIT being more effective at a modest incremental cost to the health system. CONCLUSIONS: The FIT strategy increases the probability of reliable improvement in routine clinical practice and may be associated with a small (but uncertain) incremental cost. FIT is likely to be a cost-effective strategy for mental health services.

Feedback-informed treatment versus usual psychological treatment for depression and anxiety: a multisite, open-label, cluster randomised controlled trial.

BACKGROUND: Previous research suggests that the use of outcome feedback technology can enable psychological therapists to identify and resolve obstacles to clinical improvement. We aimed to assess the effectiveness of an outcome feedback quality assurance system applied in stepped care psychological services. METHODS: This multisite, open-label, cluster randomised controlled trial was done at eight National Health Service (NHS) Trusts in England, involving therapists who were qualified to deliver evidence-based low-intensity or high-intensity psychological interventions. Adult patients (18 years or older) who accessed individual therapy with participating therapists were eligible for inclusion, except patients who accessed group therapies and those who attended less than two individual therapy sessions. Therapists were randomly assigned (1:1) to an outcome feedback intervention group or a treatment-as-usual control group by use of a computer-generated randomisation algorithm. The allocation of patients to therapists was quasi-random, whereby patients on waiting lists were allocated sequentially on the basis of therapist availability. All patients received low-intensity (less than eight sessions) or high-intensity (up to 20 sessions) psychological therapies for the duration of the 1-year study period. An automated computer algorithm alerted therapists in the outcome feedback group to patients who were not on track, and primed them to review these patients in clinical supervision. The primary outcome was symptom severity on validated depression (Patient Health Questionnaire-9 [PHQ-9]) and anxiety (Generalised Anxiety Disorder-7 [GAD-7]) measures after treatment of varying durations, which were compared between groups with multilevel modelling, controlling for cluster (therapist) effects. We used an intention-to-treat approach. This trial was prospectively registered with ISRCTN, number ISRCTN12459454. FINDINGS: In total, 79 therapists were recruited to the study between Jan 8, 2016, and July 15, 2016, but two did not participate. Of these participants, 39 (51%) were randomly assigned to the outcome feedback group and 38 (49%) to the control group. Overall, 2233 patients were included in the trial (1176 [53%] were treated by therapists in the outcome feedback group, and 1057 [47%] by therapists in the control group). Patients classified as not on track had less severe symptoms after treatment if they were allocated to the outcome feedback group than those in the control group (PHQ-9 d=0·23, B=-1·03 [95% CI -1·84 to -0·23], p=0·012; GAD-7 d=0·19, B=-0·85 [-1·56 to -0·14], p=0·019). INTERPRETATION: Supplementing psychological therapy with low-cost feedback technology can reduce symptom severity in patients at risk of poor response to treatment. This evidence supports the implementation of outcome feedback in stepped care psychological services. FUNDING: English NHS and Department of Health Sciences, University of York, York, UK.

Longitudinal measurement invariance of the Dutch Outcome Questionnaire-45 in a clinical sample.

PURPOSE: In the absence of measurement invariance across measurement occasions, change scores based on pretest-posttest measurements may be inaccurate representations of real change on the latent variable. In this study, we examined whether measurement invariance held in the Dutch version of Outcome Questionnaire-45 (OQ-45). METHOD: Using secondary data analysis of a sample of N = 540 Dutch outpatients, we tested the stability of the factorial structure (gamma change) and the metric and scalar invariance (beta change) across pretest and posttest measurements using a combination of factor analysis and item response theory methodology. RESULTS: Results revealed a stable factorial structure from pretest to posttest and minor violations of metric invariance for two items in the Dutch OQ-45. CONCLUSION: Even though for two items the assumption of invariance was violated, results suggest that the effects of these violations on practical change assessment using the OQ-45 were negligible.

Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P).

BACKGROUND: Patient self-report allows collecting comprehensive data for the purpose of performing economic evaluations. The aim of the current study was to assess the feasibility, reliability and a part of the construct validity of a commonly applied questionnaire on healthcare utilization and productivity losses in patients with a psychiatric disorder (TiC-P). METHODS: Data were derived alongside two clinical trials performed in the Netherlands in patients with mental health problems. The response rate, average time of filling out the questionnaire and proportions of missing values were used as indicators of feasibility of the questionnaire. Test-retest analyses were performed including Cohen's kappa and intra class correlation coefficients to assess reliability of the data. The construct validity was assessed by comparing patient reported data on contacts with psychotherapists and reported data on long-term absence from work with data derived from registries. RESULTS: The response rate was 72%. The mean time needed for filling out the first TiC-P was 9.4 minutes. The time needed for filling out the questionnaire was 2.3 minutes less for follow up measurements. Proportions of missing values were limited (< 2.4%) except for medication for which in 10% of the cases costs could not be calculated. Cohen's kappa was satisfactory to almost perfect for most items related to healthcare consumption and satisfactory for items on absence from work and presenteeism. Comparable results were shown by the ICCs on variables measuring volumes of medical consumption and productivity losses indicating good reliability of the questionnaire.Absolute agreement between patient-reported data and data derived from medical registrations of the psychotherapists was satisfactory. Accepting a margin of +/- seven days, the agreement on reported and registered data on long-term absence from work was satisfactory. The validity of self-reported data using the TiC-P is promising. CONCLUSIONS: The results indicate that the TiC-P is a feasible and reliable instrument for collecting data on medical consumption and productivity losses in patients with mild to moderate mental health problems. Additionally, the construct validity of questions related to contacts with psychotherapist and long-term absence from work was satisfactory.

Perceived green qualities were associated with neighborhood satisfaction, physical activity, and general health: results from a cross-sectional study in suburban and rural Scania, southern Sweden.

In this study using cross-sectional survey data from suburban and rural Scania, Sweden (N=24,847), we assessed how the recently validated index score of area-aggregated perceived green neighborhood qualities (Scania Green Score; SGS), and the five distinct qualities within this index were associated with three self-reported indicators of well-being: neighborhood satisfaction, physical activity and general health. Effect sizes were compared with objective (GIS-based) assessments of the same five qualities. Area-aggregated SGS was positively associated with neighborhood satisfaction, physical activity and general health. The association with general health was mediated by physical activity and neighborhood satisfaction. Three perceived qualities had salutogenic potential: historical remains (culture), silence such that sounds of nature can be heard (serene) and species richness (lush). Spacious and wild were not appreciated. Some independent positive effects of the GIS-based index were noted, but could not be consistently attributed to specific qualities. Perceived qualities within green areas, not merely quantity, are related to aspects of well-being in suburban and rural areas.