ABSTRACT
BACKGROUND: Heterogeneity in outcomes reported in trials of interventions for the treatment of neonatal encephalopathy (NE) makes evaluating the effectiveness of treatments difficult. Developing a core outcome set for NE treatment would enable researchers to measure and report the same outcomes in future trials. This would minimise waste, ensure relevant outcomes are measured and enable evidence synthesis. Therefore, we aimed to develop a core outcome set for treating NE. METHODS: Outcomes identified from a systematic review of the literature and interviews with parents were prioritised by stakeholders (n = 99 parents/caregivers, n = 101 healthcare providers, and n = 22 researchers/ academics) in online Delphi surveys. Agreement on the outcomes was achieved at online consensus meetings attended by n = 10 parents, n = 18 healthcare providers, and n = 13 researchers/ academics. RESULTS: Seven outcomes were included in the final core outcome set: survival; brain injury on imaging; neurological status at discharge; cerebral palsy; general cognitive ability; quality of life of the child, and adverse events related to treatment. CONCLUSION: We developed a core outcome set for the treatment of NE. This will allow future trials to measure and report the same outcomes and ensure results can be compared. Future work should identify how best to measure the COS. IMPACT: We have identified seven outcomes that should be measured and reported in all studies for the treatment of neonatal encephalopathy. Previously, a core outcome set for neonatal encephalopathy treatments did not exist. This will help to reduce heterogeneity in outcomes reported in clinical trials and other studies, and help researchers identify the best treatments for neonatal encephalopathy.
Subject(s)
Delphi Technique , Humans , Infant, Newborn , Treatment Outcome , Brain Diseases/therapy , Consensus , Quality of Life , Outcome Assessment, Health Care , Parents , Infant, Newborn, Diseases/therapyABSTRACT
OBJECTIVE: To identify current practices in the management of selective fetal growth restriction (sFGR) in monochorionic diamniotic (MCDA) twin pregnancies. DESIGN: Cross-sectional survey. SETTING: International. POPULATION: Clinicians involved in the management of MCDA twin pregnancies with sFGR. METHODS: A structured, self-administered survey. MAIN OUTCOME MEASURES: Clinical practices and attitudes to diagnostic criteria and management strategies. RESULTS: Overall, 62.8% (113/180) of clinicians completed the survey; of which, 66.4% (75/113) of the respondents reported that they would use an estimated fetal weight (EFW) of <10th centile for the smaller twin and an inter-twin EFW discordance of >25% for the diagnosis of sFGR. For early-onset type I sFGR, 79.8% (75/94) of respondents expressed that expectant management would be their routine practice. On the other hand, for early-onset type II and type III sFGR, 19.3% (17/88) and 35.7% (30/84) of respondents would manage these pregnancies expectantly, whereas 71.6% (63/88) and 57.1% (48/84) would refer these pregnancies to a fetal intervention centre or would offer fetal intervention for type II and type III cases, respectively. Moreover, 39.0% (16/41) of the respondents would consider fetoscopic laser surgery (FLS) for early-onset type I sFGR, whereas 41.5% (17/41) would offer either FLS or selective feticide, and 12.2% (5/41) would exclusively offer selective feticide. For early-onset type II and type III sFGR cases, 25.9% (21/81) and 31.4% (22/70) would exclusively offer FLS, respectively, whereas 33.3% (27/81) and 32.9% (23/70) would exclusively offer selective feticide. CONCLUSIONS: There is significant variation in clinician practices and attitudes towards the management of early-onset sFGR in MCDA twin pregnancies, especially for type II and type III cases, highlighting the need for high-level evidence to guide management.
ABSTRACT
PURPOSE: The B-MaP-C study investigated changes to breast cancer care that were necessitated by the COVID-19 pandemic. Here we present a follow-up analysis of those patients commenced on bridging endocrine therapy (BrET), whilst they were awaiting surgery due to reprioritisation of resources. METHODS: This multicentre, multinational cohort study recruited 6045 patients from the UK, Spain and Portugal during the peak pandemic period (Feb-July 2020). Patients on BrET were followed up to investigate the duration of, and response to, BrET. This included changes in tumour size to reflect downstaging potential, and changes in cellular proliferation (Ki67), as a marker of prognosis. RESULTS: 1094 patients were prescribed BrET, over a median period of 53 days (IQR 32-81 days). The majority of patients (95.6%) had strong ER expression (Allred score 7-8/8). Very few patients required expedited surgery, due to lack of response (1.2%) or due to lack of tolerance/compliance (0.8%). There were small reductions in median tumour size after 3 months' treatment duration; median of 4 mm [IQR - 20, 4]. In a small subset of patients (n = 47), a drop in cellular proliferation (Ki67) occurred in 26 patients (55%), from high (Ki67 ≥ 10%) to low (< 10%), with at least one month's duration of BrET. DISCUSSION: This study describes real-world usage of pre-operative endocrine therapy as necessitated by the pandemic. BrET was found to be tolerable and safe. The data support short-term (≤ 3 months) usage of pre-operative endocrine therapy. Longer-term use should be investigated in future trials.
Subject(s)
Breast Neoplasms , COVID-19 , Humans , Female , Breast Neoplasms/drug therapy , Breast Neoplasms/surgery , Pandemics , Ki-67 Antigen/metabolism , Cohort Studies , Prognosis , Neoadjuvant TherapyABSTRACT
BACKGROUND: There is substantial heterogeneity between trial outcomes in pressure ulcer prevention research. The development of core outcome sets is one strategy to improve comparability between trial results and thus increase the quality of evidence. OBJECTIVES: To identify core outcomes for pressure ulcer prevention trials. METHODS: A workshop was held with service users to discuss their views and understanding of the outcomes identified by a scoping review and to identify any missing outcomes. In a next step, a Delphi survey comprising three rounds was conducted to evaluate a compiled list of outcomes by their importance. Afterwards the preselection from the Delphi survey was discussed in a virtual consensus meeting with the aim of agreeing on a final set of core outcomes. Individuals who had completed all three rounds of the Delphi survey were eligible to participate in this meeting. Participants included practitioners, service users, researchers and industry representatives. The OUTPUTs project is registered in the COMET database and is part of the Cochrane Skin Core Outcome Set Initiative. RESULTS: The workshop did not reveal any missing outcomes, but highlighted the need for further efforts to make lay people understand what an outcome is in a study setting. The Delphi survey took place between December 2020 and June 2021. After the three rounds, 18 out of 37 presented outcomes were rated to be critically important. In the following consensus meeting, six outcomes were prioritized to be included in the core outcome set for pressure ulcer prevention trials: (i) pressure ulcer occurrence; (ii) pressure ulcer precursor signs and symptoms; (iii) mobility; (iv) acceptability and comfort of intervention; (v) adherence/compliance; and (vi) adverse events/safety. CONCLUSIONS: Based on a comprehensive list of outcomes in pressure ulcer prevention research, there was clear agreement on the six identified core outcomes in three international Delphi rounds and in the consensus meeting. Although outcome measurement instruments need to be identified next, the six identified core outcomes should already be considered in future trials, as service users, practitioners, researchers and industry representatives have agreed that they are critically important. What is already known about this topic? There are numerous trials on pressure ulcer prevention, but evidence on the effectiveness of preventive measures is limited due to heterogeneity between trial outcomes. The development of a core outcome set is one strategy to improve comparability between trial results. What does this study add? A service user workshop, a three-round Delphi survey and an online consensus meeting with practitioners, service users, researchers and industry representatives were conducted to identify core outcomes for pressure ulcer prevention trials. Six core outcomes were defined: (i) pressure ulcer occurrence, (ii) pressure ulcer precursor signs and symptoms, (iii) mobility, (iv) acceptability and comfort of intervention, (v) adherence/compliance and (vi) adverse events/safety. What are the clinical implications of this work? Better evidence of interventions for pressure ulcer prevention will help health professionals and service users to decide which interventions are most appropriate and effective. Better evidence may contribute to better pressure ulcer prevention.
Subject(s)
Pressure Ulcer , Humans , Delphi Technique , Endpoint Determination/methods , Pressure Ulcer/prevention & control , Research Design , Treatment Outcome , Qualitative ResearchABSTRACT
BACKGROUND: There is variation in the outcomes reported in clinical studies of basal cell carcinoma. This can prevent effective meta-analyses from answering important clinical questions. OBJECTIVE: To identify a recommended minimum set of core outcomes for basal cell carcinoma clinical trials. METHODS: Patient and professional Delphi process to cull a long list, culminating in a consensus meeting. To be provisionally accepted, outcomes needed to be deemed important (score, 7-9, with 9 being the maximum) by 70% of each stakeholder group. RESULTS: Two hundred thirty-five candidate outcomes identified via a systematic literature review and survey of key stakeholders were reduced to 74 that were rated by 100 health care professionals and patients in 2 Delphi rounds. Twenty-seven outcomes were provisionally accepted. The final core set of 5 agreed-upon outcomes after the consensus meeting included complete response; persistent or serious adverse events; recurrence-free survival; quality of life; and patient satisfaction, including cosmetic outcome. LIMITATIONS: English-speaking patients and professionals rated outcomes extracted from English language studies. CONCLUSION: A core outcome set for basal cell carcinoma has been developed. The use of relevant measures may improve the utility of clinical research and the quality of therapeutic guidance available to clinicians.
Subject(s)
Carcinoma, Basal Cell , Skin Neoplasms , Carcinoma, Basal Cell/therapy , Delphi Technique , Humans , Quality of Life , Research Design , Skin Neoplasms/therapy , Treatment OutcomeABSTRACT
BACKGROUND: The B-MaP-C study aimed to determine alterations to breast cancer (BC) management during the peak transmission period of the UK COVID-19 pandemic and the potential impact of these treatment decisions. METHODS: This was a national cohort study of patients with early BC undergoing multidisciplinary team (MDT)-guided treatment recommendations during the pandemic, designated 'standard' or 'COVID-altered', in the preoperative, operative and post-operative setting. FINDINGS: Of 3776 patients (from 64 UK units) in the study, 2246 (59%) had 'COVID-altered' management. 'Bridging' endocrine therapy was used (n = 951) where theatre capacity was reduced. There was increasing access to COVID-19 low-risk theatres during the study period (59%). In line with national guidance, immediate breast reconstruction was avoided (n = 299). Where adjuvant chemotherapy was omitted (n = 81), the median benefit was only 3% (IQR 2-9%) using 'NHS Predict'. There was the rapid adoption of new evidence-based hypofractionated radiotherapy (n = 781, from 46 units). Only 14 patients (1%) tested positive for SARS-CoV-2 during their treatment journey. CONCLUSIONS: The majority of 'COVID-altered' management decisions were largely in line with pre-COVID evidence-based guidelines, implying that breast cancer survival outcomes are unlikely to be negatively impacted by the pandemic. However, in this study, the potential impact of delays to BC presentation or diagnosis remains unknown.
Subject(s)
Breast Neoplasms/therapy , COVID-19/epidemiology , SARS-CoV-2 , Adult , Aged , Aged, 80 and over , COVID-19/diagnosis , Cohort Studies , Female , Humans , Middle Aged , Practice Guidelines as TopicABSTRACT
BACKGROUND: Large sample sizes are often required to detect statistically significant associations between pharmacogenetic markers and treatment response. Meta-analysis may be performed to synthesize data from several studies, increasing sample size and, consequently, power to detect significant genetic effects. However, performing robust synthesis of data from pharmacogenetic studies is often challenging because of poor reporting of key data in study reports. There is currently no guideline for the reporting of pharmacogenetic studies that has been developed using a widely accepted robust methodology. The objective of this project was to develop the STrengthening the Reporting Of Pharmacogenetic Studies (STROPS) guideline. METHODS AND FINDINGS: We established a preliminary checklist of reporting items to be considered for inclusion in the guideline. We invited representatives of key stakeholder groups to participate in a 2-round Delphi survey. A total of 52 individuals participated in both rounds of the survey, scoring items with regards to their importance for inclusion in the STROPS guideline. We then held a consensus meeting, at which 8 individuals considered the results of the Delphi survey and voted on whether each item ought to be included in the final guideline. The STROPS guideline consists of 54 items and is accompanied by an explanation and elaboration document. The guideline contains items that are particularly important in the field of pharmacogenetics, such as the drug regimen of interest and whether adherence to treatment was accounted for in the conducted analyses. The guideline also requires that outcomes be clearly defined and justified, because in pharmacogenetic studies, there may be a greater number of possible outcomes than in other types of study (for example, disease-gene association studies). A limitation of this project is that our consensus meeting involved a small number of individuals, the majority of whom are based in the United Kingdom. CONCLUSIONS: Our aim is for the STROPS guideline to improve the transparency of reporting of pharmacogenetic studies and also to facilitate the conduct of high-quality systematic reviews and meta-analyses. We encourage authors to adhere to the STROPS guideline when publishing pharmacogenetic studies.
Subject(s)
Pharmacogenetics/methods , Pharmacogenomic Testing/standards , Pharmacogenomic Testing/trends , Adult , Checklist , Consensus , Delphi Technique , Female , Genetic Association Studies , Goals , Humans , Male , Middle Aged , Pharmacogenetics/standards , Politics , Publishing/standards , Research Design/standards , Stakeholder Participation , Surveys and Questionnaires , United KingdomABSTRACT
OBJECTIVES: This study aimed to develop consensus on an internationally agreed dataset for juvenile dermatomyositis (JDM), designed for clinical use, to enhance collaborative research and allow integration of data between centres. METHODS: A prototype dataset was developed through a formal process that included analysing items within existing databases of patients with idiopathic inflammatory myopathies. This template was used to aid a structured multistage consensus process. Exploiting Delphi methodology, two web-based questionnaires were distributed to healthcare professionals caring for patients with JDM identified through email distribution lists of international paediatric rheumatology and myositis research groups. A separate questionnaire was sent to parents of children with JDM and patients with JDM, identified through established research networks and patient support groups. The results of these parallel processes informed a face-to-face nominal group consensus meeting of international myositis experts, tasked with defining the content of the dataset. This developed dataset was tested in routine clinical practice before review and finalisation. RESULTS: A dataset containing 123 items was formulated with an accompanying glossary. Demographic and diagnostic data are contained within form A collected at baseline visit only, disease activity measures are included within form B collected at every visit and disease damage items within form C collected at baseline and annual visits thereafter. CONCLUSIONS: Through a robust international process, a consensus dataset for JDM has been formulated that can capture disease activity and damage over time. This dataset can be incorporated into national and international collaborative efforts, including existing clinical research databases.
Subject(s)
Data Collection/methods , Databases, Factual , Dermatomyositis/diagnosis , Adolescent , Child , Consensus , Delphi Technique , Humans , ResearchABSTRACT
BACKGROUND: The use of core outcome sets (COS) ensures that researchers measure and report those outcomes that are most likely to be relevant to users of their research. Several hundred COS projects have been systematically identified to date, but there has been no formal quality assessment of these studies. The Core Outcome Set-STAndards for Development (COS-STAD) project aimed to identify minimum standards for the design of a COS study agreed upon by an international group, while other specific guidance exists for the final reporting of COS development studies (Core Outcome Set-STAndards for Reporting [COS-STAR]). METHODS AND FINDINGS: An international group of experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives produced the COS-STAD recommendations to help improve the quality of COS development and support the assessment of whether a COS had been developed using a reasonable approach. An open survey of experts generated an initial list of items, which was refined by a 2-round Delphi survey involving nearly 250 participants representing key stakeholder groups. Participants assigned importance ratings for each item using a 1-9 scale. Consensus that an item should be included in the set of minimum standards was defined as at least 70% of the voting participants from each stakeholder group providing a score between 7 and 9. The Delphi survey was followed by a consensus discussion with the study management group representing multiple stakeholder groups. COS-STAD contains 11 minimum standards that are the minimum design recommendations for all COS development projects. The recommendations focus on 3 key domains: the scope, the stakeholders, and the consensus process. CONCLUSIONS: The COS-STAD project has established 11 minimum standards to be followed by COS developers when planning their projects and by users when deciding whether a COS has been developed using reasonable methods.
Subject(s)
Delphi Technique , Endpoint Determination , Outcome Assessment, Health Care , Endpoint Determination/methods , Humans , Outcome Assessment, Health Care/methods , Research Design , Surveys and QuestionnairesABSTRACT
BACKGROUND: Core outcome sets (COS) can enhance the relevance of research by ensuring that outcomes of importance to health service users and other people making choices about health care in a particular topic area are measured routinely. Over 200 COS to date have been developed, but the clarity of these reports is suboptimal. COS studies will not achieve their goal if reports of COS are not complete and transparent. METHODS AND FINDINGS: In recognition of these issues, an international group that included experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives developed the Core Outcome Set-STAndards for Reporting (COS-STAR) Statement as a reporting guideline for COS studies. The developmental process consisted of an initial reporting item generation stage and a two-round Delphi survey involving nearly 200 participants representing key stakeholder groups, followed by a consensus meeting. The COS-STAR Statement consists of a checklist of 18 items considered essential for transparent and complete reporting in all COS studies. The checklist items focus on the introduction, methods, results, and discussion section of a manuscript describing the development of a particular COS. A limitation of the COS-STAR Statement is that it was developed without representative views of low- and middle-income countries. COS have equal relevance to studies conducted in these areas, and, subsequently, this guideline may need to evolve over time to encompass any additional challenges from developing COS in these areas. CONCLUSIONS: With many ongoing COS studies underway, the COS-STAR Statement should be a helpful resource to improve the reporting of COS studies for the benefit of all COS users.
Subject(s)
Guidelines as Topic , Outcome Assessment, Health Care/standards , Biomedical Research , Checklist , Consensus Development Conferences as Topic , Outcome Assessment, Health Care/methods , Review Literature as TopicABSTRACT
BACKGROUND: Most publications about selective reporting in clinical trials have focussed on outcomes. However, selective reporting of analyses for a given outcome may also affect the validity of findings. If analyses are selected on the basis of the results, reporting bias may occur. The aims of this study were to review and summarise the evidence from empirical cohort studies that assessed discrepant or selective reporting of analyses in randomised controlled trials (RCTs). METHODS AND FINDINGS: A systematic review was conducted and included cohort studies that assessed any aspect of the reporting of analyses of RCTs by comparing different trial documents, e.g., protocol compared to trial report, or different sections within a trial publication. The Cochrane Methodology Register, Medline (Ovid), PsycInfo (Ovid), and PubMed were searched on 5 February 2014. Two authors independently selected studies, performed data extraction, and assessed the methodological quality of the eligible studies. Twenty-two studies (containing 3,140 RCTs) published between 2000 and 2013 were included. Twenty-two studies reported on discrepancies between information given in different sources. Discrepancies were found in statistical analyses (eight studies), composite outcomes (one study), the handling of missing data (three studies), unadjusted versus adjusted analyses (three studies), handling of continuous data (three studies), and subgroup analyses (12 studies). Discrepancy rates varied, ranging from 7% (3/42) to 88% (7/8) in statistical analyses, 46% (36/79) to 82% (23/28) in adjusted versus unadjusted analyses, and 61% (11/18) to 100% (25/25) in subgroup analyses. This review is limited in that none of the included studies investigated the evidence for bias resulting from selective reporting of analyses. It was not possible to combine studies to provide overall summary estimates, and so the results of studies are discussed narratively. CONCLUSIONS: Discrepancies in analyses between publications and other study documentation were common, but reasons for these discrepancies were not discussed in the trial reports. To ensure transparency, protocols and statistical analysis plans need to be published, and investigators should adhere to these or explain discrepancies.
Subject(s)
Bias , Publishing , Research Design , Clinical Trials as Topic , Cohort Studies , HumansABSTRACT
AIMS: To examine the impact of off-label and unlicensed (OLUL) prescribing on adverse drug reactions (ADRs) causing unplanned admissions to a paediatric hospital. METHODS: Prescription data from a 12 month prospective cohort study of ADRs detected in children admitted to a paediatric hospital were scrutinized. The relative risk for off-label and unlicensed medicines being implicated in an ADR was calculated. Logistic regression analyses were carried out with exposure to off-label and unlicensed medicines and number of off-label and unlicensed medicines administered as predictor variables. RESULTS: Off-label and unlicensed medicines were more likely to be implicated in an ADR than authorized medicines (relative risk 1.67, 95% CI 1.38, 2.02, P < 0.001). There was a 25% increase in ADR risk (95% CI 1.16, 1.35, P < 0.001) with each additional authorized medicine and 23% (95% CI 1.10, 1.36, P < 0.001) with each additional off-label or unlicensed medicine. Logistic regression analysis focusing on non-oncology patients demonstrated that the number of authorized medicines (odds ratio 1.33, 95% CI 1.23, 1.44, P < 0.001), but not the number of off-label and unlicensed medicine courses, was a predictor of ADR risk. CONCLUSIONS: In a heterogeneous population of children admitted to a secondary/tertiary hospital, off-label and unlicensed medicines are more likely to be implicated in an ADR than authorized medicines. This was largely driven by ADRs related to drugs used in oncological practice, where the usage of off-label or unlicensed medicines was associated with a higher ADR risk than in non-oncological areas.
Subject(s)
Drug-Related Side Effects and Adverse Reactions/epidemiology , Hospitals, Pediatric , Off-Label Use , Patient Admission , Adolescent , Chi-Square Distribution , Child , Child, Preschool , England/epidemiology , Female , Humans , Infant , Infant, Newborn , Logistic Models , Male , Odds Ratio , Polypharmacy , Prospective Studies , Risk Factors , Tertiary Care Centers , Time FactorsABSTRACT
OBJECTIVE: The objective of this study was to determine the proportion of all published core outcome set (COS) studies that include an adverse event or harm outcome, to determine the proportion of individual versus pooled harms, and to investigate characteristics that influence their inclusion. METHODS: We examined the extent to which a sample of 100 published COS studies (from January 2021 to January 2023) include both pooled and individual harms in the final COS. One investigator extracted the information from the COS studies, which was cross-checked against previous COS investigational research, and where possible verified with COS authors or a pharmacologist. Using QualtricsTM, we conducted a personalised online survey of developers of the 100 COS to ask them about the importance, their experiences, and methodological approaches for dealing with harms within their COS development studies. RESULTS: One hundred COS were identified from 91 separate COS studies, the majority of which considered most of the minimum standards for development. Two-thirds (65%) of the COS included at least one harm outcome. In total, 1104 core outcomes were identified across the 100 COS, of which 184 (17%) were harm outcomes (154 individual vs. 56 pooled). Individual harms were more likely to be included in a final COS if they were developed for single treatment interventions (50%) compared to those being developed for multi-treatment modalities (39%). Some COS developers adopted outcome frameworks as part of their COS development process to facilitate the inclusion of harm outcomes in their final COS. A third (33%) of respondents felt that harm outcomes should be included in all COS but over half (56%) thought this would be dependent on some aspect of the scope of the COS and improved methodology and awareness of how to deal with harm outcomes in the COS development process. CONCLUSION: Harm outcomes are already included in many COS either as individual or pooled harms. It is evident that there are some challenges with regards to both the methodology and necessity to include harms within a COS (pooled or individual. COS developers should carefully consider the need to include important harms outcomes in relation to the scope of the COS that they are developing.
ABSTRACT
OBJECTIVES: To determine the reproducibility of biomedical systematic review search strategies. STUDY DESIGN AND SETTING: A cross-sectional reproducibility study was conducted on a random sample of 100 systematic reviews indexed in MEDLINE in November 2021. The primary outcome measure is the percentage of systematic reviews for which all database searches can be reproduced, operationalized as fulfilling six key Preferred Reporting Items for Systematic reviews and Meta-Analyses literature search extension (PRISMA-S) reporting guideline items and having all database searches reproduced within 10% of the number of original results. Key reporting guideline items included database name, multi-database searching, full search strategies, limits and restrictions, date(s) of searches, and total records. RESULTS: The 100 systematic review articles contained 453 database searches. Only 22 (4.9%) database searches reported all six PRISMA-S items. Forty-seven (10.4%) database searches could be reproduced within 10% of the number of results from the original search; six searches differed by more than 1,000% between the originally reported number of results and the reproduction. Only one systematic review article provided the necessary search details to be fully reproducible. CONCLUSION: Systematic review search reporting is poor. To correct this will require a multifaceted response from authors, peer reviewers, journal editors, and database providers.
Subject(s)
Research Design , Systematic Reviews as Topic , Cross-Sectional Studies , Databases, Factual , MEDLINE , Reproducibility of ResultsABSTRACT
OBJECTIVES: In 2019, only 7% of Cochrane systematic reviews (SRs) cited a core outcome set (COS) in relation to choosing outcomes, even though a relevant COS existed but was not mentioned (or cited) for a further 29% of SRs. Our objectives for the current work were to (1) examine the extent to which authors are currently considering COS to inform outcome choice in Cochrane protocols and completed SRs, and (2) understand author facilitators and barriers to using COS. STUDY DESIGN AND SETTING: We examined all completed Cochrane SRs published in the last 3 months of 2022 and all Cochrane protocols published in 2022 for the extent to which they: (a) cited a COS, (b) searched for COS, (c) used outcomes from existing COS, and (d) reported outcome inconsistency among included studies and/or noted the need for COS. One investigator extracted information; a second extractor verified all information, discussing discrepancies to achieve consensus. We then conducted an online survey of authors of the included SRs to assess awareness of COS and identify facilitators and barriers to using COS to inform outcome choice. RESULTS: Objective 1: We included 294 SRs of interventions (84 completed SRs and 210 published SR protocols), of which 13% cited specific COS and 5% did not cite but mentioned searching for COS. A median of 83% of core outcomes from cited COS (interquartile range [IQR] 57%-100%) were included in the corresponding SR. We identified a relevant COS for 39% of SRs that did not cite a COS. A median of 50% of core outcomes from noncited COS (IQR 35%-72%) were included in the corresponding SR. Objective 2: Authors of 236 (80%) of the 294 eligible SRs completed our survey. Seventy-seven percent of authors noted being aware of COS before the survey. Fifty-five percent of authors who did not cite COS but were aware of them reported searching for a COS. The most reported facilitators of using COS were author awareness of the existence of COS (59%), author positive perceptions of COS (52%), and recommendation in the Cochrane Handbook regarding COS use (48%). The most reported barriers related to matching of the scope of the COS and the SR: the COS target population was too narrow/broad relative to the SR population (29%) or the COS target intervention was too narrow/broad relative to the SR intervention (21%). Most authors (87%) mentioned that they would consider incorporating missing core outcomes in the SR/update. CONCLUSION: Since 2019, there is increasing consideration and awareness of COS when choosing outcomes for Cochrane SRs of interventions, but uptake remains low and can be improved further. Use of COS in SRs is important to improve outcome standardization, reduce research waste, and improve evidence syntheses of the relevant effects of interventions across health research.
Subject(s)
Systematic Reviews as Topic , Systematic Reviews as Topic/methods , Humans , Outcome Assessment, Health Care/methods , Outcome Assessment, Health Care/statistics & numerical dataABSTRACT
OBJECTIVES: Core outcome sets (COS) are agreed sets of outcomes for use in clinical trials, which can increase standardization and reduce heterogeneity of outcomes in research. Using a COS, or not, is a behavior that can potentially be increased using behavioral strategies. The aim of this study was to identify behavioral intervention components to potentially increase use of COS in trials. METHODS: This project was informed by the Behavior Change Wheel framework. Two reviewers extracted barriers and facilitators to COS use from four recently published studies examining COS use in trials. Barriers and facilitators were coded to the Capability, Opportunity, Motivation-Behavior (COM-B) model, which forms part of the Behavior Change Wheel. COM-B findings were mapped to intervention functions by two reviewers, and then mapped to behavior change techniques (BCTs). Full-team Affordability, Practicability, Effectiveness/Cost-effectiveness, Acceptability, Side effects/Safety, Equity ratings were used to reach consensus on intervention functions and BCTs. BCTs were operationalized using examples of tangible potential applications and were categorized based on similarity. RESULTS: Barriers and facilitators were identified for all capability, opportunity and motivation aspects of the COM-B model. Five intervention functions (education, training, enablement, persuasion, and modeling) and 15 BCTs were identified. Thirty-six BCT examples were developed, including providing information on benefits of COS for health research, and information choosing COS. BCT examples are categorized by approaches related to "workshops," "guidance," "audio/visual resources," and "other resources." CONCLUSION: Study findings represent diverse ways to potentially increase COS use in trials. Future work is needed to examine effects of these behavioral intervention components on COS use. If effective, increased use of COS can improve outcome reporting and minimize outcome heterogeneity and research waste.
Subject(s)
Behavior Therapy , Behavioral Sciences , Humans , Motivation , Consensus , Outcome Assessment, Health CareABSTRACT
Selective outcome reporting can result in overestimation of treatment effects, research waste, and reduced openness and transparency. This review aimed to examine selective outcome reporting in trials of behavioural health interventions and determine potential outcome reporting bias. A review of nine health psychology and behavioural medicine journals was conducted to identify randomised controlled trials of behavioural health interventions published since 2019. Discrepancies in outcome reporting were observed in 90% of the 29 trials with corresponding registrations/protocols. Discrepancies included 72% of trials omitting prespecified outcomes; 55% of trials introduced new outcomes. Thirty-eight percent of trials omitted prespecified and introduced new outcomes. Three trials (10%) downgraded primary outcomes in registrations/protocols to secondary outcomes in final reports; downgraded outcomes were not statistically significant in two trials. Five trials (17%) upgraded secondary outcomes to primary outcomes; upgraded outcomes were statistically significant in all trials. In final reports, three trials (7%) omitted outcomes from the methods section; three trials (7%) introduced new outcomes in results that were not in the methods. These findings indicate that selective outcome reporting is a problem in behavioural health intervention trials. Journal- and trialist-level approaches are needed to minimise selective outcome reporting in health psychology and behavioural medicine.