A survey of experts to identify methods to detect problematic studies: Stage 1 of the INSPECT-SR Project.

Background: Randomised controlled trials (RCTs) inform healthcare decisions. Unfortunately, some published RCTs contain false data, and some appear to have been entirely fabricated. Systematic reviews are performed to identify and synthesise all RCTs which have been conducted on a given topic. This means that any of these 'problematic studies' are likely to be included, but there are no agreed methods for identifying them. The INSPECT-SR project is developing a tool to identify problematic RCTs in systematic reviews of healthcare-related interventions. The tool will guide the user through a series of 'checks' to determine a study's authenticity. The first objective in the development process is to assemble a comprehensive list of checks to consider for inclusion. Methods: We assembled an initial list of checks for assessing the authenticity of research studies, with no restriction to RCTs, and categorised these into five domains: Inspecting results in the paper; Inspecting the research team; Inspecting conduct, governance, and transparency; Inspecting text and publication details; Inspecting the individual participant data. We implemented this list as an online survey, and invited people with expertise and experience of assessing potentially problematic studies to participate through professional networks and online forums. Participants were invited to provide feedback on the checks on the list, and were asked to describe any additional checks they knew of, which were not featured in the list. Results: Extensive feedback on an initial list of 102 checks was provided by 71 participants based in 16 countries across five continents. Fourteen new checks were proposed across the five domains, and suggestions were made to reword checks on the initial list. An updated list of checks was constructed, comprising 116 checks. Many participants expressed a lack of familiarity with statistical checks, and emphasized the importance of feasibility of the tool. Conclusions: A comprehensive list of trustworthiness checks has been produced. The checks will be evaluated to determine which should be included in the INSPECT-SR tool.

Study found increasing use of core outcome sets in Cochrane systematic reviews and identified facilitators and barriers.

OBJECTIVES: In 2019, only 7% of Cochrane systematic reviews (SRs) cited a core outcome set (COS) in relation to choosing outcomes, even though a relevant COS existed but was not mentioned (or cited) for a further 29% of SRs. Our objectives for the current work were to (1) examine the extent to which authors are currently considering COS to inform outcome choice in Cochrane protocols and completed SRs, and (2) understand author facilitators and barriers to using COS. STUDY DESIGN AND SETTING: We examined all completed Cochrane SRs published in the last 3 months of 2022 and all Cochrane protocols published in 2022 for the extent to which they: (a) cited a COS, (b) searched for COS, (c) used outcomes from existing COS, and (d) reported outcome inconsistency among included studies and/or noted the need for COS. One investigator extracted information; a second extractor verified all information, discussing discrepancies to achieve consensus. We then conducted an online survey of authors of the included SRs to assess awareness of COS and identify facilitators and barriers to using COS to inform outcome choice. RESULTS: Objective 1: We included 294 SRs of interventions (84 completed SRs and 210 published SR protocols), of which 13% cited specific COS and 5% did not cite but mentioned searching for COS. A median of 83% of core outcomes from cited COS (interquartile range [IQR] 57%-100%) were included in the corresponding SR. We identified a relevant COS for 39% of SRs that did not cite a COS. A median of 50% of core outcomes from noncited COS (IQR 35%-72%) were included in the corresponding SR. Objective 2: Authors of 236 (80%) of the 294 eligible SRs completed our survey. Seventy-seven percent of authors noted being aware of COS before the survey. Fifty-five percent of authors who did not cite COS but were aware of them reported searching for a COS. The most reported facilitators of using COS were author awareness of the existence of COS (59%), author positive perceptions of COS (52%), and recommendation in the Cochrane Handbook regarding COS use (48%). The most reported barriers related to matching of the scope of the COS and the SR: the COS target population was too narrow/broad relative to the SR population (29%) or the COS target intervention was too narrow/broad relative to the SR intervention (21%). Most authors (87%) mentioned that they would consider incorporating missing core outcomes in the SR/update. CONCLUSION: Since 2019, there is increasing consideration and awareness of COS when choosing outcomes for Cochrane SRs of interventions, but uptake remains low and can be improved further. Use of COS in SRs is important to improve outcome standardization, reduce research waste, and improve evidence syntheses of the relevant effects of interventions across health research.

Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions.

INTRODUCTION: Randomised controlled trials (RCTs) inform healthcare decisions. It is now apparent that some published RCTs contain false data and some appear to have been entirely fabricated. Systematic reviews are performed to identify and synthesise all RCTs that have been conducted on a given topic. While it is usual to assess methodological features of the RCTs in the process of undertaking a systematic review, it is not usual to consider whether the RCTs contain false data. Studies containing false data therefore go unnoticed and contribute to systematic review conclusions. The INveStigating ProblEmatic Clinical Trials in Systematic Reviews (INSPECT-SR) project will develop a tool to assess the trustworthiness of RCTs in systematic reviews of healthcare-related interventions. METHODS AND ANALYSIS: The INSPECT-SR tool will be developed using expert consensus in combination with empirical evidence, over five stages: (1) a survey of experts to assemble a comprehensive list of checks for detecting problematic RCTs, (2) an evaluation of the feasibility and impact of applying the checks to systematic reviews, (3) a Delphi survey to determine which of the checks are supported by expert consensus, culminating in, (4) a consensus meeting to select checks to be included in a draft tool and to determine its format and (5) prospective testing of the draft tool in the production of new health systematic reviews, to allow refinement based on user feedback. We anticipate that the INSPECT-SR tool will help researchers to identify problematic studies and will help patients by protecting them from the influence of false data on their healthcare. ETHICS AND DISSEMINATION: The University of Manchester ethics decision tool was used, and this returned the result that ethical approval was not required for this project (30 September 2022), which incorporates secondary research and surveys of professionals about subjects relating to their expertise. Informed consent will be obtained from all survey participants. All results will be published as open-access articles. The final tool will be made freely available.

Protocol of a scoping review of outcome domains in dermatology.

INTRODUCTION: Core outcome sets (COSs) are agreed outcomes (domains (subdomains) and instruments) that should be measured as a minimum in clinical trials or practice in certain diseases or clinical fields. Worldwide, the number of COSs is increasing and there might be conceptual overlaps of domains (subdomains) and instruments within disciplines. The aim of this scoping review is to map and to classify all outcomes identified with COS projects relating to skin diseases. METHODS AND ANALYSIS: We will conduct a scoping review of outcomes of skin disease-related COS initiatives to identify all concepts and their definitions. We will search PubMed, Embase and Cochrane library. The search dates will be 1 January 2010 (the point at which Core Outcome Measures in Effectiveness Trials (COMET) was established) to 1 January 2024. We will also review the COMET database and C3 website to identify parts of COSs (domains and/or instruments) that are being developed and published. This review will be supplemented by querying relevant stakeholders from COS organisations, dermatology organisations and patient organisations for additional COSs that were developed. The resulting long lists of outcomes will then be mapped into conceptually similar concepts. ETHICS AND DISSEMINATION: This study was supported by departmental research funds from the Department of Dermatology at Northwestern University. An ethics committee review was waived since this protocol was done by staff researchers with no involvement of patient care. Conflicts of interests, if any, will be addressed by replacing participants with relevant conflicts or reassigning them. The results will be disseminated through publication in peer-reviewed journals, social media posts and promotion by COS organisations.

Using behavioral science to increase core outcome set use in trials.

OBJECTIVES: Core outcome sets (COS) are agreed sets of outcomes for use in clinical trials, which can increase standardization and reduce heterogeneity of outcomes in research. Using a COS, or not, is a behavior that can potentially be increased using behavioral strategies. The aim of this study was to identify behavioral intervention components to potentially increase use of COS in trials. METHODS: This project was informed by the Behavior Change Wheel framework. Two reviewers extracted barriers and facilitators to COS use from four recently published studies examining COS use in trials. Barriers and facilitators were coded to the Capability, Opportunity, Motivation-Behavior (COM-B) model, which forms part of the Behavior Change Wheel. COM-B findings were mapped to intervention functions by two reviewers, and then mapped to behavior change techniques (BCTs). Full-team Affordability, Practicability, Effectiveness/Cost-effectiveness, Acceptability, Side effects/Safety, Equity ratings were used to reach consensus on intervention functions and BCTs. BCTs were operationalized using examples of tangible potential applications and were categorized based on similarity. RESULTS: Barriers and facilitators were identified for all capability, opportunity and motivation aspects of the COM-B model. Five intervention functions (education, training, enablement, persuasion, and modeling) and 15 BCTs were identified. Thirty-six BCT examples were developed, including providing information on benefits of COS for health research, and information choosing COS. BCT examples are categorized by approaches related to "workshops," "guidance," "audio/visual resources," and "other resources." CONCLUSION: Study findings represent diverse ways to potentially increase COS use in trials. Future work is needed to examine effects of these behavioral intervention components on COS use. If effective, increased use of COS can improve outcome reporting and minimize outcome heterogeneity and research waste.

Systematic review search strategies are poorly reported and not reproducible: a cross-sectional metaresearch study.

OBJECTIVES: To determine the reproducibility of biomedical systematic review search strategies. STUDY DESIGN AND SETTING: A cross-sectional reproducibility study was conducted on a random sample of 100 systematic reviews indexed in MEDLINE in November 2021. The primary outcome measure is the percentage of systematic reviews for which all database searches can be reproduced, operationalized as fulfilling six key Preferred Reporting Items for Systematic reviews and Meta-Analyses literature search extension (PRISMA-S) reporting guideline items and having all database searches reproduced within 10% of the number of original results. Key reporting guideline items included database name, multi-database searching, full search strategies, limits and restrictions, date(s) of searches, and total records. RESULTS: The 100 systematic review articles contained 453 database searches. Only 22 (4.9%) database searches reported all six PRISMA-S items. Forty-seven (10.4%) database searches could be reproduced within 10% of the number of results from the original search; six searches differed by more than 1,000% between the originally reported number of results and the reproduction. Only one systematic review article provided the necessary search details to be fully reproducible. CONCLUSION: Systematic review search reporting is poor. To correct this will require a multifaceted response from authors, peer reviewers, journal editors, and database providers.

COHESION: a core outcome set for the treatment of neonatal encephalopathy.

BACKGROUND: Heterogeneity in outcomes reported in trials of interventions for the treatment of neonatal encephalopathy (NE) makes evaluating the effectiveness of treatments difficult. Developing a core outcome set for NE treatment would enable researchers to measure and report the same outcomes in future trials. This would minimise waste, ensure relevant outcomes are measured and enable evidence synthesis. Therefore, we aimed to develop a core outcome set for treating NE. METHODS: Outcomes identified from a systematic review of the literature and interviews with parents were prioritised by stakeholders (n = 99 parents/caregivers, n = 101 healthcare providers, and n = 22 researchers/ academics) in online Delphi surveys. Agreement on the outcomes was achieved at online consensus meetings attended by n = 10 parents, n = 18 healthcare providers, and n = 13 researchers/ academics. RESULTS: Seven outcomes were included in the final core outcome set: survival; brain injury on imaging; neurological status at discharge; cerebral palsy; general cognitive ability; quality of life of the child, and adverse events related to treatment. CONCLUSION: We developed a core outcome set for the treatment of NE. This will allow future trials to measure and report the same outcomes and ensure results can be compared. Future work should identify how best to measure the COS. IMPACT: We have identified seven outcomes that should be measured and reported in all studies for the treatment of neonatal encephalopathy. Previously, a core outcome set for neonatal encephalopathy treatments did not exist. This will help to reduce heterogeneity in outcomes reported in clinical trials and other studies, and help researchers identify the best treatments for neonatal encephalopathy.

Protocol for the development of a core outcome set for neonatal sepsis (NESCOS).

Neonatal sepsis is a serious public health problem; however, there is substantial heterogeneity in the outcomes measured and reported in research evaluating the effectiveness of the treatments. Therefore, we aim to develop a Core Outcome Set (COS) for studies evaluating the effectiveness of treatments for neonatal sepsis. Since a systematic review of key outcomes from randomised trials of therapeutic interventions in neonatal sepsis was published recently, we will complement this with a qualitative systematic review of the key outcomes of neonatal sepsis identified by parents, other family members, parent representatives, healthcare providers, policymakers, and researchers. We will interpret the outcomes of both studies using a previously established framework. Stakeholders across three different groups i.e., (1) researchers, (2) healthcare providers, and (3) patients' parents/family members and parent representatives will rate the importance of the outcomes in an online Real-Time Delphi Survey. Afterwards, consensus meetings will be held to agree on the final COS through online discussions with key stakeholders. This COS is expected to minimize outcome heterogeneity in measurements and publications, improve comparability and synthesis, and decrease research waste.

Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions.

Introduction: Randomised controlled trials (RCTs) inform healthcare decisions. It is now apparent that some published RCTs contain false data and some appear to have been entirely fabricated. Systematic reviews are performed to identify and synthesise all RCTs that have been conducted on a given topic. While it is usual to assess methodological features of the RCTs in the process of undertaking a systematic review, it is not usual to consider whether the RCTs contain false data. Studies containing false data therefore go unnoticed and contribute to systematic review conclusions. The INSPECT-SR project will develop a tool to assess the trustworthiness of RCTs in systematic reviews of healthcare related interventions. Methods and analysis: The INSPECT-SR tool will be developed using expert consensus in combination with empirical evidence, over five stages: 1) a survey of experts to assemble a comprehensive list of checks for detecting problematic RCTs, 2) an evaluation of the feasibility and impact of applying the checks to systematic reviews, 3) a Delphi survey to determine which of the checks are supported by expert consensus, culminating in 4) a consensus meeting to select checks to be included in a draft tool and to determine its format, 5) prospective testing of the draft tool in the production of new health systematic reviews, to allow refinement based on user feedback. We anticipate that the INSPECT-SR tool will help researchers to identify problematic studies, and will help patients by protecting them from the influence of false data on their healthcare.

Gynecological trials frequently exclude people based on their symptoms rather than their condition: a systematic review of Cochrane reviews and their component trials.

OBJECTIVES: To identify strategies used in recent randomized controlled trials (RCTs) and their associated Cochrane Reviews where patients with the same gynecological condition present with different symptoms but would plausibly benefit from a common intervention. STUDY DESIGN AND SETTING: We searched the Cochrane library (February 2022) for reviews in polycystic ovarian syndrome (PCOS) and endometriosis. Reviews were included if the intervention was intended to treat all condition-specific symptoms. For each trial we recorded the strategy used and the number of potentially eligible participants excluded as a direct result of the chosen strategy. For each review we recorded the numbers of RCTs and participants excluded on the basis of symptoms experienced. RESULTS: There were 89 distinct PCOS trials in 13 reviews, and 13 Endometriosis trials in 11 reviews. Most trials restricted their eligibility to participants with specific symptoms (55% PCOS, 46% endometriosis). The second most common strategy was to measure and analyze clinical outcomes that were not relevant to all participants (38% PCOS, 31% endometriosis). Reviews excluded 27% of trials in participants evaluating the same intervention in participants experiencing the same condition based on the outcomes measured in the trials. CONCLUSION: Most gynecological trials exclude patients who could benefit from treatment or measure outcomes not relevant to all participants. We introduce a taxonomy to describe trial design strategies for conditions with heterogeneous symptoms.

Multi-Round versus Real-Time Delphi survey approach for achieving consensus in the COHESION core outcome set: a randomised trial.

BACKGROUND: Delphi surveys are commonly used to prioritise critical outcomes in core outcome set (COS) development. This trial aims to compare a three-round (Multi-Round) Delphi (MRD) with a Real-Time Delphi (RTD) in the prioritisation of outcomes for inclusion in a COS for neonatal encephalopathy treatments and explore whether 'feedback', 'iteration', and 'initial condition' effects may occur in the two survey methods. METHODS: We recruited 269 participants (parents/caregivers, healthcare providers and researchers/academics) of which 222 were randomised to either the MRD or the RTD. We investigated the outcomes prioritised in each survey and the 'feedback', 'iteration', and 'initial condition' effects to identify differences between the two survey methods. RESULTS: In the RTD, n = 92 participants (83%) fully completed the survey. In the MRD, n = 60 participants (54%) completed all three rounds. Of the 92 outcomes presented, 26 (28%) were prioritised differently between the RTD and MRD. Significantly fewer participants amended their scores when shown stakeholder responses in the RTD compared to the MRD ('feedback effect'). The 'iteration effect' analysis found most experts appeared satisfied with their initial ratings in the RTD and did not amend their scores following stakeholder response feedback. Where they did amend their scores, ratings were amended substantially, suggesting greater convergence. Variance in scores reduced with subsequent rounds of the MRD ('iteration effect'). Whilst most participants did not change their initial scores in the RTD, of those that did, later recruits tended to align their final score more closely to the group mean final score than earlier recruits (an 'initial condition' effect). CONCLUSION: The feedback effect differed between the two Delphi methods but the magnitude of this difference was small and likely due to the large number of observations rather than because of a meaningfully large difference. It did not appear to be advantageous to require participants to engage in three rounds of a survey due to the low change in scores. Larger drop-out through successive rounds in the MRD, together with a lesser convergence of scores and longer time to completion, indicate considerable benefits of the RTD approach. TRIAL REGISTRATION: NCT04471103. Registered on 14 July 2020.

Assessment highlights need for improvement in standards of development of core outcome sets for rare genetic diseases.

OBJECTIVES: A rare disease is classified as such if it affects less than one person in 2,000. The Core Outcome Set STandards for Development (COS-STAD) is a set of standards that represent the minimum recommendations to be considered in the process of core outcome set (COS) development. The aim of this study was to provide a baseline assessment of COS development standards for rare genetic diseases. STUDY DESIGN AND SETTING: Core Outcome Measures in Effectiveness Trials (COMET) database contains nearly 400 published COS studies according to the latest systematic review. Studies focusing on COS development for rare genetic diseases were eligible for inclusion and were assessed by two independent evaluators. RESULTS: Nine COS studies were included in the analysis. Eight different rare genetic diseases were investigated. None of the studies met all the standards for development. The number of standards met ranged from 6 to 10, and the median was 7. CONCLUSION: This study is the first study to assess COS-STAD for rare genetic diseases, and it highlights a great need for improvement. First in terms of numbers of rare diseases considered for COS developments, second in methodology, particularly regarding the consensus process, and third in reporting of the COS development studies.

Association between hearing loss and deprivation among Welsh adults: a cross-sectional observational study.

OBJECTIVE: To index levels of hearing loss with respect to area-level indices of deprivation in a Welsh population. DESIGN: A cross-sectional observational study of all adults (aged >18) that attended Abertawe Bro Morgannwg University (ABMU) Health Board audiology services between 2016 and 2018. Service access, first hearing aid fitting appointment rates and hearing loss at time of first hearing aid provision were used to index population hearing loss versus area-level indices of deprivation based on patient postcode. SETTING: Primary and secondary care. PARTICIPANTS: 59 493 patient entries met the inclusion criteria. Patient entries were grouped by age (18-30, 31-40, 41-50, 51-60, 61-70, 71-80, >80 years) and deprivation decile. RESULTS: The interaction between age group and deprivation decile predicted access rate to ABMU audiology services (b=-0.24, t(6858) = -2.86, p<0.01) with audiology services accessed more frequently by the most deprived versus the least deprived decile in every age group (p<0.05), except the >80 years. First hearing aid fitting rates were highest among the most deprived in the four youngest age groups (p<0.05). Severity of hearing loss at the time of first hearing aid fitting was worse among the most deprived in the five oldest age groups (p<0.01). CONCLUSIONS: Hearing health inequalities are prevalent among adults accessing ABMU audiology services. Our findings suggest that deprivation increases the likelihood of developing hearing loss, brings earlier onset of hearing loss and is linked to delays in getting help for hearing problems. However, it is not possible to know the true scale of these disparities without knowing the hearing health of the Welsh adult population including those who do not seek help for hearing problems.

Developing a core outcome set for hand fractures and joint injuries in adults.

The aim of this study was to develop a core outcome set of what to measure in all future clinical research on hand fractures and joint injuries in adults. Phase 1 consisted of steps to identify potential outcome domains through systematic review of published studies, and exploration of the patient perspective through qualitative research, consisting of 25 semi-structured interviews and five focus groups. Phase 2 involved key stakeholder groups (patients, hand surgeons, and hand therapists) prioritizing the outcome domains via a three-round international Delphi survey, with a final consensus meeting to agree the final core outcome set. The systematic review of 160 studies identified 74 outcome domains based on the World Health Organization International Classification of Functioning, Disability, and Health. Overall, 35 domains were generated through thematic analysis of the patient interviews and focus groups. The domains from these elements were synthesised to develop 37 outcome domains as the basis of the Delphi survey, with a further four generated from participant suggestions in Round 1. The Delphi survey identified 20 outcome domains as 'very important' for the core outcome set. At the consensus meeting, 27 participants from key stakeholder groups selected seven outcomes for the core outcome set: pain/discomfort with activity, pain/discomfort with rest, fine hand use/dexterity, self-hygiene/personal care, return to usual work/job, range of motion, and patient satisfaction with outcome/result. This set of core outcome domains is recommended as a minimum to be reported in all clinical research on hand fractures and joint injuries in adults. While this establishes what to measure, future work will focus on determining how best to measure these outcomes. By adopting this patient-centred core outcome set, consistency and comparability of studies will be improved, aiding meta-analysis and strengthening the evidence base for management of these common and impactful injuries.

Bridging pre-surgical endocrine therapy for breast cancer during the COVID-19 pandemic: outcomes from the B-MaP-C study.

PURPOSE: The B-MaP-C study investigated changes to breast cancer care that were necessitated by the COVID-19 pandemic. Here we present a follow-up analysis of those patients commenced on bridging endocrine therapy (BrET), whilst they were awaiting surgery due to reprioritisation of resources. METHODS: This multicentre, multinational cohort study recruited 6045 patients from the UK, Spain and Portugal during the peak pandemic period (Feb-July 2020). Patients on BrET were followed up to investigate the duration of, and response to, BrET. This included changes in tumour size to reflect downstaging potential, and changes in cellular proliferation (Ki67), as a marker of prognosis. RESULTS: 1094 patients were prescribed BrET, over a median period of 53 days (IQR 32-81 days). The majority of patients (95.6%) had strong ER expression (Allred score 7-8/8). Very few patients required expedited surgery, due to lack of response (1.2%) or due to lack of tolerance/compliance (0.8%). There were small reductions in median tumour size after 3 months' treatment duration; median of 4 mm [IQR - 20, 4]. In a small subset of patients (n = 47), a drop in cellular proliferation (Ki67) occurred in 26 patients (55%), from high (Ki67 ≥ 10%) to low (< 10%), with at least one month's duration of BrET. DISCUSSION: This study describes real-world usage of pre-operative endocrine therapy as necessitated by the pandemic. BrET was found to be tolerable and safe. The data support short-term (≤ 3 months) usage of pre-operative endocrine therapy. Longer-term use should be investigated in future trials.

Evaluation of editors' abilities to predict the citation potential of research manuscripts submitted to The BMJ: a cohort study.

OBJECTIVE: To evaluate the ability of The BMJ editors to predict the number of times submitted research manuscripts will be cited. DESIGN: Cohort study. SETTING: Manuscripts submitted to The BMJ, reviewed, and subsequently scheduled for discussion at a prepublication meeting between 27 August 2015 and 29 December 2016. PARTICIPANTS: 10 BMJ research team editors. MAIN OUTCOME MEASURES: Reviewed manuscripts were rated independently by attending editors for citation potential in the year of first publication plus the next year: no citations, below average (<10 citations), average (10-17 citations), or high (>17 citations). Predicted citations were subsequently compared with actual citations extracted from Web of Science (WOS). RESULTS: Of 534 manuscripts reviewed, 505 were published as full length articles (219 in The BMJ) by end of 2019 and indexed in WOS, 22 were unpublished, and one abstract was withdrawn. Among the 505 manuscripts, the median (IQR [range]) number of citations in the year of publication plus the following year was 9 (4-17 [0-150]); 277 (55%) manuscripts were cited <10 times, 105 (21%) were cited 10-17 times, and 123 (24%) cited >17 times. Manuscripts accepted by The BMJ were cited more highly (median 12 (IQR 7-24) citations) than those rejected (median 7 (3-12) citations). For all 10 editors, predicted ratings tended to increase in line with actual citations, but with considerable variation within categories; nine failed to identify the correct citation category for >50% (range 31%-52%) of manuscripts, and κ ranged between 0.01 to 0.19 for agreement between predicted and actual categories. Editors more often rated papers that achieved high actual citation counts as having low citation potential than the reverse. Collectively, the mean percentage of editors predicting the correct citation category was 43%, and for 160 (32%) manuscripts at least 50% of editors predicted the right category. CONCLUSIONS: Editors weren't good at estimating the citation potential of manuscripts individually or as a group; there is no wisdom of the crowd when it comes to BMJ editors.

Core outcomes in neonatal encephalopathy: a qualitative study with parents.

OBJECTIVE: To identify the outcomes considered important to parents or caregivers of infants diagnosed with neonatal encephalopathy, hypoxic ischaemic encephalopathy or birth asphyxia in high-income and low- to middle-income countries (LMiCs), as part of the outcome-identification process in developing a core outcome set (COS) for the treatment of neonatal encephalopathy. DESIGN: A qualitative study involving 25 semistructured interviews with parents or other family members (caregivers) of infants who were diagnosed with, and treated for, neonatal encephalopathy, hypoxic ischaemic encephalopathy or birth asphyxia. SETTING: Interviews were conducted in high-income countries (HiCs) (n=11) by Zoom video conferencing software and in LMiCs (n=14) by phone or face to face. FINDINGS: Parents identified 54 outcomes overall, which mapped to 16 outcome domains. The domains identified were neurological outcomes, respiratory outcomes, gastrointestinal outcomes, cardiovascular outcomes, motor development, cognitive development, development (psychosocial), development (special senses), cognitive development, development (speech and social), other organ outcomes, survival/living outcomes, long-term disability, hospitalisation, parent-reported outcomes and adverse events. CONCLUSIONS: This study provides insight into the outcomes that parents of infants diagnosed with neonatal encephalopathy have identified as the most important, to be considered in the process of developing a COS for the treatment of neonatal encephalopathy. We also provide description of the processes employed to ensure the inclusion of participants from LMiCs as well as HiCs.

Core outcomes for pressure ulcer prevention trials: results of an international consensus study: Classification: Outcomes and qualitative research.

BACKGROUND: There is substantial heterogeneity between trial outcomes in pressure ulcer prevention research. The development of core outcome sets is one strategy to improve comparability between trial results and thus increase the quality of evidence. OBJECTIVES: To identify core outcomes for pressure ulcer prevention trials. METHODS: A workshop was held with service users to discuss their views and understanding of the outcomes identified by a scoping review and to identify any missing outcomes. In a next step, a Delphi survey comprising three rounds was conducted to evaluate a compiled list of outcomes by their importance. Afterwards the preselection from the Delphi survey was discussed in a virtual consensus meeting with the aim of agreeing on a final set of core outcomes. Individuals who had completed all three rounds of the Delphi survey were eligible to participate in this meeting. Participants included practitioners, service users, researchers and industry representatives. The OUTPUTs project is registered in the COMET database and is part of the Cochrane Skin Core Outcome Set Initiative. RESULTS: The workshop did not reveal any missing outcomes, but highlighted the need for further efforts to make lay people understand what an outcome is in a study setting. The Delphi survey took place between December 2020 and June 2021. After the three rounds, 18 out of 37 presented outcomes were rated to be critically important. In the following consensus meeting, six outcomes were prioritized to be included in the core outcome set for pressure ulcer prevention trials: (i) pressure ulcer occurrence; (ii) pressure ulcer precursor signs and symptoms; (iii) mobility; (iv) acceptability and comfort of intervention; (v) adherence/compliance; and (vi) adverse events/safety. CONCLUSIONS: Based on a comprehensive list of outcomes in pressure ulcer prevention research, there was clear agreement on the six identified core outcomes in three international Delphi rounds and in the consensus meeting. Although outcome measurement instruments need to be identified next, the six identified core outcomes should already be considered in future trials, as service users, practitioners, researchers and industry representatives have agreed that they are critically important. What is already known about this topic? There are numerous trials on pressure ulcer prevention, but evidence on the effectiveness of preventive measures is limited due to heterogeneity between trial outcomes. The development of a core outcome set is one strategy to improve comparability between trial results. What does this study add? A service user workshop, a three-round Delphi survey and an online consensus meeting with practitioners, service users, researchers and industry representatives were conducted to identify core outcomes for pressure ulcer prevention trials. Six core outcomes were defined: (i) pressure ulcer occurrence, (ii) pressure ulcer precursor signs and symptoms, (iii) mobility, (iv) acceptability and comfort of intervention, (v) adherence/compliance and (vi) adverse events/safety. What are the clinical implications of this work? Better evidence of interventions for pressure ulcer prevention will help health professionals and service users to decide which interventions are most appropriate and effective. Better evidence may contribute to better pressure ulcer prevention.