Recording harms in randomised controlled trials of behaviour change interventions: a qualitative study of UK clinical trials units and NIHR trial investigators.

BACKGROUND: Harms, also known as adverse events (AEs), are recorded and monitored in randomised controlled trials (RCTs) to ensure participants' safety. Harms are recorded poorly or inconsistently in RCTs of Behaviour Change Interventions (BCI); however, limited guidance exists on how to record harms in BCI trials. This qualitative study explored experiences and perspectives from multi-disciplinary trial experts on recording harms in BCI trials. METHODS: Data were collected through fifteen in-depth semi-structured qualitative interviews and three focus groups with thirty-two participants who work in the delivery and oversight of clinical trials. Participants included multi-disciplinary staff from eight CTUs, Chief investigators, and patient and public representatives. Interviews and focus group recordings were transcribed verbatim and thematic analysis was used to analyse the transcripts. RESULTS: Five themes were identified, namely perception and understanding of harm, proportionate reporting and plausibility, the need for a multi-disciplinary approach, language of BCI harms and complex harms for complex interventions. Participants strongly believed harms should be recorded in BCI trials; however, making decisions on "how and what to record as harms" was difficult. Recording irrelevant harms placed a high burden on trial staff and participants, drained trial resources and was perceived as for little purpose. Participants believed proportionate recording was required that focused on events with a strong plausible link to the intervention. Multi-disciplinary trial team input was essential for identifying and collecting harms; however, this was difficult in practice due to lack of knowledge on harms from BCIs, lack of input or difference in opinion. The medical language of harms was recognised as a poor fit for BCI trial harms but was familiar and established within internal processes. Future guidance on this topic would be welcomed and could include summarised literature. CONCLUSIONS: Recording harms or adverse events in behaviour change intervention trials is complex and challenging; multi-disciplinary experts in trial design and implementation welcome forthcoming guidance on this topic. Issues include the high burden of recording irrelevant harms and use of definitions originally designed for drug trials. Proportionate recording of harms focused on events with a strong plausible link to the intervention and multi-disciplinary team input into decision making are essential.

Recording harms in randomized controlled trials of behavior change interventions: a scoping review and map of the evidence.

OBJECTIVES: Randomized controlled trials evaluate diverse interventions. This can include medical interventions such as drugs or surgical procedures, or behavior change interventions (BCIs) that aim to change a habit, belief, or attitude to improve health, for example, healthy eating, psychological wellbeing. Harms are often recorded poorly or inconsistently within randomized controlled trials of BCIs. This scoping review aimed to collate and describe literature on categories, definitions, and mechanisms of harms from BCIs; methods of identifying plausible harms; and recommendations for recording harms. STUDY DESIGN AND SETTING: A scoping review was conducted. Three databases (MEDLINE, PsycINFO, and CINAHL) were searched. Reference list checking and citation searching were performed. Articles were included if they discussed (1) interventions that aimed to modify behavior, (2) categories or mechanisms of harms, and (3) methods or recommendations for recording harms. All research designs were included. One reviewer reviewed titles, abstracts, and full texts; queries were checked with another reviewer. Data were extracted and synthesized descriptively by one reviewer and checked by another reviewer. A thematic map was constructed to summarize the review findings. Harms described from specific BCIs were identified, and examples were selected and summarized. RESULTS: The review included 37 articles. Nineteen of 37 articles contributed to a thematic review. Three articles described categories of harms; categories of harm included physical, psychological, group and social interactions, cultural, equity, opportunity cost, environmental, and economic. Seven articles included mechanisms or underlying factors for harms including feelings of failure leading to shame or stigma, and group interventions enabling knowledge exchange on unhealthy behaviors. Twelve articles provided recommendations for recording harms, including taking a proportionate approach by focusing on the most plausible and important harms, collecting different perspectives on whether harms had occurred (eg, caregivers and family members), and using qualitative research methods to identify harms. One article described a three-step method to identify plausible harms from an intervention, and six articles supported aspects of the method. Eighteen of 37 articles contributed to a review which collated harms arising from specific interventions, for example, a peer support intervention in inflammatory bowel disease caused distressing conversations which might lead to anxiety and confrontation with a possible negative future. CONCLUSION: BCIs can cause harm. This review identified categories and proposed mechanisms of harms, as well as methods and recommendations for identifying and recording harms in BCIs for inclusion in forthcoming recommendations.

Efficacy and safety of autologous haematopoietic stem cell transplantation versus alemtuzumab, ocrelizumab, ofatumumab or cladribine in relapsing remitting multiple sclerosis (StarMS): protocol for a randomised controlled trial.

INTRODUCTION: Autologous haematopoietic stem cell transplantation (aHSCT) is increasingly used as treatment for patients with active multiple sclerosis (MS), typically after failure of disease-modifying therapies (DMTs). A recent phase III trial, 'Multiple Sclerosis International Stem Cell Transplant, MIST', showed that aHSCT resulted in prolonged time to disability progression compared with DMTs in patients with relapsing remitting MS (RRMS). However, the MIST trial did not include many of the current high-efficacy DMTs (alemtuzumab, ocrelizumab, ofatumumab or cladribine) in use in the UK within the control arm, which are now offered to patients with rapidly evolving severe MS (RES-MS) who are treatment naïve. There remain, therefore, unanswered questions about the relative efficacy and safety of aHSCT over these high-efficacy DMTs in these patient groups. The StarMS trial (Autologous Stem Cell Transplantation versus Alemtuzumab, Ocrelizumab, Ofatumumab or Cladribine in Relapsing Remitting Multiple Sclerosis) will assess the efficacy, safety and long-term impact of aHSCT compared with high-efficacy DMTs in patients with highly active RRMS despite the use of standard DMTs or in patients with treatment naïve RES-MS. METHODS AND ANALYSIS: StarMS is a multicentre parallel-group rater-blinded randomised controlled trial with two arms. A total of 198 participants will be recruited from 19 regional neurology secondary care centres in the UK. Participants will be randomly allocated to the aHSCT arm or DMT arm in a 1:1 ratio. Participants will remain in the study for 2 years with follow-up visits at 3, 6, 9, 12, 18 and 24 months postrandomisation. The primary outcome is the proportion of patients who achieve 'no evidence of disease activity' during the 2-year postrandomisation follow-up period in an intention to treat analysis. Secondary outcomes include efficacy, safety, cost-effectiveness and immune reconstitution of aHSCT and the four high-efficacy DMTs. ETHICS AND DISSEMINATION: The study was approved by the Yorkshire and Humber-Leeds West Research Ethics Committee (20/YH/0061). Participants will provide written informed consent prior to any study specific procedures. The study results will be submitted to a peer-reviewed journal and abstracts will be submitted to relevant national and international conferences. TRIAL REGISTRATION NUMBER: ISRCTN88667898.

Personalised versus standard text message prompts for increasing trial participant response to telephone follow-up: an embedded randomised controlled retention trial.

BACKGROUND: Improving retention within randomised controlled trials is important. The effectiveness of different strategies can be assessed using a Study Within A Trial (SWAT). Previous research has shown personalised text message reminders improve clinic attendance rates; however, the results are mixed on improving postal questionnaire return. This SWAT aims to assess whether personalised text message reminders improve completion rates for scheduled telephone follow-ups. METHODS: This SWAT is a two-arm, multi-centre randomised controlled trial with equal allocation. The host trial was the Melatonin for Anxiety prior to General anaesthesia In Children trial (ISRCTN 18296119), where the child's caregiver was to answer a scheduled telephone follow-up 14 days post-surgery; participants for the SWAT were therefore the caregiver. Text messages were sent 24-48 h before the scheduled call and the personalised version contained the first name of the caregiver which was omitted in the non-personalised version. The primary outcome was questionnaire completion rate, defined as the proportion of caregivers successfully contacted, and completed any of the questionnaires, over the telephone within the follow-up window (day 14 + 7 days). RESULTS: The SWAT included 100 of the 110 (91%) participants randomised into the host trial. Randomisation within the SWAT was equal between non-personalised (n = 50) and personalised (n = 50) interventions. The overall questionnaire response rate was 73% with a difference between the two interventions of 68% in the non-personalised text message arm and 78% in the personalised text message arm. The adjusted absolute risk difference was 7.1% (95% confidence interval = -10.2%, 24.4%). There was no difference in either the time to response or the number of contact attempts between the two interventions. CONCLUSIONS: There is some evidence that personalised text messages could be effective at increasing response rates when data is collected via telephone and in a population of caregivers for paediatric trial participants. However, similar SWATs have shown mixed results. Given the low-cost and low risks associated with personalising text message reminders, this SWAT could be implemented easily in other RCTs scheduling telephone follow-up appointments. TRIAL REGISTRATION: ISRCTN 18296119 , SWAT 35 (MRC Northern Ireland Network for Trials Methodology Network).

Safety and efficacy of autologous haematopoietic stem-cell transplantation with low-dose cyclophosphamide mobilisation and reduced intensity conditioning versus standard of care in refractory Crohn's disease (ASTIClite): an open-label, multicentre, randomised controlled trial.

BACKGROUND: A previous controlled trial of autologous haematopoietic stem-cell transplantation (HSCT) in patients with refractory Crohn's disease did not meet its primary endpoint and reported high toxicity. We aimed to assess the safety and efficacy of HSCT with an immune-ablative regimen of reduced intensity versus standard of care in this patient population. METHODS: This open-label, multicentre, randomised controlled trial was conducted in nine National Health Service hospital trusts across the UK. Adults (aged 18-60 years) with active Crohn's disease on endoscopy (Simplified Endoscopic Score for Crohn's Disease [SES-CD] ulcer sub-score of ≥2) refractory to two or more classes of biological therapy, with no perianal or intra-abdominal sepsis or clinically significant comorbidity, were recruited. Participants were centrally randomly assigned (2:1) to either HSCT with a reduced dose of cyclophosphamide (intervention group) or standard care (control group). Randomisation was stratified by trial site by use of random permuted blocks of size 3 and 6. Patients in the intervention group underwent stem-cell mobilisation (cyclophosphamide 1 g/m2 with granulocyte colony-stimulating factor (G-CSF) 5 µg/kg) and stem-cell harvest (minimum 2·0 × 106 CD34+ cells per kg), before conditioning (fludarabine 125 mg/m2, cyclophosphamide 120 mg/kg, and rabbit anti-thymocyte globulin [thymoglobulin] 7·5 mg/kg in total) and subsequent stem-cell reinfusion supported by G-CSF. Patients in the control group continued any available conventional, biological, or nutritional therapy. The primary outcome was absence of endoscopic ulceration (SES-CD ulcer sub-score of 0) without surgery or death at week 48, analysed in the intention-to-treat population by central reading. This trial is registered with the ISRCTN registry, 17160440. FINDINGS: Between Oct 18, 2018, and Nov 8, 2019, 49 patients were screened for eligibility, of whom 23 (47%) were randomly assigned: 13 (57%) to the intervention group and ten (43%) to the control group. In the intervention group, ten (77%) participants underwent HSCT and nine (69%) reached 48-week follow-up; in the control group, nine (90%) reached 48-week follow-up. The trial was halted in response to nine reported suspected unexpected serious adverse reactions in six (46%) patients in the intervention group, including renal failure due to proven thrombotic microangiopathy in three participants and one death due to pulmonary veno-occlusive disease. At week 48, absence of endoscopic ulceration without surgery or death was reported in three (43%) of seven participants in the intervention group and in none of six participants in the control group with available data. Serious adverse events were more frequent in the intervention group (38 in 13 [100%] patients) than in the control group (16 in four [40%] patients). A second patient in the intervention group died after week 48 of respiratory and renal failure. INTERPRETATION: Although HSCT with an immune-ablative regimen of reduced intensity decreased endoscopic disease activity, significant adverse events deem this regimen unsuitable for future clinical use in patients with refractory Crohn's disease. FUNDING: Efficacy and Mechanism Evaluation Programme, a Medical Research Council and National Institute for Health Research partnership.

The MAGIC trial: a pragmatic, multicentre, parallel, noninferiority, randomised trial of melatonin versus midazolam in the premedication of anxious children attending for elective surgery under general anaesthesia.

BACKGROUND: Child anxiety before general anaesthesia and surgery is common. Midazolam is a commonly used premedication to address this. Melatonin is an alternative anxiolytic, however trials evaluating its efficacy in children have delivered conflicting results. METHODS: This multicentre, double-blind randomised trial was performed in 20 UK NHS Trusts. A sample size of 624 was required to declare noninferiority of melatonin. Anxious children, awaiting day case elective surgery under general anaesthesia, were randomly assigned 1:1 to midazolam or melatonin premedication (0.5 mg kg-1, maximum 20 mg) 30 min before transfer to the operating room. The primary outcome was the modified Yale Preoperative Anxiety Scale-Short Form (mYPAS-SF). Secondary outcomes included safety. Results are presented as n (%) and adjusted mean differences with 95% confidence intervals. RESULTS: The trial was stopped prematurely (n=110; 55 per group) because of recruitment futility. Participants had a median age of 7 (6-10) yr, and 57 (52%) were female. Intention-to-treat and per-protocol modified Yale Preoperative Anxiety Scale-Short Form analyses showed adjusted mean differences of 13.1 (3.7-22.4) and 12.9 (3.1-22.6), respectively, in favour of midazolam. The upper 95% confidence interval limits exceeded the predefined margin of 4.3 in both cases, whereas the lower 95% confidence interval excluded zero, indicating that melatonin was inferior to midazolam, with a difference considered to be clinically relevant. No serious adverse events were seen in either arm. CONCLUSION: Melatonin was less effective than midazolam at reducing preoperative anxiety in children, although the early termination of the trial increases the likelihood of bias. CLINICAL TRIAL REGISTRATION: ISRCTN registry: ISRCTN18296119.

A scoping literature review on minimum intervention dentistry for children with dental caries.

Background Dental caries in children's permanent teeth remains a global burden. In contrast to the traditional approach of treating the disease through surgical operative intervention, minimum intervention has increasingly been recommended for managing children with dental caries.Aim This scoping review aimed to describe the literature related to the provision of minimum intervention dentistry for children with caries and to identify research gaps.Methods Electronic databases (Medline via Ovid, PubMed, Web of Science and Scopus) were searched, together with grey literature databases, and key organisation websites. Data was extracted on a piloted extraction template and a thematic analysis was undertaken.Results Sixty-seven relevant articles were identified. No empirical literature was identified that assessed a complete minimum intervention care pathway to managing caries. Five themes were identified from the scoping literature: evidence base, clinician attitude and skills, practice implementation, acceptability and environmental factors.Conclusions The majority of articles were opinion papers. There is a paucity of empirical evidence supporting the clinical and cost-effectiveness of a minimum intervention pathway for children with dental caries in primary dental care. The scoping review has identified some potential barriers to the implementation of such a care pathway, including regulatory and remunerative frameworks and clinical training/education.

Melatonin for pre-medication in children: a systematic review.

BACKGROUND: Melatonin's effectiveness as an anxiolytic medication has been confirmed in adults; however, its efficacy in a paediatric population is unclear. A number of small studies have assessed its use in children as a pre-operative anxiolytic, with conflicting results. METHODS: We undertook a systematic review of pre-operative melatonin use in children. Four databases (MEDLINE, Embase, the Cochrane Central Register of Controlled Trials and Web of Science), and ' ClinicalTrials.gov ' were searched for ongoing and completed clinical trials of relevance. Citation tracking reference lists and relevant articles were also accessed. The review was unrestricted by comparator or outcomes. Eleven studies were judged eligible for inclusion. There were high levels of heterogeneity in melatonin administration (in terms of dose and timing). Variable outcomes were reported and included: anxiety; anaesthetic success; analgesia; sedation; post-operative recovery; and safety. Outcomes were not always assessed with the same measures. RESULTS: Evidence to support melatonin's anxiolytic properties in this setting is conflicting. Melatonin was associated with reduced sedative effects, post-operative excitement and improved emergence behaviour, compared to comparator drugs. One study reported the benefit of melatonin use on sleep disturbance at two weeks post-surgery. No adverse safety events were identified to be significantly associated with melatonin, affirming its excellent safety profile. CONCLUSION: Despite potential advantages, including improved emergence behaviour, based on current evidence we cannot confirm whether melatonin is non-inferior to current "usual care" pre-medications. Further consideration of melatonin as an anxiolytic pre-medication in paediatric surgery is needed.

Stakeholder perspectives on barriers and enablers to recruiting anxious children undergoing day surgery under general anaesthetic: a qualitative internal pilot study of the MAGIC randomised controlled trial.

BACKGROUND: The 'Melatonin for Anxiety prior to General anaesthesia In Children' (MAGIC) trial was designed to compare midazolam and melatonin as pre-medications for anxious children (aged five to fourteen), undergoing day-case surgical procedures under general anaesthesia. Low recruitment is a challenge for many trials, particularly paediatric trials and those in 'emergency' settings. A qualitative study as part of MAGIC aimed to gather stakeholder perspectives on barriers and enablers to recruitment. METHODS: Sixteen stakeholders from six sites participated in semi-structured interviews about their experiences of setting up the MAGIC trial and recruiting patients as part of the internal pilot. Data was analysed using framework analysis. RESULTS: Participants identified barriers and enablers to recruitment. Barriers and enablers related to the study, participants, the population of anxious children, practitioners, collaboration with other health professionals, ethics, specific settings and the context of surgical day units and the wider health system. Attempting to recruit anxious children from a surgical day unit is particularly challenging for several reasons. Issues include the practicalities of dealing with a child experiencing anxiety for parents/guardians; professional unwillingness to make things more difficult for families and clinicians and nurses valuing predictability within a busy and time-sensitive setting. CONCLUSIONS: Multi-site RCTs face recruitment barriers relating to study-wide and site-specific factors. There are multiple barriers to recruiting anxious children due to undergo day-case surgery. Barriers across domains can interrelate and reinforce each other, reflecting challenges relating to populations and settings. For example, in the case of anxious children, parents and other health professionals are concerned about exacerbating children's anxiety prior to surgery. They may look for ways to keep things predictable and avoid the uncertainty of an RCT. Pre-trial engagement work could help address concerns among collaborating health professionals. Using rapid ethnography during set-up or an internal pilot to focus on how the protocol will be or has been operationalised in practice may help identify issues. Allowing time to reflect on the findings of internal pilots and implement necessary changes could facilitate higher recruitment during the main phase of a trial. TRIAL REGISTRATION: NIHR Trial Registration Number: ISRCTN18296119 . Registered on October 01, 2019.

Adverse event recording failed to reflect potential harms: a review of trial protocols of behavioral, lifestyle and psychological therapy interventions.

OBJECTIVE: To explore how potential harms are assessed in trials of behavioral, lifestyle and psychological therapy interventions. STUDY DESIGN AND SETTING: This study was a review of protocols from the National Institute of Health Research Health Technology Assessment and Public Health Research programmes. Protocols were included if the study was a randomized controlled trial and the intervention intended to change lifestyle or behavior to improve health or improve psychological outcomes. RESULTS: 95 of 151 protocols planned to record adverse events (AEs). Definitions of AEs were often not given and varied widely. Serious AEs were mostly defined using standards originally devised for pharmacological trials. Twenty-two protocols listed expected AEs. Few protocols described assessment of causation between AEs and intervention. Examples of useful AE recording practice were identified. CONCLUSION: Monitoring and recording AEs in behavioral intervention trials was variable and frequently based on reporting guidelines for pharmacological trials. This may mean potential harms are being missed. Future trials should consider: 1) Potential harms posed by the intervention 2) How to define serious AEs 3) What are expected AEs. Further research to achieve consensus on AE recording is required, including identification of core adverse outcomes in clinical areas or caused by interventions.

Challenges in the design, planning and implementation of trials evaluating group interventions.

BACKGROUND: Group interventions are interventions delivered to groups of people rather than to individuals and are used in healthcare for mental health recovery, behaviour change, peer support, self-management and/or health education. Evaluating group interventions in randomised controlled trials (RCTs) presents trialists with a set of practical problems, which are not present in RCTs of one-to-one interventions and which may not be immediately obvious. METHODS: Case-based approach summarising Sheffield trials unit's experience in the design and implementation of five group interventions. We reviewed participant recruitment and attrition, facilitator training and attrition, attendance at the group sessions, group size and fidelity aspects across five RCTs. RESULTS: Median recruitment across the five trials was 3.2 (range 1.7-21.0) participants per site per month. Group intervention trials involve a delay in starting the intervention for some participants, until sufficient numbers are available to start a group. There was no evidence that the timing of consent, relative to randomisation, affected post-randomisation attrition which was a matter of concern for all trial teams. Group facilitator attrition was common in studies where facilitators were employed by the health system rather than the by the grant holder and led to the early closure of one trial; research sites responded by training 'back-up' and new facilitators. Trials specified that participants had to attend a median of 62.5% (range 16.7%-80%) of sessions, in order to receive a 'therapeutic dose'; a median of 76.7% (range 42.9%-97.8%) received a therapeutic dose. Across the five trials, 75.3% of all sessions went ahead without the pre-specified ideal group size. A variety of methods were used to assess the fidelity of group interventions at a group and individual level across the five trials. CONCLUSION: This is the first paper to provide an empirical basis for planning group intervention trials. Investigators should expect delays/difficulties in recruiting groups of the optimal size, plan for both facilitator and participant attrition, and consider how group attendance and group size affects treatment fidelity. TRIAL REGISTRATION: ISRCTN17993825 registered on 11/10/2016, ISRCTN28645428 registered on 11/04/2012, ISRCTN61215213 registered on 11/05/2011, ISRCTN67209155 registered on 22/03/2012, ISRCTN19447796 registered on 20/03/2014.

Autologous stem cell transplantation in refractory Crohn's disease - low intensity therapy evaluation (ASTIClite): study protocols for a multicentre, randomised controlled trial and observational follow up study.

BACKGROUND: Intestinal inflammation in Crohn's disease (CD) is caused by mucosal immune system reactivity to luminal antigen and results in debilitating symptoms, reduced quality of life, impaired work productivity and significant health care costs. Not all patients respond to conventional and biologic therapies, with chronic inflammation ensuing. Although surgical resection may be required, disease frequently returns and surgery may not be an option, or may be declined. Case reports suggest potential benefit after haematopoietic stem cell transplant (HSCT) for patients with refractory CD. The ASTIC trial asked whether HSCT could cure CD. Few patients achieved the primary endpoint of clinical remission for 3 months, off all medication with no evidence of active disease, and there were a high number of adverse events (AEs) and serious adverse events (SAEs), including one patient death. However, beneficial effects were observed in some aspects of disease activity. The ASTIClite trial will investigate these potential benefits and safety using a lower intensity regimen than ASTIC. METHODS: Ninety-nine participants will be recruited from secondary care IBD centres in the UK into a multicentre, randomised controlled trial (RCT, ASTIClite) and an observational follow-up, and randomised to autologous HSCT versus standard care (ratio 2:1). The primary endpoint is treatment success at week 48, defined as mucosal healing without surgery or death. Secondary endpoints relating to efficacy, safety and mechanistic analyses will be evaluated at week 8, 14, 24, 32, 40 and 48. Long-term safety of the low intensity HSCT regimen forms the primary endpoint for the EBMT follow-up study and will be assessed annually for 4-7 years. DISCUSSION: ASTIClite will compare HSCTlite with standard care with respect to safety, efficacy and quality of life, and capture outcomes allowing findings to be generalised to current clinical practice in the UK. It will also provide significant mechanistic insights into the immunological consequences of HSCTlite and its impact on treatment outcomes. The observational follow-up will provide information, which is currently unavailable for this population. TRIAL REGISTRATION: The ASTIClite RCT was registered on 31st October 2017 ( ISRCTN17160440 ) and the EBMT follow-up study on 19th January 2018 ( ISRCTN31981313 ).

A cluster randomised trial, cost-effectiveness analysis and psychosocial evaluation of insulin pump therapy compared with multiple injections during flexible intensive insulin therapy for type 1 diabetes: the REPOSE Trial.

BACKGROUND: Insulin is generally administered to people with type 1 diabetes mellitus (T1DM) using multiple daily injections (MDIs), but can also be delivered using infusion pumps. In the UK, pumps are recommended for patients with the greatest need and adult use is less than in comparable countries. Previous trials have been small, of short duration and have failed to control for training in insulin adjustment. OBJECTIVE: To assess the clinical effectiveness and cost-effectiveness of pump therapy compared with MDI for adults with T1DM, with both groups receiving equivalent structured training in flexible insulin therapy. DESIGN: Pragmatic, multicentre, open-label, parallel-group cluster randomised controlled trial, including economic and psychosocial evaluations. After participants were assigned a group training course, courses were randomly allocated in pairs to either pump or MDI. SETTING: Eight secondary care diabetes centres in the UK. PARTICIPANTS: Adults with T1DM for > 12 months, willing to undertake intensive insulin therapy, with no preference for pump or MDI, or a clinical indication for pumps. INTERVENTIONS: Pump or MDI structured training in flexible insulin therapy, followed up for 2 years. MDI participants used insulin analogues. Pump participants used a Medtronic Paradigm® VeoTM (Medtronic, Watford, UK) with insulin aspart (NovoRapid, Novo Nordisk, Gatwick, UK). MAIN OUTCOME MEASURES: Primary outcome - change in glycated haemoglobin (HbA1c) at 2 years in participants whose baseline HbA1c was ≥ 7.5% (58 mmol/mol). Key secondary outcome - proportion of participants with HbA1c ≤ 7.5% at 2 years. Other outcomes at 6, 12 and 24 months - moderate and severe hypoglycaemia; insulin dose; body weight; proteinuria; diabetic ketoacidosis; quality of life (QoL); fear of hypoglycaemia; treatment satisfaction; emotional well-being; qualitative interviews with participants and staff (2 weeks), and participants (6 months); and ICERs in trial and modelled estimates of cost-effectiveness. RESULTS: We randomised 46 courses comprising 317 participants: 267 attended a Dose Adjustment For Normal Eating course (132 pump; 135 MDI); 260 were included in the intention-to-treat analysis, of which 235 (119 pump; 116 MDI) had baseline HbA1c of ≥ 7.5%. HbA1c and severe hypoglycaemia improved in both groups. The drop in HbA1c% at 2 years was 0.85 on pump and 0.42 on MDI. The mean difference (MD) in HbA1c change at 2 years, at which the baseline HbA1c was ≥ 7.5%, was -0.24% [95% confidence interval (CI) -0.53% to 0.05%] in favour of the pump (p = 0.098). The per-protocol analysis showed a MD in change of -0.36% (95% CI -0.64% to -0.07%) favouring pumps (p = 0.015). Pumps were not cost-effective in the base case and all of the sensitivity analyses. The pump group had greater improvement in diabetes-specific QoL diet restrictions, daily hassle plus treatment satisfaction, statistically significant at 12 and 24 months and supported by qualitative interviews. LIMITATION: Blinding of pump therapy was not possible, although an objective primary outcome was used. CONCLUSION: Adding pump therapy to structured training in flexible insulin therapy did not significantly enhance glycaemic control or psychosocial outcomes in adults with T1DM. RESEARCH PRIORITY: To understand why few patients achieve a HbA1c of < 7.5%, particularly as glycaemic control is worse in the UK than in other European countries. TRIAL REGISTRATION: Current Controlled Trials ISRCTN61215213. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 20. See the NIHR Journals Library website for further project information.

A systematic review and meta-analysis to determine the contribution of mr imaging to the diagnosis of foetal brain abnormalities In Utero.

OBJECTIVES: This systematic review was undertaken to define the diagnostic performance of in utero MR (iuMR) imaging when attempting to confirm, exclude or provide additional information compared with the information provided by prenatal ultrasound scans (USS) when there is a suspicion of foetal brain abnormality. METHODS: Electronic databases were searched as well as relevant journals and conference proceedings. Reference lists of applicable studies were also explored. Data extraction was conducted by two reviewers independently to identify relevant studies for inclusion in the review. Inclusion criteria were original research that reported the findings of prenatal USS and iuMR imaging and findings in terms of accuracy as judged by an outcome reference diagnosis for foetal brain abnormalities. RESULTS: 34 studies met the inclusion criteria which allowed diagnostic accuracy to be calculated in 959 cases, all of which had an outcome reference diagnosis determined by postnatal imaging, surgery or autopsy. iuMR imaging gave the correct diagnosis in 91 % which was an increase of 16 % above that achieved by USS alone. CONCLUSION: iuMR imaging makes a significant contribution to the diagnosis of foetal brain abnormalities, increasing the diagnostic accuracy achievable by USS alone. KEY POINTS: • Ultrasound is the primary modality for monitoring foetal brain development during pregnancy • iuMRI used together with ultrasound is more accurate for detecting foetal brain abnormalities • iuMR imaging is most helpful for detecting midline brain abnormalities • The moderate heterogeneity of reviewed studies may compromise findings.

A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures.

BACKGROUND: Generic preference-based measures of health like the EQ-5D and SF-6D(®) are increasingly being used in economic evaluation and outcome assessment. However, there are concerns as to whether or not these generic measures are appropriate for use in people with mental health problems. OBJECTIVES: The EQ-5D and SF-36(®) (including its derivatives the SF-12(®) and SF-6D) were assessed using the psychometric criteria of validity and responsiveness using quantitative and qualitative methods. Another aim was to estimate mapping functions between the EQ-5D and SF-6D and condition-specific measures, where appropriate. DESIGN: Four studies were undertaken to examine the appropriateness of the measures: (1) a systematic review of quantitative evidence on validity and responsiveness; (2) a further quantitative assessment of these criteria using existing data sets; (3) a review of qualitative research on the quality of life of people with mental health problems; and (4) qualitative semistructured interviews of people with a full range of problems. A fifth study estimated mapping functions between mental health-specific measures and the EQ-5D and SF-6D. SETTING: A choice of venue was offered for the interviews including the participant's own home, a room at the university or a centre frequently used by mental health services. PARTICIPANTS: The interviews were undertaken with 19 people with a broad range of mental health problems at varying levels of severity. MAIN OUTCOME MEASURES: The reviews included the EQ-5D and SF-36 (and the SF-12 and SF-6D). The psychometric analysis included the Hospital Anxiety and Depression Scale (HADS), Clinical Outcomes in Routine Evaluation - Outcome Measure (CORE-OM), Generalised Anxiety Disorder Assessment (GAD-7), General Health Questionnaire (GHQ-12) and Patient Health Questionnaire (PHQ-9). RESULTS: (1) and (2) The EQ-5D and SF-36 achieved an adequate level of performance in depression, and to some extent in anxiety and personality disorder. Results from the psychometric analyses in schizophrenia and bipolar disorder have been more mixed. (3) A framework analysis of 13 studies identified six major themes. (4) The interview data fitted the themes from the review well and resulted in minor modifications to the themes. The final set of themes comprised: well-being and ill-being; control, autonomy and choice; self-perception; belonging; activity; hope and hopelessness; and physical health. CONCLUSIONS: The EQ-5D and SF-36 achieved mixed results in the quantitative testing against psychometric criteria. The qualitative analysis suggests this is because they provide a very limited coverage of themes identified by people with mental health problems. Recommendations for future work include the development of new preference-based measures in mental health that are based on, or substantially revise, an existing measure. FUNDING: The Medical Research Council.

Systematic searching and selection of health state utility values from the literature.

Health state utility values (HSUVs) are important parameters in decision models in health technology assessment submissions. Reimbursement agencies, such as the National Institute for Health and Clinical Excellence, recognize that such values are obtainable from the published literature. However, to use published values in health technology assessment submissions, it should be demonstrated that HSUVs have been identified and selected systematically to avoid using biased HSUVs resulting in cost-effectiveness analyses. This article presents guidance on how to conduct a systematic literature review to identify and select HSUVs from the published literature based on the authors' experience. A case study is used to demonstrate some of the features of a systematic HSUV review. Methods are discussed in relation to identifying and selecting the evidence, performing quality and relevance assessment, and undertaking data extraction. It has been developed from a Technical Support Document produced for the National Institute for Health and Clinical Excellence by the Decision Support Unit at the School of Health and Related Research, University of Sheffield.

Trabectedin for the treatment of advanced metastatic soft tissue sarcoma: a NICE single technology appraisal.

The National Institute for Health and Clinical Excellence (NICE) invited the manufacturer of trabectedin (PharmaMar) to submit evidence for the clinical and cost effectiveness of this drug for the treatment of advanced metastatic soft tissue sarcoma (aMSTS), as part of the Institute's single technology appraisal (STA) process. The School of Health and Related Research (ScHARR) was commissioned to act as the Evidence Review Group (ERG). This paper provides a description of the company submission, the ERG review and NICE's subsequent decisions. The ERG produced a review of the evidence for the clinical and cost effectiveness of the technology contained within the manufacturer's submission to NICE. The ERG also independently modified the manufacturer's decision analytic model to examine the impact of altering some of the key assumptions. The main evidence was derived from a single phase II randomized controlled trial (RCT) conducted in liposarcoma and leiomyosarcoma only, in which the licensed dose of trabectedin was compared with a different dose of trabectedin. Additional data were also presented from three uncontrolled phase II trials. Supplementary studies were used to represent best supportive care (BSC). The median overall survival (OS) was 13.9 months for the licensed dose of trabectedin in the main randomized controlled trial (RCT) and ranged from 9.2 months to 12.8 months in the other studies included. Supplementary studies supplied by the manufacturer, and assumed to represent BSC, had median OS of 5.9-6.6 months. The progression-free survival (PFS) rates at 6 months for trabectedin were 35.5 % in the main RCT and 24.4-29 % in the other studies included. The PFS rates at 6 months were 8-14 % for BSC. In the manufacturer's original submission to NICE, the base-case incremental cost-effectiveness ratio (ICER) of trabectedin compared with BSC was approximately £44,000 per QALY gained. After amendment of errors identified by the ERG, the ICER reported by the manufacturer increased to approximately £61,000. The ERG concluded that, despite clarifications from the manufacturer and the revisions made to the model, there was still considerable uncertainty in the ICER. The NICE Appraisal Committee (AC) gave a negative initial recommendation, although indicated that trabectedin in aMSTS met the end-of-life criteria. Subsequently, the manufacturer submitted a patient access scheme (PAS) where any cycles beyond the fifth were provided at no cost by the manufacturer. This improved the ICER to approximately £34,000 per QALY gained. The AC gave a positive recommendation, subject to the implementation of the PAS.

How to measure quality of life for cost-effectiveness analyses of personality disorders: a systematic review.

A systematic review was undertaken to assess the construct validity and responsiveness of four generic health-related quality of life (HRQL) measures in personality disorders (PDs). Ten databases were searched and reference lists scrutinized to identify relevant studies. Relevant data were extracted accordingly. A narrative synthesis was performed of the evidence on construct validity, including known groups validity (detecting differences in HRQL scores between two different groups), convergent validity (strength of association between generic HRQL), and other measures (e.g., symptom) and responsiveness (differences in generic HRQL measure scores in responders/nonresponders or correlation with changes in other measures). Ten studies were identified: six of the EQ-5D, two involving the SF-36, and another two the SF-12, but none with the SF-6D. Evidence indicated that the EQ-5D, SF-36, and SF-12 were probably valid measures with PDs. Four studies demonstrated that the EQ-5D Index was able to detect changes in patients. The authors conclude that generic HRQL measures appear appropriate for use with people with PDs in terms of psychometric performance. However, qualitative concerns remain as to whether they fully reflect the impact of the condition.

A qualitative study of manufacturers' submissions to the UK NICE single technology appraisal process.

OBJECTIVES: As part of the National Institute for Health and Clinical Excellence (NICE) Single Technology Appraisal (STA) process, manufacturers present submissions outlining the clinical and cost-effectiveness of new technologies. These submissions are critically appraised by Evidence Review Groups (ERGs), who produce a report, which forms part of the evidence considered by the NICE Appraisal Committees. The purpose of this research was first to identify common issues and concerns identified by the ERGs in their analyses of manufacturers' submissions (MS). The aim was then to use these as a basis to develop feedback for manufacturers. DESIGN: A qualitative study using a content analysis approach to examine two sources of evidence, the first 30 ERG reports and 21 clarification letters associated with these STAs. SETTING: UK HTA programme. PRIMARY AND SECONDARY OUTCOME MEASURES: Common issues and concerns in MS. RESULTS: There were positive comments regarding the quality of the MS, many of which were clearly written. The majority, however, were generally of poor quality and issues and concerns identified across the ERG reports and clarification letters included: criticisms related to the data being used especially data employed in the cost-effectiveness model, failure to perform a necessary analysis and poor reporting of processes used in the MS. Aspects of the decision problem were also often poorly or inadequately addressed by manufacturers. The majority of points raised for clarification related to the economic data analysis. Internal inconsistencies between the clinical and economic sections of the submission were frequently highlighted. These were used as the basis for the development of 12 suggestions for manufacturers. CONCLUSIONS: Much can be done to improve the quality of MS in the NICE STA process. Suggestions include the need for clear and transparent reporting of methods and analyses.

Dabigatran etexilate for the prevention of venous thromboembolism in patients undergoing elective hip or knee surgery: a NICE single technology appraisal.

The National Institute for Health and Clinical Excellence (NICE) invited Boehringer Ingelheim GmbH, the manufacturer of dabigatran etexilate (DBG), to submit evidence on the clinical and cost effectiveness of this drug for the primary prevention of venous thromboembolism (VTE) in adult patients who have undergone total hip replacement (THR) or total knee replacement (TKR) surgery, as part of NICE's single technology appraisal process. The comparators were enoxaparin and fondaparinux, as identified in the scope issued by NICE. The School of Health and Related Research at the University of Sheffield was commissioned to act as the Evidence Review Group (ERG). This article provides a description of the company submission, the ERG review and NICE's subsequent decisions. Clinical-effectiveness evidence for DBG versus enoxaparin was derived from two randomized, double-blind, noninferiority trials, one for THR and the other for TKR. Clinical-effectiveness evidence for DBG versus fondaparinux was taken from a mixed treatment comparison (MTC) and from one study. The results presented show that DBG at the licensed dose of 220 mg and 150 mg once daily was noninferior to enoxaparin (40 mg once daily) in terms of the primary efficacy outcome of total VTE and all-cause mortality. In the MTC, fondaparinux was found to be more effective than DBG; the level of statistical significance was not reported. The manufacturer's cost-effectiveness model estimated that at a dose of 220 mg once a day, DBG dominated enoxaparin in both THR and TKR. At a dose of 150 mg daily, DBG dominated enoxaparin in THR, while enoxaparin dominated DBG in TKR. At a dose of 220 mg daily, DBG was less cost effective than fondaparinux in THR. The cost per QALY gained for fondaparinux versus DBG was £11,111 (year 2008 values). At a dose of 150 mg daily, DBG was less cost effective than fondaparinux in THR. The cost per QALY gained for fondaparinux versus DBG was £6857 (year 2008 values). In TKR, both DBG doses were dominated by fondaparinux. There was some evidence that DBG was more cost effective than enoxaparin; however, these results were based on only one trial each in THR and TKR. Fondaparinux appeared to be more cost effective than DBG; however, this was based on indirect comparisons. NICE concluded that although there was uncertainty in the evidence base, DBG was very likely to be of equivalent clinical and cost effectiveness to enoxaparin or fondaparinux in the prevention of VTE. The NICE Appraisal Committee (AC) acknowledged that oral administration of DBG, without the need for monitoring, would reduce administration costs and that it may support adherence to treatment. Therefore, the AC concluded that DBG should be recommended as an option in the circumstances in which enoxaparin (or fondaparinux as an alternative) may be offered.