A randomised controlled trial of the clinical effectiveness and cost-effectiveness of different knee prostheses: the Knee Arthroplasty Trial (KAT).

BACKGROUND: In the late 1990s, new developments in knee replacement were identified as a priority for research within the NHS. The newer forms of arthroplasty were more expensive and information was needed on their safety and cost-effectiveness. OBJECTIVES: The Knee Arthroplasty Trial examined the clinical effectiveness and cost-effectiveness of four aspects of knee replacement surgery: patellar resurfacing, mobile bearings, all-polyethylene tibial components and unicompartmental replacement. DESIGN: This study comprised a partial factorial, pragmatic, multicentre randomised controlled trial with a trial-based cost-utility analysis which was conducted from the perspective of the NHS and the patients treated. Allocation was computer generated in a 1 : 1 ratio using a central system, stratified by eligible comparisons and surgeon, minimised by participant age, gender and site of disease. Surgeons were not blinded to allocated procedures. Participants were unblinded if they requested to know the prosthesis they received. SETTING: The setting for the trial was UK secondary care. PARTICIPANTS: Patients were eligible for inclusion if a decision had been made for them to have primary knee replacement surgery. Patients were recruited to comparisons for which the surgeon was in equipoise about which type of operation was most suitable. INTERVENTIONS: Patients were randomised to receive a knee replacement with the following: patellar resurfacing or no patellar resurfacing irrespective of the design of the prosthesis used; a mobile bearing between the tibial and femoral components or a bearing fixed to the tibial component; a tibial component made of either only high-density polyethylene ('all polyethylene') or a polyethylene bearing fixed to a metal backing plate with attached stem; or unicompartmental or total knee replacement. MAIN OUTCOME MEASURES: The primary outcome was the Oxford Knee Score (OKS). Other outcomes were Short Form 12; EuroQol 5D; intraoperative and postoperative complications; additional surgery; cost; and cost-effectiveness. Patients were followed up for a median of 10 years; the economic evaluation took a 10-year time horizon, discounting costs and quality-adjusted life-years (QALYs) at 3.5% per annum. RESULTS: A total of 116 surgeons in 34 centres participated and 2352 participants were randomised: 1715 in patellar resurfacing; 539 in mobile bearing; 409 in all-polyethylene tibial component; and 34 in the unicompartmental comparisons. Of those randomised, 345 were randomised to two comparisons. We can be more than 95% confident that patellar resurfacing is cost-effective, despite there being no significant difference in clinical outcomes, because of increased QALYs [0.187; 95% confidence interval (CI) -0.025 to 0.399] and reduced costs (-£104; 95% CI -£630 to £423). We found no definite advantage or disadvantage of mobile bearings in OKS, quality of life, reoperation and revision rates or cost-effectiveness. We found improved functional results for metal-backed tibias: complication, reoperation and revision rates were similar. The metal-backed tibia was cost-effective (particularly in the elderly), costing £35 per QALY gained. CONCLUSIONS: The results provide evidence to support the routine resurfacing of the patella and the use of metal-backed tibial components even in the elderly. Further follow-up is required to assess the stability of these findings over time and to inform the decision between mobile and fixed bearings. TRIAL REGISTRATION: Current Controlled Trials ISRCTN45837371. FUNDING: This project was funded by the NIHR Health Technology Assessment programme and the orthopaedic industry. It will be published in full in Health Technology Assessment; Vol. 18, No. 19. See the NIHR Journals Library website for further project information.

Antimicrobial catheters for reduction of symptomatic urinary tract infection in adults requiring short-term catheterisation in hospital: a multicentre randomised controlled trial.

BACKGROUND: Catheter-associated urinary tract infection (CAUTI) is a major preventable cause of harm for patients in hospital. We aimed to establish whether short-term routine use of antimicrobial catheters reduced risk of CAUTI compared with standard polytetrafluoroethylene (PTFE) catheterisation. METHODS: In our parallel, three group, multicentre, randomised controlled superiority trial, we enrolled adults (aged ≥16 years) requiring short-term (≤14 days) catheterisation at 24 hospitals in the UK. Participants were randomly allocated 1:1:1 with a remote computer allocation to receive a silver alloy-coated catheter, a nitrofural-impregnated catheter, or a PTFE-coated catheter (control group). Patients undergoing unplanned catheterisation were also included and consent for participation was obtained retrospectively. Participants and trial staff were unmasked to treatment assignment. Data were collected by trial staff and by patient-reported questionnaires for 6 weeks after randomisation. The primary outcome was incidence of symptomatic urinary tract infection for which an antibiotic was prescribed by 6 weeks. We postulated that a 3·3% absolute reduction in CAUTI would represent sufficient benefit to recommend routine use of antimicrobial catheters. This study is registered, number ISRCTN75198618. FINDINGS: 708 (10%) of 7102 randomly allocated participants were not catheterised, did not confirm consent, or withdrew, and were not included in the primary analyses. Compared with 271 (12·6%) of 2144 participants in the control group, 263 (12·5%) of 2097 participants allocated a silver alloy catheter had the primary outcome (difference -0·1% [95% CI -2·4 to 2·2]), as did 228 (10·6%) of 2153 participants allocated a nitrofural catheter (-2·1% [-4·2 to 0·1]). Rates of catheter-related discomfort were higher in the nitrofural group than they were in the other groups. INTERPRETATION: Silver alloy-coated catheters were not effective for reduction of incidence of symptomatic CAUTI. The reduction we noted in CAUTI associated with nitrofural-impregnated catheters was less than that regarded as clinically important. Routine use of antimicrobial-impregnated catheters is not supported by this trial. FUNDING: UK National Institute for Health Research Health Technology Assessment Programme.

Patellar resurfacing in total knee replacement: five-year clinical and economic results of a large randomized controlled trial.

BACKGROUND: There is conflicting evidence regarding the merits of patellar resurfacing during total knee arthroplasty, as many of the previous randomized controlled trials have not been adequately powered. METHODS: A pragmatic, multicenter, randomized controlled trial was initiated in 1999 in the United Kingdom. Within a partial factorial design, 1715 patients were randomly allocated to receive or not receive patellar resurfacing during total knee arthroplasty. The primary outcome measure was the Oxford Knee Score; secondary measures included the Short Form-12, the EuroQoL 5D, cost, cost-effectiveness, and the need for subsequent knee surgery. RESULTS: The mean Oxford Knee Score was 35 points at five years postoperatively in both groups. There was no significant difference between the groups with respect to the mean Oxford Knee Score (difference, 0.59 point; 95% confidence interval, -0.58 to 1.76 points) or any other outcome measure at five years postoperatively. The outcome was not affected by whether the patella was domed or anatomic. There was no significant difference between the two groups with respect to the prevalence of knee-related readmission, of minor or intermediate reoperation, or of subsequent patella-related surgery. The total health care cost for the primary arthroplasty, subsequent monitoring, and any revision surgery did not differ significantly between the two groups. CONCLUSIONS: In the largest randomized controlled trial of patellar resurfacing reported to date, the functional outcome, reoperation rate, and total health care cost five years after primary total knee arthroplasty were not significantly affected by the addition of patellar resurfacing to the surgical procedure.

A pragmatic multi-centre randomised controlled trial of fluid loading in high-risk surgical patients undergoing major elective surgery--the FOCCUS study.

INTRODUCTION: Fluid strategies may impact on patient outcomes in major elective surgery. We aimed to study the effectiveness and cost-effectiveness of pre-operative fluid loading in high-risk surgical patients undergoing major elective surgery. METHODS: This was a pragmatic, non-blinded, multi-centre, randomised, controlled trial. We sought to recruit 128 consecutive high-risk surgical patients undergoing major abdominal surgery. The patients underwent pre-operative fluid loading with 25 ml/kg of Ringer's solution in the six hours before surgery. The control group had no pre-operative fluid loading. The primary outcome was the number of hospital days after surgery with cost-effectiveness as a secondary outcome. RESULTS: A total of 111 patients were recruited within the study time frame in agreement with the funder. The median pre-operative fluid loading volume was 1,875 ml (IQR 1,375 to 2,025) in the fluid group compared to 0 (IQR 0 to 0) in controls with days in hospital after surgery 12.2 (SD 11.5) days compared to 17.4 (SD 20.0) and an adjusted mean difference of 5.5 days (median 2.2 days; 95% CI -0.44 to 11.44; P = 0.07). There was a reduction in adverse events in the fluid intervention group (P = 0.048) and no increase in fluid based complications. The intervention was less costly and more effective (adjusted average cost saving: £2,047; adjusted average gain in benefit: 0.0431 quality adjusted life year (QALY)) and has a high probability of being cost-effective. CONCLUSIONS: Pre-operative intravenous fluid loading leads to a non-significant reduction in hospital length of stay after high-risk major surgery and is likely to be cost-effective. Confirmatory work is required to determine whether these effects are reproducible, and to confirm whether this simple intervention could allow more cost-effective delivery of care. TRIAL REGISTRATION: Prospective Clinical Trials, ISRCTN32188676.

Urinary incontinence in men after formal one-to-one pelvic-floor muscle training following radical prostatectomy or transurethral resection of the prostate (MAPS): two parallel randomised controlled trials.

BACKGROUND: Urinary incontinence is common immediately after prostate surgery. Men are often advised to do pelvic-floor exercises, but evidence to support this is inconclusive. Our aim was to establish if formal one-to-one pelvic floor muscle training reduces incontinence. METHODS: We undertook two randomised trials in men in the UK who were incontinent 6 weeks after radical prostatectomy (trial 1) or transurethral resection of the prostate (TURP; trial 2) to compare four sessions with a therapist over 3 months with standard care and lifestyle advice only. Randomisation was by remote computer allocation. Our primary endpoints, collected via postal questionnaires, were participants' reports of urinary incontinence and incremental cost per quality-adjusted life year (QALY) after 12 months. Group assignment was masked from outcome assessors, but this masking was not possible for participants or caregivers. We used intention-to-treat analyses to compare the primary outcome at 12 months. This study is registered, number ISRCTN87696430. FINDINGS: In the intervention group in trial 1, the rate of urinary incontinence at 12 months (148 [76%] of 196) was not significantly different from the control group (151 [77%] of 195; absolute risk difference [RD] -1·9%, 95% CI -10 to 6). In trial 2, the difference in the rate of urinary incontinence at 12 months (126 [65%] of 194) from the control group was not significant (125 [62%] of 203; RD 3·4%, 95% CI -6 to 13). Adjusting for minimisation factors or doing treatment-received analyses did not change these results in either trial. No adverse effects were reported. In both trials, the intervention resulted in higher mean costs per patient (£180 and £209 respectively) but we did not identify evidence of an economically important difference in QALYs (0·002 [95% CI -0·027 to 0·023] and -0·00003 [-0·026 to 0·026]). INTERPRETATION: In settings where information about pelvic-floor exercise is widely available, one-to-one conservative physical therapy for men who are incontinent after prostate surgery is unlikely to be effective or cost effective. The high rates of persisting incontinence after 12 months suggest a substantial unrecognised and unmet need for management in these men. FUNDING: National Institute of Health Research, Health Technology Assessment (NIHR HTA) Programme.

The introduction of new interventional procedures in the British National Health Service--a qualitative study.

OBJECTIVES: To investigate how interventional procedures (IPs) are introduced into the British National Health Services and identify areas for improvement in the current process. METHODS: Qualitative study using one to one semi-structured interviews. Using the framework approach, the data generated from 14 participants were analysed with coding of emergent themes. Data were analysed separately for providers and commissioner organisations. RESULTS: Variations were observed in how IPs are introduced from both the provider and commissioner perspectives. Patterns of approaches allowed the development of models reflecting practice at each type of organisation: very structured in some places to, unstructured or almost non-existent in others. Factors affecting the decision to introduce a procedure include: immediate costs and benefits, numbers of people affected, training requirements, NICE guidance, nature of procedure, support from colleagues, incentives, public or policy-maker pressure, and aims of the institution. Monitoring was seen as a key area for improvement by many. CONCLUSIONS: These variations indicate that the process of introducing new IPs in the NHS can be improved. Factors affecting decision-making and problems have been identified. The results of our study could inform and help shape future processes of managing and the introduction of new procedures into the NHS.

A pragmatic multi-centre randomised controlled trial of fluid loading and level of dependency in high-risk surgical patients undergoing major elective surgery: trial protocol.

BACKGROUND: Patients undergoing major elective or urgent surgery are at high risk of death or significant morbidity. Measures to reduce this morbidity and mortality include pre-operative optimisation and use of higher levels of dependency care after surgery. We propose a pragmatic multi-centre randomised controlled trial of level of dependency and pre-operative fluid therapy in high-risk surgical patients undergoing major elective surgery. METHODS/DESIGN: A multi-centre randomised controlled trial with a 2 * 2 factorial design. The first randomisation is to pre-operative fluid therapy or standard regimen and the second randomisation is to routine intensive care versus high dependency care during the early post-operative period. We intend to recruit 204 patients undergoing major elective and urgent abdominal and thoraco-abdominal surgery who fulfil high-risk surgical criteria. The primary outcome for the comparison of level of care is cost-effectiveness at six months and for the comparison of fluid optimisation is the number of hospital days after surgery. DISCUSSION: We believe that the results of this study will be invaluable in determining the future care and clinical resource utilisation for this group of patients and thus will have a major impact on clinical practice. TRIAL REGISTRATION: Trial registration number - ISRCTN32188676.

Local decision-makers views' of national guidance on interventional procedures in the UK.

OBJECTIVES: To identify how decision-makers in the NHS perceive and manage interventional procedures guidance and to determine whether additional information would be useful. METHODS: Qualitative study using semi-structured interviews with seven providers, six commissioners and one policy-maker. The framework approach was used to analyse transcribed data, and emergent themes coded. Data were analysed separately for providers and commissioner organizations. RESULTS: Perceptions about how guidance is managed in provider organizations varied. Some decision-makers considered that guidance is handled very well whereas others think it is suboptimal and haphazard. It is unclear whether clinicians follow procedure for cautionary guidance. In commissioner organizations, guidance is not seen as a priority by most and is not considered an area that will soon enter routine clinical practice. Moreover, commissioners felt that guidance lacked relevance as there is no consideration of whether procedures are cost-effective or affordable. Despite this, respondents perceived that the content and quality of guidance is satisfactory. Useful additional information for inclusion in guidance would be: prevalence, incidence, cost, patients' views, consequences of using the new intervention, comparative information, effectiveness and cost-effectiveness. CONCLUSIONS: Management of interventional procedures guidance in the NHS can be improved. It is important to understand the ways in which guidance meets and fails to meet decision-makers' needs.

Evaluation and stages of surgical innovations.

Surgical innovation is an important part of surgical practice. Its assessment is complex because of idiosyncrasies related to surgical practice, but necessary so that introduction and adoption of surgical innovations can derive from evidence-based principles rather than trial and error. A regulatory framework is also desirable to protect patients against the potential harms of any novel procedure. In this first of three Series papers on surgical innovation and evaluation, we propose a five-stage paradigm to describe the development of innovative surgical procedures.

No surgical innovation without evaluation: the IDEAL recommendations.

Surgery and other invasive therapies are complex interventions, the assessment of which is challenged by factors that depend on operator, team, and setting, such as learning curves, quality variations, and perception of equipoise. We propose recommendations for the assessment of surgery based on a five-stage description of the surgical development process. We also encourage the widespread use of prospective databases and registries. Reports of new techniques should be registered as a professional duty, anonymously if necessary when outcomes are adverse. Case series studies should be replaced by prospective development studies for early technical modifications and by prospective research databases for later pre-trial evaluation. Protocols for these studies should be registered publicly. Statistical process control techniques can be useful in both early and late assessment. Randomised trials should be used whenever possible to investigate efficacy, but adequate pre-trial data are essential to allow power calculations, clarify the definition and indications of the intervention, and develop quality measures. Difficulties in doing randomised clinical trials should be addressed by measures to evaluate learning curves and alleviate equipoise problems. Alternative prospective designs, such as interrupted time series studies, should be used when randomised trials are not feasible. Established procedures should be monitored with prospective databases to analyse outcome variations and to identify late and rare events. Achievement of improved design, conduct, and reporting of surgical research will need concerted action by editors, funders of health care and research, regulatory bodies, and professional societies.

Challenges in evaluating surgical innovation.

Research on surgical interventions is associated with several methodological and practical challenges of which few, if any, apply only to surgery. However, surgical evaluation is especially demanding because many of these challenges coincide. In this report, the second of three on surgical innovation and evaluation, we discuss obstacles related to the study design of randomised controlled trials and non-randomised studies assessing surgical interventions. We also describe the issues related to the nature of surgical procedures-for example, their complexity, surgeon-related factors, and the range of outcomes. Although difficult, surgical evaluation is achievable and necessary. Solutions tailored to surgical research and a framework for generating evidence on which to base surgical practice are essential.

Financial considerations in the conduct of multi-centre randomised controlled trials: evidence from a qualitative study.

BACKGROUND: Securing and managing finances for multicentre randomised controlled trials is a highly complex activity which is rarely considered in the research literature. This paper describes the process of financial negotiation and the impact of financial considerations in four UK multicentre trials. These trials had met, or were on schedule to meet, recruitment targets agreed with their public-sector funders. The trials were considered within a larger study examining factors which might be associated with trial recruitment (STEPS). METHODS: In-depth semi-structured telephone interviews were conducted in 2003-04 with 45 individuals with various responsibilities to one of the four trials. Interviewees were recruited through purposive and then snowball sampling. Interview transcripts were analysed with the assistance of the qualitative package Atlas-ti. RESULTS: The data suggest that the UK system of dividing funds into research, treatment and NHS support costs brought the trial teams into complicated negotiations with multiple funders. The divisions were somewhat malleable and the funding system was used differently in each trial. The fact that all funders had the potential to influence and shape the trials considered here was an important issue as the perspectives of applicants and funders could diverge. The extent and range of industry involvement in non-industry-led trials was striking. Three broad periods of financial work (foundation, maintenance, and resourcing completion) were identified. From development to completion of a trial, the trialists had to be resourceful and flexible, adapting to changing internal and external circumstances. In each period, trialists and collaborators could face changing costs and challenges. Each trial extended the recruitment period; three required funding extensions from MRC or HTA. CONCLUSION: This study highlights complex financial aspects of planning and conducting trials, especially where multiple funders are involved. Recognition of the importance of financial stability and of the need for appropriate training in this area should be paralleled by further similar research with a broader range of trials, aimed at understanding and facilitating the conduct of clinical research.

What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies.

BACKGROUND: A commonly reported problem with the conduct of multicentre randomised controlled trials (RCTs) is that recruitment is often slower or more difficult than expected, with many trials failing to reach their planned sample size within the timescale and funding originally envisaged. The aim of this study was to explore factors that may have been associated with good and poor recruitment in a cohort of multicentre trials funded by two public bodies: the UK Medical Research Council (MRC) and the Health Technology Assessment (HTA) Programme. METHODS: The cohort of trials was identified from the administrative databases held by the two funding bodies. 114 trials that recruited participants between 1994 and 2002 met the inclusion criteria. The full scientific applications and subsequent trial reports submitted by the trial teams to the funders provided the principal data sources. Associations between trial characteristics and recruitment success were tested using the Chi-squared test, or Fisher's exact test where appropriate. RESULTS: Less than a third (31%) of the trials achieved their original recruitment target and half (53%) were awarded an extension. The proportion achieving targets did not appear to improve over time. The overall start to recruitment was delayed in 47 (41%) trials and early recruitment problems were identified in 77 (63%) trials. The inter-relationship between trial features and recruitment success was complex. A variety of strategies were employed to try to increase recruitment, but their success could not be assessed. CONCLUSION: Recruitment problems are complex and challenging. Many of the trials in the cohort experienced recruitment difficulties. Trials often required extended recruitment periods (sometimes supported by additional funds). While this is of continuing concern, success in addressing the trial question may be more important than recruitment alone.

The effectiveness of metal on metal hip resurfacing: a systematic review of the available evidence published before 2002.

BACKGROUND: Conventional total hip replacement (THR) may be felt to carry too high a risk of failure over a patient's lifetime, especially in young people. There is increasing interest in metal on metal hip resurfacing arthroplasty (MoM) as this offers a bone-conserving option for treating those patients who are not considered eligible for THR. We aim to evaluate the effectiveness of MoM for treatment of hip disease, and compare it with alternative treatments for hip disease offered within the UK. METHODS: A systematic review was carried out to identify the relevant literature on MoM published before 2002. As watchful waiting and total hip replacement are alternative methods commonly used to alleviate the symptoms of degenerative joint disease of the hip, we compared MoM with these. RESULTS: The data on the effectiveness of MoM are scarce, as it is a relatively new technique and at present only short-term results are available. CONCLUSION: It is not possible to make any firm conclusions about the effectiveness of MoM based on these early results. While the short-term results are promising, it is unclear if such results would be replicated in more rigorous studies, and what the long-term performance might be. Further research is needed which ideally should involve long-term randomised comparisons of MoM with alternative approaches to the clinical management of hip disease.

Cost effectiveness of tension-free vaginal tape for the surgical management of female stress incontinence.

OBJECTIVES: Stress urinary incontinence affects between 10 percent and 50 percent of women. Surgery is commonly recommended for troublesome incontinence that does not respond to nonsurgical management. Tension-free vaginal tape (TVT) is a newer, minimal access surgical sling procedure, which is being increasingly adopted worldwide. The cost-effectiveness of TVT in comparison with other surgical procedures, particularly open colposuspension, is assessed. METHODS: Effectiveness estimates came from a systematic review of TVT compared with other surgical procedures (open and laparoscopic colposuspension, traditional slings, and injectables). Deterministic and probabilistic analyses were used to assess the likelihood of TVT being cost-effective. Sensitivity analyses assessed the impact of changing assumptions about cure rates and costs for TVT, cure rates for retreatment open colposuspension, and proportions of women who choose retreatment. RESULTS: Reliable estimates of relative effectiveness were difficult to derive because the few randomized controlled comparisons had not been optimally analyzed or fully reported. Results of the economic model suggested that TVT dominates open colposuspension (lower cost and same quality of life years [QALYs]) within 5 years after surgery. Stochastic analysis indicated that the likelihood of TVT being cost-effective was 100 percent if decision-makers are unwilling to pay for additional QALYs. TVT's dominance depended on the assumption fact that retreatment open colposuspension has lower cure rates than a first colposuspension. CONCLUSIONS: Analysis based on current short-term data indicates dominance of TVT over open colposuspension from approximately 5 years. There is a need for longer-term follow-up data from methodologically rigorous randomized trials to provide a sounder basis for estimating the relative benefits and cost implications.

Cost-effectiveness of alternative methods of surgical repair of inguinal hernia.

OBJECTIVES: To assess the relative cost-effectiveness of laparoscopic methods of inguinal hernia repair compared with open flat mesh and open non-mesh repair. METHODS: Data on the effectiveness of these alternatives came from three systematic reviews comparing: (i) laparoscopic methods with open flat mesh or non-mesh methods; (ii) open flat mesh with open non-mesh repair; and (iii) methods that used synthetic mesh to repair the hernia defect with those that did not. Data on costs were obtained from the authors of economic evaluations previously conducted alongside trials included in the reviews. A Markov model was used to model cost-effectiveness for a five-year period after the initial operation. The outcomes of the model were presented using a balance sheet approach and as cost per hernia recurrence avoided and cost per extra day at usual activities. RESULTS: Open flat mesh was the most cost-effective method of preventing recurrences. Laparoscopic repair provided a shorter period of convalescence and less long-term pain compared with open flat mesh but was more costly. The mean incremental cost per additional day back at usual activities compared with open flat mesh was Euro 38 and Euro 80 for totally extraperitoneal and transabdominal preperitoneal repair, respectively. CONCLUSIONS: Laparoscopic repair is not cost-effective compared with open flat mesh repair in terms of cost per recurrence avoided. Decisions about the use of laparoscopic repair depend on whether the benefits (reduced pain and earlier return to usual activities) outweigh the extra costs and intraoperative risks. On the evidence presented here, these extra costs are unlikely to be offset by the short-term benefits of laparoscopic repair.

Low back pain: influence of early MR imaging or CT on treatment and outcome--multicenter randomized trial.

PURPOSE: To establish whether early use of magnetic resonance (MR) imaging or computed tomography (CT) influences treatment and outcome of patients with low back pain (LBP) and whether it is cost-effective. MATERIALS AND METHODS: In a multicenter randomized study, two imaging policies for LBP were compared in 782 participants with symptomatic lumbar spine disorders who were referred to orthopedists or neurosurgeons. Participants were randomly allocated to early (393 participants; mean age, 43.9 years; range, 16-82 years) or delayed selective (389 participants; mean age, 42.8 years; range, 14-82 years) imaging groups. Delayed selective imaging referred to imaging restricted to patients in whom a clear clinical need subsequently developed. Main outcome measures were Aberdeen Low Back Pain (ALBP) score, Short Form 36 (SF-36) score (for multidimensional health status), EuroQol (EQ-5D) score (for quality-adjusted life-year [QALY] estimates), and healthcare resource use at 8 and 24 months after randomization. Data were evaluated with analysis of covariance, ordinal logistic regression analysis, and chi(2) and Mann-Whitney tests. RESULTS: Both groups showed improvement in ALBP score, but this was greater in the early group (adjusted mean difference between groups, -3.05 points [95% CI: -5.16, -0.95; P =.005] and -3.62 points [95% CI: -5.92, -1.32; P =.002] at 8 and 24 months, respectively). Scores for SF-36 (bodily pain domain) and EQ-5D were also significantly better at 24 months. Clinical treatment was similar in both groups. Differences in total costs reflected cost of imaging. Imaging provided an adjusted mean additional QALY of 0.041 during 24 months at a mean incremental cost per QALY of $2,124. CONCLUSION: Early use of imaging does not appear to affect treatment overall. Decisions about the use of imaging depend on judgments concerning whether the small observed improvement in outcome justifies additional cost.

Assessing the learning curve effect in health technologies. Lessons from the nonclinical literature.

INTRODUCTION: Many health technologies exhibit some from of learning effect, and this represents a barrier to rigorous assessment. It has been shown that the statistical methods used are relatively crude. Methods to describe learning curves in fields outside medicine, for example, psychology and engineering, may be better. METHODS: To systematically search non-health technology assessment literature (for example, PsycLit and Econlit databases) to identify novel statistical techniques applied to learning curves. RESULTS: The search retrieved 9,431 abstracts for assessment, of which 18 used a statistical technique for analyzing learning effects that had not previously been identified in the clinical literature. The newly identified methods were combined with those previously used in health technology assessment, and categorized into four groups of increasing complexity: a) exploratory data analysis; b) simple data analysis; c) complex data analysis; and d) generic methods. All the complex structured data techniques for analyzing learning effects were identified in the nonclinical literature, and these emphasized the importance of estimating intra- and interindividual learning effects. CONCLUSION: A good dividend of more sophisticated methods was obtained by searching in nonclinical fields. These methods now require formal testing on health technology data sets.

Resource use data by patient report or hospital records: do they agree?

BACKGROUND: Economic evaluations alongside clinical trials are becoming increasingly common. Cost data are often collected through the use of postal questionnaires; however, the accuracy of this method is uncertain. We compared postal questionnaires with hospital records for collecting data on physiotherapy service use. METHODS: As part of a randomised trial of orthopaedic medicine compared with orthopaedic surgery we collected physiotherapy use data on a group of patients from retrospective postal questionnaires and from hospital records. RESULTS: 315 patients were referred for physiotherapy. Hospital data on attendances was available for 30% (n = 96), compared with 48% (n = 150) of patients completing questionnaire data (95% Cl for difference = 10% to 24%); 19% (n = 59) had data available from both sources. The two methods produced an intraclass correlation coefficient of 0.54 (95% Cl 0.31 to 0.70). However, the two methods produced significantly different estimates of resource use with patient self report recalling a mean of 1.3 extra visits (95% Cl 0.4 to 2.2) compared with hospital records. CONCLUSIONS: Using questionnaires in this study produced data on a greater number of patients compared with examination of hospital records. However, the two data sources did differ in the quantity of physiotherapy used and this should be taken into account in any analysis.