Testing criterion-based benchmarking for the appropriate use of radiotherapy.

INTRODUCTION: Planning for radiotherapy (RT) services requires information on the proportion of patients who should be given radiotherapy. Criterion-Based Benchmark (CBB) has been proposed in Canada to estimate the proportion of cancer patients who should be treated with radiotherapy. The aim of this study was to assess CBB in a health system outside of Canada. METHODS: Radiotherapy data for all new cases of cancer in New South Wales (NSW), and the Australian Capital Territory (ACT) Australia in 2004-06 and were linked to Central Cancer Registry records. Road distances between patient residence and the nearest RT centre were calculated. Local Government Areas (LGAs) with public radiotherapy departments were selected as CBB LGAs if they met the following criteria: 1. Patients make no direct payment for radiotherapy. 2. All RT is provided by site-specialised radiation oncologists in multi-disciplinary centres. 3. Radiation oncologists receive salary for their service. 4. More than 75% of patients live within 30 km from the nearest RT, and 5. Patients' waiting times were <4 weeks. RESULTS: 25,383 (26%) out of 98,000 eligible patients in NSW and ACT received radiotherapy in the study period as part of their initial treatment. An average of 31% of patients in the CBB LGAs received radiotherapy compared to an average of 26% in all LGAs during the study period. DISCUSSION: NSW-ACT RT utilisation for selected tumour sites was 7-16% higher in the CBB LGAs than in all LGAs, but was still 30-65% below the estimated optimal radiotherapy utilisation rates and differed significantly from Canadian CBBs. CBB is based on the assumption that there is perfect service delivery in some parts of the health service that can be used to benchmark the whole service. It may be applicable in well-resourced publicly-funded services in Canada, but the CBB approach may not be reproducible in other jurisdictions.

Estimation of the optimal utilisation rates of radical prostatectomy, external beam radiotherapy and brachytherapy in the treatment of prostate cancer by a review of clinical practice guidelines.

BACKGROUND AND PURPOSE: We aimed to construct an evidence-based model of optimal treatment utilisation for prostate cancer, incorporating all local treatment modalities: radical prostatectomy (RP), external beam radiotherapy (EBRT), and brachytherapy (BT); and then to compare this optimal model with actual practice. MATERIALS AND METHODS: Evidence-based guidelines were used to construct a prostate cancer treatment decision-tree. The proportion of patients who fulfilled treatment criteria was drawn from the epidemiological literature. These data were combined to calculate the overall proportion of patients that should optimally have RP, EBRT and/or BT at least once during the course of their disease. The model was peer reviewed and tested by sensitivity analyses and compared with actual practice. RESULTS: Optimal utilisation rates, at some point during the disease course, were: RP, 24% (range 15-30%); EBRT, 58% (range 54-64%); BT, 9.6% (range 6.0-17.9%); and any RT, 60% (range 56-66%). Many patients had indications for more than one of these treatments, and at least one of these treatments was indicated in 76% of patients. The model was sensitive to patient preference estimates. Optimal rates were achievable in some health care jurisdictions. CONCLUSIONS: Modelling optimal utilisation of all local treatment options for a particular cancer is possible. These optimal prostate cancer treatment rates can be used as a planning and quality assurance tool, providing an evidence-based benchmark against which can be measured patterns of practice.

Patterns of care study of brachytherapy in New South Wales: malignancies of the uterine corpus.

PURPOSE: There are limited data at a population level on adjuvant brachytherapy (BT) practice for uterine corpus malignancies. The aims of the current study were to describe BT practice for this disease in New South Wales (NSW), to assess quality of BT, and to determine if a caseload effect on quality exists. MATERIAL AND METHODS: Patient, tumour, and treatment related data were collected from all nine NSW radiation oncology departments that treated patients with BT. Included patients had malignancy of the uterine corpus with treatment including BT. Brachytherapy quality was assessed using published quality benchmarks. Higher gynaecological BT caseload departments were compared with lower caseload departments. RESULTS: One hundred sixty-three NSW residents with gynaecological cancer were treated with BT. The four higher gynaecological BT caseload departments treated a median of 25.5 NSW residents (range 22-38), compared to median 10 (range 3-18) in the five lower caseload departments. Seventy-five patients underwent BT for uterine malignancies. Most patients had early stage endometrioid disease and were treated adjuvantly with intravaginal cylinders using high-dose-rate BT. Doses were in accordance with guideline recommendations in 83% of cases, and BT was appropriately indicated in 76% of cases. Higher caseload departments were more likely to treat with guideline doses (96% vs. 53%, p < 0.001) but there was no difference in compliance rate with treatment indications (p = 0.75). CONCLUSIONS: Brachytherapy patients, techniques, and numbers/unit for uterine corpus malignancies were similar in NSW compared to the USA but more dispersed than in Western Europe. Doses prescribed may not be optimal in lower gynaecological BT caseload departments - the significance of this represents an area in which more research is needed.

Prostate brachytherapy in New South Wales: patterns of care study and impact of caseload on treatment quality.

PURPOSE: We performed the first comprehensive, population-based brachytherapy (BT) Patterns of Care Study in the Australian setting. Herein we report on prostate BT and assess the technical quality of BT practice, focusing on whether a caseload effect could be identified in New South Wales (NSW). MATERIAL AND METHODS: Site visits were made to all radiation oncology departments in NSW that delivered prostate BT, collecting relevant data on NSW residents treated with prostate BT in 2003. Overall quality of NSW prostate BT treatment was assessed using benchmarks including treatment of appropriate prostate cancer disease risk category, absence of (relative) physical contraindications, optimal planned and treated dosimetry, and pre-/post-implant planning/CT. Quality was compared between higher and lower caseload departments. RESULTS: One hundred and fifty-seven (67%) patients underwent temporary BT and 79 (33%) permanent seed BT. Prostate BT was concentrated in five departments, with three of four departments with active programmes treating greater than the recommended 25 cases. Rates of concordance with quality benchmarks were high (85-99%) with no consistent caseload effect identified. CONCLUSIONS: Prostate BT in NSW in 2003 was generally of high quality and a caseload effect on quality could not be identified. This may be because the number of departments was insufficient to determine a caseload effect, or because the prostate BT was largely concentrated in a small number of high caseload departments.

Patterns of care study of brachytherapy in New South Wales: cervical cancer treatment quality depends on caseload.

PURPOSE: We previously conducted modelling and a patterns of care study (POCS) that showed gynaecological brachytherapy (BT) was underutilized in New South Wales (NSW), the USA and Western Europe. The aim of the current study was to assess the quality of cervical BT in NSW, and to determine if caseload affects quality of treatment delivery. MATERIAL AND METHODS: All nine NSW radiation oncology departments that treated patients with cervical BT in 2003 were visited. Patient, tumour and treatment related data were collected. Quality of BT was assessed using published quality benchmarks. Higher and lower caseload departments were compared. RESULTS: The four higher cervical BT caseload departments treated 11-15 NSW residents in 2003, compared to 1-8 patients for the lower caseload departments. Cervix cancer patients treated at the higher caseload departments were more likely to be treated to a point A dose ≥ 80 Gy (58% vs. 14%, p = 0.001), and to have treatment completed within 8 weeks (66% vs. 35%, p = 0.02). Despite higher point A doses, there was no significant difference in proportions achieving lower than recommended rectal or bladder doses, implying better BT insertions in higher caseload departments. CONCLUSIONS: Cervical BT in NSW was dispersed amongst a large number of departments and was frequently of sub-optimal quality. Higher quality BT was achieved in departments treating at least 10 patients per year. It is likely that improved outcomes will be achievable if at least 10 patients are treated per department per year.

Estimation of the optimal brachytherapy utilization rate in the treatment of gynecological cancers and comparison with patterns of care.

PURPOSE: We aimed to estimate the optimal proportion of all gynecological cancers that should be treated with brachytherapy (BT)-the optimal brachytherapy utilization rate (BTU)-to compare this with actual gynecological BTU and to assess the effects of nonmedical factors on access to BT. METHODS AND MATERIALS: The previously constructed inter/multinational guideline-based peer-reviewed models of optimal BTU for cancers of the uterine cervix, uterine corpus, and vagina were combined to estimate optimal BTU for all gynecological cancers. The robustness of the model was tested by univariate and multivariate sensitivity analyses. The resulting model was applied to New South Wales (NSW), the United States, and Western Europe. Actual BTU was determined for NSW by a retrospective patterns-of-care study of BT; for Western Europe from published reports; and for the United States from Surveillance, Epidemiology, and End Results data. Differences between optimal and actual BTU were assessed. The effect of nonmedical factors on access to BT in NSW were analyzed. RESULTS: Gynecological BTU was as follows: NSW 28% optimal (95% confidence interval [CI] 26%-33%) compared with 14% actual; United States 30% optimal (95% CI 26%-34%) and 10% actual; and Western Europe 27% optimal (95% CI 25%-32%) and 16% actual. On multivariate analysis, NSW patients were more likely to undergo gynecological BT if residing in Area Health Service equipped with BT (odds ratio 1.76, P=.008) and if residing in socioeconomically disadvantaged postcodes (odds ratio 1.12, P=.05), but remoteness of residence was not significant. CONCLUSIONS: Gynecological BT is underutilized in NSW, Western Europe, and the United States given evidence-based guidelines. Access to BT equipment in NSW was significantly associated with higher utilization rates. Causes of underutilization elsewhere were undetermined. Our model of optimal BTU can be used as a quality assurance tool, providing an evidence-based benchmark against which actual patterns of practice can be measured. It can also be used to assist in determining the adequacy of BT resource allocation.

Estimation of the optimal brachytherapy utilisation rate in the treatment of vaginal cancer and comparison with patterns of care.

INTRODUCTION: Having previously modelled the optimal proportion of uterine cervix and corpus cancers that should be treated with brachytherapy (BT), we aimed to complete the assessment of the role of BT for gynaecological cancers by estimating the optimal proportion of vaginal cancer cases that should be treated with BT, the optimal BT utilisation (BTU) rate for vaginal cancer. We compared this with actual vaginal BTU and assessed quality of BT for vaginal cancer by a Patterns-of-Care Study (POCS). METHODS: Evidence-based guidelines were used to construct an optimal BTU decision tree for vaginal cancer. Searches of the epidemiological literature to ascertain the proportion of patients who fulfilled the criteria for BT were conducted. The robustness of the model was tested by sensitivity analyses and by peer review. A retrospective POCS of BT in New South Wales (NSW) for 2003 was conducted, and actual BTU for vaginal cancer was determined. Differences between optimal and actual BTU were assessed. Quality of BT for vaginal cancer was compared with published benchmarks. RESULTS: The optimal vaginal cancer BTU rate was estimated to be 85% (range 81-87%). In NSW in 2003, actual vaginal cancer BTU was only 42% (95% confidence interval 22-62%). In NSW, only nine patients were treated, all with intra-vaginal cylinders, and two of four to lower than recommended doses. CONCLUSIONS: BT for vaginal cancers is underutilised in NSW compared with the proposed optimal models of care. BT quality may have been suboptimal and this may relate to the rarity of this disease.

Why do some lung cancer patients receive no anticancer treatment?

INTRODUCTION: A significant proportion of lung cancer patients receive no anticancer treatment. This varies from 19% in USA, 33% in Australia, 37% in Scotland, and 50% in Ireland. The aim of this study was to identify the reasons behind this. METHODS: The Lung Cancer Multidisciplinary Meeting (MDM) in South-West Sydney prospectively collects data on all patients presented. All new lung cancer patients presented between December 1, 2005, and December 31, 2007, were reviewed. Patients were assigned optimal treatment based on evidence-based guidelines. Those patients in whom guidelines recommended no treatment (GNT) were compared with those whom the MDM recommended no treatment (MNT) and with those who actually received no treatment (ANT). RESULTS: There were 335 patients with a median age of 69 years. A total of 82% had non-small cell lung cancer, 14% had small cell lung cancer, and 4% had no pathologic diagnosis. Eighty-five percent had locally advanced or metastatic disease. GNT was recommended in 4% (n = 13), MNT in 10% (n = 32) but ANT comprised 20% (n = 66). The differences between GNT and MNT were mainly due to patient comorbidities and clinician decision, but the differences between MNT and ANT were due to patient preference and declining performance status. In multivariate analysis, older age, poorer Eastern Cooperative Oncology Group status, non-small cell lung cancer, and non-English language predicted for ANT. CONCLUSIONS: The proportion of patients with lung cancer receiving no treatment is greater than that predicted by guidelines or recommended by the MDM but lower than that described in population-based studies suggesting that MDMs can improve treatment utilization in lung cancer.

Estimation of optimal brachytherapy utilization rate in the treatment of malignancies of the uterine corpus by a review of clinical practice guidelines and the primary evidence.

PURPOSE: Brachytherapy (BT) is an important treatment technique for uterine corpus malignancies. We modeled the optimal proportion of these cases that should be treated with BT-the optimal rate of brachytherapy utilization (BTU). We compared this optimal BTU rate with the actual BTU rate. METHODS AND MATERIALS: Evidence-based guidelines and the primary evidence were used to construct a decision tree for BTU for malignancies of the uterine corpus. Searches of the literature to ascertain the proportion of patients who fulfilled the criteria for BT were conducted. The robustness of the model was tested by sensitivity analyses and peer review. A retrospective Patterns of Care Study of BT in New South Wales for 2003 was conducted, and the actual BTU for uterine corpus malignancies was determined. The actual BTU in other geographic areas was calculated from published reports. The differences between the optimal and actual rates of BTU were assessed. RESULTS: The optimal uterine corpus BTU rate was estimated to be 40% (range, 36-49%). In New South Wales in 2003, the actual BTU rate was only 14% of the 545 patients with uterine corpus cancer. The actual BTU rate in 2001 was 11% in the Surveillance, Epidemiology, and End Results areas and 30% in Sweden. CONCLUSION: The results of this study have shown that BT for uterine corpus malignancies is underused in New South Wales and in the Surveillance, Epidemiology, and End Results areas. Our model of optimal BTU can be used as a quality assurance tool, providing an evidence-based benchmark against which can be measured actual patterns of practice. It can also be used to assist in determining the adequacy of BT resource allocation.

Cancer knowledge and perception of skills of general practice registrars in Australia.

BACKGROUND: The objective was to assess cancer knowledge and perception of skills of general practice (GP) registrars in Australia. This will help design future educational resources. METHODS: We surveyed GP registrars in different Australian states. RESULTS: Of the registrars, 86% rated highly their ability in performing cervical smears. Registrars reported examining more patients with breast cancer, lung cancer, or melanoma than rectal cancer, cancer of mouth/tongue, or lymphoma. More registrars rated the quality of their training as reasonable or better in assisting patients to stop smoking or modify alcohol intake than in cancer-related tasks. One third rated their teaching on management of curable/incurable cancer and care of the dying as poor and/or very poor, and over half had never examined prostate or rectal cancers. CONCLUSIONS: GP registrars generally have good knowledge of cancer. Their exposure to cases of cancer is low, and it is of concern that many have never examined common tumors in our community.

Surgical procedures for melanoma in public and private New South Wales hospitals, 2001-2002.

BACKGROUND: Evidence suggests that there is considerable variation in the types of procedures used to treat cancer. This variation may result in suboptimal or cost-ineffective care. The present study examined the variation in surgical treatment of melanoma before the establishment of a Melanoma Network that could promote more uniform high-quality care in New South Wales (NSW). The variations in the use of surgical procedures for melanoma by NSW Area Health Service of patient residence were examined. METHODS: Data in the Health Information Exchange of NSW Health collected on procedures carried out on patients with a diagnosis of melanoma in NSW public and private hospitals from 1 July 2001 to 30 June 2002 were examined. Data were aggregated by Area Health Services of patient residence. These data were compared with the numbers of new cases of melanoma notified to the NSW Central Cancer Registry in the same areas in 2001-2002. Excision of skin lesions, skin grafting and numbers and types of lymph node procedures were examined. RESULTS: During the study period, the Central Cancer Registry reported that there were 3085 notifications of melanoma, whereas hospital inpatient data recorded that 6864 procedures were carried out for patients with a melanoma diagnosis in NSW public and private hospitals. Sixty-seven per cent of procedures were carried out in private hospitals. A total of 852 skin grafting procedures were recorded. Of these, 60% were carried out in private hospitals. The average proportion of skin grafts associated with excisions in NSW was 30% (range, 0-53%). Eight hundred and fifty-eight lymph node procedures were recorded for 747 NSW residents. These were biopsies, excisions or both. Forty per cent were carried out in private hospitals. The average proportion of new cases of melanoma associated with a lymph node procedure in NSW was 28% (range, 0-47%). CONCLUSION: Most of the inpatient procedures for patients with melanoma were carried out in private hospitals. The proportions of new cases that underwent skin grafting after excision, or underwent lymph node dissection, varied more than fivefold from one Area Health Service to another. This may indicate variations in casemix, variations in clinical practice or both.