Development of the Australasian vascular surgical audit.

OBJECTIVE: The purpose of this study was to describe the development of the Australasian Vascular Audit that was created to unify audit activities under the umbrella of the Australian and New Zealand Society for Vascular Surgery as a Web-based application. METHODS: Constitutional change in late 2008 deemed participation in this audit compulsory for Society members. The Web-based application was developed and tested during 2009. Data for all open vascular surgery and for all endovascular procedures are collected at two points in the admission episode: at the time of operation and at discharge, and entered into the application. Data are analyzed to produce risk-adjusted outcomes. An algorithm has been developed to deal with outliers according to natural justice and to comply with the requirements of regulatory bodies. The Audit is protected by legislated privilege and is officially endorsed and indemnified by the Royal Australasian College of Surgeons. Confidentiality of surgeons and patients alike is ensured by a legally protected coding system and computer encryption system. Validation is by a verification process of 5% of members per year who are randomly selected. The application is completely funded by the Society. RESULTS: Data entry commenced on January 1, 2010. Over 40,000 vascular procedures were entered in the first year. The Audit application allows instantaneous on-line access to individual data and to deidentified group data and specific reports. It also allows real-time instantaneous production of log books for vascular trainees. The Audit has already gained recognition in the Australasian public arena during its first year of operation as an important benchmark of correct professional surgical behavior. Compliance has been extremely high in public hospitals but less so in private hospitals such that only 60% of members received a certificate of complete participation at the end of its first year of operation. CONCLUSION: An Internet-based compulsory audit of complete surgical practice is possible to create and be maintained by a society of surgeons with a membership of just over 200. The 60% compliance rate for complete data entry has created an immediate constitutional challenge for the Society. Future challenges are to improve total participation to an acceptable level and to ensure accurate data entry via a robust validation system.

Trends and outcomes in Australian carotid artery revascularization surgery: 2010-2017.

BACKGROUND: Carotid endarterectomy (CEA) and carotid artery stenting (CAS) reduce the risk of stroke in patients with severe carotid stenosis. The aim was to compare contemporary treatment trends and outcomes after CEA and CAS between states of Australia. METHODS: A retrospective analysis was conducted on data from the Australasian Vascular Audit between 2010 and 2017. The primary endpoint was perioperative stroke or death (S/D). We also analysed stroke and death independently and revascularization rates per 100 000 population. RESULTS: A total of 15 413 patients underwent carotid revascularization (CEA 14 070; CAS 1343). S/D rates were similar for CEA and CAS (1.9% versus 1.8%; P = 0.37; symptomatic 2.1% versus 2.3%; P = 0.12; asymptomatic 1.5% versus 1.1%; P = 0.67). Patients ≥80 years (2.7% versus 1.7%; P = 0.01), those who had shunts (2.2% versus 1.7%; P = 0.03) or surgery in teaching hospitals (2.6% versus 1.4%; P = 0.02) had higher rates of S/D after CEA. Patients whose proceduralist used a cerebral protection device had lower S/D rates after CAS for symptomatic disease (4.8% versus 2.2%; P = 0.03). There was a wide variation in practice between states, where CAS as a proportion of total carotid procedures ranged from 0% to 17%, and a wide variation in outcomes, with rates of S/D varying between 1.4-6.6% for CEA and 0-6.7% after CAS. CONCLUSION: Outcomes after CAS are equivalent to CEA when performed by vascular surgeons, however significant variation exists for both choice of revascularization procedure and perioperative outcomes between states. Further investigation is needed to determine whether clinical care pathways should be revised to achieve consistency and quality of outcomes.

Validation of data submitted by the treating surgeon in the Victorian Audit of Surgical Mortality.

BACKGROUND: The Victorian Audit of Surgical Mortality (VASM) seeks to peer review all deaths associated with surgical care in Victoria, Australia. The effectiveness of the VASM as an educational and quality improvement tool is dependent on the accuracy of source data it receives. We aimed to examine the accuracy and quality of source data provided by the treating surgeon for peer review, and the inter-rater concordance level between the external validator findings and the treating surgeon. METHODS: Of the 629 cases that completed the VASM audit second-line peer review process over a 4-year period (from 1 July 2012 to 30 June 2016), a total of 32 (5%) were randomly selected for the external validation process. The blinded external validator was impartial to the VASM audit, and was provided only de-identified patient medical records. The analysis for the checked and validated data points and their concordance was determined using Gwet's agreement coefficient, which provides a stable inter-rater reliability coefficient not affected by prevalence and marginal probability. RESULTS: The inter-rater concordance analysis suggested that there is a high level of agreement (82.9% overall) between the treating surgeon and external validator. The use of thromboembolism deterrent stockings was the only variable where agreement was poor (52.4%) with a Gwet score of 0.10 (-0.40 to 0.60). CONCLUSION: The inter-rater concordance analysis results support the validity of the VASM process, which is dependent on the accuracy of data submitted by the treating surgeon.

Potentially preventable deaths in the Victorian Audit of Surgical Mortality.

BACKGROUND: The Victorian Audit of Surgical Mortality (VASM) seeks to peer-review all deaths associated with surgical care. This study aimed to examine the mortalities that were determined by the assessor to be potentially preventable, and identify the clinical factors associated with these cases. The assessment of preventability of death and its relationship to management issues at different stages of the admission episode, as opposed to whether the management issue(s) alone were preventable have not been reported previously. METHODS: Mortality data from the VASM audit since 2007 that completed the peer-review process were retrospectively analysed. Mortalities identified as being preventable were assessed to determine any treatment errors. RESULTS: A total of 6155 deaths were assessed. Of these, 14.6% (896/6155) were considered to be potentially preventable. Where a second-line assessment was requested (1113/6155, 17.5% cases), 48.3% of these deaths were considered potentially preventable. Elective patient deaths were more likely to be potentially preventable (P < 0.001), especially in public patients. Lack of timely involvement of senior staff, inappropriate treatment delay and failure of problem recognition were factors most frequently associated with potentially preventable mortality. CONCLUSION: Overall assessment of the preventability of death is unique to VASM. This allows an additional level of analysis to be applied to the circumstances surrounding each mortality and correlation of preventability of death with clinical management issues provides important feedback to surgeons and health-care providers to further improve the safety and quality of care.

Validation of Australian data in the Australasian Vascular Audit.

BACKGROUND: Accuracy of data is important in any clinical audit. It is necessary to determine how complete the dataset is as well as the accuracy of the data that have been entered. The Australasian Vascular Audit has been operational for 4 years and a data validation process has been undertaken. METHOD: An independent data source is available, which is collected by the Australian Institute of Health and Welfare. This collects all public and private hospital data and is available for interrogation. Similarly, private-only data are available from the Medicare website. This has been compared with the Australasian Vascular Audit dataset to establish completeness of data collection. Quality of data collected has been verified by comparing accuracy of data fields with that present in patient records in a 5% random sample. RESULTS: For the 2 years studied, there was a 63% capture rate in Australia for all patients. In the private sector, only 50% of patients were captured with a significant decrease noted in 2013. The quality of data entered had a 2.6% error rate. CONCLUSION: There is a need to increase compliance with vascular audit in Australia and data accuracy is acceptable but could be improved.

Clinical management issues vary by specialty in the Victorian Audit of Surgical Mortality: a retrospective observational study.

OBJECTIVE: Clinical management issues are contributory factors to mortality. The aim of this study was to use data from the Victorian Audit of Surgical Mortality (VASM), an educational peer-review process for surgeons, to discover differences in the incidence of these issues between surgical specialties in order to focus attention to areas of care that might be improved. DESIGN: This study used retrospectively analysed observational data from VASM. Clinical management issues between eight specialties were assessed using χ(2) analysis. DATA SOURCES: VASM data were reported by participating public and private health services, the Coroner and self-reporting surgeons across Victoria. RESULTS: A total of 2946 specific clinical issues as deficiencies of care were reported. 15% of cases had significant issues of care. The most common clinical management issue was the delay in delivery of treatment. Other clinical issues included the quality of communication and documentation, preoperative and postoperative care, adverse events and protocol issues. There were significant differences in issues between specialties. CONCLUSIONS: The clinical management issues presented across surgical specialties were similar; however, five issues of clinical care differed significantly in frequency across surgical specialties. The three main issues varying among specialties were complications after operation, communication and postoperative care. Addressing these clinical management issues via the peer-review process may impact positively on patient care.