Reliability and validity of multicentre surveillance of surgical site infections after colorectal surgery.

BACKGROUND: Surveillance is the cornerstone of surgical site infection prevention programs. The validity of the data collection and awareness of vulnerability to inter-rater variation is crucial for correct interpretation and use of surveillance data. The aim of this study was to investigate the reliability and validity of surgical site infection (SSI) surveillance after colorectal surgery in the Netherlands. METHODS: In this multicentre prospective observational study, seven Dutch hospitals performed SSI surveillance after colorectal surgeries performed in 2018 and/or 2019. When executing the surveillance, a local case assessment was performed to calculate the overall percentage agreement between raters within hospitals. Additionally, two case-vignette assessments were performed to estimate intra-rater and inter-rater reliability by calculating a weighted Cohen's Kappa and Fleiss' Kappa coefficient. To estimate the validity, answers of the two case-vignettes questionnaires were compared with the answers of an external medical panel. RESULTS: 1111 colorectal surgeries were included in this study with an overall SSI incidence of 8.8% (n = 98). From the local case assessment it was estimated that the overall percent agreement between raters within a hospital was good (mean 95%, range 90-100%). The Cohen's Kappa estimated for the intra-rater reliability of case-vignette review varied from 0.73 to 1.00, indicating substantial to perfect agreement. The inter-rater reliability within hospitals showed more variation, with Kappa estimates ranging between 0.61 and 0.94. In total, 87.9% of the answers given by the raters were in accordance with the medical panel. CONCLUSIONS: This study showed that raters were consistent in their SSI-ascertainment (good reliability), but improvements can be made regarding the accuracy (moderate validity). Accuracy of surveillance may be improved by providing regular training, adapting definitions to reduce subjectivity, and by supporting surveillance through automation.

A framework to develop semiautomated surveillance of surgical site infections: An international multicenter study.

OBJECTIVE: Automated surveillance of healthcare-associated infections reduces workload and improves standardization, but it has not yet been adopted widely. In this study, we assessed the performance and feasibility of an easy implementable framework to develop algorithms for semiautomated surveillance of deep incisional and organ-space surgical site infections (SSIs) after orthopedic, cardiac, and colon surgeries. DESIGN: Retrospective cohort study in multiple countries. METHODS: European hospitals were recruited and selected based on the availability of manual SSI surveillance data from 2012 onward (reference standard) and on the ability to extract relevant data from electronic health records. A questionnaire on local manual surveillance and clinical practices was administered to participating hospitals, and the information collected was used to pre-emptively design semiautomated surveillance algorithms standardized for multiple hospitals and for center-specific application. Algorithm sensitivity, positive predictive value, and reduction of manual charts requiring review were calculated. Reasons for misclassification were explored using discrepancy analyses. RESULTS: The study included 3 hospitals, in the Netherlands, France, and Spain. Classification algorithms were developed to indicate procedures with a high probability of SSI. Components concerned microbiology, prolonged length of stay or readmission, and reinterventions. Antibiotics and radiology ordering were optional. In total, 4,770 orthopedic procedures, 5,047 cardiac procedures, and 3,906 colon procedures were analyzed. Across hospitals, standardized algorithm sensitivity ranged between 82% and 100% for orthopedic surgery, between 67% and 100% for cardiac surgery, and between 84% and 100% for colon surgery, with 72%-98% workload reduction. Center-specific algorithms had lower sensitivity. CONCLUSIONS: Using this framework, algorithms for semiautomated surveillance of SSI can be successfully developed. The high performance of standardized algorithms holds promise for large-scale standardization.

Genotypic and phenotypic characteristics of Dutch patients with early onset Parkinson's disease.

Early onset Parkinson's disease (EOPD) has been associated with mutations in the Parkin, DJ-1, PINK1, LRRK2, and SNCA genes. The aim of this study is to assess the contribution of these genes in a Dutch EOPD cohort and the phenotypic characteristics of the mutation carriers. A total of 187 unrelated Dutch EOPD patients (age at onset < or = 50 years) were phenotyped and screened for mutations in all exons of Parkin, DJ-1, and PINK1 by direct sequencing and gene dosage analysis. Additionally, analysis of the A30P mutation and exon dosage of SNCA and sequencing of exons 19,31,35,38,41, and 48 of LRRK2 was performed. Pathogenic variations could explain disease in 4% (7 of 187) of the patients including five patients carrying homozygous or compound heterozygous mutations in Parkin, one with a novel homozygous deletion in DJ-1 (P158Del) and one with a heterozygous mutation in LRRK2 (T2356I). We found seven novel mutations. The phenotypic characteristics of mutation carriers varied widely, comparable to the variability seen in sporadic EOPD. Parkin is the most frequently mutated gene in this EOPD cohort, followed by DJ-1, PINK1 and LRRK2. The low overall mutation frequency indicates that the extrapolation of mutation frequencies from other populations should be applied with caution.