RESUMO
BACKGROUND: The purpose of this study was to demonstrate the validity and efficiency of the Outcomes Management and Evaluation (OME) system, a prospectively designed electronic data collection tool, for collecting comprehensive and standardized surgical data in shoulder arthroplasty. METHODS: Surgical data from the first 100 cases of shoulder arthroplasty that were collected into the OME database were analyzed. Surgeons completed a traditional narrative operative note and also an OME case report using an encrypted smartphone. A blinded reviewer extracted data from the operative notes and implant logs in the electronic medical records (EMR) by manual chart review. OME and EMR data were compared with regard to data counts and agreement between 39 variables related to preoperative pathology, including rotator cuff status and glenoid wear, and surgical procedures. Data counts were assessed using both raw percentages and with McNemar's test (with continuity correction). Agreement of nominal variables was analyzed using Cohen's unweighted kappa (κ) and of ordinal variables using the linearly weighted Cohen's test. Efficiency was assessed by calculating the median time needed to complete OME. RESULTS: Compared to the EMR, the OME database had significantly higher data counts for 56% (22 of 39) of the variables assessed. A high level of proportional and statistical agreement was demonstrated between the data in the two datasets. 10 of 39 variables had 100% agreement but could not be statistically compared because both datasets had the same single response under those variables. Among the 29 variables that were compared, 79% (23 of 29) of variables had >80% raw proportional agreement, and 69% (20 of 29) of variables showed at least substantial agreement (κ > 0.6). The median time for completing OME surgery data entry was 92 seconds (IQR 70 - 126). CONCLUSION: The prospectively designed, electronic data entry system (OME) is an efficient and valid tool for collecting comprehensive and standardized surgical data on shoulder arthroplasty. LEVEL OF EVIDENCE: Level IV.
RESUMO
BACKGROUND: This study tested validity and efficiency of Orthopaedic Minimal Data Set (OrthoMiDaS) Episode of Care (OME). METHODS: We analyzed 100 isolated rotator cuff repair cases in the OME database. Surgeons completed a traditional operative note and OME report. A blinded reviewer extracted data from operative notes and implant logs in electronic medical records by manual chart review. OME and electronic medical record data were compared with data counts and agreement between 40 variables of rotator cuff disease and repair procedures. Data counts were assessed using raw percentages and McNemar test (with continuity correction). Agreement of categorical variables was analyzed using Cohen κ (unweighted) and of numerical variables using the concordance correlation coefficient (CCC). Efficiency was assessed by median time to complete. RESULTS: OME database had significantly higher data counts for 25% (10/40) of variables. A high level of proportional and statistical agreement was demonstrated between the data. Among 35 categorical variables, proportional agreement was perfect for 17%, almost perfect (0.81 ≤ κ ≤ 1.00) for 37%, substantial (0.61 ≤ κ ≤ 0.80) for 20%, moderate (0.41 ≤ κ ≤ 0.60) for 14%, fair (0.21 ≤ κ ≤ 0.40) for 6%, and slight (0.0 ≤ κ ≤ 0.20) for 6%. Of 5 numerical variables, agreement was almost perfect (CCC > 0.99) for 20% and poor (CCC < 0.90) for 80%. Median OME completion time was 161.5 seconds (interquartile range, 116-224.5). CONCLUSION: OME is an efficient, valid tool for collecting comprehensive, standardized data on rotator cuff repair.