Methodology for Online Reliability Studies: A Primer for Orthopedic Surgeons.

In orthopedic surgery, there is an increasing number of papers about online studies on the reliability of classification systems. Useful classification systems need to be reliable and valid. Measurement of validity can be variable and is prone to observer bias. These online collaboratives derive adequate power to study reliability by having a large group of trained surgeons review a small number of cases instead of the "classic" reliability studies in which a small number of observers evaluate many cases. Large online interobserver studies have advantages (i.e., less than 15 minutes to complete the survey, the ability to randomize, and the ability to study factors associated with reliability, accuracy, or decision-making). This 'handbook' paper gives an overview of current methods for online reliability studies. We discuss the study design, sample size calculation, statistical analyses of results, pitfalls, and limitations of the study design.

Post-traumatic disturbance of the epiphysis of the humeral trochlea: a spectrum of pathology.

BACKGROUND: Hegemann disease and fishtail deformity are classified as growth disturbances in the physeal plate of the humeral trochlea. It is questionable if these 2 diseases should be considered as 2 distinct conditions. The aims of this study are to (1) point out similarities between both conditions, (2) discuss etiology, and (3) provide diagnostic tools. METHODS: In a multicenter prospective cohort study, 19 patients with growth disturbance of the humeral trochlea were included. Assessment consisted of a detailed history, physical examination, and standard radiographs in 2 directions. The radiographs were evaluated for skeletal age, carrying angles, and trochlear notch angles. Statistical analysis was performed using Stata. RESULTS: A total of 19 patients were included: 2 males (11%) and 17 females (89%). The mean age of the patients was 12.8 years. In 17 patients (89%), a traumatic injury of the elbow was reported, before presentation. Decreased trochlear notch angle (<104°) was seen in 16 patients (84%). Accelerated closure of the growth plate of the affected elbow was seen in all skeletally immature patients. CONCLUSIONS: The main risk factor for both Hegemann disease and fishtail deformity is an injury of the elbow with open growth plates. Imaging studies support the hypothesis that both diseases are likely to be a continuum of the same process. Therefore, we propose to use 1 nomenclature for this pathologic process: post-traumatic disturbance of the epiphysis of the humeral trochlea.

Early repolarisation among athletes.

OBJECTIVES: Traditionally, early repolarisation (ER) is considered a benign ECG variant, predominantly found in youths and athletes. However, a limited number of studies have reported an association between ER and the incidental occurrence of ventricular fibrillation or sudden cardiac death. Yet definite, direct comparisons of the incidence of ER in unselected, contemporary populations in athletes as compared with non-athletes and across different sports are lacking. This study therefore aimed to investigate whether ER is more common among athletes as compared with non-athletes, and if ER patterns differ between sport disciplines based on static and dynamic intensity. METHODS: To assess ER we retrospectively analysed ECGs of 2241 adult subjects (2090 athletes, 151 non-athletes), who had a sports medical screening between 2010 and 2014 in an outpatient clinic. The outcome was tested for confounders in a multivariable logistic regression analysis. RESULTS: ER was found in 502 athletes (24%). We found a 50% higher prevalence of ER in the athlete group compared with the control group (OR 1.5 (SE 0.34), adjusted 95% CI 1.0 to 2.4) in multivariable analysis. A 30% higher prevalence of ER in the inferior leads only (OR 1.3 (SE 0.38), adjusted 95% CI 0.74 to 2.3), a 120% higher prevalence of ER in the lateral leads only (OR 2.2 (SE 1.0), adjusted 95% CI 0.87 to 5.4), and a 20% higher prevalence of ER in the inferior and lateral leads (OR 1.2 (SE 0.49), adjusted 95% CI 0.55 to 2.7) was found in athletes. CONCLUSION: Athletes had a 50% higher prevalence of ER and a 30% higher prevalence of ER in the inferior leads specifically. There was no association between training duration or sports discipline and ER.

Follow-up radiographs in isolated Greater Tuberosity fractures lead to a change in treatment recommendation; an online survey study.

INTRODUCTION: It is common practice to obtain follow-up radiographs of non-operatively treated isolated greater tuberosity (GT) fractures 1 to 2 weeks after trauma. However, the majority of non-operatively treated GT fractures remain stable and do not require reconsideration of the initial treatment decision. Radiological follow-up therefore might be unnecessary. Our primary objective was to study whether radiological folow-up changes the initial treatment recommendation, hypothesizing no change. MATERIALS AND METHODS: Radiographs of 25 patients diagnosed with an isolated GT fracture were selected from our hospital database and presented on a web-based platform. Sixty-eight trauma- and orthopedic surgeons evaluated these radiographs. First the radiographs directly post-trauma and then, in random order, the radiographs 5-14 days post-trauma alongside the first radiographs. Each observer evaluated each set of radiographs once. The observers answered which treatment they would recommend (non-operative/operative), and how certain they were about their advice (absolutely certain, certain, some doubt, very uncertain). Recommendation-consistency and inter-observer agreement are presented as percentages and intra class correlation coefficients (ICC). RESULTS: Overall, 84% (95% CI 82.1-85.8) of treatment recommendations was unchanged after evaluation of the second radiograph. Agreement within each observer ranged from 60 to 98%. The mean proportion of patients about whom the observers were (absolutely) certain of their recommendation increased from 70% at the first evaluation to 83% at the second evaluation (12.8; 95% CI 9.8-15.9). Furthermore, the ICC between the surgeons improved from 0.37 (95% CI 0.26-0.54) for the first evaluation to 0.60 (95% CI 0.47-0.74) for the second. CONCLUSION: In 16% of the patients the treatment recommendation for an isolated GT fracture changed after the evaluation of radiographs 1 to 2 weeks post-trauma. In addition, surgeons were more certain about their recommendation and there was less inter-observer variation. Radiological follow-up of a non-operatively treated isolated GT fracture therefore seems justifiable. LEVEL OF EVIDENCE: III, diagnostic study.

Radiographic Predictors for Short-term Functional Outcome after Radial Head Arthroplasty in Patients with Persistent Symptoms after Treatment for Radial Head.

BACKGROUND: Evaluation of the accurate position after radial head arthroplasty remains a challenge for surgeons. Standard radiographs are used to evaluate the position of the implant, however, results regarding radiographic deficiencies on clinical outcome are not consistent. In this retrospective study our main aim was to determine if subtle radiographic deficiencies after radial head arthroplasty can predict functional outcomes measured with the Mayo Elbow Performance Score (MEPS). METHODS: A total of 24 patients, that had a press-fit bipolar radial head arthroplasty because of persistent symptoms after treatment of a radial head fracture, were included. The mean follow-up time was 27 months and the MEPS was assessed at the final follow-up. Three upper extremity orthopaedic surgeons evaluated 12 potential deficiencies on anteroposterior and lateral radiographs in consensus agreement. RESULTS: The median MEPS was 97.5 (Interquartile Range 82.5-100). No association was found between the presence of subtle radiographic deficiencies and MEPS. CONCLUSION: Functional outcome of the elbow after uncemented press-fit bipolar radial head arthroplasty is not associated with subtle radiographic deficiencies. Therefore, surgeons might accept small imperfections on postoperative radiographs.

Avascular Necrosis of the Scaphoid Preiser Disease.

No consensus regarding optimal treatment or etiology of Preiser disease exists. We described the epidemiology, classification and treatment characteristics of 18 patients with Preiser disease. Patients with changes related to previous trauma, and without radiographs were excluded. Based on the radiographs at diagnosis, we classified 13 scaphoids as Herbert Lanzetta stage II, four as stage III, and one as stage IV. In 12 patients nonspecific treatment was offered and only two patients received surgical treatment. We found that chosen treatment is not associated with the severity of Herbert Lanzetta stage and the outcome is not influenced by chosen treatment.

Radiographic assessment of calcifying tendinitis of the rotator cuff : an inter- and intraobserver study.

The radiographic appearance of calcific tendinitis of the rotator cuff varies according to the stage of the disease. We compared currently used classification systems in a large group of observers to identify the most reliable classification system. Thirty-seven orthopaedic surgeons evaluated shoulder radiographs of 25 patients to classify the stage of the calcific tendinitis according to the classifications by (1) Gärtner and (2) Molé on a Web-based study platform. Inter and intraobserver agreement among observers was measured using the Siegel and Castellan multirater κ. Both classification systems had fair interobserver agreement : κ was 0.25 for the Molé classification and 0.34 for the Gärtner classification. The Gärtner classification was significantly more reliable than the Molé classification. Currently there is no radiographic classification that can serve the purpose of guiding the treatment in a reliable way.

Unplanned Operations and Adverse Events after Surgery for Diaphyseal Fracture of the Clavicle.

BACKGROUND: We used a database of patients treated at three hospitals to study the primary null hypothesis that there are no factors associated with unplanned reoperations or adverse events after surgical repair for diaphyseal clavicle fracture. Additionally we addressed the following secondary study questions: 1. What is the prevalence of unplanned reoperations or adverse events after surgical repair for diaphyseal clavicle fracture? 2. Is early implant loosening or breakage after surgical repair for diaphyseal clavicle fracture related to fixation type? 3. Is the type of fixation associated with the prevalence of brachial plexus palsy after surgical repair of a diaphyseal clavicle fracture? METHODS: We retrospectively analyzed 249 adult patients who had surgery for a diaphyseal clavicle fracture to determine factors associated with unplanned reoperations or adverse events. Thirty-two patients (13%) had at least one unplanned reoperation or adverse event. Four of 249 patients (1.6%) developed early implant loosening or breakage. Patients that had local implant irritation, planned implant removal, or sensory symptoms thought to be due to nerve irritation were not included in the reported unplanned reoperations or adverse event rate. RESULTS: Only female sex was associated with unplanned reoperations or adverse events after surgery for diaphyseal clavicle fracture. No other patient, technical, or injury related factors tested in this study were associated with unplanned reoperations or adverse events. CONCLUSION: Patients that have surgery for diaphyseal clavicle fracture have an approximately 13% risk of an unplanned second surgery or an adverse event. Women can be counseled that they are three times as likely as men to have an unplanned reoperations or adverse event.

How Well do Orthopedic Surgeons Recognize Different Models of Total Elbow Arthroplasties on Plain Radiographs with the Use of a Diagnostic Flowchart?

BACKGROUND: Recognition of total elbow arthroplasties (TEAs) on plain radiographs is difficult due to a multitude of different types and models. Especially if surgery reports and documentation are not available, lost or when the primary surgery was performed in another hospital the prosthesis type may be undeterminable. Therefore we investigated in this platform study if a flowchart aids in recognition of thirteen different total elbow arthroplasty models on plain radiographs. METHODS: An online questionnaire on the Shoulder and Elbow Platform was developed. Plain radiographs of thirteen TEA models were shown with and without the help of an especially developed flowchart describing distinguishing features. RESULTS: Ten orthopedic surgeons specialized in upper extremity surgery completed the study. Recognition rates of the thirteen total elbow arthroplasty models ranged between 20 and 100 percent without the flowchart. Using the flowchart recognition varied between 40 and 90 percent. The recognition rates with the flowchart were not significantly higher. Inter-observer reliability did not increase on a significant level. CONCLUSION: Correct recognition of total elbow arthroplasty models with plain radiographs remains imperfect with our developed flowchart. The flowchart increased correct recognition rates and inter-observer reliability.

What Predicts Outstanding Orthopedic Residents among the Program?

BACKGROUND: An oversupply of qualified applicants leads to intense competition for the limited number of first year orthopedic residency positions. Therefore, program directors can be more selective in choosing their future residents. However, it is unclear if there are resident characteristics that correspond with trainee performance. METHODS: We asked (1) what resident characteristics are associated with subjective residency performance score? and (2) what resident characteristics are associated with Orthopedic In-Training Examination (OITE) score?A total of 119 orthopedic residents accepted at the Harvard Combined Orthopedic Residency Program from 1999 - 2009 were included in this study. The current program director together with two former program directors in the selected time period defined the subjective residency performance score based on the clinical skills of the residents during training. RESULTS: Former Olympic or varsity athlete (P=0.018) and Alpha Omega Alpha (AOA) status (P=0.014) were associated with a better subjective residency performance score. Higher USMLE step 1 score (P=0.0038), known person within faculty prior to the residency (did a research rotation, or local medical student) (P=0.041), and AOA (P=0.015) status were associated with a higher OITE score. CONCLUSION: AOA status of the applicant for orthopedic residency is associated with both a higher OITE score and a better subjective residency performance score.

Correction to: Tension band wiring for simple olecranon fractures: evaluation of surgical technique.

Unfortunately, after publication of this article [1], it was noticed that the author J. Carel Goslings was tagged incorrectly during the production process. This resulted in the PubMed display of the author name as 'J Carel Goslings'. The correct display is 'Goslings JC'. This correction contains the correct tagging.

Interobserver Variability of the Diagnosis of Scaphoid Proximal Pole Fractures.

Purpose Fractures of the proximal pole of the scaphoid are prone to adverse outcomes such as nonunion and avascular necrosis. Distinction of scaphoid proximal pole fractures from waist fractures is important for management but it is unclear if the distinction is reliable. Methods A consecutive series of 29 scaphoid fractures from one tertiary hospital was collected consisting of 5 scaphoid proximal pole and 24 scaphoid waist fractures. Fifty-seven members of the Science of Variation Group (SOVG) were randomized to diagnose fracture location and displacement by using radiographs alone or radiographs and a computed tomography (CT) scan. Results Observers reviewing radiographs alone and observers reviewing radiographs and CT scans both had substantial agreement on fracture location (κ = 0.82 and κ = 0.80, respectively; p = 0.54). Both groups had only fair agreement on fracture displacement (κ = 0.28 and κ = 0.35, respectively; p = 0.029). Conclusion Proximal pole fractures are sufficiently distinct from proximal waist fractures that CT does not improve reliability of diagnosis. Level of Evidence Level IV interobserver reliability case-control study.

Interobserver reliability of radiographic assessment after radial head arthroplasty.

BACKGROUND: Radiographs are part of routine clinical care after radial head arthroplasty (RHA). Therefore, the aim of this diagnostic study was to assess the interobserver reliability of radiographic assessment following RHA. METHODS: Anteroposterior (AP) and lateral radiographs of 24 consecutive patients who underwent press-fit bipolar RHA were evaluated with respect to 14 parameters by 14 orthopaedic surgeons specializing in the elbow: shaft loosening (AP, lateral), subcollar bone resorption, nonbridging heterotopic ossification, capitellar erosion, capitellar osteopenia, implant size, ulnohumeral joint gapping, ulnohumeral joint degeneration, proximal radio-ulnar joint congruency, stem size, stem positioning (AP, lateral) and component dissociation or polyethylene wear of the head with increased angulation. Observer agreement was evaluated using the multirater kappa (κ) measure. RESULTS: Nine of 14 parameters had poor interobserver agreement [κ = 0.0 to 0.20, confidence interval (CI) = 0.0 to 0.31). Four parameters had fair agreement: subcollar bone resorption (κ = 0.27, CI = 0.12 to 0.40), capitellar erosion (κ = 0.30, CI = 0.20 to 0.40), ulnohumeral joint degeneration (κ = 0.35, CI = 0.22 to 0.51) and stem positioning in AP view (κ = 0.24, CI = 0.14 to 0.36). One parameter had moderate agreement: nonbridging heterotopic ossification (κ = 0.47, CI = 0.31 to 0.64). CONCLUSIONS: The overall interobserver reliability of radiographic assessment following press-fit bipolar RHA was poor among experienced elbow surgeons. Therefore, radiographic evaluation after RHA should be interpreted with caution when making treatment decisions.

Ulnar Neck Fractures Associated with Distal Radius Fractures.

Background There is little published data to guide management of ulnar neck fractures associated with fractures of the distal radius. Purpose As unplanned surgery usually reflects adverse events and this injury combination is relatively uncommon, we used a large database to study the incidence of unplanned surgeries after surgical and nonsurgical treatment of distal metaphyseal ulna fractures associated with a distal radius fracture and identify factors associated with these unplanned surgeries. Patients and Methods We identified 277 patients with an ulnar neck fracture associated with a distal radius fracture. Fifty-six (20%) ulnar neck fractures were initially treated operatively and six of them (11%) had a second, unplanned surgery. Of the 221 initially nonoperatively treated fractures, only one (0.45%) had a subsequent unplanned surgery that seemed unrelated to the fracture (ulnar nerve neurolysis). Results Bivariate analysis showed that younger age, open fracture, multifragmentary fractures, and initial operative treatment of the ulnar neck fracture were significantly associated with unplanned surgery. A multivariable analysis was not feasible due to the small number of unplanned surgeries. Conclusion Eighty percent of ulnar neck fractures associated with a fracture of the distal radius was treated nonoperatively in our region, and subsequent surgery for problems was very uncommon. Operative treatment and fracture complexity were associated with unplanned surgery, which reflected some measure of injury severity, technical inadequacy, and inherent problems associated with surgery. Level of Evidence Level II, prognostic study.

The Effect of Priming With Questionnaire Content on Grip Strength in Patients With Hand and Upper Extremity Illness.

BACKGROUND: Grip strength is a performance-based measure of upper extremity function that might be influenced by priming (the influence of a response to a stimulus by exposure to another stimulus). This study addressed the influence of questionnaire content on performance measurements such as grip strength between patients who complete the standard Pain Catastrophizing Scale (PCS) compared with patients who complete a positively adjusted PCS. METHODS: Between June 2015 and August 2015, we enrolled 122 patients who presented to 3 hand surgeons at 3 outpatient offices. They were randomized to 2 groups: the control group, which completed the PCS, and the intervention group, which completed a positively phrased version of the PCS. Before and after completion of the questionnaire, we measured each patient's grip strength 3 times by alternating between hands. Two patients were excluded after participation. We calculated both the preintervention and postintervention mean and maximum grip strengths. RESULTS: There was no significant difference between groups on mean or maximum grip strength before completion of the questionnaires. There was a greater improvement in mean grip strength of both hands in the intervention group compared with the PCS group. This improvement was statistically significant in the affected hand. The maximum grip strength showed a statistically significant greater improvement in both hands in the positive PCS group compared with the control group. CONCLUSIONS: Positive priming through a questionnaire leads to an increase in mean and maximum grip strength when compared with the standard questionnaire that uses negative terms rather than positive.

Graft Site Morbidity in Elbow Ligament Reconstruction Procedures: A Systematic Review.

BACKGROUND: It is unclear which tendon harvest for ulnar or lateral collateral ligament reconstruction has the lowest graft site morbidity rate. PURPOSES: To obtain graft site morbidity rates after tendon harvest for ulnar and lateral collateral ligament reconstruction procedures. STUDY DESIGN: Systematic review/Meta-analysis. METHODS: Studies were eligible if (1) patients had undergone elbow ligament reconstruction procedures; (2) original data for at least 5 patients were available; (3) the article was written in English, German, or Dutch; (4) a full-text article was available; and (5) information about graft site morbidity was available. The review excluded studies about complicated elbow ligament reconstruction procedures due to initial fractures, revision procedures, or circumferential graft techniques; animal studies; (systematic) reviews; and expert opinions. Because the majority of studies were case reports, no selection form or overall scoring system to evaluate methodological quality was used. RESULTS: The review included 619 patients with an ulnar or lateral collateral ligament reconstruction procedure. The autograft types used included palmaris longus tendon (58%), gracilis tendon (24%), semitendinosus tendon (8%), triceps tendon (7%), toe extensor tendon (<2%), plantaris tendon (<2%), extensor carpi radialis longus tendon (<1%), and Achilles tendon (<1%). CONCLUSION: Graft site morbidity occurred in 1% of the patients after an ulnar or lateral collateral ligament reconstruction procedure. This study did not have enough samples of all the autograft types to conclude that autograft type and graft site morbidity are unrelated.

The Influence of Psychological Factors on the Michigan Hand Questionnaire.

Background: Psychosocial factors help account for the gap between impairment and disability. This study examines the relationship between the Michigan Hand Questionnaire (MHQ) and commonly used psychological measures in patients with upper extremity illness. Methods: A cohort of 135 new or follow-up patients presenting to an urban academic hospital-based hand surgeon were invited to complete a web-based version of the MHQ, Abbreviated Pain Catastrophizing Scale (PCS), and two Patient-Reported Outcomes Measurement Information System (PROMIS)-based questionnaires: Pain Interference and Depression. Bivariate and multivariable analyses measured the correlation of these psychological measures with MHQ. Results: Accounting for potential confounding factors in multivariable regression, upper extremity disability as rated by the MHQ was independently associated with PROMIS Depression, PROMIS Pain Interference, visit type, and working status. The model accounted for 37% of the variability in MHQ scores, with PROMIS Pain Interference having the most influence. Conclusion: Among the non-pathophysiological factors that contribute to patient-to-patient variation in MHQ scores, the measure of less effective coping strategies and symptoms of depression were most influential. Our data add to the evidence of the pivotal role of emotional health in upper extremity symptoms and limitations and the importance of psychosocial considerations in the care of hand illness.

Diagnostic Wrist Arthroscopy for Nonspecific Wrist Pain.

Background: This study addresses the prevalence of discrete pathophysiology accounting for patients' symptoms during diagnostic wrist arthroscopy in individuals with wrist pain without a specific preoperative diagnosis. Secondarily, we determined the number and type of surgeries subsequent to diagnostic wrist arthroscopy. Methods: Between January 2000 and January 2015, 135 diagnostic wrist arthroscopies were performed by 12 surgeons in 3 urban academic hospitals. We recorded the diagnostic findings of diagnostic wrist arthroscopy and any subsequent surgeries. Results: One hundred and five patients had synovitis or a normal wrist (78%), 17 had likely age-appropriate changes (eg, central triangular fibrocartilage complex defects scapholunate changes) (13%), 8 (6%) were given uncommon diagnoses, and 5 (4%) had osteochondral defects. Sixteen patients (12%) had subsequent wrist surgery: 2 were for adverse events, 2 were carpal tunnel releases, and 12 were other surgeries. Conclusion: Diagnostic arthroscopy performed in the setting of an unclear preoperative diagnosis yielded limited diagnostic benefit.

Tension band wiring for simple olecranon fractures: evaluation of surgical technique.

BACKGROUND: In some settings, specific techniques for open reduction and internal fixation are preferred based on the eminence of a surgeon or professional organization. An emphasis on technical aspects of surgery that are not proved superior and vary substantially from surgeon to surgeon can be confusing for trainees. This study applied a numerical grading of the technical aspects of tension band wire (TBW) fixation for olecranon fracture; assessed the interobserver agreement of each criterion; and measured the correlation of the technical grading and objective and subjective long-term outcomes. MATERIALS AND METHODS: Forty observers were invited to rate the technical aspects of TBW fixation of the olecranon on 26 post-operative radiographs. The interobserver reliability of the rating was measured using the intra-class correlation coefficient. The correlation between the rating and motion, Mayo elbow performance index, and disabilities of the arm, shoulder and hand score was tested with the Spearman's rank correlation test. RESULTS: None of the figure-of-eight TBW constructs were considered perfect according to the numerical grading: the majority of observers found three deviations per fixation. The interobserver agreement was only fair for the total number of deviations and no correlation between the number of deviations and long-term objective and subjective outcome was found. CONCLUSIONS: A rating of the technical aspects of TBW for olecranon fractures was unreliable and did not correlate with subjective and objective outcomes. Emphasis on specific technical aspects of fixation might be confusing for trainees and could distract them from the principles of effective treatment. LEVEL OF EVIDENCE: Level IV diagnostic study.