Use of an Objective Structured Assessment of Technical Skill After a Sports Medicine Rotation.

PURPOSE: The purpose of this study was to determine if the use of an Objective Structured Assessment of Technical skill (OSATS), using dry models, would be a valid method of assessing residents' ability to perform sports medicine procedures after training in a competency-based model. METHODS: Over 18 months, 27 residents (19 junior [postgraduate year (PGY) 1-3] and 8 senior [PGY 4-5]) sat the OSATS after their rotation, in addition to 14 sports medicine staff and fellows. Each resident was provided a list of 10 procedures in which they were expected to show competence. At the end of the rotation, each resident undertook an OSATS composed of 6 stations sampled from the 10 procedures using dry models-faculty used the Arthroscopic Surgical Skill Evaluation Tool (ASSET), task-specific checklists, as well as an overall 5-point global rating scale (GRS) to score each resident. Each procedure was videotaped for blinded review. RESULTS: The overall reliability of the OSATS (0.9) and the inter-rater reliability (0.9) were both high. A significant difference by year in training was seen for the overall GRS, the total ASSET score, and the total checklist score, as well as for each technical procedure (P < .001). Further analysis revealed a significant difference in the total ASSET score between junior (mean 18.4, 95% confidence interval [CI] 16.8 to 19.9) and senior residents (24.2, 95% CI 22.7 to 25.6), senior residents and fellows (30.1, 95% CI 28.2 to 31.9), as well as between fellows and faculty (37, 95% CI 36.1 to 27.8) (P < .05). CONCLUSIONS: The results of this study show that an OSATS using dry models shows evidence of validity when used to assess performance of technical procedures after a sports medicine rotation. However, junior residents were not able to perform as well as senior residents, suggesting that overall surgical experience is as important as intensive teaching. CLINICAL RELEVANCE: As postgraduate medical training shifts to a competency-based model, methods of assessing performance of technical procedures become necessary.

What factors influence the production of orthopaedic research in East Africa? A qualitative analysis of interviews.

BACKGROUND: Research addressing the burden of musculoskeletal disease in low- and middle-income countries does not reflect the magnitude of the epidemic in these countries as only 9% of the world's biomedical resources are devoted to addressing problems that affect the health of 90% of the world's population. Little is known regarding the barriers to and drivers of orthopaedic surgery research in such resource-poor settings, the knowledge of which would help direct specific interventions for increasing research capacity and help surgeons from high-income countries support the efforts of our colleagues in low- and middle-income countries. PURPOSE: We sought to identify through surveying academic orthopaedic surgeons in East Africa: (1) barriers impeding research, (2) factors that support or drive research, and (3) factors that were identified by some surgeons as barriers and others as drivers (what we term barrier-driver overlap) as they considered the production of clinical research in resource-poor environments. MATERIALS: Semistructured interviews were conducted with 21 orthopaedic surgeon faculty members at four academic medical centers in Ethiopia, Kenya, Tanzania, and Uganda. Qualitative content analysis of the interviews was conducted using methods based in grounded theory. Grounded theory begins with qualitative data, such as interview transcripts, and analyzes the data for repeated ideas or concepts which then are coded and grouped into categories which allow for identification of subjects or problems that may not have been apparent previously to the interviewer. RESULTS: We identified and quantified 19 barriers to and 21 drivers of orthopaedic surgery research (mentioned n = 1688 and n = 1729, respectively). Resource, research process, and institutional domains were identified to categorize the barriers (n = 7, n = 5, n = 7, respectively) and drivers (n = 7, n = 8, n = 6, respectively). Resource barriers (46%) were discussed more often by interview subjects compared with the research process (26%) and institutional barriers (28%). Drivers of research discussed at least once were proportionally similar across the three domains. Some themes such as research ethics boards, technology, and literature access occurred with similar frequency as barriers to and drivers of orthopaedic surgery research. CONCLUSIONS: The barriers we identified most often among East African academic orthopaedic faculty members focused on resources to accomplish research, followed by institutional barriers, and method or process barriers. Drivers to be fostered included a desire to effect change, collaboration with colleagues, and mentorship opportunities. The identified barriers and drivers of research in East Africa provide a targeted framework for interventions and collaborations with surgeons and organizations from high-resource settings looking to be involved in global health.

Relationship between probability of future shoulder arthroplasty and outcomes of arthroscopic debridement in patients with advanced osteoarthritis of glenohumeral joint.

BACKGROUND: Arthroscopic glenohumeral debridement for symptom control has shown promising short term results in the young active population, when arthroplasty may not be a practical option due to the recommended activity restrictions, potential for complications and/or early wear, and a need for revision. The purpose of this study was twofold: 1) to examine the impact of arthroscopic debridement with or without subacromial decompression on clinical outcomes in patients with severe glenohumeral osteoarthritis (OA), and 2) to explore the differences in post-debridement outcomes between patients who eventually progressed to arthroplasty vs. those who did not. The role of an active worker's compensation claim was examined. METHODS: Prospectively collected data of patients who were not good candidates for shoulder arthroplasty and had subsequently undergone arthroscopic shoulder debridement were used for analysis. Disability was measured using the relative Constant-Murley score (CMS), the American Shoulder and Elbow Surgeon's (ASES) assessment form, pain free range of motion (ROM), and strength. RESULTS: Fifty-six patients were included in the final analysis. Eighteen (32 %) patients underwent arthroplasty surgery (arthroplasty group) over a period of 11 years. The arthroplasty group was comparable with the non-arthroplasty group prior to debridement but was more disabled at post-debridement surgery follow-up, functioning at less than 50 % of normal based on ASES, relative CMS, and active painfree ROM. In the multivariable analysis, the post-debridement relative CMS was affected by having a compensation claim and having a future arthroplasty. CONCLUSION: Arthroscopic debridement improved clinical outcome in 68 % of patients suffering from advanced OA of glenohumeral joint. Having less than 50 % of normal score in ASES, relative CMS and painfree ROM post- debridement within a period of two years may be an indication for future arthroplasty. Role of worker's compensation claims should not be underestimated.

The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education.

PURPOSE: The purpose of this systematic review was to identify standard procedures for the validation of arthroscopic simulators and determine whether simulators improve the surgical skills of users. METHODS: Arthroscopic simulator validation studies and randomized trials assessing the effectiveness of arthroscopic simulators in education were identified from online databases, as well as, grey literature and reference lists. Only validation studies and randomized trials were included for review. Study heterogeneity was calculated and where appropriate, study results were combined employing a random effects model. RESULTS: Four hundred and thirteen studies were reviewed. Thirteen studies met the inclusion criteria assessing the construct validity of simulators. A pooled analysis of internal validation studies determined that simulators could discriminate between novice and experts, but not between novice and intermediate trainees on time of completion of a simulated task. Only one study assessed the utility of a knee simulator in training arthroscopic skills directly and demonstrated that the skill level of simulator-trained residents was greater than non-simulator-trained residents. CONCLUSIONS: Excessive heterogeneity exists in the literature to determine the internal and transfer validity of arthroscopic simulators currently available. Evidence suggests that simulators can discriminate between novice and expert users, but discrimination between novice and intermediate trainees in surgical education should be paramount. International standards for the assessment of arthroscopic simulator validity should be developed to increase the use and effectiveness of simulators in orthopedic surgery.

Validation of a global assessment of arthroscopic skills in a cadaveric knee model.

PURPOSE: The purpose of this study was to determine whether a global assessment of arthroscopic skills was valid for blinded assessment of cadaveric diagnostic knee arthroscopy. METHODS: A global skills assessment for arthroscopy was created using a published theory of the development of expertise. Faculty surgeons, fellows, and residents were consented and enrolled in this institutional review board-approved validation study. All participants were oriented to the equipment and procedures for diagnostic arthroscopy of the knee. After reviewing the anatomic structures to be visualized, participants were allowed 10 minutes to complete a diagnostic arthroscopy of the knee. The hands and arthroscopic view were recorded during this attempt. Resident participants completed a second filmed diagnostic arthroscopy 1 week after the initial attempt. Five blinded reviewers watched the synchronized videos and assessed arthroscopic skills with a procedure-specific checklist and the newly developed global skills assessment. The agreement between reviewers was determined by intraclass correlation coefficient. Internal consistency was determined with Cronbach's α. Test-retest reliability was measured by correlating repeated arthroscopies by residents. The ability of the global assessment to discriminate skill levels was determined with between-group Mann-Whitney U tests. RESULTS: The agreement between global assessment scores was strong (I.C.C. = 0.80, 95% C.I. 0.68-0.92). The internal consistency of evaluations was excellent (Cronbach's α = 0.97), and the test-retest reliability was strong (r = 0.52). The global assessment score was shown to be able to discriminate between skill levels by an analysis of variance indicating the difference in means among the various levels of training (P < .0001). CONCLUSIONS: The Objective Assessment of Arthroscopic Skills is a useful adjunct to arthroscopic educators and learners and could be used for in-training evaluations. CLINICAL RELEVANCE: The Objective Assessment of Arthroscopic Skills is an instrument that can be employed to measure the impact of skills curricula, including but not limited to simulation.

Surgeon-Therapist Communication: Do All Members See Eye-to-Eye?

BACKGROUND: Poor interprofessional collaboration has been shown to negatively affect patient care within many fields of medicine. Growing evidence is suggesting that improved interprofessional collaboration can positively affect patient care. Postoperative rehabilitation of many orthopedic conditions necessitates the combined efforts of surgeons, and therapists. There is a paucity of literature examining collaboration among orthopedic surgeons and therapists regarding postoperative rehabilitation. OBJECTIVES: The following study examines the perceived quality of communications between orthopedic surgeons and therapists employing an online survey. We hypothesized that collaborative practice patterns result in improved perceptions of communication. METHODS: Ethics board approval was obtained. Subjects consisted of orthopedic surgeons, licensed physiotherapists and certified athletic therapists. The online survey was distributed through the Canadian Orthopaedic Association (COA), the Canadian Physiotherapy Association (CPA) and the Canadian Athletic Therapists Association (CATA). Data analysis was performed using Stata/IC 12.1 (Stata Corp, College Station, TX, USA). Descriptive statistics were calculated to determine the median responses and ranges. Median responses were compared using the Kruskal-Wallis one-way analysis of variance. Qualitative analysis regarding text responses was performed by three reviewers. RESULTS: Responses were received from all specialties (COA 164, CPA 524, CATA 163). There were significant differences in the perceived quality of communication by quantitative and qualitative analysis (p < 0.001). Analysis of communication within practice patterns of stand-alone versus collaborative revealed improved perception of communication quality with increased contact. 65.6% of responders that practiced as stand-alone had a negative view of interprofessional communication. 48.4% of responders in a collaborative practice had a positive view of interprofessional communication. Analysis of the preferred form of communication found that orthopedic surgeons felt the most useful referral information was a pre-printed consult sheet (odds ratio [OR] = 1.56, p < 0.001), whereas therapists were more likely to rank consult notes (OR = 1.27, p < 0.042) and operative reports (OR = 1.20, p < 0.092) as a more useful form of communication. CONCLUSIONS: Collaborative practice shows improved perceptions of communication between specialties. Orthopedic surgeons perceive a higher quality of communication than therapists. Therapists and orthopedic surgeons also do not agree on the information that should be relayed between the specialties regarding postoperative rehabilitation.

Simulation of Anterior Cruciate Ligament Reconstruction in a Dry Model.

BACKGROUND: As the demand increases for demonstration of competence in surgical skill, the need for validated assessment tools also increases. HYPOTHESIS/PURPOSE: The purpose of this study was to validate a dry knee model for the assessment of performance of anterior cruciate ligament reconstruction (ACLR). The hypothesis was that the combination of a checklist and a previously validated global rating scale would be a valid and reliable means of assessing ACLR when performed by residents in a dry model. STUDY DESIGN: Controlled laboratory study. METHODS: All residents, sports medicine staff, and fellows were invited to perform a hamstring ACLR using anteromedial drilling and Endobutton fixation on a dry model of an anterior cruciate ligament. Previous exposure to knee arthroscopy and ACLR was recorded. A detailed surgical manuscript and technique video were sent to all participants before the study. Residents were evaluated by staff surgeons with task-specific checklists created by use of a modified Delphi procedure and the Arthroscopic Surgical Skill Evaluation Tool (ASSET). Each procedure (hand movements and arthroscopic video) was recorded and scored by a fellow blinded to the year of training of each participant. RESULTS: A total of 29 residents, 5 fellows, and 6 staff surgeons (40 participants total) performed an ACLR on the dry model. The internal reliability (Cronbach alpha) of the test when using the total ASSET score was very high (>0.9). One-way analysis of variance for the total ASSET score and the total checklist score demonstrated a difference between participants based on year of training (P < .001). Post hoc analysis demonstrated a significant difference in global ratings and checklist scores between junior residents (postgraduate year [PGY] 1-3) and senior residents (PGY 4 and 5) and senior residents and fellows (P < .05). A significant difference was seen between fellows and staff on the global rating (P < .05) but not on the checklist scores (P > .05). A good correlation was seen between the total ASSET score and prior exposure to knee arthroscopy (0.73) and ACLR (0.65). The interrater reliability (intraclass correlation coefficient) between the examiner ratings and the blinded assessor ratings for the total ASSET score was very high (>0.8). CONCLUSION: The results of this study provide evidence that the performance of an ACLR in a dry model is a reliable method of assessing a resident's knowledge of the steps and instrumentation required, and the method shows evidence of validity. CLINICAL RELEVANCE: These models may be used to ensure a minimal level of competence before residents and fellows perform ACLR in the operating room.

The application of wearable technology in surgery: ensuring the positive impact of the wearable revolution on surgical patients.

Wearable technology has become an important trend in consumer electronics in the past year. The miniaturization and mass production of myriad sensors have made possible the integration of sensors and output devices in wearable platforms. Despite the consumer focus of the wearable revolution some surgical applications are being developed. These fall into augmentative, assistive, and assessment functions and primarily layer onto current surgical workflows. Some challenges to the adoption of wearable technologies are discussed and a conceptual framework for understanding the potential of wearable technology to revolutionize surgical practice are presented.

Modulation of macrophage activity during fracture repair has differential effects in young adult and elderly mice.

OBJECTIVES: Advanced age is a factor associated with altered fracture healing. Delays in healing may increase the incidence of complications in the elderly, who are less able to tolerate long periods of immobilization and activity restrictions. This study sought to determine whether fracture repair could be enhanced in elderly animals by: (1) inhibiting macrophage activation, (2) blocking the M-CSF receptor c-fms, and (3) inhibiting monocyte trafficking using CC chemokine receptor-2 (CCR2) knockout mice. METHODS: Closed unstable tibial shaft fractures were produced in mice aged 4, 12, and 78 weeks. Mice were then fed a diet containing PLX3397 or a control diet from days 1-10 after injury. Fractures were similarly made in CCR2 mice aged 78 weeks. The fracture callus was collected during fracture healing and was assessed for its size and the presence of macrophages, both of which were evaluated using the Mann-Whitney U test. RESULTS: PLX3397 treatment resulted in a decrease in the number of macrophages in the fracture callus at day 5. Calluses in juvenile mice trended toward being smaller compared with those in elderly mice (P = 0.08). There was also a trend toward larger callus size and increased bone formation in PLX3397-treated elderly animals when compared with those of the control animals (P = 0.12). Similar increases in bone formation (P = 0.013) and decreases in cartilage within the callus (P = 0.03) were seen at day 10 in CCR2 mice. CONCLUSIONS: The inhibition of macrophages in elderly mice may lead to an acceleration of fracture healing. Altering macrophage activation after fracture may represent a therapeutic strategy for preventing delayed healing and nonunion in the elderly.

Sutures versus staples for wound closure in orthopaedic surgery: a pilot randomized controlled trial.

BACKGROUND: In the spectrum of surgical decision-making, wound closure material is often an afterthought. However, the findings of a recent meta-analysis suggest that the rate of surgical site infections (SSIs) is increased by using staples to close surgical wounds. Less clear is the effect of closure material on the incidence of non-infectious wound complications.The aim of this study was to compare sutures and staples in terms of: incidence of wound complications to determine the sample size for a definitive trial comparing wound closure methods. METHODS: Eligible adult orthopaedic patients were randomized to have wounds closed with sutures or staples. Time for skin closure was recorded. Wounds were assessed for complications for six weeks. The incidence of complications was compared using Fisher's exact test. Time to close and pain with removal of closure material were compared using a Student's t-test. RESULTS: The total number of patients reporting a wound complication was 59 of 148 patients completing six-week followup (41%), with no differennce between sutures and staples (RR = 0.77, CI = 0.52-1.14). The time to close wounds was shorter in the staple group (mean=4.8 min, CI = 2.6-7.1) than the suture group (mean=12 min, CI = 7.9-16). Patients in the staple group (mean=3.7, CI =2.8-4.6) reported more pain with removal than suture group (mean=2.5, CI =1.6-3.4). CONCLUSIONS: This study suggests that 42% of patients report a wound complication with no difference between sutures and staples. It was demonstrated that suturing skin requires more time and staples are more painful to remove. TRIAL REGISTRATION: Clinicaltrials.gov identifier NCT01146236 (registered June 14, 2010).