Are evaluations in simulated medical encounters reliable among rater types? A comparison between standardized patient and outside observer ratings of OSCEs.

Objective: By analyzing Objective Structured Clinical Examination (OSCE) evaluations of first-year interns' communication with standardized patients (SP), our study aimed to examine the differences between ratings of SPs and a set of outside observers with training in healthcare communication. Methods: Immediately following completion of OSCEs, SPs evaluated interns' communication skills using 30 items. Later, two observers independently coded video recordings using the same items. We conducted two-tailed t-tests to examine differences between SP and observers' ratings. Results: Rater scores differed significantly on 21 items (p < .05), with 20 of the 21 differences due to higher SP in-person evaluation scores. Items most divergent between SPs and observers included items related to empathic communication and nonverbal communication. Conclusion: Differences between SP and observer ratings should be further investigated to determine if additional rater training is needed or if a revised evaluation measure is needed. Educators may benefit from adjusting evaluation criteria to decrease the number of items raters must complete and may do so by encompassing more global questions regarding various criteria. Furthermore, evaluation measures may be strengthened by undergoing reliability and validity testing. Innovation: This study highlights the strengths and limitations to rater types (observers or SPs), as well as evaluation methods (recorded or in-person).

The Florida Clinical Skills Collaborative: A New Regional Consortium for the Assessment of Clinical Skills.

Discontinuation of the United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) exam and Comprehensive Osteopathic Medical Licensing Examination (COMLEX) Level 2 Performance Evaluation (2-PE) raised questions about the ability of medical schools to ensure the clinical skills competence of graduating students. In February 2021, representatives from all Florida, United States, allopathic and osteopathic schools initiated a collaboration to address this critically important issue in the evolving landscape of medical education. A 5-point Likert scale survey of all members (n=18/20 individuals representing 10/10 institutions) reveals that initial interest in joining the collaboration was high among both individuals (mean 4.78, SD 0.43) and institutions (mean 4.69, SD 0.48). Most individuals (mean 4.78, SD 0.55) and institutions (mean 4.53, SD 0.72) are highly satisfied with their decision to join. Members most commonly cited a "desire to establish a shared assessment in place of Step 2 CS/2-PE" as their most important reason for joining. Experienced benefits of membership were ranked as the following: 1) Networking, 2) Shared resources for curriculum implementation, 3) Scholarship, and 4) Work towards a shared assessment in place of Step 2 CS/2-PE. Challenges of membership were ranked as the following: 1) Logistics such as scheduling and technology, 2) Agreement on common goals, 3) Total time commitment, and 4) Large group size. Members cited the "administration of a joint assessment pilot" as the highest priority for the coming year. Florida has successfully launched a regional consortium for the assessment of clinical skills competency with high levels of member satisfaction which may serve as a model for future regional consortia.

Peer assisted feedback: a successful approach for providing feedback on United States Medical Licensing Exam-style clinical skills exam notes in the United States.

PURPOSE: Peer assisted learning (PAL) promotes the development of communication, facilitates improvement of clinical skills, and provides feedback to learners. We utilized PAL as a conceptual framework to explore the feasibility of peer-assisted feedback (PAF) to improve note writing skills without requiring faculty time. The aim was to assess if peer assisted learning was a successful method to provide feedback on USMLE-style clinical skills exam notes by using student feedback on a survey in the United States. METHODS: The University of Florida College of Medicine administers clinical skills examinations (CSEs) includes USMLE-like note-writing. PAL, where students support the learning of peers, was utilized as an alternative to faculty feedback. Second (MS2) and third (MS3) year medical students taking CSEs participated in faculty-run note-grading sessions immediately after testing, which included explanations of grading rubrics and the feedback process. Students graded an anonymized peer's notes. The graded material was then forwarded anonymously to its student author to review. Students were surveyed on perceived ability to provide feedback and benefits derived from PAF using a Likert scale (1-6) and open-ended comments during the 2017-2018 academic year. RESULTS: Students felt generally positively about the activity with mean score for items related to educational value of 4.49 for MS2 and 5.11 for MS3 out of 6. MS3s perceived peer feedback as constructive, felt benefit from evaluating other's notes, and felt the exercise would improve their future notes. While still positive, MS2 students gave comparatively lower scores than the MS2 students. CONCLUSION: PAF was a successful method to provide feedback on student CSE notes, especially for MS3s. MS2s commented that although they learned during the process, they might be more invested in improving their note writing as they approach their own USMLE exam.

Application of an objective structured clinical examination to evaluate and monitor intern's proficiency of hand hygiene and personal protective equipment use in the United States.

PURPOSE: To determine if an objective structured clinical examination (OSCE) could be used to evaluate and monitor hand hygiene and personal protective equipment (PPE) proficiency for medical interns in the United States. METHODS: Interns in July 2015 (N=123, Cohort 1) without OSCE-based contact precaution evaluation and teaching were evaluated early 2016 by OSCE for hand hygiene and PPE proficiency. They performed poorly. Therefore, the new interns entering July 2016 (N=151, Cohort 2) were immediately tested in the same OSCE station as Cohort 1 and provided feedback and teaching. Cohort 2 was then retested in the OSCE station early 2017. The Mann Whitney U test was used to compare Cohort 1 vs. Cohort 2 performances on checklist items. Cohort 2 performance differences at the beginning and end of the intern year were compared using McNemar's X2 test for paired nominal data. RESULTS: Checklist items were scored, summed and reported as percent correct. In Cohort 2, the mean percent correct was higher in posttest than pretest, 92% vs. 77% )(P <0 .0001). The passing rate (100% correct) was significantly higher, 55% vs. 16%. Comparing Cohort 1 and Cohort 2 at the end of intern year, the mean percent correct was higher for Cohort 2 compared to Cohort 1, 95% vs 90% (P < 0.0001). 55% of the Cohort 2 passed (a perfect score) compared to 24% in Cohort 1 (P < 0.0001). CONCLUSION: An OSCE can be utilized to evaluate and monitor hand hygiene and PPE proficiency for interns in the United States.

Venothromboembolic signs and medical eponyms: Part II.

Eponyms were established to serve the purpose of honoring individuals who have made important observations and discoveries. The use of eponyms remains controversial, and important questions have been raised regarding their appropriateness. Although there have been instances where eponyms were abandoned, the remainder are largely embedded within the established literature making their disappearance unlikely. Physicians used a variety of techniques to describe signs of medical eponyms as a method for diagnosing deep venous thrombosis (DVT), pulmonary embolism (PE) or venothromboembolism (VTE). These methods (observation, palpation, pressure, or maneuvers), were detected during the physical examination and using bedside sphygmomanometer or radiographic imaging. Reviewed are both common and less frequently encountered VTE eponyms identified during the physical examination and radiologic imaging. Most of these signs have not been further studied and, therefore, there is a lack of information regarding their accuracy and reliability in clinical practice.

Venothromboembolic signs and medical eponyms: Part I.

Eponyms are honorific terms ascribed to individuals who discovered a sign, test, syndrome, technique, or instrument. Despite some contentions, eponyms continue to be widely ingrained and incorporated into the medical literature and contemporary language. Physical signs are considered unreliable methods alone for detecting deep venous thrombosis (DVT). The accuracy of the majority of these signs is unknown. For those signs that have been studied, there are a number of methodological limitations hindering the ability to draw meaningful conclusions about their accuracy and validity in clinical practice. Nevertheless, some findings when present and used in conjunction with other key signs, symptoms, and aspects of the patients history may be useful in further supporting the clinical suspicion and likelihood of DVT and/or pulmonary embolism (PE) or venothromboembolism (VTE). These signs also provide the means to better recognize the relationship between clinical findings and VTE. The acquisition of historical knowledge about these signs is important as it further enhances our understanding and appreciation of the diagnostic acumen that physicians were required to employ and to diagnose VTE prior to the advent of advanced imaging methods. Described in this paper is a brief overview of thrombosis as enumerated by Rudolf Virchow, and eponymous signs described in the late eighteenth and nineteenth centuries.

Assessing Prognosis of Acute Coronary Syndrome in Recent Clinical Trials: A Systematic Review.

There is no recent comprehensive overview of contemporary clinical trials assessing short and long-term outcomes in patients with acute coronary syndrome (ACS). This paper reviews factors from recent clinical trials that influenced prognosis in patients with ACS. Cochrane and PubMed databases were screened systematically for clinical trials published in the English literature reporting on ACS prognosis. Two authors independently screened titles, abstracts, and full text. Studies meeting inclusion criteria evaluated the impact of modern practice on prognosis. In vitro and animal models studies, conference abstracts, imaging studies, and review articles were excluded. Disagreement in inclusion criteria was resolved by consensus. A large study of 8,859 patients showed no difference in all-cause mortality between 31 days and 2 years in patients with ST segment elevation myocardial infarction (STEMI) compared to those with non-ST segment elevation myocardial infarction (NSTEMI) or stable ischemic heart disease (SIHD). Other studies showed a significant increase in all-cause mortality in patients with STEMI within the first 30 days, with NSTEMI patients exhibiting a higher mortality rate compared to those with SIHD during the 2-year follow-up period. Our review found that women have a poorer short-term prognosis compared to men. Additionally, reports from patients receiving comprehensive and coordinated care showed longer survival rates. In view of the improved prognosis demonstrated for patients suffering from ACS, assessing prognosis in patients represents a formidable task in modern practice. Our review highlights the need for further evidence-based studies evaluating long-term outcomes on diagnostic and treatment strategies.

Patient-level adherence and interventions in an interdisciplinary DOAC clinic.

BACKGROUND: Direct oral anticoagulants (DOACs) are high risk medications with short half-lives making adherence vitally important. Global measures for adherence have been described; however, there is a lack of patient-level data on adherence. METHODS: This prospective, single-center study in an interdisciplinary internal medicine clinic included patients referred by their primary care physician for DOAC therapy evaluation. Patients were interviewed by a clinical pharmacist who confirmed dose and indication. Adherence was evaluated by asking how it was taken, at what time(s) of the day, and how many doses of their DOAC were missed. Labs and concomitant drugs were evaluated and patients received medication counseling. If any issues arose, the pharmacist would work together with the physician to resolve them. FINDINGS: Of 116 visits from 72 patients, an intervention was needed in 79 visits (68·1%). The most common problem identified was related to adherence: non-adherence to timing of dosing (n = 30), non-adherence to frequency of dosing (n = 5), and non-adherence to administration with food when indicated (n = 11). Adherence issues were present in 11 (61·1%) visits in patients taking rivaroxaban and 31 (33·0%) visits in patients taking apixaban. INTERPRETATION: An interdisciplinary DOAC service provided interventions for the majority of patients referred for DOAC therapy evaluation. The most frequent problem was non-adherence, with more than a third of patients found to be non-adherent to the timing of their medication administration.

Proposed mechanisms of relative bradycardia.

Relative bradycardia is the term used to describe the mechanism where there is dissociation between pulse and temperature. This finding is important to recognize since it may provide further insights into the potential underlying causes of disease. There is no known proposed mechanism to explain this phenomenon. We hypothesize that relative bradycardia is the central mechanism reflecting and influenced potentially by the direct pathogenic effect on the sinoatrial node as well as cross-talk between the autonomic nervous system and immune system. Cardiac pacemaker cells may act as a target for inflammatory cytokines leading to alteration in heart rate dynamics or their responsiveness to neurotransmitters during systemic inflammation. These factors account for the important role of how the host response to infectious and non-infectious causes influences the appearance of relative bradycardia. We propose several methods that may be useful to confirm the proposed theoretical framework to further enhance our understanding of this paradoxical phenomenon. This includes measuring, during the episode of relative bradycardia, proinflammatory and anti-inflammatory cytokines, monitoring heart rate variability (HRV), and assessing underlying comorbidities and outcomes in patients with the same disease.

Diffuse alveolar haemorrhage and Libman-Sacks endocarditis: a rare presentation of antiphospholipid syndrome.

A 26-year-old woman with a history of idiopathic thrombocytopaenic purpura and a 1-year history of blood-streaked sputum presented after a severe episode of haemoptysis with dyspnoea. Chest imaging revealed diffuse ground glass and bronchovascular nodules. Bronchoscopy revealed bilateral diffuse alveolar haemorrhage (DAH). Sputum and bronchoalveolar lavage studies were negative for infectious aetiologies. A transthoracic echocardiogram revealed Libman-Sacks endocarditis with severe mitral regurgitation and physical examination revealed retinal artery occlusion and Osler's nodes. The patient had an increased anticardiolipin Immunoglobulin IgG and anti-B2 glycoprotein IgG, suggesting antiphospholipid syndrome (APLS). The patient was then started on high-dose methylprednisolone and had an improvement in her dyspnoea and haemoptysis. She was also started on anticoagulation as treatment for Libman-Sacks endocarditis. APLS should be considered as a possible underlying aetiology for unusual presentations of DAH with concurrent Libman-Sacks endocarditis in non-intravenous drug users with existing autoimmune disorders.

A systematic review of mobility/immobility in thromboembolism risk assessment models for hospitalized patients.

Hospitalized patients are at risk of venous thromboembolism (VTE) and prophylaxis is often suboptimal due to difficulty in identifying at-risk patients. Simple and validated risk-assessment models (RAMs) are available to assist clinicians in identifying patients who have a high risk for developing VTE. Despite the well-documented association of immobility with increased risk of thrombosis, immobility is not consistently defined in clinical studies. We conducted a systematic review of published VTE RAMs and used objective criteria to determine how the term immobility is defined in RAMs. We identified 17 RAMs with six being externally validated. The concept of immobility is vaguely described in different RAMs, impacting the validity of these models in clinical practice. The wide variability in defining mobility in RAMs precluded its accurate clinical application, further limiting generalization of published RAMs. Externally validated RAMs with clearly defined qualitative or quantitative terms of immobility are needed to assess VTE risk in real-time at the point-of-care.