Using the Novel Musculoskeletal Emergency Medicine Assessment Tool: A Feasibility Study.

Background and objective While musculoskeletal (MSK) disorders account for a significant number of primary care and emergency department (ED) visits, there are widely recognized shortcomings and gaps in MSK education throughout medical training. Undergraduate medical education (UME) frequently fails to impart clinically relevant MSK knowledge, while many emergency medicine (EM) residency graduates report feeling unprepared to manage MSK complaints. Existing MSK assessments are not tailored to EM and may inaccurately assess specialty-specific MSK knowledge. The novel validated Musculoskeletal Emergency Medicine Assessment Tool (MEAT) holds great promise in standardizing EM MSK knowledge assessment. This trial of feasibility was conducted to assess the viability and practicality of using MEAT to evaluate MSK knowledge among incoming resident physicians in EM programs. Methods This feasibility study involved 21 incoming EM resident physicians from two programs at a single institution. MEAT was administered online during orientation, and demographic data and survey metadata were collected. UME MSK education details were obtained, and MEAT scores were analyzed. Results Participants reported no difficulties in accessing or understanding the 50-question online MEAT, resulting in a 100% response rate. The average pretest score for all interns was 29.9, with a median of 30. Most participants had documented UME MSK education, but curricular content varied widely. The participants took an average of 32 minutes to complete the assessment. Conclusions MEAT demonstrated successful implementation and high response rates, suggesting a high level of feasibility. The tool can be used to assess baseline MSK knowledge and ultimately track progression during residency with the potential for evaluating educational interventions once further validation studies have been performed. Further adoption of MEAT across multiple EM residency programs will help to enhance the tool's generalizability.

First Evidence on the Validity of the Complexity Index Derived from the Resident Assessment Instrument for Home Care in Home Care Patients.

OBJECTIVES: Recently, a Complexity Index (CI), based on the multidimensional complexity model and derived from the Resident Assessment Instrument for Home Care (interRAI HC) was proposed as a decision-support tool to help frontline health care professionals in their clinical evaluation to identify and analyze complex situations. This study aims to test the CI: (1) concurrent validity with another measure of complexity (ie, the COMID), (2) convergent validity with related constructs assessed by interRAI HC scales (eg, depression), (3) divergent validity (comparison between CI-COMID and scales-COMID correlations), and (4) predictive validity on coordination meetings. DESIGN: A cross-sectional observational design was used for a secondary analysis of interRAI HC and COMID data collected in routine home care nursing practice (July-December 2021). SETTING AND PARTICIPANTS: Participants were community-dwelling adults receiving home care, with full interRAI HC and COMID assessments (N = 3533). METHODS: Correlational analyses were conducted to test the concurrent validity of the CI (with the COMID) and the convergent and divergent validity of the CI (with interRAI HCSwitzerland scales, eg, Depression Rating Scale, Method for Assigning Priority Levels, and a Frailty Index). A receiver operating characteristic (ROC) analysis was conducted to test the discriminative ability of CI on specific professional team coordination meetings. RESULTS: Results showed that the CI correlated positively and strongly with the COMID (ρ = 0.691, P < .001, concurrent validity), positively with all the tested scales (P < .001, convergent validity), whereas the CI-COMID correlation was higher than the interRAI HC scales-COMID correlations (divergent validity). The ROC analysis showed the CI had a high area under the curve (AUC = 0.719, predictive validity). CONCLUSIONS AND IMPLICATIONS: The CI demonstrates good validity properties with a strong correlation with the COMID and a high predictive value for coordination meeting. It is distinct from the other interRAI HC scales and has its place among them to support the clinical analysis of complex situations.

A Prospective Study Measuring Resident and Faculty Contour Concordance: A Potential Tool for Quantitative Assessment of Residents' Performance in Contouring and Target Delineation in Radiation Oncology Residency.

PURPOSE/OBJECTIVE(S): Accurate target delineation (ie, contouring) is essential for radiation treatment planning and radiotherapy efficacy. As a result, improving the quality of target delineation is an important goal in the education of radiation oncology residents. The purpose of this study was to track the concordance of radiation oncology residents' contours with those of faculty physicians over the course of 1 year to assess for patterns. MATERIALS/METHODS: Residents in postgraduate year (PGY) levels 2 to 4 were asked to contour target volumes that were then compared to the finalized, faculty physician-approved contours. Concordance between resident and faculty physician contours was determined by calculating the Jaccard concordance index (JCI), ranging from 0, meaning no agreement, to 1, meaning complete agreement. Multivariate mixed-effect models were used to assess the association of JCI to the fixed effect of PGY level and its interactions with cancer type and other baseline characteristics. Post hoc means of JCI were compared between PGY levels after accounting for multiple comparisons using Tukey's method. RESULTS: In total, 958 structures from 314 patients collected during the 2020-2021 academic year were studied. The mean JCI was 0.77, 0.75, and 0.61 for the PGY-4, PGY-3, and PGY-2 levels, respectively. The JCI score for PGY-2 was found to be lower than those for PGY-3 and PGY-4, respectively (all P < .001). No statistically significant difference of JCI score was found between the PGY-3 and PGY-4 levels. The average JCI score was lowest (0.51) for primary head and/or neck cancers, and it was highest (0.80) for gynecologic cancers. CONCLUSIONS: Tracking and comparing the concordance of resident contours with faculty physician contours is an intriguing method of assessing resident performance in contouring and target delineation and could potentially serve as a quantitative metric, which is lacking currently, in radiation oncology resident evaluation. However, additional study is necessary before this technique can be incorporated into residency assessments.

The Association of Long-Term Opioid Use With Health Care and Home Care Service Use Among Aged Home Care Clients.

OBJECTIVES: To compare health care and home care service utilization, mortality, and long-term care admissions between long-term opioid users and nonusers among aged home care clients. DESIGN: A retrospective cohort study based on the Resident Assessment Instrument-Home Care (RAI-HC) assessments and electronic medical records. SETTING AND PARTICIPANTS: The study sample included all regular home care clients aged ≥65 years (n = 2475), of whom 220 were long-term opioid users, in one city in Finland (population base 222,000 inhabitants). METHODS: Health care utilization, mortality, and long-term care admissions over a 1-year follow-up were recorded from electronic medical records, and home care service use from the RAI-HC. Negative binomial and multivariable logistic regression, adjusted for several socioeconomic and health characteristics, were used to analyze the associations between opioid use and health and home care service use. RESULTS: Compared with nonusers, long-term opioid users had more outpatient consultations (incidence rate ratio 1.26; 95% CI 1.08-1.48), home visits (1.23; 1.01-1.49), phone contacts (1.38; 1.13-1.68), and consultations without a patient attending a practice (1.22; 1.04-1.43) after adjustments. A greater proportion of long-term opioid users than nonusers had at least 1 hospitalization (49% vs 41%) but the number of inpatient days did not differ after adjustments. The home care nurses' median work hours per week were 4.3 (Q1-Q3 1.5-7.7) among opioid users and 2.8 (1.0-6.1) among nonusers. Mortality and long-term care admissions were not associated with opioid use. CONCLUSIONS AND IMPLICATIONS: Long-term opioid use in home care clients is associated with increased health care utilization regardless of the severity of pain and other sociodemographic and health characteristics. This may indicate the inability of health care organizations to produce alternative treatment strategies for pain management when opioids do not meet patients' needs. The exact reasons for opioid users' greater health care utilization should be examined in future.

A Cross-Sectional, Correlational Study Comparing Individual Characteristics of Younger and Older Nursing Home Residents using Western Canadian Resident Assessment Instrument-Minimum Data Set (RAI-MDS) 2.0.

OBJECTIVE: To compare characteristics of nursing home (NH) residents by age categories in Western Canada. DESIGN: A cross-sectional, correlational analysis of secondary data. SETTING AND PARTICIPANTS: 89,231 residents living in Western Canada NHs in the provinces of Alberta, Manitoba, and British Columbia in 2016 and 2017. METHODS: Resident characteristics (age, sex, marital status, body mass index, medical diagnoses, cognitive function, physical function, depressive symptoms) came from the Resident Assessment Instrument-Minimum Data Set 2.0 and were analyzed using chi-square, analysis of variance, and post hoc pairwise tests. Human developmental stage age categories were used to create 5 age groups: 18-34, 35-50, 51-64, 65-80, and 81 years and older. RESULTS: The demographics, medical diagnoses, cognitive function, and physical function characteristics of NH residents among 5 age groups differed considerably (all P < .001). Residents aged 18-34 years were predominately male, never married, with a higher incidence of paralysis and traumatic brain injury. Residents aged 35-50 years had a higher incidence of stroke and multiple sclerosis, and residents aged 51-64 years mainly were morbidly obese and more prone to depression. Residents aged 65-80 years were predominately married and more prone to diabetes, and residents aged 81 years and older were predominately widowed, with a higher incidence of dementia compared with others. CONCLUSIONS AND IMPLICATIONS: Findings describe the uniqueness of younger NH age groups and indicate that the youngest NH residents often have the severe disability and a modest support system (as defined by partnered status) compared to older residents in NHs. Future studies must analyze longitudinal data that track the growth of, and changes in, residents' health and functional status.

Validity Evidence for ENTRUST as an Assessment of Surgical Decision-Making for the Inguinal Hernia Entrustable Professional Activity (EPA).

OBJECTIVE: As the American Board of Surgery (ABS) moves toward implementation of Entrustable Professional Activities (EPAs), there is a growing need for objective evaluation of readiness for entrustment of residents. This requires not only assessment of technical skills and knowledge, but also surgical decision-making in preoperative, intraoperative, and postoperative settings. We developed and piloted an Inguinal Hernia EPA Assessment on ENTRUST, a serious game-based online virtual patient simulation platform to assess trainees' decision-making competence. DESIGN: This is a prospective analysis of resident performance on the ENTRUST Inguinal Hernia EPA Assessment using bivariate analyses. SETTING: This study was conducted at an academic institution in a proctored exam setting. PARTICIPANTS: Forty-three surgical residents completed the ENTRUST Inguinal Hernia EPA Assessment. RESULTS: Four case scenarios for the Inguinal Hernia EPA and corresponding scoring algorithms were iteratively developed by expert consensus aligned with ABS EPA descriptions and functions. ENTRUST Inguinal Hernia Grand Total Score was positively correlated with PGY-level (p < 0.0001). Preoperative, Intraoperative, and Postoperative Total Scores were also positively correlated with PGY-level (p = 0.001, p = 0.006, and p = 0.038, respectively). Total Case Scores were positively correlated with PGY-level for cases representing elective unilateral inguinal hernia (p = 0.0004), strangulated inguinal hernia (p < 0.0001), and elective bilateral inguinal hernia (p = 0.0003). Preoperative Sub-Scores were positively correlated with PGY-level for all cases (p < 0.01). Intraoperative Sub-Scores were positively correlated with PGY-level for strangulated inguinal hernia and bilateral inguinal hernia (p = 0.0007 and p = 0.0002, respectively). Grand Total Score and Intraoperative Sub-Score were correlated with prior operative experience (p < 0.0001). Prior video game experience did not correlate with performance on ENTRUST (p = 0.56). CONCLUSIONS: Performance on the ENTRUST Inguinal Hernia EPA Assessment was positively correlated to PGY-level and prior inguinal hernia operative performance, providing initial validity evidence for its use as an objective assessment for surgical decision-making. The ENTRUST platform holds potential as tool for assessment of ABS EPAs in surgical residency programs.

Resident Readiness for Senior Level Decision Making: Identifying the Domains for Formative Assessment and Feedback.

OBJECTIVE: To establish expert consensus regarding the domains and topics for senior surgery residents (PGY-4) to make critical decisions and assume senior-level responsibilities, and to develop the formative American College of Surgeons Senior Resident Readiness Assessment (ACS SRRA) Program. DESIGN: The American College of Surgeons (ACS) education leadership team conducted a focus group with surgical experts to identify the content for an assessment tool to evaluate senior residents' readiness for their increased levels of responsibility. After the focus group, national experts were recruited to develop consensus on the topics through three rounds of surveys using Delphi methodology. The Delphi participants rated topics using Likert-type scales and their comments were incorporated into subsequent rounds. Consensus was defined as ≥ 80% agreement with internal-consistency reliability (Cronbach's alpha) ≥ 0.8. In a stepwise fashion, topics that did not achieve consensus for inclusion were removed from subsequent survey rounds. SETTING: The surveys were administered via an online questionnaire. PARTICIPANTS: Twelve program directors and assistant program directors made up the focus group. The 39 Delphi participants represented seven different surgical subspecialties and were from diverse practice settings. The median length of experience in general surgery resident education was 20 years (IQR 14.3-30.0) with 64% of the experts being either current or past general surgery residency program directors. RESULTS: The response rate was 100% and Cronbach's alpha was ≥ 0.9 for each round. The Delphi participants contributed a large number of comments. Of the 201 topics that were evaluated initially, 120 topics in 25 core clinical areas were included to create the final domains of ACS SRRA. CONCLUSIONS: National consensus on the domain of the ACS SRRA has been achieved via the modified Delphi method among expert surgeon educators. ACS SRRA will identify clinical topics and areas in which each senior resident needs improvement and provide data to residents and residency programs to develop individualized learning plans. This would help in preparing the senior residents to assume their responsibilities and support their readiness for future fellowship training or surgical practice.

Words Matter: Examining Gender Differences in the Language Used to Evaluate Pediatrics Residents.

BACKGROUND: Gender disparities in academic medicine continue to be pervasive. Written evaluations of residents may provide insight into perceptions of residents by faculty, which may influence letters of recommendation for positions beyond residency and reinforce perceived stereotype threat experienced by trainees. OBJECTIVE: To examine language used in faculty evaluations of pediatrics residents to determine if there are differences in language used with respect to gender of resident. DESIGN/METHODS: All faculty evaluations of residents in 3 consecutive intern classes from 2016 to 2018 were collected and redacted for name and gender identifiers. We performed a qualitative analysis of written comments in 2 mandatory free text sections. The study team initially coded text collectively, generating a code book, then individually to apply the coding scheme. Next, evaluations were unblinded to gender. Code applications were aggregated by resident, and frequencies of code application by resident were compared by standardized mean differences to detect imbalances between genders. RESULTS: A total of 448 evaluations were analyzed: 88 evaluations of 17 male residents, and 360 evaluations of 70 female residents. Codes more frequently applied to women included "enthusiasm," and "caring," while codes more frequently applied to men included "intelligence," and "prepared." A conceptual model was created to reflect potential impacts of these differences using a lens of social role theory. CONCLUSIONS: We identified differences in the way male and female residents are evaluated by faculty, which may have negative downstream effects on female residents, who may experience negative self-perception, differential development of clinical skills, and divergent career opportunities as a result.

Factors associated with daily opioid use among aged home care clients: a cross-sectional analysis of Resident Assessment Instrument data.

PURPOSE: To examine which client characteristics and other factors, including possible adverse effects, identified in the Resident Assessment Instrument-Home Care (RAI-HC) are associated with daily opioid use among aged home care clients. METHODS: The study sample comprised 2584 home care clients aged ≥ 65 years, of which 282 persons used opioids daily. Clients using opioids less than once daily were excluded. The cross-sectional data were gathered from each client's first assessment with the RAI-HC during 2014. Multivariable logistic regression was used to study associations of daily opioid use with the clients' characteristics and symptoms. RESULTS: Cognitive impairment was associated with less frequent opioid use after adjusting for pain-related diseases, disabilities and depressive symptoms (OR 0.43, 95% CI 0.32-0.58). The association was not explained by the estimated severity of pain. Osteoporosis, cancer within previous 5 years and greater disabilities in Instrumental Activities of Daily Living (IADL) were associated with daily opioid use regardless of the estimated severity of pain. Depressive symptoms and Parkinson's disease were associated with daily opioid use only among clients with cognitive impairment, and disabilities in Activities of Daily Living, cancer, arthritis, fractures and pressure ulcers only among clients without cognitive impairment. Constipation was the only adverse effect associated with daily opioid use. CONCLUSION: The pain of home care clients with cognitive impairment may not be treated optimally, whereas there might be prolonged opioid use without a sufficient evaluation of current pain among clients with osteoporosis, cancer within previous 5 years and disabilities in IADLs.

Quality of care plans in long-term care facilities for the older persons-How well is information from RAI assessments utilised in care planning?

BACKGROUND: In Finland, care plans at long-term care facilities (LTCF) for the older persons should be based on information from Resident Assessment Instrument (RAI) assessments and the principles of structured data. Hence, managers are responsible for ensuring that the RAI system is used to a satisfactory extent, the provided information is used in care planning, and that staff members are competent at composing high-quality care plans. AIM: To explore the congruence between first-line managers' assessments of the extent to which care plans include RAI information and separately observed RAI-related contents of care plans. METHODS: The study was based on a descriptive, cross-sectional survey of first-line managers (n = 15) from three LTCF organisations and a randomly selected sample of care plans (n = 45) from two LTCF organisations in Finland. Manager responses and analysis of care plans were reviewed at a general level. The data were gathered in 2019 and analysed using statistical methods and content analysis. RESULTS: First-line managers' assessments of the extent to which their units' care plans included RAI information did not match the observed care plan contents. The care plan analysis revealed that managers significantly overestimated the extent to which care plans included RAI-related content. CONCLUSION: Managers at LTCF organisations need more training to be able to sufficiently support their staff in using RAI information to draft high-quality care plans. IMPLICATION FOR PRACTICE: Care plans must include a higher level of information related to RAI assessments. To develop competencies in drafting high-quality care plans, training related to RAI information utilisation on all aspects of the care plan should be emphasised and training should be provided to first-line managers and more broadly across the nursing staff.

Validity Evidence for Vascular Skills Assessment: The Feasibility of Fundamentals of Vascular Surgery in General Surgery Residency.

OBJECTIVE: As the Fundamentals of Laparoscopic Surgery (FLS) and Fundamentals of Endoscopic Surgery (FES) have been used for general surgery assessment, the Fundamentals of Vascular Surgery (FVS) has recently been developed to evaluate core operative skills for vascular trainees. This study examines the 3 year implementation of FVS for general surgery residents and it gathers validity evidence using Messick's framework. We hypothesized that the curriculum and assessment tool enhance general surgery resident training and assessment. DESIGN: This is a retrospective review of FVS assessments of residents using descriptive and multivariate analyses. SETTING: This study was conducted at an academic institution, where simulation-based teaching sessions occur in coordination between the general surgery and the integrated vascular surgery residency programs. PARTICIPANTS: Seventeen general surgery residents were assessed in FVS skills by an expert rater from 2018 to 2020. RESULTS: Overall, 86 assessments were completed. CONTENT: Assessment focuses on 3 open vascular skills (End-to-Side Anastomosis, Patch Angioplasty and Clockface Suturing). Response Process: 7 items comprise a graded rating for a skills score. Additionally, a global summary score is designated. Internal Structure: The assessment tool has a Cronbach's alpha of 0.87, demonstrating good internal consistency. Addition of the second rater correlated with Cohen's kappa -0.69 (p < 0.001), indicating poor interrater reliability. Relationships to other variables: The most significant improvement occurred in total scores between PGY2s (17.4 ± 2.37) and PGY4s (23.2 ± 3.00), p < 0.001, indicating adequate level discernment. CONCLUSIONS: The validity evidence of FVS assessment in this study supports its use in general surgery residency at a time when opportunities for open vascular skills assessment may be decreasing due to case availability and shifting paradigms. Further study into quality rater training is needed to optimize national implementation of FVS and ensure consistency in grading.

Value of Standardized Testing in Surgical Training.

Standardized testing remains a cornerstone of assessment in surgical education. Summative standardized tests make up a bulk of the certification requirements that encompasses demonstration of efficient, safe application of clinically relevant surgical knowledge and skills. Formative standardized tests serve similar role to guide teaching endeavors for the programs and comparison of individual trainees on a national level. Ongoing rigorous psychometric evaluations of the standardized tests ensure reliability and validity; however, standardized tests are not without their limitations and biases.

The International Council of Ophthalmology Ophthalmic clinical evaluation exercise.

Purpose: Fifteen years after the publication of the Ophthalmic Clinical Evaluation Exercise (OCEX), it was deemed necessary to review and revise it, and to validate it for an international audience of ophthalmologists. This study to revise the OCEX and validate it for international use. Methods: The OCEX rubric was changed to a modified Dreyfus scale; a behavioral descriptor was created for each category. An international panel of ophthalmic educators reviewed the international applicability and appropriateness of the tool. Results: A tool for assessing and giving feedback on four aspects of clinical competence during the ophthalmic consultation (interview skills, examination, interpersonal and communication skills, and case presentation) was revised. The original scoring tool was improved to a new behavioral one, and relevant comments and suggestions from international reviewers were incorporated. The new tool has face and content validity for an international audience. Conclusion: The OCEX is the only tool for workplace assessment and feedback specifically for ophthalmology residents and the ophthalmic consultation. This improved and simplified version will facilitate its use and implementation to diverse programs around the world.

Differences in operative self-assessment between male and female plastic surgery residents: A survey of 8,149 cases.

BACKGROUND: Previous studies show female residents tend to underrate and male residents to overrate their own performance. We sought to determine if plastic surgery resident trainee self-evaluations differ by resident sex. METHODS: We extracted Operative Entrustability Assessment (OEA) data for plastic surgery programs from MileMarker™, a program capable of storing assessment data for CPT-coded procedures. Complete OEAs contain a trainee self-assessment and attending surgeon assessment. We used simple statistics and linear regression to assess differences, stratifying by trainee sex and post-graduate year (PGY). RESULTS: We analyzed 8149 OEAs from 3 training programs representing 64 residents (25% female) and 51 attendings. Compared to attending assessments, both male and female residents significantly underrated their performance during PGY1. However, during PGY2-6 male residents' self-evaluations were significantly higher and female residents' self-evaluations significantly lower than their attending evaluations. CONCLUSIONS: Results demonstrated female plastic surgery residents underestimated and male residents overestimated their performance. Further studies are needed to determine reasons for these differences.

Aspects of oral health and dementia among Swiss nursing home residents.

BACKGROUND: Little empirical evidence of high levels of oral diseases of people in need of care and the impact of dementia is available. The resident assessment instrument minimum data set (RAI-MDS) is an evaluation tool for caregivers. OBJECTIVE: The aim of this study was to show oral health of nursing home residents through RAI-MDS 2.0 data as a function of the cognitive impairment. METHODS: A retrospective analysis of RAI-MDS (general, cognitive, oral health variables) of 357 long-term care facilities in Switzerland (data of 105,835 residents) was carried out. The final sample size was 7922 residents after applying the inclusion/exclusion criteria in four evaluation groups (no dementia, moderate, severe and incident dementia). RESULTS: As dementia developed and severity increased over time, subjects often had fewer or no teeth and did not wear removable dentures. Chewing problems increased over time regardless of the dementia severity. Oral complaints increased over time in subjects with severe dementia, which in turn led to low body mass index (BMI) values (<23 kg/m2) and was associated with an higher risk of mortality. CONCLUSION: This dataset provides an overview on dental aspects in patients with dementia in nursing homes. The accuracy of the assessment of a given dental situation by nursing staff is to be questioned. The results indicated an underdetection of oral illnesses by nurses.

The prevalence of and exact indications for daily opioid use among aged home care clients with and without dementia.

BACKGROUND: The increasing trend of opioid use for non-malignant pain among older people has raised concerns about whether opioids are used for appropriate indications. On the other hand, pain in patients with dementia may be undertreated. AIMS: To examine the prevalence of and indications for daily opioid use among home care clients, and to determine opioid use differs between those with and without dementia. METHODS: All home care clients aged ≥ 65 years using opioids daily (n = 282) were identified based on their first Resident Assessment Instrument-Home Care assessment in 2014. Exact indications for opioid use, the opioid substance used, the median duration of use, and changes in opioid medication within 12 months from study entry were obtained from the electronic medical records. RESULTS: The prevalence of daily opioid use was 9.3%, and the median duration of use before the study entry was 357 days (interquartile range 126-719 days). The majority of clients continued to use opioids daily during the follow-up year. Vertebral osteoporotic fractures (21.6%), degenerative spinal disorders (20.9%), and osteoarthritis (20.6%) were the most common indications for opioid use. Buprenorphine was used more frequently in persons with dementia, but otherwise there were no differences between those with and without dementia. DISCUSSION AND CONCLUSIONS: Home care clients use opioids for long periods of time for pain related mostly to musculoskeletal disorders, although the effectiveness of long-term opioid use is not clear. The lack of effective or suitable options for management of pain might explain the situation.

Establishing an Orthopedic Program-Specific, Comprehensive Competency-Based Education Program.

BACKGROUND: Competency-based education (CBE) seeks to determine resident proficiency in the knowledge, skills, and behaviors required for independent patient care. Multiple assessment instruments evaluate technical skills or direct patient care in the clinic setting, but there are few reports incorporating both within an orthopedic specialty rotation. This study reports a residency program's comprehensive CBE initiative using formative assessments in the clinic and operating room during a sports medicine rotation. MATERIALS AND METHODS: The sports medicine rotation used validated formative assessments to evaluate resident performance during clinic encounters and program-defined surgical entrustable professional activities (EPAs). Junior resident (postgraduate year [PGY] 1-2) EPAs included basic knee/shoulder arthroscopic procedures. Senior resident (PYG 5) EPAs comprised anterior cruciate ligament reconstruction, biceps tenodesis, shoulder stabilization, and rotator cuff repair. Assessment scores were compared between individuals and PGY groups. RESULTS: Sixty-six clinical skills (CS) and 106 surgical skills assessments were conducted for 22 residents in one academic year. Surgical skills assessments demonstrated significant differences between each PGY group (P < 0.01). All PGY2 and PGY5 residents achieved independence on the evaluated EPAs. PGY5s earned higher scores in CS assessments than the other classes (P < 0.01). PGY2 residents scored higher than PGY1s in 7 of 9 CS domains. CS independence was achieved by 21 of 22 residents by the end of the rotation. CONCLUSIONS: The CBE program effectively quantified expected differences in resident performance by PGY for clinic and surgical assessments on a sports medicine rotation. Assessments built an environment where feedback was more structured and standardized, creating a culture to improve resident education.

Differential Association of Aggression With Sadness for People With Moderate and Severe Dementia.

Little is known about how individual behavioral and psychological symptoms of dementia (BPSD) impact the person with dementia. This cross-sectional, retrospective study examined the association between one BPSD, aggressive behavior, and a patient-identified outcome, sadness, among people with moderate and severe dementia (n = 5001) using clinical administrative Resident Assessment Instrument 2.0 data. For people with moderate or severe cognitive impairment, the odds of sadness were significantly higher if verbal aggression was exhibited 4 to 6 (adjusted odds ratio [aOR] = 2.85, P < .001) or 1 to 3 (aOR = 2.28, P < .001) times per week, or daily (aOR = 1.77, P = .003). People with severe cognitive impairment and who displayed physical aggression either daily (OR = 2.16, P = .002) or 1 to 3 times per week (OR = 1.45, P = .023) also had an increased odds of sadness. Aggression may harm the person with dementia's mental well-being, depending on the level of cognitive impairment, and type and frequency of aggression. Prospective studies can build on these correlational findings.

Perceptions of scheduled vs. unscheduled directly observed visits in an internal medicine residency outpatient clinic.

INTRODUCTION: Learners may subconsciously change their behavior once they know they are being observed, and this Hawthorne effect should be considered when designing assessments of learner behavior. While there is a growing body of literature to suggest direct observation is the ideal standard for formative assessment, the best method to directly observe learners is unknown. We explored scheduled and unscheduled methods of direct observation among internal medicine residents in the outpatient continuity clinic to advance the understanding of both observation methods. METHODS: We conducted a thematic analysis of faculty and internal medicine residents in an outpatient clinic setting. A semi-structured interview guide for focus group sessions was created. Focus groups were used to explore the internal medicine resident and core teaching faculty perceptions of the scheduled and unscheduled direct observation methods in the outpatient clinc. An experienced qualitative research interviewer external to the internal medicine residency was moderating the sessions. Eight peer focus groups were held. Abstraction of themes from focus group transcripts identified resident and faculty perceptions of the different observation methods. RESULTS: Focus groups had 14 resident participants and 14 faculty participants. Unscheduled observations were felt to be more authentic than scheduled observations since residents perceived their behavior to be unmodified. Unscheduled observations allowed for increased numbers of observations per resident, which permitted more frequent formative assessments. Residents and faculty preferred remote video observation compared to in-room observation. Participants found direct observation a useful learning tool for high-yield, specific feedback. CONCLUSIONS: Unscheduled remote direct observation captures authentic clinical encounters while minimizing learner behavior modification. An unscheduled observation approach results in more frequent formative assessment and therefore in more instances of valuable feedback compared to scheduled observations. These findings can help guide the best practice approaches to direct clinical observation in order to enhance residents learning and experience.