Patient and caregiver opinions about an FDA-developed generic drug educational handout: A pilot cross-sectional survey.

OBJECTIVE: To examine patient and caregiver opinions and "receptivity" regarding generic drug educational material in terms of content, format and design, delivery channel, and level of satisfaction. METHODS: Interviewer-administered surveys were conducted with patients and caregivers who were clients of a regional medication management program or pharmacy services clinic to gather perceptions about generic drugs and input on a generic drug educational handout developed by the U.S. Food and Drug Administration (FDA). Survey questions were developed by the investigators and pretested before use. Data were analyzed using descriptive statistics, and responses to open-ended questions were assessed using qualitative content analysis. Survey psychometrics were examined using exploratory factor analysis (EFA). RESULTS: Of the 100 survey participants, most (93%) had positive perceptions about generic drug safety and effectiveness after reading the handout. Most participants were satisfied or very satisfied with the handout's content (87%) as well as format and design (92%). However, more than 20% of participants were still unsure about the benefits and risks of generic drugs compared with those of brand drugs, and more than 15% were still unsure about which benefits and risks mattered most to them. The participants' preferred source for the handout was a pharmacy (49%) or doctor's office (27%). In an EFA of the survey instrument, 2 factors emerged related to the educational handout's content: (1) generic drug information, a 7-item factor (Cronbach alpha = 0.882); and (2) personal relevance, a 3-item factor (Cronbach alpha = 0.692). CONCLUSION: The findings indicate an overall positive "receptiveness" toward generic drug informational materials from patients and caregivers, which highlights the feasibility and importance of educational outreach programs about generic drugs targeted toward this population. Future studies may focus on more diverse populations and tailor materials to the needs of specific patient and caregiver subgroups and health literacy levels.

Red Blood Cell Product Transfusion Thresholds and Clinical Outcomes.

OBJECTIVE: To determine whether patients transfused red blood cell (RBC) products according to guideline-specified pretransfusion hemoglobin (Hb) concentrations or for other reasons were more likely to survive their intensive care unit (ICU) stay. DESIGN: An observational study of 375 478 episodes of ICU care, over 5 years, was performed with ICU survival as the primary outcome. Outcomes were analyzed as a function of pretransfusion Hb concentration for groups with distinct transfusion indications while adjusting for potential confounders. SETTING AND PATIENTS: This study included all adult patients discharged from 1 of 203 adult ICUs from 32 US health-care systems. The patients were from community hospitals, tertiary, and academic medical centers. INTERVENTION: Transfusion of allogenic packed RBCs or whole blood was prescribed at the discretion of the treating clinicians. MEASUREMENTS AND MAIN RESULTS: We found that 15% of adult ICU patients are transfused RBC products, and most transfusions for hemodynamically stable patients are administered above the guideline-specified pretransfusion Hb threshold of 7 g/dL. Hemodynamically stable patients transfused below this threshold were significantly more likely to survive their ICU stay than those not transfused (odds ratio [OR] 0.59, 95% confidence interval [CI], 0.43-0.81; P = .001), and patients transfused at thresholds above 9 g/dL were less likely to survive their ICU stay than those not transfused. Patients of the acute blood loss group who were transfused appeared to benefit or were not harmed by transfusion. CONCLUSION: Conservative RBC product transfusion practices for groups that are targeted by guidelines are justified by outcomes observed in clinical practice. This study provides evidence for the liberal administration of RBC products to critically ill adults with acute blood loss based on association with lower risk of mortality.

Do organizational cultures of Canadian medical schools promote a quality culture?

Purpose: Medical schools are expected to engage in ongoing reflection to maintain the quality of the education they deliver, that is, to cultivate a Quality Culture. Quality Culture integrates the culture of an organization with its structure and management processes. The culture of medical schools has not been previously studied. Organizational cultures can be identified using the Competing Value Questionnaire, and classified into four types, based on organizations' climate, leader style, reward systems, and strategic emphasis. Clan and Open cultures are typically positively associated with quality improvement. This study identifies the dominant organizational cultures of Canadian medical schools. Method: Sixteen of the 17 Canadian medical schools were invited to participate; one school was excluded due to ongoing accreditation activities. Faculty members of participating schools were surveyed. Results: Eleven (69%) schools participated. Nine had a dominant Hierarchical culture; two had a dominant Clan culture. Conclusions: Only two schools had a Clan culture, which might better support ongoing reflections on quality improvement. Schools leaders should examine the staff climate, leadership style, rewards system, and strategic emphasis in place at their school; these will provide clues to the existing culture and help prioritize changes required to support the implementation of a Quality Culture.

Quality of Online Resources for Pancreatic Cancer Patients.

The Internet is increasingly a source of information for pancreatic cancer patients. This disease is usually diagnosed at an advanced stage; therefore, timely access to high-quality information is critical. Our purpose is to systematically evaluate the information available to pancreatic cancer patients on the internet. An internet search using the term "pancreatic cancer" was performed, with the meta-search engines "Dogpile", "Yippy" and "Google". The top 100 websites returned by the search engines were evaluated using a validated structured rating tool. Inter-rater reliability was evaluated using kappa statistics and results were analyzed using descriptive statistics. Amongst the 100 websites evaluated, etiology/risk factors and symptoms were the most accurately covered (70 and 67% of websites). Prevention, treatment and prognosis were the least accurate sections (55, 55 and 43% of websites). Prevention and prognosis were also the least likely to be covered with 63 and 51 websites covering these, respectively. Only 40% of websites identified an author. Twenty-two percent of websites were at a university reading level. The majority of online information is accurate but incomplete. Websites may lack information on prognosis. Many websites are outdated and lacked author information, and readability levels are inappropriate. This knowledge can inform the dialogue between healthcare providers and patients.

Maryland Multipayor Patient-centered Medical Home Program: A 4-Year Quasiexperimental Evaluation of Quality, Utilization, Patient Satisfaction, and Provider Perceptions.

OBJECTIVE: To evaluate impact of the Maryland Multipayor Patient-centered Medical Home Program (MMPP) on: (1) quality, utilization, and costs of care; (2) beneficiaries' experiences and satisfaction with care; and (3) perceptions of providers. DESIGN: 4-year quasiexperimental design with a difference-in-differences analytic approach to compare changes in outcomes between MMPP practices and propensity score-matched comparisons; pre-post design for patient-reported outcomes among MMPP beneficiaries. SUBJECTS: Beneficiaries (Medicaid-insured and privately insured) and providers in 52 MMPP practices and 104 matched comparisons in Maryland. INTERVENTION: Participating practices received unconditional financial support and coaching to facilitate functioning as medical homes, membership in a learning collaborative to promote education and dissemination of best practices, and performance-based payments. MEASURES: Sixteen quality, 20 utilization, and 13 cost measures from administrative data; patient-reported outcomes on care delivery, trust in provider, access to care, and chronic illness management; and provider perceptions of team operation, team culture, satisfaction with care provided, and patient-centered medical home transformation. RESULTS: The MMPP had mixed impact on site-level quality and utilization measures. Participation was significantly associated with lower inpatient and outpatient payments in the first year among privately insured beneficiaries, and for the entire duration among Medicaid beneficiaries. There was indication that MMPP practices shifted responsibility for certain administrative tasks from clinicians to medical assistants or care managers. The program had limited effect on measures of patient satisfaction (although response rates were low) and on provider perceptions. CONCLUSIONS: The MMPP demonstrated mixed results of its impact and indicated differential program effects for privately insured and Medicaid beneficiaries.

Association between Higher Generic Drug Use and Medicare Part D Star Ratings: An Observational Analysis.

BACKGROUND: Increasing generic drug use, due to potential for cost savings and drug access, is a viable consideration for Medicare prescription drug plans to achieve high star ratings and improve quality of plan offerings for Medicare beneficiaries. OBJECTIVE: To examine the association between contract-level proportion of generic drugs dispensed (pGDD) and Medicare Part D star ratings. METHODS: This was a retrospective study of linked 2011 Medicare Part D star rating data with contract-level pGDD data. A total of 477 individual Medicare prescription contracts were included, representing 75% of total Prescription Drug Plans and more than 65% of total Medicare Advantage Prescription Drug Plans available by the end of 2010. Primary outcomes were Medicare Part D summary and domain star ratings (1-5 indicating lowest to highest performance), incorporating a range of quality measures for access, cost, beneficiary satisfaction, and health services outcomes and processes. Ordinal logistic regression models were used to examine associations between pGDD and Medicare Part D summary and domain star ratings, controlling for contract type and number of beneficiary enrollment. RESULTS: Higher pGDD was associated with higher summary star ratings (adjusted odds ratio 1.08 with 95% confidence interval 1.04-1.12) and higher "member experience with drug plan" domain ratings (adjusted odds ratio 1.07 with 95% confidence interval 1.03-1.11). CONCLUSIONS: Prescription formulary benefit design targeting increasing generic drug use appears to be associated with improved member experience and higher plan star ratings. Consideration may be given to incorporating pGDD into Medicare Part D star rating measures to improve quality of prescription plans.

The association of antidepressant treatment with COPD maintenance medication use and adherence in a comorbid Medicare population: A longitudinal cohort study.

The effect of treating comorbid depression to achieve optimal management of chronic obstructive pulmonary disease (COPD) has not yet empirically tested. We examined the association between antidepressant treatment and use of and adherence to COPD maintenance medications among patients with new-onset COPD and comorbid depression. METHODS: Using 2006-2012 Medicare data, this retrospective cohort study identified patients with newly diagnosed COPD and new-onset major depression. Two exposures-antidepressant use (versus non-use) and adherence measured by proportion of days covered (PDC) (PDC ≥0.8 versus <0.8)-were assessed quarterly. We used marginal structural models to estimate the effects of prior antidepressant use and adherence on subsequent COPD maintenance inhaler use and adherence outcomes, accounting for time-varying confounders. RESULTS: A total of 25 458 COPD-depression patients, 82% with antidepressant treatment, were followed for a median of 2.5 years. Nearly half (48%) used at least 1 COPD maintenance inhaler in any given quarter; among users, 3 in 5 (61%) had a PDC of <0.8. Compared to patients with no antidepressant treatment, those with antidepressant use were more likely to use (relative ratio [RR] = 1.15, 95% confidence interval [CI] = 1.12- 1.17) and adhere to (RR = 1.08, 95% = 1.03-1.14) their COPD maintenance inhalers. Patients who adhered to antidepressant treatment were more likely to use and adhere to COPD maintenance inhalers. CONCLUSION: Regularly treated depression may increase use of and adherence to necessary maintenance medications for COPD. Antidepressant treatment may be a key determinant to improving medication-taking behaviors among COPD patients comorbid with depression.

The impact of accreditation on medical schools' processes.

OBJECTIVES: Increased emphasis is being placed worldwide on accreditation of undergraduate medical education programmes, and costs of participation in accreditation continue to rise. The primary purposes of accreditation are to ensure the quality of medical education and to promote quality improvement. Student performance data as indicators of the impact of accreditation have important limitations. The purpose of this study was to evaluate the impact of accreditation using an innovative marker: the processes implemented at medical schools as a result of accreditation. This conceptual model suggests that accreditation drives medical schools to implement and strengthen processes that support quality in medical education. METHODS: In this qualitative study, conducted in 2015-2016, interviews and focus group discussions with deans, undergraduate medical education deans and faculty leaders at 13 of the 17 Canadian medical schools were used to elicit perspectives about processes influenced by accreditation; the method of constant comparative analysis associated with grounded theory was used to generate themes of processes. Perceived negative consequences of accreditation on medical education programmes were also explored. RESULTS: Nine themes representing processes reported as resulting from accreditation were identified. These processes related to: (i) governance, (ii) data collection and analysis, (iii) monitoring, (iv) documentation, (v) creation and revision of policies and procedures, (vi) continuous quality improvement, (vii) faculty members' engagement, (viii) academic accountability and (ix) curriculum reforms. Themes representing negative consequences of accreditation included (i) costs, (ii) staff and faculty members' morale and feelings, (iii) school reputation and (iv) standards. The identified processes, given their nature, appear likely to be associated with improvement of quality in medical education. These results help justify the costs associated with accreditation. CONCLUSIONS: This study uses an innovative marker, medical schools' processes, to evaluate the impact of accreditation. Results provide evidence that accreditation-related activities steer medical education programmes towards establishment of processes likely to be associated with improved quality in medical education.

A critical narrative review of transfer of basic science knowledge in health professions education.

CONTEXT: 'Transfer' is the application of a previously learned concept to solve a new problem in another context. Transfer is essential for basic science education because, to be valuable, basic science knowledge must be transferred to clinical problem solving. Therefore, better understanding of interventions that enhance the transfer of basic science knowledge to clinical reasoning is essential. This review systematically identifies interventions described in the health professions education (HPE) literature that document the transfer of basic science knowledge to clinical reasoning, and considers teaching and assessment strategies. METHODS: A systematic search of the literature was conducted. Articles related to basic science teaching at the undergraduate level in HPE were analysed using a 'transfer out'/'transfer in' conceptual framework. 'Transfer out' refers to the application of knowledge developed in one learning situation to the solving of a new problem. 'Transfer in' refers to the use of previously acquired knowledge to learn from new problems or learning situations. RESULTS: Of 9803 articles initially identified, 627 studies were retrieved for full text evaluation; 15 were included in the literature review. A total of 93% explored 'transfer out' to clinical reasoning and 7% (one article) explored 'transfer in'. Measures of 'transfer out' fostered by basic science knowledge included diagnostic accuracy over time and in new clinical cases. Basic science knowledge supported learning - 'transfer in' - of new related content and ultimately the 'transfer out' to diagnostic reasoning. Successful teaching strategies included the making of connections between basic and clinical sciences, the use of commonsense analogies, and the study of multiple clinical problems in multiple contexts. Performance on recall tests did not reflect the transfer of basic science knowledge to clinical reasoning. CONCLUSIONS: Transfer of basic science knowledge to clinical reasoning is an essential component of HPE that requires further development for implementation and scholarship.

Assessing Physician and Patient Perceptions of Generic Drugs via Facebook: A Feasibility Study.

Background: Social media offer a novel avenue to engage with and recruit research participants. Facebook in particular is a promising option given its popularity and widespread use. Objective: To explore the feasibility of using Facebook to recruit physicians and patients to participate in a survey to assess their perceptions about generic venlafaxine extended release (ER) tablet indicated for depression. Methods: Web-based surveys were developed to gauge physicians' prescribing experiences with and patients' perceptions of generic venlafaxine ER tablet. The surveys included questions specific to venlafaxine ER tablets, such as perceived safety and efficacy of the drug and overall comfort level with either prescribing or taking the drug. Survey links were then posted and advertised on Facebook to recruit physicians and patients. Results: Advertisement for physicians reached 1898 Facebook users and advertisement for patients reached 1144 users during a 10-day advertising period. However, only 14 and 35 users clicked on the survey for physicians and patients, respectively. No physician completed the physician survey while 3 patients completed the patient survey. Conclusions: The findings of this study suggest that Facebook may not be an effective method to recruit physicians. Facebook holds promise to recruit patients, but additional recruitment efforts, such as incentives, are needed.

Disclosure of industry payments to prescribers: industry payments might be a factor impacting generic drug prescribing.

PURPOSE: Pharmaceutical companies paid at least $3.91bn to prescribers in 2013, yet evidence indicating whether industry payments shift prescribing away from generics is limited. This study examined the association between amount of industry payments to prescribers and generic drug prescribing rates among Medicare Part D prescribers. METHODS: A cross-sectional analysis was conducted among 770 095 Medicare Part D prescribers after linking the 2013 national Open Payments data with 2013 Medicare Provider Utilization and Payment data. The exposure variable was the categorized amount of total industry payments to prescribers (i.e., meals, travel, research, and ownership). The outcome was prescriber's annual generic drug prescribing rate. Multivariable generalized linear regression models were used to examine the association between the amount of industry payments and prescriber's annual generic drug prescribing rates, controlling for prescriber's demographic and practice characteristics. RESULTS: In this sample, over one-third (38.0%) of Medicare Part D prescribers received industry payments in 2013. The mean annual generic drug prescribing rate was highest among prescribers receiving no payments and lowest among those receiving more than $500 of industry payments (77.5% vs. 71.3%, respectively; p < 0.001). The receipt of industry payments was independently associated with prescribers' generic drug prescribing rate; higher payments corresponded with lower generic drug prescribing rates. Other prescriber characteristics associated with higher annual generic drug prescribing rate included male sex, non-northeast region, specialty, and patient volume. CONCLUSIONS: Receipt of industry payments was associated with a decreased rate of generic drug prescribing. How this affects patient care and total medical costs warrants further study. Copyright © 2017 John Wiley & Sons, Ltd.

Effect of a simulation-based workshop on breaking bad news for anesthesiology residents: an intervention study.

BACKGROUND: Breaking bad news (BBN) to patients and their relatives is a complex and stressful task. The ideal structure, training methods and assessment instruments best used to teach and assess BBN for anesthesiology residents remain unclear. The purpose of this study is to evaluate the effectiveness of an education intervention for BBN based on immersive experiences with a high fidelity simulator and role-play with standardized patients (SPs). A secondary purpose is to gather validity evidence to support the use of a GRIEV_ING instrument to assess BBN skills. METHODS: The communication skills for BBN of 16 residents were assessed via videotaped SP encounters at baseline and immediately post-intervention. Residents' perceptions about their ability and comfort for BBN were collected using pre and post workshop surveys. RESULTS: Posttest scores were significantly higher than the pretest scores for the GRIEV_ING checklist, as well as on the communication global rating. The GRIEV_ING checklist had acceptable inter-rater and internal-consistency reliabilities. Performance was not related to years of training, or previous BBN experience. CONCLUSION: Anesthesiology residents' communication skills when BBN in relation to a critical incident may be improved with educational interventions based on immersive experiences with a high fidelity simulator and role-play with SPs.

How do clinical competency committees use different sources of data to assess residents' performance on the internal medicine milestones?A mixed methods pilot study.

PURPOSE: This study examines how Clinical Competency Committees (CCCs) synthesize assessment data to make judgments about residents' clinical performances. METHODS: Between 2014 and 2015, after four six-month reporting periods to the Accreditation Council for Graduate Medical Education (ACGME), 7 of 16 CCC faculty at Rush University Medical Center completed questionnaires focused on their perspectives about rating residents on their achievement of the milestones and participated in a focus group. Qualitative data were analyzed using grounded theory. Milestones ratings for two six-month ACGME reporting cycles (n = 100 categorical residents) were also analyzed. RESULTS: CCC members weighted resident rotation ratings highest (weight = 37%), followed by faculty rotation comments (weight = 27%) and personal experience with residents (weight = 14%) for making judgments about learner's milestone levels. Three assessment issues were identified from qualitative analyses: (1) "design issues" (e.g. problems with available data or lack thereof); (2) "synthesis issues" (e.g. factors influencing ratings and decision-making processes) and (3) "impact issues" (e.g. how CCC generated milestones ratings are used). CONCLUSIONS: Identifying factors that affect assessment at all stages of the CCC process can contribute to improving assessment systems, including support for faculty development for CCCs. Recognizing challenges in synthesizing first and second-hand assessment data is an important step in understanding the CCC decision-making process.

Evaluation of a distance learning academic support program for medical graduates during rural hospital service in India.

BACKGROUND: Christian Medical College (CMC), Vellore, India, a tertiary care hospital, designed a year-long Fellowship in Secondary Hospital Medicine (FSHM) for CMC graduates, with the aim to support them during rural service and be motivated to consider practicing in these hospitals. The FSHM was a blend of 15 paper-based distance learning modules, 3 contact sessions, community project work, and networking. This paper reports on the evaluation of the FSHM program. METHODS: The curriculum development process for the FSHM reflected the six-step approach including problem identification, needs assessment, formulating objectives, selecting educational strategies, implementation, and evaluation. Telephone interviews with students were conducted to determine if the program motivated them to consider working in smaller hospitals. RESULTS: Qualitative data analysis showed that the program motivated the FSHM students to consider practicing in secondary hospitals by creating awareness of challenging opportunities and instilling confidence to provide good quality clinical care with limited resources. DISCUSSION: We propose rural service for MBBS graduates, supported by a blend of on-site and distance education as a model for medical education.

New episodes of depression among Medicare beneficiaries with chronic obstructive pulmonary disease.

OBJECTIVES: Depression is a common comorbidity of chronic obstructive pulmonary disease (COPD) and is associated with increased exacerbations, healthcare utilization, and mortality. Among Medicare beneficiaries newly diagnosed with COPD, the objectives of this study were to (1) estimate the rate of new episodes of depression and (2) identify factors associated with depression. METHODS: We identified beneficiaries with a first diagnosis of COPD during 2006-2012 using a 5% random sample of Medicare administrative claims data by searching for ICD-9-CM codes 490, 491.x, 492.x, 494.x, or 496. We identified episodes of depression using ICD-9-CM codes 296.2x, 296.3x, and 311.xx. We calculated incidence rates and their 95% confidence intervals (95% CI) and used a discrete time analysis to identify factors associated with development of depression. RESULTS: Between 2006 and 2012, 125,348 beneficiaries meeting inclusion criteria were newly diagnosed with COPD. Twenty-three percent developed depression following COPD diagnosis. The annualized incidence rate of depression per 100 beneficiaries following COPD diagnosis was 9.4 (95% CI 9.3, 9.5). Rates were highest in the first 2 months following COPD diagnosis. COPD diagnosis was associated with increased risk of depression (risk ratio 1.76; 95% CI 1.73, 1.79) as were COPD-related hospitalizations (risk ratio 4.59; 95% CI 4.09, 5.15), a measure of COPD severity. CONCLUSIONS: Diagnosis of COPD increases the risk of depression. This study will aid in the allocation of resources to monitor and provide support for individuals with COPD at high risk of developing depression.

Competencies for Patient Safety and Quality Improvement: A Synthesis of Recommendations in Influential Position Papers.

BACKGROUND: There is limited conformity among patient safety and quality improvement (QI) competencies of the knowledge, skills, and attitudes (KSA), by stage of skill acquisition, essential for all health professionals. A study was conducted to identify, categorize, critically appraise, and discuss implications of competency recommendations published in influential position papers. METHODS: A literature search was conducted of competency recommendations in position papers published by national and international professional associations, expert panels, consortia, centers and institutes, and convened committees, in the domain of patient safety and QI. To be included in the analysis, the competency had to be recommended in at least 20% (rounded) of the position papers. Qualitative content analysis was used to identify themes among the published competencies for the skill acquisition levels of competent and expert, using Dreyfus's definitions. RESULTS: On the basis of the 22 papers that met the inclusion criteria, 17 themes were identified among the 59 competencies for the skill level competent. Among the 23 competencies for the skill level expert, 13 themes were identfied. Competencies within the theme "Evidence-Based Practice" were most frequently recommended across both skill levels. The themes "Interdisciplinary Teamwork and Collaboration" and "Evidence-Based Practice" were the themes identified among the greatest number of position papers for the skill level competent and expert, respectively. CONCLUSIONS: The identified themes for competencies in patient safety and QI have implications for curriculum development and assessment of competence in education and practice. The findings in this study demonstrate a need to discourage publication of recommendations of yet more competencies and to instead encourage development of an international consensus on the essential KSA for patient safety and QI across all health professions and all levels of skill acquisition.

The Barriers and Facilitators to Transfer of Ultrasound-Guided Central Venous Line Skills From Simulation to Practice: Exploring Perceptions of Learners and Supervisors.

UNLABELLED: PHENOMENON: Ultrasound-guided central venous line insertion is currently the standard of care. Randomized controlled trials and systematic reviews show that simulation is superior to apprenticeship training. The purpose of this study is to explore, from the perspectives of participants in a simulation-training program, the factors that help or hinder the transfer of skills from simulation to practice. APPROACH: Purposeful sampling was used to select and study the experience and perspective of novice fellows after they had completed simulation training and then performed ultrasound-guided central venous line in practice. Seven novice pediatric intensive care unit fellows and six supervising faculty in a university-affiliated academic center in a large urban city were recruited between September 2012 and January 2013. We conducted a qualitative study using semistructured interviews as our data source, employing a constructivist, grounded theory methodology. FINDINGS: Both curricular and real-life factors influence the transfer of skills from simulation to practice and the overall performance of trainees. Clear instructions, the opportunity to practice to mastery, one-on-one observation with feedback, supervision, and further real-life experiences were perceived as factors that facilitated the transfer of skills. Concern for patient welfare, live trouble shooting, complexity of the intensive care unit environment, and the procedure itself were perceived as real-life factors that hindered the transfer of skills. Insights: As more studies confirm the superiority of simulation training versus apprenticeship training for initial student learning, the faculty should gain insight into factors that facilitate and hinder the transfer of skills from simulation to bedside settings and impact learners' performances. As simulation further augments clinical learning, efforts should be made to modify the curricular and bedside factors that facilitate transfer of skills from simulation to practice settings.

Technical skills assessment toolbox: a review using the unitary framework of validity.

OBJECTIVE: The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. BACKGROUND: Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. METHODS: A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. RESULTS: A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. CONCLUSIONS: This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Differences in proxy-reported and patient-reported outcomes: assessing health and functional status among medicare beneficiaries.

BACKGROUND: Proxy responses are very common when surveys are conducted among the elderly or disabled population. Outcomes reported by proxy may be systematically different from those obtained from patients directly. The objective of the study is to examine the presence, direction, and magnitude of possible differences between proxy-reported and patient-reported outcomes in health and functional status measures among Medicare beneficiaries. METHODS: This study is a pooled cross-sectional study of a nationally representative sample of community-dwelling Medicare beneficiaries from 2006 to 2011. Survey respondents can respond to the Medicare Current Beneficiary Survey either by themselves or via proxies. Health and functional status was assessed across five domains: physical, affective, cognitive, social, and sensory status. Propensity score matching was used to get matched pairs of patient-reports and proxy-reports. RESULTS: After applying the propensity score matching, the study identified 7,780 person-years of patient-reports paired with 7,780 person-years of proxy-reports. Except for the sensory limitation, differences between proxy-reported and patient-reported outcomes were present in physical, affective, cognitive, and social limitations. Compared to patient-reports, a question regarding survey respondents' difficulties in managing money was associated with the largest proxy response bias (relative risk, RR = 3.83). With few exceptions, the presence, direction, and magnitude of differences between proxy-reported and patient-reported outcomes did not vary much in the subgroup analysis. CONCLUSIONS: When there is a difference between proxy-reported and patient-reported outcomes, proxies tended to report more health and functional limitations among the elderly and disabled population. The extent of proxy response bias depended on the domain being tested and the nature of the question being asked. Researchers should accept proxy reports for sensory status and objective, observable, or easy questions. For physical, affective, cognitive, or social status and private, unobservable, or complex questions, proxy-reported outcomes should be used with caution when patient-reported outcomes are not available.

Harnessing the hidden curriculum: a four-step approach to developing and reinforcing reflective competencies in medical clinical clerkship.

Changing the culture of medicine through the education of medical students has been proposed as a solution to the intractable problems of our profession. Yet few have explored the issues associated with making students partners in this change. There is a powerful hidden curriculum that perpetuates not only desired attitudes and behaviors but also those that are less than desirable. So, how do we educate medical students to resist adopting unprofessional practices they see modeled by supervisors and mentors in the clinical environment? This paper explores these issues and, informed by the literature, we propose a specific set of reflective competencies for medical students as they transition from classroom curricula to clinical practice in a four-step approach: (1) Priming-students about hidden curriculum in their clinical environment and their motivations to conform or comply with external pressures; (2) Noticing-educating students to be aware of their motivations and actions in situations where they experience pressures to conform to practices that they may view as unprofessional; (3) Processing-guiding students to analyze their experiences in collaborative reflective exercises and finally; (4) Choosing-supporting students in selecting behaviors that validate and reinforce their aspirations to develop their best professional identity.