Bioethics curriculum for undergraduate medical students: an evaluation study utilizing mixed methods approach.

BACKGROUND: The undergraduate bioethics curriculum introduced in a private medical college in Pakistan in 1988 and revised in 2009 has evolved over time to incorporate globally relevant innovations, including integration of bioethics spirally within an existing problem-based learning curricular framework. The present evaluation study shares the results of this integrated bioethics curriculum delivered for 10 years across the five-year undergraduate medical curriculum. The study assessed the effectiveness of the curriculum in terms of student achievement, appropriateness of course contents and efficiency of instructional methods. METHODS: The study utilized a mixed method sequential explanatory design. The quantitative method was used in the first phase to gather data by utilizing a structured online questionnaire. This was followed by the second phase of qualitative methods to explain the findings of the first phase and enrich the data gathered. This phase was based on focus group discussions and document review. RESULTS: Student and faculty responses showed the curriculum contents to be relevant, informative, and appropriate as per learning objectives and student achievement. Multi-modal instructional methods used were stated to be effective and engaging; small group teaching and shorter sessions suggested to be preferable for fostering discussion and maintaining student engagement and attention. Large class formats were stated to be less effective. Students affirmed the contribution of bioethics education to their personal and professional development and ethical positioning. The majority of students agreed that the curriculum contributed to their knowledge acquisition (60.3-71.2%), skill development (59.41-60.30%) and demonstration of ethical/professional behavior (62.54-67.65%). The ranges indicate agreement with related sets of questions. Participants suggested that the curriculum could be further strengthened by better integration in clinical years, role modelling and providing opportunities for application in clinical health care settings. Moreover, topics like ethical issues related to the use of social media, public health ethics and ethics and law were suggested as additions to the existing curriculum. These findings have regional and global relevance for the development and assessment of effective bioethics curricula. CONCLUSION: An effective bioethics curriculum for undergraduate medical education should run longitudinally across the 5 year curriculum and be integrated in the modules and clerkships. Basic acquisition of knowledge and skills takes place in Years 1 & 2 with reinforcement and application in Years 3-5. Learning embedded in an integrated curriculum can help students recognize, critically analyze and address ethical dilemmas. Involvement and commitment of the clinical faculty is essential for reinforcing the ethical principles and concepts learnt in the earlier years.

Relationship of Emotional Intelligence with academic scores and gender in students of Masters in Health Professions Education (MHPE) at a Public Sector University.

Objective: To determine the correlation between Emotional Intelligence (EI) scores and academic scores and identify other factors that have a relationship with EI. Methods: Cross-sectional analytical study was conducted in the year 2021 on 52 students enrolled in three batches of the MHPE program of a public sector university in Karachi. Data was collected by using Sterrett's Emotional Quotient Self-Assessment Checklist along with a self-constructed form for obtaining demographic profile information. Descriptive analysis was done by calculating percentage, mean and standard deviation. The correlation was done by using Spearman rho and association was tested by Chi-square. Results: Data from forty-one participants showed that the majority need to improve their EI. Females and married participants had higher EI scores. There was a significant positive correlation between EI scores and academic performance but no significant association was found between EI and gender of the participants. Conclusion: The study showed that EI competencies have a strong positive correlation with the academic performance of MHPE students. Hence, it emphasizes the need for including development of EI in the outcomes and curricula of the existing MHPE program.

Role of Politics, Guilds and Pedagogy in defining Policies in Medical Education: The Pakistan Scenario.

Politics in education is not a new concept and has been a sore point of discussion between academia and policy makers. The politics of medical education has led to the formation of informal guilds that have taken control over medical education. Policy decisions concerning medical/dental education affecting the lives of the community, at large are implemented without giving due consideration to the pedagogy of medical education. This paper delves into the definitions of politics, pedagogy and guilds and with evidence identifies that major policy decisions in medical education are strongly influenced by politics. The paper will discuss that politics of medical education is not necessarily a bad thing if it ensures public safety and is based on best evidence medical education. In the same context the guilds formed for medical education reforms should uphold the principles of pedagogy.

Relationship between level of empathy during residency training and perception of professionalism climate.

BACKGROUND: Empathy is one of the vital personality attributes for all physicians. It is essential for establishing general interpersonal relationships among doctors and patients. Unfortunately, there is evidence for the decline of physician's empathy during the clinical training phase and is a major concern for medical educators worldwide. One of the major factors reported for the decline of this trait is an unprofessional learning environment. OBJECTIVE: This study examines the relationship between empathy level and perception of climate of professionalism among residents. METHOD: The study participants included 70 residents of Obstetrics & Gynecology and Pediatrics departments of a private sector tertiary care hospital in Karachi, Pakistan. Two self-administered internet based surveys - Jefferson Scale of Physician Empathy (JSPE) and "Professionalism Climate Instrument"(PCI) - were administered to assess the level of empathy among the participants and their perception of professionalism in the learning environment. The relationship between the level of empathy and professionalism was analyzed using Spearman rank correlation. RESULTS: The overall response rate was 81.4% with mean empathy level of 103 ± 13. The internal consistency of each scale measured by Cronbach's coefficient α was 0.76 for JSPE and 0.65 for PCI. No significant difference was observed in the mean empathy scores between senior and junior residents of both specialties. Statistically significant difference in empathy scores existed between female and male residents (p = 0.012; 95% CI, 2.27 to 17.59). The mean PCI score was 106 + 8.88 with no significant difference among residents of two specialties. Professionalism score was not found to vary with either the year of residency or gender. Empathy score and professionalism climate were not found to be correlated (rs = 0.56, p = 0.64). CONCLUSION: The findings suggested that empathy is a relatively stable trait that remains unchanged during residency training programs. Female residents had higher empathic concern than the male trainees, however, the empathy level of the participants was not found to be influenced by the climate of professionalism.

Development and Pilot Testing of a Novel Tool for Evaluating Practical Skills in Hematopathology Residents in Pakistan.

BACKGROUND: The mini-Clinical Evaluation Exercise (mini-CEX) and direct observation of procedural skills (DOPS) are reliable tools for work-based assessment of medical trainees. Tools of this type do not yet exist for evaluation of practical laboratory skills of pathology residents. OBJECTIVE: We developed and piloted a 9-item instrument for direct observation of laboratory skills (DOLS). METHODS: We used the DOLS tool with 10 hematopathology residents (PGY-1 to PGY-5) from Aga Khan University. Each resident was evaluated by 3 faculty members in the laboratory during 4 separate encounters using the DOLS instrument. We assessed construct validity, interrater reliability and G coefficient, feasibility of using DOLS, and learner satisfaction. RESULTS: A total of 120 encounters were observed with a mean score (±1 SD) of 56.7% (±12.44). Assessment scores moderately correlated with the number of laboratory procedures previously performed by participants (r = 0.658 and 0.641; P = .0001) and with PGY level. Interrater reliability ranged between 0.47 and 0.96. Cohen's d was 1.64. Residents accounted for a large component of estimated variance (73%), suggesting DOLS can differentiate residents' laboratory skills; variance associated with assessors was small (0.01%). Residents reported being satisfied with the tool. Mean time (±1 SD) taken for observing and feedback was 17.89 ± 5.89 minutes. CONCLUSIONS: The new DOLS instrument could provide reliable scores for observing laboratory skills. Residents were satisfied with the tool, and rating times make the tool feasible for formative assessments.

Predictive validity of a Uniform Entrance Test for the health professionals.

OBJECTIVE: To investigate the predictive validity of Uniform Entrance Test for academic performance in the first two years in various health science degree programs. METHODS: A retrospective analysis of admissions data and academic performance of students admitted in under-graduate programs of medicine, dentistry and pharmacy of three cohorts was taken. The independent and dependent variables were entry test scores and semester scores respectively. Spearman's Correlation co-efficient was computed to determine the association between entrance test scores and semester scores for three groups. RESULTS: Majority of the students were from the MBBS degree program (61%) with majority of female students (65%) in all three programs. In MBBS the highest correlation coefficient between entry test and semester scores was observed for semester one rs = 0.334 and lowest in semester four rs= 0.208. In BDS degree program both highest and lowest correlations were in semester one. In the Pharm-D degree program, a significant correlation was only seen in cohort 1 but not in the subsequent cohorts. CONCLUSION: The uniform entrance test has an incremental predictive validity for the MBBS and BDS programs as compared to Pharm-D. Better performance in the entrance test predicts higher semester scores and more likelihood of achieving higher scores in the first year as compared to the second year.

Breaking Bad News: A contextual model for Pakistan.

OBJECTIVES: The purpose of the study was to identify the sequence of violence that ensues after breaking bad news and develop a contextual model of breaking bad news and develop a model contextual for Pakistan. METHODS: A qualitative exploratory study was conducted using Six FGDs and 14 IDIs with healthcare providers working in the emergency and the obstetrics and gynecology departments of tertiary care hospitals of Karachi, Pakistan. Data was transcribed and analyzed to identify emerging themes and subthemes using thematic content analysis. RESULTS: Impatience or lack of tolerance, lack of respect towards healthcare providers, unrealistic expectations from healthcare facility or healthcare staff were identified as main reasons that provoked violence after breaking bad news. A conceptual five step model was developed to guide communication of bad news by the health care providers. On initial testing the model was found to be effective in de-escalation of violence. CONCLUSION: Communication of bad news requires application of specific approaches to deal with contextual challenges for reducing violence against healthcare.

Multiple dimensions of violence against healthcare providers in Karachi: Results from a multicenter study from Karachi.

OBJECTIVE: To investigate the causes, consequences and possible solutions for violence against healthcare. METHODS: The qualitative study was conducted in Karachi June 2015 to December 2015 using in-depth interviews and focus groups discussions with all stakeholders. Transcription was done verbatim using both audio and videotapes of all the sessions. First open coding was done using inductive analyses by 3 researchers. After consensus, these codes were used for thematic content analysis. Interviews and discussions were stopped after saturation was reached and no new codes were identified.. RESULTS: Overall, 42 in-depth interviews and 17 focus groups discussions were held. Major forms of physical violence included beating, throwing things, abusive language, threats, harassment, damage to building, furniture, vehicles and equipment. The threshold of violence was very high for verbal violence and minor forms of physical violence. The causes were identified as behavioural (communication gap between providers and patients, attendants), institutional (capacity, resources and systems) and socio-political (growing illiteracy and intolerance). The sequelae of violence included guilt, night dreams, shame and 61.9 % (N=26/42 IDIs)% who faced violence did not report it officially. CONCLUSIONS: Violence faced by healthcare providers was multifaceted and needs interventions at varied levels, including training of healthcare staff in dealing with violence and its aftermaths, security measures at the healthcare institutions inclusive of ambulance services and policies at the national level to manage and de-escalate violence against healthcare.

Identifying a parsimonious model for predicting academic achievement in undergraduate medical education: A confirmatory factor analysis.

OBJECTIVES: This study was conducted to adduce evidence of validity for admissions tests and processes and for identifying a parsimonious model that predicts students' academic achievement in Medical College. METHODS: Psychometric study done on admission data and assessment scores for five years of medical studies at Aga Khan University Medical College, Pakistan using confirmatory factor analysis (CFA) and structured equation modeling (SEM). Sample included 276 medical students admitted in 2003, 2004 and 2005. RESULTS: The SEM supported the existence of covariance between verbal reasoning, science and clinical knowledge for predicting achievement in medical school employing Maximum Likelihood (ML) estimations (n=112). Fit indices: χ2 (21) = 59.70, p =<.0001; CFI=.873; RMSEA = 0.129; SRMR = 0.093. CONCLUSIONS: This study shows that in addition to biology and chemistry which have been traditionally used as major criteria for admission to medical colleges in Pakistan; mathematics has proven to be a better predictor for higher achievements in medical college.

Challenges of providing timely feedback to residents: Faculty perspectives.

OBJECTIVE: To explore faculty's perceptions of challenges in providing verbal feedback to the Residents and suggest ways to overcome the barriers. METHODS: As part of a larger study on feedback assessment, five focus group discussions were conducted at the Department of Medicine, Aga Khan University Hospital, Karachi, during faculty development workshops held from January to June 2010. Qualitative grounded theory was used to explore faculty perceptions of challenges in providing verbal feedback to the Residents. RESULTS: Of the 54 faculty members, 49(91%) participated. Four themes that emerged were 'time constraint' indicating high patient load; 'faculty related issues' indicating faculty's apprehension about its own evaluation by Residents; 'educational issues' indicating that the importance of feedback was not emphasised; and 'system and logistic issues' indicating that the assessment form used for assessing Residents was ambiguous. CONCLUSIONS: Work load of the faculty and the expectations with respect to patient care responsibilities may have an impact on the quality, timing, content and delivery of the feedback provided to the Residents.

Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences.

OBJECTIVES: To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. METHODS: This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated. RESULTS: A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%). CONCLUSION: There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.

A 360-degree evaluation of the communication and interpersonal skills of medicine resident physicians in Pakistan.

BACKGROUND: To provide high-quality patient care, effective communication and interpersonal skills are necessary for physicians. A 360-degree evaluation of residents in the department of medicine was conducted to assess their interpersonal and communication skills. The measurement properties and utility of the multi-source ratings were investigated. METHODS: A cross-sectional assessment of a cohort of Internal Medicine residents was conducted at the Aga Khan Medical University in Pakistan. Every resident (n = 49) was evaluated by eight raters, including physicians, nurses and unit staff. Each resident also completed a self-evaluation. Evidence to support the validity of the ratings was gathered by exploring performance differences amongst more- and less-experienced providers. Analysis of variance (ANOVA) was employed to test for differences in mean scores, both for rater type and experience (residency year). Generalizability theory was employed to estimate the reliability of the ratings. RESULTS: We received 367/441 (83.2%) completed forms. There was a significant effect attributable to rater source (F = 5.2, P < 0.01). There were no significant differences in mean scores for residents at different levels of training. The mean resident self-assessment scores were significantly lower than those provided by faculty (P < 0.01). Based on eight raters, the reliability of the ratings was moderate (ρ2 = 0.39). DISCUSSION: The 360-degree evaluation technique can be used to measure the communication and interpersonal skills of residents. It can also provide important data to guide resident feedback. Health care providers and staff who interact with residents on regular basis can, as a group provide moderately consistent judgments of their abilities.

The construct and criterion validity of the mini-CEX: a meta-analysis of the published research.

PURPOSE: To conduct a meta-analysis of published studies to determine the construct and criterion validity of the mini-clinical evaluation exercise (mini-CEX) to measure clinical performance. METHOD: The authors included all peer-reviewed studies published from 1995 to 2012 that reported the relationship between participants' performance on the mini-CEX and on other standardized academic and clinical performance measures. Moderator variables and performance and standardized exam measures were extracted and reviewed independently using a standardized coding protocol. RESULTS: Performance measures from 11 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: (1) construct validity coefficients for the mini-CEX on the trainees' performance across different residency year levels ranging from d=0.25 (95% confidence intervals [CI]: 0.04-0.46) to d=0.50 (95% CI: 0.31-0.70), and (2) concurrent validity coefficients for the mini-CEX based on personnel ratings ranging from d=0.23 (95% CI: 0.04-0.50) to d=0.50 (95% CI: 0.34-0.65). Also, a random-effects model of weighted correlation effect size differences (r) resulted in predictive validity coefficients for the mini-CEX on trainees' performance across different standardized measures ranging from r=0.26 (95% CI: 0.16-0.35) to r=0.85 (95% CI: 0.47-0.96). CONCLUSIONS: The construct and criterion validity of the mini-CEX was supported by small to large effect size differences based on measures between trainees' achievement and clinical skills performance, indicating that it is an important instrument for the direct observation of trainees' clinical performance.

Problems and issues in implementing innovative curriculum in the developing countries: the Pakistani experience.

BACKGROUND: The Government of Pakistan identified 4 medical Colleges for introduction of COME, one from each province. Curriculum was prepared by the faculty of these colleges and launched in 2001 and despite concerted efforts could not be implemented. The purpose of this research was to identify the reasons for delay in implementation of the COME curriculum and to assess the understanding of the stakeholders about COME. METHODS: Mixed methods study design was used for data collection. In-depth interviews, mail-in survey questionnaire, and focus group discussions were held with the representatives of federal and provincial governments, Principals of medical colleges, faculty and students of the designated colleges. Rigor was ensured through independent coding and triangulation of data. RESULTS: The reasons for delay in implementation differed amongst the policy makers and faculty and included thematic issues at the institutional, programmatic and curricular level. Majority (92% of the faculty) felt that COME curriculum couldn't be implemented without adequate infrastructure. The administrators were willing to provide financial assistance, political support and better coordination and felt that COME could improve the overall health system of the country whereas the faculty did not agree to it. CONCLUSION: The paper discusses the reasons of delay based on findings and identifies the strategies for curriculum change in established institutions. The key issues identified in our study included frequent transfer of faculty of the designated colleges and perceived lack of: Continuation at the policy making level. Communication between the stakeholders. Effective leadership.

Tips for developing a valid and reliable bank of multiple choice questions (MCQs).

INTRODUCTION: Multiple choice questions (MCQs) are one of the most frequently used written assessments particularly when there is a large body of material to be tested and a large number of students to be assessed. MCQ examinations have manageable logistics, are easy to administer, can be scored rapidly and difficulty indices and the discriminatory value of each item can be easily calculated, facilitating standard application. Methods of ensuring quality assurance are essential when assessment is used for the purposes of certification. METHODS: Developing MCQs requires a concerted effort from curriculum planners, content experts, course coordinators and medical educators. This article aims at outlining a stepwise approach towards ensuring quality assurance in written assessments in an integrated curriculum from aligning assessment with the learning to ensuring banking of good quality MCQs. DISCUSSION: Coordinated efforts and a stepwise approach towards item development, coupled with focused faculty development exercises, is a cost-effective means of developing a huge 'Question Data Bank' of valid and reliable test items which can serve as a National Resource for the Professional Regulatory Councils in the country for their Licensure Examination.

How we developed a bioethics theme in an undergraduate medical curriculum.

The 5-year undergraduate medical curriculum at Aga Khan University integrates basic sciences with clinical and community health sciences. Multimodal strategies of teaching and learning, with an emphasis on problem-based learning, are utilized to equip students with knowledge, skills, behaviours, attitudes and values necessary for a high-calibre medical graduate. Bioethics teaching was introduced in the medical curriculum in 1988 and has since undergone several changes. In 2009, a multidisciplinary voluntary group began review of undergraduate bioethics teaching and invested over 350 man-hours in curricular revision. This involved formulating terminal objectives, delineating specific objectives and identifying instructional methodologies and assessment strategies appropriate for the contents of each objective. Innovative strategies were specially devised to work within the time constraints of the existing medical curriculum and importantly, to increase student interest and engagement. The new bioethics curriculum is designed to be comprehensive and robust, and strives to develop graduates who, in addition to being technically skilled and competent, are well-versed in the history and philosophy of ethics and bioethics and are ethical in their thinking and practice, especially in the context of a developing country like Pakistan where health indicators are among the worst in the region, and clinical practices are not effectively regulated to ensure quality of care.