Managing assessment during curriculum change: Ottawa Consensus Statement.

Curriculum change is relatively frequent in health professional education. Formal, planned curriculum review must be conducted periodically to incorporate new knowledge and skills, changing teaching and learning methods or changing roles and expectations of graduates. Unplanned curriculum evolution arguably happens continually, usually taking the form of "minor" changes that in combination over time may produce a substantially different programme. However, reviewing assessment practices is less likely to be a major consideration during curriculum change, overlooking the potential for unintended consequences for learning. This includes potentially undermining or negating the impact of even well-designed and important curriculum changes. Changes to any component of the curriculum "ecosystem "- graduate outcomes, content, delivery or assessment of learning - should trigger an automatic review of the whole ecosystem to maintain constructive alignment. Consideration of potential impact on assessment is essential to support curriculum change. Powerful contextual drivers of a curriculum include national examinations and programme accreditation, so each assessment programme sits within its own external context. Internal drivers are also important, such as adoption of new learning technologies and learning preferences of students and faculty. Achieving optimal and sustainable outcomes from a curriculum review requires strong governance and support, stakeholder engagement, curriculum and assessment expertise and internal quality assurance processes. This consensus paper provides guidance on managing assessment during curriculum change, building on evidence and the contributions of previous consensus papers.

Inclusion in global health professions education communities through many lenses.

In this paper, we reflect on what inclusion can mean to the global Health Professions Education (HPE) community, the impact of lack of inclusion, and offer suggestions on how to be inclusive. To illustrate the impact of inclusion, we offer perspectives from the lens of a medical student, junior doctor, educators, and educational leaders. The viewpoints offered in this communication can be useful to broaden and nurture inclusive pedagogy and scholarship. Furthermore, since the aim of HPE is high quality patient care and social advocacy, emphasising inclusion in HPE could enhance inclusion in patient care.

Adaptive leadership during challenging times: Effective strategies for health professions educators: AMEE Guide No. 148.

Leadership and management are becoming increasingly recognised as vital for high-performing organisations and teams in health professions education. It is often difficult for those embarking on leadership activities (as well as more experienced leaders) to find their way through the volume of literature and generic information on the topic. This guide aims to provide a framework for developing educators' understanding of leadership, management, and followership in the context of health professions education. It explains many relevant approaches to leadership and suggests various strategies through which educators can develop their practice to become more effective.

Synthesis and perspectives from the Ottawa 2022 conference on the assessment of competence.

INTRODUCTION: The Ottawa Conference on the Assessment of Competence in Medicine and the Healthcare Professions was first convened in 1985 in Ottawa. Since then, what has become known as the Ottawa conference has been held in various locations around the world every 2 years. It has become an important conference for the community of assessment - including researchers, educators, administrators and leaders - to share contemporary knowledge and develop international standards for assessment in medical and health professions education. METHODS: The Ottawa 2022 conference was held in Lyon, France, in conjunction with the AMEE 2022 conference. A diverse group of international assessment experts were invited to present a symposium at the AMEE conference to summarise key concepts from the Ottawa conference. This paper was developed from that symposium. RESULTS AND DISCUSSION: This paper summarises key themes and issues that emerged from the Ottawa 2022 conference. It highlights the importance of the consensus statements and discusses challenges for assessment such as issues of equity, diversity, and inclusion, shifts in emphasis to systems of assessment, implications of 'big data' and analytics, and challenges to ensure published research and practice are based on contemporary theories and concepts.

Remote online open book examinations: through the lenses of faculty and students in health professions programmes.

BACKGROUND: Open book examinations have been used to assess students' higher order cognitive skills. These examinations can be conducted online remotely with the advancement of technology. However, there are concerns regarding its validity and reliability particularly if the examinations are not proctored. The objective of this study was to explore the perceptions of faculty and students in health professions programmes about remote online open book examinations (ROOBE). METHODS: Semi-structured interviews were conducted among 22 faculty staff who were involved in ROOBE in health professions programmes. All interviews were audio recorded, transcribed verbatim and analysed using a thematic analysis approach. The perceptions of 249 medical students were obtained using an online questionnaire after they completed ROOBE. RESULTS: The faculty agreed that open book examinations could promote students' higher order cognitive skills and reduce students' stress. However, they were concerned about students' academic integrity during non-invigilated ROOBE which could affect recognition by accreditation and professional bodies. The shift from traditional practice of closed-book examinations to ROOBE required change management with the support of guidelines and faculty training.  Majority of the students claimed that the examinations were challenging as they assessed their ability to apply knowledge in real world problems. Nevertheless, they preferred ROOBE due to less anxiety and memorisation, and more emphasis on problem solving skills. The shortcomings were insufficient time for information searching during examinations and uncertainty in preparedness for future practice as they focused less on memorisation of factual knowledge during examination preparation. Cheating among peers and internet instability during non-invigilated ROOBE were the concerns highlighted by some students. CONCLUSIONS: Faculty and students expressed favourable views about ROOBE in promoting higher order cognitive skills. Adequate technological support was essential during ROOBE. While there was a need to address issues related to academic integrity, ROOBE could be included as an authentic assessment within the systems of assessment.

Entrustable professional activities in undergraduate dental education: A practical model for development and validation.

OBJECTIVE: Entrustable professional activities (EPAs) are tasks that a person who is qualified or is in the process to be credentialed are allowed to engage. There are several levels of entrustment based on degrees of supervision assigned to each EPA. This paper aims to describe the process and outcome of creating EPAs; validate EPAs relevant to undergraduate dental training. METHODS: A draft set of EPA statements was developed based on the consensus of an expert panel. These were then mapped to the nationally determined minimum experience thresholds (clinical and procedural experiences/competencies) and aligned to task-based instructional strategy. The EPAs were validated to improve the relevance by using a criterion-based rubric. RESULTS: An end-to-end process workflow led to the development of an EPA-based educational framework to bridge the gaps in the curriculum. The process identified a total of 41 EPAs and out of which, 10 EPAs were notated as core EPAs and will be subjected to structured workplace-based assessment complying to the national standards. The validation exercise rated core EPAs with an overall score matching close to the cut-off of 4.07 (Equal rubric). CONCLUSION: The end-to-end process workflow provided the opportunity to elaborate a structured process for the development of EPAs for undergraduate dental education. As validation is a continuous process, feedback from implementation will inform the next steps.

Communication skills in primary care settings: aligning student and patient voices.

INTRODUCTION: Effective communication is essential for patient-centred relationships. Although medical graduates acquire communication skills during undergraduate training, these have been shown to be inadequate in early practice. Both students' and patients' perspectives are required to improve readiness for the workplace, patient satisfaction, and health outcomes. Our research question was: to what extent are medical students prepared with patient-centred communication skills in primary care settings? METHODS: A qualitative descriptive research study using in-depth semi-structured interviews was conducted with Year 3 medical students and patients to study their experiences at a primary care clinic, over two weeks. Data were transcribed verbatim and analysed using Braun and Clark's thematic analysis. Both students' and patients' views on communication skills were obtained. RESULTS: Three themes were established based on student-patient communication in primary care settings: socio-cultural elements in student-patient communication; cognitive and emotional challenges for effective communication; and enablers for effective student-patient communication. The themes and sub-themes describe both students and patients valuing each other as individuals with socio-cultural beliefs and needs. CONCLUSION: The findings can be used to structure new approaches to communication skills education that is patient-centred, culturally sensitive, and informed by patients. Communication skills training should encourage students to prioritise and reflect more on patient perspectives while educators should engage patients to inform and assess the outcomes.

Stakeholder perspectives on veterinary student preparedness for workplace clinical training - a qualitative study.

BACKGROUND: The success of workplace clinical training (WCT) is important given that veterinary students are licensed to work independently upon graduation. Considering this, it is perhaps surprising that there is limited published work describing what it means to be prepared for this educational experience, particularly given that the transition to WCT can be stressful for students. This paper reports the results of a qualitative study aiming to generate a rich understanding of veterinary student preparedness for WCT using emic, or insider, perspectives of key stakeholders. METHODS: From a constructivist standpoint, homogenous online group interviews were held with final year veterinary students, recent student alumni, clinical supervisors, faculty, and academic educationalists to discuss what it means to be prepared for WCT. The data was analysed using a template analysis approach. RESULTS: A three-tier taxonomy to describe preparedness for WCT was constructed from the data. At the topmost level, there were seven themes to illuminate different aspects of preparedness: students should be prepared 1) for the transition to learning and working in a clinical and professional environment, 2) for self-directed and experiential learning whilst working, 3) with a growth mindset, 4) with intrinsic motivation and enthusiasm for learning and working, 5) for communication, consultation and clinical reasoning, 6) with the knowledge for work, and 7) with the practical competence and confidence for work. CONCLUSIONS: This study provides a deeper understanding of the tools we can provide, and the attributes we can nurture in, senior veterinary students to facilitate their learning and working during WCT. This improved understanding is a necessary precursor to refining pedagogical support and curriculum design within veterinary schools.

Co-creating scholarship through collaborative writing in health professions education: AMEE Guide No. 143.

This AMEE guide provides a robust framework and practical strategies for health professions educators to enhance their writing skills and engage in successful scholarship within a collaborative writing team. Whether scholarly output involves peer-reviewed articles, book chapters, blogs and online posts, online educational resources, collaborative writing requires more than the usual core writing skills, it requires teamwork, leadership and followership, negotiation, and conflict resolution, mentoring and more. Whilst educators can attend workshops or courses to enhance their writing skills, there may be fewer opportunities to join a community of scholars and engage in successful collaborative writing. There is very little guidance on how to find, join, position oneself and contribute to a writing group. Once individuals join a group, further questions arise as to how to contribute, when and whom to ask for help, whether their contribution is significant, and how to move from the periphery to the centre of the group. The most important question of all is how to translate disparate ideas into a shared key message and articulate it clearly. In this guide, we describe the value of working within a collaborative writing group; reflect on principles that anchor the concept of writing as a team and guide team behaviours; suggest explicit strategies to overcome challenges and promote successful writing that contributes to and advances the field; and review challenges to starting, maintaining, and completing writing tasks. We approach writing through three lenses: that of the individual writer, the writing team, and the scholarly product, the ultimate goal being meaningful contributions to the field of Health Professions Education.

Mind your language: the importance of english language skills in an International Medical Programme (IMP).

BACKGROUND: Language proficiency is crucial for doctors as they communicate with patients, peers and other healthcare professionals. Although proficiency in English is part of admission requirements, there is a gap in the knowledge of medical students' perception of factors enhancing English language (EL) skills during training in international medical programmes (IMPs). The gap prevents educators and policy makers from helping students who struggle with communication skills during medical training. This study therefore explores the importance of English language skills from medical students' perspectives. METHODS: Six focus group interviews with 24 medical students were conducted in an IMP. Data were analysed using Braun and Clarke's framework of thematic analysis. RESULTS: Results established three themes that constitute the importance of EL skills, namely the use of EL in medical training and practice, influence of university culture in EL mastery and individual EL proficiency as perceived by medical students. CONCLUSIONS: Findings of this study demonstrate how students perceived the importance of EL skills as a professional and social requirement during medical training and for future practice. It also informs that setting English language admission pre requisites needs to be complemented with opportunities to practice context specific communication skills. Thus, international medical programmes should embed diverse and inclusive strategies to support and develop medical students' English language skills.

IMoCC - Measure of cultural competence among medical students in the Malaysian context.

Cultural beliefs and practices impact heavily on health outcomes of patients. Doctors' ability to deal with such issues in clinical practice, i.e. cultural competence, is widely studied in the west. It has yet to be given due importance in non-western contexts. This study aimed to develop a valid and reliable measure of cultural competence in the Malaysian cultural context and to assess cultural competence among Malaysian medical students. Thirty-five cultural issues faced by Malaysian doctors were identified with a series of interviews to develop a preliminary tool. The responses of students to these cultural issues were evaluated against the extent of inquiry and advocacy based on a theoretical framework of cultural competence. The responses were subjected to statistical analysis to determine the internal structure of the tool and to reduce the number of items in the tool. The final tool (IMU Measure of Cultural Competence - IMoCC) comprised of 22 issues, which deemed to be reliable in the second round of testing. In both tools, student cohorts demonstrated an acceptable level of cultural competence with room for improvement. However, they appeared to learn how to deal with cultural issues primarily through informal means and not in the formal curriculum.

Student evaluation of the learning environment in an undergraduate pharmacy programme: Lessons for educators.

BACKGROUND: Student evaluation of the learning environment is important to enhance learning experiences. Programs such as Pharmacy use feedback from the evaluation to identify teaching-learning issues and use it to improve the quality of the learning experiences. The article aims to explore the general observations from the evaluation; to identify how the feedback is used to improve the learning environment and to identify lessons for educators in managing and using the feedback. METHODS: A cross-sectional data analysis of Pharmacy students' learning environment from 2011-2015 based on data from module, faculty, IMU-REEM and Student Barometer Survey was applied. Feedback obtained from the data was triangulated to establish commonalities/differences of the issues. RESULTS: Based on the analysis, issues affecting Pharmacy student learning experiences were identified. The identified issues included teaching by subject matter experts, pedagogical delivery and physical learning environment. Seven lessons were presented for educators to assess the practicality of the feedback. CONCLUSIONS: The feedback serves as a means to improve the Pharmacy program. Nonetheless, the challenges lie between the ideal and realistic expectations of students in optimizing the learning experiences. Lessons acquired from the evaluation of the learning environment are essential for educators in managing and using the information.

Twelve tips for institutional approach to outcome-based education in health professions programmes.

Outcome-based education (OBE) has brought along a significant development in health professions education in the past decade. The shift from a process-driven to product-driven model of education is valuable for ensuring graduate quality and facilitating global movement of healthcare workers. Such a model can align the expectations of key stakeholders in an era of rapid knowledge expansion and technological advancement. Nevertheless, the experienced benefits of OBE depend on the effectiveness of its implementation. This article therefore provides practical tips and strategies for implementing OBE in order to maximize its potential.

Validation of a 'Work Readiness Scale' for health professional (HP) graduates.

BACKGROUND: There is a continuing concern about how graduate work readiness (WR) reflects on the success of universities meeting the requirements of employment. This study is to establish a valid and reliable instrument measuring WR in health professions (HP) graduates of medicine, pharmacy and dentistry. METHODS: The study from March 2016 to April 2017 was conducted to validate the 'Work Readiness Scale' (WRS; Deakin University) using Principal Component Analysis and Cronbach - α for internal consistency. It was modified to a four-item even-point scale and distributed as an online survey to 335 final year students of the three programs. RESULTS: A reduction from 64 to 53 items provided good internal consistency in all factors: WC 0.85, OA 0.88, SI 0.88 and PC 0.71. The PC domain had the greatest item reduction from 22 to 6, whilst the SI domain increased in items from 8 to 19. These changes may be associated with difference in understanding or interpretation of the items in the SI domain. CONCLUSION: The modified WRS can be used to evaluate job readiness in HP graduates. However, it needs further refinement and validation in specific educational and employment contexts.

Twelve tips for developing a global community of scholars in health professions education.

Scholarship in Health Professions Education is not just original research, it also includes study of educational processes, and application of new knowledge to practice. The pathways to successful scholarship are not always clear to novice educators. In this article, we describe strategies to establish a Community of Scholars (CoS), where more experienced and senior members guide junior members in scholarship to advance the field. Drawing on Lave and Wenger's concepts of Communities of Practice (CoP), we describe twelve practical tips, which include generation of a shared vision, formation of a global community of scholars, engagement in scholarly initiatives, and development of a professional identity, categorised under three major steps: establish, grow, and sustain the community. The tips embrace inclusivity for diverse cultural contexts which further provide opportunities for Health Professions Educators, interested in forming communities of practice, to work on scholarly outputs and add value to the professional arena.

'Being international is always a good thing': A multicentre interview study on ethics in international medical education.

CONTEXT: Internationalisation in medical education raises ethical concerns over, for instance, its for-profit orientation, the potential erosion of cultural diversity and the possibility that standardised education may not meet the needs of patients everywhere. These concerns fit into a broader debate on social responsibility in higher education. This study aims to explore how academic staff in international medical education experience and act upon the ethical concerns that pertain to their programmes. By adding their perspectives to the debate, this study helps us understand how theory-based ethical concerns are reflected in practice. METHODS: We conducted a multicentre instrumental case study across three international medical programmes, all of which were characterised by an international student intake, an internationalised curriculum and international partnerships, and all of which used English as the medium of instruction. We conducted 24 semi-structured interviews with purposively sampled curriculum directors and teaching staff. Participants shared their personal experiences and responded to ethical concerns expressed in the literature. Our multidisciplinary team performed a template analysis of the data based on theoretical frameworks of ethics and social responsibility. RESULTS: Participants primarily experienced the internationalisation of their institutions and programmes as having a positive impact on students, the university and the future global society. However, they did face several ethical dilemmas. The first of these involved the possibility that marketisation through international recruitment and the application of substantial tuition fees might widen access to medical education, but might allow weaker students to enter medical schools. The second concern referred to the homogenisation of education methods and content, which offers opportunities to expose students to best practices, but may also pose a risk to education quality. The third issue referred to the experience that although student diversity helped to promote intercultural learning, it also jeopardised student well-being. CONCLUSIONS: In the eyes of teaching staff in international medical education, internationalisation can benefit education quality and society, but poses ethical dilemmas through the forces of marketisation, homogenisation and diversification. The findings reflect a tension between the views of scholars and those of practitioners. The critical perspective found in academic debates is largely missing in practice, and theoretical frameworks on ethics possibly overlook the benefits of international education. To facilitate ethical decision making, we propose that scholars and practitioners globally try to learn from each other.

Educating universal professionals or global physicians? A multi-centre study of international medical programmes design.

Introduction: Medical schools increasingly offer curricula that specifically aim to prepare students for an international medical career. This is challenging as well as controversial: curriculum designers must balance specific local healthcare requirements with global health competencies doctors need in our globalised world. By investigating how international medical programme designers experience this balancing act, this study aims to contribute insights to the debate on local versus global medical education.Methods: We conducted a multi-centre instrumental case study across three universities with international medical programmes in three countries. The study involved 26 semi-structured interviews with key curriculum designers recruited through purposive sampling. Additionally, we performed a curriculum document analysis. Data were thematically analysed within a multidisciplinary team.Results: Participants described two profiles of international medical programme graduates: 'a global physician', equipped with specific competencies for international practice, and 'a universal professional', an overall high-level graduate fit for future practice anywhere. These perspectives presented different curriculum design challenges.Conclusions: International medical programmes teach us how we can rethink graduate profiles in a globalising world. Yet, educational standardisation poses risks and securing equity in global health education is challenging, as is preparing students to be adaptable to the requirements of a rapidly changing future local healthcare context.

Drug-like dietary vanilloids induce anticancer activity through proliferation inhibition and regulation of bcl-related apoptotic proteins.

In this study, a series of 20 structurally similar vanilloids (Vn) were tested for their antiproliferative effects against 12 human cancer cells: human breast (MCF-7 and MDA-MB-231), cervical (HeLa), ovarian (Caov-3), lung (A549), liver (HepG2), colorectal (HT-29 and HCT116), nasopharyngeal (CNE-1 and HK-1), and leukemic (K562 and CEM-SS) cancer cells. Among all the tested vanilloids, Vn16 (6-shogaol) exhibited the most potent cytotoxic effects against human colorectal cancer cells (HT-29). The apoptotic induction effects exhibited by Vn16 on HT-29 cells were confirmed using dual staining fluorescence microscopy and enzyme-linked immunosorbent assay. The effects of Vn16 on regulation of 43 apoptotic-related markers were determined in HT-29. The results suggested that 8 apoptotic markers (caspase 8, BAD, BAX, second mitochondrial-derived activator, caspase 3, survivin, bcl-2, and cIAP-2) were either upregulated or downregulated. These results further support the chemopreventive properties of foods that contain vanilloids.

Student preparedness characteristics important for clinical learning: perspectives of supervisors from medicine, pharmacy and nursing.

BACKGROUND: Student perspectives of clinical preparedness have been studied in the literature, but the viewpoint of supervisors is limited. Hence, the aim was to examine the perspective of supervisors on the characteristics of health professional students important for preparedness for clinical learning. METHODS: This was a descriptive, questionnaire-based, cross-sectional study conducted at three higher education institutions in Malaysia. A previously published questionnaire with 62 characteristics was adopted with modifications after pre-testing. Descriptive analysis was completed for the demographic data. The sample was grouped based on health profession, clinical practice experience and teaching experience for further analysis. Non-parametric Kruskal-Wallis test was selected to evaluate differences in mean ranks to assess the null hypothesis that the medians are equal across the groups. Kruskal-Wallis post-hoc pair wise comparison was performed on samples with significant differences across samples. RESULTS: The sample was comprised of 173 supervisors from medicine (55, 32%), pharmacy (84, 48%) and nursing (34, 20%). The majority (63%) of the supervisors were currently in professional practice. A high percentage (40%) of supervisors had less than 4 years of teaching experience. The highest theme ratings were for willingness (6.00) and professionalism (5.90). There was a significant difference (p < 0.05) in the medians, among medicine, pharmacy and nursing professional speciality for willingness (5.70, 6.00 and 6.00), professionalism (5.70, 5.90 and 6.15), communication and interaction (5.42, 5.67 and 6.00), personal attributes (5.42, 5.71 and 6.02) and the professional and interpersonal skills (5.50, 5.63 and 6.00) themes. Post-hoc analysis showed a significant difference (p < 0.05) between medicine and nursing groups in the willingness (5.70 and 6.00), professionalism (5.70 and 6.15) and personal attributes (5.42 and 6.02) themes. Supervisors who are currently in practice had given high ratings compared to other groups. There were no significant differences observed within groups with different level of teaching experiences. CONCLUSIONS: All supervisors rated professionalism and willingness as the most important characteristics followed by personal attributes. Further strengthening learning opportunities related to these characteristics in the curriculum may improve the students' preparedness in clinical learning.