Using MCQ response certainty to determine how aspects of self-monitoring develop through a medical course.

INTRODUCTION: Self-monitoring of clinical-decision-making is essential for health care professional practice. Using certainty in responses to assessment items could allow self-monitoring of clinical-decision-making by medical students to be tracked over time. This research introduces how aspects of insightfulness, safety and efficiency could be based on certainty in, and correctness of, multiple-choice question (MCQ) responses. We also show how these measures change over time. METHODS: With each answer on twice yearly MCQ progress tests, medical students provided their certainty of correctness. An insightful student would be more likely to be correct for those answers given with increasing certainty. A safe student would be expected to have a high probability of being correct for answers given with a high certainty. An efficient student would be expected to have a sufficiently low probability of being correct when they have no certainty. The system was developed using first principles and data from one cohort of students. A dataset from a second cohort was then used as an independent validation sample. RESULTS: The patterns of aspects of self-monitoring were similar for both cohorts. Almost all the students met the criteria for insightfulness on all tests. Most students had an undetermined outcome for the safety aspect. When a definitive result for safety was obtained, absence of safety was most prevalent in the middle of the course, while the presence of safety increased later. Most of the students met the criteria for efficiency, with the highest prevalence mid-course, but efficiency was more likely to be absent later. DISCUSSION: Throughout the course, students showed reassuring levels of insightfulness. The results suggest that students may balance safety with efficiency. This may be explained by students learning the positive implications of decisions before the negative implications, making them initially more efficient, but later being more cautious and safer.

Educators as Judges: Applying Judicial Decision-Making Principles to High-Stakes Education Assessment Decisions.

Phenomenon: Programmatic assessment and competency-based education have highlighted the need to make robust high-stakes assessment decisions on learner performance from evidence of varying types and quality. Without guidance, lengthy deliberations by decision makers and competence committees can end inconclusively with unresolved concerns. These decisional dilemmas are heightened by their potential impacts. For learners, erroneous decisions may lead to an unjustified exit from a long-desired career, or premature promotion to clinical responsibilities. For educators, there is the risk of wrongful decision-making, leading to successful appeals and mistrust. For communities, ill-prepared graduates risk the quality and safety of care. Approaches such as psychometric analyses are limited when decision-makers are faced with seemingly contradictory qualitative and quantitative evidence about the same individual. Expertise in using such evidence to make fair and defensible decisions is well established in judicial practice but is yet to be practically applied to assessment decision-making. Approach: Through interdisciplinary exchange, we investigated medical education and judicial perspectives on decision-making to explore whether principles of decision-making in law could be applied to educational assessment decision-making. Using Dialogic Inquiry, an iterative process of scholarly and mutual critique, we contrasted assessment decision making in medical education with judicial practice to identify key principles in judicial decision-making relevant to educational assessment decisions. We developed vignettes about common but problematic high-stakes decision-making scenarios to test how these principles could apply. Findings: Over 14 sessions, we identified, described, and applied four principles for fair, reasonable, and transparent assessment decision-making. These were: The person whose interests are affected has a right to know the case against them, and to be heard.Reasons for the decision should be given.Rules should be transparent and consistently applied.Like cases should be treated alike and unlike cases treated differently.Reflecting our dialogic process, we report findings by separately presenting the medical educator and judicial perspectives, followed by a synthesis describing a preferred approach to decision-making in three vignettes. Insights: Judicial principles remind educators to consider both sides of arguments, to be consistent, and to demonstrate transparency when making assessment decisions. Dialogic Inquiry is a useful approach for generating interdisciplinary insights on challenges in medical education by critiquing difference (e.g., the meaning of objectivity) and achieving synthesis where possible (e.g., fairness is not equal treatment of all cases). Our principles and exemplars provide groundwork for promoting good practice and furthering assessment research toward fairer and more robust decisions that will assist learning.

Cross-cultural code-switching - the impact on international medical graduates in New Zealand.

BACKGROUND: New Zealand relies on International Medical Graduates (IMGs); however, the retention of IMGs is not optimal. This research uses a lens of cross-cultural code-switching to explore how professional and cultural differences impact on International Medical Graduates' (IMGs') journeys to practise effectively and remain in New Zealand. METHODS: Utilising theory-informing inductive analysis within a constructivist approach, framework analysis was conducted following 14 face-to-face interviews with IMGs. The analysis then explored the degree to which their experiences could be explained by cross-cultural code-switching's psychological challenges (authenticity, competence, and resentment). RESULTS: Analysis showed there was an expectation for IMGs to code-switch. The greater the cultural and professional difference of IMGs (compared to New Zealand), the greater the intensity of psychological challenges experienced when switching. Moreover, IMGs received minimal support, making it difficult to overcome psychological challenges, especially the competence challenge. This led to feelings of frustration and vulnerability. Code-switching could also explain why complaints about IMGs were more likely when IMGs were stressed or tired. CONCLUSION: Cross-cultural code-switching can be used to explain and identify how cultural differences cause psychological challenges. These findings inform how programmes can better support IMGs in orientation and ongoing training. Additionally, establishing, and allocating IMG cultural mentors would assist in addressing IMGs' vulnerability and isolation. With this support, the journey may prove more manageable and encourage IMGs to continue practising in their adopted country.

Sample representativeness and influence of attrition on longitudinal data collected as part of a national medical career tracking project.

BACKGROUND: The Medical Schools Outcomes Database and Longitudinal Tracking Project (MSOD) in New Zealand is one example of a national survey-based resource of medical student experiences and career outcomes. Longitudinal studies of medical students are valuable for evaluating the outcomes of medical programs against workforce objectives. As a prospective longitudinal multiple-cohort study, survey response rates at each collection point of MSOD vary. This paper assesses the effects of participant non-response rates on MSOD data. METHODS: Demographic variables of MSOD respondents between 2012 and 2018 were compared to the distribution of the demographic variables in the population of all NZ medical graduates to ascertain whether respondent samples at multiple survey collection points were representative of the population. Analysis using logistic regression assessed the impact of participant non-response on variables at collection points throughout MSOD. RESULTS: 2874 out of a total population of 2939 domestic medical students graduating between 2012 and 2018 responded to MSOD surveys. Entry and exit surveys achieved response rates around 80% and were broadly representative of the total population on demographic variables. Post-graduation survey response rates were around 50% of the total population of graduates and underrepresented graduates from the University of Auckland. Between the entry and exit and the exit and postgraduation year three samples, there was a significant impact of non-response on ascribed variables, including age at graduation, university, gender and ethnic identity. Between the exit and postgraduation year one sample, non-response significantly impacted ascribed and non-ascribed variables, including future practice intentions. CONCLUSION: Samples collected from MSOD at entry and exit are representative, and findings from cross-sectional studies using these datasets are likely generalisable to the wider population of NZ medical graduates. Samples collected one and three years post-graduation are less representative. Researchers should be aware of this bias when utilizing these data. When using MSOD data in a longitudinal manner, e.g. comparing the change in career intentions from one collection point to the next, researchers should appropriately control for bias due to non-response between collection points. This study highlights the value of longitudinal career-tracking studies for answering questions relevant to medical education and workforce development.

Widening how we see the impact of culture on learning, practice and identity development in clinical environments.

As part of this State of the Science series on Self, Society and Situation, we focus on how we might see the situation of the workplace as a learning environment in the future. Research to date into how health professionals learn while working in clinical workplace environments has mostly focused on the supervisor-trainee relationship or on the interaction between the affordances of a workplace and the receptiveness of trainees. However, the wider environment has not received as much focus-though frequently mentioned, it is seldom investigated. We suggest there is a need to embrace the wider institution factors, recognise and acknowledge an organisation's values and culture as they impact on clinical learning in order to work with these, not around them or ignore them, to make what may be tacit visible through reflection and observation and to embrace a range of perspectives on culture.

Learning, judgement and workforce tensions impact failure to fail in a medical postgraduate setting: A supervisor perspective.

PURPOSE: Medical training organisations have a duty to prepare medical graduates for future safe, competent practice. Decisions about underperformance are high stakes at the postgraduate level and failure to fail can occur. We aimed to explore this concept from a systems and supervisor perspective. METHOD: Supervisors of specialist physician trainees were invited to provide written feedback on failure to fail as part of a broader anonymous supervisor survey. They were provided with a trigger statement and responded in free-text format. A deductive content analysis was undertaken through the lenses of supervisor and institution. RESULTS: Of 663 supervisors who responded to the broader survey, 373 (56%) provided feedback on the failure to fail trigger statement. Analyses indicated an interplay between trainee and supervisor characteristics, and broader system elements. System elements that contributed to failure to fail trainees included lack of longitudinal monitoring and quality of assessment information. Supervisor characteristics included confident, conflicted and avoidant behaviours towards underperforming trainees. CONCLUSIONS: Individual and system challenges that contributed to failure to fail were identified in this study, and we propose a three-way tension among learning, judgement and workforce. Three potential mitigation strategies have been identified to reduce failure to fail, namely a stage-based approach to remediation, faculty development in supervisory skills and improved assessment-for-learning processes.

Technology enhanced neuroanatomy teaching techniques: A focused BEME systematic review of current evidence: BEME Guide No. 75.

BACKGROUND: In response to growing curriculum pressures and reduced time dedicated to teaching anatomy, research has been conducted into developing innovative teaching techniques. This raises important questions for neuroanatomy education regarding which teaching techniques are most beneficial for knowledge acquisition and long-term retention, and how they are best implemented. This focused systematic review aims to provide a review of technology-enhanced teaching methods available to neuroanatomy educators, particularly in knowledge acquisition and long-term retention, compared to traditional didactic techniques, and proposes reasons for why they work in some contexts. METHODS: Electronic databases were searched from January 2015 to June 2020 with keywords that included combinations of 'neuroanatomy,' 'technology,' 'teaching,' and 'effectiveness' combined with Boolean phrases 'AND' and 'OR.' The contexts and outcomes for all studies were summarised while coding, and theories for why particular interventions worked were discussed. RESULTS: There were 4287 articles identified for screening, with 13 studies included for final analysis. There were four technologies of interest: stereoscopic views of videos, stereoscopic views of images, augmented reality (AR), and virtual reality (VR). No recommendation for a particular teaching method was made in six studies (46%) while recommendations (from weak to moderate) were made in seven studies (54%). There was weak to moderate evidence for the efficacy of stereoscopic images and AR, and no difference in the use of stereoscopic videos or VR compared to controls. CONCLUSIONS: To date, technology-enhanced teaching is not inferior to teaching by conventional didactic methods. There are promising results for these methods in complex spatial anatomy and reducing cognitive load. Possible reasons for why interventions worked were described including students' engagement with the object, cognitive load theory, complex spatial relationships, and the technology learning curve. Future research may build on the theorised explanations proposed here and develop and test innovative technologies that build on prior research.

When the wheels fall off - Medical students' experiences of interrupted academic progression.

INTRODUCTION: There is limited published research on medical students' perspectives of a significant interruption to their academic progression. This study sought to identify the factors that contribute to difficulties with academic progression and to understand how medical students successfully respond. METHODS: This interpretive phenomenological study reports on the findings from in-depth interviews of 38 final year medical students who had experienced a significant academic interruption. RESULTS: The two superordinate themes were: the factors contributing to the interruption and their experience of the interruption. Factors identified as contributing to the interruption were: workload, learning in medicine, motivation for medicine, isolation, adapting to local culture, health and external factors. Their experience of the interruption focused on stages of working through the process: 'what happened,' 'how it felt,' 'managing the failure,' 'accepting the failure' and 'making some changes.' DISCUSSION: Each factor affected how the participants reacted and responded to the interruption. Regardless of the origins of the interruption, most reacted and responded in a comparable process, albeit with varying timespans. These reactions and responses were in a state of fluctuation. In order to succeed many stated they shifted their motivation from external to internal, in direct response to the interruption, resulting in changed learning behaviours. CONCLUSIONS: The process of working through an interruption to academic progression for students may benefit from a model of interval debriefing, restorative academic and personal development support. Facilitation of this process could enable students to face an interruption constructively rather than as an insurmountable emotionally burdensome barrier. Medical schools could utilise these findings to implement further support strategies to reduce the number of significant academic disruptions.

Twelve tips for medical students experiencing an interruption in their academic progress.

For every commencing cohort of medical students, a small but significant number will experience an interruption to their academic progression because of academic difficulties, health concerns or external influences outside of the students' control. During the process of researching the factors surrounding difficulties with academic progression, students told us many ways that they have learned from that experience, which then allowed most of them to graduate. This paper combines the shared experiences of students who have had an interruption, and those of the authors as medical educators.

Global health classroom: mixed methods evaluation of an interinstitutional model for reciprocal global health learning among Samoan and New Zealand medical students.

BACKGROUND: Global health education partnerships should be collaborative and reciprocal to ensure mutual benefit. Utilisation of digital technologies can overcome geographic boundaries and facilitate collaborative global health learning. Global Health Classroom (GHCR) is a collaborative global health learning model involving medical students from different countries learning about each other's health systems, cultures, and determinants of health via videoconference. Principles of reciprocity and interinstitutional partnership informed the development of the GHCR. This study explores learning outcomes and experiences in the GHCR between students from New Zealand and Samoa. METHODS: This study used a mixed methods approach employing post-GHCR questionnaires and semi-structured face-to-face interviews to explore self-reported learning and experiences among medical students in the GHCR. The GHCR collaboration studied was between the medical schools at the University of Otago, New Zealand and the National University of Samoa, Samoa. RESULTS: Questionnaire response rate was 85% (74/87). Nineteen interviews were conducted among New Zealand and Samoan students. Students reported acquiring the intended learning outcomes relating to patient care, health systems, culture, and determinants of health with regards to their partner country. Interview data was indicative of attitudinal changes in relation to cultural humility and curiosity. Some reported a vision for progress regarding their own health system. Students in the GHCR reported that learning with their international peers in the virtual classroom made learning about global health more real and tangible. The benefits to students from both countries indicated reciprocity. CONCLUSIONS: This study demonstrates GHCR to be a promising model for collaborative and reciprocal global health learning using a student-led format and employing digital technology to create a virtual classroom. The self-reported learning outcomes align favourably with those recommended in the literature. In view of our positive findings, we present GHCR as an adaptable model for equitable, collaborative global health learning between students in internationally partnered institutions.

Randomised controlled trial of students access to resources in an examination.

INTRODUCTION: Assessment of healthcare professionals should be authentic to clinical practice. As clinicians regularly use resources in practice, similar resources should be available to those sitting assessment. There is limited information on the impacts of open-book (resource) assessments on standard setting for use in high-stakes assessments. This research aims to explore the effects on standard setting and student perceptions when open vs closed resources are available in high-stakes assessment of medical students. METHODS: Students sat multiple-choice question (MCQ) examinations under both closed- and open-resource conditions in a randomised crossover design. A standard setting panel set pass-marks for both closed- and open-resource conditions of delivery, and we compared these pass-marks with each other and with actual performance. Students responded to a survey on perceptions of open-resource assessments. RESULTS: The pass-mark was set higher when panellists considered open-resource conditions compared to closed conditions (59% vs 47%), but actual student performance showed no difference in scores between the two conditions. The net effect was that the pass rate was higher for closed than open-resource conditions (71% vs 34%). Open-resource conditions increased the time to complete the questions. The students perceived that open resource was more authentic but was more time-consuming and would require different preparation. Regarding the acceptability of including open resources in high-stakes assessment, the responses of students were mixed. DISCUSSION: Pass standards based solely on judgements by panellists experienced in closed-resource conditions might not be applicable under open conditions. Questions vary in how much time accessing resources may take and the degree of assistance in selecting the correct answer. A programme of assessment could be constructed to include both closed- and open-resource condition assessments depending on the questions' content and format. Open-resource conditions may promote assessment preparation that focuses more on seeking and evaluating resources rather than learning facts.

Medical student learner neglect in the clinical learning environment: Applying Glaser's theoretical model.

INTRODUCTION: Learner neglect is a relatively new concept in education, and no suitable framework for its exploration has been devised. The aim of this study was to determine whether an existing framework, Glaser's framework of child neglect, could be applied to learner neglect in clinical learning environments. This was a retrospective analysis of data obtained as part of a related study. METHOD: Six focus groups were conducted with medical students in their early clinical years to explore their views of what experiences in medical education were challenging and why they presented a challenge. The transcript data were analysed using inductive content analysis, within an interpretivist approach in the development of categories. The identified categories were cross referenced with Glaser's framework categories replacing the carer with the teacher and the child with the learner. RESULTS: Glaser's classifications of teacher (parent) behaviours were all identified in the negative aspects of medical learner clinical education including emotional unavailability/unresponsiveness, acting in a hostile manner, inappropriate inconsistent developmental interaction, failure to recognise individuality and failure to promote social adaption. Physical unavailability was identified as an additional category and is included in our proposed framework of learner neglect. DISCUSSION: Adapting Glaser's framework was useful in considering learner neglect. Medical schools have a role in ensuring learning experiences are positive across contexts and to make explicit to teachers any behaviours that may appear as learner neglect. Applying this framework has the potential to make more explicit any subtle undermining teacher behaviours. Once explicit, there is a greater likelihood that behaviours may be reappraised both by the teacher and learner and modified to promote a more effective clinical learning experience.

Risk factors for injuries in New Zealand older adults with complex needs: a national population retrospective study.

BACKGROUND: Falls and falls-related injuries are common among older adults. Injuries in older adults lead to poor outcomes and lower quality of life. The objective of our study was to identify factors associated with fall-related injuries among home care clients in New Zealand. METHODS: The study cohort consisted of 75,484 community-dwelling people aged 65 years or older who underwent an interRAI home care assessment between June 2012 and June 2018 in New Zealand. The injuries included for analysis were fracture of the distal radius, hip fracture, pelvic fracture, proximal humerus fracture, subarachnoid haemorrhage, traumatic subdural haematoma, and vertebral fracture. Unadjusted and adjusted competing risk regression models were used to identify factors associated with fall-related injuries. RESULTS: A total of 7414 (9.8%) people sustained a falls-related injury over the 6-year period, and most injuries sustained were hip fractures (4735 63.9%). The rate of injurious falls was 47 per 1000 person-years. The factors associated with injury were female sex, older age, living alone, Parkinson's disease, stroke/CVA, falls, unsteady gait, tobacco use, and being underweight. Cancer, dyspnoea, high BMI, and a decrease in the amount of food or fluid usually consumed, were associated with a reduced risk of sustaining an injury. After censoring hip fractures the risks associated with other types of injury were sex, age, previous falls, dyspnoea, tobacco use, and BMI. CONCLUSIONS: While it is important to reduce the risk of falls, it is especially important to reduce the risk of falls-related injuries. Knowledge of risk factors associated with these types of injuries can help to develop focused intervention programmes and development of a predictive model to identify those who would benefit from intervention programmes.

Redefining scholarship for health professions education: AMEE Guide No. 142.

Scholarship is an integral aspect of academia. It shapes the practice of individuals and the field and is often used to inform career progression decisions and policies. This makes it high stakes. Yet it is complex, and ambiguous. Definitions vary and the term does not necessarily translate well across contexts. In this AMEE guide, our aim is to establish a contemporary definition of scholarship which is appropriate to health professions education (HPE). Our specific objectives are to provide guidance to support colleagues in their career development as professional educators and to challenge biases and assumptions about scholarship which may still exist in educational systems and structures. Ultimately, we hope that this work will advance the stature/standing of scholarship in the field. We provide a general definition of scholarship and how this relates to the scholarship of teaching (and learning) (SoT[L]) and scholarly teaching. Drawing on Boyer's seminal work, we describe different types of scholarship and reflect on how these apply to HPE, before moving on to describe different types of engagement with scholarship in HPE, including scope of contribution and influence. Using cases and examples, we illustrate differences in scholarly engagement across stages of a career, contexts, and ways of engaging. We provide guidance on how to assess 'quality' of scholarship. We offer practical advice for health professions' educators seeking academic advancement. We advocate that institutional leaders consider their systems and structures, so that these align with faculty work patterns, and judge teaching and professional practice appropriately. We conclude by offering a new definition of scholarship in HPE.

Ottawa 2020 consensus statement for programmatic assessment - 1. Agreement on the principles.

INTRODUCTION: In the Ottawa 2018 Consensus framework for good assessment, a set of criteria was presented for systems of assessment. Currently, programmatic assessment is being established in an increasing number of programmes. In this Ottawa 2020 consensus statement for programmatic assessment insights from practice and research are used to define the principles of programmatic assessment. METHODS: For fifteen programmes in health professions education affiliated with members of an expert group (n = 20), an inventory was completed for the perceived components, rationale, and importance of a programmatic assessment design. Input from attendees of a programmatic assessment workshop and symposium at the 2020 Ottawa conference was included. The outcome is discussed in concurrence with current theory and research. RESULTS AND DISCUSSION: Twelve principles are presented that are considered as important and recognisable facets of programmatic assessment. Overall these principles were used in the curriculum and assessment design, albeit with a range of approaches and rigor, suggesting that programmatic assessment is an achievable education and assessment model, embedded both in practice and research. Knowledge on and sharing how programmatic assessment is being operationalized may help support educators charting their own implementation journey of programmatic assessment in their respective programmes.

Ottawa 2020 consensus statements for programmatic assessment - 2. Implementation and practice.

INTRODUCTION: Programmatic assessment is a longitudinal, developmental approach that fosters and harnesses the learning function of assessment. Yet the implementation, a critical step to translate theory into practice, can be challenging. As part of the Ottawa 2020 consensus statement on programmatic assessment, we sought to provide descriptions of the implementation of the 12 principles of programmatic assessment and to gain insight into enablers and barriers across different institutions and contexts. METHODS: After the 2020 Ottawa conference, we surveyed 15 Health Profession Education programmes from six different countries about the implementation of the 12 principles of programmatic assessment. Survey responses were analysed using a deductive thematic analysis. RESULTS AND DISCUSSION: A wide range of implementations were reported although the principles remained, for the most part, faithful to the original enunciation and rationale. Enablers included strong leadership support, ongoing faculty development, providing students with clear expectations about assessment, simultaneous curriculum renewal and organisational commitment to change. Most barriers were related to the need for a paradigm shift in the culture of assessment. Descriptions of implementations in relation to the theoretical principles, across multiple educational contexts, coupled with explanations of enablers and barriers, provided new insights and a clearer understanding of the strategic and operational considerations in the implementation of programmatic assessment. Future research is needed to further explore how contextual and cultural factors affect implementation.

How rural is rural? The relationship between rural background of medical students and their career location intentions.

OBJECTIVE: Rural background is associated with greater interest in rural practice. However, there is no universally agreed definition of 'rural' background used in medical school selection. This study explored the association between definitions of 'rural' background and students' intended career locations. DESIGN: Prospective cohort study using survey data on career intention, hometown size, rurality of background, home address, high school and intended career location. SETTING: University of Auckland, New Zealand (NZ). PARTICIPANTS: Commencing medical students 2009-2017, inclusive. MAIN OUTCOME MEASURES: Univariate associations between student background according to 7 definitions of 'rural', and 3 definitions of intended practice location based on population size: urban intention (>100 000); regional intention (25 000-100 000); rural intention (<25 000). RESULTS: The sample size was 1592 students. 27.4% had a rural background by at least one definition. All definitions of rural background were associated with a greater rural intention. Applying a restrictive definition of rural (population<25 000) was associated with a higher likelihood of rural intention, but captured a smaller number of students. There was strong agreement between the population size of a student's background and intended practice location (chi-square P < .0001). CONCLUSION: Rural intention varies by definition, but the number of students captured by each definition is important. Applying a binary or overly restrictive definition may limit interested students. Medical schools should adopt a definition of 'rural' that optimises the number of eligible students and their propensity to work rurally. Further, alternative ways of identifying students with rural intentions without a rural background should be explored.

The stress paradox: how stress can be good for learning.

CONTEXT: This article explores the myth that stress is always bad for learning. The term "stress" has been narrowed by habitual use to equate with the negative outcome of distress; this article takes an alternative view that ultimately rejects the myth that demonises stress. The avoidance of distress is important, but a broader view of stress as something that can have either positive or negative outcomes is considered. PROPOSAL: We propose that stress is important for learning and stress-related growth. We explore the little-mentioned concept of eustress (good stress) as a counter to the more familiar concept of distress. We further consider that the negative associations of stress may contribute to its negative impact. The impact of stress on learning should be deliberately and carefully considered. We offer a hypothetical learning journey that considers the cause of potential stress, a stressor, and how a stressor is moderated to result in stress that may influence learning either by positively challenging the learner or by functioning as a hindrance to learning. CONCLUSIONS: In thinking more positively about stress, health professional educators may better support the student's learning journey.

Towards a Definition of Distinction in Professionalism.

Phenomenon: Professionalism can be characterized by a particular set of attributes that clinicians demonstrate in practice. Although much has been described on those attributes that define acceptable professionalism, the characteristics that define distinction in professionalism have not yet been well defined. Approach: In this exploratory project, qualitative methods were used to triangulate three sources of data collected from three campuses of one medical school: student assessment summaries, teacher interviews, and an institutional policy. Findings: One hundred-thirty student assessment summaries, eight teacher interviews, and one institutional policy were analyzed. Three characteristics emerged that define distinction in professionalism: improvement of oneself, helping others learn, and teamwork. These characteristics are in addition to students demonstrating a clear minimum standard in all other aspects of professionalism. Insights: Findings from this project offer a first step toward a definition of distinction in professionalism for assessing student performance. The characteristics can be demonstrated by students to varying degrees of proficiency and are potentially achievable by all students. Finally, the characteristics would be required in addition to demonstrating a clear minimum standard of performance in all other aspects of professionalism and cannot be inferred by the absence of negative or unprofessional behaviors. Recognizing that conceptions of professionalism have contextual and cultural influences, the characteristics of distinction identified by this project expand the language available for teachers and learners to discuss professionalism. Teachers may use these characteristics to help inform their teaching, learning, and feedback practices. Students will gain clarity about the expectations regarding their professional behavior.

Differences between medical school and PGY1 learning outcomes: An explanation for new graduates not being "work ready"?

Background: Widespread concerns about new medical graduates' 'work readiness' may reflect, in part, differences in mandatory learning outcomes for medical students and new medical graduates.Purpose: To examine differences between required medical student and PGY1 (first year resident) training program outcomes, and the nature and magnitude of these differences.Method: Comparison, systematic identification and thematic analysis of differences between the graduate outcomes in the Australian Medical Council Standards for the Assessment and Accreditation of Primary Medical Programs and those in the New Zealand Curriculum Framework for Prevocational Training.Results: The relationship between these outcome statements were categorized as: essentially similar; continuity; partial discontinuity; and complete discontinuity of learning trajectory. Areas requiring substantial new learning may reflect medical schools' focus on individual student performance, and on learning and assessments based on single episodes of often uncomplicated illness. This contrasted with a post-graduate focus on integrated health care delivery by teams and management of complex illnesses over the whole patient care journey.Conclusions: Characterizing these marked differences between pre-graduate and postgraduate standards, within a trajectory of learning, explains some of the difficulties in students' preparation for work readiness. These could inform learning interventions to support new graduates' professional development to ensure patient safety. Development and revision of accreditation standards should include formal review against the expectations of the preceding and succeeding phases of learning.