Measuring the Impact of a Faculty Development Program on Clinical Educators.

INTRODUCTION: An Academy of Clinical Educators (ACE) was established at the University of Newcastle, to support and build capacity among existing and prospective medical educators. ACE established a Certificate of Clinical Teaching and Supervision (CCTS) program, the final assessment of which was a reflective piece on how the course has affected participants' practice as clinical teachers or supervisors and how changes are expected to impact learner achievement. We conducted a qualitative evaluation of these to explore the impact of the CCTS on participants' teaching. METHODS: Thirty-one participants (of 90 completers to date) consented for their written reflections to undergo qualitative thematic analysis and completed a survey exploring their preparation for, and experience of the program, and application of skills learnt. RESULTS: Most participants reported applying the skills gained through the CCTS to their teaching practice to a large (n=23; 72%) or very large (n=5; 16%) extent. Four themes emerged from the qualitative data, aligned with the topics of the CCTS: teaching structure; feedback; orientation; and assessment. Participants described application of more structured approaches to orientation, teaching and feedback, positive student responses, and self-reported satisfaction with adopted changes. DISCUSSION: The CCTS has motivated change in the teaching practice of participants. Although evidence presented here is limited by the self-reported nature, descriptions of actual changes in practice were detailed and specific enough to suggest they could act as a proxy for objectively measured change in behaviour and outcome. CONCLUSION: A faculty development program delivered to clinicians with a range of teaching and education-related roles, from varied clinical disciplines and professions, can promote improved, structured teaching and feedback.

How does moulage contribute to medical students' perceived engagement in simulation? A mixed-methods pilot study.

INTRODUCTION: Moulage is used frequently in simulation, with emerging evidence for its use in fields such as paramedicine, radiography and dermatology. It is argued that moulage adds to realism in simulation, although recent work highlighted the ambiguity of moulage practice in simulation. In the absence of knowledge, this study sought to explore the impact of highly authentic moulage on engagement in simulation. METHODS: We conducted a randomised mixed-methods study exploring undergraduate medical students' perception of engagement in relation to the authenticity moulage. Participants were randomised to one of three groups: control (no moulage, narrative only), low authenticity (LowAuth) or high authenticity (HighAuth). Measures included self-report of engagement, the Immersion Scale Reporting Instrument (ISRI), omission of treatment actions, time-to-treat and self-report of authenticity. In combination with these objective measures, we utilised the Stimulated Recall (SR) technique to conduct interviews immediately following the simulation. RESULTS: A total of 33 medical students participated in the study. There was no statistically significant difference between groups on the overall ISRI score. There were statistically significant results between groups on the self-reported engagement measure, and on the treatment actions, time-to-treat measures and the rating of authenticity. Four primary themes ((1) the rules of simulation, (2) believability, (3) consistency of presentation, (4) personal knowledge ) were extracted from the interview analysis, with a further 9 subthemes identified ((1) awareness of simulating, (2) making sense of the context (3) hidden agendas, (4) between two places, (5) dismissing, (6) person centredness, (7) missing information (8) level of training (9) previous experiences). CONCLUSIONS: Students rate moulage authenticity highly in simulations. The use of high-authenticity moulage impacts on their prioritisation and task completion. Although the slower performance in the HighAuth group did not have impact on simulated treatment outcomes, highly authentic moulage may be a stronger predictor of performance. Highly authentic moulage is preferable on the basis of optimising learning conditions.

Simulation can offer a sustainable contribution to clinical education in osteopathy.

Background: Clinical education forms a substantial component of health professional education. Increased cohorts in Australian osteopathic education have led to consideration of alternatives to traditional placements to ensure adequate clinical exposure and learning opportunities. Simulated learning offers a new avenue for sustainable clinical education. The aim of the study was to explore whether directed observation of simulated scenarios, as part replacement of clinical hours, could provide an equivalent learning experience as measured by performance in an objective structured clinical examination (OSCE). Methods: The year 3 osteopathy cohort were invited to participate in replacement of 50% of their clinical placement hours with online facilitated, video-based simulation exercises (intervention). Competency was assessed by an OSCE at the end of the teaching period. Inferential statistics were used to explore any differences between the control and intervention groups as a post-test control design. Results: The funding model allowed ten learners to participate in the intervention, with sixty-six in the control group. Only one OSCE item was significantly different between groups, that being technique selection (p = 0.038, d = 0.72) in favour of the intervention group, although this may be a type 1 error. Grade point average was moderately positively correlated with the manual therapy technique station total score (r = 0.35, p < 0.01) and a trivial relationship with the treatment reasoning station total score (r = 0.17, p = 0.132). Conclusions: The current study provides support for further investigation into part replacement of clinical placements with directed observation of simulated scenarios in osteopathy.

Expert opinions on the authenticity of moulage in simulation: a Delphi study.

BACKGROUND: Moulage is a technique in which special effects makeup is used to create wounds and other effects in simulation to add context and create realism in an otherwise fabricated environment. The degree to which moulage is used in the simulated environment is varied; that is, there is no guide for how authentic it is required to be. To objectively assess whether a higher level of authenticity in moulage influences engagement and better outcomes, a common model to assess authenticity is required. The aim of this study was to explore expert opinions on moulage in simulation and develop an instrument for the classification of moulage in simulation. METHODS: The instrument was developed in 3 phases: expert panellist recruitment, domain identification, and consensus rounds. A Delphi technique was used to explore themes of authenticity using Dieckmann's Theory of Realism as a frame of reference. An initial list of elements was raised by a panel of international experts. The experts participated in a further four rounds of questioning, identifying and then ranking and/or rating elements of authenticity in moulage. A priori consensus threshold was set at 80%. RESULTS: In round 1, 18 of 31 invited panellists participated, and a total of 10 completed round 5 (attrition 44%). As a result of the Delphi, the Moulage Authenticity Rating Scale was developed. Under the three domains of realism, 60 elements were identified by experts. A total of 13 elements reached the consensus threshold, whilst tensions regarding the necessity for authentic moulage were identified throughout the rounds. CONCLUSION: This study demonstrates the complexity of moulage in simulation, with particular challenges surrounding the experts' views on authenticity. A prototype instrument for measuring moulage authenticity is presented in the form of the Moulage Authenticity Rating Scale (MARS) to further aid progress in understanding the role of authentic moulage in simulation.

Improved laparoscopic skills in gynaecology trainees following a simulation-training program using take-home box trainers.

BACKGROUND: Lack of time and access to equipment are recognised barriers to simulation training. AIM: To investigate the effect of a take-home laparoscopic simulator training program on the laparoscopic skills of gynaecology trainees. METHOD: Participants (n = 17 in 2015, n = 16 in 2016) were supplied with a box trainer, associated equipment and instructions on self-directed training. A program was designed and implemented in 2015 comprising of ten weekly laparoscopic skills tasks and modified in 2016 to eight monthly tasks. Half of the participants were randomly allocated a supervisor. Participants performed baseline and post-training assessments of laparoscopic skills in a box trainer task (thread transfer) and virtual reality simulator tasks (laparoscopic tubal ligation and bilateral oophorectomy). RESULTS: Trainees in 2015 demonstrated an improvement in the median time to complete the laparoscopic tubal ligation task (baseline 124 s vs post-training 91 s, P = 0.041). There was no difference in the number of tubal ligation bleeding incidents, or in the time taken to complete the box trainer thread transfer task. In 2016 trainees demonstrated improvement in tubal ligation time (baseline 251 vs 71 post-training, P = 0.021) and bilateral oophorectomy time (baseline 891 s vs 504 post-training, P = 0.025). There was no significant difference in other outcome measures. There was no difference found in performance when groups were compared by supervisor allocation. CONCLUSION: A take-home box trainer simulation-training program was associated with improvement in laparoscopic skills. This type of program may improve trainee access to simulation training.

The reliability of a portfolio of workplace-based assessments in anesthesia training.

PURPOSE: Competency-based anesthesia training programs require robust assessment of trainee performance and commonly combine different types of workplace-based assessment (WBA) covering multiple facets of practice. This study measured the reliability of WBAs in a large existing database and explored how they could be combined to optimize reliability for assessment decisions. METHODS: We used generalizability theory to measure the composite reliability of four different types of WBAs used by the Australian and New Zealand College of Anaesthetists: mini-Clinical Evaluation Exercise (mini-CEX), direct observation of procedural skills (DOPS), case-based discussion (CbD), and multi-source feedback (MSF). We then modified the number and weighting of WBA combinations to optimize reliability with fewer assessments. RESULTS: We analyzed 67,405 assessments from 1,837 trainees and 4,145 assessors. We assumed acceptable reliability for interim (intermediate stakes) and final (high stakes) decisions of 0.7 and 0.8, respectively. Depending on the combination of WBA types, 12 assessments allowed the 0.7 threshold to be reached where one assessment of any type has the same weighting, while 20 were required for reliability to reach 0.8. If the weighting of the assessments is optimized, acceptable reliability for interim and final decisions is possible with nine (e.g., two DOPS, three CbD, two mini-CEX, two MSF) and 15 (e.g., two DOPS, eight CbD, three mini-CEX, two MSF) assessments respectively. CONCLUSIONS: Reliability is an important factor to consider when designing assessments, and measuring composite reliability can allow the selection of a WBA portfolio with adequate reliability to provide evidence for defensible decisions on trainee progression.

RéSUMé: OBJECTIF: Les programmes de formation en anesthésie basés sur les compétences nécessitent de solides évaluations des performances des stagiaires et combinent habituellement des évaluations sur le lieu de travail (ÉLT) couvrant de nombreux aspects de la pratique. Cette étude a mesuré la fiabilité des ÉLT dans une grande base de données existante et a exploré comment elles pourraient être combinées pour accroître leur fiabilité pour des décisions sur les évaluations. MéTHODES: Nous avons utilisé la théorie de la généralisation pour mesurer un critère composite de fiabilité de quatre types d'ÉLT utilisés par les collèges d'anesthésiologistes d'Australie et de Nouvelle-Zélande : un exercice de mini-évaluation clinique (mini-CEX), l'observation directe des habiletés procédurales (DOPS), une discussion de cas (CbD) et une rétroaction de multiples sources (MSF). Nous avons alors modifié le nombre et la pondération des combinaisons d'ÉLT pour optimiser la fiabilité avec moins d'évaluations. RéSULTATS: Nous avons analysé 67 405 évaluations de 1 837 stagiaires et 4 145 assesseurs. Nous avons supposé une fiabilité acceptable pour les décisions intérimaires (enjeux intermédiaires) et définitives (enjeux élevés) à, respectivement, 0,7 et 0,8. Selon la combinaison des types d'ÉLT, 12 évaluations ont permis d'atteindre le seuil de 0,7 lorsqu'une évaluation de chaque type a le même poids, alors qu'il en a fallu 20 pour que la fiabilité atteigne 0,8. Si la pondération des évaluations est optimisée, la fiabilité acceptable pour les décisions intérimaires et finales est possible avec, respectivement, neuf évaluations (p. ex., deux DOPS, trois CbD, deux mini-CEX, deux MSF) et quinze évaluations (p. ex. deux DOPS, huit CbD, trois mini-CEX, deux MSF). CONCLUSIONS: La fiabilité est un facteur important dont il faut tenir compte quand on conçoit les évaluations et la mesure d'une fiabilité composite permet la sélection d'un éventail d'ÉLT avec une fiabilité adéquate pour l'obtention de données probantes et la défense de décisions sur les progrès des stagiaires.

Trainee Performance in Loop Electrosurgical Excision Procedure (LEEP) After Simulation Training.

OBJECTIVE: The aim of the study was to review the performance of trainees in loop electrosurgical excision procedure (LEEP) procedures after the introduction of a simulation training program. MATERIALS AND METHOD: A simulation training program was introduced in September 2016 for gynecology trainees at the study institution. Trainees were encouraged to perform at least 3 simulated LEEP procedures before operating. For a 12-month period after the introduction of training, data on operating time and specimen quality measures of clear margin status, adequate depth, and absence of fragmentation were reviewed. This was compared with a 12-month period before simulation training (from September 2014-September 2015). Trainees were surveyed for feedback on the training. RESULTS: In total, 135 LEEP procedures were reviewed: 68 before and 67 after simulator training. Trainee specimens after training were more likely to be nonfragmented (89.2% vs 55.9%, p = .003), have clear margins (72.2% vs 41.9%, p = .015), and meet "all criteria" (46% vs 20.6%, p = .043) than trainee specimens before training. There was no change in depth adequacy (70.3% vs 67.7%, p = .99). Median trainee procedure time reduced from 18 minutes (interquartile range = 11-24) before training to 8 minutes after training (interquartile range = 6-11) (p = <0.001). There was no significant change in operating time or specimen quality from LEEP procedures performed by attendings (who did not use the simulator). Trainee and attending procedural outcomes were similar after training. Trainees had mostly positive views on the training, though reported time constraints as a barrier to simulation. CONCLUSIONS: After the introduction of an LEEP simulation training program, operative time and specimen quality from trainee procedures seemed to improve.

Is that realistic? The development of a realism assessment questionnaire and its application in appraising three simulators for a gynaecology procedure.

INTRODUCTION: There is no standard approach to determining the realism of a simulator, valuable information when planning simulation training. The aim of this research was to design a generic simulator realism questionnaire and investigate the contributions of different elements of simulator design to a user's impression of simulator realism and performance. METHODS: A questionnaire was designed with procedure-specific and non-procedure-specific (global) questions, grouped in subscales related to simulator structure and function. Three intrauterine contraceptive device (IUCD) simulators were selected for comparison. Participants were doctors of varying experience, who performed an IUCD insertion on each of the three models and used the questionnaire to rate the realism and importance of each aspect of the simulators. The questionnaire was evaluated by correlation between procedure-specific and global items and the correlation of these items to overall realism scores. Realism scores for each simulator were compared by Kruskal-Wallis and subsequent between-simulator comparison by Dunn's test. RESULTS: Global question scores were highly related to procedure-specific scores. Comparison revealed global item subscale scores were significantly different across models on each of the nine subscales (P < 0.001). Function items were rated of higher importance than structure items (mean function item importance 5.36 versus mean structure item importance 5.02; P = 0.009). CONCLUSIONS: The designed questionnaire was able to discriminate between the models for perceived simulator realism. Findings from this study may assist simulator design and inform future development of a generic questionnaire for assessing user perceptions of simulator realism.

Investigating the impact of moulage on simulation engagement - A systematic review.

BACKGROUND: Simulation Based Education (SBE) is used as a primer for clinical education in nursing and other health professions. Participant engagement strategies and good debriefing have been identified as key for effective simulations. The environment in which the simulation is situated also plays a large role in the degree of participant engagement. Various cues are staged within simulations to enhance this engagement process. Moulage techniques are used in current-day simulation to mimic illnesses and wounds, acting as visual and tactile cues for the learner. To effectively utilise moulage in simulation, significant expense is required to train simulation staff and to purchase relevant equipment. OBJECTIVE: Explore the use of moulage in simulation practice today and its influence on participant engagement. DESIGN: Using a systematic process to extract papers, we reviewed the literature with a critical-realist lens. DATA SOURCES: CINAHL Complete, ERIC, Embase, Medline, PsycINFO, SCOPUS, Web of Science, Proquest, Science Direct and SAGE. REVIEW METHODS: 10 databases were systematically reviewed using the keyword "moulage" to answer the question "How does the authenticity of moulage impact on participant engagement?". 1318 records were identified prior to exclusion criterion were applied. 10 articles were targeted for review, following exclusion for English language and publication between 2005 and 2015. RESULTS: The resulting 10 papers were assessed for quality using the Medical Education Research Study Quality Instrument (MERSQI). The majority of papers were situated in dermatology teaching, with only one nursing paper. Study participants were both undergraduate and postgraduate. Most of the studies were undertaken at a university setting. No papers comprehensively addressed whether the authenticity of moulage influences learner engagement. CONCLUSIONS: Results were limited, yet clearly outline a widely held assumption that moulage is essential in simulation-based education for improved realism and subsequent learner engagement. Despite this, there is no clear evidence from the literature that this is the case, suggesting that further research to explore the impact of moulage on participant engagement is warranted. A number of recommendations are made for future research.

Composite reliability of workplace-based assessment of international medical graduates.

OBJECTIVE: The fitness to practise of international medical graduates (IMGs) is usually evaluated with standardised assessment tests. The performance rather than the competency of practising doctors should, however, be assessed, for which reason workplace-based assessment (WBA) has gained increasing attention. Our aim was to assess the composite reliability of WBA instruments for assessing IMGs. DESIGN AND SETTING: Between June 2010 and April 2015, 142 IMGs were assessed by 99 calibrated assessors; each was assessed in the workplace over 6 months. The IMGs completed 970 case-based discussions (CBDs), 1741 mini-clinical examination exercises (mini-CEX), and 1020 multi-source feedback (MSF) assessments. PARTICIPANTS: 103 male and 39 female candidates from 28 countries (Africa, Asia, Europe, South America, South Pacific) in urban and rural hospitals of the Hunter New England Health region. MAIN OUTCOME MEASURES: The composite reliability across the three WBA tools, expressed as the standard error of measurement (SEM). RESULTS: In our WBA program, a combination of five CBD and 12 mini-CEX assessments achieved an SEM of 0.33, greater than the threshold 0.26 of a scale point. Adding six MSF results to the assessment package reduced the SEM to 0.24, which is adequately precise. CONCLUSIONS: Combining data from different WBA assessment instruments achieves acceptable reliability for assessing IMGs, provided that the panel of WBA assessment types are carefully selected and the assessors are calibrated.

Evaluation of a Low-Fidelity Surgical Simulator for Large Loop Excision of the Transformation Zone (LLETZ).

INTRODUCTION: Large loop excision of the transformation zone (LLETZ) is a common gynecological treatment for cervical dysplasia but can be challenging to teach. There is no widely adopted simulator for this procedure in Australia, so a new low-fidelity simulator was designed and evaluated. METHOD: A simulator for a LLETZ procedure was developed. Doctors (N = 29), varied in experience level in gynecology at a tertiary hospital, performed a LLETZ procedure using the simulator. The procedures were filmed, and two independent assessors rated the deidentified videos. The assessment involved a checklist (of crucial procedural steps) and global rating scale to evaluate whether the simulator facilitated the demonstration of LLETZ procedure skills. Participants completed a questionnaire evaluating the performance and utility of the simulator to determine participant perceptions of simulator realism and acceptability. RESULTS: The participant questionnaire revealed positive evaluations of realism and acceptability of the simulator. Performance scores were significantly different across experience levels (P < 0.001) with post hoc pairwise comparison between levels confirming significant differences between each group in assessed simulator performance for global rating scale and overall performance scores. The interrater reliability of the assessors was high (0.84). CONCLUSIONS: A low-fidelity simulator for a LLETZ procedure seems to adequately demonstrate procedural performance reflecting doctor experience level. Participant questionnaire responses were positive, supporting further evaluation of the simulator for use in training.

Does Appearance Matter? Current Issues and Formulation of a Research Agenda for Moulage in Simulation.

STATEMENT: The use of moulage is assumed to add realism and authentic context in simulation. Despite the expense required to utilize moulage effectively, there is little exploration in the literature as to both its necessity and its accuracy of portrayal. We explore engagement, authenticity, and realism theories in the context of moulage and highlight the need for more evidence on moulage in simulation-based education, including suggestions for future research. In particular, we urge the simulation community to move beyond descriptive papers to investigate moulage in terms of justification and clarification.

Simulation training in obstetrics and gynaecology: What's happening on the frontline?

BACKGROUND: Despite evidence supporting simulation training and awareness that trainee exposure to surgery is suboptimal, it is not known how simulation is being incorporated in obstetrics and gynaecology (O&G) training across Australia and New Zealand. AIM: To investigate the current availability and utilisation of simulation training, and the attitudes, perceived barriers and enablers towards simulation in Australia and New Zealand. METHOD: A survey was distributed to O&G trainees and fellows in Australia and New Zealand. The survey recorded demographic data, current exposure to simulation and beliefs about simulation training. RESULTS: The survey returned 624 responses (24.3%). Most trainees had access to at least one type of simulation (87%). Access to simulators was higher for trainees at tertiary hospitals (92% vs 76%). Few trainees had a simulation curriculum, allocated time or supervision for simulation training. 'Limited access' was the highest rated barrier to using simulation. Lack of time, other training priorities and cost were identified as further barriers. More than 80% of respondents believed simulation improves surgical skills, skills transfer to the operating theatre, and the addition of simulation to the RANZCOG curriculum would benefit trainees. However, a minority of respondents believed simulator proficiency should be shown prior to performing surgery. The need for a curriculum and supervision were highlighted as necessary supports for simulation training. CONCLUSIONS: Despite simulator availability, few trainees are supported by simulation training curricula, allocated time or supervision. Participants believed that simulation training benefits trainees and should be supported with a curriculum and teaching.

A national training program for simulation educators and technicians: evaluation strategy and outcomes.

BACKGROUND: Simulation-based education (SBE) has seen a dramatic uptake in health professions education over the last decade. SBE offers learning opportunities that are difficult to access by other methods. Competent faculty is seen as key to high quality SBE. In 2011, in response to a significant national healthcare issue--the need to enhance the quality and scale of SBE--a group of Australian universities was commissioned to develop a national training program--Australian Simulation Educator and Technician Training (AusSETT) Program. This paper reports the evaluation of this large-scale initiative. METHODS: The AusSETT Program adopted a train-the-trainer model, which offered up to three days of workshops and between four and eight hours of e-learning. The Program was offered across all professions in all states and territories. Three hundred and three participants attended workshops with 230 also completing e-learning modules. Topics included: foundational learning theory; orientation to diverse simulation modalities; briefing; and debriefing. A layered objectives-oriented evaluation strategy was adopted with multiple stakeholders (participants, external experts), methods of data collection (end of module evaluations, workshop observer reports and individual interviews) and at multiple data points (immediate and two months later). Descriptive statistics were used to analyse numerical data while textual data (written comments and transcripts of interviews) underwent content or thematic analysis. RESULTS: For each module, between 45 and 254 participants completed evaluations. The content and educational methods were rated highly with items exceeding the pre-established standard. In written evaluations, participants identified strengths (e.g. high quality facilitation, breadth and depth of content) and areas for development (e.g. electronic portfolio, learning management system) of the Program. Interviews with participants suggested the Program had positively impacted their educational practices. Observers reported a high quality educational experience for participants with alignment of content and methods with perceived participant needs. CONCLUSIONS: The AusSETT Program is a significant and enduring learning resource. The development of a national training program to support a competent simulation workforce is feasible. The Program objectives were largely met. Although there are limitations with the study design (e.g. self-report), there are strengths such as exploring the impact two months later. The evaluation of the Program informs the next phase of the national strategy for simulation educators and technicians with respect to content and processes, strengths and areas for development.

An Online Survey Investigating Australian Radiation Therapists' Responses to Hypothetical Dilemmas Concerning Impaired Fitness to Practise.

INTRODUCTION: Impairment in health care professionals has been identified as one of the determinants of fitness to practise (FTP), and practitioners have a legal obligation to notify regulatory authorities if they experience it. However, there remains confusion as to how radiation therapists (RTs) discern what constitutes impaired practice and how they would respond to such dilemmas. The aim of this study was to identify the range of responses to hypothetical professional impairment dilemmas, which may inform an educational strategy for improving reporting occurrences. METHODS: A convenience sample of Australian RTs was invited to participate in an anonymous online survey that presented a range of FTP dilemmas relating to impairment, competence, and values/ethics. Participants were asked to describe how they would deal with such situations. Qualitative responses were coded using NVivo software. This article reports on the themes that emerged from the impairment dilemmas. RESULTS: One hundred eighty-two RTs responded to the survey. The emerging key theme and subthemes included dealing with the situation, removal of the practitioner from the situation, stop working, avoiding responsibility, giving the benefit of the doubt, and carrying on with the workload. CONCLUSIONS: Practitioners' interpretations of the impairment dilemmas varied, which, in turn, influenced their suggestions of how they would deal with them. The continuum of responses supports a key tenant of the interpretive paradigm-multiple interpretations of social phenomena exist. Those seeking to improve practitioner understanding of their obligations under national law should consider a scenario-based approach to raising awareness of FTP issues such as impairment.

A contemporary examination of workplace learning culture: an ethnomethodology study.

BACKGROUND: Creating and maintaining a sustainable workforce is currently an international concern. Extensive literature suggest that students and staff need to be 'engaged', that is they need to interact with the health team if they are to maximise learning opportunities. Despite many studies since the 1970s into what creates a 'good' learning environment, ongoing issues continue to challenge healthcare organisations and educators. A 'good' learning environment has been an intangible element for many professions as learning is hindered by the complexity of practice and by limitations on practitioners' time available to assist and guide novices. OBJECTIVES: This study sought to explore the nature of the learning interactions and experiences in clinical nursing practice that enhance a 'good' workplace learning culture for both nursing students and qualified nurses. DESIGN: An ethnomethodology study. SETTING: A range of clinical settings in Victoria and Queensland, Australia. PARTICIPANTS: Students and registered nurses (n=95). METHODS: Fieldwork observations were carried out on student nurses and registered nurses, followed by an individual interview with each participant. An iterative approach to analysis was undertaken; field notes of observations were reviewed, interviews transcribed verbatim and entered into NVivo10. Major themes were then extracted. RESULTS: Three central themes: learning by doing, navigating through communication, and 'entrustability', emerged providing insights into common practices potentially enhancing or detracting from learning in the workplace. CONCLUSIONS: Students' and registered nurses' learning is constrained by a myriad of interactions and embedded workplace practices, which can either enhance the individual's opportunities for learning or detract from the richness of affordances that healthcare workplace settings have to offer. Until the culture/or routine practices of the healthcare workplace are challenged, the trust and meaningful communication essential to learning in practice, will be achievable only serendipitously.

Medical school benchmarking - from tools to programmes.

BACKGROUND: Benchmarking among medical schools is essential, but may result in unwanted effects. AIM: To apply a conceptual framework to selected benchmarking activities of medical schools. METHODS: We present an analogy between the effects of assessment on student learning and the effects of benchmarking on medical school educational activities. A framework by which benchmarking can be evaluated was developed and applied to key current benchmarking activities in Australia and New Zealand. RESULTS: The analogy generated a conceptual framework that tested five questions to be considered in relation to benchmarking: what is the purpose? what are the attributes of value? what are the best tools to assess the attributes of value? what happens to the results? and, what is the likely "institutional impact" of the results? If the activities were compared against a blueprint of desirable medical graduate outcomes, notable omissions would emerge. CONCLUSION: Medical schools should benchmark their performance on a range of educational activities to ensure quality improvement and to assure stakeholders that standards are being met. Although benchmarking potentially has positive benefits, it could also result in perverse incentives with unforeseen and detrimental effects on learning if it is undertaken using only a few selected assessment tools.

Breakeven, cost benefit, cost effectiveness, and willingness to pay for web-based versus face-to-face education delivery for health professionals.

BACKGROUND: The introduction of Web-based education and open universities has seen an increase in access to professional development within the health professional education marketplace. Economic efficiencies of Web-based education and traditional face-to-face educational approaches have not been compared under randomized controlled trial conditions. OBJECTIVE: To compare costs and effects of Web-based and face-to-face short courses in falls prevention education for health professionals. METHODS: We designed two short courses to improve the clinical performance of health professionals in exercise prescription for falls prevention. One was developed for delivery in face-to-face mode and the other for online learning. Data were collected on learning outcomes including participation, satisfaction, knowledge acquisition, and change in practice, and combined with costs, savings, and benefits, to enable a break-even analysis from the perspective of the provider, cost-effectiveness analysis from the perspective of the health service, and cost-benefit analysis from the perspective of the participant. RESULTS: Face-to-face and Web-based delivery modalities produced comparable outcomes for participation, satisfaction, knowledge acquisition, and change in practice. Break-even analysis identified the Web-based educational approach to be robustly superior to face-to-face education, requiring a lower number of enrollments for the program to reach its break-even point. Cost-effectiveness analyses from the perspective of the health service and cost-benefit analysis from the perspective of the participant favored face-to-face education, although the outcomes were contingent on the sensitivity analysis applied (eg, the fee structure used). CONCLUSIONS: The Web-based educational approach was clearly more efficient from the perspective of the education provider. In the presence of relatively equivocal results for comparisons from other stakeholder perspectives, it is likely that providers would prefer to deliver education via a Web-based medium. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry (ACTRN): 12610000135011; http://www.anzctr.org.au/trial_view.aspx?id=335135 (Archived by WebCite at http://www.webcitation.org/668POww4L).