A roadmap to realist interviews in health professions education research: Recommendations based on a critical analysis.

CONTEXT: Realist evaluation is increasingly employed in health professions education research (HPER) because it can unpack the extent to which complex educational interventions work (or not), for whom under what circumstances and how. While realist evaluation is not wedded to particular methods, realist interviews are commonly the primary, if not only, data collection method in realist evaluations. While qualitative interviewing from an interpretivist standpoint has been well-articulated in the HPER literature, realist interviewing differs substantially. The former elicits participants' views and experiences of a topic of inquiry, whereas realist interviewing focuses on building, testing and/or refining programme theory. Therefore, this article aims to help readers better understand, conduct, report and critique realist interviews as part of realist evaluations. METHODS: In this paper, we describe what realist approaches are, what realist interviewing is and why realist interviewing matters. We outline five stages to realist interviewing (developing initial programme theory, realist sampling/samples, the interview itself, realist analysis and reporting realist interviews), drawing on two illustrative cases from our own realist evaluations employing interviewing to bring theory to life. We provide a critical analysis of 12 realist evaluations employing interviewing in the HPER literature. Alongside reporting standards, and our own realist interviewing experiences, this critical analysis of published articles serves to foreground our recommendations for realist interviewing. CONCLUSIONS: We encourage HPE researchers to consider realist interviews as part of realist evaluations of complex interventions. Our critical analysis reveals that realist interviews can provide unique insights into HPE, but authors now need to report their sampling approach, type of interviewing and interview questions more explicitly. Studies should also more explicitly draw on existing realist interviewing literature and follow reporting guidelines for realist evaluations. We hope this paper provides a useful roadmap to conducting, reporting and critically appraising realist interviews in HPER.

Unpacking economic programme theory for supervision training: Preliminary steps towards realist economic evaluation.

INTRODUCTION: Cost studies are increasingly popular given resource constraints. While scholars stress the context-dependent nature of cost, and the importance of theory, cost studies remain context-blind and atheoretical. However, realist economic evaluation (REE) privileges context and the testing/refinement of economic programme theory. This preliminary REE serves to test and refine economic programme theory for supervision training programmes of different durations to better inform future programme design/implementation. METHODS: Our preliminary REE unpacked how short (half-day) and extended (12 week) supervision training programmes in Victoria, Australia, produced costs and outcomes. We employed mixed methods: qualitative realist and quantitative cost methods. Economically optimised programme models were developed guided by identified cost-sensitive mechanisms and contexts. RESULTS: As part of identified context-mechanism-outcome configurations (CMOCs) for both training programmes, we found a wider diversity of positive outcomes but greater costs for the extended programme (11 outcomes; AU$3069/learner) compared with the short programme (7 outcomes; $385/learner). We identified four shared cost-sensitive mechanisms for both programmes (training duration, learner protected time, learner engagement, and facilitator competence) and one shared cost-sensitive context (learners' supervisory experience). We developed two economically optimised programme models: (1) short programme for experienced supervisors facilitated by senior educators ($406/learner); and (2) extended programme for inexperienced supervisors facilitated by junior educators ($2104/learner). DISCUSSION: Our initial economic programme theory was somewhat supported, refuted and refined. Results were partly consistent with previous research, but also extended it through unpacking cost-sensitive mechanisms and contexts. Although our preliminary REE fills a pressing gap in the methodology literature, conducting REE was challenging given our desire to integrate economic and realist analyses fully, and remain faithful to realist principles. Attention to training duration and experience levels of the facilitator-learner dyad may help to balance the cost and outcomes of training programmes.

Balancing the effectiveness and cost of online education: A preliminary realist economic evaluation.

PURPOSE: While online learning for faculty development has grown substantially over recent decades, it has been further accelerated in the face of the worldwide pandemic. The effectiveness of online learning has been repeatedly established through systematic reviews and meta-analyses, yet questions remain about its cost-effectiveness. This study evaluates how synchronous online supervision training workshops and their cost-effectiveness might work, and in what contexts. METHODS: We conducted preliminary realist economic evaluation including qualitative (13 realist interviews), and quantitative approaches (cost Ingredients method). We developed a cost-optimised model based on identified costs and cost-sensitive mechanisms. RESULTS: We identified 14 recurring patterns (so-called demi-regularities) illustrating multiple online workshop outcomes (e.g. satisfaction, engagement, knowledge), generated by various mechanisms (e.g. online technology, mixed pedagogies involving didactic and active/experiential learning, peer learning), and triggered by two contexts (supervisor experience levels, and workplace location). Each workshop cost $302.92 per learner, but the optimised model including senior facilitators cost $305.70. CONCLUSIONS: Our initial realist program theories were largely supported and refined. Although findings were largely concordant with previous literature, we illustrate how online workshop costs compare favourably with face-to-face alternatives. We encourage program developers to consider synchronous online learning for faculty development especially for remote learners, and in resource-constrained environments.

The effect of preparation strategies, qualification and professional background on clinical nurse educator confidence.

AIMS: To describe how clinical nurse educators (CliNEs) in Vietnam are prepared for their role; to identify which preparation strategies assist development of confidence in clinical teaching; and to measure the effect of educational qualifications and professional background on perceived confidence levels. BACKGROUND: The quality of clinical teaching can directly affect the quality of the student learning experience. The role of the clinical educator is complex and dynamic and requires a period of adjustment for successful role transition to occur. Planned orientation and specific preparation programmes assist transition and reduce anxiety for new CliNEs. There is, however, a lack of clear evidence to identify the form this preparation should take or which strategies are likely to facilitate the development of role confidence. DESIGN: Descriptive survey study. METHODS: Cross-sectional surveys were used to collect data from 334 CliNEs during January-March 2015. RESULTS: Eight preparation methods commonly used in Vietnam were identified. There was a small yet significant association between preparation and CliNEs' perceived confidence. Formal preparation methods, and postgraduate qualifications and years of clinical teaching experience were linked to increased confidence in clinical teaching. Conversely, informal mentorship was found to hinder confidence development. CONCLUSIONS: This study identifies several preparation strategies that significantly enhance clinical educator confidence and readiness for their complex role. These preparation strategies drawn from the Vietnamese context, provide important examples for the wider nursing community to consider.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process.

Australian radiographer roles in the emergency department; evidence of regulatory compliance to improve patient safety - A narrative review.

OBJECTIVES: Using a narrative approach, this paper aims to determine the extent of Australian radiographers' regulatory compliance to improve patient safety when performing appendicular X-ray and non-contrast brain computed tomography (CT) in the Emergency Department (ED). KEY FINDINGS: A narrative review explored relevant literature and key regulatory policy. Ten documents were identified, three main themes were developed related to the radiographer roles in X-ray request justification, dose optimisation and preliminary image evaluation (PIE). Radiographers were equally aware of justification and optimisation pre and post the introduction of a Medical Code of Practice. The collective PIE accuracy of radiographers remained unaffected by changes in mode of PIE delivery and regulatory factors but varied based on the anatomical region. CONCLUSION: While current Australian regulations mandate radiographer request justification, dose optimisation and PIE, the degree of compliance by Australian radiographers remains uncertain. Current literature provides evidence that radiographers can improve patient care and safety through justification, optimisation, and PIE delivery. Change in workplace practice, supported by key stakeholders including radiologists, is essential to integrate radiographers' functions into routine ED clinical practice. Further research is required to audit radiographers' regulatory compliance to improve patient safety. IMPLICATIONS FOR PRACTICE: Patient safety in ED can be improved with timely and accurate diagnosis provided by radiographers. Radiographers have a professional obligation to adhere to the capabilities and standards for safe medical radiation practice defined by Australian regulations. Therefore, radiographers must justify the X-ray request, optimise the radiation dose where appropriate and communicate urgent or unexpected findings to the referrer.

A snapshot of Australian primary health care nursing workforce characteristics and reasons they work in these settings: A longitudinal retrospective study.

AIM: This article aimed to provide a snapshot of demographics and professional characteristics of nursing and midwifery workforce in Australian primary health care (PHC) settings during 2015-2019 and factors that influenced their decisions to work in PHC. DESIGN: Longitudinal retrospective survey. METHODS: Longitudinal data that were collected from a descriptive workforce survey were retrieved retrospectively. After collation and cleaning, data from 7066 participants were analysed using descriptive and inferential statistics in SPSS version 27.0. RESULTS: The majority of the participants were female, aged between 45 and 64 years old and working in general practice. There was a small yet steady increase in the number of participants in the 25-34 age group and a downward trend in the percentage of postgraduate study completion among participants. While factors perceived most/least important to their decision to work in PHC were consistent during 2015-2019, these factors differed among different age groups and postgraduate qualification holders. This study's findings are both novel and supported by previous research. It is necessary to tailor recruitment and retention strategies to nurses/midwives' age groups and qualifications to attract and retain highly skilled and qualified nursing and midwifery workforce in PHC settings.

The effectiveness of extended-duration supervision training for nurses and allied health professionals: A realist evaluation.

BACKGROUND: Training helps maintain high-quality supervision and its associated benefits (e.g. reduced burnout, improved care). While studies have previously evaluated extended-duration supervision training programmes, none have treated these as complex interventions so have not employed realist approaches. OBJECTIVES: Building on a previous realist synthesis, this evaluation tests and develops programme theory for extended-duration supervision training to answer the question: to what extent does the supervision training programme work, for whom, under what circumstances and why? DESIGN: We conducted a realist evaluation of a novel state-wide Victorian 3-month supervision training programme including one or two 3.5-h workshops followed by weekly reflexive longitudinal audio diaries (LADs) for up to 12 weeks. METHODS: Realist evaluation data comprised 25 entrance interviews with nurses and allied health professionals, 176 LADs (and 29 written diaries), and 23 exit interviews. We employed team-based realist analysis to identify context-mechanism-outcome configurations (CMOCs) to test and develop programme theory. RESULTS: We refined four recurring CMOCs from the realist synthesis programme theory, found insufficient evidence for two, and established five new recurring CMOCs. We identified multiple positive outcomes from our extended-duration supervision training programme (e.g. improved supervisor practices) through various mechanisms relating to pedagogy (e.g. weekly reflexivity), supervisors (e.g. engagement), and workplaces (e.g. enabling supervision cultures). Some negative outcomes were reported (e.g. decreased engagement) through various mechanisms (e.g. suboptimal training design). Such mechanisms were thought to come about by diverse contexts including supervisors (e.g. inexperienced/experienced), professions (nursing/allied health), and organisations (supervision-enabled/non-enabled cultures). CONCLUSIONS: Our findings extend the realist synthesis programme theory by highlighting various contexts triggering outcome-generating mechanisms. Programme outcomes are maximised through ongoing supervisor reflexivity paying attention to facilitator-supervisor relationships, as well as protected time for supervisors to translate learning into practice.

What Really Matters for Supervision Training Workshops? A Realist Evaluation.

PURPOSE: Supervision training supports health care supervisors to perform their essential functions. Realist evaluations are increasingly popular for evaluating complex educational interventions, but no such evaluations exist appraising supervision workshops. Building on an earlier realist synthesis of supervision training, the authors evaluated whether supervision workshops work, for whom and under what circumstances, and why. METHOD: The authors conducted a 2-stage realist evaluation during 2018-2019 to refine and develop program theory. The intervention involved half-day, face-to-face supervision workshops as part of an Australian state-wide government-funded program for health care and human services supervisors. Data collection involved realist interviews with 10 workshop developers (stage 1) and 43 supervisors (stage 2). The authors employed team-based data analysis using realist logic to refine and develop program theory by identifying contexts, mechanisms, outcomes, and context-mechanism-outcome configurations. RESULTS: Despite their brevity, the supervision workshops had many reported benefits for supervisors (e.g., improved satisfaction) through various perceived mechanisms pertaining to pedagogy (e.g., mixed pedagogies), workshops (e.g., optimal duration), and individuals (e.g., supervisor engagement). However, they also yielded negative reported outcomes (e.g., suboptimal knowledge gains) brought about by assorted perceived mechanisms related to pedagogy (e.g., suboptimal peer learning), workshops (e.g., content irrelevance), and individuals (e.g., suboptimal facilitator competence). Such mechanisms were thought to be triggered by diverse contexts including supervisors' levels of experience, sector, and workplace supervision cultures. CONCLUSIONS: While the findings partly support the realist synthesis of supervision training and previous realist evaluations of faculty development, this realist evaluation extends this literature considerably. Health care educators should employ mixed pedagogies (e.g., didactic teaching, peer learning), relevant content, optimal workshop duration, and competent/engaging facilitators. Educators also need to tailor workshops according to supervisors' contexts including the sectors and supervision cultures in which supervision is practiced, and supervisors' levels of experience (e.g., experienced supervisors appreciated workshop brevity).

The effectiveness of partnership models in clinical nursing education - A scoping review.

OBJECTIVES: To examine the effectiveness of partnership models in clinical nursing education with regards to cost effectiveness; student employability, work-readiness, confidence, and competence; and stakeholders' satisfaction. DESIGN: Scoping review. DATA SOURCES: Research studies published in English were searched electronically through EbscoHost (CINAHL and ERIC), Scopus, Medline (via Ovid), ProQuest Central, and Web of Science databases. Criteria were developed to guide the selection of original studies published in English before 2019 for review. REVIEW METHODS: Arksey and Malley's framework (2005) and relevant enhancements guided the conduct of the review. An informal appraisal of selected studies was applied. RESULTS: Two theses and 31 articles with a variation in methodologies, methods, sample sizes, research populations and quality of evidence were included for review. Four themes were identified: (i) Description of partnership models in clinical education, (ii) length of model implementation prior to evaluation, (iii) positive qualitative findings, and (iv) quantitative findings limited by data collection periods and methods. CONCLUSIONS: Shared among the reviewed studies is stakeholder view of the positive impacts of partnership models on the clinical learning environment, and the increased level of support and individualised instruction for students. However, the use of not fully validated survey instruments and the lack of description about the implementation period before evaluation in many reviewed studies limit the interpretation of quantifiable effect of the partnership models. This review identifies a lack of attention on student employability, work-readiness, cost evaluation, patient perspective, and partnership models in low-income countries. Future research to address these knowledge gaps using high quality data collection methods and rigorous research design is warranted.