Learning technology in health professions education: Realising an (un)imagined future.

CONTEXT: Technology is being introduced, used and studied in almost all areas of health professions education (HPE), often with a claim of making HPE better in one way or another. However, it remains unclear if technology has driven real change in HPE. In this article, we seek to develop an understanding of the transformative capacity of learning technology in HPE. METHODS AND OUTCOMES: We first consider the wider scholarship highlighting the intersection between technology and pedagogy, articulating what is meant by transformation and the role of learning technology in driving educational transformation. We then undertake a synthesis of the current high visibility HPE-focused research. We sampled the literature in two ways-for the five highest impact factor health professional education journals over the past decade and for all PubMed indexed journals for the last 3 years-and categorised the extant research against the Substitution, Augmentation, Modification, Redefinition model. We found that the majority of research we sampled focussed on substituting or augmenting learning through technology, with relatively few studies using technology to modify or redefine what HPE is through the use of technology. Of more concern was the lack of theoretical justification for pedagogical improvement, including transformation, underpinning the majority of studies. CONCLUSIONS: While all kinds of technology use in learning have their place, the next step for HPE is the robust use of technology aiming to lead transformation. This should be guided by transformational educational theory and aligned with pedagogical context. We challenge HPE practitioners and scholars to work thoughtfully and with intent to enable transformation in education for future health professionals.

Can storytelling of women's lived experience enhance empathy in medical students? A pilot intervention study.

PURPOSE: This pilot study aimed to investigate the acceptability and efficacy of a patient storytelling intervention (live and recorded) on empathy levels of medical students. MATERIALS AND METHODS: Medical students participated in a storytelling intervention that had three components: listening to live or recorded stories from women with abnormal uterine bleeding, reflective writing, and a debriefing session. Empathy scores of students pre- and post-intervention were measured using the Jefferson Scale of Empathy-student version (JSE-S). Students also completed a feedback survey. Descriptive and inferential statistics were used to analyse quantitative data and content analysis was used for text comments. RESULTS: Both live and recorded storytelling interventions had positive effects on student's empathy scores post intervention. Overall, students were satisfied with the intervention and reported that it improved their understanding of life experiences of women. Suggestions were made for an in-person storytelling session and interactive discussion after listening to each story. CONCLUSION: A storytelling intervention has the potential to improve medical students' empathy and understanding of lived experience of women with health conditions. This could be valuable when student-patient interactions are limited in healthcare settings, or to enable stories of small numbers of patient volunteers to reach students.

Validating a measure of motivational climate in health science courses.

PURPOSE: The aim of the study was to examine the validity evidence for the 19-item form of the MUSIC Model of Academic Motivation Inventory (College Student version) within health science schools in three different countries. The MUSIC Inventory includes five scales that assess the motivational climate by measuring students' perceptions related to five separate constructs: empowerment, usefulness, success, interest, and caring. BACKGROUND: The 26-item form of the MUSIC Inventory has been validated for use with undergraduate students and with students in professional schools, including students at a veterinary medicine school, a pharmacy school, and a medical school. A 19-item form of the MUSIC Inventory has also been validated for use with undergraduate students, but it has not yet been validated for use with medical school students. The purpose of this study was to provide validity evidence for the use of the 19-item form in heath science schools in three different countries to determine if this version is acceptable for use in different cultures. If validated, this shorter form of the MUSIC Inventory would provide more differentiation between the Interest and Usefulness scales and could reduce respondent fatigue. METHODOLOGY: Cook et al's [1] practical guidelines were followed to implement Kane's [2] validity framework as a means to examine the evidence of validity through scoring inferences, generalization inferences, and extrapolation inferences. Students (n = 667) in health science schools within three countries were surveyed. RESULTS: The results produced evidence to support all five hypotheses related to scoring, generalization, and extrapolation inferences. CONCLUSIONS: Scores from the 19-item form of the MUSIC Inventory are valid for use in health science courses within professional schools in different countries. Therefore, the MUSIC Inventory can be used in these schools to assess students' perceptions of the motivational climate.

Work-place cancer and palliative care interprofessional education: experiences of students and staff.

Workplace-based interprofessional education (IPE) offers opportunities for pre-registration students to interact with patients in authentic settings. Senior dietetic, medical, nursing, physiotherapy and radiation therapy students took part in a workplace IPE initiative on cancer and palliative care informed by experiential learning theory and run by clinical tutors. Research was undertaken to gauge students and tutors' experiences of the initiative. The mixed methods approach included: Pre and post-administration of the University of West England Interprofessional questionnaire 'Communication and Teamwork Scale, 'Interprofessional Learning Scale,' 'Interprofessional Interaction Scale.' Two questions were added relating to cancer and palliative care. Separate focus group interviews were held with students and tutors. There was a positive shift in the Communication and Teamwork scale based on students' pre and post questionnaires, but no change in the other two scales. Analysis of student and tutor focus group data showed that both affirmed the IPE initiative for a range of reasons. A brief experiential, theory-informed IPE initiative with a focus on cancer and palliative care was well received by both students and clinical tutors. The mixed method approach highlighted some discrepancies between quantitative and qualitative results but when synthesized were explicable, demonstrating the value of using a mixed methods approach to research.

Investigating New Zealand radiation therapy student perceptions about their degree curriculum.

BACKGROUND: Radiation Therapists (RTs) are a key professional grouping in the delivery of health services for cancer patients. The education of RTs in New Zealand has evolved in response to regulatory and clinical workforce requirements. To date, it has lacked a fundamental underpinning of educational theory. Stakeholders, including students, were canvassed for their perspectives on the drivers behind the current curriculum with a view to developing theory which could shape future curricular development. METHODS: A focus group was conducted with eight student RTs enrolled at the time of the study. A process driven by Constructivist Grounded Theory principles was adopted for the analysis of the resulting data. RESULTS: Four themes were established to represent the data: "Being" is prized over "doing", Change is inevitable, A framework for Professional Identity formation and Modelling is key to learning. CONCLUSIONS: There is utility in exploring the student perspective around curriculum. The data suggest that students on this programme are engaged with the process of preparing for practice and the connected learning experiences. There is a focus on the patient and the personal values and qualities which result from that focus. While specialist knowledge and technical skills are required for delivering patient care, it is fully expected those aspects of the clinical role will significantly change over time. Even at this early stage in their careers, students recognise the development and need for professional identity formation. Role models are perceived to be a vital part of student learning, be they positive or negative. Scrutiny of the study findings provides reason to question some assumptions which are sometimes made about student practitioners based on factors such as age and gender and the assumed universal ability of practitioners to teach the next generation. The perspectives gained inform the next stage of data collection from this group and theory building that will be reported outside the confines of this article.

MUSIC® for Medical Students: Confirming the Reliability and Validity of a Multi-Factorial Measure of Academic Motivation for Medical Education.

Construct: The MUSIC® Inventory measures the construct of academic motivation across five factors: empowerment, usefulness, success, interest, and caring. The factors are defined in terms of the degree the student perceives that they have control over their environment, that the coursework is useful to their future, that they can succeed in the course, that the course and instructional methods are interesting, and that the teacher cares about their wellbeing and their success respectively. Background: A valid measure of medical students' academic motivation would provide medical teachers with a method for evaluating the motivational aspect of their course and provide focus for changes in teaching and learning to improve medical student engagement. While the MUSIC® Inventory structure has been validated in the tertiary setting and with several professional programs, it has not been validated with medical students. The aim of this study was to use both classical test theory and Rasch modeling to assess the reliability and confirm the structure of the five-factor model of the MUSIC® Inventory with medical students. Approach: One-hundred-fifty-two medical students completed the 26-item inventory. Descriptive statistics, internal consistency, correlations between factors, confirmatory factor analysis, and Rasch analysis using the rating scale model were performed to determine reliability and validity. Findings: The five factors showed good internal consistency (Cronbach's alpha .87 - .92). Correlations between factors were moderate to high (r = .38 - .89). Confirmatory factor analysis highlighted inconsistencies in factor loadings of three of the items hypothesized to measure interest. Rasch analysis using the rating scale model showed that all items for each factor had good item fit (0.65 - 1.37). Person separation (2.28 - 2.85) and reliability (.84 -.91) scores indicated that the scales were able to differentiate different levels of respondents. Item separation (2.25 - 6.97) and reliability scores (.83 -.98) indicated that the items of the scales were being differentiated by the respondents. Conclusions: Rasch analysis indicates that the five factors of academic motivation measured by the MUSIC® Inventory account for the response patterns in data from medical students. However, while the factors of empowerment, usefulness, success, and caring showed expected reliability and validity using classical analysis, three of the interest items cross-loaded on to the usefulness factor. Possible reasons may include ambiguity of language for the items or medical students' conception of usefulness and interest. Future research will explore medical students' understanding of the language used to measure these factors in further detail.

Rapid Design of a Student-Centred App for Musculoskeletal Clinical Skills: An Example of a Theoretically Informed Approach to Developing Apps for Learning.

Background and need for innovation: The process to design mobile apps for learning are infrequently reported and focus more on evaluation than process. This lack of clear process for health professional education mobile apps may explain the lack of quality mobile apps to support medical student learning. Goal of innovation: The goal of this project was to develop a student informed ready for production wireframe model of a minimally viable mobile app to support learning of musculoskeletal (MSK) clinical skills. Steps taken for development and implementation of innovation: The Information Systems Research (ISR) framework and Design Thinking were combined for the mobile app design. The process followed the cycles and modes of the combined framework to; systematically review available apps, use a focus group to identify attributes of the app valued by students, define the initial plan for the mobile app, develop an app prototype, and test and refine it with students. Outcomes of innovation: The student focus group data had five themes: 1) interactive usability, 2) environment, 3) clear and concise layout, 4) anatomy and pathology, 5) cultural safety and 'red flags'. The prototyping of the app went through three cycles of student review and improvement to produce a final design ready for app development. Critical reflection on our process: We used a student-centred approach guided by design frameworks to design a minimally viable product mobile app to support learning of MSK clinical skills in ten weeks with a small team. The framework supported nonlinear, iterative, rapid prototyping. Student data converged and diverged with the MSK teaching methods literature. Of note our students requested cultural safety learning in the app design, suggesting mobile apps could support cultural safety learning.

Using the MUSIC Inventory to Evaluate Pathology Courses: an Exploratory Study.

Background: The MUSIC Inventory evaluates student's academic motivation across five constructs. We aimed to examine its use in undergraduate medical pathology courses. Activity: Students from three pathology courses completed questions for three factors of the MUSIC Inventory plus one open-ended question. We conducted an exploratory analysis of the survey data. Results: Results showed that the open-ended responses corresponded to differences in ratings on the MUSIC Inventory. Discussion: Combining an open-ended question with the MUSIC Inventory identified differences in student motivation plus aspects of each course that could be improved. The MUSIC Inventory is an appropriate evaluation method for pathology teaching.

Student video production within health professions education: A scoping review.

BACKGROUND: Recent technological developments have influenced a shift in the use of videos in Health Professions Education (HPE). Rather than casting students in the role of observers of videos, educators have been asking students to produce videos as a learning activity. The assumption is that video production is often an active and collaborative exercise, therefore could engage students and enhance learning. However, applications of this emerging pedagogical approach vary, and there has not been a knowledge synthesis to guide future research and practice. METHODS: With a view to mapping existing knowledge, identifying avenues for further research, and informing practice, we conducted a scoping review to establish current understanding of video production in HPE. We undertook a literature search of seven databases and identified thirty-six studies. RESULTS: The findings showed considerable variation in purposes and implementation approaches, consequences and challenges associated with video production. In particular, the assumption that creating a video automatically promotes student engagement was not well supported, especially when the intended learning was not made apparent to students. CONCLUSION: Overall, the review suggests that despite the increasing adoption of video production in HPE, the purposes are often unclear; pedagogical considerations underlying project design are limited, which risks undermining the intended learning. To optimise educational benefits, future video production projects should be explicit in their intention and approach, draw upon pedagogical theories, anticipate and address implementation issues, and be robust in their formative and summative assessment processes. Future research should more explicitly show the relationship between the intended learning and the underlying pedagogy and thoroughly evaluate the effectiveness and feasibility of video production projects.

Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales.

BACKGROUND: Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning. OBJECTIVE: This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures-the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning-to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning. METHODS: Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL. RESULTS: The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; P<.001 and MARuL ICC [two-way]=0.68; P<.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality. CONCLUSIONS: This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps-Geeky Medics-OSCE revision and OSCE PASS: Medical Revision-rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL's incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS's more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning.

Student use of common online resources in a multi-campus medical school.

This article was migrated. The article was marked as recommended. Background: Multi-campus medical schools can differ in medical curriculum delivery due to location specific factors, creating different learning contexts. Common online learning may reduce perceived inequities. Using a shared curriculum structure, we developed two learning resource components (topic-based learning objects and multiple-choice question banks) in Obstetrics and Gynaecology for students in our 3-campus medical school. Objective: We evaluated common learning resource use across different learning contexts. We hypothesised that students with fewer structured learning hours would make greater use of topic-based learning resources due to their perceived utility value. We also explored an alternative hypothesis; that resources more closely linked to assessment (MCQ banks) would encourage a strategic approach to learning and would be used most highly at all campuses. Methods: We assessed student opinion of the value of the resources through a cross-campus online survey, and quantified usage of the resources by analysing learning management system logs. Comparisons of response and usage patterns for the two resource components were conducted to identify if context influenced usage. Results: Survey results (RR = 70%) showed that students across campuses rated the resources as valuable. Usage logs partially supported our hypothesis that learning object usage would be highest at the campus (Campus 3) with the lowest structured learning hours in both the proportion of users (p <0.006) and frequency of access for 16 of the 26 topics (p<0.05). However, the reverse was found to be true for the question bank, with lowest usage of question banks at Campus 3 (p< 0.001). Conclusions: We interpret the results as evidence of difference in the perceived utility value of the learning resources across campuses. Clear differences in usage patterns provide evidence that different learning contexts can influence online resource use, and these contexts should be considered when evaluating the effectiveness of online learning resources.

A Tool for Rating the Value of Health Education Mobile Apps to Enhance Student Learning (MARuL): Development and Usability Study.

BACKGROUND: To realize the potential for mobile learning in clinical skills acquisition, medical students and their teachers should be able to evaluate the value of an app to support student learning of clinical skills. To our knowledge, there is currently no rubric for evaluation of quality or value that is specific for apps to support medical student learning. Such a rubric might assist students to be more confident in using apps to support their learning. OBJECTIVE: The objective of this study was to develop an instrument that can be used by health professional educators to rate the value of a mobile app to support health professional student learning. METHODS: Using the literature, we developed a list of potential criteria for the evaluation of educational app value, which were then refined with a student group using a modified nominal group technique. The refined list was organized into themes, and the initial rubric, Mobile App Rubric for Learning (MARuL, version 1), was developed. iOS and Android app stores were searched for clinical skills apps that met our inclusion criteria. After the 2 reviewers were trained and the item descriptions were refined (version 2), a random sample of 10 included apps, 5 for each mobile operating system, was reviewed. Interitem and interrater analyses and discussions with the reviewers resulted in refinement of MARuL to version 3. The reviewers completed a review of 41 clinical skills mobile apps, and a second round of interitem and interrater reliability testing was performed, leading to version 4 of the MARuL. RESULTS: Students identified 28 items (from an initial set of 144 possible items) during the nominal group phase, and these were then grouped into 4 themes: teaching and learning, user centered, professional, and usability. Testing and refinement with reviewers reduced the list to 26 items. Internal consistency for MARuL was excellent (α=.96), and the interrater reliability as measured by the intraclass correlation coefficient (ICC) was good (ICC=0.66). CONCLUSIONS: MARuL offers a fast and user-friendly method for teachers to select valuable apps to enhance student learning.