Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

BACKGROUND: Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. OBJECTIVE: We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. METHODS: This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. RESULTS: The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner satisfaction surveys, were found to be the most common types of TEL evaluations evident in the literature. The studies reviewed had low scores across reporting on ethical matters, design, and data collection categories. CONCLUSIONS: There continues to be a need to develop effective and standard TEL evaluation tools, and good quality studies that describe effective evaluation of TEL education for health care professionals. Studies often fail to provide sufficient detail to support transferability or direct future TEL health care education programs.

The characteristics of effective technology-enabled dementia education: a systematic review and mixed research synthesis.

BACKGROUND: Dementia education is required to address gaps in dementia-specific knowledge among health and social care practitioners amidst increasing dementia prevalence. Harnessing technology for dementia education may remove obstacles to traditional education and empower large communities of learners. This systematic review aimed to establish the technological and pedagogical characteristics associated with effective technology-enabled dementia education for health and social care practitioners. METHODS: MEDLINE, PubMed, Web of Science, CINAHL, Scopus, PsycINFO, ERIC and OVID Nursing Database were searched from January 2005 until February 2020. Quantitative, qualitative and mixed methods studies were eligible for inclusion. Study quality was assessed with the Mixed Methods Appraisal Tool. Quantitative evidence was categorised based on Kirkpatrick's Model. Qualitative data was synthesised thematically and integrated with quantitative findings before conclusions were drawn. RESULTS: Twenty-one published papers were identified. Participants were acute, primary and long-term care practitioners, or were students in higher education. Most training was internet-based; CD-ROMs, simulations and tele-mentoring were also described. Technology-enabled dementia education was predominantly associated with positive effects on learning outcomes. Case-based instruction was the most frequently described instructional strategy and videos were common modes of information delivery. Qualitative themes emerged as existing strengths and experience; knowledge gaps and uncertainty; developing core competence and expertise; involving relevant others; and optimising feasibility. DISCUSSION: Technology-enabled dementia education is likely to improve dementia knowledge, skills and attitudes among health and social care practitioners from multiple practice contexts. Confidence in the results from quantitative studies was undermined by multiple confounding factors that may be difficult to control in the educational research context. Convenience and flexibility are key benefits of technology-enabled instructive and simulated pedagogy that can support the application of theory into practice. More research is required to understand the role of online learning networks and provisions for equitable engagement. A future emphasis on organisational and environmental factors may elucidate the role of technology in ameliorating obstacles to traditional dementia education. SYSTEMATIC REVIEW REGISTRATION: PROSPERO ( CRD42018115378 ).

Establishing the effectiveness of technology-enabled dementia education for health and social care practitioners: a systematic review.

BACKGROUND: Dementia prevalence is increasing globally and yet evidence suggest that gaps exist in dementia-specific knowledge among health and social care practitioners. Technological modes of educational delivery may be as effective as traditional education and can provide practitioners with increased accessibility to dementia training. Benefits of digitally based dementia education have been established including pedagogical strategies that influence dementia knowledge and care attitudes. This review aimed to appraise and synthesise contemporary experimental evidence that evaluated technology-enabled dementia education for health and social care practitioners. Outcomes based on Kirkpatrick's Model were learner satisfaction; knowledge, skills, and attitudes; behaviours; and results. METHODS: MEDLINE, CINAHL, and Web of Science were among 8 bibliographic databases searched from January 2005 until February 2020. Keywords included dementia and education (and terms for technological modes of education, learning, or training). We included experimental and quasi-experimental studies. Medical Education Research Study Quality Instrument established the overall quality of included studies and pragmatic application of Mixed Methods Appraisal Tool established individual study quality and highlighted methodological features of educational research. Narrative synthesis was conducted as heterogeneous outcome data precluded meta-analysis. RESULTS: We identified 21 relevant studies: 16 evaluated online dementia education and 5 evaluated computer-based approaches. Most studies used before-after designs and study quality was moderate overall. Most studies reported knowledge-based outcomes with statistically significant findings favouring the training interventions. Positive effects were also observed in studies measuring skills and attitudinal change. Fewer studies reported significant findings for behavioural change and results due to training. Case-based instruction was a frequently described instructional strategy in online dementia education and videos were common information delivery modes. CD-ROM training and simulation activities were described in computer-based dementia education. DISCUSSION: Future emphasis must be placed on teaching and learning methods within technology-enabled dementia education which should be role relevant and incorporate active and interactive learning strategies. Future evaluations will require contextually relevant research methodologies with capacity to address challenges presented by these complex educational programmes and multi-component characteristics. SYSTEMATIC REVIEW REGISTRATION: This systematic review is based on a protocol registered with PROSPERO ( CRD42018115378 ).

The characteristics of effective technology-enabled dementia education for health and social care practitioners: protocol for a mixed studies systematic review.

BACKGROUND: The global prevalence of people living with dementia is expected to increase exponentially and yet evidence suggests gaps in dementia-specific knowledge amongst practitioners. Evidence-based learning approaches can support educators and learners who are transitioning into new educational paradigms resulting from technological advances. Technology-enabled learning is increasingly being used in health care education and may be a feasible approach to dementia education. METHODS: This protocol aims to describe the methodological and analytical approaches for undertaking a systematic review of the current evidence based on technology-enabled approaches to dementia education for health and social care practitioners. The design and methodology were informed by guidelines from the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols. DISCUSSION: The evidence generated from a systematic review of the current evidence is intended to inform the design and implementation of technology-enabled dementia education programmes and to advance the current academic literature at a time of unprecedented demographic and technological transition. TRIAL REGISTRATION: PROSPERO, CRD42018115378.