Assessment of Clinical Information Quality in Digital Health Technologies: International eDelphi Study.

BACKGROUND: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs. OBJECTIVE: This study explored clinicians' perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework. METHODS: We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions. RESULTS: Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity. CONCLUSIONS: The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1136/bmjopen-2021-057430.

Effect of introducing interprofessional education concepts on students of various healthcare disciplines: a pre-post study in the United Arab Emirates.

BACKGROUND: The value of interprofessional education (IPE) in nurturing healthcare professionals, and in shaping their professional identities, and their attitudes towards interdisciplinary teamwork and collaboration is established in the literature. IPE is an emerging concept in the Middle East and North Africa (MENA) region and is new to the United Arab Emirates (UAE). To date, the applicability and feasibility of IPE and of the corresponding collaborative practice in MENA countries remain largely unexamined. PURPOSE: To investigate the effect of one of the first experiences of IPE in the UAE, which was purposefully designed in alignment with the principles of the Situated Learning Theory (SLT), on the readiness for interprofessional learning and collaboration among students of various healthcare disciplines in the UAE. METHODS: A pre-post intervention quantitative research design was adopted for this study. The intervention focused on communication skills, and consisted of 2 tailor-made case-based scenarios. A total of 90 students (40 medical, 16 nursing, 16 pharmacy, and 18 physiotherapy), spread across two sessions (1 session per academic year across 2 academic years), took part in the IPE intervention. Readiness for Interprofessional Learning Scale (RIPLS) was used as the pre- and post- intervention assessments; aggregate data was analyzed using SPSS. RESULTS: Of those who participated in the intervention (across both rounds), 77 participants responded to the pre-assessment (85. 6%) and 84 responded to the post-assessment (93. 3%). The IPE intervention under investigation significantly increased the level of readiness to engage in cross-disciplinary learning and collaboration among participating health professions' students. In terms of the subscales, the participants' openness to engage in teamwork was raised and their professional identity was fostered. Yet, no statistical significance around clarity of roles and responsibilities was detected. CONCLUSION: The findings of this study encourage other universities in the MENA region to adopt IPE to improve future health professionals' capacity to develop shared understanding and mutual respect within cross-disciplinary teams. This, ultimately, feeds into improved quality of care and patient outcomes.

Virtual Clinical Encounter Examination (VICEE): A novel approach for assessing medical students' non-psychomotor clinical competency.

INTRODUCTION: The Corona Virus Disease-19 (COVID-19) pandemic disrupted medical education across the world. Online teaching has grown rapidly under lockdown. Yet the online approach for assessment presents a number of challenges, particularly when evaluating clinical competencies. The aim of this study was to investigate the feasibility, acceptability, reliability and validity of an online Virtual Clinical Encounter Examination (VICEE) to assess non-psychomotor competencies (non-procedure or manual skills) of medical students. METHOD: Sixty-one final year medical students took the VICEE as part of the final summative examination. A panel of faculty experts developed the exam cases and competencies. They administered the test online via real-time interaction with artificial intelligence (AI) based virtual patients, along with faculty and IT support. RESULTS: Student and faculty surveys demonstrated satisfaction with the experience. Confirmatory factor analysis supported convergent validity of VICEE with Direct Observation Clinical Encounter Examination (DOCEE), a previously validated clinical examination. The observed sensitivity was 81.8%, specificity 64.1% and likelihood ratio 12.6, supporting the ability of VICEE to diagnose 'clinical incompetence' among students. CONCLUSION: Our results suggest that online AI-based virtual patient high fidelity simulation may be used as an alternative tool to assess some aspects of non-psychometric competencies.

Digital Education in Health Professions: The Need for Overarching Evidence Synthesis.

Synthesizing evidence from randomized controlled trials of digital health education poses some challenges. These include a lack of clear categorization of digital health education in the literature; constantly evolving concepts, pedagogies, or theories; and a multitude of methods, features, technologies, or delivery settings. The Digital Health Education Collaboration was established to evaluate the evidence on digital education in health professions; inform policymakers, educators, and students; and ultimately, change the way in which these professionals learn and are taught. The aim of this paper is to present the overarching methodology that we use to synthesize evidence across our digital health education reviews and to discuss challenges related to the process. For our research, we followed Cochrane recommendations for the conduct of systematic reviews; all reviews are reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidance. This included assembling experts in various digital health education fields; identifying gaps in the evidence base; formulating focused research questions, aims, and outcome measures; choosing appropriate search terms and databases; defining inclusion and exclusion criteria; running the searches jointly with librarians and information specialists; managing abstracts; retrieving full-text versions of papers; extracting and storing large datasets, critically appraising the quality of studies; analyzing data; discussing findings; drawing meaningful conclusions; and drafting research papers. The approach used for synthesizing evidence from digital health education trials is commonly regarded as the most rigorous benchmark for conducting systematic reviews. Although we acknowledge the presence of certain biases ingrained in the process, we have clearly highlighted and minimized those biases by strictly adhering to scientific rigor, methodological integrity, and standard operating procedures. This paper will be a valuable asset for researchers and methodologists undertaking systematic reviews in digital health education.

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration.

BACKGROUND: Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education. OBJECTIVE: The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction. METHODS: We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models. RESULTS: A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI -0.17 to 0.39, I2=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I2=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence. CONCLUSIONS: Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.

Serious Gaming and Gamification Education in Health Professions: Systematic Review.

BACKGROUND: There is a worldwide shortage of health workers, and this issue requires innovative education solutions. Serious gaming and gamification education have the potential to provide a quality, cost-effective, novel approach that is flexible, portable, and enjoyable and allow interaction with tutors and peers. OBJECTIVE: The aim of this systematic review was to evaluate the effectiveness of serious gaming/gamification for health professions education compared with traditional learning, other types of digital education, or other serious gaming/gamification interventions in terms of patient outcomes, knowledge, skills, professional attitudes, and satisfaction (primary outcomes) as well as economic outcomes of education and adverse events (secondary outcomes). METHODS: A comprehensive search of MEDLINE, EMBASE, Web of Knowledge, Educational Resources Information Centre, Cochrane Central Register of Controlled Trials, PsycINFO, and Cumulative Index to Nursing and Allied Health Literature was conducted from 1990 to August 2017. Randomized controlled trials (RCTs) and cluster RCTs were eligible for inclusion. Two reviewers independently searched, screened, and assessed the study quality and extracted data. A meta-analysis was not deemed appropriate due to the heterogeneity of populations, interventions, comparisons, and outcomes. Therefore, a narrative synthesis is presented. RESULTS: A total of 27 RCTs and 3 cluster RCTs with 3634 participants were included. Two studies evaluated gamification interventions, and the remaining evaluated serious gaming interventions. One study reported a small statistically significant difference between serious gaming and digital education of primary care physicians in the time to control blood pressure in a subgroup of their patients already taking antihypertensive medications. There was evidence of a moderate-to-large magnitude of effect from five studies evaluating individually delivered interventions for objectively measured knowledge compared with traditional learning. There was also evidence of a small-to-large magnitude of effect from 10 studies for improved skills compared with traditional learning. Two and four studies suggested equivalence between interventions and controls for knowledge and skills, respectively. Evidence suggested that serious gaming was at least as effective as other digital education modalities for these outcomes. There was insufficient evidence to conclude whether one type of serious gaming/gamification intervention is more effective than any other. There was limited evidence for the effects of serious gaming/gamification on professional attitudes. Serious gaming/gamification may improve satisfaction, but the evidence was limited. Evidence was of low or very low quality for all outcomes. Quality of evidence was downgraded due to the imprecision, inconsistency, and limitations of the study. CONCLUSIONS: Serious gaming/gamification appears to be at least as effective as controls, and in many studies, more effective for improving knowledge, skills, and satisfaction. However, the available evidence is mostly of low quality and calls for further rigorous, theory-driven research.

Online Digital Education for Postregistration Training of Medical Doctors: Systematic Review by the Digital Health Education Collaboration.

BACKGROUND: Globally, online and local area network-based (LAN) digital education (ODE) has grown in popularity. Blended learning is used by ODE along with traditional learning. Studies have shown the increasing potential of these technologies in training medical doctors; however, the evidence for its effectiveness and cost-effectiveness is unclear. OBJECTIVE: This systematic review evaluated the effectiveness of online and LAN-based ODE in improving practicing medical doctors' knowledge, skills, attitude, satisfaction (primary outcomes), practice or behavior change, patient outcomes, and cost-effectiveness (secondary outcomes). METHODS: We searched seven electronic databased for randomized controlled trials, cluster-randomized trials, and quasi-randomized trials from January 1990 to March 2017. Two review authors independently extracted data and assessed the risk of bias. We have presented the findings narratively. We mainly compared ODE with self-directed/face-to-face learning and blended learning with self-directed/face-to-face learning. RESULTS: A total of 93 studies (N=16,895) were included, of which 76 compared ODE (including blended) and self-directed/face-to-face learning. Overall, the effect of ODE (including blended) on postintervention knowledge, skills, attitude, satisfaction, practice or behavior change, and patient outcomes was inconsistent and ranged mostly from no difference between the groups to higher postintervention score in the intervention group (small to large effect size, very low to low quality evidence). Twenty-one studies reported higher knowledge scores (small to large effect size and very low quality) for the intervention, while 20 studies reported no difference in knowledge between the groups. Seven studies reported higher skill score in the intervention (large effect size and low quality), while 13 studies reported no difference in the skill scores between the groups. One study reported a higher attitude score for the intervention (very low quality), while four studies reported no difference in the attitude score between the groups. Four studies reported higher postintervention physician satisfaction with the intervention (large effect size and low quality), while six studies reported no difference in satisfaction between the groups. Eight studies reported higher postintervention practice or behavior change for the ODE group (small to moderate effect size and low quality), while five studies reported no difference in practice or behavior change between the groups. One study reported higher improvement in patient outcome, while three others reported no difference in patient outcome between the groups. None of the included studies reported any unintended/adverse effects or cost-effectiveness of the interventions. CONCLUSIONS: Empiric evidence showed that ODE and blended learning may be equivalent to self-directed/face-to-face learning for training practicing physicians. Few other studies demonstrated that ODE and blended learning may significantly improve learning outcomes compared to self-directed/face-to-face learning. The quality of the evidence in these studies was found to be very low for knowledge. Further high-quality randomized controlled trials are required to confirm these findings.

Virtual Reality for Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration.

BACKGROUND: Virtual reality (VR) is a technology that allows the user to explore and manipulate computer-generated real or artificial three-dimensional multimedia sensory environments in real time to gain practical knowledge that can be used in clinical practice. OBJECTIVE: The aim of this systematic review was to evaluate the effectiveness of VR for educating health professionals and improving their knowledge, cognitive skills, attitudes, and satisfaction. METHODS: We performed a systematic review of the effectiveness of VR in pre- and postregistration health professions education following the gold standard Cochrane methodology. We searched 7 databases from the year 1990 to August 2017. No language restrictions were applied. We included randomized controlled trials and cluster-randomized trials. We independently selected studies, extracted data, and assessed risk of bias, and then, we compared the information in pairs. We contacted authors of the studies for additional information if necessary. All pooled analyses were based on random-effects models. We used the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach to rate the quality of the body of evidence. RESULTS: A total of 31 studies (2407 participants) were included. Meta-analysis of 8 studies found that VR slightly improves postintervention knowledge scores when compared with traditional learning (standardized mean difference [SMD]=0.44; 95% CI 0.18-0.69; I2=49%; 603 participants; moderate certainty evidence) or other types of digital education such as online or offline digital education (SMD=0.43; 95% CI 0.07-0.79; I2=78%; 608 participants [8 studies]; low certainty evidence). Another meta-analysis of 4 studies found that VR improves health professionals' cognitive skills when compared with traditional learning (SMD=1.12; 95% CI 0.81-1.43; I2=0%; 235 participants; large effect size; moderate certainty evidence). Two studies compared the effect of VR with other forms of digital education on skills, favoring the VR group (SMD=0.5; 95% CI 0.32-0.69; I2=0%; 467 participants; moderate effect size; low certainty evidence). The findings for attitudes and satisfaction were mixed and inconclusive. None of the studies reported any patient-related outcomes, behavior change, as well as unintended or adverse effects of VR. Overall, the certainty of evidence according to the GRADE criteria ranged from low to moderate. We downgraded our certainty of evidence primarily because of the risk of bias and/or inconsistency. CONCLUSIONS: We found evidence suggesting that VR improves postintervention knowledge and skills outcomes of health professionals when compared with traditional education or other types of digital education such as online or offline digital education. The findings on other outcomes are limited. Future research should evaluate the effectiveness of immersive and interactive forms of VR and evaluate other outcomes such as attitude, satisfaction, cost-effectiveness, and clinical practice or behavior change.

Implementation of team-based learning on a large scale: Three factors to keep in mind.

Team-based learning (TBL) is a structured form of small group learning that can be scaled up for delivery in large classes. The principles of successful TBL implementation are well established. TBL has become widely practiced in medical schools, but its use is typically limited to certain courses or parts of courses. Implementing TBL on a large scale, across different courses and disciplines, is the next logical step. The Lee Kong Chian School of Medicine (LKCMedicine), a partnership between Nanyang Technological University, Singapore and Imperial College London, admitted its first students in 2013. This new undergraduate medical program, developed collaboratively by faculty at both institutions, uses TBL as its main learning and teaching strategy, replacing all face-to-face lectures. TBL accounts for over 60% of the curriculum in the first two years, and there is continued learning through TBL during campus teaching in the remaining years. This paper describes our experience of rolling out TBL across all years of the medical curriculum, focusing on three success factors: (1) "team-centric" learning spaces, to foster active, collaborative learning; (2) an e-learning ecosystem, seamlessly integrated to support all phases of the TBL process and (3) teaching teams in which experts in pedagogical process (TBL Facilitators) co-teach with experts in subject matter (Content Experts).

Quality of life and healthcare service utilization among methadone maintenance patients in a mountainous area of Northern Vietnam.

BACKGROUND: The expansion of methadone maintenance treatment in mountainous areas in still limited and little is known about its health impacts on drug users. This study aimed to examine health-related quality of life (HRQOL) and health care access among patients engaging in methadone maintenance treatment (MMT) in Tuyen Quang, a mountainous province in Vietnam. METHODS: We conducted a cross-sectional survey with 241 patients conveniently recruited in two MMT clinics (Son Duong and Tuyen Quang). EuroQol-5 Dimensions - 5 levels (EQ-5D-5 L) and Visual analogue scale (VAS) were employed to measure HRQOL. Multivariate logistic and tobit regressions were used to determine the factors associated with HRQOL and health care utilization. RESULTS: The overall mean score of the EQ-5D index and EQ-VAS were 0.88 (SD = 0.20) and 81.8% (SD = 15.27%), respectively. Only 8.7% utilized inpatient services, and 14.9% used outpatient services. Being more highly educated, suffering acute diseases, and using health service within the last 12 months were associated with a decreased EQ-5D index. Individuals who were multiple substance abusers and those who recently had inpatient care were more likely to have a lower VAS. Older respondents, those taking their medications at the more impoverished clinic, substance abusers, and individuals who were struggling with anxiety/depression or their usual daily activities were more likely to use both inpatient and outpatient care. CONCLUSIONS: In summary, we observed good HRQOL, but high prevalence of anxiety/depression and low rates of service utilization among MMT patients in Tuyen Quang province. To improve the outcomes of MMT services in mountainous areas, it is necessary to introduce personalized and integrative services models with counseling and interventions on multiple substance use.

Virtual Patients in a Behavioral Medicine Massive Open Online Course (MOOC): A Qualitative and Quantitative Analysis of Participants' Perceptions.

OBJECTIVE: The purpose of this article is to explore learners' perceptions of using virtual patients in a behavioral medicine Massive Open Online Course (MOOCs) and thereby describe innovative ways of disseminating knowledge in health-related areas. METHODS: A 5-week MOOC on behavioral medicine was hosted on the edX platform. The authors developed two branched virtual patients consisting of video recordings of a live standardized patient, with multiple clinical decision points and narration unfolding depending on learners' choices. Students interacted with the virtual patients to treat stress and sleep problems. Answers to the exit survey and participant comments from the discussion forum were analyzed qualitatively and quantitatively. RESULTS: In total, 19,236 participants enrolled in the MOOC, out of which 740 received the final certificate. The virtual patients were completed by 2317 and 1640 participants respectively. Among survey respondents (n = 442), 83.1% agreed that the virtual patient exercise was helpful. The qualitative analysis resulted in themes covering what it was like to work with the virtual patient, with subthemes on learner-centered education, emotions/eustress, game comparisons, what the participants learned, what surprised them, how confident participants felt about applying interventions in practice, suggestions for improvement, and previous experiences of virtual patients. CONCLUSIONS: Students were enthusiastic about interacting with the virtual patients as a means to apply new knowledge about behavioral medicine interventions. The most common suggestion was to incorporate more interactive cases with various levels of complexity. Further research should include patient outcomes and focus on interprofessional aspects of learning with virtual patients in a MOOC.

Applicability of the theory of planned behavior in explaining the general practitioners eLearning use in continuing medical education.

BACKGROUND: General practitioners (GP) update their knowledge and skills by participating in continuing medical education (CME) programs either in a traditional or an e-Learning format. GPs' beliefs about electronic format of CME have been studied but without an explicit theoretical framework which makes the findings difficult to interpret. In other health disciplines, researchers used theory of planned behavior (TPB) to predict user's behavior. METHODS: In this study, an instrument was developed to investigate GPs' intention to use e-Learning in CME based on TPB. The goodness of fit of TPB was measured using confirmatory factor analysis and the relationship between latent variables was assessed using structural equation modeling. RESULTS: A total of 148 GPs participated in the study. Most of the items in the questionnaire related well to the TPB theoretical constructs, and the model had good fitness. The perceived behavioral control and attitudinal constructs were included, and the subjective norms construct was excluded from the structural model. The developed questionnaire could explain 66 % of the GPs' intention variance. CONCLUSIONS: The TPB could be used as a model to construct instruments that investigate GPs' intention to participate in e-Learning programs in CME. The findings from the study will encourage CME managers and researchers to explore the developed instrument as a mean to explain and improve the GPs' intentions to use eLearning in CME.

Medical Student and Tutor Perceptions of Video Versus Text in an Interactive Online Virtual Patient for Problem-Based Learning: A Pilot Study.

BACKGROUND: The impact of the use of video resources in primarily paper-based problem-based learning (PBL) settings has been widely explored. Although it can provide many benefits, the use of video can also hamper the critical thinking of learners in contexts where learners are developing clinical reasoning. However, the use of video has not been explored in the context of interactive virtual patients for PBL. OBJECTIVE: A pilot study was conducted to explore how undergraduate medical students interpreted and evaluated information from video- and text-based materials presented in the context of a branched interactive online virtual patient designed for PBL. The goal was to inform the development and use of virtual patients for PBL and to inform future research in this area. METHODS: An existing virtual patient for PBL was adapted for use in video and provided as an intervention to students in the transition year of the undergraduate medicine course at St George's, University of London. Survey instruments were used to capture student and PBL tutor experiences and perceptions of the intervention, and a formative review meeting was run with PBL tutors. Descriptive statistics were generated for the structured responses and a thematic analysis was used to identify emergent themes in the unstructured responses. RESULTS: Analysis of student responses (n=119) and tutor comments (n=18) yielded 8 distinct themes relating to the perceived educational efficacy of information presented in video and text formats in a PBL context. Although some students found some characteristics of the videos beneficial, when asked to express a preference for video or text the majority of those that responded to the question (65%, 65/100) expressed a preference for text. Student responses indicated that the use of video slowed the pace of PBL and impeded students' ability to review and critically appraise the presented information. CONCLUSIONS: Our findings suggest that text was perceived to be a better source of information than video in virtual patients for PBL. More specifically, the use of video was perceived as beneficial for providing details, visual information, and context where text was unable to do so. However, learner acceptance of text was higher in the context of PBL, particularly when targeting clinical reasoning skills. This pilot study has provided the foundation for further research into the effectiveness of different virtual patient designs for PBL.

Virtual patients--what are we talking about? A framework to classify the meanings of the term in healthcare education.

BACKGROUND: The term "virtual patients" (VPs) has been used for many years in academic publications, but its meaning varies, leading to confusion. Our aim was to investigate and categorize the use of the term "virtual patient" and then classify its use in healthcare education. METHODS: A literature review was conducted to determine all articles using the term "virtual patient" in the title or abstract. These articles were categorized into: Education, Clinical Procedures, Clinical Research and E-Health. All educational articles were further classified based on a framework published by Talbot et al. which was further developed using a deductive content analysis approach. RESULTS: 536 articles published between 1991 and December 2013 were included in the study. From these, 330 were categorized as educational. Classifying these showed that 37% articles used VPs in the form of Interactive Patient Scenarios. VPs in form of High Fidelity Software Simulations (19%) and Virtual Standardized Patients (16%) were also frequent. Less frequent were other forms, such as VP Games. Analyzing the literature across time shows an overall trend towards the use of Interactive Patient Scenarios as the predominant form of VPs in healthcare education. CONCLUSIONS: The main form of educational VPs in the literature are Interactive Patient Scenarios despite rapid technical advances that would support more complex applications. The adapted classification provides a valuable model for VP developers and researchers in healthcare education to more clearly communicate the type of VP they are addressing avoiding misunderstandings.

Web-based virtual patients in nursing education: development and validation of theory-anchored design and activity models.

BACKGROUND: Research has shown that nursing students find it difficult to translate and apply their theoretical knowledge in a clinical context. Virtual patients (VPs) have been proposed as a learning activity that can support nursing students in their learning of scientific knowledge and help them integrate theory and practice. Although VPs are increasingly used in health care education, they still lack a systematic consistency that would allow their reuse outside of their original context. There is therefore a need to develop a model for the development and implementation of VPs in nursing education. OBJECTIVE: The aim of this study was to develop and evaluate a virtual patient model optimized to the learning and assessment needs in nursing education. METHODS: The process of modeling started by reviewing theoretical frameworks reported in the literature and used by practitioners when designing learning and assessment activities. The Outcome-Present State Test (OPT) model was chosen as the theoretical framework. The model was then, in an iterative manner, developed and optimized to the affordances of virtual patients. Content validation was performed with faculty both in terms of the relevance of the chosen theories but also its applicability in nursing education. The virtual patient nursing model was then instantiated in two VPs. The students' perceived usefulness of the VPs was investigated using a questionnaire. The result was analyzed using descriptive statistics. RESULTS: A virtual patient Nursing Design Model (vpNDM) composed of three layers was developed. Layer 1 contains the patient story and ways of interacting with the data, Layer 2 includes aspects of the iterative process of clinical reasoning, and finally Layer 3 includes measurable outcomes. A virtual patient Nursing Activity Model (vpNAM) was also developed as a guide when creating VP-centric learning activities. The students perceived the global linear VPs as a relevant learning activity for the integration of theory and practice. CONCLUSIONS: Virtual patients that are adapted to the nursing paradigm can support nursing students' development of clinical reasoning skills. The proposed virtual patient nursing design and activity models will allow the systematic development of different types of virtual patients from a common model and thereby create opportunities for sharing pedagogical designs across technical solutions.

Virtual patients in primary care: developing a reusable model that fosters reflective practice and clinical reasoning.

BACKGROUND: Primary care is an integral part of the medical curriculum at Karolinska Institutet, Sweden. It is present at every stage of the students' education. Virtual patients (VPs) may support learning processes and be a valuable complement in teaching communication skills, patient-centeredness, clinical reasoning, and reflective thinking. Current literature on virtual patients lacks reports on how to design and use virtual patients with a primary care perspective. OBJECTIVE: The objective of this study was to create a model for a virtual patient in primary care that facilitates medical students' reflective practice and clinical reasoning. The main research question was how to design a virtual patient model with embedded process skills suitable for primary care education. METHODS: The VP model was developed using the Open Tufts University Sciences Knowledgebase (OpenTUSK) virtual patient system as a prototyping tool. Both the VP model and the case created using the developed model were validated by a group of 10 experienced primary care physicians and then further improved by a work group of faculty involved in the medical program. The students' opinions on the VP were investigated through focus group interviews with 14 students and the results analyzed using content analysis. RESULTS: The VP primary care model was based on a patient-centered model of consultation modified according to the Calgary-Cambridge Guides, and the learning outcomes of the study program in medicine were taken into account. The VP primary care model is based on Kolb's learning theories and consists of several learning cycles. Each learning cycle includes a didactic inventory and then provides the student with a concrete experience (video, pictures, and other material) and preformulated feedback. The students' learning process was visualized by requiring the students to expose their clinical reasoning and reflections in-action in every learning cycle. Content analysis of the focus group interviews showed good acceptance of the model by students. The VP was regarded as an intermediate learning activity and a complement to both the theoretical and the clinical part of the education, filling out gaps in clinical knowledge. The content of the VP case was regarded as authentic and the students appreciated the immediate feedback. The students found the structure of the model interactive and easy to follow. The students also reported that the VP case supported their self-directed learning and reflective ability. CONCLUSIONS: We have built a new VP model for primary care with embedded communication training and iterated learning cycles that in pilot testing showed good acceptance by students, supporting their self-directed learning and reflective thinking.

A framework for different levels of integration of computational models into web-based virtual patients.

BACKGROUND: Virtual patients are increasingly common tools used in health care education to foster learning of clinical reasoning skills. One potential way to expand their functionality is to augment virtual patients' interactivity by enriching them with computational models of physiological and pathological processes. OBJECTIVE: The primary goal of this paper was to propose a conceptual framework for the integration of computational models within virtual patients, with particular focus on (1) characteristics to be addressed while preparing the integration, (2) the extent of the integration, (3) strategies to achieve integration, and (4) methods for evaluating the feasibility of integration. An additional goal was to pilot the first investigation of changing framework variables on altering perceptions of integration. METHODS: The framework was constructed using an iterative process informed by Soft System Methodology. The Virtual Physiological Human (VPH) initiative has been used as a source of new computational models. The technical challenges associated with development of virtual patients enhanced by computational models are discussed from the perspectives of a number of different stakeholders. Concrete design and evaluation steps are discussed in the context of an exemplar virtual patient employing the results of the VPH ARCH project, as well as improvements for future iterations. RESULTS: The proposed framework consists of four main elements. The first element is a list of feasibility features characterizing the integration process from three perspectives: the computational modelling researcher, the health care educationalist, and the virtual patient system developer. The second element included three integration levels: basic, where a single set of simulation outcomes is generated for specific nodes in the activity graph; intermediate, involving pre-generation of simulation datasets over a range of input parameters; advanced, including dynamic solution of the model. The third element is the description of four integration strategies, and the last element consisted of evaluation profiles specifying the relevant feasibility features and acceptance thresholds for specific purposes. The group of experts who evaluated the virtual patient exemplar found higher integration more interesting, but at the same time they were more concerned with the validity of the result. The observed differences were not statistically significant. CONCLUSIONS: This paper outlines a framework for the integration of computational models into virtual patients. The opportunities and challenges of model exploitation are discussed from a number of user perspectives, considering different levels of model integration. The long-term aim for future research is to isolate the most crucial factors in the framework and to determine their influence on the integration outcome.

A Web-Based Public Health Intervention for Addressing Vaccine Misinformation: Analysis of Learner Engagement and Shift in Hesitancy to Vaccinate.

Web-based public health interventions can be a useful tool for disseminating evidence-based information to the public. However, completion rates are traditionally low, and misinformation often travels at a faster pace than evidence-based sources. This study describes the design of a web-based public health intervention to address COVID-19 vaccine hesitancy. A quasi-experimental approach was used in which a validated instrument, the Adult Vaccine Hesitancy Survey, was given to learners both pre and post intervention to observe any change in attitude towards vaccination. Our pilot observed a small positive shift in vaccine hesitancy and experienced higher than average completion rates. By integrating motivational learning design into public health interventions we increase the likelihood that learners finish the entire intervention, creating greater chance for positive behavior change.

Democratizing the Development of Chatbots to Improve Public Health: Feasibility Study of COVID-19 Misinformation.

BACKGROUND: Chatbots enable users to have humanlike conversations on various topics and can vary widely in complexity and functionality. An area of research priority in chatbots is democratizing chatbots to all, removing barriers to entry, such as financial ones, to help make chatbots a possibility for the wider global population to improve access to information, help reduce the digital divide between nations, and improve areas of public good (eg, health communication). Chatbots in this space may help create the potential for improved health outcomes, potentially alleviating some of the burdens on health care providers and systems to be the sole voices of outreach to public health. OBJECTIVE: This study explored the feasibility of developing a chatbot using approaches that are accessible in low- and middle-resource settings, such as using technology that is low cost, can be developed by nonprogrammers, and can be deployed over social media platforms to reach the broadest-possible audience without the need for a specialized technical team. METHODS: This study is presented in 2 parts. First, we detailed the design and development of a chatbot, VWise, including the resources used and development considerations for the conversational model. Next, we conducted a case study of 33 participants who engaged in a pilot with our chatbot. We explored the following 3 research questions: (1) Is it feasible to develop and implement a chatbot addressing a public health issue with only minimal resources? (2) What is the participants' experience with using the chatbot? (3) What kinds of measures of engagement are observed from using the chatbot? RESULTS: A high level of engagement with the chatbot was demonstrated by the large number of participants who stayed with the conversation to its natural end (n=17, 52%), requested to see the free online resource, selected to view all information about a given concern, and returned to have a dialogue about a second concern (n=12, 36%). CONCLUSIONS: This study explored the feasibility of and the design and development considerations for a chatbot, VWise. Our early findings from this initial pilot suggest that developing a functioning and low-cost chatbot is feasible, even in low-resource environments. Our results show that low-resource environments can enter the health communication chatbot space using readily available human and technical resources. However, despite these early indicators, many limitations exist in this study and further work with a larger sample size and greater diversity of participants is needed. This study represents early work on a chatbot in its virtual infancy. We hope this study will help provide those who feel chatbot access may be out of reach with a useful guide to enter this space, enabling more democratized access to chatbots for all.

Identification of Key Factors for Optimized Health Care Services: Protocol for a Multiphase Study of the Dubai Vaccination Campaign.

BACKGROUND: Mass vaccination of the global population against the novel COVID-19 outbreak posed multiple challenges, including effectively administering millions of doses in a short period of time while ensuring public safety and accessibility. The government of Dubai launched a mass campaign in December 2020 to vaccinate all its citizens and residents, targeting the population aged >18 years against COVID-19. The vaccination campaign involved a transformation of multiple commercial spaces into mass vaccination centers across the city of Dubai, the largest of which was the Dubai One Central (DOC) vaccination center. It was operational between January 17, 2021, and 27 January 27, 2022. OBJECTIVE: The multiphase research study aims to empirically explore the opinions of multiple health care stakeholders, elicit the key success factors that can influence the effective delivery of emergency health care services such as a COVID-19 mass vaccination center, and explore how these factors relate to one another. METHODS: To understand more about the operations of the DOC vaccination center, the study follows a multiphase design divided into 2 phases. The study is being conducted by the Institute for Excellence in Health Professions Education at Mohammed Bin Rashid University of Medicine and Health Sciences between December 2021 and January 2023. To elicit the key success factors that contributed to the vaccination campaign administered at DOC, the research team conducted 30 semistructured interviews (SSIs) with a sample of staff and volunteers who worked at the DOC vaccination center. Stratified random sampling was used to select the participants, and the interview cohort included representatives from the management team, team leaders, the administration and registration team, vaccinators, and volunteers. A total of 103 people were invited to take part in the research study, and 30 agreed to participate in the SSIs. To validate the participation of various stakeholders, phase 2 will analytically investigate one's subjectivity through Q-methodology and empirically investigate the opinions obtained from the research participants during phase 1. RESULTS: As of July 2022, 30 SSIs were conducted with the research participants. CONCLUSIONS: The study will provide a comprehensive 2-phase approach to obtaining the key success factors that can influence the delivery of high-quality health care services such as emergency services launched during a global pandemic. The study's findings will be translated into key factors that could support designing future health care services utilizing evidence-based practice. In line with future plans, a study will use data, collected through the DOC vaccination center, to develop a simulation model outlining the process of the customer journey and center workflow. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/42278.