ABSTRACT
BACKGROUND: Access to valid and reliable instruments is essential in the field of implementation science, where the measurement of factors associated with healthcare professionals' uptake of EBP is central. The Norwegian version of the Evidence-based practice profile questionnaire (EBP2-N) measures EBP constructs, such as EBP knowledge, confidence, attitudes, and behavior. Despite its potential utility, the EBP2-N requires further validation before being used in a cross-sectional survey targeting different healthcare professionals in Norwegian primary healthcare. This study assessed the content validity, construct validity, and internal consistency of the EBP2-N among Norwegian primary healthcare professionals. METHODS: To evaluate the content validity of the EBP2-N, we conducted qualitative individual interviews with eight healthcare professionals in primary healthcare from different disciplines. Qualitative data was analyzed using the "text summary" model, followed by panel group discussions, minor linguistic changes, and a pilot test of the revised version. To evaluate construct validity (structural validity) and internal consistency, we used data from a web-based cross-sectional survey among nurses, assistant nurses, physical therapists, occupational therapists, medical doctors, and other professionals (n = 313). Structural validity was tested using a confirmatory factor analysis (CFA) on the original five-factor structure, and Cronbach's alpha was calculated to assess internal consistency. RESULTS: The qualitative interviews with primary healthcare professionals indicated that the content of the EBP2-N was perceived to reflect the constructs intended to be measured by the instrument. However, interviews revealed concerns regarding the formulation of some items, leading to minor linguistic revisions. In addition, several participants expressed that some of the most specific research terms in the terminology domain felt less relevant to them in clinical practice. CFA results exposed partial alignment with the original five-factor model, with the following model fit indices: CFI = 0.749, RMSEA = 0.074, and SRMR = 0.075. Cronbach's alphas ranged between 0.82 and 0.95 for all domains except for the Sympathy domain (0.69), indicating good internal consistency in four out of five domains. CONCLUSION: The EBP2-N is a suitable instrument for measuring Norwegian primary healthcare professionals' EBP knowledge, attitudes, confidence, and behavior. Although EBP2-N seems to be an adequate instrument in its current form, we recommend that future research focuses on further assessing the factor structure, evaluating the relevance of the items, and the number of items needed. REGISTRATION: Retrospectively registered (prior to data analysis) in OSF Preregistration. Registration DOI: https://doi.org/10.17605/OSF.IO/428RP .
Subject(s)
Evidence-Based Practice , Primary Health Care , Psychometrics , Humans , Norway , Primary Health Care/standards , Surveys and Questionnaires/standards , Cross-Sectional Studies , Female , Reproducibility of Results , Male , Adult , Attitude of Health Personnel , Middle Aged , Health Personnel , Qualitative Research , Health Knowledge, Attitudes, PracticeABSTRACT
BACKGROUND: Evidence-based practice (EBP) is an important aspect of the health care education curriculum. EBP involves following the 5 EBP steps: ask, assess, appraise, apply, and audit. These 5 steps reflect the suggested core competencies covered in teaching and learning programs to support future health care professionals applying EBP. When implementing EBP teaching, assessing outcomes by documenting the student's performance and skills is relevant. This can be done using mobile devices. OBJECTIVE: The aim of this study was to assess occupational therapy students' EBP skills as reported in a mobile app. METHODS: We applied a cross-sectional design. Descriptive statistics were used to present frequencies, percentages, means, and ranges of data regarding EBP skills found in the EBPsteps app. Associations between students' ability to formulate the Population, Intervention, Comparison, and Outcome/Population, Interest, and Context (PICO/PICo) elements and identifying relevant research evidence were analyzed with the chi-square test. RESULTS: Of 4 cohorts with 150 students, 119 (79.3%) students used the app and produced 240 critically appraised topics (CATs) in the app. The EBP steps "ask," "assess," and "appraise" were often correctly performed. The clinical question was formulated correctly in 53.3% (128/240) of the CATs, and students identified research evidence in 81.2% (195/240) of the CATs. Critical appraisal checklists were used in 81.2% (195/240) of the CATs, and most of these checklists were assessed as relevant for the type of research evidence identified (165/195, 84.6%). The least frequently correctly reported steps were "apply" and "audit." In 39.6% (95/240) of the CATs, it was reported that research evidence was applied. Only 61% (58/95) of these CATs described how the research was applied to clinical practice. Evaluation of practice changes was reported in 38.8% (93/240) of the CATs. However, details about practice changes were lacking in all these CATs. A positive association was found between correctly reporting the "population" and "interventions/interest" elements of the PICO/PICo and identifying research evidence (P<.001). CONCLUSIONS: We assessed the students' EBP skills based on how they documented following the EBP steps in the EBPsteps app, and our results showed variations in how well the students mastered the steps. "Apply" and "audit" were the most difficult EBP steps for the students to perform, and this finding has implications and gives directions for further development of the app and educational instruction in EBP. The EBPsteps app is a new and relevant app for students to learn and practice EBP, and it can be used to assess students' EBP skills objectively.
Subject(s)
Mobile Applications , Occupational Therapy , Humans , Cross-Sectional Studies , Students , Evidence-Based PracticeABSTRACT
BACKGROUND: Despite substantial research evidence indicating the effectiveness of a range of interventions to prevent falls, uptake into routine clinical practice has been limited by several implementation challenges. The complexity of fall prevention in municipality health care underlines the importance of flexible implementation strategies tailored both to general determinants of fall prevention and to local contexts. This cluster-randomised trial (RCT) investigates the effectiveness of a tailored intervention to implement national recommendations on fall prevention among older home-dwelling adults compared to usual practice on adherence to the recommendations in health professionals. METHODS: Twenty-five municipalities from four regions in Norway will be randomised to intervention or control arms. Each municipality cluster will recruit up to 30 health professionals to participate in the study as responders. The tailored implementation intervention comprises four components: (1) identifying local structures for implementation, (2) establishing a resource team from different professions and levels, (3) promoting knowledge on implementation and fall prevention and (4) supporting the implementation process. Each of these components includes several implementation activities. The Consolidated Framework for Implementation Research (CFIR) will be used to categorise determinants of the implementation process and the Expert Recommendations for Implementing Change (ERIC) will guide the matching of barriers to implementation strategies. The primary outcome measure for the study will be health professionals' adherence to the national recommendations on fall prevention measured by a questionnaire. Secondary outcomes include injurious falls, the feasibility of the intervention, the experiences of the implementation process and intervention costs. Measurements will be carried out at baseline in August 2023, post-intervention in May 2024 and at a follow-up in November 2024. DISCUSSION: This study will provide evidence on the effectiveness, intervention costs and underlying processes of change of tailored implementation of evidence-based fall prevention recommendations. TRIAL REGISTRATION: The trial is registered in the Open Science Registry: https://doi.org/10.17605/OSF.IO/JQ9T5 . Registered: March 03, 2023.
Subject(s)
Randomized Controlled Trials as Topic , Humans , Aged , Cities , NorwayABSTRACT
BACKGROUND: Evidence-based practice (EBP) is well known to most healthcare professionals. Implementing EBP in clinical practice is a complex process that can be challenging and slow. Lack of EBP knowledge, skills, attitudes, self-efficacy, and behavior can be essential barriers that should be measured using valid and reliable instruments for the population in question. Results from previous systematic reviews show that information regarding high-quality instruments that measure EBP attitudes, behavior, and self-efficacy in various healthcare disciplines need to be improved. This systematic review aimed to summarize the measurement properties of existing instruments that measure healthcare professionals' EBP attitudes, behaviors, and self-efficacy. METHODS: We included studies that reported measurement properties of instruments that measure healthcare professionals' EBP attitudes, behaviors, and self-efficacy. Medline, Embase, PsycINFO, HaPI, AMED via Ovid, and Cinahl via Ebscohost were searched in October 2020. The search was updated in December 2022. The measurement properties extracted included data on the item development process, content validity, structural validity, internal consistency, reliability, and measurement error. The quality assessment, rating of measurement properties, synthesis, and modified grading of the evidence were conducted in accordance with the COSMIN methodology for systematic reviews. RESULTS: Thirty-four instruments that measure healthcare professionals' EBP attitudes, behaviors or self-efficacy were identified. Seventeen of the 34 were validated in two or more healthcare disciplines. Nurses were most frequently represented (n = 53). Despite the varying quality of instrument development and content validity studies, most instruments received sufficient ( +) ratings on content validity, with the quality of evidence graded as "very low" in most cases. Structural validity and internal consistency were the measurement properties most often assessed, and reliability and measurement error were most rarely assessed. The quality assessment results and overall rating of these measurement properties varied, but the quality of evidence was generally graded higher for these properties than for content validity. CONCLUSIONS: Based on the summarized results, the constructs, and the population of interest, several instruments can be recommended for use in various healthcare disciplines. However, future studies should strive to use qualitative methods to further develop existing EBP instruments and involve the target population. TRIAL REGISTRATION: This review is registered in PROSPERO. CRD42020196009. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020196009.
Subject(s)
Attitude of Health Personnel , Self Efficacy , Humans , Evidence-Based Practice , Reproducibility of Results , Systematic Reviews as TopicABSTRACT
BACKGROUND: Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users' needs. No previous reviews have investigated the usability of mobile apps developed for health care education. OBJECTIVE: The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education. METHODS: A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O'Malley framework for scoping reviews. RESULTS: Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method. CONCLUSIONS: Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/19072.
ABSTRACT
BACKGROUND: Health and social care students are expected to apply evidence-based practice (EBP). An innovative mobile application, EBPsteps, was developed to support learning EBP. AIM: The aim of this study was to explore health and social care students' experiences of learning about EBP using the mobile application EBPsteps during their clinical placements. METHODS: An interpretive description approach guided the exploration of student experiences. Four focus groups were conducted with a convenience sample of students from three undergraduate degree programs: occupational therapy, physical therapy, and social education. The constant comparison method was used to categorize and compare the qualitative data. RESULTS: Three integrated themes were generated: "triggers for EBP", "barriers to EBP", and "design matters". Information needs, academic requirements, and encouragement from clinical instructors triggered the students to use EBPsteps. Lack of EBP knowledge, lack of academic demand, and lack of emphasis on EBP in clinical placement were barriers to using EBPsteps. Design issues mattered, as use of the app was motivated by design features such as the opportunity to practice EBP in one place and taking notes in a digital notebook. The use of the app was hindered by anticipation that the use of phones during clinical placements would be viewed negatively by others and by specific design features, such as unfamiliar icons. CONCLUSIONS: The students perceived the EBPsteps app as a relevant tool for learning EBP, although they also suggested specific changes to the design of the app. Requirements must be embedded in the curriculum to ensure that the app is used. Our findings bring important information to developing and implementing mobile applications as a teaching method in health and social care educations.
Subject(s)
Evidence-Based Practice/education , Health Education , Learning , Mobile Applications , Social Support , Adult , Female , Humans , Male , Young AdultABSTRACT
BACKGROUND: Today, there are fewer opportunities for health care students and staff for skills training through direct patient contact. The World Health Organization therefore recommends learning about patient safety through hands-on experience and simulation. Simulation has the potential to improve skills through training in a controlled environment, and simulation has a positive effect on knowledge and skills, and even patient-related outcomes. Reviews addressing the use of simulation across the different radiography specialties are lacking. Further knowledge on simulation in radiography education is needed to inform curriculum design and future research. The purpose of this scoping review is to explore, map, and summarize the extent, range, and nature of published research on simulation in radiography education. METHODS: We will follow the methodological framework for scoping reviews originally described by Arksey and O'Malley. We will search the MEDLINE, Embase, Epistemonikos, The Cochrane Library, ERIC, Scopus, and sources of grey literature. A comprehensive search strategy for Ovid MEDLINE was developed in collaboration with a research librarian. An example of a full electronic search from the Ovid MEDLINE (1641 articles records, January 9, 2020) is provided and will be used to adapt the search strategy to each database. Two independent review authors will screen all abstracts and titles, and full-text publications during a second stage. Next, they will extract data from each included study using a data extraction form informed by the aim of the study. A narrative account of all studies included will be presented. We will present a simple numerical analysis related to the extent, nature, and distribution of studies, and we will use content analysis to map the different simulation interventions and learning design elements reported. Any type of simulation intervention within all types of radiography specializations will be included. Our search strategy is not limited by language or date of publication. DISCUSSION: An overview of publications on simulation in radiography education across all radiography specialties will help to inform future research and will be useful for stakeholders within radiography education using simulation, both in the academic and clinical settings. SYSTEMATIC REVIEW REGISTRATION: Open Science Framework (OSF). Submitted on October 18, 2020.
Subject(s)
Delivery of Health Care , Learning , Humans , Radiography , Review Literature as TopicABSTRACT
BACKGROUND: E-learning technologies, including mobile apps, are used to a large extent in health care education. Mobile apps can provide extendable learning environments and motivate students for adaptive and collaborative learning outside the classroom context. Developers should design practical, effective, and easy-to-use mobile apps. Usability testing is an important part of app development in order to understand if apps meet the needs of users. OBJECTIVE: The aim of this study is to perform a scoping review of usability methods and attributes reported in usability studies of mobile apps for health care education. METHODS: The scoping review is guided by the methodological framework developed by Arksey & O'Malley and further developed by Levac et al and Kahlil et al. The stages we will follow are as follows: (1) identifying the research question; (2) identifying relevant studies; (3) selecting studies; (4) charting the data; and (5) summarizing and reporting the results. We have developed two research questions to meet the aim of the study, which are as follows: (1) What usability methods are used to evaluate the usability of mobile apps for health care education? and (2) What usability attributes are reported in the usability studies of mobile apps for health care education? We will apply a comprehensive search of the literature, including 10 databases, a reference search, and a search for grey literature. Two review authors will independently screen articles for eligibility. RESULTS: The initial electronic database searches were completed in March 2019. The literature search identified 14,297 unique references. Following title and abstract screening, the full texts of 369 records were obtained. The scoping review is expected to be completed in spring 2021. CONCLUSIONS: We expect the overview of usability methods and attributes reported in usability studies of mobile apps for health care education to contribute to the knowledge base for researchers and developers. It will give an overview of the research field and provide researchers and developers with relevant and important information on the usability research area, including highlighting possible research gaps. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/19072.
ABSTRACT
CONTEXT: Extremely premature (EP) infants are at increased risk of left vocal cord paralysis (LVCP) following surgery for patent ductus arteriosus (PDA). OBJECTIVE: A Systematical Review was conducted to investigate the incidence and outcomes of LVCP after PDA ligation in EP born infants. DATA SOURCES: Searches were performed in Cochrane, Medline, Embase, Cinahl and PsycInfo. STUDY SELECTION: Studies describing EP infants undergoing PDA surgery and reporting incidence of LVCP were included. DATA EXTRACTION AND SYNTHESIS: Study details, demographics, incidence of LVCP, diagnostic method and reported outcomes were extracted. DerSimonian and Laird random effect models with inverse variance weighting were used for all analyses. STUDY APPRAISAL: The Newcastle-Ottawa scale for observational studies was used for quality assessment. RESULTS: 21 publications including 2067 infants were studied. The overall pooled summary estimate of LVCP incidence was 9.0% (95% CI 5.0, 15.0). However, the pooled incidence increased to 32% when only infants examined with laryngoscopy were included. The overall risk ratio for negative outcomes was higher in the LVCP group (2.20, 95% CI 1.69, 2.88, pâ¯=â¯0.01) compared to the non-LVCP-group. CONCLUSIONS: Reported incidence of LVCP varies widely. This may be explained by differences in study designs and lack of routine vocal cords postoperative assessment. LVCP is associated with negative outcomes in EP infants. The understanding of long-term outcomes is scarce. Routine laryngoscopy may be necessary to identify all cases of LVCP, and to provide correct handling for infants with LVCP.
Subject(s)
Ductus Arteriosus, Patent/surgery , Ligation/adverse effects , Postoperative Complications/epidemiology , Vocal Cord Paralysis , Humans , Infant , Infant, Extremely Premature , Ligation/methods , Observational Studies as Topic , Risk Assessment , Vocal Cord Paralysis/epidemiology , Vocal Cord Paralysis/etiologyABSTRACT
Importance: Evidence-based practice (EBP) is necessary for improving the quality of health care as well as patient outcomes. Evidence-based practice is commonly integrated into the curricula of undergraduate, postgraduate, and continuing professional development health programs. There is, however, inconsistency in the curriculum content of EBP teaching and learning programs. A standardized set of minimum core competencies in EBP that health professionals should meet has the potential to standardize and improve education in EBP. Objective: To develop a consensus set of core competencies for health professionals in EBP. Evidence Review: For this modified Delphi survey study, a set of EBP core competencies that should be covered in EBP teaching and learning programs was developed in 4 stages: (1) generation of an initial set of relevant EBP competencies derived from a systematic review of EBP education studies for health professionals; (2) a 2-round, web-based Delphi survey of health professionals, selected using purposive sampling, to prioritize and gain consensus on the most essential EBP core competencies; (3) consensus meetings, both face-to-face and via video conference, to finalize the consensus on the most essential core competencies; and (4) feedback and endorsement from EBP experts. Findings: From an earlier systematic review of 83 EBP educational intervention studies, 86 unique EBP competencies were identified. In a Delphi survey of 234 participants representing a range of health professionals (physicians, nurses, and allied health professionals) who registered interest (88 [61.1%] women; mean [SD] age, 45.2 [10.2] years), 184 (78.6%) participated in round 1 and 144 (61.5%) in round 2. Consensus was reached on 68 EBP core competencies. The final set of EBP core competencies were grouped into the main EBP domains. For each key competency, a description of the level of detail or delivery was identified. Conclusions and Relevance: A consensus-based, contemporary set of EBP core competencies has been identified that may inform curriculum development of entry-level EBP teaching and learning programs for health professionals and benchmark standards for EBP teaching.
Subject(s)
Clinical Competence/standards , Evidence-Based Practice , Health Personnel/standards , Adult , Consensus , Curriculum/standards , Delphi Technique , Evidence-Based Practice/methods , Evidence-Based Practice/standards , Female , Global Health , Humans , Male , Middle Aged , Surveys and QuestionnairesSubject(s)
Arthroscopy , Knee Joint , Osteoarthritis, Knee/surgery , Osteoarthritis/surgery , Humans , Middle AgedABSTRACT
BACKGROUND AND PURPOSE: Physiotherapists practicing at clinical placement sites assigned the role as clinical instructors (CIs), are responsible for supervising physiotherapy students. For CIs to role model evidence-based practice (EBP) they need EBP competence. The aim of this study was to assess the short and long term impact of a six-month multifaceted and clinically integrated training program in EBP on the knowledge, skills, beliefs and behaviour of CIs supervising physiotherapy students. METHODS: We invited 37 CIs to participate in this non-randomized controlled study. Three self-administered questionnaires were used pre- and post-intervention, and at six-month follow-up: 1) The Adapted Fresno test (AFT), 2) the EBP Belief Scale and 3) the EBP Implementation Scale. The analysis approach was linear regression modeling using Generalized Estimating Equations. RESULTS: In total, 29 CIs agreed to participate in the study: 14 were invited to participate in the intervention group and 15 were invited to participate in the control group. One in the intervention group and five in the control group were lost to follow-up. At follow-up, the group difference was statistically significant for the AFT (mean difference = 37, 95% CI (15.9 -58.1), p < 0.001) and the EBP Beliefs scale (mean difference = 8.1, 95% CI (3.1 -13.2), p = 0.002), but not for the EBP Implementation scale (mean difference = 1.8. 95% CI (-4.5-8.1), p = 0.574). Comparing measurements over time, we found a statistically significant increase in mean scores related to all outcome measures for the intervention group only. CONCLUSIONS: A multifaceted and clinically integrated training program in EBP was successful in improving EBP knowledge, skills and beliefs among CIs. Future studies need to ensure long-term EBP behaviour change, in addition to assessing CIs' abilities to apply EBP knowledge and skills when supervising students.
Subject(s)
Attitude of Health Personnel , Evidence-Based Medicine/methods , Health Knowledge, Attitudes, Practice , Physical Therapy Modalities/education , Physical Therapy Specialty/education , Surveys and Questionnaires , Adult , Education , Female , Humans , Male , Middle Aged , Norway , Regression Analysis , Reproducibility of Results , Students , Young AdultABSTRACT
BACKGROUND AND PURPOSE: Physiotherapists are expected to practice in an evidence-based way. Evidence-based practice (EBP) should be an integral part of the curriculum to ensure use of the five EBP steps: asking clinical questions, searching for and appraising research evidence, integrating the evidence into clinical practice and evaluating this process. The aim of this study was to compare self-reported EBP behaviour, abilities and barriers during clinical placements reported by five cohorts of final year physiotherapy students' with different EBP exposure across the 3-year bachelor programme. METHODS: A cross-sectional study was conducted among five cohorts (2006-2010) with third year physiotherapy students at a University College in Norway. In total, 246 students were eligible for this study. To collect data, we used a questionnaire with 42 items related to EBP behaviour, ability and barriers. Associations were investigated using the Spearman's rho (r). RESULTS: In total, 180 out of 246 third year physiotherapy students, who had recently completed a clinical placement, filled out the questionnaire (73 %). The association between the level of EBP exposure and students' self-reported EBP behaviour, abilities and barriers was low for most items in the questionnaire. Statistically significant correlations were found for eight items, related to information need, question formulation, use of checklists, searching and perceived ability to search for and critically appraise research evidence. The strongest correlation was found between the level of EBP exposure and ability to critically appraise research evidence (r = 0.41, p < 0.001). CONCLUSIONS: An association between the level of EBP exposure and physiotherapy students' EBP behaviour was found for elements such as asking and searching, ability to search for and critically appraise research evidence, and experience of critical appraisal as a barrier. Further research need to explore strategies for EBP exposure throughout the curriculum, regarding content, timing, amount and type of training.