RESUMO
BACKGROUND: The Modified Fresno Test has been used to evaluate the use of the Evidence-Based Physiotherapy (EBP). So far, none of the versions of the Fresno Test were subjected to analysis of the factorial structure. The objective of the study was to describe the exploratory and confirmatory factor structure of the Modified Fresno Test adapted to the Portuguese-Brazilian and analyze the statistical feasibility for the elaboration of a short version. METHODS: The questionnaire was applied with a convenience sample of 57 physiotherapists, being 36 professionals (13 of these also professors) and 21 students from the last semester of the physiotherapy course. Exploratory Factor Analysis (EFA) was performed by the method of principal components. Confirmatory Factor Analysis (CFA) was performed by the method of maximum likelihood. The total score of the answers in the test and retest was evaluated, totalling 228 observations. Reliability was assessed by means of internal consistency, using Cronbach's alpha coefficient. RESULTS: Reliability was satisfactory (α 0.81) for all questions of the instrument. The coefficient α calculated for the corrected item-total showed values higher than 0.20 except for item 9. Preliminary tests for Exploratory Factor Analysis showed acceptable values with Kaiser-Meyer-Olkin (KMO = 0.80) and Bartlett's test of sphericity [chi-square (78) = 1149.615, p < 0.001], indicating that the correlations were sufficient for analysis. The analysis revealed the presence of 3 factors (eigenvalues> 1), which explains 60.9% of the instrument's total variance. In Confirmatory Factor Analysis, none of the indices came close to an acceptable level (≥ 0.90), however, the second model which tested a three-factor structure provided a better fit to the data. From the results of this study the Modified Fresno Test short version was drawn. CONCLUSION: The analysis showed good factor validity and adequate internal consistency for the use of the instrument consisting of 13 questions and 3 factors. This model proved to be better than the original model. The short version consisting of 9 questions may be an appropriate alternative for use in the population of interest.
Assuntos
Análise Fatorial , Fisioterapeutas , Psicometria/instrumentação , Brasil , Estudos Transversais , Prática Clínica Baseada em Evidências , Humanos , Reprodutibilidade dos TestesRESUMO
BACKGROUND: Global and national undergraduate medical education accreditation organizations recommend the inclusion of Evidence-Based Medicine (EBM) instructions into the medical schools' curricula. Accordingly, some Turkish medical schools have individually developed and implemented EBM training programs, but there is no data of current programs' effectiveness and students' learning achievements due to the lack of a validated Turkish language EBM assessment tool. This study evaluates the effect of a newly introduced formal EBM instruction to the curriculum on students' knowledge and skills by using the recently published Turkish adaptation of the Fresno Test. METHODS: The study is an experimental investigation using pre- and post-test evaluations. A five-week EBM course was developed according to Kern's six-step curriculum development approach. A total of 78 students from the third (n = 30), fourth (n = 19) and fifth (n = 29) year of medical school voluntarily consented and were enrolled into the course. Overall, the Cerrahpasa Medical Faculty had a total of 555, 461, and 400 students enrolled in the third, fourth, and fifth year, respectively. The program has been evaluated based on students' learning achievements and survey responses. RESULTS: The students' mean pre-test Fresno Test score improved from 49.9 ± 18.2 to 118.9 ± 26.3 post-training. The Cohen's effect size was 3.04 (95% CI, 2.6-3.5). The overall students' satisfaction score was 8.66 ± 1.09 on a 1 to 10 scale. CONCLUSIONS: The program was effective in improving students' knowledge and skills on EBM. We propose to offer the program as an elective course during the third year of the medical school curriculum based on all data obtained during the program evaluation.
Assuntos
Educação de Graduação em Medicina , Estudantes de Medicina , Currículo , Avaliação Educacional , Medicina Baseada em Evidências/educação , Humanos , IdiomaRESUMO
BACKGROUND: The importance of ensuring medical students are equipped with the skills to be able to practice evidence-based medicine (EBM) has been increasingly recognized in recent years. However, there is limited information on an effective EBM curriculum for undergraduate medical schools. This study aims to test the feasibility of integrating a multifaceted EBM curriculum in the early years of an undergraduate medical school. This was subsequently evaluated using the validated Fresno test and students' self-reported knowledge and attitudes as they progressed through the curriculum. METHODS: EBM was integrated horizontally and vertically into the curriculum into the first 2 years of undergraduate medical school. First year medical students were recruited to participate in the study. The 212-point Fresno test was administered along with a locally developed questionnaire at baseline before EBM teaching in year one and at the end of EBM teaching in year two. RESULTS: Thirty-one students participated at baseline and 55 students participated at the end of second year EBM teaching. For the 18 students who completed the Fresno at both time points, the average score increased by 38.7 marks (p < 0.001) after EBM teaching. Students felt confident in formulating clinical questions and in critically appraising journal articles after EBM teaching. EBM was perceived to be important to their future practice as a doctor and for improving patient outcomes at both time points. CONCLUSIONS: It has been feasible to integrate a multifaceted, EBM curriculum from the first year of an undergraduate medical program. Early evaluation of the curriculum using the Fresno test has shown a significant increase in students' EBM knowledge. The curriculum also demonstrated an increase in students' perceptions of the clinical relevance of EBM in their developing practice.
Assuntos
Educação de Graduação em Medicina , Estudantes de Medicina , Currículo , Medicina Baseada em Evidências/educação , Humanos , Estudos Prospectivos , Faculdades de MedicinaRESUMO
BACKGROUND: Flipped classroom is known to improve learning efficiency and to develop one's ability to apply high-level knowledge. To investigate the effect of flipped classroom approach on teaching evidence-based medicine to medical technology students, we conducted a tailor-made six flipped classroom based EBM courses for medical technology students. METHODS: This study adopted a qusai-experimental design with 62 medical technology interns as the research object. Students in the experimental group attended the flipped classroom course, while students in the control group attended the traditional course. The learning outcomes were evaluated by Fresno test in both groups. Furthermore, to understand student's perceptions on the flipped classroom approach, students in the experimental group were required to fill in a satisfaction survey and answer some open-ended questions. RESULTS: The Fresno test scores of the experimental group were significantly higher than that of the control group. From the results of the satisfaction survey, we know that students were satisfied with this course format. Students claimed that the flipped classroom approach could improve their learning efficiency and the interactions with teacher could help them to think more deeply. CONCLUSIONS: To conclude, most students showed positive attitudes and views on flipped classroom strategy. Moreover, students' questions were solved more effectively during class resulting in an improvement of effectiveness of evidence-based medicine trainings.
Assuntos
Medicina Baseada em Evidências/educação , Pessoal de Laboratório Médico/educação , Ensino , Educação a Distância , Feminino , Humanos , Masculino , Aprendizagem Baseada em Problemas , Taiwan , Adulto JovemRESUMO
BACKGROUND: There are a few studies of alignment between different knowledge-indices for evidence-based medicine (EBM). The aim of this study was to investigate whether the type of test used to assess knowledge of EBM affects the estimation of this knowledge in medical students. METHODS: Medical students enrolled in 1-week EBM course were tested with the Fresno, Berlin, and ACE tests at the beginning and the end of the course. We evaluated the ability of these tests to detect a change in the acquired level of EBM knowledge and compared the estimates of change with those of the Control group that was tested with the ACE and Berlin tests before and after an unrelated non-EBM course. The distributions of test scores and average item difficulty indices were compared among the tests and the groups. RESULTS: Test scores improved on all three tests when compared with their pre-test results and the control. Students had on average a "good" performance on the ACE test, "sufficient" performance on the Berlin test, and "insufficient" performance or have "not passed" on the Fresno test. The post-test improvements in performance on the Fresno test (median 31% increase in percent scores, 95% confidence interval (CI) 25-42%) outperformed those on the ACE (13, 95% CI 13-20%) and Berlin tests (13, 95% CI 7-20%). Post-test score distributions demonstrated that the ACE test had less potential to discriminate between levels of EBM knowledge than other tests. CONCLUSION: The use of different EBM tests resulted in different assessment of general EBM knowledge in a sample of graduate medical students, with lowest results on the Fresno and highest on the ACE test. In the light of these findings, EBM knowledge assessment should be based on the course's content and learning objectives.
Assuntos
Competência Clínica/normas , Currículo , Educação de Graduação em Medicina , Avaliação Educacional/métodos , Medicina Baseada em Evidências/educação , Estudantes de Medicina , Feminino , Humanos , Masculino , Avaliação de Programas e Projetos de Saúde , Adulto JovemRESUMO
PURPOSE: Instruments used to assess evidence-based practice (EBP) competence in nurses have been subjective, unreliable, or invalid. The Fresno test was identified as the only instrument to measure all the steps of EBP with supportive reliability and validity data. However, the items and psychometric properties of the original Fresno test are only relevant to measure EBP with medical residents. Therefore, the purpose of this paper is to describe the development of the adapted Fresno test for pediatric nurses, and provide preliminary validity and reliability data for its use with Bachelor of Science in Nursing-prepared pediatric bedside nurses. METHODS: General adaptations were made to the original instrument's case studies, item content, wording, and format to meet the needs of a pediatric nursing sample. The scoring rubric was also modified to complement changes made to the instrument. Content and face validity, and intrarater reliability of the adapted Fresno test were assessed during a mixed-methods pilot study conducted from October to December 2013 with 29 Bachelor of Science in Nursing-prepared pediatric nurses. RESULTS: Validity data provided evidence for good content and face validity. Intrarater reliability estimates were high. LINKING EVIDENCE TO ACTION: The adapted Fresno test presented here appears to be a valid and reliable assessment of EBP competence in Bachelor of Science in Nursing-prepared pediatric nurses. However, further testing of this instrument is warranted using a larger sample of pediatric nurses in diverse settings. This instrument can be a starting point for evaluating the impact of EBP competence on patient outcomes.
Assuntos
Competência Clínica/normas , Enfermeiros Pediátricos/normas , Enfermagem Pediátrica , Avaliação Educacional/métodos , Enfermagem Baseada em Evidências/métodos , Enfermagem Baseada em Evidências/normas , Conhecimentos, Atitudes e Prática em Saúde , Humanos , Enfermeiros Pediátricos/estatística & dados numéricos , Enfermagem Pediátrica/normas , Projetos Piloto , Psicometria/instrumentação , Psicometria/métodos , Inquéritos e Questionários , Habilidades para Realização de Testes/psicologiaRESUMO
BACKGROUND: Proficiency in evidence-based practice (EBP) is essential for relevant research findings to be integrated into clinical care when congruent with patient preferences. Few valid and reliable tools are available to evaluate the effectiveness of educational programs in advancing EBP attitudes, knowledge, skills, or behaviors, and ongoing competency. The Fresno test is one objective method to evaluate EBP knowledge and skills; however, the original and modified versions were validated with family physicians, physical therapists, and speech and language therapists. AIMS: To adapt the Modified Fresno-Acute Care Nursing test and develop a psychometrically sound tool for use in academic and practice settings. METHODS: In Phase 1, modified Fresno (Tilson, 2010) items were adapted for acute care nursing. In Phase 2, content validity was established with an expert panel. Content validity indices (I-CVI) ranged from .75 to 1.0. Scale CVI was .95%. A cross-sectional convenience sample of acute care nurses (n = 90) in novice, master, and expert cohorts completed the Modified Fresno-Acute Care Nursing test administered electronically via SurveyMonkey. FINDINGS: Total scores were significantly different between training levels (p < .0001). Novice nurses scored significantly lower than master or expert nurses, but differences were not found between the latter cohorts. Total score reliability was acceptable: (interrater [ICC (2, 1)]) = .88. Cronbach's alpha was 0.70. Psychometric properties of most modified items were satisfactory; however, six require further revision and testing to meet acceptable standards. LINKING EVIDENCE TO ACTION: The Modified Fresno-Acute Care Nursing test is a 14-item test for objectively assessing EBP knowledge and skills of acute care nurses. While preliminary psychometric properties for this new EBP knowledge measure for acute care nursing are promising, further validation of some of the items and scoring rubric is needed.
Assuntos
Educação em Enfermagem/normas , Avaliação Educacional/métodos , Psicometria/normas , Competência Clínica/normas , Estudos de Coortes , Estudos Transversais , Educação em Enfermagem/métodos , Prática Clínica Baseada em Evidências/métodos , Prática Clínica Baseada em Evidências/normas , Humanos , Psicometria/instrumentação , Psicometria/métodos , Reprodutibilidade dos Testes , Inquéritos e QuestionáriosRESUMO
BACKGROUND: Evidence-based medicine (EBM) has been included in the Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Emergency Medicine (ABEM) milestones project as a required component during emergency medicine (EM) residency training. Milestone Level One states that graduating medical students must be able to "describe basic principles of EBM." OBJECTIVE: We sought to identify the EBM skills of third- and fourth-year medical students. METHODS: Our institution, a network with 17 different residencies, hosts U.S. osteopathic and allopathic medical students. As a part of orientation, students are required to complete an entry Fresno Test of EBM (FTEBM). Retrospectively, medical student FTEBM scores from 2011 were assessed using descriptive statistics. RESULTS: Four hundred seventeen FTEBM scores were analyzed. Participants represented 40 medical schools, including 17 allopathic (MD) and 23 osteopathic (DO) schools. Fifty percent of participants (n = 210) were female, and 51.6% (n = 215) were from a DO medical school. Overall mean performance for the FTEBM was 47.2%. Exploring the results by individual question were (individual EBM question topics are in parentheses): 1A (study question), 62.0%; 1B (study question), 64.4%: 2 (sources of evidence), 67.6%; 3 (study design), 57.1%; 4 (search strategies), 53.2%; 5 (relevance), 41.2%; 6 (internal validity), 43.6%; 7 (magnitude), 37.8%; 8 (two-by-two grids), 30.0%; 9 (number needed to treat), 16.9%; 10 (confidence intervals), 34.3%; 11 (diagnosis), 5.0%; and 12 (prognosis), 43.4%. CONCLUSIONS: As measured by the FTEBM, senior medical students demonstrate understanding of about half of EBM. EM residencies can anticipate the need to instruct their residents in EBM concepts in order to meet ACGME/ABEM milestone requirements.
Assuntos
Competência Clínica/normas , Avaliação Educacional/métodos , Medicina Baseada em Evidências/normas , Conhecimento , Estudantes de Medicina/psicologia , Adulto , Estudos Transversais , Educação de Graduação em Medicina/métodos , Educação de Graduação em Medicina/normas , Medicina Baseada em Evidências/métodos , Feminino , Humanos , Masculino , Estudos Retrospectivos , Recursos HumanosRESUMO
The EPA regulates ambient particulate matter (PM) because substantial associations have been established between PM and health impacts. Presently, regulatory compliance involves broad control of PM emission sources based on mass concentration rather than chemical composition, although PM toxicity is likely to vary depending upon PM physicochemical properties. The overall objective of this study was to help inform source-specific PM emission control regulations. For the first time, source-oriented PM was collected from the atmosphere in Fresno, CA, onto 38 source/size substrates. Mice were exposed via oropharyngeal aspiration to equivalent mass doses [50 µg] of two size fractions: ultrafine (Dp < 0.17µm) and submicron fine (0.17 < Dp < 1 µm) during summer and winter seasons. At 24 hours post-exposure, cellular and biochemical indicators of pulmonary inflammation were evaluated in the bronchoalveolar lavage fluid. Significant inflammatory responses were elicited by vehicle, regional background, and cooking PM sources that were dependent on season and particle size. This is the first study of source-oriented toxicity of atmospheric PM and supports source-specific emissions control strategies.
RESUMO
BACKGROUND: Journal club is a standard component of residency education. Journal club focuses on review and interpretation of the medical literature with varying degrees of evidence-based medicine (EBM) education. OBJECTIVES: To evaluate learning of EBM principles with an EBM curriculum implemented as a component of journal club. EBM competency was established using the Fresno test, a validated 12-question instrument of short-answer and essay-style questions to assess competency in EBM. METHODS: An EBM curriculum was implemented that consisted of a focus on EBM topics (e.g., study validity, bias, confidence intervals, search strategies) using a structured journal club format using a peer instruction model. The Fresno test was used prior to and after the implementation of the first year of this curriculum to measure effectiveness of the intervention. A hierarchical multivariable model using generalized estimating equations was used to account for repeated measures in the primary outcome of change in total Fresno test score. RESULTS: The total test scores did not increase significantly (105.4 vs. 120.9, p = 0.058) in the before-after analysis. The only subscore showing improvement was interpretation of study validity (32.1 vs. 40.4 points, p = 0.03). Attendance was significantly associated with Fresno test score, with those attending ≥ 6/11 sessions (55%) scoring 28.2 points higher (p = 0.003), and those attending fewer than six sessions scoring only 1.9 points higher (p = 0.81) than in the preintervention group. CONCLUSION: An EBM curriculum implemented as part of journal club improves performance on the Fresno test among residents who attended at least six journal club sessions.
Assuntos
Currículo , Educação de Pós-Graduação em Medicina/métodos , Medicina de Emergência/educação , Medicina Baseada em Evidências/educação , Internato e Residência , Competência Clínica , Estudos Transversais , Avaliação Educacional/métodos , Humanos , IowaRESUMO
To capture the spatial distribution of phenanthrene in an urban setting we used vegetation biomonitoring with Jeffrey pine trees (Pinus jeffreyi). The major challenge in characterizing spatial variation in polycyclic aromatic hydrocarbon (PAH) concentrations within a metropolitan area has been sampling at a fine enough resolution to observe the underlying spatial pattern. However, field and chamber studies show that the primary pathway through which PAHs enter plants is from air into leaves, making vegetation biomonitoring a feasible way to examine the spatial distribution of these compounds. Previous research has shown that phenanthrene has adverse health effects and that it is one of the most abundant PAHs in urban air. We collected 99 pine needle samples from 91 locations in Fresno in the morning on a winter day, and analyzed them for PAHs in the inner needle. All 99 pine needle samples had detectable levels of phenanthrene, with mean concentration of 41.0 ng g-1, median 36.9 ng g-1, and standard deviation of 28.5 ng g-1 fresh weight. The ratio of the 90th:10th percentile concentrations by location was 3.3. The phenanthrene distribution had a statistically significant Moran's I of 0.035, indicating a high degree of spatial clustering. We implemented land use regression to fit a model to our data. Our model was able to explain a moderate amount of the variability in the data (R 2 = 0.56), likely reflecting the major sources of phenanthrene in Fresno. The spatial distribution of modeled airborne phenanthrene shows the influences of highways, railroads, and industrial and commercial zones.
RESUMO
OBJECTIVE: To determine the effectiveness of education in evidence-based medicine (EBM) on the knowledge, competency, and skills of otolaryngology residents of Tehran University of Medical Sciences (TUMS) at Amir-Alam and Imam Khomeini Hospitals. METHODS: In a quasi-experimental (before-and-after) study, all ear, nose, and throat residents of TUMS (n = 41) entered the study. The residents underwent the modified Fresno test. Then, two EBM workshops with a similar content were held on 2 separate days in each hospital, with each session lasting 6 hours. The learned material was practiced in weekly journal clubs. Six months after the workshop, the modified Fresno test was applied again, and the results were analyzed. RESULTS: A significant improvement in the modified Fresno test score was observed. The mean score of the modified Fresno test was 57.43 ± 22.07 before the workshop and 79.26 ± 22.48 after the workshop (P < 0.001). CONCLUSION: The results of the study show that EBM education and practice of the learned materials in journal clubs can improve the knowledge and skills of residents. Further research with larger samples is needed to improve the precision of our findings and to increase confidence in the results. LEVEL OF EVIDENCE: 2 Laryngoscope, 129:2291-2294, 2019.
Assuntos
Competência Clínica/estatística & dados numéricos , Avaliação Educacional/estatística & dados numéricos , Medicina Baseada em Evidências/educação , Internato e Residência/estatística & dados numéricos , Otolaringologia/educação , Adulto , Currículo , Avaliação Educacional/métodos , Feminino , Humanos , Irã (Geográfico) , Masculino , Ensaios Clínicos Controlados não Aleatórios como AssuntoRESUMO
Objective. To assess the effectiveness of an evidence-based practice (EBP) pharmacology elective course to teach EBP skills using the Fresno Test (FT). Methods. Pharmacy faculty members and medical librarians developed the elective course and offered it to two cohorts of doctor of pharmacy (PharmD) students. A pre/post intervention study design was used. Seven of 12 FT items were chosen to measure specific EBP skills: Ask, Access, Appraise and Apply. Pre/postcomposite and FT item mean scores were compared using Student's t test with p<0.05 set as significant a priori. Results. Composite FT mean scores increased significantly for both cohorts. Mean scores for both cohorts increased significantly in four of the seven FT items but on different FT items. Conclusion. As a profession that commonly uses evidence-based guidelines, developing and integrating an EBP course in the PharmD curriculum is worth considering.
Assuntos
Educação em Farmácia/métodos , Avaliação Educacional/métodos , Prática Clínica Baseada em Evidências/educação , Farmacologia/educação , Adulto , Competência Clínica , Estudos de Coortes , Currículo , Docentes de Farmácia , Feminino , Humanos , Masculino , Estudantes de Farmácia , Adulto JovemRESUMO
PURPOSE: The current versions of the Adapted Fresno test (AFT) are limited to physiotherapists and occupational therapists, and new scenarios and scoring rubrics are required for other allied health disciplines. The aim of this study was to examine the validity, reliability, and internal consistency of the AFT developed for speech pathologists (SPs), social workers (SWs), and dieticians/nutritionists (DNs). MATERIALS AND METHODS: An expert panel from each discipline was formed to content-validate the AFT. A draft instrument, including clinical scenarios, questionnaire, and scoring rubric, was developed. The new versions were completed by ten SPs, 16 SWs, and 12 DNs, and scored by four raters. Interrater reliability was calculated using intraclass correlation coefficients (2,1) for the individual AFT items and the total score. The internal consistency of the AFT was examined using Cronbach's α. RESULTS: Two new clinical scenarios and a revised scoring rubric were developed for each discipline. The reliability among raters was excellent for questions 1, 3, and 6 across all disciplines. Question 7 showed excellent reliability for SPs, but not for SWs and DNs. All other reliability coefficients increased to moderate or excellent levels following training. Cronbach's α was 0.71 for SPs, 0.68 for SWs, and 0.74 for DNs, indicating that internal consistency was acceptable for all disciplines. CONCLUSION: There is preliminary evidence to show that AFT is a valid and reliable tool for the assessment of evidence-based practice knowledge and skills of SPs, SWs, and DNs. Further research is required to establish its sensitivity to detect change in knowledge and skills following an educational program.
RESUMO
PURPOSE: The Adapted Fresno Test (AFT) is a seven-item instrument for assessing knowledge and skills in the major domains of evidence-based practice (EBP), including formulating clinical questions and searching for and critically appraising research evidence. This study examined the interrater reliability of the AFT using several raters with different levels of professional experience. METHOD: The AFT was completed by physiotherapists and occupational therapists, and a random sample of 12 tests was scored by four raters with different levels of professional experience. Interrater reliability was calculated using intra-class correlation coefficients (ICC [2, 1]) for the individual AFT items and the total AFT score. RESULTS: Interrater reliability was moderate to excellent for items 1 and 7 (ICC=0.63-0.95). Questionable levels of reliability among raters were found for other items and for the total score. For these items, the raters were clustered into two groups-"experienced" and "inexperienced"-and then examined for reliability. The reliability estimates for rater 1 and rater 2 ("inexperienced") increased slightly for items 2 and 5 and for the total score, but not for other items. For raters 3 and 4 ("experienced"), ICCs increased considerably, indicating excellent reliability for all items and for the total score (0.80-0.99), except for item 4, which showed a further decrease in ICC. CONCLUSION: Use of the AFT to assess knowledge and skills in EBP may be problematic unless raters are carefully selected and trained.
Objectif : Le test adapté de Fresno (Adapted Fresno Test, AFT) est un instrument de mesure en sept points qui vise l'évaluation des connaissances et des compétences dans les principaux domaines de pratique fondée sur des faits probants, notamment la formulation de questions cliniques et la recherche ainsi que l'évaluation critique de preuves issues de la recherche. L'étude s'est penchée sur la fiabilité de l'AFT entre évaluateurs, en travaillant avec des évaluateurs ayant divers degrés d'expérience professionnelle. Méthodologie : Des physiothérapeutes et des ergothérapeutes ont procédé à un AFT. Un échantillon aléatoire de 12 tests a ensuite été analysé par quatre évaluateurs avec des degrés variés d'expérience professionnelle. La fiabilité entre évaluateurs a été calculée à l'aide de coefficients de corrélation intraclasse (CCI [2, 1]) pour les points individuels de l'AFT et pour le pointage total de l'AFT. Résultats : La fiabilité entre évaluateurs variait de modérée à excellente pour les points 1 et 7 (CCI=0,630,95). Pour les autres points et pour la note totale toutefois, les niveaux de fiabilité sont sujets à caution. Pour les points en question, les évaluateurs ont été séparés en deux groupesles « expérimentés ¼ et les « inexpérimentés ¼et leur fiabilité a ensuite été analysée. Les estimations de la fiabilité de l'évaluateur 1 et de l'évaluateur 2 (« inexpérimentés ¼) étaient légèrement supérieures pour les points 2 et 5 et pour le pointage total, mais ce n'était pas le cas pour les autres points. Pour les évaluateurs 3 et 4 (« expérimentés ¼), le CCI était beaucoup plus élevé, ce qui dénote une excellente fiabilité pour tous les points et pour la note totale (0,700,99), sauf pour le point 4, qui affichait une baisse plus marquée de son CCI. Conclusion : L'utilisation du test de Fresno adapté pour évaluer les connaissances et les compétences en pratique fondée sur les faits probants peut être problématique, à moins que les évaluateurs soient rigoureusement choisis et formés.
RESUMO
BACKGROUND: The Modified Fresno Test was developed to assess knowledge and skills of both physical therapy (PT) professionals and students to use evidence-based practice (EBP). OBJECTIVES: To translate the Modified Fresno Test into Brazilian-Portuguese and to evaluate the test's reproducibility. METHOD: The first step consisted of adapting the instrument into the Brazilian-Portuguese language. Then, a total of 57 participants, including PT students, PT professors and PT practitioners, completed the translated instrument. The responses from the participants were used to evaluate reproducibility of the translated instrument. Internal consistency was calculated using the Cronbach's alpha. Reliability was calculated using the intraclass correlation coefficient (ICC) for continuous variables, and the Kappa coefficient (K) for categorical variables. The agreement was assessed using the standard error of the measurement (SEM). RESULTS: The cross-cultural adaptation process was appropriate, providing an adequate Brazilian-Portuguese version of the instrument. The internal consistency was good (α=0.769). The reliability for inter- and intra-rater assessment were ICC=0.89 (95% CI 0.82 to 0.93); for evaluator 1 was ICC=0.85 (95% CI 0.57 to 0.93); and for evaluator 2 was ICC=0.98 (95% CI 0.97 to 0.99). The SEM was 13.04 points for inter-rater assessment, 12.57 points for rater 1 and 4.59 points for rater 2. CONCLUSION: The Brazilian-Portuguese language version of the Modified Fresno Test showed satisfactory results in terms of reproducibility. The Modified Fresno Test will allow physical therapy professionals and students to be evaluated on the use of understanding EBP.