Psychometric properties of the arabic version of PHEEM applied on a sample of medical residents in Syria.

BACKGROUND: The clinical learning environment (CLE) plays a crucial role in shaping the learning experiences and professional development of medical professionals. Understanding and optimising this environment is essential for improving doctors' knowledge acquisition, clinical skills, and overall well-being. The development of the Postgraduate Hospital Educational Environment Measure (PHEEM) and its translation to numerous languages has been a milestone in clinical education. Even though PHEEM was recently translated into Arabic, its psychometric properties in this form remain unevaluated. Therefore, this study aims to conduct a comprehensive psychometric analysis of the Arabic version of the PHEEM questionnaire. METHODS: This is a cross-sectional questionnaire survey validation study. The defined population were medical residents in Damascus, Syria. A paper-based survey as well as an online-based one were conducted using several non-probability sampling methods namely, convenience, river and, snowball sampling between June 15, 2023, and June 21, 2023. Both exploratory (EFA) and confirmatory (CFA) factor analyses were conducted. Several psychometric criteria were applied including scree plot, eigenvalue > 1.5 and the 'proportion of variance accounted for' criterion. RESULTS: A total of 543 participants completed the questionnaire (56.9% female). Kaiser-Meyer-Olkin measure for sample adequacy was high (0.937) and the P-value for Bartlett's test was < 0.001. EFA revealed five meaningful factors which were labelled: perception of teachers, learner's engagement and social participation, external regulation, work culture, and living conditions. These factors had the following eigenvalues: 12.6, 2.18, 2.03, 1.86, and 1.41 respectively, with a total explained variance of 43.45%. Cronbach's Alpha was 0.938. CFA confirmed the model structure of EFA (SRMR = 0.067 and RMSEA = 0.066). The Average Variance Explained (AVE) value of any given factor was > 0.7. DISCUSSION: The Arabic PHEEM inventory demonstrated satisfactory psychometric properties. The extracted domains are of theoretical relevance to the psychosocial-material conceptual framework for learning environment. Nonetheless, this validation was performed in the Syrian context; therefore, future studies in other Arabic countries are recommended to support the applicability of Arabic PHEEM in the wide Arab World.

Translation, cultural adaptation and linguistic validation of the postgraduate hospital educational environment measure into Arabic.

BACKGROUND: Assessment of the clinical learning environment (CLE) is an essential step that teaching hospitals routinely undertake to ensure the environment is conducive, learning-oriented and supportive of junior doctors' education. The Postgraduate Hospital Educational Environment Measure (PHEEM) is an internationally recognized tool for assessing the CLE with evidence of high reliability and validity. Translation of PHEEM into other languages such as Spanish, Japanese and Persian enabled wider adoption of the instrument in the world. However, in Syria and other Arabic countries, a validated Arabic translation of PHEEM is still not available, making it difficult to adopt it and use it in Arabic contexts. This study aims to translate and culturally adapt the PHEEM from English into Arabic. METHODS: This study followed the structured translation and validation process guideline proposed by Sousa & Rojjanasrirat 2010. First, the PHEEM went through forward translation by three translators, then reconciled with the aid of a fourth translator. Afterwards, two professional bicultural and bilingual translators conducted back translation into English and compared it with the original version. This formed the Pre-final Version (PFV) which was then pretested for clarity on a sample of medical residents in Damascus, Syria. Following appropriate modifications, the PFV was sent to a panel of experts for a comprehensive review of language clarity and to assess content validity. RESULTS: A total of thirty-five medical residents were recruited. Ten items with language clarity issues were identified and modified according to the elicited suggestions. Thereafter, the modified PFV was presented to ten subject experts who identified three items in need of revision. The item-content Validity Index (CVI) was over 0.78 for all of the 40 items; the calculated scale-CVI was 0.945. DISCUSSION: This study provided the first linguistically valid Arabic translation of the widely used PHEEM inventory. The next step is to conduct a full psychometric analysis of the Arabic PHEEM to provide further evidence of validity and reliability.

Evaluation of a workplace assessment method designed to improve self-assessment in operative dentistry: a quasi-experiment.

BACKGROUND: Dental education has placed continued emphasis on self-regulated learning (SRL) and its subprocess, self-assessment. This study set out to evaluate the effectiveness of a novel workplace assessment method in developing trainees' self-assessment of operative procedures. METHODS: A Direct Observation of Procedural Skills (DOPS) form was modified for the use and measurement of self-assessment. Participants were trained on how to conduct self-assessment using the designed assessment form and its grading rubric. Feedback and feedforward sessions were given to address self-assessment and performance issues. A P-value less than 0.10 was considered significant and the confidence level was set at 90%. RESULTS: Thirty-two Year 5 dental students with an age mean of 22.45 (SD = 0.8) completed five self DOPS encounters during the clinical operative dentistry module in 2022. The aggregated total deviation (absolute difference) between self-assessment and teacher assessment decreased consistently in the five assessment encounters with a significant mean difference and a medium effect size (P = 0.064, partial Eta squared = 0.069). Participants' self-assessment accuracy differed from one skill to another and their ability to identify areas of improvement as perceived by teachers improved significantly (P = 0.011, partial Eta squared = 0.099). Participants' attitudes towards the assessment method were positive. CONCLUSIONS: The findings suggest that the self DOPS method was effective in developing participants' ability to self-assess. Future research should explore the effectiveness of this assessment method in a wider range of clinical procedures.

Revealing the significant shortcomings in the learning environment at the three largest medical schools in Syria: what's next?

BACKGROUND: Medical education in Syria still adopts a traditional, teacher-centered curriculum to this day. These elements imply the existence of issues in the learning environment (LE). This study aims to provide the first evaluation of the LE at the largest medical schools in Syria using the DREEM inventory. METHODS: The three largest medical schools in Syria are the ones at Damascus University (DU), University of Aleppo (AU), Tishreen University (TU). The Arabic version of the DREEM questionnaire was used. Students across all years of study except year 1 were approached. Both paper-based and electronic surveys were conducted. RESULTS: A total of 1774 questionnaire forms were completed (DU:941, AU:533, TU: 300). The overall DREEM score at DU, AU, and TU were 100.8 ± 28.7, 101.3 ± 31.7, and 97.8 ± 35.7 respectively with no significant difference (P = 0.254) between the three universities. DREEM subscales concerning Learning, Atmosphere, Academic Self-perception and Social Self-perception had a low score across all universities. Clinical-stage students reported significantly lower perception (P ≤ 0.001) of the LE in comparison to their pre-clinical counterparts across all subscales. CONCLUSIONS: The findings of this study highlight the significant shortcomings of the medical LE in Syria. If not addressed properly, the academic, clinical, and professional competence of the healthcare workforce will continue to deteriorate. Moreover, the negative LE might be a predisposing factor for medical students' exodus. The Syrian medical education system requires leaders who are willing to defy the status quo to achieve a true educational transformation.

Scaffolding Self-Regulated Learning in Operative Dentistry Through Self-Assessment Training.

OBJECTIVES: This study aimed to investigate how effective self-assessment training is in improving the self-regulated learning (SRL) ability of operative dentistry students. The secondary aim was to explore students' attitudes towards self-assessment in clinical settings. INTRODUCTION: Self-assessment has been the focus of dental education research for decades and has been claimed to be cornerstone in the SRL process. METHODS: This is quasi-experimental study conducted at Damascus University Faculty of Dental Medicine, Syria. A modified direct observation of procedural skills (DOPS) assessment protocol with a self-assessment component was applied to a convenience sample of students across five clinical encounters in 2022. Data were collected during clinical training on the DOPS form and at the end of the experiment using a structured questionnaire with a single open-ended question. The qualitative part of the study followed a deductive theory-informed content analysis approach, relying on Zimmerman SRL theory. RESULTS: A total number of 32 students participated in the study, eight of whom were male. During the experiment assessment, participants showed overwhelming positive attitudes towards the utility of self-assessment (m ≥ 3.5; max:4) and the overall assessment method (3.3 ≥ m ≥ 3.5; max:4). Cronbach's alpha for the post-experiment questionnaire was 0.888. A total of 84.4% of the participants strongly agreed that self-assessment is useful in clinical training. Data collected (qualitative and quantitative) from participants revealed the positive effects of self-assessment on all three phases of SRL, especially the reflection phase. CONCLUSION: Self-assessment practice and training showed positive results in terms of improving SRL and performance in a clinical context; SRL appeared to be affected by self-assessment in all phases (forethought, performance, and reflection). Participants' perceptions of self-assessment were generally very positive. These findings imply the potential benefits of applying self-assessment training interventions to foster the SRL ability of learners within the clinical context.

Evaluation of the Undergraduate Learning Environment at Dental Schools in Syria.

OBJECTIVE: The learning environment plays a vital role in dental education. A positive learning environment could improve students' satisfaction, psychosocial well-being, and academic achievement. This study set out to measure the quality of the learning environment according to the Dundee Ready Educational Environment Measure (DREEM) at different dental schools in Syria. METHODS: The study included dental schools at Damascus University (DU), Tishreen University (TU), and University of Hama (HU). DU and TU are considered 2 of the largest universities in Syria. Students across all years of study were invited to complete an Arabic version of the DREEM questionnaire. RESULTS: In total, 1205 students completed the questionnaire: 650 were from DU, 309 from HU, and 243 from TU. Cronbach's alpha value of the DREEM instrument was 0.927. The total DREEM score for all universities was 108.8 ± 31.5 (n = 1205), which is 54.4% of the total score; DU scored the lowest on the DREEM scale (105.9 ± 28.5) followed by TU (111.1 ± 34.3) and HU (113.3 ± 34.4). There was a significant difference amongst the 3 universities (P = .001) with a small effect size (eta-squared = 0.01). At the subscale level, students' perception of learning (SPL) at DU and TU was perceived unfavourably, and the social self-perception of students (SSP) was negatively perceived across all universities. Clinical students scored significantly lower than their preclinical counterparts. No significant difference emerged between male and female students. CONCLUSIONS: This study provides a baseline data on the learning environment at dental schools in Syria. Although the study suggests a more positive than negative perception of the learning environment, Syrian dental schools scored considerably lower than their Arab and international counterparts. Aspects related to SPL and SSP were the most serious areas requiring improvement, and future research should focus on designing proper interventions to address them.

Major Stress Sources Amongst Dental Students at Damascus University, Syria.

INTRODUCTION: Stress amongst dental students is frequently reported. Various environmental, socioeconomic, and cultural factors affect students' perceived stress levels. The aim of this study was to investigate stress levels and sources amongst undergraduate dental students at Damascus University, Syria. METHODS: A cross-sectional design was used. A questionnaire was undertaken in 2019 at the Faculty of Dentistry at Damascus University. Students participated voluntarily in the survey. The sample comprised students at the preclinical and clinical stage. A modified 29-item version of the validated Dental Environmental Stress (DES) questionnaire with a 5-point scale (1 = not stressful to 5 = extremely stressful) was used as the measurement tool. Ethical approval was granted by Damascus University. RESULTS: In all, 365 students participated in the study, with a response rate of 96% (365/379). Cronbach's alpha was 0.83, indicating good reliability of the measurement tool. The overall mean score of the perceived stress was 2.64 (95% confidence interval [CI], 2.5-2.7). The mean scores for clinical factors, academic work, educational environment, personal factors, and living accommodation were 3.22 (95% CI, 3.1-3.3), 3.17 (95% CI, 3.1-3.2), 2.99 (95% CI, 2.9-3.0), 2.15 (95% CI, 2.1-2.2), 2.15 (95% CI, 2.0-2.2), respectively. The specific stressors with the highest mean scores were lack of dental equipment and difficulty in finding requested clinical cases; the respective means were 4.1 (95% CI, 4.0-4.2) and 3.9 (95% CI, 3.8-4.0). CONCLUSIONS: The findings revealed moderate stress levels amongst students. The major stress factors pertained to stressors from the clinical, academic, and educational environment domains. Certain clinical and environmental stressors, such as difficulty in finding clinical cases and lack of dental equipment, were more powerful than the strongest academic stressors, such as examinations and grades and amount of assigned work.

Gauging the learning environment at Damascus University Pharmacy School in Syria using the DREEM questionnaire: A cross-sectional study.

Introduction: This study was undertaken to provide the first record of evaluation of the educational environment of the Bachelor of Pharmacy program at Damascus University (DU), Syria using the internationally adopted Dundee Ready Education Environment Measure (DREEM) tool and compare it with other pharmacy schools around the world. Methods: A cross-sectional study was conducted at DU Pharmacy School in 2022. The validated DREEM 50-item inventory was added to Google Forms and used to collect data electronically. River sampling and snowball sampling methods were used. Data was collected during the second term between April 2022 and June 2022. Students from all years were included. Results: A total of 269 students completed the questionnaire; that is about 6.7% of the total population. The Cronbach's alpha of the DREEM questionnaire was 0.94. The total DREEM score was 89.8±32.1/200. Senior students scored significantly less on the DREEM scale than their younger counterparts. DU Pharmacy School scored significantly less on the total DREEM score than its other counterparts around the world with a large effect size (d>0.80). All subscales scored below 50% and the lowest scoring subscales were students' perception of learning (SPL=41.8%) and students' perception of the social environment (SSP=42.5%). Conclusions: The findings implied that the educational environment is in need of major improvement, especially in areas related to teaching and learning practices and the general social environment; failure to address the current issues in the learning environment might hinder learning and clinical practice of the future generation of pharmacists. This study provides a quality improvement map which could be used preciously address the areas that need most attention at DU Pharmacy School.

Peer-assessment ability of trainees in clinical restorative dentistry: can it be fostered?

OBJECTIVES: The study was conducted to investigate whether peer-assessment among dental students at the clinical stage can be fostered and become closer to that of experienced faculty assessors. METHODS: A prospective pilot study was conducted in 2021 at the Faculty of Dentistry, Damascus University. Sixteen 5th year clinical students volunteered to participate in the study. A modified version of the validated Peer Direct Observation of Procedural Skills (Peer-DOPS) assessment form was used together with a grading rubric. Participants undertook peer-assessment on their colleagues across three encounters. The difference between peers and faculty assessment was the main variable. RESULTS: The mean difference between peers and faculty assessment decreased after each encounter with a significant difference and a medium effect size between the first and third encounters (p = 0.016, d = 0.67). Peer-assessment was significantly higher than faculty, however, the overestimation declined with each encounter reducing the difference between peer- and faculty assessment. Peers' perception of the educational benefit of conducting assessment was overwhelmingly positive, reporting improvements in their own performance. CONCLUSION: This pilot study provides preliminary evidence that dental students assessment ability of their peers can be fostered and become closer to that of experienced faculty assessment with practice and assessment-specific instruction.

Bridging the gap between self-assessment and faculty assessment of clinical performance in restorative dentistry: A prospective pilot study.

PURPOSE/OBJECTIVES: The current study was undertaken to investigate whether self-assessment of clinical skills of undergraduate dental students could be bridged with faculty assessment by deliberate training over an extended period. A secondary aim was to explore students' perception of self-assessment and its effect on their learning and motivation. MATERIAL AND METHODS: A prospective pilot study was conducted at the Department of Restorative Dentistry at Damascus University. Sixteen students participated in the study, ranging in age between 22 and 23 years. A modified Direct Observation of Procedural Skills form with a grading rubric was used to register and guide students' self-assessment; both were pretested on four students before the study. In total, four clinical encounters were completed by each student. Students were trained on how to conduct proper self-assessment before and after each clinical encounter. A postcourse questionnaire was used to investigate students' perception of self-assessment. RESULTS: Bias in self-assessment decreased consistently after each encounter, and the difference in bias between the first (bias = 0.77) and the last encounter (bias = 0.21) was significant with a medium effect size (p = .022, d = 0.64). The percentage of disconfirming performance dimensions decreased from 39.7% to 26.9%. Students' ability to exactly pinpoint strengths improved consistently and significantly. However, their ability to pinpoint areas of improvement was volatile and showed no significant difference. Bland-Altman graph plots showed higher levels of agreement between self-assessment and faculty assessment. Moreover, students' perception of self-assessment was very positive overall. CONCLUSIONS: These findings suggest the possibility that the gap between self-assessment and faculty assessment could be bridged through deliberate training. Future longitudinal research using a larger sample size is still required to further explore whether self-assessment can be actively bridged with faculty assessment by deliberate training.