Insights into undergraduate medical student selection tools: a systematic review and meta-analysis.

PURPOSE: Evaluating medical school selection tools is vital for evidence-based student selection. With previous reviews revealing knowledge gaps, this meta-analysis offers insights into the effectiveness of these selection tools. METHODS: A systematic review and meta-analysis were conducted applying the following criteria: peer-reviewed articles available in English, published from 2010 and which include empirical data linking performance in selection tools with assessment and dropout outcomes of undergraduate entry medical programs. Systematic reviews, meta-analyses, general opinion pieces, or commentaries were excluded. Effect sizes (ESs) of the predictability of academic and clinical performance within and by the end of the medicine program were extracted, and the pooled ESs were presented. RESULTS: Sixty-seven out of 2,212 articles were included, which yielded 236 ESs. Previous academic achievement predicted medical program academic performance (Cohen's d=0.697 in early program; 0.619 in end of program) and clinical exams (0.545 in end of program). Within aptitude tests, verbal reasoning and quantitative reasoning predicted academic achievement in the early program and in the last years (0.704 & 0.643, respectively). Overall aptitude tests predicted academic achievement in both the early and last years (0.550 & 0.371, respectively). Neither panel interviews, multiple mini-interviews, nor situational judgement tests (SJT) yielded statistically significant pooled ES. CONCLUSION: Current evidence suggests that learning outcomes are predicted by previous academic achievement and aptitude tests. The predictive value of SJT and topics such as selection algorithms, features of interview (e.g., content of the questions) and the way the interviewers' reports are used, warrant further research.

Establishing Minimal Clinically Important Differences (MCIDs) for the Pemphigus Disease Area Index (PDAI).

BACKGROUND: Pemphigus is a rare autoimmune blistering disease (AIBD) with potentially life-threatening consequences. Establishing minimal clinically important differences (MCIDs) for disease severity scores like the Pemphigus Disease Area Index (PDAI) is crucial for assessing treatment efficacy. OBJECTIVE: To calculate MCIDs for both improvement and deterioration in PDAI scores in patients with pemphigus vulgaris (PV) and pemphigus foliaceous (PF) using the anchor-based method. METHODS: A total of 41 pemphigus patients were recruited, with 35 meeting the MCID analysis criteria. The anchor-based method was employed to calculate MCIDs for PDAI scores against the 15-point Likert scale and the Physician Global Assessment Visual Analogue Scale (PGA-VAS) anchors. Receiver operating characteristic (ROC) curves were employed to determine optimal MCID cutpoints with the highest Youden Index (J). The 15-point Likert scale scores the change in disease severity spanning from -7 to +7, designed to quantify the extent of disease improvement/deterioration since the preceding visit. RESULTS: The MCID for improvement in PDAI activity scores was 2.65 points using the 15-point Likert scale (78.7% correct classification; sensitivity 75.9%; specificity 73.5%) and 2.5 points using the PGA-VAS as the anchor (78.0% correct classification; sensitivity 84.4%; specificity 68.2%). Given the slightly higher correct classification rate using the 15-point Likert scale anchor, the MCID of 2.65 points was selected for PDAI activity score improvement. In contrast, MCID for deterioration consistently remained at 2.5 points for the 15-point Likert scale anchor (81.0% correct classification; sensitivity 72.7%; specificity 81.0%) and 2.5 points for the PGA-VAS anchor (70.9% correct classification; sensitivity 69.6%; specificity 76.9%). CONCLUSION: This study marks the inaugural attempt at MCID determination for PDAI scores in pemphigus, filling a critical knowledge gap. The study's calculated MCIDs provide essential benchmarks for clinical trials, treatment evaluation, and research design optimisation. Future studies should explore international collaborations to examine potential cross-cultural variations in MCIDs.

"Excited When They See Their Name in Print": Research Outputs from an Australian Medical Program.

To promote evidence-based practice, medical schools offer students opportunities to undertake either elective or mandatory research projects. One important measure of the research program success is student publication rates. In 2006, UNSW Medicine implemented a mandatory research program in the 4th year of the undergraduate medical education program. This study identified student publication rates and explored student and supervisor experiences with the publication process. A retrospective audit of student publications from the 2007, 2011, and 2015 cohorts was undertaken to look at trends over time. Data collected included type of publication and study methodology. Semi-structured interviews were conducted with a sample of undergraduate students (n = 11), medical graduates (n = 14), and supervisors (n = 25) and analysed thematically. Student publication rates increased significantly (P = 0.002) from 28% in 2007 to 50.2% in 2015. Students able to negotiate their own project were more likely to publish (P = 0.02). Students reported personal affirmation and development of research skills from publishing their research findings, while graduates noted improved career opportunities. Supervisors expected students to publish but identified the time to publications and student motivation as key factors in achieving publication(s). A high publication rate is possible in a mandatory research program where students can negotiate their own topic and are given protected time. Publications happen after the research project has finished. Critical factors in successful publication include supervisor support and student motivation. Given the importance of the supervisor's role, staff development and faculty support to train and develop a body of skilled supervisors is required.

A Systematic Review of Ophthalmology Education in Medical Schools: The Global Decline.

TOPIC: This systematic review examined geographical and temporal trends in medical school ophthalmology education in relationship to course and student outcomes. CLINICAL RELEVANCE: Evidence suggesting a decline in ophthalmology teaching in medical schools is increasing, raising concern for the adequacy of eye knowledge across the rest of the medical profession. METHODS: Systematic review of Embase and SCOPUS, with inclusion of studies containing data on medical school ophthalmic course length; 1 or more outcome measures on student ophthalmology knowledge, skills, self-evaluation of knowledge or skills, or student course appraisal; or both. The systematic review was registered prospectively on the International Prospective Register of Systematic Reviews (identifier, CRD42022323865). Results were aggregated with outcome subgroup analysis and description in relationship to geographical and temporal trends. Descriptive statistics, including nonparametric correlations, were used to analyze data and trends. RESULTS: Systematic review yielded 4596 publication titles, of which 52 were included in the analysis, with data from 19 countries. Average course length ranged from 12.5 to 208.7 hours, with significant continental disparity among mean course lengths. Africa reported the longest average course length at 103.3 hours, and North America reported the shortest at 36.4 hours. On average, course lengths have been declining over the last 2 decades, from an average overall course length of 92.9 hours in the 2000s to 52.9 hours in the 2020s. Mean student self-evaluation of skills was 51.3%, and mean student self-evaluation of knowledge was 55.4%. Objective mean assessment mark of skills was 57.5% and that of knowledge was 71.7%, compared with an average pass mark of 66.7%. On average, 26.4% of students felt confident in their ophthalmology knowledge and 34.5% felt confident in their skills. DISCUSSION: Most evidence describes declining length of courses devoted to ophthalmology in the last 20 years, significant student dissatisfaction with courses and content, and suboptimal knowledge and confidence. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study

PURPOSE: This study aimed to devise a valid measurement for assessing clinical students' perceptions of teaching practices. METHODS: A new tool was developed based on a meta-analysis encompassing effective clinical teaching-learning factors. Seventy-nine items were generated using a frequency (never to always) scale. The tool was applied to the University of New South Wales year 2, 3, and 6 medical students. Exploratory and confirmatory factor analysis (exploratory factor analysis [EFA] and confirmatory factor analysis [CFA], respectively) were conducted to establish the tool's construct validity and goodness of fit, and Cronbach's α was used for reliability. RESULTS: In total, 352 students (44.2%) completed the questionnaire. The EFA identified student-centered learning, problem-solving learning, self-directed learning, and visual technology (reliability, 0.77 to 0.89). CFA showed acceptable goodness of fit (chi-square P<0.01, comparative fit index=0.930 and Tucker-Lewis index=0.917, root mean square error of approximation=0.069, standardized root mean square residual=0.06). CONCLUSION: The established tool­Student Ratings in Clinical Teaching (STRICT)­is a valid and reliable tool that demonstrates how students perceive clinical teaching efficacy. STRICT measures the frequency of teaching practices to mitigate the biases of acquiescence and social desirability. Clinical teachers may use the tool to adapt their teaching practices with more active learning activities and to utilize visual technology to facilitate clinical learning efficacy. Clinical educators may apply STRICT to assess how these teaching practices are implemented in current clinical settings.

Telemedicine vs Face-to-Face for Nursing Home Residents With Acute Presentations: A Noninferiority Study.

OBJECTIVES: Telemedicine and face-to-face outreach services to nursing homes (NHs) have been used to reduce hospital utilization rates for acute presentations. However, how these modalities compare against each other is unclear. This article examines if the management of acute presentations in NHs with care involving telemedicine is noninferior to care delivered face-to-face. DESIGN: A noninferiority study was conducted on a prospective cohort. Face-to-face intervention involved on-site assessment by a geriatrician and aged care clinical nurse specialist (CNS). Telemedicine intervention involved on-site assessment by an aged care CNS with telemedicine input by a geriatrician. SETTING AND PARTICIPANTS: A total of 438 NH residents with acute presentations from 17 NHs between November 2021 and June 2022. METHODS: Between-group differences in proportion of residents successfully managed on-site and mean number of encounters were evaluated using bootstrapped multiple linear regression; 95% CIs were compared against predefined noninferiority margins with noninferiority P values calculated. RESULTS: In the adjusted models, care involving telemedicine demonstrated noninferiority in the difference in proportion of residents successfully managed on-site (95% CI lower limit -6.2% to -1.4% vs -10% noninferiority margin; P < .001 for noninferiority) but not in the difference in mean number of encounters (95% CI upper limit 1.42 to 1.50 encounters vs 1 encounter noninferiority margin; P = .7 for noninferiority). CONCLUSIONS AND IMPLICATIONS: In our model of care, care that involved telemedicine was noninferior to care delivered face-to-face in managing NH residents with acute presentations on-site. However, additional encounters may be required. Application of telemedicine ought to be tailored to fit the needs and preferences of stakeholders.

Screening for Media Use in the Emergency Department Among Young Australians: Cross-sectional Study.

BACKGROUND: Research on problematic internet use has largely adhered to addiction paradigms, possibly impeding the identification of specific internet behaviors related to psychopathology. This study presents a novel approach to screening for specific problematic internet behaviors by using a new measure, the emergency department media use screener (EDMUS). OBJECTIVE: The purpose of this study was to identify patterns of internet use in young people presenting with mental health concerns to the emergency department (ED), ascertain associations with their mental health, and evaluate whether the EDMUS can be used to predict subsequent ED presentations within 3 months. METHODS: This cross-sectional retrospective study of Australian young people (N=149, aged 11-25 years; female: n=92, 61.7%) sought to use the EDMUS, a 24-item questionnaire, to identify problematic internet behaviors, including accessing or posting prosuicidal or proeating disorder content, cyberbullying, and inappropriate digital content. Data on each person's mental health were extracted from electronic medical records to look for associations with EDMUS responses and ED re-presentation over 3 months. EDMUS items were grouped into clusters for analysis using chi-square tests, binary logistic regression, and path analyses. RESULTS: Sharing suicidal digital content was the most common problematic internet use pattern identified by the EDMUS. However, this did not correlate with having a prior mental health diagnosis or predict readmission. Most participants had families with a concern for their internet use; however, this was less likely in participants with a diagnosis of personality disorder. Diagnoses of personality disorder or posttraumatic stress disorder were independent predictors of readmission (P=.003; P=.048). CONCLUSIONS: Although a history of complex psychopathology increases the likelihood of subsequent ED presentations, its links to internet use-related behaviors are still unclear. The EDMUS has potential for identifying young people who are most vulnerable to problematic internet behaviors and offers the opportunity for early intervention and potential prevention of more entrenched difficulties.

What impacts students' satisfaction the most from Medicine Student Experience Questionnaire in Australia: a validity study.

PURPOSE: This study evaluated the validity of student feedback derived from Medicine Student Experience Questionnaire (MedSEQ), as well as the predictors of students' satisfaction in the Medicine program. METHODS: Data from MedSEQ applying to the University of New South Wales Medicine program in 2017, 2019, and 2021 were analyzed. Confirmatory factor analysis (CFA) and Cronbach's α were used to assess the construct validity and reliability of MedSEQ respectively. Hierarchical multiple linear regressions were used to identify the factors that most impact students' overall satisfaction with the program. RESULTS: A total of 1,719 students (34.50%) responded to MedSEQ. CFA showed good fit indices (root mean square error of approximation=0.051; comparative fit index=0.939; chi-square/degrees of freedom=6.429). All factors yielded good (α>0.7) or very good (α>0.8) levels of reliability, except the "online resources" factor, which had acceptable reliability (α=0.687). A multiple linear regression model with only demographic characteristics explained 3.8% of the variance in students' overall satisfaction, whereas the model adding 8 domains from MedSEQ explained 40%, indicating that 36.2% of the variance was attributable to students' experience across the 8 domains. Three domains had the strongest impact on overall satisfaction: "being cared for," "satisfaction with teaching," and "satisfaction with assessment" (ß=0.327, 0.148, 0.148, respectively; all with P<0.001). CONCLUSION: MedSEQ has good construct validity and high reliability, reflecting students' satisfaction with the Medicine program. Key factors impacting students' satisfaction are the perception of being cared for, quality teaching irrespective of the mode of delivery and fair assessment tasks which enhance learning.

Factors predicting rural location employment intent and choice among medical students and graduates.

PURPOSE: Workforce shortage is a contributing cause of health inequality in rural Australia. There is inconclusive evidence demonstrating which factors cause doctors to choose rural practice. This study's objective is to determine predictive factors for medical students' intent to work rurally and for graduates' current rural employment location choice. METHODS: This prospective cohort study, utilized data gathered from the University of New South Wales about students and graduates who had spent one or more years in a Rural Clinical School. Participants were final year students and graduates already working in Australia. Stepwise logistic regression was used to determine predictive factors for the two outcomes. RESULTS: Predictors for student intent to work rurally are rural background (odds ratio [OR], 7.16; 95% confidence interval [CI], 2.59-19.53), choosing to study at the Rural Clinical School (OR, 8.72; 95% CI, 1.32-57.63), and perceiving rural areas as opportunistic for career advancement (OR, 1.69; 95% CI, 1.15-2.49). Predictors for graduates currently working in a rural location are Bonded Medical Program participation (OR, 6.40; 95% CI, 1.15-35.59) and personal altruism (OR, 1.91; 95% CI, 1.02-3.57). CONCLUSION: While intent is predicted by having a rural background, choosing to study at the Rural Clinical School and perception of rural areas as having positive career opportunities, a current rural workplace location among graduates is predicted by holding a bonded medical position and a desire to serve an under-resourced population. Maintaining the Bonded Medical Program and clear communication regarding training pathways may increase numbers of rural doctors.

Medical student selection process enhanced by improving selection algorithms and changing the focus of interviews in Australia: a descriptive study

PURPOSE: The study investigates the efficacy of new features introduced to the selection process for medical school at the University of New South Wales, Australia: (1) considering the relative ranks rather than scores of the Undergraduate Medicine and Health Sciences Admission Test and Australian Tertiary Admission Rank; (2) structured interview focusing on interpersonal interaction and concerns should the applicants become students; and (3) embracing interviewers' diverse perspectives. METHODS: Data from 5 cohorts of students were analyzed, comparing outcomes of the second year in the medicine program of 4 cohorts of the old selection process and 1 of the new process. The main analysis comprised multiple linear regression models for predicting academic, clinical, and professional outcomes, by section tools and demographic variables. RESULTS: Selection interview marks from the new interview (512 applicants, 2 interviewers each) were analyzed for inter-rater reliability, which identified a high level of agreement (kappa=0.639). No such analysis was possible for the old interview since it required interviewers to reach a consensus. Multivariate linear regression models utilizing outcomes for 5 cohorts (N=905) revealed that the new selection process was much more effective in predicting academic and clinical achievement in the program (R2=9.4%­17.8% vs. R2=1.5%­8.4%). CONCLUSION: The results suggest that the medical student selection process can be significantly enhanced by employing a non-compensatory selection algorithm; and using a structured interview focusing on interpersonal interaction and concerns should the applicants become students; as well as embracing interviewers' diverse perspectives.

Equal Z standard-setting method to estimate the minimum number of panelists for a medical school's objective structured clinical examination in Taiwan: a simulation study

PURPOSE: Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method. METHODS: The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school's final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station. RESULTS: On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts. CONCLUSION: The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.

Medical school grades may predict future clinical competence.

BACKGROUND: In real-world medical education, there is a lack of reliable predictors of future clinical competencies. Hence, we aim to identify the factors associated with clinical competencies and construct a prediction model to identify "improvement required" trainees. METHODS: We analyzed data from medical students who graduated from National Yang-Ming University with clerkship training and participated in the postgraduate year (PGY) interview at Taipei Veterans General Hospital. Clinical competencies were evaluated using grades of national objective structured clinical examination (OSCEs). This study used data from medical students who graduated in July 2018 as the derivation cohort (N = 50) and those who graduated in July 2020 (n = 56) for validation. RESULTS: Medical school grades were associated with the performance of national OSCEs (Pearson r = 0.34, p = 0.017), but the grades of the structured PGY interviews were marginally associated with the national OSCE (Pearson r = 0.268, p = 0.06). A prediction model was constructed to identify "improvement required" trainees, defined: trainees with the lowest 25% of scores in the national OSCEs. According to this model, trainees with the lowest 25% medical school grades predicted a higher risk of the "improvement required" clinical performance (Q1-Q3 vs Q4 = 15% vs 60%, odds ratio = 8.5 [95% confidence interval = 1.8-39.4], p = 0.029). In the validation cohort, our prediction model could accurately classify 76.7% "improvement required" and "nonimprovement required" students. CONCLUSION: Our study suggests that interventions for students with unsatisfactory medical school grades are warranted to improve their clinical competencies.

Faculty appointment and promotion in Taiwan's medical schools, a systematic analysis.

BACKGROUND: A rigorous faculty appointment and promotion (FAP) system is vital for the success of any academic institution. However, studies examining the FAP system in Asian universities are lacking. We surveyed the FAP policies of Taiwan's medical schools and identified an overreliance on the CJA score (manuscript Category, Journal quality, and Author order). The potential shortcomings of this metric and recommendations for refinement were discussed. METHODS: We obtained the FAP documents from all 12 medical schools in Taiwan, and analyzed their use of traditional versus non-traditional criteria for FAP according to a published methodology. The influence of the journal impact factor (JIF) on the FAP process was quantified by comparing its relative weight between papers with two extreme JIFs. To better understand the research impact and international standing of each school, we utilized the public bibliographic database to rank universities by the number of papers, and the proportions of papers within the top 10% or 50% citation. RESULTS: Compared with other countries, Taiwan's medical schools focus more on the quantifiable quality of the research, mostly using a "CJA" score that integrates the category, JIF or ranking, and authorship of a paper, with the JIF being the most influential factor. The CJA score for an article with a JIF of 20 can be up to three times the threshold for promotion to Assistant Professor. The emphasis on JIF is based on a presumed correlation between JIF and citation counts. However, our analysis shows that Taiwan's medical schools have lower-than-average citation counts despite a competitive rank in the number of publications. CONCLUSIONS: The JIF plays an unrivaled role in determining the outcome of FAP in Taiwan's medical schools, mostly via the CJA system. The questionable effectiveness of the current system in elevating the international standing of Taiwan's higher-education institutions calls for a re-examination of the FAP system. We recommend a reduction in the relative importance of CJA score in the FAP system, adopting more rigorous metrics such as the h-index for evaluating research quality, and supporting more research aimed at improving the FAP system.

Implementing a flipped classroom model in an evidence-based medicine curriculum for pre-clinical medical students: evaluating learning effectiveness through prospective propensity score-matched cohorts.

BACKGROUND: In a flipped classroom (FC) model, blended learning is used to increase student engagement and learning by having students finish their readings at home and work on problem-solving with tutors during class time. Evidence-based medicine (EBM) integrates clinical experience and patient values with the best evidence-based research to inform clinical decisions. To implement a FC and EBM, students require sufficient information acquisition and problem-solving skills. Therefore, a FC is regarded as an excellent teaching model for tutoring EBM skills. However, the effectiveness of a FC for teaching EBM competency has not been rigorously investigated in pre-clinical educational programs. In this study, we used an innovative FC model in a pre-clinical EBM teaching program. METHODS: FC's teaching was compared with a traditional teaching model by using an assessment framework of prospective propensity score matching, which reduced the potential difference in basic characteristics between the two groups of students on 1:1 ratio. For the outcome assessments of EBM competency, we used an analysis of covariance and multivariate linear regression analysis to investigate comparative effectiveness between the two teaching models. A total of 90 students were prospectively enrolled and assigned to the experimental or control group using 1:1 propensity matching. RESULTS: Compared with traditional teaching methods, the FC model was associated with better learning outcomes for the EBM competency categories of Ask, Acquire, Appraise, and Apply for both written and oral tests at the end of the course (all p-values< 0.001). In particular, the "appraise" skill for the written test (6.87 ± 2.20) vs. (1.47 ± 1.74), p < 0.001), and the "apply" skill for the oral test (7.34 ± 0.80 vs. 3.97 ± 1.24, p < 0.001) had the biggest difference between the two groups. CONCLUSIONS: After adjusting for a number of potential confunding factors, our study findings support the effectiveness of applying an FC teaching model to cultivate medical students' EBM literacy.

Comparison of OSCE performance between 6- and 7-year medical school curricula in Taiwan.

BACKGROUND: The year 2013 marks a watershed in the history of medical education in Taiwan. Following Taiwan's Taskforce of Medical School Curriculum Reform recommendations, the medical school curriculum was reduced from 7 to 6 years. This study aimed to analyze the impact of medical school curriculum reform on medical students' performance in objective structured clinical examinations (OSCEs). METHODS: We retrospectively analyzed the OSCE records at Taipei Veterans General Hospital (Taipei VGH), one of Taiwan's largest tertiary medical centers, between November 2016 and July 2020. The eligibility criteria were medical students receiving a full one-year clinical sub-internship training at Taipei VGH and in their last year of medical school. All medical students received a mock OSCE-1 at the beginning of their sub-internship, a mock OSCE-2 after six months of training, and a national OSCE at the end of their sub-internship. The parameters for performance in OSCEs included "percentage of scores above the qualification standard" and "percentage of qualified stations." RESULTS: Between November 2016 and July 2020, 361 undergraduates underwent clinical sub-internship training at Taipei VGH. Among them, 218 were taught under the 7-year curriculum, and 143 were instructed under the 6-year curriculum. Based on baseline-adjusted ANCOVA results, medical students under the 7-year curriculum had a higher percentage of scores above the qualification standard than those under the 6-year curriculum at the mock OSCE-1 (7-year curriculum vs. 6-year curriculum: 33.8% [95% CI 32.0-35.7] vs. 28.2% [95% CI 25.9-30.4], p < 0.001), and mock OSCE-2 (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 87.4-91.4] vs. 84.0% [95% CI 81.5-86.4], p = 0.001). Moreover, medical students in the 7-year curriculum had a higher percentage of qualified stations in mock OSCE-1 (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 87.4-91.4] vs. 84.0% [95% CI 81.5-86.4], p = 0.001) and mock OSCE-2 (7-year curriculum vs. 6-year curriculum: 91.9% [95% CI 90.1-93.8] vs. 86.1% [95% CI 83.8-88.3], p = 0.001). After clinical sub-internship training, there were no differences in the percentage of scores above the qualification standard (7-year curriculum vs. 6-year curriculum: 33.5% [95% CI 32.2-34.9] vs. 34.6 [95% CI 32.9-36.3], p = 0.328) and percentage of qualified stations (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 88.1-90.7] vs. 90.2% [95% CI 88.6-91.8], p = 0.492). CONCLUSIONS: At the beginning of the sub-internship, medical students under the 7-year curriculum had better OSCE performance than those under the 6-year curriculum. After the clinical sub-internship training in Taipei VGH, there was no difference in the national OSCE score between the 6- and 7-year curricula. Our study suggests that clinical sub-internship is crucial for the development of clinical skills and performance in the national OSCE.

Immersive virtual reality (VR) training increases the self-efficacy of in-hospital healthcare providers and patient families regarding tracheostomy-related knowledge and care skills: A prospective pre-post study.

BACKGROUND: Virtual reality (VR)-based simulation in hospital settings facilitates the acquisition of skills without compromising patient safety. Despite regular text-based training, a baseline survey of randomly selected healthcare providers revealed deficiencies in their knowledge, confidence, comfort, and care skills regarding tracheostomy. This prospective pre-post study compared the effectiveness of regular text- and VR-based intervention modules in training healthcare providers' self-efficacy in tracheostomy care skills. METHODS: Between January 2018 and January 2020, 60 healthcare providers, including physicians, nurses, and respiratory therapists, were enrolled. For the intervention, a newly developed head-mounted display (HMD) and web VR materials were implemented in training and clinical services. Subsequently, in-hospital healthcare providers were trained using either text or head-mounted display virtual reality (HMD-VR) materials in the regular and intervention modules, respectively. For tracheostomy care skills, preceptors directly audited the performance of trainees and provided feedback. RESULTS: At baseline, the degree of trainees' agreement with the self-efficacy-related statements, including the aspects of familiarity, confidence, and anxiety about tracheostomy-related knowledge and care skills, were not different between the control and intervention groups. At follow-up stage, compared with the regular group, a higher percentage of intervention group' trainees reported that they are "strongly agree" or "somewhat agree" that the HMD-VR simulation increases their self-efficacy, including the aspects of familiarity and confidence, and reduced their anxiety about tracheostomy-related knowledge and care skills. After implementation, a higher degree of trainees' average satisfaction with VR-based training and VR materials was observed in the intervention group than in the regular group. Most reported that VR materials enabled accurate messaging and decreased anxiety. The increasing trend of the average written test and hands-on tracheostomy care skills scores among the intervention group trainees was significant compared to those in the regular group. The benefits of HMD-VR simulations and web-VR material-based clinical services for in-hospital healthcare providers and patient families persisted until 3 to 4 weeks later. CONCLUSION: The current study suggests that VR materials significantly enhance trainees' self-efficacy (increased familiarity, increased confidence, and reduced anxiety) and their satisfaction with the training, while motivating them to use acquired knowledge and skills in clinical practice.

Medical students' perception of an online dental trauma course in medical education.

BACKGROUND: With dental trauma education not commonly offered in medicine programmes, offering an online learning course may fill the knowledge deficiency for medical students. The aim of this study is to evaluate medical students' perceptions of an online dental trauma course. MATERIAL AND METHODS: This was a cross-sectional questionnaire study conducted among medical students at an Australian University. Exploratory factor analysis was used to identify the underlying factor structure within the items. Cronbach's alpha was employed to estimate the factors' reliability. Confirmatory factor analysis was used to assess construct validity; SPSS v22 and AMOIS v22 were used for data analyses. RESULTS: Exploratory factor analysis identified two distinct factors: 'visual' and 'content', with excellent reliability for visual (Cronbach's alpha = 0.911) and good reliability for content (Cronbach's alpha = 0.755). CONCLUSIONS: This research supports the findings that medical students perceived the online dental trauma course to be easily understood for self-learning this topic.

Developing a prototype dental trauma e-learning course for medical education.

This article aims to demonstrate how an expert feedback process was used to identify emerging issues within a prototype extracurricular course on dental trauma and show how the feedback was addressed prior to piloting the course more widely. Dowse's Design Research Model was adapted for the design and development of a prototype dental trauma e-learning course. This paper will focus on step five, gathering expert feedback and the evaluation process. Four critical features emerged from the feedback that ought to be incorporated into the e-learning course design, namely, 1) keep resources clinically relevant; 2) keep resources simple to learn; 3) make resources easy to understand; and 4) support self-learning. The results demonstrate the value of an expert feedback process for improving a prototype designed to address a major gap in knowledge among medical doctors identified in the literature.

It's what you do, not the way you do it - online versus face-to-face small group teaching in first year medical school.

BACKGROUND: Major disruptions imposed on medical education by the COVID-19 pandemic and the rapid shift to online teaching in medical programs, necessitated need for evaluation of this format. In this study we directly compared knowledge outcomes, social outcomes, and wellbeing of first year student small group teaching in either face to face (f2f) or online format. METHODS: At the end of the first course of our medical program, students were invited to participate in an online questionnaire with 10 quantitative items and 1 qualitative item. These were analysed using Factor Analysis Pattern Matrix and linear regression to group items and assess relatedness. Qualitative responses were thematized using Qualtrics software (Qualtrics, Provo, UT, USA). Summative assessment results were compared, both between current cohorts to historical cohorts. RESULTS: From a cohort of 298 students there was a 77% response rate. Overall, there were no differences in knowledge gains, either between groups or when compared to historical cohorts. Questionnaire items fell reliably into groups that related to either learning outcomes, social outcomes, or wellbeing. Independent T tests showed that format for teaching (online versus f2f) had an impact on social outcomes but no direct impact on learning outcomes. Linear regression revealed that the social outcomes have a direct impact on wellbeing and almost the double the impact on learning outcomes than mode of learning i.e.. F2f or online (ß = .448 and ß = .232 respectively). CONCLUSION: In this study, we were able to show with statistical strength that social outcomes for students such as engaging with peers and facilitator, contributing to the group, and making friends have a direct impact on wellbeing and indirectly impact learning outcomes (such as motivation, satisfaction, integration of knowledge). In a rapidly changing educational landscape, in our opinion, it is vital that these aspects are a focus of design and delivery of medical education. The data from this study supports the notion that activity design and the expertise of the teacher in facilitating the small group activities, has greater impact than the mode of educational delivery itself on students' learning processes.

Empirical analysis comparing the tele-objective structured clinical examination (teleOSCE) and the in-person assessment in Australia.

PURPOSE: It aimed to compare the use of the tele objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE. METHODS: This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia. RESULTS: In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference -0.277, P<0.001, effect size 0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020. CONCLUSION: The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.