Reforming Physician Licensure in the United States to Improve Access to Telehealth: State, Regional, and Federal Initiatives.

Policy Points The reinstitution of pre-COVID-19 pandemic licensure regulations has impeded interstate telehealth. This has disproportionately impacted patients who live near a state border; geographically mobile patients, such as college students; and patients with rare diseases who may need care from a specialist outside their state. Several promising and feasible reforms are available, at both state and federal levels, to facilitate interstate telehealth. For example, states can offer exemptions to licensure requirements for certain types of telehealth such as follow-up care or create licensure registries that impose little reduced paperwork and fees on physicians. On the federal level, congressional interventions that mimic the Department of Veterans Affairs Maintaining Internal Systems and Strengthening Integrated Outside Networks (VA MISSION) Act of 2018 can waive provider licensing and geographic restrictions to telehealth within certain federal programs such as Medicare. Any discussion of medical licensure reform, however, must also consider the current political climate, one in which states are taking divergent stances on sensitive topics such as reproductive care, gender-affirming care, and substance use treatments.

Performance measurement part I: Foundational knowledge for measure development.

As medicine is moving toward performance and outcome-based payment and is transitioning away from productivity-based systems, value is now being appraised in healthcare through "performance measures." Over the past few decades, assessment of clinical performance in health care has been essential in ensuring safe and cost-effective patient care. The Centers for Medicare & Medicaid Services is further driving this change with measurable, outcomes-based national payer incentive payment systems. With the continually evolving requirements in health care reform focused on value-based care, there is a growing concern that clinicians, particularly dermatologists, may not understand the scientific rationale of health care quality measurement. As such, in order to help dermatologists understand the health care measurement science landscape to empower them to engage in the performance measure development and implementation process, the first article in this 2-part continuing medical education series reviews the value equation, historic and evolving policy issues, and the American Academy of Dermatology's approach to performance measurement development to provide the required foundational knowledge for performance measure developers.

When can we identify the students at risk of failure in the national medical licensure examination in Japan using the predictive pass rate?

CONTEXT: Failure of students to pass the National Medical Licensure Examination (NMLE) is a major problem for universities and the health system in Japan. To assist students at risk for NMLE failure as early as possible after admission, this study investigated the time points (from the time of admission to graduation) at which predictive pass rate (PPR) can be used to identify students at risk of failing the NMLE. METHODS: Seven consecutive cohorts of medical students between 2012 and 2018 (n = 637) at the Gifu University Graduate School of Medicine were investigated. Using 7 variables before admission to medical school and 10 variables after admission, a prediction model to obtain the PPR for the NMLE was developed using logistic regression analysis at five time points, i.e., at admission and the end of the 1st, 2nd, 4th, and 6th grades. All students were divided into high (PPR < 95%) and low (PPR ≥ 95%) risk groups for failing the NMLE at the five time points, respectively, and the movement between the groups during 6 years in school was simulated. RESULTS: Medical students who passed the NMLE had statistically significant factors at each of the 5 time points, and the number of significant variables increased as their grade in school advanced. In addition, two factors extracted at admission were also selected as significant variables at all other time points. Especially, age at entry had a consistent and significant effect during medical school. CONCLUSIONS: Risk analysis based on multiple variables, such as PPR, can inform more effective intervention compared to a single variable, such as performance in the mock exam. A longer prospective study is required to confirm the validity of PPR.

Experts' prediction of item difficulty of multiple-choice questions in the Ethiopian Undergraduate Medicine Licensure Examination.

BACKGROUND: The ability of an expert's item difficulty ratings to predict test-taker actual performance is an important aspect of licensure examinations. Expert judgment is used as a primary source of information for users to make prior decisions to determine the pass rate of test takers. The nature of raters involved in predicting item difficulty is central to set credible standards. Therefore, this study aimed to assess and compare raters' prediction and actual Multiple-Choice Questions' difficulty of the undergraduate medicine licensure examination (UGMLE) in Ethiopia. METHOD: 815 examinees' responses to 200 Multiple-Choice Questions (MCQs) were used in this study. The study also included experts' item difficulty ratings of seven physicians who participated in the standard settings of UGMLE. Then, analysis was conducted to understand experts' rating variation in predicting the actual difficulty levels of examinees. Descriptive statistics was used to profile the mean rater's and actual difficulty value for MCQs, and ANOVA was used to compare the mean differences between raters' prediction of item difficulty. Additionally, regression analysis was used to understand the interrater variations in item difficulty predictions compared to the actual difficulty. The proportion of variance of actual difficulty explained from rater prediction was computed using regression analysis. RESULTS: In this study, the mean difference between raters' prediction and examinees' actual performance was inconsistent across the exam domains. The study revealed a statistically significant strong positive correlation between the actual and predicted item difficulty in exam domains eight and eleven. However, a non-statistically significant very weak positive correlation was reported in exam domains seven and twelve. The multiple comparison analysis showed significant differences in mean item difficulty ratings between raters. In the regression analysis, experts' item difficulty ratings of the UGMLE had 33% power in predicting the actual difficulty level. The regression model also showed a moderate positive correlation (R = 0.57) that was statistically significant at F (6, 193) = 15.58, P = 0.001. CONCLUSION: This study demonstrated the complex process for assessing the difficulty level of MCQs in the UGMLE and emphasized the benefits of using experts' ratings in advance. To ensure the exams maintain the necessary reliable and valid scores, raters' accuracy on the UGMLE must be improved. To achieve this, techniques that align with the evolving assessment methodologies must be developed.

Exploring experiential learning within interprofessional practice education initiatives for pre-licensure healthcare students: a scoping review.

BACKGROUND: Interprofessional collaborative team-based approaches to care in health service delivery has been identified as important to health care reform around the world. Many academic institutions have integrated interprofessional education (IPE) into curricula for pre-licensure students in healthcare disciplines, but few provide formal initiatives for interprofessional practice (IPP). It is recognized that experiential learning (EL) can play a significant role supporting IPP education initiatives; however, little is known of how EL is used within education for IPP in healthcare settings. METHODS: We conducted a scoping review to map peer-reviewed literature describing IPP education initiatives involving EL for pre-licensure students in healthcare disciplines. A literature search was executed in MEDLINE, CINAHL, EMBASE, ERIC, PsycINFO, Scopus, and Social Services Abstracts. After deduplication, two independent reviewers screened titles and abstracts of 5664 records and then 252 full-text articles that yielded 100 articles for data extraction. Data was extracted using an Excel template, and results synthesized for presentation in narrative and tabular formats. RESULTS: The 100 included articles represented 12 countries and IPP education initiatives were described in three main typologies of literature - primary research, program descriptions, and program evaluations. Forty-three articles used a theory, framework, or model for design of their initiatives with only eight specific to EL. A variety of teaching and learning strategies were employed, such as small interprofessional groups of students, team huddles, direct provision of care, and reflective activities, but few initiatives utilized a full EL cycle. A range of perspectives and outcomes were evaluated such as student learning outcomes, including competencies associated with IPP, impacts and perceptions of the IPP initiatives, and others such as client satisfaction. CONCLUSION: Few educational frameworks specific to EL have been used to inform EL teaching and learning strategies to consolidate IPE learning and prepare students for IPP in healthcare settings. Further development and evaluation of existing EL frameworks and models would be beneficial in supporting robust IPP educational initiatives for students in healthcare disciplines. Intentional, thoughtful, and comprehensive use of EL informed by theory can contribute important advances in IPP educational approaches and the preparation of a future health care workforce.

Developing pre-licensure interprofessional and stroke care competencies through skills-based simulations.

Interprofessional collaboration (IPC) in stroke care is accepted as best practice and necessary given the multi-system challenges and array of professionals involved. Our two-part stroke team simulations offer an intentional interprofessional educational experience (IPE) embedded in pre-licensure occupational therapy, physical therapy, pharmacy, medicine, nursing and speech-language pathology curricula. This six-year mixed method program evaluation aimed to determine if simulation delivery differences necessitated by COVID-19 impacted students' IPC perception, ratings, and reported learning. Following both simulations, the Interprofessional Collaborative Competency Assessment Scale (ICCAS) and free-text self-reported learning was voluntarily and anonymously collected. A factorial ANOVA using the ICCAS interprofessional competency factors compared scores across delivery methods. Content and category analysis was done for free-text responses. Overall, delivery formats did not affect positive changes in pre-post ICCAS scores. However, pre and post ICCAS scores were significantly different for interprofessional competencies of roles/responsibilities and collaborative patient/family centered approach. Analysis of over 10,000 written response to four open-ended questions revealed the simulation designs evoked better understanding of others' and own scope of practice, how roles and shared leadership change based on context and client need, and the value of each team member's expertise. Virtual-experience-only students noted preference for an in-person stroke clinic simulation opportunity.

Strategies to expand the distribution of nursing talent in the United States.

This panel paper is the third installment in a six-part Nursing Outlook special edition based on the 2022 Emory Business Case for Nursing Summit. The 2022 summit was led by Emory School of Nursing in partnership with Emory School of Business. It convened national nursing, health care, and business leaders to explore possible solutions to nursing workforce crises, including the nursing shortage. Each of the summit's four panels authored a paper in this special edition on their respective topic(s). This panel paper focuses on strategies to optimally distribute nursing talent in rural and underserved areas. It discusses the role of nursing talent distribution in ensuring equity in access to care for U.S. populations. Topics covered include the need for expanded and standardized advanced practice registered nurse (APRN) scope of practice, an expanded nurse licensure compact, reimbursement reforms, and competitive nursing salaries.

[Internationalization as an innovation in long-term care]. / Internationalisierung als Innovation in der Langzeitpflege.

BACKGROUND: Long-term care in Germany is undergoing a process of internationalization. Against the backdrop of a growing need for skilled workers, personnel are also increasingly being recruited from abroad. OBJECTIVE: The article analyzes the relevance of immigration of skilled workers for the labor market and derives the needs for innovation on the side of companies. MATERIAL AND METHODS: Selected results of the professional recognition statistics are presented and literature-supported innovation needs are worked out. RESULTS AND CONCLUSION: Significant innovation needs lie in the areas of implementation of recognition procedures, operational integration measures and approaches to municipal cooperation.

Nurses' Perceptions of Licensure Compact Legislation to Facilitate Interstate Practice: Results From the 2022 Michigan Nurses' Study.

States are struggling to assure an adequate number of registered nurses are active in the clinical workforce to serve patients and communities. Nurse compact legislation-enacted in 39 states-facilitates interstate recognition of nurse licensure. We used a cross-sectional email survey of registered nurses in Michigan to measure their opinions on compact licensure legislation and examined differences in compact licensure opinions by nurses' personal characteristics. Primary analyses reported herein are from 7,098 Michigan nurses with complete data. Most respondents felt that the compact would make it easier to redeploy nurses in an emergency (76.6%), improve access to nursing care (66.6%), and boost their personal career options (55.1%). Most nurses disagreed that compact legislation would weaken patient protections (60.7%). The majority expressed neutral feelings on whether compact licensure would make disciplinary actions more difficult to enforce (50.9%) and a plurality that current licensure policies were satisfactory (44.0%). The majority were supportive of Michigan joining the compact (72.3%). In multivariable analysis, stronger support for joining the compact was associated with advanced degrees, male sex, and younger age. Less support was associated with membership in a collective bargaining unit. Policymakers who wish to ease acute nurse vacancies should consider enacting nurse licensure compact legislation. Careful attention to patient protections and disciplinary review would address potential safety concerns.

Factors associated with applicant performance on the Saudi Pharmacist Licensure Examination (SPLE).

Background: Limited data are available on factors that are associated with passing rates for the Saudi Pharmacist Licensure Examination (SPLE). The aim of this study is to investigate student characteristics and academic performance characteristics that may predict their success on SPLE. Methods: This was a single-institution retrospective cohort study, which included pharmacy graduates from 2019 to 2021. Demographic, academic, and SPLE data were collected for each graduate. Binary logistic regression was used to explore the association between potential predictors and first-time SPLE pass status. A stepwise regression was then performed to develop multiple logistic models. Results: A total of 494 graduates were included in the study. Females, PharmD graduates, and on-time graduation had higher odds of passing SPLE (P = 0.0065, P = 0.0003, and P < 0.0001, respectively). For each 0.5 increase in GPA, the odds of passing SPLE increase by 3.5 times (OR 3.53; 95 % CI, 2.83-4.42; P < 0.0001). Of the tests taken prior to university admission, the overall high school score, general aptitude test (GAT) score, and qualifying score were significantly associated with higher SPLE first-time pass rates. When multiple logistic regression analysis was performed, GPA and GAT scores were the only significant predictors for higher SPLE first-time pass rates (P < 0.0001 and P = 0.0002, respectively). Conclusion: The current research has shown that there is an association between higher SPLE first-time pass rates and several factors, most importantly the GPA and GAT score. Further research is needed, as it has the potential to inform the decision when reviewing pharmacy admission criteria.

The effectiveness of badging systems in engaging, motivating, and incentivizing students in the mastery of nursing licensure materials.

INTRODUCTION: Integrating gamification methods into undergraduate nursing programs has prepared students to pass the nursing comprehensive predictor test and the licensure examination. LITERATURE REVIEW: Research demonstrates that the motivational factors of game elements like badging and leaderboards are of great value and utility to student engagement and motivation. The badges symbolize achievement, authority, and belonging, whereas leaderboards rank students based on different levels of course engagement. DISCUSSION: This paper explores the benefits, challenges, and strategies of incorporating digital badges and leaderboards in the undergraduate program. Immersion courses preparing students for professional practice are usually one of the last didactic courses offered in the undergraduate curriculum, designed to integrate all knowledge gained from the nursing program. IMPLICATIONS FOR AN INTERNATIONAL AUDIENCE: The digital badging system can encourage nurse educators globally to engage, motivate, and power students to achieve professional goals. Furthermore, nursing programs worldwide can benefit from adding digital badges and leaderboards to final semester preparatory courses or any nursing course with the same emphasis. CONCLUSIONS: Digital badges and leaderboards engage and motivate students to integrate knowledge and skills learned in the nursing program and successfully master nurse licensure materials.

Tiered Licensure for Pharmacy Technicians: Is the Advanced Pharmacy Technician (APhT) License the Model for State Regulators?

Two states-Connecticut and New Hampshire-have created or attempted to create advanced pharmacy technician (APhT) licenses. Both licenses, proposed and actual, have high barriers to entry, such as requiring 1 to 3 years of prior technician experience and passage of various assessments or trainings, such as a state-specific jurisprudence exam. Those obtaining APhT licensure are granted additional authority, such as performing final product verification (e.g., tech-check-tech) and vaccine administration. Compared with practices in other states, the APhT role in CT and NH provides minimal scope gains relative to the requirements imposed; as a result, there has been limited uptake (<1%) among current technicians. As such, it appears unlikely that tiered licensure for technicians will be the preferred mechanism for states to expand the role of pharmacy technicians in the future.

Human Challenge Studies for Cholera.

The human challenge model permits an estimate of the vaccine protection against moderate and severe cholera. It eliminates the difficulty in setting up a vaccine study in endemic area including uncertainties about the incidence of cholera and the logistic arrangements for capturing those who do/do not become ill. Valuable information from small groups of subjects can be obtained in a short period. Under proper precautions and study design, the challenge model is safe and efficient. Although the model has evolved since it was introduced over 50 years ago, it has been used extensively to test vaccine efficacy. Vaccine licensure has resulted from data obtained using the human challenge model. In addition, the model has been used to: (1) Establish and validate a standardized inoculum, (2) Identify immune markers and immune responses, (3) Determine natural immunity (in re-challenge studies), (4) Identify the role of the gastric acid barrier in preventing cholera infection, (5) Show homologous and heterologous infection-derived immunity, and (6) Test the efficacy of anti-diarrheal/anti-secretory small molecules. The aim of this chapter is to present an overview on the state of the art for human challenge models used to study cholera and new medical interventions against it.

Clinician educators' conceptions of assessment in medical education.

In pursuing assessment excellence, clinician-educators who design and implement assessment are pivotal. The influence of their assessment practice in university-run licensure exams on student learning has direct implications for future patient care. While teaching practice has been shown to parallel conceptions of teaching, we know too little about conceptions of assessment in medical education to know if this is the case for assessment practice and conceptions of assessment. To explore clinician-educators' conceptions of assessment, a phenomenographic study was undertaken. Phenomenography explores conceptions, the qualitatively different ways of understanding a phenomenon. Data analysis identifies a range of hierarchically inclusive categories of understanding, from simple to more complex, and the dimensions that distinguish each category or conception. Thirty-one clerkship convenors in three diverse Southern settings were interviewed in three cycles of iterative data collection and analysis. Four conceptions of assessment were identified: passive operator, awakening enquirer, active owner and scholarly assessor. Six dimensions were elucidated to describe and distinguish each conception: purpose of assessment; temporal perspective; role and responsibility; accountability; reflexivity and emotional valence. Additionally, three characteristics that appeared to track the progressive nature of the conceptions were identified: professional identity, assessment literacy and self-efficacy. These conceptions encompass and extend previously described conceptions across different educational levels, disciplines and contexts, suggesting applicability to other settings. There is some evidence of a relationship between conceptions and practice, suggesting, together with the hierarchical nature of these conceptions, that targeting conceptions during faculty development may be an effective approach to enhance assessment practice.

The influence of licensure on ABGC certification examination outcomes.

The genetic counseling field established ABGC certification and state licensure as professional standards for practice. All current state licensure laws require passing the ABGC certification examination, although states differ in their requirements regarding how soon after graduation the examination must be taken. Graduates in states without licensure can schedule the certification examination at their preference. This study explores the influence of licensure requirements on timing to take the examination and likelihood of passing the examination. Genetic counselors who graduated between 2017 and 2021 were invited to complete a 20-question survey that included demographic information, first-time pass rates, year of graduation and the month and year they took the certification examination. Usable responses were received from 246 genetic counselors who responded to the survey, a minimum response rate of 12.9%. Participants were largely female (92.7%), white (88.6%), and almost evenly divided between those whose first job was in a state with licensure (56.3%) and one without licensure (43.7%). Those who worked in states with licensure took the examination significantly sooner than those who worked in states without licensure (p = 0.028) and were 2.4 times more likely to fail the first attempt [95% CI = 1.08-5.49]). When asked about personal preference on timing of the examination, those who "would have waited if there were no licensure requirement" were almost 7 times more likely to fail the first attempt (RR = 6.81, 95% CI = 3.10-14.97). This study identified an association between state licensure requirements, genetic counselors' timing of taking the ABGC examination, and their examination performance. The data suggest that the element of choice is an important factor in pass rates. New graduates need to be aware of state-specific licensure laws' impact on their ability to choose when to take the examination.

Perceived barriers, recommendations, and resources for multistate licensure in the United States: A mixed-methods study of laboratory genetic counselors.

With genetic counselor licensure now available in 32 states, the number of laboratory genetic counselors (LGCs) who are required to be licensed in multiple states has risen substantially. Although previous studies have documented the complexity of the multistate licensing (MSL) process, there has been little research on the experiences of LGCs applying for and maintaining licensure. The purpose of this study was to identify perceived barriers, recommendations, and resources for LGCs pursuing MSL. A 15-item mixed-methods, anonymous questionnaire was used to survey genetic counselors currently or formerly employed by genetic testing laboratories. Responses were analyzed with a combination of descriptive statistics and inductive thematic analysis. Of the 150 eligible participants who completed the survey, the majority worked at a commercial, non-academic laboratory (84%, n = 126), had 1-4 years of laboratory genetic counseling experience (54%, n = 81), held non-patient-facing roles (65%, n = 97), and were required by their employer to hold licensure in at least one state (73%, n = 110). Most participants (86%, n = 129) felt there were barriers to MSL for LGCs, with three emergent themes: (1) resource burden, (2) complexity, and (3) legislative ambiguity. Participants described the current MSL process as tedious, cumbersome, confusing, overwhelming, and redundant. Several shared that the current licensing system undermines the intent to improve the status of the profession and actually negatively impacts patient care. Recommendations to improve MSL included overall process enhancements, like transitioning to online systems and a single central information repository for licensees, increased professional advocacy, and investing in collaborative pathways to licensure such as interstate compacts. Participants found national genetic counseling organizations, state-based genetic counseling organizations, and genetic counseling colleagues to be the most helpful resources for understanding licensure law and where to apply for licensure.

After the Discontinuation of Step 2 CS: A Collaborative Statement from the Directors of Clinical Skills Education (DOCS).

Issue: The United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills Examination (Step 2 CS), the only clinical skills competency testing required for licensure in the United States, has been discontinued. Evidence: This exam, though controversial, propelled a movement emphasizing the value of clinical skills instruction and assessment in undergraduate medical education. While disappointed by the loss of this national driver that facilitated standardization of clinical skills education, the Directors of Clinical Skills Education (DOCS) see prospects for educational innovation and growth. DOCS is a national organization and inclusive community of clinical skills education leaders. This statement from DOCS regarding the discontinuation of USMLE Step 2 CS has been informed by DOCS meetings, listserv discussions, an internal survey, and a review of recent literature. Implications: Rigorous clinical skills assessment remains central to effective and patient-centered healthcare. DOCS shares specific concerns as well as potential solutions. Now free from the external pressure to prepare students for success on Step 2 CS, clinical skills educators can reprioritize content and restructure clinical skills programs to best meet the needs of learners and the ever-evolving healthcare landscape. DOCS, as an organization of clinical skills leaders, makes the following recommendations: 1) Collaboration amongst institutions must be prioritized; clinical skills assessment consortia should be expanded. 2) Governing, accrediting, and licensing organizations should leverage their influence to support and require high quality clinical skills assessments. 3) UME clinical skills leaders should develop ways to identify students who perform with exceptional, borderline, and poor clinical skills at their local institutions. 4) UME leadership should fully commit resources and curricular time to graduate students with excellent clinical skills.

Connecting lived experiences of pre-nursing students during COVID-19 with learner well-being: A qualitative inquiry.

AIM: To explore pre-nursing students' experiences and identify factors influencing their well-being as learners during COVID-19. DESIGN: A qualitative descriptive design was used. METHODS: Short answer study data (n = 289) were collected in Fall 2020 as part of a larger IRB-approved survey-based study focused on pre-nursing students. Participants were presented with three short answer questions designed to elicit a description of their experiences as a pre-nursing student. NVivo and reflexive thematic analysis were used to analyse participant responses. RESULTS: Six themes related to learner well-being emerged from the data. Learner well-being was supported by achieving academic goals, experiencing positive feelings about current course content, creating connections with peers and envisioning themselves as nurses in the future. Negative contributors to pre-nursing student well-being included managing fears of program rejection and juggling multiple roles and demands. Online learning necessitated by COVID-19 created opportunities for loneliness and isolation from peers, technological difficulties and additional psychological stress, which also contributed negatively to learner well-being. CONCLUSION: These findings illustrate pre-nursing students' experiences and provide support for the influence of the learning environment and factors within the individual on the well-being of learners. IMPACT: Students preparing to apply to nursing programs are an understudied population and little is known about their well-being as learners. Survey-based open-ended short answer questions can be utilized to gain rich insight into their experiences. The study themes and sub-themes can be utilized for discussion and reflection in courses with pre-nursing students and as a starting point for additional conversations between pre-nursing students and educators regarding improving the support of well-being in learners. Additional research and evidence-based interventions that promote learner well-being in pre-nursing students are needed as they prepare for nursing program admission and to support their academic progression. PATIENT OR PUBLIC CONTRIBUTION: Members of the public were not involved in the design or conduct of the study, analysis, or interpretation of the data, or in the preparation of the manuscript because the study focus is on gaining an understanding the experiences of pre-nursing students and their well-being.

Are Ethiopian schools of medicine producing competent medical graduates for providing quality health care in the era of COVID-19 pandemic?

BACKGROUND: Competent health workforce, including medical doctors, is the heart of health systems. Cognizant of this, Ethiopia is implementing licensure exam as a strategy to produce competent health workforce, including medical doctors and beyond, for the provision of high quality health care, among others. However, there is a dearth of evidence on medical graduates' competence in Ethiopia in the era of Covid-19 pandemic. Hence, this study aimed to assess the competence of medical graduates-based on licensure exam results in Ethiopia. METHODS: A multi -center institution-based cross-sectional study was conducted among 1051 medical graduates (selected through cluster sampling method) from May - July 2022 in Medical Schools found in Amhara region, Northwest Ethiopia. Data were collected from secondary sources at the Ministry of Health and Medical Schools using a structured checklist. Data analysis was performed using SPSS Version 23 software. A binary logistic regression analysis was performed to identify factors associated with graduates' competence. RESULTS: Nine hundred sixty-one (91.4%) medical graduates were competent. The study revealed that those graduates with older age (AOR: 0.63; 95% CI: 0.52, 0.76), being female graduates (AOR: 0.39; 95% CI: 0.22, 0.69), graduated in 2021 (AOR: 0.31; 95%; CI: 0.17, 0.60) and attending education in junior medical schools (AOR: 0.06; 95% CI : 0.01, 0.40) have lower competence as compared with that of their counterparts. Whereas, graduates with no repeating internship attachment (AOR: 2.41; 95% CI: 1.40, 4.17) and graduates with repeating academic year (AOR: 2.01; 95% CI: 1.14, 3.56) have better competence than that of their counterparts. CONCLUSION: The proportion of competent medical graduates was relatively low as per the national strategic plan which aspires that all medical graduates to be competent. Medical graduate's competence was affected by age, gender, curriculum being implemented, and having academic as well as internship repeats. As result, policymakers should scale up competency based education in Medical Schools.

Novel innovative computer-based test (Inno-CBT) item types for national licensing examinations for health care professionals.

BACKGROUND: An effective test mechanism to evaluate clinical knowledge and skills of the entry-level healthcare professionals is important for providing clinical competency and improving patient care. This study aimed to develop novel, innovative computer-based test (Inno-CBT) item types for application in the national examination of Korean healthcare professionals. METHODS: This exploratory study was conducted from May 2021 to March 2022 by a team of faculty members from pharmacy schools in South Korea. A literature search using PubMed, Google Scholar, RISS, Web of Science, and KoreaMed was performed. Forum presentations, media articles, and previous reports by the Korea Health Personnel Licensing Examination Institute (KHPLEI) were included. Workshops were held, information and ideas were collected and conceptualized, and item types were designed, drafted, and refined. By repeating this process, the Inno-CBT item types were finalized. RESULTS: Forty-one Inno-CBT item types with 28 subtypes were developed. New digital technologies, such as a reactive responsive media interface, an animation insertion, multimedia embedding, and network surfing, were utilized in these novel types. It was anticipated that these Inno-CBT item types would effectively measure abilities in healthcare knowledge, problem-solving skills, and professional behaviors. Some potential barriers to implementing the Inno-CBT item types include item difficulty, operational unfamiliarity, complexity in scoring protocols, and network security. CONCLUSIONS: A variety of styles of novel Inno-CBT item types were developed to evaluate the multifaceted and in-depth professional abilities required for healthcare professionals. Prior to implementing these item types in the national examination, item validation and technical support should be conducted.