Analysis of Responses of GPT-4 V to the Japanese National Clinical Engineer Licensing Examination.

Chat Generative Pretrained Transformer (ChatGPT; OpenAI) is a state-of-the-art large language model that can simulate human-like conversations based on user input. We evaluated the performance of GPT-4 V in the Japanese National Clinical Engineer Licensing Examination using 2,155 questions from 2012 to 2023. The average correct answer rate for all questions was 86.0%. In particular, clinical medicine, basic medicine, medical materials, biological properties, and mechanical engineering achieved a correct response rate of ≥ 90%. Conversely, medical device safety management, electrical and electronic engineering, and extracorporeal circulation obtained low correct answer rates ranging from 64.8% to 76.5%. The correct answer rates for questions that included figures/tables, required numerical calculation, figure/table ∩ calculation, and knowledge of Japanese Industrial Standards were 55.2%, 85.8%, 64.2% and 31.0%, respectively. The reason for the low correct answer rates is that ChatGPT lacked recognition of the images and knowledge of standards and laws. This study concludes that careful attention is required when using ChatGPT because several of its explanations lack the correct description.

Performance of ChatGPT-3.5 and GPT-4 in national licensing examinations for medicine, pharmacy, dentistry, and nursing: a systematic review and meta-analysis.

BACKGROUND: ChatGPT, a recently developed artificial intelligence (AI) chatbot, has demonstrated improved performance in examinations in the medical field. However, thus far, an overall evaluation of the potential of ChatGPT models (ChatGPT-3.5 and GPT-4) in a variety of national health licensing examinations is lacking. This study aimed to provide a comprehensive assessment of the ChatGPT models' performance in national licensing examinations for medical, pharmacy, dentistry, and nursing research through a meta-analysis. METHODS: Following the PRISMA protocol, full-text articles from MEDLINE/PubMed, EMBASE, ERIC, Cochrane Library, Web of Science, and key journals were reviewed from the time of ChatGPT's introduction to February 27, 2024. Studies were eligible if they evaluated the performance of a ChatGPT model (ChatGPT-3.5 or GPT-4); related to national licensing examinations in the fields of medicine, pharmacy, dentistry, or nursing; involved multiple-choice questions; and provided data that enabled the calculation of effect size. Two reviewers independently completed data extraction, coding, and quality assessment. The JBI Critical Appraisal Tools were used to assess the quality of the selected articles. Overall effect size and 95% confidence intervals [CIs] were calculated using a random-effects model. RESULTS: A total of 23 studies were considered for this review, which evaluated the accuracy of four types of national licensing examinations. The selected articles were in the fields of medicine (n = 17), pharmacy (n = 3), nursing (n = 2), and dentistry (n = 1). They reported varying accuracy levels, ranging from 36 to 77% for ChatGPT-3.5 and 64.4-100% for GPT-4. The overall effect size for the percentage of accuracy was 70.1% (95% CI, 65-74.8%), which was statistically significant (p < 0.001). Subgroup analyses revealed that GPT-4 demonstrated significantly higher accuracy in providing correct responses than its earlier version, ChatGPT-3.5. Additionally, in the context of health licensing examinations, the ChatGPT models exhibited greater proficiency in the following order: pharmacy, medicine, dentistry, and nursing. However, the lack of a broader set of questions, including open-ended and scenario-based questions, and significant heterogeneity were limitations of this meta-analysis. CONCLUSIONS: This study sheds light on the accuracy of ChatGPT models in four national health licensing examinations across various countries and provides a practical basis and theoretical support for future research. Further studies are needed to explore their utilization in medical and health education by including a broader and more diverse range of questions, along with more advanced versions of AI chatbots.

Stores Licensing Scheme in remote Indigenous communities of the Northern Territory, Australia: a meta-evaluation.

A form of food retail regulation called the Stores Licensing Scheme was introduced by the Australian Government in 2007-2022 to ensure food security in remote Indigenous communities of the Northern Territory. We examined evaluations of this Scheme implemented under the Northern Territory National Emergency Response and Stronger Futures Northern Territory Acts. Grey literature search identified nine primary source evaluations. Reported outcomes were extracted and thematic analysis utilised to determine barriers and enablers. Outcomes included improved availability and quality of groceries, financial structures, and retail practices, albeit not consistently reported. Governance and food cost were perceived barriers. Future policy aimed to improve food security through community stores should consider food cost subsidy, measures to incentivise all stores to improve standards, and improved governance arrangements enabling self-determination for Aboriginal and Torres Strait Islander Store Directors.

Driver's license, head protection devices and severity of motorcyclists' injuries in traffic accidents.

OBJECTIVES: to describe traffic accidents involving motorcyclists and analyze the association between possession of a motorcycle driver's license and use of helmets according to the severity of injuries. METHODS: a cross-sectional study was conducted among all patients hospitalized in the traumatology and orthopedics sector of a public reference hospital in northeastern Brazil. RESULTS: 170 patients were surveyed, the majority were male (95.9%). Their ages ranged from 18 to 67 years. Most were black or brown (52.3%), had completed elementary school (58.9%) and had monthly income smaller than two minimum wages (56.5%). An association was found between being licensed to drive a motorcycle and wearing a helmet. Among those who suffered moderate injuries, this association was OR=5.66(1.85-17.23) and among those who suffered severe injuries it was OR=13.57(2.82-65.14). CONCLUSIONS: people who were licensed to drive motorcycles used a helmet as protective equipment more often and, in accidents, suffered fewer injuries.

A Review of the Ethics of Patient-Based Licensure Examinations.

Purpose Concerns regarding the ethical justification for the use of single-encounter, procedure-based examinations on live patients for the licensure of dental hygienists and dentists in the United States persists despite decades of debate and publication on the subject. The purpose of this literature review was to summarize the specific ethical concerns and quantify recommendations in favor or against this examination methodology.Methods A population, intervention, control or comparison, outcome (PICO) question was developed to review the topic as follows: "For individuals receiving dental care as part of determination of candidates for competency and readiness for licensure, do patient-based licensure examinations, as compared to other assessment methods, violate or infringe upon ethical principles or ethical standards for health care or society?" An electronic search was performed in three databases: PubMed/Medline, Scopus, and Embase. Key search terms and Medical Subject Headings (MeSH) included the following: ethics, clinical, competence, dental, dental hygiene, dentistry, education, licensure, live patient, and practice.Results Ethical concerns about the use of patient examinations have been published in the professional literature for over 35 years. Of the 29 selected or endpoint articles identified, 27 articles cited one or more ethical concerns relating to single-encounter patient-based examinations while 20 articles recommended the elimination of this type of examination with an additional 6 articles citing elimination as an option in resolving the ethical issues regarding this type of licensure examination.Conclusion The literature holds a predominant, prevailing professional opinion that single-encounter, procedure-based examinations on live patients presents significant ethical concerns and should be eliminated as a method in initial dental hygiene and dental licensure. The literature also suggests that state dental boards should initiate corrective regulatory or legislative actions to expeditiously end recognition of live patient examinations in their licensure processes.

Long-term effects of an alcohol prevention program at licensed premises: a Swedish 20-year follow-up study.

Background: In 1996, a multicomponent community-based alcohol prevention program in Responsible Beverage Service (RBS) targeting licensed premises was developed by STAD (Stockholm Prevents Alcohol and Drug Problems) and implemented in Stockholm, Sweden. The program consists of community mobilization and collaboration, training, and enforcement. Early evaluations have shown a significant increase in the refusal rates of alcohol service to intoxicated patrons, from 5% in 1996 to 70% in 2001, and a 29% decrease in the frequency of police-reported violence. A cost-effectiveness analysis showed a cost-saving ratio of 1:39. The program was institutionalized by a collaborative steering group consisting of community stakeholders. This study aimed to evaluate the long-term effects over 20 years of the RBS program. The indicator chosen was the rate of alcohol overserving to obviously intoxicated patrons at licensed premises in Stockholm. Methods: A 20-year follow-up study was conducted using the same procedure as the baseline and previous follow-ups. Professional male actors (pseudopatrons) were trained by an expert panel to enact a standardized scene of obvious alcohol-intoxication. In 2016, 146 licensed premises located in the central part of Stockholm were randomly selected and visited. A review of program implementation from its initiation 1996 was conducted, examining critical events, including commitment from key actors in the community, training of bar staff, and enforcement. Results: At the 20-year follow-up, pseudopatrons were refused alcohol service in 76.7% of the attempts, which was at the same level (70%) as in the follow-up in 2001, thus indicating sustained effects of the RBS program. Compared with previous follow-ups, serving staff used more active intervention techniques in 2016 toward intoxicated patrons, such as refusing to take the order (56.9% in 2016 vs. 42.0% in 2001), and fewer passive techniques, such as ignoring patrons (6.5% in 2016 vs. 15.5% in 1999) or contacting a colleague (4.1% in 2016 vs. 25% in 2001). Conclusion: The sustained long-term effects of the RBS program are unique and can be explained by the high level of institutionalization of the multicomponent program, which is still ongoing in Stockholm. These findings can inform the dissemination of the program to other countries and settings.

Meeting report: Considerations for trial design and endpoints in licensing therapeutic HPV16/18 vaccines to prevent cervical cancer.

Cervical cancer is a major cause of morbidity and mortality globally with a disproportionate impact on women in low- and middle-income countries. In 2021, the World Health Organization (WHO) called for increased vaccination, screening, and treatment to eliminate cervical cancer. However, even with widespread rollout of human papillomavirus (HPV) prophylactic vaccines, millions of women who previously acquired HPV infections will remain at risk for progression to cancer for decades to come. The development and licensing of an affordable, accessible therapeutic HPV vaccine, designed to clear or control carcinogenic HPV and/or to induce regression precancer could significantly contribute to the elimination efforts, particularly benefiting those who missed out on the prophylactic vaccine. One barrier to development of such vaccines is clarity around the regulatory pathway for licensure. In Washington, D.C. on September 12-13, 2023, a meeting was convened to provide input and guidance on trial design with associated ethical and regulatory considerations. This report summarizes the discussion and conclusions from the meeting. Expert presentation topics included the current state of research, potential regulatory challenges, WHO preferred product characteristics, modeling results of impact of vaccine implementation, epidemiology and natural history of HPV infection, immune responses related to viral clearance and/or precancer regression including potential biomarkers, and ethical considerations. Panel discussions were held to explore specific trial design recommendations to support the licensure process for two vaccine indications: (1) treatment of prevalent HPV infection or (2) treatment of cervical precancers. Discussion covered inclusion/exclusion criteria, study endpoints, sample size and power, safety, study length, and additional data needed, which are reported here. Further research of HPV natural history is needed to address identified gaps in regulatory guidance, especially for therapeutic vaccines intended to treat existing HPV infections.

Transferability of Effective Consultation Skills for Decision-Making Support in the Voluntary Surrender of Older Adult Drivers' Licences in Super-Aged Japan.

INTRODUCTION: Previously, we identified eight effective consultation skills to support decision-making in the voluntary surrender of older adult drivers' licences in super-aged Japan. This study aimed to clarify the transferability of these skills. METHODS: We collected text data by interviewing 11 safe-driving counsellors (four police officers, four clerical staff and three nurses) in the License Division of the National Police Agency from February to March 2022. Interviews were semi-structured and conducted by telephone or email. During the interview, participants were asked to recall their experiences as counsellors providing decision-making support to older drivers and to compare their experiences with the eight consultation skills. We analysed the content of the responses by quantitative text analysis with KH Coder 3 software. RESULTS: As a characteristic of the words and phrases used by counsellors in their narratives about consultation skills, the most frequently extracted words from among 3147 words were think, parties and family, and promote had the highest mediation centrality. The eight subgraphs were 'Respecting the will of relevant parties from their standpoint is natural', 'Listening attentively and empathetically to relevant parties is effective', 'Presenting objective data to guide decisions is successful', 'Showing cognitive functioning test results is often effective', 'Counselors with medical expertise can elicit positive counseling outcomes', 'Intervention by medical or police counselors facilitates the decision to surrender voluntarily', 'Counseling skills need to be improved' and 'A diagram of the 8 skills is helpful for inexperienced counselors'. CONCLUSION: The results suggest that the eight consultation skills have similarities and are transferable. This transferability might contribute to practical application or cohort follow-up study research. These skills can be incorporated into counsellor training, and counsellors can be expected to use these skills in the future. Regardless of the safe-driving counsellor's years of experience, the skills can help them provide uniform and accurate support in decision-making regarding the voluntary surrender of older adult drivers' licences. These skills are a promising approach to help older adults lead safe and secure lives as they age.

The Phenomenon of Teen Delay in Driving Licensure: Considerations at the Intersection of Mobility and Social Welfare for Emerging Adults.

In 2021, there were 11.7 million licensed young drivers in the U.S. This is 1.5 million fewer young drivers compared to 2007. The phenomenon of delay in driving licensure among teens has notable implications for opportunities positioning them for life success when transitioning into emerging adulthood and in later life.

Intellectual property licensing of therapeutics during the COVID-19 crisis: lessons learnt for pandemic preparedness and response.

During the COVID-19 pandemic, intellectual property licensing through bilateral agreements and the Medicines Patent Pool were used to facilitate access to new COVID-19 therapeutics in low- and middle-income countries (LMICs). The lessons learnt from the application of the model to COVID-19 could be relevant for preparedness and response to future pandemics and other health emergencies.The speed at which affordable versions of a new product are available in LMICs is key to the realization of the potential global impact of the product. When initiated early in the research and development life cycle, licensing could facilitate rapid development of generic versions of innovative products in LMICs during a pandemic. The pre-selection of qualified manufacturers, for instance building on the existing network of generic manufacturers engaged during the COVID-19 pandemic, the sharing of know-how and the quick provision of critical inputs such as reference listed drugs (RLDs) could also result in significant time saved. It is important to find a good balance between speed and quality. Necessary quality assurance terms need to be included in licensing agreements, and the potentials of the new World Health Organization Listed Authority mechanism could be explored to promote expedited regulatory reviews and timely access to safe and quality-assured products.The number, capacity, and geographical distribution of licensed companies and the transparency of licensing agreements have implications for the sufficiency of supply, affordability, and supply security. To foster competition and support supply security, licenses should be non-exclusive. There is also a need to put modalities in place to de-risk the development of critical pandemic therapeutics, particularly where generic product development is initiated before the innovator product is proven to be effective and approved. IP licensing and technology transfer can be effective tools to improve the diversification of manufacturing and need to be explored for regional manufacturing for accelerated access at scale in in LMICs and supply security in future pandemics.

[Checking the fitness to drive of senior citizens under German law-pending corrective measures to ensure road safety]. / Die Überprüfung der Fahreignung von Senioren nach deutschem Recht ­ Anstehende Korrekturbedarfe zur Gewährleistung der Verkehrssicherheit.

German driving licence law takes a reactive approach to dealing with suitability deficiencies of senior citizens. If the driver is no longer fit to drive and nevertheless participates in traffic, an administrative offence has been committed. If this endangers or injures other people or causes significant damage to property, it may even be a criminal offence. In addition to prosecuting these offences, the driving licence authority may restrict or even withdraw the licence issued. In this respect, senior citizens have a high degree of personal responsibility when assessing their fitness to drive. This article presents the current driving license law and discusses the need for changes.Legally, various corrections are required to the current Driving Licence Ordinance and its annexes. At present, there is no clear regulation regarding the general reduction in performance in old age for an event-related assessment of fitness to drive. In addition, in the event of doubts about fitness to drive, the driving licence authority should be expressly granted the power to order standardised driving tests. Furthermore, the legislator must take preventive measures to ensure road safety. He must no longer ignore the current accident situation. In view of the fact that senior citizens aged 75 and over are disproportionately involved in traffic accidents with personal injury in terms of their culpable behaviour, it is important to impose moderate restrictions on the personal responsibility of driving licence holders. This is especially true for sensory abilities, which are particularly important in road traffic. Seniors should therefore be required to undergo eye tests from the age of 75. From this age onwards, it also seems sensible to introduce compulsory advice on fitness to drive, preferably from your family doctor.

Dynamic efficiency of tradable license system with time-flexible quantities.

Tradable license system (TLS) is a fundamental policy instrument for environmental management or resource development. We construct a muti-periods dynamic model with respect to a general TLS with three time-flexible quantity mechanisms: fixed quantity, solely banking, and banking and borrowing, in which the firm maximizes its discounted net benefits over the horizon by selecting an optimal license usage by license trading across agents or transferring across periods. The dynamic efficiency performance and price dynamics in TLS are respectively examined. The decentralized equilibrium in TLS with fixed quantity cannot achieve benefit-maximum unless initial license allocation is efficient. The decentralized behaviors in TLS with solely banking lead to benefit-maximum and price dynamics follows the Hotelling rule, if and only if the cumulative initial license allocation in each period is not less than the optimum, while TLS with banking and borrowing can achieve the optimal outcome and price dynamics follows Hotelling rule regardless of the initial allocation. The findings highlight the synergistic effects between the initial allocation of licenses and time-flexible quantity mechanisms in TLS design.

Overview of State Laws Restricting Alcohol Outlet Density in the United States.

OBJECTIVES: Complementing the extensive research literature demonstrating that increased alcohol outlet density is associated with excessive alcohol consumption and related harms, this article synthesizes information on the types of alcohol outlet density restrictions in US state-level laws. DESIGN: Statutes and regulations related to alcohol outlet density in all 50 states and the District of Columbia in effect as of January 1, 2022, were collected using Westlaw. State-level density restrictions were coded according to 4 variables and overlaid with existing research on state-specific local authority to regulate outlet density. Alcohol outlet density laws in Michigan and Massachusetts were analyzed in detail as case studies. SETTING: United States. MAIN OUTCOME MEASURE: US state-level licensing laws restricting alcohol outlet density. RESULTS: Thirty-three states and the District of Columbia have state-level licensing laws that limit alcohol outlet density. Of those, 25 have population-based restrictions, 8 have distance-based restrictions, 7 have quotas, and 6 require the licensing agency to consider density-related factors. Within the same group of 34 jurisdictions, 22 apply restrictions to both on- and off-premises outlets, 5 apply them only to on-premises outlets, and 7 apply them only to off-premises outlets. Among the 32 states where localities lack authority to license alcohol outlets, two-thirds have state-level laws restricting outlet density. State-level density restrictions also exist in approximately two-thirds of the states where localities have licensing authority. Case studies of Michigan and Massachusetts highlight how state-level density restrictions operate in practice. CONCLUSIONS: Two-thirds of jurisdictions have state-level alcohol outlet density restrictions, with population-based restrictions being the most common. In addition, outlet density restrictions may exist regardless of limits on local control and whether localities with authority to enact density restrictions have done so. Policymakers and others can reference this assessment to identify examples and opportunities to strengthen the alcohol policy environment in any given state.

Distribution of licensed acupuncturists and educational institutions in the United States at the start of 2023, during the late stage of the COVID-19 pandemic.

This study was conducted to identify the number and density of active licensed acupuncturists (LAcs), as well as the number of accredited schools in acupuncture and Oriental medicine (AOM), as of January 1, 2023, in the United States (U.S.). The number of active LAcs as of January 1, 2023 was 34,524, potentially 33,364 after removing license duplication in multiple states, among which the largest three states were California (with 7317 LAcs [21.19% of the total]), New York (5024 [14.55%]) and Florida (2644 [7.66%]). The total number of LAcs decreased by 8.87% from 2018, and fell short of our projected number of LAcs in 2023 by 9037, or 20.75%. The overall LAc density in the U.S.-measured as the number of LAcs per 100,000 population-was 10.36, less than in 2018. There were 56 active, accredited AOM schools which offered a total of 147 programs (121 at the level necessary for licensing [entry-level], 12 for an advanced practicing degree [advanced-level], and 14 for certifications). Broken down further, offerings included 50 master's degrees in acupuncture, 40 master's degrees in Oriental medicine, 31 entry-level doctorate degrees (10 in acupuncture and 21 in acupuncture plus Chinese herbal medicine), and 12 advanced-level doctorate degrees in AOM. The certification programs included one in East-Asian Medical Bodywork and 13 in CHM. Among these schools in 2023, institutions in the West and East Coast states comprised 67.86% (decreased from 77.42% in 2018) of the national total. California, Florida and Illinois represented 39.29%. There were 48 jurisdictions with acupuncture practice laws in place. The data suggests that the acupuncture profession in the U.S. has been significantly impacted during the coronavirus disease 2019 pandemic. Please cite this article as: Fan AY, He DG, Sangraula A, Alemi SF, Matecki A. Distribution of licensed acupuncturists and educational institutions in the United States at the start of 2023, during the late stage of the COVID-19 pandemic. J Integr Med. 2024; 22(4): 379-384.

Lineamientos técnicos para el archivo, resguardo y administración de licencias de software del MINSAL / Technical guidelines for archiving, safeguarding and software license management MINSAL

El Ministerio de Salud, con el propósito de establecer actividades generales para el archivo, resguardo y administración de los recursos informáticos institucionales, ha elaborado los presentes Lineamientos técnicos, facilitando el ordenamiento de los sistemas de información, el soporte técnico del equipamiento de cómputo, así como los enlaces y servicios de telecomunicaciones. Asimismo, se detallan los lineamientos específicos para la ejecución de actividades destinadas a mantener la coherencia, crecimiento y sostenibilidad de la plataforma tecnológica; en lo referente a respaldos de datos, programas de cómputo, el inventario de software y resguardo de licencias de software

The Ministry of Health, with the purpose of establishing general activities for the archiving, safeguarding and administration of institutional computing resources, has prepared these technical guidelines, facilitating the organization of information systems, the technical support of computing equipment, as well as such as telecommunications links and services. Likewise, the specific guidelines for the execution of activities aimed at maintaining the coherence, growth and sustainability of the technological platform are detailed; regarding data backups, computer programs, software inventory and safeguarding of software licenses