The Promise and Perils of Artificial Intelligence in Health Professions Education Practice and Scholarship.

ABSTRACT: Artificial intelligence (AI) methods, especially machine learning and natural language processing, are increasingly affecting health professions education (HPE), including the medical school application and selection processes, assessment, and scholarship production. The rise of large language models over the past 18 months, such as ChatGPT, has raised questions about how best to incorporate these methods into HPE. The lack of training in AI among most HPE faculty and scholars poses an important challenge in facilitating such discussions. In this commentary, the authors provide a primer on the AI methods most often used in the practice and scholarship of HPE, discuss the most pressing challenges and opportunities these tools afford, and underscore that these methods should be understood as part of the larger set of statistical tools available.Despite their ability to process huge amounts of data and their high performance completing some tasks, AI methods are only as good as the data on which they are trained. Of particular importance is that these models can perpetuate the biases that are present in those training datasets, and they can be applied in a biased manner by human users. A minimum set of expectations for the application of AI methods in HPE practice and scholarship is discussed in this commentary, including the interpretability of the models developed and the transparency needed into the use and characteristics of such methods.The rise of AI methods is affecting multiple aspects of HPE including raising questions about how best to incorporate these models into HPE practice and scholarship. In this commentary, we provide a primer on the AI methods most often used in HPE and discuss the most pressing challenges and opportunities these tools afford.

Advancing anti-oppression and social justice in healthcare through competency-based medical education (CBME).

Competency-based medical education (CBME) focuses on preparing physicians to improve the health of patients and populations. In the context of ongoing health disparities worldwide, medical educators must implement CBME in ways that advance social justice and anti-oppression. In this article, authors describe how CBME can be implemented to promote equity pedagogy, an approach to education in which curricular design, teaching, assessment strategies, and learning environments support learners from diverse groups to be successful. The five core components of CBME programs - outcomes competency framework, progressive sequencing of competencies, learning experiences tailored to learners' needs, teaching focused on competencies, and programmatic assessment - enable individualization of learning experiences and teaching and encourage learners to partner with their teachers in driving their learning. These educational approaches appreciate each learner's background, experiences, and strengths. Using an exemplar case study, the authors illustrate how CBME can afford opportunities to enhance anti-oppression and social justice in medical education and promote each learner's success in meeting the expected outcomes of training. The authors provide recommendations for individuals and institutions implementing CBME to enact equity pedagogy.

Practical, Privacy and Ethical, and Philosophical Considerations for Using Big Data in Medical Education.

ABSTRACT: In this issue of Academic Medicine , Thelen and colleagues present a thoughtful perspective on the emerging opportunity to use longitudinal educational data to improve graduate medical education and optimize the education of individual residents, and call for the accelerated development of large interinstitutional data sets for this purpose. Such applications of big data to medical education hold great promise in terms of informing the teaching of individuals, enhancing transitions between phases of training and between institutions, and permitting better longitudinal education research. At the same time, there is a tension between whose data they are and consequently how they ought to be used. This commentary proposes some practical, privacy and ethical, and philosophical considerations that need to be explored as early efforts to aggregate data across the medical education continuum mature and new efforts are undertaken.

Entrustable professional activities as a training and assessment framework in undergraduate medical education: A case study of a multi-institutional pilot.

In 2014, the Association of American Medical Colleges (AAMC) published 13 Core Entrustable Professional Activities (EPAs) that graduating students should be able to perform with indirect supervision when entering residency. A ten-school multi-year pilot was commissioned to test feasibility of implementing training and assessment of the AAMC's 13 Core EPAs. In 2020-21, a case study was employed to describe pilot schools' implementation experiences. Teams from nine of ten schools were interviewed to identify means and contexts of implementing EPAs and lessons learned. Audiotapes were transcribed then coded by investigators using conventional content analysis and a constant comparative method. Coded passages were organized in a database and analyzed for themes. Consensus among school teams regarding facilitators of EPA implementation included team commitment to piloting EPAs; agreement that: proximal EPA adoption with curriculum reform facilitates EPA implementation; EPAs 'naturally fit' in clerkships and provided opportunity for schools to reflect on and adjust curricula and assessments; and inter-school collaboration bolstered individual school progress. Schools did not make high-stakes decisions about student progress (e.g., promotion, graduation), yet EPA assessment results complemented other forms of assessment in providing students with robust formative feedback about their progress. Teams had varied perceptions of school capability to implement an EPA framework, influenced by various levels of dean involvement, willingness, and capability of schools to invest in data systems and provide other resources, strategic deployment of EPAs and assessments, and faculty buy-in. These factors affected varied pace of implementation. Teams agreed on the worthiness of piloting the Core EPAs, but substantial work is still needed to fully employ an EPA framework at the scale of entire classes of students with enough assessments per EPA and with required data validity/reliability. Recommendations stemming from findings may help inform further implementation efforts across other schools adopting or considering an EPA framework.

Core Entrustable Professional Activities for Entering Residency: A National Survey of Graduating Medical Students' Self-Assessed Skills by Specialty.

BACKGROUND: The Association of American Medical Colleges described 13 Core Entrustable Professional Activities (EPAs) that graduating students should be prepared to perform under indirect supervision on day one of residency. Surgery program directors recently recommended entrustability in these Core EPAs for incoming surgery interns. We sought to determine if graduating students intending to enter surgery agreed they had the skills to perform these Core EPAs. STUDY DESIGN: Using de-identified, individual-level data collected from and about 2019 Association of American Medical Colleges Graduation Questionnaire respondents, latent profile analysis was used to group respondents based on their self-assessed Core EPAs skills' response patterns. Associations between intended specialty, among other variables, and latent profile analysis group were assessed using independent sample t -tests and chi-square tests and multivariable logistic regression methods. RESULTS: Among 12,308 Graduation Questionnaire respondents, latent profile analysis identified 2 respondent groups: 7,863 (63.9%) in a high skill acquisition agreement (SAA) group and 4,445 (36.1%) in a moderate SAA group. Specialty was associated with SAA group membership (p < 0.001), with general surgery, orthopaedic surgery, and emergency medicine respondents (among others) overrepresented in the high SAA group. In the multivariable logistic regression models, each of anesthesiology, ophthalmology, pediatrics, psychiatry, and radiology (vs general surgery) specialty intention was associated with a lower odds of high SAA group membership. CONCLUSION: Graduating students' self-assessed Core EPAs skills were higher for those intending general surgery than for those intending some other specialties. Our findings can inform collaborative efforts to ensure graduates' acquisition of the skills expected of them at the start of residency.

Comparing Entrustment Decision-Making Outcomes of the Core Entrustable Professional Activities Pilot, 2019-2020.

Importance: Gaps in readiness for indirect supervision have been identified for essential responsibilities encountered early in residency, presenting risks to patient safety. Core Entrustable Professional Activities (EPAs) for entering residency have been proposed as a framework to address these gaps and strengthen the transition from medical school to residency. Objective: To assess progress in developing an entrustment process in the Core EPAs framework. Design, Setting, and Participants: In this quality improvement study in the Core EPAs for Entering Residency Pilot, trained faculty made theoretical entrustment determinations and recorded the number of workplace-based assessments (WBAs) available for each determination in 2019 and 2020. Four participating schools attempted entrustment decision-making for all graduating students or a randomly selected subset of students. Deidentified, individual-level data were merged into a multischool database. Interventions: Schools implemented EPA-related curriculum, WBAs, and faculty development; developed systems to compile and display data; and convened groups to make theoretical summative entrustment determinations. Main Outcomes and Measures: On an EPA-specific basis, the percentage of students for whom an entrustment determination could be made, the percentage of students ready for indirect supervision, and the volume of WBAs available were recorded. Results: Four participating schools made 4525 EPA-specific readiness determinations (2296 determinations in 2019 and 2229 determinations in 2020) for 732 graduating students (349 students in 2019 and 383 students in 2020). Across all EPAs, the proportion of determinations of "ready for indirect supervision" increased from 2019 to 2020 (997 determinations [43.4%] vs 1340 determinations [60.1%]; 16.7 percentage point increase; 95% CI, 13.8-19.6 percentage points; P < .001), as did the proportion of determinations for which there were 4 or more WBAs (456 of 2295 determinations with WBA data [19.9%] vs 938 [42.1%]; 22.2 percentage point increase; 95% CI, 19.6-24.8 percentage points; P < .001). The proportion of EPA-specific data sets considered for which an entrustment determination could be made increased from 1731 determinations (75.4%) in 2019 to 2010 determinations (90.2%) in 2020 (14.8 percentage point increase; 95% CI, 12.6-16.9 percentage points; P < .001). On an EPA-specific basis, there were 5 EPAs (EPA 4 [orders], EPA 8 [handovers], EPA 10 [urgent care], EPA 11 [informed consent], and EPA 13 [patient safety]) for which few students were deemed ready for indirect supervision and for which there were few WBAs available per student in either year. For example, for EPA 13, 0 of 125 students were deemed ready in 2019 and 0 of 127 students were deemed ready in 2020, while 0 determinations in either year included 4 or more WBAs. Conclusions and Relevance: These findings suggest that there was progress in WBA data collected, the extent to which entrustment determinations could be made, and proportions of entrustment determinations reported as ready for indirect supervision. However, important gaps remained, particularly for a subset of Core EPAs.

Revisiting the Core Entrustable Professional Activities for Entering Residency.

The Core EPAs for Entering Residency Pilot project aimed to test the feasibility of implementing 13 entrustable professional activities (EPAs) at 10 U.S. medical schools and to gauge whether the use of the Core EPAs could improve graduates' performance early in residency. In this manuscript, the authors (members of the pilot institutions and Association of American Medical Colleges staff supporting the project evaluation) describe the schools' capacity to collect multimodal evidence about their students' performance in each of the Core EPAs and the ability of faculty committees to use those data to make decisions regarding learners' readiness for entrustment. In reviewing data for each of the Core EPAs, the authors reflected on how each activity performed as an EPA informed by how well it could be assessed and entrusted. For EPAs that did not perform well, the authors examined whether there are underlying practical and/or theoretical issues limiting its utility as a measure of student performance in medical school.

Columbia COVID-19 Student Service Corps: Harnessing student skills and galvanizing the power of service learning.

The COVID-19 pandemic in New York City led to the forced rapid transformation of the medical school curriculum as well as increased critical needs to the health system. In response, a group of faculty and student leaders at CUIMC developed the COVID-19 Student Service Corps (Columbia CSSC). The CSSC is an interprofessional service-learning organization that galvanizes the skills and expertise of faculty and students from over 12 schools and programs in the response to the COVID-19 pandemic, and is agile enough to shift and respond to future public health and medical emergencies. Since March 2020, over 30 projects have been developed and implemented supporting needs identified by the health system, providers, faculty, staff, and students as well as the larger community. The development of the CSSC also provided critical virtual educational opportunities in the form of service learning for students who were unable to have any in-person instruction. The CSSC model has been shared nationally and nine additional chapters have started at academic institutions across the country.

Faculty Development Revisited: A Systems-Based View of Stakeholder Development to Meet the Demands of Entrustable Professional Activity Implementation.

In 2015, the Association of American Medical Colleges implemented an interinstitutional pilot of 13 core entrustable professional activities (EPAs) for entering residency, activities that entering residents should be expected to perform with indirect supervision. The pilot included a concept group on faculty development; this group previously offered a shared mental model focused on the development of faculty who devote their efforts to clinical teaching and assessment for learning and entrustment decision making. In this article, the authors draw from the literature of competency-based education to propose what is needed in overall approaches to faculty development to prepare institutions for undergraduate EPA implementation.Taking a systems-based view that defines the necessary tasks of EPA implementation, the authors move beyond the variably used term "faculty" and enumerate a comprehensive list of institutional stakeholders who can meaningfully support and/or engage in the relationships and organizational processes required for EPA learning and assessment. They consider each group's responsibilities and development needs according to five domains delineated by Steinert: teaching improvement, leadership and management, research-building capacity, academic career building, and organizational change.The authors argue that the EPA framework addresses barriers posed with the use of a competency-based framework. By facilitating the communication required for organizational change, enabling valid assessment with comprehensive yet feasible levels of faculty development, and incorporating all relevant data on student professional behavior into summative assessment decisions, EPAs may offer a clearer path toward the goal of competency-based education.

Implementing an Entrustable Professional Activities Framework in Undergraduate Medical Education: Early Lessons From the AAMC Core Entrustable Professional Activities for Entering Residency Pilot.

In 2014, the Association of American Medical Colleges (AAMC) published a list of 13 Core Entrustable Professional Activities for Entering Residency (Core EPAs) that medical school graduates might be expected to perform, without direct supervision, on the first day of residency. Soon after, the AAMC commissioned a five-year pilot with 10 medical schools across the United States, seeking to implement the Core EPA framework to improve the transition from undergraduate to graduate medical education.In this article, the pilot team presents the organizational structure and early results of collaborative efforts to provide guidance to other institutions planning to implement the Core EPA framework. They describe the aims, timeline, and organization of the pilot as well as findings to date regarding the concepts of entrustment, assessment, curriculum development, and faculty development. On the basis of their experiences over the first two years of the pilot, the authors offer a set of guiding principles for institutions intending to implement the Core EPA framework. They also discuss the impact of the pilot, its limitations, and next steps, as well as how the pilot team is engaging the broader medical education community. They encourage ongoing communication across institutions to capitalize on the expertise of educators to tackle challenges related to the implementation of this novel approach and to generate common national standards for entrustment. The Core EPA pilot aims to better prepare medical school graduates for their professional duties at the beginning of residency with the ultimate goal of improving patient care.

The medical home model: new opportunities for psychiatric services in the United States.

PURPOSE OF REVIEW: The Patient-Centered Medical Home (PCMH) model is an approach to providing integrated healthcare through one main point of access. As the PCMH model gains increasing adoption in large health systems, its implications for psychiatric services are becoming increasingly important. This review highlights the development of the medical home model and a number of ways in which it has been adopted in psychiatric delivery systems. RECENT FINDINGS: Numerous pilot initiatives have demonstrated quality improvement through the provision of psychiatric care in medical settings, medical care in psychiatric settings or fully integrated care through broadly trained providers. SUMMARY: The PCMH model offers a useful conceptual framework for the management of complex and chronic psychiatric illness. Early pilots of its use in psychiatric settings have demonstrated that people with psychiatric illness who receive their care in a medical home have better access to care, improved response to treatment, and higher cost-efficiency compared with usual care.

Addressing cardiometabolic risk during treatment with antipsychotic medications.

PURPOSE OF REVIEW: To raise awareness of and inform evidence-based practice regarding medical and behavioral interventions for antipsychotic medication-induced metabolic abnormalities. RECENT FINDINGS: The current literature indicates that individuals with severe and persistent mental illness have significantly worse health outcomes and premature mortality than the general population, owing to a combination of under-recognition and treatment of medical risk factors, reduced access to care, sedentary lifestyle and poor diet, and the potential contribution of adverse metabolic side effects of antipsychotic medications such as weight gain, hyperglycemia and dyslipidemia. A combination of administrative, behavioral and medical approaches to addressing these medical risks may be more effective than any one of these approaches alone. SUMMARY: Treatment with antipsychotic medications can induce significant weight gain and abnormalities in lipid and glucose metabolism that increase risk for cardiovascular disease and diabetes in a population already at risk from multiple other sources. Managing the side effects of antipsychotics and lowering risk in general is an important aspect of the management of chronic mental illness. There are a variety of effective medical and behavioral interventions that can be employed to achieve primary and secondary prevention aims.

Glutamate and anxiety disorders.

Anxiety disorders are among the most prevalent psychiatric disorders, but they represent a particular challenge for treatment. The standard first-line treatments, including antidepressants, benzodiazepines, and buspirone, result in significant response rates for a majority of patients; however, unfavorable side effect profiles or risk for dependency for particular agents might limit their use by anxious patients, who often have low thresholds for medication discontinuation. Novel pharmacologic agents that modulate particular receptors, ion channels, or transporters relevant to glutamatergic neurotransmission may represent a new approach to the treatment of anxiety disorders, with generally more favorable side effect profiles. Although the role of glutamate in the pathophysiology of anxiety disorders is still being elucidated, the use of these agents in treatment of anxiety disorders and commonly comorbid conditions such as substance abuse and mood disorders will continue to increase.

Open-label trial of riluzole in generalized anxiety disorder.

OBJECTIVE: There is a need to identify novel pharmacotherapies for anxiety disorders. The authors examined the safety and efficacy of riluzole, an antiglutamatergic agent, in adult outpatients with generalized anxiety disorder. METHOD: In an 8-week, open-label, fixed-dose study, 18 medically healthy patients with DSM-IV generalized anxiety disorder received treatment with riluzole (100 mg/day) following a 2-week drug-free period. The primary efficacy measure was the Hamilton Anxiety Rating Scale (HAM-A) score at endpoint. RESULTS: Twelve of the 15 patients who completed the trial responded positively to riluzole. At 8 weeks, eight of the 15 patients had HAM-A score indicating remission of their anxiety. The median time to response was 2.5 weeks. CONCLUSIONS: Riluzole appears to be an effective, well-tolerated, and rapidly acting anxiolytic medication for some patients with generalized anxiety disorder. Larger, placebo-controlled studies are indicated.