2022 ACC/AHA Guideline for the Diagnosis and Management of Aortic Disease: A Report of the American Heart Association/American College of Cardiology Joint Committee on Clinical Practice Guidelines.

AIM: The "2022 ACC/AHA Guideline for the Diagnosis and Management of Aortic Disease" provides recommendations to guide clinicians in the diagnosis, genetic evaluation and family screening, medical therapy, endovascular and surgical treatment, and long-term surveillance of patients with aortic disease across its multiple clinical presentation subsets (ie, asymptomatic, stable symptomatic, and acute aortic syndromes). METHODS: A comprehensive literature search was conducted from January 2021 to April 2021, encompassing studies, reviews, and other evidence conducted on human subjects that were published in English from PubMed, EMBASE, the Cochrane Library, CINHL Complete, and other selected databases relevant to this guideline. Additional relevant studies, published through June 2022 during the guideline writing process, were also considered by the writing committee, where appropriate. Structure: Recommendations from previously published AHA/ACC guidelines on thoracic aortic disease, peripheral artery disease, and bicuspid aortic valve disease have been updated with new evidence to guide clinicians. In addition, new recommendations addressing comprehensive care for patients with aortic disease have been developed. There is added emphasis on the role of shared decision making, especially in the management of patients with aortic disease both before and during pregnancy. The is also an increased emphasis on the importance of institutional interventional volume and multidisciplinary aortic team expertise in the care of patients with aortic disease.

Adaptation of an NLP system to a new healthcare environment to identify social determinants of health.

Social determinants of health (SDoH) are increasingly important factors for population health, healthcare outcomes, and care delivery. However, many of these factors are not reliably captured within structured electronic health record (EHR) data. In this work, we evaluated and adapted a previously published NLP tool to include additional social risk factors for deployment at Vanderbilt University Medical Center in an Acute Myocardial Infarction cohort. We developed a transformation of the SDoH outputs of the tool into the OMOP common data model (CDM) for re-use across many potential use cases, yielding performance measures across 8 SDoH classes of precision 0.83 recall 0.74 and F-measure of 0.78.

Shedding Light on the Black Box: Explaining Deep Neural Network Prediction of Clinical Outcomes.

Deep neural network models are emerging as an important method in healthcare delivery, following the recent success in other domains such as image recognition. Due to the multiple non-linear inner transformations, deep neural networks are viewed by many as black boxes. For practical use, deep learning models require explanations that are intuitive to clinicians. In this study, we developed a deep neural network model to predict outcomes following major cardiovascular procedures, using temporal image representation of past medical history as input. We created a novel explanation for the prediction of the model by defining impact scores that associate clinical observations with the outcome. For comparison, a logistic regression model was fitted to the same dataset. We compared the impact scores and log odds ratios by calculating three types of correlations, which provided a partial validation of the impact scores. The deep neural network model achieved an area under the receiver operating characteristics curve (AUC) of 0.787, compared to 0.746 for the logistic regression model. Moderate correlations were found between the impact scores and the log odds ratios. Impact scores generated by the explanation algorithm has the potential to shed light on the "black box" deep neural network model and could facilitate its adoption by clinicians.

Role of Nursing Informatics in the Automation of Pneumonia Quality Measure Data Elements.

Core measures are standard metrics to reflect the processes of care provided by hospitals. Hospitals in the United States are expected to extract data from electronic health records, automated computation of core measures, and electronic submission of the quality measures data. Traditional manual calculation processes are time intensive and susceptible to error. Automated calculation has the potential to provide timely, accurate information, which could guide quality-of-care decisions, but this vision has yet to be achieved. In this study, nursing informaticists and data analysts implemented a method to automatically extract data elements from electronic health records to calculate a core measure. We analyzed the sensitivity, specificity, and accuracy of core measure data elements extracted via SQL query and compared the results to manually extracted data elements. This method achieved excellent performance for the structured data elements but was less efficient for semistructured and unstructured elements. We analyzed challenges in automating the calculation of quality measures and proposed a rule-based (hybrid) approach for semistructured and unstructured data elements.

Generating disease-pertinent treatment vocabularies from MEDLINE citations.

OBJECTIVE: Healthcare communities have identified a significant need for disease-specific information. Disease-specific ontologies are useful in assisting the retrieval of disease-relevant information from various sources. However, building these ontologies is labor intensive. Our goal is to develop a system for an automated generation of disease-pertinent concepts from a popular knowledge resource for the building of disease-specific ontologies. METHODS: A pipeline system was developed with an initial focus of generating disease-specific treatment vocabularies. It was comprised of the components of disease-specific citation retrieval, predication extraction, treatment predication extraction, treatment concept extraction, and relevance ranking. A semantic schema was developed to support the extraction of treatment predications and concepts. Four ranking approaches (i.e., occurrence, interest, degree centrality, and weighted degree centrality) were proposed to measure the relevance of treatment concepts to the disease of interest. We measured the performance of four ranks in terms of the mean precision at the top 100 concepts with five diseases, as well as the precision-recall curves against two reference vocabularies. The performance of the system was also compared to two baseline approaches. RESULTS: The pipeline system achieved a mean precision of 0.80 for the top 100 concepts with the ranking by interest. There were no significant different among the four ranks (p=0.53). However, the pipeline-based system had significantly better performance than the two baselines. CONCLUSIONS: The pipeline system can be useful for an automated generation of disease-relevant treatment concepts from the biomedical literature.

Veterans Like Me: Formative evaluation of a patient decision aid design.

Patient decision aids are tools intended to facilitate shared decision-making. Currently development of a patient decision aid is resource intensive: it requires a decision-specific review of the scientific literature by experts to ascertain the potential outcomes under different treatments. The goal of this project was to conduct a formative evaluation of a generalizable, scalable decision aid component we call Veterans Like Me (VLme). VLme mines EHR data to present the outcomes of individuals "like you" on different treatments to the user. These outcome are presented through a combination of an icon array and simulated narratives. Twenty-six patients participated in semi-structured interviews intended to elicit feedback on the tool's functional and interface design. The interview focused on the filters users desired with which to make cases similar to them, the kinds of outcomes they wanted presented, and their envisioned use of the tool. The interview also elicited participants information needs and salient factors related to the therapeutic decision. The interview transcripts were analyzed using an iteratively refined coding schema and content analysis. . Participants generally expressed enthusiasm for the tool's design and functionality. Our analysis identified desired filters for users to view patients like themselves, outcome types that should be included in future iterations of the tool (e.g. patient reported outcomes), and information needs that need to be addressed for patients to effectively participate in shared decision making. Implications for the integration of our findings into the design of patient decision aids are discussed.

Patient needs and preferences for herb-drug-disease interaction alerts: a structured interview study.

BACKGROUND: While complementary and alternative medicine (CAM) is commonly used in the United States and elsewhere, and hazardous interactions with prescription drugs can occur, patients do not regularly communicate with physicians about their CAM use. The objective of this study was to discover patient information needs and preferences for herb-drug-disease interaction alerts. METHODS: We recruited 50 people from several locations within the University of Utah Hospital to participate in this structured interview study. They were asked to provide their preferences for the herb-drug-disease interaction alerts. Qualitative methods were used to reveal the themes that emerged from the interviews. RESULTS: Most participants reported they had previously used, or they were currently using, CAM therapies. The majority had made the effort to inform their healthcare provider(s) about their CAM usage, although some had not. We found that most respondents were interested in receiving alerts and information about potential interactions. Many preferred to receive the alerts in a variety of ways, both in person and electronically. CONCLUSIONS: In addition to conventional medicine, many patients regularly use complementary and alternative therapies. And yet, communication between patients and providers about CAM use is not consistent. There is a demand for interventions in health care that provide timely, integrative communication support. Delivering the herb-drug-disease alerts through multiple channels could help meet critical patient information needs.

Changes in Oral Anticoagulant Treatment Rates in Atrial Fibrillation before and after the Introduction of Direct Oral Anticoagulants.

BACKGROUND: Direct oral anticoagulants (DOACs) have the potential to improve stroke prevention among atrial fibrillation (AF) patients. We sought to determine if oral anticoagulation (OAC) treatment rates have increased since the approval of DOACs. METHODS: We identified 6,688 patients with AF at an academic medical center from January 2008 to June 2015. We examined OAC prescription rates over time and according to CHA2DS2VASc score using multivariable Poisson regression models, with an interaction term between risk score and year of AF diagnosis. RESULTS: Among 6,688 AF patients, 78% had CHA2DS2VASc scores ≥2, 51.6% of whom received an OAC prescription within 90 days of diagnosis. The OAC prescription rate was 47.8% in the pre-DOAC era and peaked at 56.4% in 2014. Relative to the pre-DOAC era, prescription rates increased in 2012 and leveled off thereafter. The prescription rate for the highest risk group was 58.5%, compared with 45.0% in patients with a CHA2DS2VASc score of 2 (p < 0.01). In the adjusted analysis, prescription rates were higher for the higher risk group (adjusted relative risk 1.24 for CHA2DS2VASc score 7-9 vs. 2, 95% CI 1.09-1.40). CONCLUSIONS: OAC treatment rates have increased since DOAC introduction, but substantial treatment gaps remain, specifically among the higher risk patients.

Assessing Pictograph Recognition: A Comparison of Crowdsourcing and Traditional Survey Approaches.

BACKGROUND: Compared to traditional methods of participant recruitment, online crowdsourcing platforms provide a fast and low-cost alternative. Amazon Mechanical Turk (MTurk) is a large and well-known crowdsourcing service. It has developed into the leading platform for crowdsourcing recruitment. OBJECTIVE: To explore the application of online crowdsourcing for health informatics research, specifically the testing of medical pictographs. METHODS: A set of pictographs created for cardiovascular hospital discharge instructions was tested for recognition. This set of illustrations (n=486) was first tested through an in-person survey in a hospital setting (n=150) and then using online MTurk participants (n=150). We analyzed these survey results to determine their comparability. RESULTS: Both the demographics and the pictograph recognition rates of online participants were different from those of the in-person participants. In the multivariable linear regression model comparing the 2 groups, the MTurk group scored significantly higher than the hospital sample after adjusting for potential demographic characteristics (adjusted mean difference 0.18, 95% CI 0.08-0.28, P<.001). The adjusted mean ratings were 2.95 (95% CI 2.89-3.02) for the in-person hospital sample and 3.14 (95% CI 3.07-3.20) for the online MTurk sample on a 4-point Likert scale (1=totally incorrect, 4=totally correct). CONCLUSIONS: The findings suggest that crowdsourcing is a viable complement to traditional in-person surveys, but it cannot replace them.

A three-step approach for the derivation and validation of high-performing predictive models using an operational dataset: congestive heart failure readmission case study.

BACKGROUND: The aim of this study was to propose an analytical approach to develop high-performing predictive models for congestive heart failure (CHF) readmission using an operational dataset with incomplete records and changing data over time. METHODS: Our analytical approach involves three steps: pre-processing, systematic model development, and risk factor analysis. For pre-processing, variables that were absent in >50% of records were removed. Moreover, the dataset was divided into a validation dataset and derivation datasets which were separated into three temporal subsets based on changes to the data over time. For systematic model development, using the different temporal datasets and the remaining explanatory variables, the models were developed by combining the use of various (i) statistical analyses to explore the relationships between the validation and the derivation datasets; (ii) adjustment methods for handling missing values; (iii) classifiers; (iv) feature selection methods; and (iv) discretization methods. We then selected the best derivation dataset and the models with the highest predictive performance. For risk factor analysis, factors in the highest-performing predictive models were analyzed and ranked using (i) statistical analyses of the best derivation dataset, (ii) feature rankers, and (iii) a newly developed algorithm to categorize risk factors as being strong, regular, or weak. RESULTS: The analysis dataset consisted of 2,787 CHF hospitalizations at University of Utah Health Care from January 2003 to June 2013. In this study, we used the complete-case analysis and mean-based imputation adjustment methods; the wrapper subset feature selection method; and four ranking strategies based on information gain, gain ratio, symmetrical uncertainty, and wrapper subset feature evaluators. The best-performing models resulted from the use of a complete-case analysis derivation dataset combined with the Class-Attribute Contingency Coefficient discretization method and a voting classifier which averaged the results of multi-nominal logistic regression and voting feature intervals classifiers. Of 42 final model risk factors, discharge disposition, discretized age, and indicators of anemia were the most significant. This model achieved a c-statistic of 86.8%. CONCLUSION: The proposed three-step analytical approach enhanced predictive model performance for CHF readmissions. It could potentially be leveraged to improve predictive model performance in other areas of clinical medicine.

Systematic review of clinical decision support interventions with potential for inpatient cost reduction.

BACKGROUND: Healthcare costs are increasing rapidly and at an unsustainable rate in many countries, and inpatient hospitalizations are a significant driver of these costs. Clinical decision support (CDS) represents a promising approach to not only improve care but to reduce costs in the inpatient setting. The purpose of this study was to systematically review trials of CDS interventions with the potential to reduce inpatient costs, so as to identify promising interventions for more widespread implementation and to inform future research in this area. METHODS: To identify relevant studies, MEDLINE was searched up to July 2013. CDS intervention studies with the potential to reduce inpatient healthcare costs were identified through titles and abstracts, and full text articles were reviewed to make a final determination on inclusion. Relevant characteristics of the studies were extracted and summarized. RESULTS: Following a screening of 7,663 articles, 78 manuscripts were included. 78.2% of studies were controlled before-after studies, and 15.4% were randomized controlled trials. 53.8% of the studies were focused on pharmacotherapy. The majority of manuscripts were published during or after 2008. 70.5% of the studies resulted in statistically and clinically significant improvements in an explicit financial measure or a proxy financial measure. Only 12.8% of the studies directly measured the financial impact of an intervention, whereas the financial impact was inferred in the remainder of studies. Data on cost effectiveness was available for only one study. CONCLUSIONS: Significantly more research is required on the impact of clinical decision support on inpatient costs. In particular, there is a remarkable gap in the availability of cost effectiveness studies required by policy makers and decision makers in healthcare systems.

2022 ACC/AHA guideline for the diagnosis and management of aortic disease: A report of the American Heart Association/American College of Cardiology Joint Committee on Clinical Practice Guidelines.

AIM: The "2022 ACC/AHA Guideline for the Diagnosis and Management of Aortic Disease" provides recommendations to guide clinicians in the diagnosis, genetic evaluation and family screening, medical therapy, endovascular and surgical treatment, and long-term surveillance of patients with aortic disease across its multiple clinical presentation subsets (ie, asymptomatic, stable symptomatic, and acute aortic syndromes). METHODS: A comprehensive literature search was conducted from January 2021 to April 2021, encompassing studies, reviews, and other evidence conducted on human subjects that were published in English from PubMed, EMBASE, the Cochrane Library, CINHL Complete, and other selected databases relevant to this guideline. Additional relevant studies, published through June 2022 during the guideline writing process, were also considered by the writing committee, where appropriate. STRUCTURE: Recommendations from previously published AHA/ACC guidelines on thoracic aortic disease, peripheral artery disease, and bicuspid aortic valve disease have been updated with new evidence to guide clinicians. In addition, new recommendations addressing comprehensive care for patients with aortic disease have been developed. There is added emphasis on the role of shared decision making, especially in the management of patients with aortic disease both before and during pregnancy. The is also an increased emphasis on the importance of institutional interventional volume and multidisciplinary aortic team expertise in the care of patients with aortic disease.

Summary of fourth annual MCBK public meeting: Mobilizing computable biomedical knowledge-metadata and trust.

The exponential growth of biomedical knowledge in computable formats challenges organizations to consider mobilizing artifacts in findable, accessible, interoperable, reusable, and trustable (FAIR+T) ways1. There is a growing need to apply biomedical knowledge artifacts to improve health in Learning Health Systems, health delivery organizations, and other settings. However, most organizations lack the infrastructure required to consume and apply computable knowledge, and national policies and standards adoption are insufficient to ensure that it is discoverable and used safely and fairly, nor is there widespread experience in the process of knowledge implementation as clinical decision support. The Mobilizing Computable Biomedical Knowledge (MCBK) community formed in 2016 to address these needs. This report summarizes the main outputs of the Fourth Annual MCBK public meeting, which was held virtually July 20 to July 21, 2021 and convened over 100 participants spanning diverse domains to frame and address important dimensions for mobilizing CBK.

Information Extraction From Electronic Health Records to Predict Readmission Following Acute Myocardial Infarction: Does Natural Language Processing Using Clinical Notes Improve Prediction of Readmission?

Background Social risk factors influence rehospitalization rates yet are challenging to incorporate into prediction models. Integration of social risk factors using natural language processing (NLP) and machine learning could improve risk prediction of 30-day readmission following an acute myocardial infarction. Methods and Results Patients were enrolled into derivation and validation cohorts. The derivation cohort included inpatient discharges from Vanderbilt University Medical Center between January 1, 2007, and December 31, 2016, with a primary diagnosis of acute myocardial infarction, who were discharged alive, and not transferred from another facility. The validation cohort included patients from Dartmouth-Hitchcock Health Center between April 2, 2011, and December 31, 2016, meeting the same eligibility criteria described above. Data from both sites were linked to Centers for Medicare & Medicaid Services administrative data to supplement 30-day hospital readmissions. Clinical notes from each cohort were extracted, and an NLP model was deployed, counting mentions of 7 social risk factors. Five machine learning models were run using clinical and NLP-derived variables. Model discrimination and calibration were assessed, and receiver operating characteristic comparison analyses were performed. The 30-day rehospitalization rates among the derivation (n=6165) and validation (n=4024) cohorts were 15.1% (n=934) and 10.2% (n=412), respectively. The derivation models demonstrated no statistical improvement in model performance with the addition of the selected NLP-derived social risk factors. Conclusions Social risk factors extracted using NLP did not significantly improve 30-day readmission prediction among hospitalized patients with acute myocardial infarction. Alternative methods are needed to capture social risk factors.

An explainable artificial intelligence approach for predicting cardiovascular outcomes using electronic health records.

Understanding the conditionally-dependent clinical variables that drive cardiovascular health outcomes is a major challenge for precision medicine. Here, we deploy a recently developed massively scalable comorbidity discovery method called Poisson Binomial based Comorbidity discovery (PBC), to analyze Electronic Health Records (EHRs) from the University of Utah and Primary Children's Hospital (over 1.6 million patients and 77 million visits) for comorbid diagnoses, procedures, and medications. Using explainable Artificial Intelligence (AI) methodologies, we then tease apart the intertwined, conditionally-dependent impacts of comorbid conditions and demography upon cardiovascular health, focusing on the key areas of heart transplant, sinoatrial node dysfunction and various forms of congenital heart disease. The resulting multimorbidity networks make possible wide-ranging explorations of the comorbid and demographic landscapes surrounding these cardiovascular outcomes, and can be distributed as web-based tools for further community-based outcomes research. The ability to transform enormous collections of EHRs into compact, portable tools devoid of Protected Health Information solves many of the legal, technological, and data-scientific challenges associated with large-scale EHR analyses.

Categorizing metadata to help mobilize computable biomedical knowledge.

INTRODUCTION: Computable biomedical knowledge artifacts (CBKs) are digital objects conveying biomedical knowledge in machine-interpretable structures. As more CBKs are produced and their complexity increases, the value obtained from sharing CBKs grows. Mobilizing CBKs and sharing them widely can only be achieved if the CBKs are findable, accessible, interoperable, reusable, and trustable (FAIR+T). To help mobilize CBKs, we describe our efforts to outline metadata categories to make CBKs FAIR+T. METHODS: We examined the literature regarding metadata with the potential to make digital artifacts FAIR+T. We also examined metadata available online today for actual CBKs of 12 different types. With iterative refinement, we came to a consensus on key categories of metadata that, when taken together, can make CBKs FAIR+T. We use subject-predicate-object triples to more clearly differentiate metadata categories. RESULTS: We defined 13 categories of CBK metadata most relevant to making CBKs FAIR+T. Eleven of these categories (type, domain, purpose, identification, location, CBK-to-CBK relationships, technical, authorization and rights management, provenance, evidential basis, and evidence from use metadata) are evident today where CBKs are stored online. Two additional categories (preservation and integrity metadata) were not evident in our examples. We provide a research agenda to guide further study and development of these and other metadata categories. CONCLUSION: A wide variety of metadata elements in various categories is needed to make CBKs FAIR+T. More work is needed to develop a common framework for CBK metadata that can make CBKs FAIR+T for all stakeholders.

2022 ACC/AHA Guideline for the Diagnosis and Management of Aortic Disease: A Report of the American Heart Association/American College of Cardiology Joint Committee on Clinical Practice Guidelines.

AIM: The "2022 ACC/AHA Guideline for the Diagnosis and Management of Aortic Disease" provides recommendations to guide clinicians in the diagnosis, genetic evaluation and family screening, medical therapy, endovascular and surgical treatment, and long-term surveillance of patients with aortic disease across its multiple clinical presentation subsets (ie, asymptomatic, stable symptomatic, and acute aortic syndromes). METHODS: A comprehensive literature search was conducted from January 2021 to April 2021, encompassing studies, reviews, and other evidence conducted on human subjects that were published in English from PubMed, EMBASE, the Cochrane Library, CINHL Complete, and other selected databases relevant to this guideline. Additional relevant studies, published through June 2022 during the guideline writing process, were also considered by the writing committee, where appropriate. STRUCTURE: Recommendations from previously published AHA/ACC guidelines on thoracic aortic disease, peripheral artery disease, and bicuspid aortic valve disease have been updated with new evidence to guide clinicians. In addition, new recommendations addressing comprehensive care for patients with aortic disease have been developed. There is added emphasis on the role of shared decision making, especially in the management of patients with aortic disease both before and during pregnancy. The is also an increased emphasis on the importance of institutional interventional volume and multidisciplinary aortic team expertise in the care of patients with aortic disease.

A bootstrapping algorithm to improve cohort identification using structured data.

Cohort identification is an important step in conducting clinical research studies. Use of ICD-9 codes to identify disease cohorts is a common approach that can yield satisfactory results in certain conditions; however, for many use-cases more accurate methods are required. In this study, we propose a bootstrapping method that supplements ICD-9 codes with lab results, medications, etc. to build classification models that can be used to identify cohorts more accurately. The proposed method does not require prior information about the true class of the patients. We used the method to identify Diabetes Mellitus (DM) and Hyperlipidemia (HL) patient cohorts from a database of 800 thousand patients. Evaluation results show that the method identified 11,000 patients who did not have DM related ICD-9 codes as positive for DM and 52,000 patients without HL codes as positive for HL. A review of 400 patient charts (200 patients for each condition) by two clinicians shows that in both the conditions studied, the labeling assigned by the proposed approach is more consistent with that of the clinicians compared to labeling through ICD-9 codes. The method is reasonably automated and, we believe, holds potential for inexpensive, more accurate cohort identification.

Summary of third annual MCBK public meeting: Mobilizing computable biomedical knowledge-Accelerating the second knowledge revolution.

The volume of biomedical knowledge is growing exponentially and much of this knowledge is represented in computer executable formats, such as models, algorithms, and programmatic code. There is a growing need to apply this knowledge to improve health in Learning Health Systems, health delivery organizations, and other settings. However, most organizations do not yet have the infrastructure required to consume and apply computable knowledge, and national policies and standards adoption are not sufficient to ensure that it is discoverable and used safely and fairly, nor is there widespread experience in the process of knowledge implementation as clinical decision support. The Mobilizing Computable Biomedical Knowledge (MCBK) community was formed in 2016 to address these needs. This report summarizes the main outputs of the third annual MCBK public meeting, which was held virtually from June 30 to July 1, 2020 and brought together over 200 participants from various domains to frame and address important dimensions for mobilizing CBK.

Development of Electronic Health Record-Based Prediction Models for 30-Day Readmission Risk Among Patients Hospitalized for Acute Myocardial Infarction.

Importance: In the US, more than 600 000 adults will experience an acute myocardial infarction (AMI) each year, and up to 20% of the patients will be rehospitalized within 30 days. This study highlights the need for consideration of calibration in these risk models. Objective: To compare multiple machine learning risk prediction models using an electronic health record (EHR)-derived data set standardized to a common data model. Design, Setting, and Participants: This was a retrospective cohort study that developed risk prediction models for 30-day readmission among all inpatients discharged from Vanderbilt University Medical Center between January 1, 2007, and December 31, 2016, with a primary diagnosis of AMI who were not transferred from another facility. The model was externally validated at Dartmouth-Hitchcock Medical Center from April 2, 2011, to December 31, 2016. Data analysis occurred between January 4, 2019, and November 15, 2020. Exposures: Acute myocardial infarction that required hospital admission. Main Outcomes and Measures: The main outcome was thirty-day hospital readmission. A total of 141 candidate variables were considered from administrative codes, medication orders, and laboratory tests. Multiple risk prediction models were developed using parametric models (elastic net, least absolute shrinkage and selection operator, and ridge regression) and nonparametric models (random forest and gradient boosting). The models were assessed using holdout data with area under the receiver operating characteristic curve (AUROC), percentage of calibration, and calibration curve belts. Results: The final Vanderbilt University Medical Center cohort included 6163 unique patients, among whom the mean (SD) age was 67 (13) years, 4137 were male (67.1%), 1019 (16.5%) were Black or other race, and 933 (15.1%) were rehospitalized within 30 days. The final Dartmouth-Hitchcock Medical Center cohort included 4024 unique patients, with mean (SD) age of 68 (12) years; 2584 (64.2%) were male, 412 (10.2%) were rehospitalized within 30 days, and most of the cohort were non-Hispanic and White. The final test set AUROC performance was between 0.686 to 0.695 for the parametric models and 0.686 to 0.704 for the nonparametric models. In the validation cohort, AUROC performance was between 0.558 to 0.655 for parametric models and 0.606 to 0.608 for nonparametric models. Conclusions and Relevance: In this study, 5 machine learning models were developed and externally validated to predict 30-day readmission AMI hospitalization. These models can be deployed within an EHR using routinely collected data.