A novel approach to patient portal activation data to power equity improvements.

BACKGROUND: There are significant disparities in access and utilization of patient portals by age, language, race, and ethnicity. MATERIALS AND METHODS: We developed ambulatory and inpatient portal activation equity dashboards to understand disparities in initial portal activation, identify targets for improvement, and enable monitoring of interventions over time. We selected key metrics focused on episodes of care and filters to enable high-level overviews and granular data selection to meet the needs of health system leaders and individual clinical units. RESULTS: In addition to highlighting disparities by age, preferred language, race and ethnicity, and insurance payor, the dashboards enabled development and monitoring of interventions to improve portal activation and equity. DISCUSSION AND CONCLUSIONS: Data visualization tools that provide easily accessible, timely, and customizable data can enable a variety of stakeholders to understand and address healthcare disparities, such as patient portal activation. Further institutional efforts are needed to address the persistent inequities highlighted by these dashboards.

What Complexity Science Predicts About the Potential of Artificial Intelligence/Machine Learning to Improve Primary Care.

Primary care physicians are likely both excited and apprehensive at the prospects for artificial intelligence (AI) and machine learning (ML). Complexity science may provide insight into which AI/ML applications will most likely affect primary care in the future. AI/ML has successfully diagnosed some diseases from digital images, helped with administrative tasks such as writing notes in the electronic record by converting voice to text, and organized information from multiple sources within a health care system. AI/ML has less successfully recommended treatments for patients with complicated single diseases such as cancer; or improved diagnosing, patient shared decision making, and treating patients with multiple comorbidities and social determinant challenges. AI/ML has magnified disparities in health equity, and almost nothing is known of the effect of AI/ML on primary care physician-patient relationships. An intervention in Victoria, Australia showed promise where an AI/ML tool was used only as an adjunct to complex medical decision making. Putting these findings in a complex adaptive system framework, AI/ML tools will likely work when its tasks are limited in scope, have clean data that are mostly linear and deterministic, and fit well into existing workflows. AI/ML has rarely improved comprehensive care, especially in primary care settings, where data have a significant number of errors and inconsistencies. Primary care should be intimately involved in AI/ML development, and its tools carefully tested before implementation; and unlike electronic health records, not just assumed that AI/ML tools will improve primary care work life, quality, safety, and person-centered clinical decision making.

The Costs of Anonymization: Case Study Using Clinical Data.

BACKGROUND: Sharing data from clinical studies can accelerate scientific progress, improve transparency, and increase the potential for innovation and collaboration. However, privacy concerns remain a barrier to data sharing. Certain concerns, such as reidentification risk, can be addressed through the application of anonymization algorithms, whereby data are altered so that it is no longer reasonably related to a person. Yet, such alterations have the potential to influence the data set's statistical properties, such that the privacy-utility trade-off must be considered. This has been studied in theory, but evidence based on real-world individual-level clinical data is rare, and anonymization has not broadly been adopted in clinical practice. OBJECTIVE: The goal of this study is to contribute to a better understanding of anonymization in the real world by comprehensively evaluating the privacy-utility trade-off of differently anonymized data using data and scientific results from the German Chronic Kidney Disease (GCKD) study. METHODS: The GCKD data set extracted for this study consists of 5217 records and 70 variables. A 2-step procedure was followed to determine which variables constituted reidentification risks. To capture a large portion of the risk-utility space, we decided on risk thresholds ranging from 0.02 to 1. The data were then transformed via generalization and suppression, and the anonymization process was varied using a generic and a use case-specific configuration. To assess the utility of the anonymized GCKD data, general-purpose metrics (ie, data granularity and entropy), as well as use case-specific metrics (ie, reproducibility), were applied. Reproducibility was assessed by measuring the overlap of the 95% CI lengths between anonymized and original results. RESULTS: Reproducibility measured by 95% CI overlap was higher than utility obtained from general-purpose metrics. For example, granularity varied between 68.2% and 87.6%, and entropy varied between 25.5% and 46.2%, whereas the average 95% CI overlap was above 90% for all risk thresholds applied. A nonoverlapping 95% CI was detected in 6 estimates across all analyses, but the overwhelming majority of estimates exhibited an overlap over 50%. The use case-specific configuration outperformed the generic one in terms of actual utility (ie, reproducibility) at the same level of privacy. CONCLUSIONS: Our results illustrate the challenges that anonymization faces when aiming to support multiple likely and possibly competing uses, while use case-specific anonymization can provide greater utility. This aspect should be taken into account when evaluating the associated costs of anonymized data and attempting to maintain sufficiently high levels of privacy for anonymized data. TRIAL REGISTRATION: German Clinical Trials Register DRKS00003971; https://drks.de/search/en/trial/DRKS00003971. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1093/ndt/gfr456.

Machine-learning-based risk assessment tool to rule out empirical use of ESBL-targeted therapy in endemic areas.

BACKGROUND: Antimicrobial stewardship focuses on identifying patients who require extended-spectrum beta-lactamase (ESBL)-targeted therapy. 'Rule-in' tools have been researched extensively in areas of low endemicity; however, such tools are inadequate for areas with high prevalence of ESBL-producing pathogens, as almost all patients will be selected. AIM: To develop a machine-learning-based 'rule-out' tool suitable for areas with high levels of resistance. METHODS: Gradient-boosted decision trees were used to train and validate a risk prediction model on data from 17,913 (45% ESBL) patients with Escherichia coli and Klebsiella pneumoniae in urine cultures. The predictive power of different sets of variables was evaluated using Shapley values to evaluate the contributions of variables. FINDINGS: The model successfully identified patients with low risk of ESBL resistance in ESBL-endemic areas (area under receiver operating characteristic curve 0.72). When used to select the 30% of patients with the lowest predicted risk, the model yielded a negative predictive value ≥0.74. A simplified model with seven input features was found to perform nearly as well as the full model. This simplified model is freely accessible as a web application. CONCLUSIONS: This study found that a risk calculator for antibiotic resistance can be a viable 'rule-out' strategy to reduce the use of ESBL-targeted therapy in ESBL-endemic areas. The robust performance of a version of the model with limited features makes the clinical use of such a tool feasible. This tool provides an important alternative in an era with growing rates of ESBL-producing pathogens, where some experts have called for empirical use of carbapenems as first-line therapy for all patients in areas with high prevalence of ESBL-producing pathogens.

Codesign of health technology interventions to support best-practice perioperative care and surgical waitlist management.

OBJECTIVES: This project aimed to determine where health technology can support best-practice perioperative care for patients waiting for surgery. METHODS: An exploratory codesign process used personas and journey mapping in three interprofessional workshops to identify key challenges in perioperative care across four health districts in Sydney, Australia. Through participatory methodology, the research inquiry directly involved perioperative clinicians. In three facilitated workshops, clinician and patient participants codesigned potential digital interventions to support perioperative pathways. Workshop output was coded and thematically analysed, using design principles. RESULTS: Codesign workshops, involving 51 participants, were conducted October to November 2022. Participants designed seven patient personas, with consumer representatives confirming acceptability and diversity. Interprofessional team members and consumers mapped key clinical moments, feelings and barriers for each persona during a hypothetical perioperative journey. Six key themes were identified: 'preventative care', 'personalised care', 'integrated communication', 'shared decision-making', 'care transitions' and 'partnership'. Twenty potential solutions were proposed, with top priorities a digital dashboard and virtual care coordination. DISCUSSION: Our findings emphasise the importance of interprofessional collaboration, patient and family engagement and supporting health technology infrastructure. Through user-based codesign, participants identified potential opportunities where health technology could improve system efficiencies and enhance care quality for patients waiting for surgical procedures. The codesign approach embedded users in the development of locally-driven, contextually oriented policies to address current perioperative service challenges, such as prolonged waiting times and care fragmentation. CONCLUSION: Health technology innovation provides opportunities to improve perioperative care and integrate clinical information. Future research will prototype priority solutions for further implementation and evaluation.

The MAPSTROKE project: A computational strategy to improve access to acute stroke care.

BACKGROUND: Global access to acute stroke treatment is variable worldwide, with notable gaps in low and middle-income countries (LMIC), especially in rural areas. Ensuring a standardized method for pinpointing the existing regional coverage and proposing potential sites for new stroke centers is essential to change this scenario. AIMS: To create and apply computational strategies (CSs) to determine optimal locations for new acute stroke centers (ASCs), with a pilot application in nine Latin American regions/countries. METHODS: Hospitals treating acute ischemic stroke (AIS) with intravenous thrombolysis (IVT) and meeting the minimum infrastructure requirements per structured protocols were categorized as ASCs. Hospitals with emergency departments, noncontrast computed tomography (NCCT) scanners, and 24/7 laboratories were identified as potential acute stroke centers (PASCs). Hospital geolocation data were collected and mapped using the OpenStreetMap data set. A 45-min drive radius was considered the ideal coverage area for each hospital based on the drive speeds from the OpenRouteService database. Population data, including demographic density, were obtained from the Kontur Population data sets. The proposed CS assessed the population covered by ASCs and proposed new ASCs or artificial points (APs) settled in densely populated areas to achieve a target population coverage (TPC) of 95%. RESULTS: The observed coverage in the region presented significant disparities, ranging from 0% in the Bahamas to 73.92% in Trinidad and Tobago. No country/region reached the 95% TPC using only its current ASCs or PASCs, leading to the proposal of APs. For example, in Rio Grande do Sul, Brazil, the introduction of 132 new centers was suggested. Furthermore, it was observed that most ASCs were in major urban hubs or university hospitals, leaving rural areas largely underserved. CONCLUSIONS: The MAPSTROKE project has the potential to provide a systematic approach to identify areas with limited access to stroke centers and propose solutions for increasing access to AIS treatment. DATA ACCESS STATEMENT: Data used for this publication are available from the authors upon reasonable request.

Gastroenterology Fellowship and Postdoctoral Training in Omics and Statistics-Part I: Why Is It Needed?

A multitude of federally and industry-funded efforts are underway to generate and collect human, animal, microbial, and other sources of data on an unprecedented scale; the results are commonly referred to as "big data." Often vaguely defined, big data refers to large and complex datasets consisting of myriad datatypes that can be integrated to address complex questions. Big data offers a wealth of information that can be accessed only by those who pose the right questions and have sufficient technical knowhow and analytical skills. The intersection comprised of the gut-brain axis, the intestinal microbiome and multi-ome, and several other interconnected organ systems poses particular challenges and opportunities for those engaged in gastrointestinal and liver research. Unfortunately, there is currently a shortage of clinicians, scientists, and physician-scientists with the training needed to use and analyze big data at the scale necessary for widespread implementation of precision medicine. Here, we review the importance of training in the use of big data, the perils of insufficient training, and potential solutions that exist or can be developed to address the dearth of individuals in GI and hepatology research with the necessary level of big data expertise.

Gastroenterology Fellowship and Postdoctoral Training in Omics and Statistics-Part II: How Can It Be Achieved?

Data are being generated, collected, and aggregated in massive quantities at exponentially increasing rates. This "big data," discussed in depth in the first section of this two-part series, is increasingly important to understand the nuances of the gastrointestinal tract and its complex interactions and networks involving a host of other organ systems and microbes. Creating and using these datasets correctly requires comprehensive training; however, current instruction in the integration, analysis, and interpretation of big data appears to lag far behind data acquisition. While opportunities exist for those interested in acquiring the requisite training, these appear to be underutilized, in part due to widespread ignorance of their existence. Here, to address these gaps in knowledge, we highlight existing big data learning opportunities and propose innovative approaches to attain such training. We offer suggestions at both the undergraduate and graduate medical education levels for prospective clinical and basic investigators. Lastly, we categorize training opportunities that can be selected to fit specific needs and timeframes.

Comparative study of ChatGPT and human evaluators on the assessment of medical literature according to recognised reporting standards.

INTRODUCTION: Amid clinicians' challenges in staying updated with medical research, artificial intelligence (AI) tools like the large language model (LLM) ChatGPT could automate appraisal of research quality, saving time and reducing bias. This study compares the proficiency of ChatGPT3 against human evaluation in scoring abstracts to determine its potential as a tool for evidence synthesis. METHODS: We compared ChatGPT's scoring of implant dentistry abstracts with human evaluators using the Consolidated Standards of Reporting Trials for Abstracts reporting standards checklist, yielding an overall compliance score (OCS). Bland-Altman analysis assessed agreement between human and AI-generated OCS percentages. Additional error analysis included mean difference of OCS subscores, Welch's t-test and Pearson's correlation coefficient. RESULTS: Bland-Altman analysis showed a mean difference of 4.92% (95% CI 0.62%, 0.37%) in OCS between human evaluation and ChatGPT. Error analysis displayed small mean differences in most domains, with the highest in 'conclusion' (0.764 (95% CI 0.186, 0.280)) and the lowest in 'blinding' (0.034 (95% CI 0.818, 0.895)). The strongest correlations between were in 'harms' (r=0.32, p<0.001) and 'trial registration' (r=0.34, p=0.002), whereas the weakest were in 'intervention' (r=0.02, p<0.001) and 'objective' (r=0.06, p<0.001). CONCLUSION: LLMs like ChatGPT can help automate appraisal of medical literature, aiding in the identification of accurately reported research. Possible applications of ChatGPT include integration within medical databases for abstract evaluation. Current limitations include the token limit, restricting its usage to abstracts. As AI technology advances, future versions like GPT4 could offer more reliable, comprehensive evaluations, enhancing the identification of high-quality research and potentially improving patient outcomes.

Association Between Urinary Bisphenols and Body Composition Among American Adults: Cross-Sectional National Health and Nutrition Examination Survey Study.

BACKGROUND: Bisphenol A (BPA), bisphenol S (BPS), and bisphenol F (BPF) are widely used in various consumer products. They are environmental contaminants with estrogenic properties that have been linked to various health outcomes. Understanding their impact on body composition is crucial for identifying potential health risks and developing preventive strategies. However, most current studies have only focused on their relationship with BMI. OBJECTIVE: This study aimed to investigate the association between urinary levels of BPA, BPS, and BPF and body composition, including BMI, lean mass, and fat mass, in a large population-based sample. METHODS: We conducted a cross-sectional analysis using data from the National Health and Nutrition Examination Survey 2003-2016. Body composition data were assessed using dual-energy X-ray absorptiometry, which provided precise measurements of lean mass, fat mass, and other indicators. We used multivariate linear regression models to estimate the associations, adjusting for potential confounders such as age, gender, race, socioeconomic factors, and lifestyle variables. RESULTS: The results revealed significant associations between bisphenol exposure and body composition. After adjusting for covariates, BPS showed a positive association with BMI, with quartiles 3 and 4 having 0.91 (95% CI 0.34-1.48) and 1.15 (95% CI 0.55-1.74) higher BMI, respectively, compared with quartile 1 (P<.001). BPA was negatively associated with total lean mass (TLM) and appendicular lean mass, with quartiles 2, 3, and 4 having -7.85 (95% CI -11.44 to -4.25), -12.33 (95% CI -16.12 to -8.54), and -11.08 (95% CI -15.16 to -7.01) lower TLM, respectively, compared with quartile 1 (P<.001). BPS was negatively associated with TLM, with quartiles 3 (ß=-10.53, 95% CI -16.98 to -4.08) and 4 (ß=-11.14, 95% CI -17.83 to -4.45) having significantly lower TLM (P=.005). Both BPA and BPS showed a positive dose-response relationship with trunk fat (BPA: P=.002; BPS: P<.001) and total fat (BPA: P<.001; BPS: P=.01). No significant association was found between BPF and any body composition parameter. CONCLUSIONS: This large-sample study highlights the associations between urinary levels of BPA and BPS and alterations in body composition, including changes in lean mass, fat mass, and regional fat distribution. These findings underscore the importance of understanding the potential health risks associated with bisphenol exposure and emphasize the need for targeted interventions to mitigate adverse effects on body composition.

Strengthening Cybersecurity for Patient Data Protection in Europe.

The health care sector experiences 76% of cybersecurity breaches due to basic web application attacks, miscellaneous errors, and system intrusions, resulting in compromised health data or disrupted health services. The European Commission proposed the European Health Data Space (EHDS) in 2022 to enhance care delivery and improve patients' lives by offering all European Union (EU) citizens control over their personal health data in a private and secure environment. The EU has taken an important step in homogenizing the health data environment of the European health ecosystem, although more attention needs to be paid to keeping the health data of EU citizens safe and secure within the EHDS. The pooling of health data across countries can have tremendous benefits, but it may also become a target for cybercriminals or state-sponsored hackers. State-of-the-art security measures are essential, and the current EHDS proposal lacks sufficient measures to warrant a cybersecure and resilient environment.

Social Determinants of Health Documentation in Structured and Unstructured Clinical Data of Patients With Diabetes: Comparative Analysis.

Background: Electronic health records (EHRs) have yet to fully capture social determinants of health (SDOH) due to challenges such as nonexistent or inconsistent data capture tools across clinics, lack of time, and the burden of extra steps for the clinician. However, patient clinical notes (unstructured data) may be a better source of patient-related SDOH information. Objective: It is unclear how accurately EHR data reflect patients' lived experience of SDOH. The manual process of retrieving SDOH information from clinical notes is time-consuming and not feasible. We leveraged two high-throughput tools to identify SDOH mappings to structured and unstructured patient data: PatientExploreR and Electronic Medical Record Search Engine (EMERSE). Methods: We included adult patients (≥18 years of age) receiving primary care for their diabetes at the University of California, San Francisco (UCSF), from January 1, 2018, to December 31, 2019. We used expert raters to develop a corpus using SDOH in the compendium as a knowledge base as targets for the natural language processing (NLP) text string mapping to find string stems, roots, and syntactic similarities in the clinical notes of patients with diabetes. We applied advanced built-in EMERSE NLP query parsers implemented with JavaCC. Results: We included 4283 adult patients receiving primary care for diabetes at UCSF. Our study revealed that SDOH may be more significant in the lives of patients with diabetes than is evident from structured data recorded on EHRs. With the application of EMERSE NLP rules, we uncovered additional information from patient clinical notes on problems related to social connectionsisolation, employment, financial insecurity, housing insecurity, food insecurity, education, and stress. Conclusions: We discovered more patient information related to SDOH in unstructured data than in structured data. The application of this technique and further investment in similar user-friendly tools and infrastructure to extract SDOH information from unstructured data may help to identify the range of social conditions that influence patients' disease experiences and inform clinical decision-making.

Usability and acceptability of virtual reality for chronic pain management among diverse patients in a safety-net setting: a qualitative analysis.

Objective: The aim of this study was to understand the usability and acceptability of virtual reality (VR) among a racially and ethnically diverse group of patients who experience chronic pain. Materials and Methods: Using the Technology Acceptance Model theory, we conducted semistructured interviews and direct observation of VR use with English-speaking patients who experience chronic pain treated in a public healthcare system (n = 15), using a commercially available VR technology platform. Interviews included questions about current pain management strategies, technology use, experiences and opinions with VR, and motivators for future use. Results: Before the study, none of the 15 participants had heard about or used VR for pain management. Common motivators for VR use included a previous history of substance use and having exhausted many other options to manage their pain and curiosity. Most participants had a positive experience with VR and 47% found that the VR modules distracted them from their pain. When attempting the navigation-based usability tasks, most participants (73%-92%) were able to complete them independently. Discussion: VR is a usable tool for diverse patients with chronic pain. Our findings suggest that the usability of VR is not a barrier and perhaps a focus on improving the accessibility of VR in safety-net settings is needed to reduce disparities in health technology use. Conclusions: The usability and acceptability of VR are rarely studied in diverse patient populations. We found that participants had a positive experience using VR, showed interest in future use, and would recommend VR to family and friends.

Applying anti-racist approaches to informatics: a new lens on traditional frames.

Health organizations and systems rely on increasingly sophisticated informatics infrastructure. Without anti-racist expertise, the field risks reifying and entrenching racism in information systems. We consider ways the informatics field can recognize institutional, systemic, and structural racism and propose the use of the Public Health Critical Race Praxis (PHCRP) to mitigate and dismantle racism in digital forms. We enumerate guiding questions for stakeholders along with a PHCRP-Informatics framework. By focusing on (1) critical self-reflection, (2) following the expertise of well-established scholars of racism, (3) centering the voices of affected individuals and communities, and (4) critically evaluating practice resulting from informatics systems, stakeholders can work to minimize the impacts of racism. Informatics, informed and guided by this proposed framework, will help realize the vision of health systems that are more fair, just, and equitable.

Economic Impact of a Hospital Cyberattack in a National Health System: Descriptive Case Study.

BACKGROUND: Over the last decade, the frequency and size of cyberattacks in the health care industry have increased, ranging from breaches of processes or networks to encryption of files that restrict access to data. These attacks may have multiple consequences for patient safety, as they can, for example, target electronic health records, access to critical information, and support for critical systems, thereby causing delays in hospital activities. The effects of cybersecurity breaches are not only a threat to patients' lives but also have financial consequences due to causing inactivity in health care systems. However, publicly available information on these incidents quantifying their impact is scarce. OBJECTIVE: We aim, while using public domain data from Portugal, to (1) identify data breaches in the public national health system since 2017 and (2) measure the economic impact using a hypothesized scenario as a case study. METHODS: We retrieved data from multiple national and local media sources on cybersecurity from 2017 until 2022 and built a timeline of attacks. In the absence of public information on cyberattacks, reported drops in activity were estimated using a hypothesized scenario for affected resources and percentages and duration of inactivity. Only direct costs were considered for estimates. Data for estimates were produced based on planned activity through the hospital contract program. We use sensitivity analysis to illustrate how a midlevel ransomware attack might impact health institutions' daily costs (inferring a potential range of values based on assumptions). Given the heterogeneity of our included parameters, we also provide a tool for users to distinguish such impacts of different attacks on institutions according to different contract programs, served population size, and proportion of inactivity. RESULTS: From 2017 to 2022, we were able to identify 6 incidents in Portuguese public hospitals using public domain data (there was 1 incident each year and 2 in 2018). Financial impacts were obtained from a cost point of view, where estimated values have a minimum-to-maximum range of €115,882.96 to €2,317,659.11 (a currency exchange rate of €1=US $1.0233 is applicable). Costs of this range and magnitude were inferred assuming different percentages of affected resources and with different numbers of working days while considering the costs of external consultation, hospitalization, and use of in- and outpatient clinics and emergency rooms, for a maximum of 5 working days. CONCLUSIONS: To enhance cybersecurity capabilities at hospitals, it is important to provide robust information to support decision-making. Our study provides valuable information and preliminary insights that can help health care organizations better understand the costs and risks associated with cyber threats and improve their cybersecurity strategies. Additionally, it demonstrates the importance of adopting effective preventive and reactive strategies, such as contingency plans, as well as enhanced investment in improving cybersecurity capabilities in this critical area while aiming to achieve cyber-resilience.

The effect of digitalization of nursing forms in ICUs on time and cost.

OBJECTIVE: Intensive Care Units are one of the areas with the lowest digitization rate. This study aims to measure the effect of digitizing medical records kept in paper forms in ICUs on time-saving and paper consumption. In our study, care forms in ICUs were transferred to digital media. In our research, care forms in ICUs were transferred to digital media. METHODS: The time required to fill out the nursing care forms on paper and digital media was measured, the change in paper and printer costs was determined, and the results were compared. Two volunteer nurses working in the ICU of a university hospital in Istanbul measured the time it took to fill out the forms of patients on paper. Then, a future projection was made using digital form data of 5,420 care days of 428 patients hospitalized between October 2017 and September 2018. Only anonymous data of patients hospitalized in the general ICU were used, and other untempered were not included in the study. RESULTS: When the forms were filled in digitally by the nurses, one nurse per patient per day saved 56.82 min (3.95% per day). DISCUSSION: Health care services are provided in hospitals in Turkey with 28,353 adult intensive care beds and an occupancy rate of 68%. Based on the occupancy rate of 68%, the number of full beds is 19,280. When 56.82 min are saved per bed from the forms filled by the nurses, 760.71 care days are dedicated. Considering the salary of 1,428.67 US dollars per nurse, the savings to be achieved are estimated to be 13,040,804.8 US dollars per year.

New Artificial Intelligence ChatGPT Performs Poorly on the 2022 Self-assessment Study Program for Urology.

INTRODUCTION: Large language models have demonstrated impressive capabilities, but application to medicine remains unclear. We seek to evaluate the use of ChatGPT on the American Urological Association Self-assessment Study Program as an educational adjunct for urology trainees and practicing physicians. METHODS: One hundred fifty questions from the 2022 Self-assessment Study Program exam were screened, and those containing visual assets (n=15) were removed. The remaining items were encoded as open ended or multiple choice. ChatGPT's output was coded as correct, incorrect, or indeterminate; if indeterminate, responses were regenerated up to 2 times. Concordance, quality, and accuracy were ascertained by 3 independent researchers and reviewed by 2 physician adjudicators. A new session was started for each entry to avoid crossover learning. RESULTS: ChatGPT was correct on 36/135 (26.7%) open-ended and 38/135 (28.2%) multiple-choice questions. Indeterminate responses were generated in 40 (29.6%) and 4 (3.0%), respectively. Of the correct responses, 24/36 (66.7%) and 36/38 (94.7%) were on initial output, 8 (22.2%) and 1 (2.6%) on second output, and 4 (11.1%) and 1 (2.6%) on final output, respectively. Although regeneration decreased indeterminate responses, proportion of correct responses did not increase. For open-ended and multiple-choice questions, ChatGPT provided consistent justifications for incorrect answers and remained concordant between correct and incorrect answers. CONCLUSIONS: ChatGPT previously demonstrated promise on medical licensing exams; however, application to the 2022 Self-assessment Study Program was not demonstrated. Performance improved with multiple-choice over open-ended questions. More importantly were the persistent justifications for incorrect responses-left unchecked, utilization of ChatGPT in medicine may facilitate medical misinformation.

Asymmetric Interoperability as a Strategy Among Provider Group Health Information Exchange: Directional Analysis.

BACKGROUND: High levels of seamless, bidirectional health information exchange continue to be broadly limited among provider groups despite the vast array of benefits that interoperability entails for patient care and the many persistent efforts across the health care ecosystem directed at advancing interoperability. As provider groups seek to act in their strategic best interests, they are often interoperable and exchange information in certain directions but not others, leading to the formation of asymmetries. OBJECTIVE: We aimed to examine the correlation at the provider group level between the distinct directions of interoperability with regard to sending health information and receiving health information, to describe how this correlation varies across provider group types and provider group sizes, and to analyze the symmetries and asymmetries that arise in the exchange of patient health information across the health care ecosystem as a result. METHODS: We used data from the Centers for Medicare & Medicaid Services (CMS), which included interoperability performance information for 2033 provider groups within the Quality Payment Program Merit-based Incentive Payment System and maintained distinct performance measures for sending health information and receiving health information. In addition to compiling descriptive statistics, we also conducted a cluster analysis to identify differences among provider groups-particularly with respect to symmetric versus asymmetric interoperability. RESULTS: We found that the examined directions of interoperability-sending health information and receiving health information-have relatively low bivariate correlation (0.4147) with a significant number of observations exhibiting asymmetric interoperability (42.5%). Primary care providers are generally more likely to exchange information asymmetrically than specialty providers, being more inclined to receive health information than to send health information. Finally, we found that larger provider groups are significantly less likely to be bidirectionally interoperable than smaller groups, although both are asymmetrically interoperable at similar rates. CONCLUSIONS: The adoption of interoperability by provider groups is more nuanced than traditionally considered and should not be seen as a binary determination (ie, to be interoperable or not). Asymmetric interoperability-and its pervasive presence among provider groups-reiterates how the manner in which provider groups exchange patient health information is a strategic choice and may pose similar implications and potential harms as the practice of information blocking has in the past. Differences in the operational paradigms among provider groups of varying types and sizes may explain their varying extents of health information exchange for sending and receiving health information. There continues to remain substantial room for improvement on the path to achieving a fully interoperable health care ecosystem, and future policy efforts directed at advancing interoperability should consider the practice of being asymmetrically interoperable among provider groups.

Acceptability and Usability of a Wearable Device for Sleep Health Among English- and Spanish-Speaking Patients in a Safety Net Clinic: Qualitative Analysis.

BACKGROUND: Sleep disorders are common and disproportionately affect marginalized populations. Technology, such as wearable devices, holds the potential to improve sleep quality and reduce sleep disparities, but most devices have not been designed or tested with racially, ethnically, and socioeconomically diverse patients. Inclusion and engagement of diverse patients throughout digital health development and implementation are critical to achieving health equity. OBJECTIVE: This study aims to evaluate the usability and acceptability of a wearable sleep monitoring device-SomnoRing-and its accompanying mobile app among patients treated in a safety net clinic. METHODS: The study team recruited English- and Spanish-speaking patients from a mid-sized pulmonary and sleep medicine practice serving publicly insured patients. Eligibility criteria included initial evaluation of obstructed sleep apnea, which is most appropriate for limited cardiopulmonary testing. Patients with primary insomnia or other suspected sleep disorders were not included. Patients tested the SomnoRing over a 7-night period and participated in a 1-hour semistructured web-based qualitative interview covering perceptions of the device, motivators and barriers to use, and general experiences with digital health tools. The study team used inductive or deductive processes to code interview transcripts, guided by the Technology Acceptance Model. RESULTS: A total of 21 individuals participated in the study. All participants owned a smartphone, almost all (19/21) felt comfortable using their phone, and few already owned a wearable (6/21). Almost all participants wore the SomnoRing for 7 nights and found it comfortable. The following four themes emerged from qualitative data: (1) the SomnoRing was easy to use compared to other wearable devices or traditional home sleep testing alternatives, such as the standard polysomnogram technology for sleep studies; (2) the patient's context and environment, such as family and peer influence, housing status, access to insurance, and device cost affected the overall acceptance of the SomnoRing; (3) clinical champions motivated use in supporting effective onboarding, interpretation of data, and, ongoing technical support; and (4) participants desired more assistance and information to best interpret their own sleep data summarized in the companion app. CONCLUSIONS: Racially, ethnically, and socioeconomically diverse patients with sleep disorders perceived a wearable as useful and acceptable for sleep health. Participants also uncovered external barriers related to the perceived usefulness of the technology, such as housing status, insurance coverage, and clinical support. Future studies should further examine how to best address these barriers so that wearables, such as the SomnoRing, can be successfully implemented in the safety net health setting.

Aplicación de la dinámica de sistemas en el análisis de la evolución de la hipoacusia y la evaluación del impacto de estrategias sanitarias

Objetivos: Aplicar la dinámica de sistemas para estimar la evolución de la incidencia y la prevalencia de hipoacusia en personas mayores en países de bajos, medios y altos ingresos, así como el acceso al tratamiento, y evaluar la influencia de la implementación de estrategias sanitarias sobre estos indicadores. Metodología: Los análisis se realizaron mediante simulación con dinámica de sistemas según parámetros globales. Para ello, se desarrolló un diagrama de bucles causal, integrando la incidencia, la prevalencia y el tratamiento de hipoacusia con el nivel de desigualdad, factores de riesgo, uso de dispositivos de ayuda auditiva, fuerza laboral de audiólogos y otorrinolaringólogos según el nivel de ingresos del país. Luego, se construyó un diagrama de flujo para ejecutar las simulaciones durante un período de 100 años. Además, se ejecutaron cuatro simulaciones con estrategias sanitarias (reducción de factores de riesgo, mejora en el uso dispositivos de ayuda auditiva, aumento del número de audiólogos y otorrinolaringólogos) y se estimó el porcentaje de cambio respecto al modelo basal. Resultados: Los países de bajos ingresos mostraron una mayor incidencia y prevalencia de hipoacusia, menor acceso a tratamiento adecuado y una mayor prevalencia de hipoacusia sin tratar o con tratamiento inadecuado. La reducción de factores de riesgo creció en un 15 y 33 % la población con audición normal en los próximos 50 y 100 años, respectivamente. Además, la mejora en el uso de dispositivos de ayuda auditiva logró una reducción del 60 % de la población con tratamientos inadecuados o sin tratamiento, y el aumento de audiólogos y otorrinolaringólogos incrementó un 250 % el acceso a un tratamiento adecuado. Conclusiones: La evolución de la salud auditiva está condicionada por factores económicos, donde los entornos más desfavorecidos muestran peores indicadores. Además, la implementación de estrategias combinadas favorecería la salud auditiva en el futuro.

Objectives: To estimate the evolution of the incidence and prevalence of hearing loss in the elderly in low-, middle- and high-income countries by means of system dynamics simulation according to global parameters and to analyze the influence of the implementation of health strategies. Methodology: A causal loop diagram was developed to relate the incidence, prevalence and treatment of hearing loss to the level of inequality, risk factors (RF), use of hearing aids (HA), audiologist and otolaryngologist (ENT) workforce by country income level. A flow chart was then constructed to run the simulations over a 100-year period. In addition, four simulations were run with health strategies (reduction of RF, improvement in HA use, increase in the number of audiologists and ENT specialists) and the percentage change from the baseline model was estimated. Results: Low-income countries showed a higher incidence and prevalence of hearing loss, less access to adequate treatment, and a higher prevalence of untreated or inadequately treated hearing loss. The reduction of RF increased the population with normal hearing by 15% and 33% over the next 50 and 100 years, respectively. In addition, the improvement in the use of ha achieved a 60% reduction in the population with inadequate or untreated treatment, and the increase in audiologists and ENT specialists improved the access to adequate treatment by 250%. Conclusions: The evolution of hearing health is conditioned by economic factors, where the most disadvantaged environments show worse indicators. In addition, the implementation of combined strategies would favor hearing health in the future. System dynamics is a very useful methodology for health managers because it enables to understand how a disease evolves and define what are the best health interventions considering different scenarios.

Objetivos: Aplicar a dinâmica do sistema para estimar a evolução da incidência e prevalência da perda auditiva em pessoas idosas em países de baixo, médio e alto rendimento, bem como o acesso ao tratamento, e avaliar a influência da implementação de estratégias de saúde sobre estes indicadores. Metodologia: As análises foram conduzidas utilizando simulação da dinâmica do sistema com base em parâmetros globais. Para tal, foi desenvolvido um diagrama do laço causal, integrando a incidência, prevalência e tratamento da perda auditiva com o nível de desigualdade, fatores de risco, utilização de aparelhos auditivos, mão-de-obra de audiologistas e otorrinolaringologistas por nível de rendimento nacional. Foi então construído um fluxograma para executar as simulações ao longo de um período de 100 anos. Além disso, foram realizadas quatro simulações com estratégias de saúde (reduzindo os fatores de risco, melhorando a utilização de aparelhos auditivos, aumentando o número de audiologistas e otorrinolaringologistas) e foi estimada a mudança percentual em relação ao modelo de base. Resultados: Os países de baixos rendimentos mostraram maior incidência e prevalência de perda auditiva, menor acesso a tratamento apropriado e maior prevalência de perda auditiva não tratada ou tratada de forma inadequada. A redução dos fatores de risco aumentou a população com audição normal em 15 e 33% durante os próximos 50 e 100 anos, respectivamente. Além disso, uma melhor utilização de aparelhos auditivos permitiu uma redução de 60% na população mal tratada ou não tratada, e o aumento do número de audiologistas e especialistas em ORL aumentou em 250% o acesso ao tratamento adequado. Conclusões: A evolução da saúde auditiva é condicionada por fatores económicos, com os ambientes mais desfavorecidos a apresentarem indicadores piores. Além disso, a implementação de estratégias combinadas favoreceria a saúde auditiva no futuro.