Analysis of Oklahoma amputation trends and identification of risk factors to target areas for limb preservation interventions.

OBJECTIVE: Annual trends of lower extremity amputation due to end-stage chronic disease are on the rise in the United States. These amputations are leading to massive expenses for patients and the medical system. In Oklahoma, we have a high-risk population because access to care is low, the number of uninsured is high, cardiovascular health is poor, and our overall health care performance is ranked 50th in the country. But we know little about Oklahomans and their risk of limb loss. It is, therefore, imperative to look closely at this population to discover contemporary rates, trends, and state-specific risk factors for amputation due to diabetes and/or peripheral arterial disease (PAD). We hypothesize that state-specific groups will be identified as having the highest risk for limb loss and that contemporary trends in amputations are rising. To create implementable solutions to limb preservation, a baseline must be set. METHODS: We conducted a 12-consecutive-year observational study using Oklahoma's hospital discharge data. Discharges among patients 20 years or older with a primary or secondary diagnosis of diabetes and/or PAD were included. Diagnoses and amputation procedures were identified using International Classification of Disease-9 and -10 codes. Amputation rates were calculated per 1000 discharges. Trends in amputation rates were measured by annual percentage changes (APC). Prevalence ratios evaluated the differences in amputation rates across demographic groups. RESULTS: Over 5,000,000 discharges were identified from 2008 to 2019. Twenty-four percent had a diagnosis of diabetes and/or PAD. The overall amputation rate was 12 per 1000 discharges for those with diabetes and/or PAD. Diabetes and/or PAD-related amputation rates increased from 8.1 to 16.2 (APC, 6.0; 95% confidence interval [CI], 4.7-7.3). Most amputations were minor (59.5%), and although minor, increased at a faster rate compared with major amputations (minor amputation APC, 8.1; 95% CI, 6.7-9.6 vs major amputation APC, 3.1; 95% CI, 1.5-4.7); major amputations were notable in that they were significantly increasing. Amputation rates were the highest among males (16.7), American Indians (19.2), uninsured (21.2), non-married patients (12.7), and patients between 45 and 49 years of age (18.8), and calculated prevalence ratios for each were significant (P = .001) when compared within their respective category. CONCLUSIONS: Amputation rates in Oklahoma have nearly doubled in 12 years, with both major and minor amputations significantly increasing. This study describes a worsening trend, underscoring that amputations due to chronic disease is an urgent statewide health care problem. We also present imperative examples of amputation health care disparities. By defining these state-specific areas and populations at risk, we have identified areas to pursue and improve care. These distinctive risk factors will help to frame a statewide limb preservation intervention.

Teledermatology: Simulating Hybrid Workflows for Telemedicine Education.

Given the importance of telemedicine in improving healthcare access for underserved patients, professional students need experience using virtual clinical workflows. We developed an educational workshop with (1) readings, (2) a knowledge assessment test, (3) dermatology and teledermatology lectures, (5) a telemedicine simulation with a standardized patient, and (6) a debriefing session. The simulation included a "hybrid" workflow with live videoconferencing and store-and-forward image review. We measured student performance using three American Association of Medical Colleges (AAMC) Telemedicine Competencies for medical education. Ninety-eight medical and physician assistant students completed this workshop between 2021 and 2022, and 80% were entrustable or approaching entrustment in each competency. Some students struggled with data collection and technology use. Our results suggest that this workshop offers a practical and generalizable way to teach about multiple virtual workflows and strengthen students' telemedicine competencies.

Simulating Telemedicine, Medication Reconciliation, and Social Determinants: A Novel Instructional Approach to Health Systems Competencies.

While medication reconciliation is necessary to reduce errors, it is often challenging to gather an accurate history in the clinic. Telemedicine offers a relative advantage over clinic and hospital-based interviews by enabling the clinician to inspect the home environment, review pill bottles, and identify social determinants affecting adherence, such as financial instability. To be effective, however, clinicians must be trained in best-practice interview methods and the proper use of telemedicine. There is very little information in the literature describing the best strategies for teaching students or measuring competencies in telemedicine. Therefore, we created an educational module with a telemedicine simulation and an evaluation rubric. We piloted this module with 48 medical and physician assistant students. Most students could complete a virtual interview and gather a medication history. However, only half identified an over-the-counter medication missing from the list. Most students were either entrustable or approaching entrustment in the six telemedicine competencies measured in this simulation. This simulation is valuable for teaching students about medication reconciliation, using telemedicine to close gaps in access to care, and identifying health-related social needs affecting medication adherence.

Automation vs. Innovation: Unexplored Strategies to Improve Virtual Care.

While there is a global desire to increase digital health capacity, digital health should transform health services delivery rather than simply automate - or worse - replicate existing practices. Failing to capitalize on this transformative potential misses an opportunity to engage patients and other users to provide a more person-centered experience. However, digital transformation done recklessly can disrupt workflow, alienate users, and jeopardize patient safety, as we have observed with implementation of many digital health tools. This paper uses a telemedicine example to provide insight into how digital health innovation can be a meaningful enabler of health system transformation. Examining different ways to leverage digital health technologies is crucial to best capitalize on their potential.

Identifying Failure Modes in Telemedicine: An Instructional Needs Assessment.

Technology failures in telehealth are common, and clinicians need the skills to diagnose and manage them at the point of care. However, there are issues beyond technology failures mediating the effective use of telehealth. We must teach best-practice procedures for conducting telemedicine visits and include in instructional simulations commonly encountered failure modes so students can build their skills. To this end, we recruited medical students to conduct a Healthcare Failure Modes and Effects Analysis (HFMEA) to predict failures in telemedicine, their potential causes, and the consequences to develop and teach prevention strategies. Sixteen students observed telehealth appointments independently. Based on their observations, we identified four categories of failures in telemedicine: technical issues, patient safety, communication, and social and structural determinants. We proposed a normalized workflow that included management and prevention strategies. Our findings can inform the creation of new curricula.

Assessing Telemedicine Competencies: Developing and Validating Learner Measures for Simulation-Based Telemedicine Training.

In 2021, the Association of American Medical Colleges published Telehealth Competencies Across the Learning Continuum, a roadmap for designing telemedicine curricula and evaluating learners. While this document advances educators' shared understanding of telemedicine's core content and performance expectations, it does not include turn-key-ready evaluation instruments. At the University of Oklahoma School of Community Medicine, we developed a year-long telemedicine curriculum for third-year medical and second-year physician assistant students. We used the AAMC framework to create program objectives and instructional simulations. We designed and piloted an assessment rubric for eight AAMC competencies to accompany the simulations. In this monograph, we describe the rubric development, scores for students participating in simulations, and results comparing inter-rater reliability between faculty and standardized patient evaluators. Our preliminary work suggests that our rubric provides a practical method for evaluating learners by faculty during telemedicine simulations. We also identified opportunities for additional reliability and validity testing.

Teaching Teledermatology: A Simulation Pilot for Health Professional Students.

We developed a teledermatology simulation to give medical and physician assistant students practice with live videoconferencing and store-and-forward workflows. The simulation included (1) pre-session reading; (2) a brief teledermatology didactic; (3) a simulated encounter with a standardized patient; and (4) faculty-led debriefs. The faculty observed students during the simulation and distributed a post-session learner satisfaction survey. Although students had mixed feelings about the simulation, 88% said the workshop met or exceeded expectations.

A Telepsychiatry Simulation for Suicide Assessment: Teaching Telemedicine Safety Competencies.

Educators must provide controlled scenarios for health professional students to develop patient safety competencies related to telemedicine, including when and how to escalate care. We developed a telepsychiatry workshop to give students experience with a high-stakes mental health condition. The workshop included (1) pre-session readings; (2) didactics on mood disorders and telepsychiatry; (3) a motivational interviewing exercise; (4) a simulated telemedicine encounter; and (5) a faculty-led group debrief. We evaluated teaching effectiveness using a competency assessment with three scales: (1) medical knowledge; (2) interpersonal and communication skills; and (3) telemedicine competencies. Between 0 and 59% of students were entrustable for each telemedicine competency. Our workshop demonstrates how to teach students about the safe use of telehealth technology and provides practice triaging mental health conditions commonly encountered in primary care and mental health telemedicine clinics.

A structural model of high crime neighborhoods as a driver of toxic stress leading to asthma diagnoses among children of a large medical practice.

This study tested the relationship of neighborhood crime as a driver of pediatric asthma diagnoses via the mechanism of toxic stress utilizing data from a police department, and pediatric clinic in a large urban city in the southwestern United States. Using structural equation modeling, a full mediation model of neighborhood crime as a driver of toxic stress resulting in increased asthma diagnoses fit the data well (Χ2 = 14.0, p =.371; df = 13; RMSEA = .028 [90% CI: 0.00, 0.102]; CFI: 0.995; SRMR = .053). Advocates should explore ways to reduce neighborhood crime to address toxic stress and asthma.

Teaching Medical Students Health Care Failure Mode and Effect Analysis: A Case Study of Inpatient Pain Management Computerized Decision Support.

There is a pressing need to provide health professional leaners experiential learning opportunities in health systems science and quality improvement. Moreover, there are several published tools to diagnose and treat health system vulnerabilities and hazards. The Health Care Failure Mode and Effect AnalysisTM (HFMEA) is a systems-engineering tool that the military and aerospace industries developed to proactively identify potential errors. While this technique has been used in a range of healthcare settings, there are few reports where health professional educators have used it with learners to teach quality improvement and systems engineering methods. We describe herewith an application of HFMEA in a medical informatics professional student rotation. In this manuscript, we briefly review HFMEA theory and methods, illustrate its application to address a quality improvement initiative, and reflect upon its value - and limitations - when used in an educational context.

Validity of Medical Record Abstraction and Electronic Health Record-Generated Reports to Assess Performance on Cardiovascular Quality Measures in Primary Care.

Importance: Cardiovascular disease is the leading cause of death in the United States. To improve cardiovascular outcomes, primary care must have valid methods of assessing performance on cardiovascular clinical quality measures, including aspirin use (aspirin measure), blood pressure control (BP measure), and smoking cessation counseling and intervention (smoking measure). Objective: To compare observed performance scores measured using 2 imperfect reference standard data sources (medical record abstraction [MRA] and electronic health record [EHR]-generated reports) with misclassification-adjusted performance scores obtained using bayesian latent class analysis. Design, Setting, and Participants: This cross-sectional study used a subset of the 2016 aspirin, BP, and smoking performance data from the Healthy Hearts for Oklahoma Project. Each clinical quality measure was calculated for a subset of a practice's patient population who can benefit from recommended care (ie, the eligible population). A random sample of 380 eligible patients were included for the aspirin measure; 126, for the BP measure; and 115, for the smoking measure. Data were collected from 21 primary care practices belonging to a single large health care system from January 1 to December 31, 2018, and analyzed from February 21 to April 17, 2019. Main Outcomes and Measures: The main outcomes include performance scores for the aspirin, BP, and smoking measures using imperfect MRA and EHRs and estimated through bayesian latent class models. Results: A total of 621 eligible patients were included in the analysis. Based on MRA and EHR data, observed aspirin performance scores were 76.0% (95% bayesian credible interval [BCI], 71.5%-80.1%) and 74.9% (95% BCI, 70.4%-79.1%), respectively; observed BP performance scores, 80.6% (95% BCI, 73.2%-86.9%) and 75.1% (95% BCI, 67.2%-82.1%), respectively; and observed smoking performance scores, 85.7% (95% BCI, 78.6%-91.2%) and 75.4% (95% BCI, 67.0%-82.6%), respectively. Misclassification-adjusted estimates were 74.9% (95% BCI, 70.5%-79.1%) for the aspirin performance score, 75.0% (95% BCI, 66.6%-82.5%) for the BP performance score, and 83.0% (95% BCI, 74.4%-89.8%) for the smoking performance score. Conclusions and Relevance: Ensuring valid performance measurement is critical for value-based payment models and quality improvement activities in primary care. This study found that extracting information for the same individuals using different data sources generated different performance score estimates. Further research is required to identify the sources of these differences.

User Experience Theories, Models, and Frameworks: A Focused Review of the Healthcare Literature.

User experience (UX) theories, models, and frameworks (TMFs) help scope user-centered design activities, aid in the selection of constructs and measures, and contextualize findings within a larger knowledge base. However, the fragmentation of literature across disciplines and the inconsistent use of TMFs makes integrating concepts and selecting UX tools challenging. Therefore, we conducted a focused review of the healthcare literature to identify a succinct list of UX-specific TMFs for academic UX researchers and industry practitioners alike.

Challenges and Best Practices in Ethical Review of Human and Organizational Factors Studies in Health Technology: a Synthesis of Testimonies.

OBJECTIVE: Human and Organizational Factors (HOF) studies in health technology involve human beings and thus require Institutional Review Board (IRB) approval. Yet HOF studies have specific constraints and methods that may not fit standard regulations and IRB practices. Gaining IRB approval may pose difficulties for HOF researchers. This paper aims to provide a first overview of HOF study challenges to get IRB review by exploring differences and best practices across different countries. METHODS: HOF researchers were contacted by email to provide a testimony about their experience with IRB review and approval. Testimonies were thematically analyzed and synthesized to identify and discuss shared themes. RESULTS: Researchers from seven European countries, Argentina, Canada, Australia, and the United States answered the call. Four themes emerged that indicate shared challenges in legislation, IRB inefficiencies and inconsistencies, general regulation and costs, and lack of HOF study knowledge by IRB members. We propose a model for IRB review of HOF studies based on best practices. CONCLUSION: International criteria are needed that define low and high-risk HOF studies, to allow identification of studies that can undergo an expedited (or exempted) process from those that need full IRB review. Enhancing IRB processes in such a way would be beneficial to the conduct of HOF studies. Greater knowledge and promotion of HOF methods and evidence-based HOF study designs may support the evolving discipline. Based on these insights, training and guidance to IRB members may be developed to support them in ensuring that appropriate ethical issues for HOF studies are considered.

Validity of International Classification of Diseases codes in identifying illicit drug use target conditions using medical record data as a reference standard: A systematic review.

BACKGROUND: The twenty-first century opioid crisis has spurred interest in using International Classification of Diseases (ICD) code algorithms to identify patients using illicit drugs from administrative healthcare data. We conducted a systematic review of studies that validated ICD code algorithms for illicit drug use against a reference standard of medical record data. METHODS: Systematic searches of MEDLINE, EMBASE, PsycINFO, and Web of Science were conducted for studies published between 1980 and 2018 in English, French, Italian, or Spanish. We included validation studies of ICD-9 or ICD-10 code algorithms for an illicit drug use target condition (e.g., illicit drug use, abuse, or dependence (UAD), illicit drug use-related complications) given the sensitivity or specificity was reported or could be calculated. Bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies Version 2 (QUADAS-2) tool. RESULTS: Six of the 1210 articles identified met the inclusion criteria. For validation studies of broad UAD (n = 4), the specificity was nearly perfect, but the sensitivity ranged from 47% to 83%, with higher sensitivities tending to occur in higher prevalence populations. For validation studies of injection drug use (IDU)-associated infective endocarditis (n = 2), sensitivity and specificity were poor due to the lack of an ICD code for IDU. For all six studies, the risk of bias for the QUADAS-2 "reference standard" and "flow/timing domains" was scored as "unclear" due to insufficient reporting. CONCLUSIONS: Few studies have validated ICD code algorithms for illicit drug use target conditions, and available evidence is challenging to interpret due to inadequate reporting. PROSPERO Registration: CRD42019118401.

Variation and Change Over Time in PROMIS-29 Survey Results Among Primary Care Patients With Type 2 Diabetes.

PURPOSE: We sought to describe results of patient-reported outcome measures implemented among primary care patients with diabetes and explore factors associated with changes in scores over time. METHODS: Two organizations serving diverse patient populations collected the PROMIS-29 survey at baseline and 3-month follow-up for patients with type 2 diabetes. Bayesian regression analysis was used to examine the relationship between patient characteristics and changes in PROMIS-29 scores. Exploratory analyses assessed relationships between goal-setting and changes in scores. RESULTS: The study population reported substantially more problems with physical functioning (mean: 42.5 at Site 1 and 38.9 at Site 2) and pain interference (mean: 58.0 at Site 1 and 61.1 at Site 2) compared to the general population (mean: 50; standard deviation: 10). At least 33% of patients had a clinically meaningful change (ie, at least half the standard deviation, or 5 points) in each PROMIS domain. For pain interference, 55% had no change, 22% improved by 5 or more points, and 23% worsened by 5 or more points. Bayesian regression analyses suggest that chronic conditions, insurance status, and Hispanic ethnicity are likely associated with decreased functioning over time. Exploratory analyses found that setting a mental health goal did not appear to be associated with improvement for anxiety or depression. CONCLUSIONS: Use of patient-reported outcome measures in routine clinical care identified areas of functional limitations among people with diabetes. However, changes in participants' PROMIS-29 scores over time were minimal. Research is needed to understand patterns of change in global and domain-specific functioning, particularly among racial/ethnic minorities.

Disseminating, implementing, and evaluating patient-centered outcomes to improve cardiovascular care using a stepped-wedge design: healthy hearts for Oklahoma.

BACKGROUND: Cardiovascular disease (CVD) is the leading cause of death in the US and incurs high health care costs. While many initiatives promote the implementation of ABCS (aspirin therapy, blood pressure control, cholesterol management, and smoking cessation) measures, most primary care practices (PCPs) lack quality improvement (QI) support and resources to achieve meaningful targets. The Healthy Hearts for Oklahoma (H2O) Study proposes to build a QI infrastructure by (1) constructing a sustainable Oklahoma Primary Healthcare Improvement Collaborative (OPHIC) to support dissemination and implementation (D&I) of QI methods; (2) providing QI support in PCPs to better manage patients at risk for CVD events. Parallel to infrastructure building, H2O aims to conduct a comprehensive evaluation of the QI support D&I in primary care and assess the relationship between QI support uptake and changes in ABCS measures. METHODS: H2O has partnered with public health agencies and communities to build OPHIC and facilitate QI. H2O has 263 small primary care practices across Oklahoma that receive the bundled QI intervention to improve ABCS performance. A stepped-wedge designed is used to evaluate D&I of QI support. Changes in ABCS measures will be estimated as a function of various components of the QI support and capacity and readiness of PCPs to change. Notes from academic detailing and practice facilitation sessions will be analyzed to help interpret findings on ABCS performance. DISCUSSION: H2O program is designed to improve cardiovascular health and outcomes for more than 1.25 million Oklahomans. The infrastructure established as a result of this funding will help reach medically underserved Oklahomans, particularly among rural and tribal populations. Lessons learned from this project will guide future strategies for D&I of evidence-based practices in PCPs. Trained practice facilitators will continue to serve as critical resource to assists small, rural PCPs in adapting to the ever-changing health environment and continue to deliver quality care to their communities.

Implementation of the PROMIS-29 in Routine Care for People With Diabetes: Challenges and Opportunities.

Using patient-reported outcome measures (PROMs) in care planning has the potential to improve care, but information about routine implementation in settings serving disadvantaged groups is needed. Two primary care clinics serving populations predominantly eligible for Medicaid and diverse in race/ethnicity implemented the PROMIS-29 as part of clinical care planning. Of the target population with diabetes, 26% (n = 490) completed the PROMs; the proportion that set a goal based on the PROMs differed by site. This report describes factors influencing the PROMs process and the results of interviews with patients and members of the care team about PROMs' implementation and impact.

The Alarming Rate of Major Disruptive Events in Primary Care Practices in Oklahoma.

PURPOSE: In primary care practices, sustainability of performance improvements and ability to deliver continuity of care to patients can be adversely affected by major disruptive events, such as relocations and changes in ownership, clinicians, and key staff. This study documented the rates of major disruptive events in a cohort of primary care practices in Oklahoma. METHODS: Practices were included if they had existed for 1 year before enrollment and remained in the project for at least 1 year after enrollment. Practice characteristics for 208 practices and major disruptive events during the preenrollment year were collected by survey. Postenrollment major disruptive events were prospectively collected by practice facilitators. We compiled frequency statistics and conducted bivariate analyses for each data set. RESULTS: Of 208 eligible practices, 81 (39%) were clinician owned, and 51 (25%) were health system owned. One hundred nine practices (52%) were in nonmetropolitan counties. One hundred seventy-five major disruptive events occurred in 120 (58%) practices during the preenrollment year, with 42 practices having experienced multiple events. During the first year of the project, 89 major disruptive events occurred in 67 (32%) practices, with 20 practices experiencing multiple events. The major disruptive events reported most often during both periods were loss of personnel and implementation of electronic health records and billing systems. Practice size was associated with occurrence of these events. CONCLUSIONS: During a 2-year period, major disruptive events occurred at an alarming rate, adversely affecting quality improvement efforts. Most reported events involved losses of clinicians and staff. More research is needed to identify and address the root causes of these events.

Assessing guideline-concordant prescribing for community-acquired pneumonia.

Background Current reports of outpatient antimicrobial prescribing practices may overestimate guideline concordance since they address only drug selection. Appropriate stewardship should consider all prescribing criteria (i.e., dose, frequency, duration, and route of administration) to fully assess guideline concordance. Objective Using a community-acquired pneumonia (CAP) example, the aims of this pilot study were to estimate guideline concordance in adult patients 18 years or older when all prescribing criteria are considered, and provide recommendations to optimize treatment. Specific objectives were to determine which medications were most commonly prescribed for high-and low-risk patients, respectively, and determine if prescription parameters typically meet guideline recommendations. Methods This historical (retrospective) chart review at a large, non-emergent, outpatient academic practice included adult cases of CAP identified by ICD-9 codes, 481.x-486.x, 480.x and 487.x, diagnosed between July 1, 2014 and June 30, 2015. Patients were stratified into low- or high-risk categories based on presence of comorbidities and recent antibiotic use. Descriptive statistics were used to profile the sample and estimate aggregate guideline appropriateness, based on Infectious Disease Society of America/American Thoracic Society guidelines. Cases that were not prescribed an antibiotic at the index visit were excluded from assessment of concordance. Results Of the 101 total episodes identified, 49% were treated with an antibiotic. Of the 45 cases that met low-risk criteria, seven of the 24 treated cases (29%) received an appropriate antibiotic. When considering all prescription elements, all seven cases were congruent, for a composite concordance rate of 29%. Of the 56 cases that met high-risk criteria, 13 of the 25 treated cases (52%) received an appropriate antibiotic, although two cases were prescribed a suboptimal dose, and one case was prescribed a suboptimal duration, dropping composite concordance to 40%. Overall, prescribing was concordant in 17 of the 49 treated cases (35%). Conclusion Concordance with current guidelines in this local sample is suboptimal. In the low-risk group, when the correct medication was chosen, dose, duration, and frequency were appropriate. Consideration of dose and duration of treatment decreased the rate of concordant prescribing in the high-risk group.

Understanding prescription adherence: pharmacy claims data from the Contraceptive CHOICE Project.

BACKGROUND: We examined prescription adherence rates by contraceptive method among women who used oral contraceptive pills (OCP), transdermal patch or vaginal ring. STUDY DESIGN: Women in the St. Louis area were provided their choice of OCP, patch or ring at no cost and followed for 18 months. Time between monthly refills was obtained from pharmacy data and analyzed as a marker of adherence. Risk factors for initial nonadherence were estimated using Cox proportional hazards; predictors for repeated nonadherence were analyzed using Poisson regression with robust error variance. RESULTS: Overall, 619 participants filled 6435 contraceptive prescriptions with a median of 10 refills per participant. Only 30% of women (n = 187) obtained all refills on time. In the time-to-failure analysis, use of vaginal ring and increased parity were predictors of early nonadherence (p < .05). In the multivariable analysis, use of the vaginal ring and history of abortion were risk factors for repeated nonadherence (p < .01). CONCLUSIONS: Even with financial barriers removed, pharmacy data show that many women inconsistently refill their contraception and may be at risk for unintended pregnancy.