Assessing readiness to use electronic health record data for outcome ascertainment in clinical trials - A case study.

BACKGROUND: Variable data quality poses a challenge to using electronic health record (EHR) data to ascertain acute clinical outcomes in multi-site clinical trials. Differing EHR platforms and data comprehensiveness across clinical trial sites, especially if patients received care outside of the clinical site's network, can also affect validity of results. Overcoming these challenges requires a structured approach. METHODS: We propose a framework and create a checklist to assess the readiness of clinical sites to contribute EHR data to a clinical trial for the purpose of outcome ascertainment, based on our experience with the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) study, which enrolled 5451 participants in 86 primary care practices across 10 healthcare systems (sites). RESULTS: The site readiness checklist includes assessment of the infrastructure (i.e., size and structure of the site's healthcare system or clinical network), data procurement (i.e., quality of the data), and cost of obtaining study data. The checklist emphasizes the importance of understanding how data are captured and integrated across a site's catchment area and having a protocol in place for data procurement to ensure consistent and uniform extraction across each site. CONCLUSIONS: We suggest rigorous, prospective vetting of the data quality and infrastructure of each clinical site before launching a multi-site trial dependent on EHR data. The proposed checklist serves as a guiding tool to help investigators ensure robust and unbiased data capture for their clinical trials. ORIGINAL TRIAL REGISTRATION NUMBER: NCT02475850.

Validation of a Rule-Based ICD-10-CM Algorithm to Detect Fall Injuries in Medicare Data.

BACKGROUND: Diagnosis-code-based algorithms to identify fall injuries in Medicare data are useful for ascertaining outcomes in interventional and observational studies. However, these algorithms have not been validated against a fully external reference standard, in ICD-10-CM, or in Medicare Advantage (MA) data. METHODS: We linked self-reported fall injuries leading to medical attention (FIMA) from the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) trial (reference standard) to Medicare fee-for-service (FFS) and MA data from 2015-2019. We measured the area under the receiver operating characteristic curve (AUC) based on sensitivity and specificity of a diagnosis-code-based algorithm against the reference standard for presence or absence of ≥1 FIMA within a specified window of dates, varying the window size to obtain points on the curve. We stratified results by source (FFS versus MA), trial arm (intervention versus control), and STRIDE's ten participating healthcare systems. RESULTS: Both reference standard data and Medicare data were available for 4941 (of 5451) participants. The reference standard and algorithm identified 2054 and 2067 FIMA, respectively. The algorithm had 45% sensitivity (95% confidence interval [CI], 43%-47%) and 99% specificity (95% CI, 99%-99%) to identify reference standard FIMA within the same calendar month. The AUC was 0.79 (95% CI, 0.78-0.81) and was similar by FFS or MA data source or trial arm, but showed variation among STRIDE healthcare systems (AUC range by healthcare system, 0.71 to 0.84). CONCLUSIONS: An ICD-10-CM algorithm to identify fall injuries demonstrated acceptable performance against an external reference standard, in both MA and FFS data.

The dementia care study (D-CARE): Recruitment strategies and demographic characteristics of participants in a pragmatic randomized trial of dementia care.

INTRODUCTION: Pragmatic research studies that include diverse dyads of persons living with dementia (PLWD) and their family caregivers are rare. METHODS: Community-dwelling dyads were recruited for a pragmatic clinical trial evaluating three approaches to dementia care. Four clinical trial sites used shared and site-specific recruitment strategies to enroll health system patients. RESULTS: Electronic health record (EHR) queries of patients with a diagnosis of dementia and engagement of their clinicians were the main recruitment strategies. A total of 2176 dyads were enrolled, with 80% recruited after the onset of the pandemic. PLWD had a mean age of 80.6 years (SD 8.5), 58.4% were women, and 8.8% were Hispanic/Latino, and 11.9% were Black/African American. Caregivers were mostly children of the PLWD (46.5%) or spouses/partners (45.2%), 75.8% were women, 9.4% were Hispanic/Latino, and 11.6% were Black/African American. DISCUSSION: Health systems can successfully enroll diverse dyads in a pragmatic clinical trial.

A compressed large language model embedding dataset of ICD 10 CM descriptions.

This paper presents novel datasets providing numerical representations of ICD-10-CM codes by generating description embeddings using a large language model followed by a dimension reduction via autoencoder. The embeddings serve as informative input features for machine learning models by capturing relationships among categories and preserving inherent context information. The model generating the data was validated in two ways. First, the dimension reduction was validated using an autoencoder, and secondly, a supervised model was created to estimate the ICD-10-CM hierarchical categories. Results show that the dimension of the data can be reduced to as few as 10 dimensions while maintaining the ability to reproduce the original embeddings, with the fidelity decreasing as the reduced-dimension representation decreases. Multiple compression levels are provided, allowing users to choose as per their requirements, download and use without any other setup. The readily available datasets of ICD-10-CM codes are anticipated to be highly valuable for researchers in biomedical informatics, enabling more advanced analyses in the field. This approach has the potential to significantly improve the utility of ICD-10-CM codes in the biomedical domain.

Costs of fall injuries in the STRIDE study: an economic evaluation of healthcare system heterogeneity and heterogeneity of treatment effect.

OBJECTIVES: The Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) Study cluster-randomized 86 primary care practices in 10 healthcare systems to a patient-centered multifactorial fall injury prevention intervention or enhanced usual care, enrolling 5451 participants. We estimated total healthcare costs from participant-reported fall injuries receiving medical attention (FIMA) that were averted by the STRIDE intervention and tested for healthcare-system-level heterogeneity and heterogeneity of treatment effect (HTE). METHODS: Participants were community-dwelling adults age ≥ 70 at increased fall injury risk. We estimated practice-level total costs per person-year of follow-up (PYF), assigning unit costs to FIMA with and without an overnight hospital stay. Using independent variables for treatment arm, healthcare system, and their interaction, we fit a generalized linear model with log link, log follow-up time offset, and Tweedie error distribution. RESULTS: Unadjusted total costs per PYF were $2,034 (intervention) and $2,289 (control). The adjusted (intervention minus control) cost difference per PYF was -$167 (95% confidence interval (CI), -$491, $216). Cost heterogeneity by healthcare system was present (p = 0.035), as well as HTE (p = 0.090). Adjusted total costs per PYF in control practices varied from $1,529 to $3,684 for individual healthcare systems; one system with mean intervention minus control costs of -$2092 (95% CI, -$3,686 to -$944) per PYF accounted for HTE, but not healthcare system cost heterogeneity. CONCLUSIONS: We observed substantial heterogeneity of healthcare system costs in the STRIDE study, with small reductions in healthcare costs for FIMA in the STRIDE intervention accounted for by a single healthcare system. TRIAL REGISTRATION: Clinicaltrials.gov (NCT02475850).

A Compressed Language Model Embedding Dataset of ICD 10 CM Descriptions.

This paper presents novel datasets providing numerical representations of ICD-10-CM codes by generating description embeddings using a large language model followed by a dimension reduction via autoencoder. The embeddings serve as informative input features for machine learning models by capturing relationships among categories and preserving inherent context information. The model generating the data was validated in two ways. First, the dimension reduction was validated using an autoencoder, and secondly, a supervised model was created to estimate the ICD-10-CM hierarchical categories. Results show that the dimension of the data can be reduced to as few as 10 dimensions while maintaining the ability to reproduce the original embeddings, with the fidelity decreasing as the reduced-dimension representation decreases. Multiple compression levels are provided, allowing users to choose as per their requirements. The readily available datasets of ICD-10-CM codes are anticipated to be highly valuable for researchers in biomedical informatics, enabling more advanced analyses in the field. This approach has the potential to significantly improve the utility of ICD-10-CM codes in the biomedical domain.

Sex Differences in Symptom Complexity and Door-to-Balloon Time in Patients With ST-Elevation Myocardial Infarction.

Greater symptom complexity in women than in men could slow acute ST-elevation myocardial infarction (STEMI) recognition and delay door-to-balloon (D2B) times. We sought to determine the sex differences in symptom complexity and their relation to D2B times in 1,677 young and older patients with STEMI using data from the VIRGO and SILVER-AMI studies. Symptom complexity was defined by the number of symptom patterns or phenotypes and average number of symptoms. The numbers of symptom phenotypes were compared in women and men using the Monte Carlo permutation testing. Groups were also compared using the generalized linear regression and logistic regression. The number of symptom phenotypes (244 vs 171, p = 0.02), mean number of symptoms (4.7 vs 4.2, p <0.001), and mean D2B time (114.6 vs 97.8 minutes, p = 0.004) were greater in young women than in young men but were not significantly different in older women compared with older men. The regression analysis did not show a relation between symptom complexity and D2B time overall; although, chest pain was a significant predictor of D2B times, and young women were more likely to report symptoms other than chest pain. Among patients with STEMI, 36% did not receive percutaneous coronary intervention (PCI), which was associated with presentation delay >6 hours. In patients with STEMI with either D2B time ≥90 minutes or no PCI, women had significantly more symptom phenotypes overall and in VIRGO but not in SILVER-AMI. In conclusion, the markers of symptom complexity were not associated with D2B time overall, but more symptom phenotypes in young women were associated with prolonged D2B time or no PCI. In addition, greater frequency of nonchest pain symptoms in young women may have also slowed the recognition of STEMI and D2B times in young women. Further research on symptoms clusters is needed to improve the recognition of STEMIs to improve the D2B times in young women.

Simulating time-to-event data subject to competing risks and clustering: A review and synthesis.

Simulation studies play an important role in evaluating the performance of statistical models developed for analyzing complex survival data such as those with competing risks and clustering. This article aims to provide researchers with a basic understanding of competing risks data generation, techniques for inducing cluster-level correlation, and ways to combine them together in simulation studies, in the context of randomized clinical trials with a binary exposure or treatment. We review data generation with competing and semi-competing risks and three approaches of inducing cluster-level correlation for time-to-event data: the frailty model framework, the probability transform, and Moran's algorithm. Using exponentially distributed event times as an example, we discuss how to introduce cluster-level correlation into generating complex survival outcomes, and illustrate multiple ways of combining these methods to simulate clustered, competing and semi-competing risks data with pre-specified correlation values or degree of clustering.

Engagement of older adults in STRIDE's multifactorial fall injury prevention intervention.

BACKGROUND: Evidence-based multifactorial fall prevention interventions in clinical practice have been less effective than expected. One plausible reason is that older adults' engagement in fall prevention care is suboptimal. METHODS: This was a post-hoc analysis of 2403 older adults' engagement in a multifactorial fall prevention intervention in the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) pragmatic trial. Based on the direct clinical care level of the Patient and Family Continuum of Engagement (CE) framework, three indicators of progressively interactive engagement were assessed: (1) Consultation (receiving information), (2) Involvement (prioritizing risks), and (3) Partnership (identifying prevention actions). Drop off at each step was determined as well as predictors of engagement. RESULTS: The participants' engagement waned with increasingly interactive CE domains. Although all participants received information about their positive fall risk factors (consultation) and most (51%-96%) prioritized them (involvement), fewer participants (33%-55%) identified fall prevention actions (partnership) for most of their risk factors, except for strength gait or balance problems (95%). More participants (70%) identified home exercises than other actions. Finally, fall prevention actions were identified more commonly among participants who received two visits compared to one (OR = 2.33 [95% CI, 2.06-2.64]), were ≥80 years old (OR = 1.83 [95% CI, 1.51-2.23]), and had fewer fall risk factors (OR = 0.90 [95% CI, 0.83-0.99]). CONCLUSIONS: The drop-off in participants' engagement based on the level of their interaction with clinicians suggests that future multifactorial fall prevention interventions need to be more focused on interactive patient-clinician partnerships that help older adults increase and maintain fall prevention actions. Our analyses suggest that more frequent contact with clinicians and more monitoring of the implementation and outcomes of Fall Prevention Care Plans could potentially improve engagement and help older adults maintain fall prevention actions.

Effect of the STRIDE fall injury prevention intervention on falls, fall injuries, and health-related quality of life.

BACKGROUND: Falls are common in older adults and can lead to severe injuries. The Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) trial cluster-randomized 86 primary care practices across 10 health systems to a multifactorial intervention to prevent fall injuries, delivered by registered nurses trained as falls care managers, or enhanced usual care. STRIDE enrolled 5451 community-dwelling older adults age ≥70 at increased fall injury risk. METHODS: We assessed fall-related outcomes via telephone interviews of participants (or proxies) every 4 months. At baseline, 12 and 24 months, we assessed health-related quality of life (HRQOL) using the EQ-5D-5L and EQ-VAS. We used Poisson models to assess intervention effects on falls, fall-related fractures, fall injuries leading to hospital admission, and fall injuries leading to medical attention. We used hierarchical longitudinal linear models to assess HRQOL. RESULTS: For recurrent event models, intervention versus control incidence rate ratios were 0.97 (95% confidence interval [CI], 0.93-1.00; p = 0.048) for falls, 0.93 (95% CI, 0.80-1.08; p = 0.337) for self-reported fractures, 0.89 (95% CI, 0.73-1.07; p = 0.205) for adjudicated fractures, 0.91 (95% CI, 0.77-1.07; p = 0.263) for falls leading to hospital admission, and 0.97 (95% CI, 0.89-1.06; p = 0.477) for falls leading to medical attention. Similar effect sizes (non-significant) were obtained for dichotomous outcomes (e.g., participants with ≥1 events). The difference in least square mean change over time in EQ-5D-5L (intervention minus control) was 0.009 (95% CI, -0.002 to 0.019; p = 0.106) at 12 months and 0.005 (95% CI, -0.006 to 0.015; p = 0.384) at 24 months. CONCLUSIONS: Across a standard set of outcomes typically reported in fall prevention studies, we observed modest improvements, one of which was statistically significant. Future work should focus on patient-, practice-, and organization-level operational strategies to increase the real-world effectiveness of interventions, and improving the ability to detect small but potentially meaningful clinical effects. CLINICALTRIALS: gov identifier: NCT02475850.

A comparison of analytical strategies for cluster randomized trials with survival outcomes in the presence of competing risks.

While statistical methods for analyzing cluster randomized trials with continuous and binary outcomes have been extensively studied and compared, little comparative evidence has been provided for analyzing cluster randomized trials with survival outcomes in the presence of competing risks. Motivated by the Strategies to Reduce Injuries and Develop Confidence in Elders trial, we carried out a simulation study to compare the operating characteristics of several existing population-averaged survival models, including the marginal Cox, marginal Fine and Gray, and marginal multi-state models. For each model, we found that adjusting for the intraclass correlations through the sandwich variance estimator effectively maintained the type I error rate when the number of clusters is large. With no more than 30 clusters, however, the sandwich variance estimator can exhibit notable negative bias, and a permutation test provides better control of type I error inflation. Under the alternative, the power for each model is differentially affected by two types of intraclass correlations-the within-individual and between-individual correlations. Furthermore, the marginal Fine and Gray model occasionally leads to higher power than the marginal Cox model or the marginal multi-state model, especially when the competing event rate is high. Finally, we provide an illustrative analysis of Strategies to Reduce Injuries and Develop Confidence in Elders trial using each analytical strategy considered.

Sex Differences in Symptom Phenotypes Among Older Patients with Acute Myocardial Infarction.

BACKGROUND: Clinicians make a medical diagnosis by recognizing diagnostic possibilities, often using memories of prior examples. These memories, called "exemplars," reflect specific symptom combinations in individual patients, yet most clinical studies report how symptoms aggregate in populations. We studied how symptoms of acute myocardial infarction combine in individuals as symptom phenotypes and how symptom phenotypes are distributed in women and men. METHODS: In this analysis of the SILVER-AMI Study, we studied 3041 patients (1346 women and 1645 men) 75 years of age or older with acute myocardial infarction. Each patient had a standardized in-person interview during the acute myocardial infarction admission to document the presenting symptoms, which enabled a thorough examination of symptom combinations in individuals. Specific symptom combinations defined symptom phenotypes and distributions of symptom phenotypes were compared in women and men using Monte Carlo permutation testing and repeated subsampling. RESULTS: There were 1469 unique symptom phenotypes in the entire SILVER-AMI cohort of patients with acute myocardial infarction. There were 831 unique symptom phenotypes in women, as compared with 819 in men, which was highly significant, given the larger number of men than women in the study (P < .0001). Women had significantly more symptom phenotypes than men in almost all acute myocardial infarction subgroups. CONCLUSIONS: Older patients with acute myocardial infarction have enormous variation in symptom phenotypes. Women reported more symptoms and had significantly more symptom phenotypes than men. Appreciation of the diversity of symptom phenotypes may help clinicians recognize the less common phenotypes that occur more often in women.

A case study of ascertainment bias for the primary outcome in the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) trial.

BACKGROUND/AIM: In clinical trials, there is potential for bias from unblinded observers that may influence ascertainment of outcomes. This issue arose in the Strategies to Reduce Injuries and Develop Confidence in Elders trial, a cluster randomized trial to test a multicomponent intervention versus enhanced usual care (control) to prevent serious fall injuries, originally defined as a fall injury leading to medical attention. An unblinded nurse falls care manager administered the intervention, while the usual care arm did not involve contact with a falls care manager. Thus, there was an opportunity for falls care managers to refer participants reporting falls to seek medical attention. Since this type of observer bias could not occur in the usual care arm, there was potential for additional falls to be reported in the intervention arm, leading to dilution of the intervention effect and a reduction in study power. We describe the clinical basis for ascertainment bias, the statistical approach used to assess it, and its effect on study power. METHODS: The prespecified interim monitoring plan included a decision algorithm for assessing ascertainment bias and adapting (revising) the primary outcome definition, if necessary. The original definition categorized serious fall injuries requiring medical attention into Type 1 (fracture other than thoracic/lumbar vertebral, joint dislocation, cut requiring closure) and Type 2 (head injury, sprain or strain, bruising or swelling, other). The revised definition, proposed by the monitoring plan, excluded Type 2 injuries that did not necessarily require an overnight hospitalization since these would be most subject to bias. These injuries were categorized into those with (Type 2b) and without (Type 2c) medical attention. The remaining Type 2a injuries required medical attention and an overnight hospitalization. We used the ratio of 2b/(2b + 2c) in intervention versus control as a measure of ascertainment bias; ratios > 1 indicated the likelihood of falls care manager bias. We determined the effect of ascertainment bias on study power for the revised (Types 1 and 2a) versus original definition (Types 1, 2a, and 2b). RESULTS: The estimate of ascertainment bias was 1.14 (95% confidence interval: 0.98, 1.30), providing evidence of the likelihood of falls care manager bias. We estimated that this bias diluted the hazard ratio from the hypothesized 0.80 to 0.86 and reduced power to under 80% for the original primary outcome definition. In contrast, adapting the revised definition maintained study power at nearly 90%. CONCLUSION: There was evidence of ascertainment bias in the Strategies to Reduce Injuries and Develop Confidence in Elders trial. The decision to adapt the primary outcome definition reduced the likelihood of this bias while preserving the intervention effect and study power.

Effect of a Multifactorial Fall Injury Prevention Intervention on Patient Well-Being: The STRIDE Study.

BACKGROUND/OBJECTIVES: In the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) study, a multifactorial intervention was associated with a nonsignificant 8% reduction in time to first serious fall injury but a significant 10% reduction in time to first self-reported fall injury relative to enhanced usual care. The effect of the intervention on other outcomes important to patients has not yet been reported. We aimed to evaluate the effect of the intervention on patient well-being including concern about falling, anxiety, depression, physical function, and disability. DESIGN: Pragmatic cluster-randomized trial of 5,451 community-living persons at high risk for serious fall injuries. SETTING: A total of 86 primary care practices within 10 U.S. healthcare systems. PARTICIPANTS: A random subsample of 743 persons aged 75 and older. MEASUREMENTS: The well-being measures, assessed at baseline, 12 months, and 24 months, included a modified version of the Fall Efficacy Scale, Patient-Reported Outcomes Measurement Information System (PROMIS) anxiety and depression scales, and Late-Life Function and Disability Instrument. RESULTS: Participants in the intervention (n = 384) and control groups (n = 359) were comparable in age: mean (standard deviation) of 81.9 (4.7) versus 81.8 (5.0) years. Mean scores were similar between groups at 12 and 24 months for concern about falling, physical function, and disability, whereas the intervention group's mean scores on anxiety and depression were .7 points lower (i.e., better) at 12 months and .6 to .8 points lower at 24 months. For each of these outcomes, differences between the groups' adjusted least square mean changes from baseline to 12 and 24 months, respectively, were quantitatively small. The overall difference in means between groups over 2 years was statistically significant only for depression, favoring the intervention: -1.19 (99% confidence interval, -2.36 to -.02), with 3.5 points representing a minimally important difference. CONCLUSIONS: STRIDE's multifactorial intervention to reduce fall injuries was not associated with clinically meaningful improvements in patient well-being.

Estimation of ascertainment bias and its effect on power in clinical trials with time-to-event outcomes.

While the gold standard for clinical trials is to blind all parties-participants, researchers, and evaluators-to treatment assignment, this is not always a possibility. When some or all of the above individuals know the treatment assignment, this leaves the study open to the introduction of postrandomization biases. In the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) trial, we were presented with the potential for the unblinded clinicians administering the treatment, as well as the individuals enrolled in the study, to introduce ascertainment bias into some but not all events comprising the primary outcome. In this article, we present ways to estimate the ascertainment bias for a time-to-event outcome, and discuss its impact on the overall power of a trial vs changing of the outcome definition to a more stringent unbiased definition that restricts attention to measurements less subject to potentially differential assessment. We found that for the majority of situations, it is better to revise the definition to a more stringent definition, as was done in STRIDE, even though fewer events may be observed.

D-CARE: The Dementia Care Study: Design of a Pragmatic Trial of the Effectiveness and Cost Effectiveness of Health System-Based Versus Community-Based Dementia Care Versus Usual Dementia Care.

BACKGROUND/OBJECTIVES: Although several approaches have been developed to provide comprehensive care for persons living with dementia (PWD) and their family or friend caregivers, the relative effectiveness and cost effectiveness of community-based dementia care (CBDC) versus health system-based dementia care (CBDC) and the effectiveness of both approaches compared with usual care (UC) are unknown. DESIGN: Pragmatic randomized three-arm superiority trial. The unit of randomization is the PWD/caregiver dyad. SETTING: Four clinical trial sites (CTSs) based in academic and clinical health systems. PARTICIPANTS: A total of 2,150 English- or Spanish-speaking PWD who are not receiving hospice or residing in a nursing home and their caregivers. INTERVENTIONS: Eighteen months of (1) HSDC provided by a nurse practitioner or physician's assistant dementia care specialist who works within the health system, or (2) CBDC provided by a social worker or nurse care consultant who works at a community-based organization, or (3) UC with as needed referral to the Alzheimer's Association Helpline. MEASUREMENTS: Primary outcomes: PWD behavioral symptoms and caregiver distress as measured by the Neuropsychiatric Inventory Questionnaire (NPI-Q) Severity and Modified Caregiver Strain Index scales. SECONDARY OUTCOMES: NPI-Q Distress, caregiver unmet needs and confidence, and caregiver depressive symptoms. Tertiary outcomes: PWD long-term nursing home placement rates, caregiver-reported PWD functional status, cognition, goal attainment, "time spent at home," Dementia Burden Scale-Caregiver, a composite measure of clinical benefit, Quality of Life of persons with dementia, Positive Aspects of Caregiving, and cost effectiveness using intervention costs and Medicare claims. RESULTS: The results will be reported in the spring of 2024. CONCLUSION: D-CARE will address whether emphasis on clinical support and tighter integration with other medical services has greater benefit than emphasis on social support that is tied more closely to community resources. It will also assess the effectiveness of both interventions compared with UC and will evaluate the cost effectiveness of each intervention.

A Randomized Trial of a Multifactorial Strategy to Prevent Serious Fall Injuries.

BACKGROUND: Injuries from falls are major contributors to complications and death in older adults. Despite evidence from efficacy trials that many falls can be prevented, rates of falls resulting in injury have not declined. METHODS: We conducted a pragmatic, cluster-randomized trial to evaluate the effectiveness of a multifactorial intervention that included risk assessment and individualized plans, administered by specially trained nurses, to prevent fall injuries. A total of 86 primary care practices across 10 health care systems were randomly assigned to the intervention or to enhanced usual care (the control) (43 practices each). The participants were community-dwelling adults, 70 years of age or older, who were at increased risk for fall injuries. The primary outcome, assessed in a time-to-event analysis, was the first serious fall injury, adjudicated with the use of participant report, electronic health records, and claims data. We hypothesized that the event rate would be lower by 20% in the intervention group than in the control group. RESULTS: The demographic and baseline characteristics of the participants were similar in the intervention group (2802 participants) and the control group (2649 participants); the mean age was 80 years, and 62.0% of the participants were women. The rate of a first adjudicated serious fall injury did not differ significantly between the groups, as assessed in a time-to-first-event analysis (events per 100 person-years of follow-up, 4.9 in the intervention group and 5.3 in the control group; hazard ratio, 0.92; 95% confidence interval [CI], 0.80 to 1.06; P = 0.25). The rate of a first participant-reported fall injury was 25.6 events per 100 person-years of follow-up in the intervention group and 28.6 events per 100 person-years of follow-up in the control group (hazard ratio, 0.90; 95% CI, 0.83 to 0.99; P = 0.004). The rates of hospitalization or death were similar in the two groups. CONCLUSIONS: A multifactorial intervention, administered by nurses, did not result in a significantly lower rate of a first adjudicated serious fall injury than enhanced usual care. (Funded by the Patient-Centered Outcomes Research Institute and others; STRIDE ClinicalTrials.gov number, NCT02475850.).

Optimizing Retention in a Pragmatic Trial of Community-Living Older Persons: The STRIDE Study.

OBJECTIVES: The Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) study is testing the effectiveness of a multifactorial intervention to prevent serious fall injuries. Our aim was to describe procedures that were implemented to optimize participant retention; report retention yields by age, sex, clinical site, and follow-up time; provide reasons for study withdrawals; and highlight the successes and lessons learned from the STRIDE retention efforts. DESIGN: Pragmatic cluster randomized trial. SETTING: A total of 86 primary care practices within 10 US healthcare systems. PARTICIPANTS: A total of 5451 community-living persons, 70 years of age or older, at high risk for serious fall injuries. MEASUREMENTS: Study outcomes were collected every 4 months by a central call center. Reconsent was required to extend follow-up beyond the originally planned 36 months. RESULTS: Over a median follow-up of 3.2 years (interquartile range = 2.8-3.7 y), 439 (8.1%) participants died and 600 (11.0%) withdrew their consent or did not reconsent to extend follow-up beyond 36 months, yielding rates (per 100 person-years) of deaths and withdrawals of 2.6 and 3.6, respectively. The withdrawal rate increased with advancing age, was comparable for men and women, and did not differ much by clinical site. The most common reasons for withdrawal were illness and unable to contact for reconsent at 36 months. Completion of the follow-up interviews was greater than 93% at each time point. Most participants completed all (71.8%) or all but one (9.2%) of the follow-up interviews. The most common reason for not completing a follow-up interview was unable to contact, with rates ranging from 2.8% at 40 months to 4.6% at 20 months. CONCLUSION: Completion of the thrice-yearly follow-up interviews in STRIDE was high, and retention of participants over 44 months exceeded the original projections. The procedures used in STRIDE, together with lessons learned, should assist other investigators who are planning or conducting large pragmatic trials of vulnerable older persons. J Am Geriatr Soc 68:1242-1249, 2020.

Sex Differences in Symptom Phenotypes Among Patients With Acute Myocardial Infarction.

BACKGROUND: The diagnosis of acute myocardial infarction (AMI) is missed more frequently in young women than men, which may be related to the cognitive psychology of the diagnostic process. Physicians start the diagnostic process by intuitively recognizing familiar symptom phenotypes, but little is known about how symptoms combine in individuals as unique symptom phenotypes. We examined how symptoms of AMI combine as unique symptom phenotypes in individual patients to compare the distribution of symptom phenotypes in women versus men. METHODS AND RESULTS: The VIRGO study (Variation in Recovery: Role of Gender on Outcomes of Young AMI Patients) was a multicenter, observational cohort study of 3501 young adults hospitalized with AMI. Data were collected on presenting symptoms with standardized interviews and from medical record abstraction. The number and distribution of unique symptom phenotypes were compared between women and men. Because of the 2:1 female-to-male enrollment ratio, women and men were compared with permutation testing and repeated subsampling. There were 426 interview-symptom phenotypes in women and 280 in men. The observed difference between women and men of 146 phenotypes was significant, even allowing for the greater enrollment of women (permutation P=0.004, median difference 110 under the null hypothesis of no association between sex and phenotype). The repeated subsample analysis also showed significantly more interview-symptom phenotypes in women than men (206.8±7.3 versus 188.6±6.0, P<0.001). Women were more broadly distributed among symptom phenotype subgroups than men (P<0.001). Similar findings were observed in the analysis of symptoms abstracted from the medical record. CONCLUSIONS: Women exhibited substantially more variation in unique symptom phenotypes than men, regardless of whether the symptoms were derived from structured interviews or abstracted from the medical record. These findings may provide an explanation for the higher missed diagnosis rate in young women with AMI and may have important implications for teaching and improving clinicians' ability to recognize the diagnosis of AMI in women.

Protocol for serious fall injury adjudication in the Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE) study.

BACKGROUND: This paper describes a protocol for determining the incidence of serious fall injuries for Strategies to Reduce Injuries and Develop Confidence in Elders (STRIDE), a large, multicenter pragmatic clinical trial with limited resources for event adjudication. We describe how administrative data (from participating health systems and Medicare claims) can be used to confirm participant-reported events, with more time- and resource-intensive full-text medical record data used only on an "as-needed" basis. METHODS: STRIDE is a pragmatic cluster-randomized controlled trial involving 5451 participants age ≥ 70 and at increased risk for falls, served by 86 primary care practices in 10 US health systems. The STRIDE intervention involves a nurse falls care manager who assesses a participant's underlying risks for falls, suggests interventions using motivational interviewing, and then creates, implements and longitudinally follows up on an individualized care plan with the participant (and caregiver when appropriate), in partnership with the participant's primary care provider. STRIDE's primary outcome is serious fall injuries, defined as a fall resulting in: (1) medical attention billable according to Medicare guidelines with a) fracture (excluding isolated thoracic vertebral and/or lumbar vertebral fracture), b) joint dislocation, or c) cut requiring closure; OR (2) overnight hospitalization with a) head injury, b) sprain or strain, c) bruising or swelling, or d) other injury determined to be "serious" (i.e., burn, rhabdomyolysis, or internal injury). Two sources of data are required to confirm a serious fall injury. The primary data source is the participant's self-report of a fall leading to medical attention, identified during telephone interview every 4 months, with the confirmatory source being (1) administrative data capturing encounters at the participating health systems or Medicare claims and/or (2) the full text of medical records requested only as needed. DISCUSSION: Adjudication is ongoing, with over 1000 potentially qualifying events adjudicated to date. Administrative data can be successfully used for adjudication, as part of a hybrid approach that retrieves full-text medical records only when needed. With the continued refinement and availability of administrative data sources, future studies may be able to use administrative data completely in lieu of medical record review to maximize the quality of adjudication with finite resources. TRIAL REGISTRATION: ClinicalTrials.gov (NCT02475850).