Prospective evaluation of social risks, physical function, and cognitive function in prediction of non-elective rehospitalization and post-discharge mortality.

BACKGROUND: Increasing evidence suggests that social factors and problems with physical and cognitive function may contribute to patients' rehospitalization risk. Understanding a patient's readmission risk may help healthcare providers develop tailored treatment and post-discharge care plans to reduce readmission and mortality. This study aimed to evaluate whether including patient-reported data on social factors; cognitive status; and physical function improves on a predictive model based on electronic health record (EHR) data alone. METHODS: We conducted a prospective study of 1,547 hospitalized adult patients in 3 Kaiser Permanente Northern California hospitals. The main outcomes were non-elective rehospitalization or death within 30 days post-discharge. Exposures included patient-reported social factors and cognitive and physical function (obtained in a pre-discharge interview) and EHR-derived data for comorbidity burden, acute physiology, care directives, prior utilization, and hospital length of stay. We performed bivariate comparisons using Chi-square, t-tests, and Wilcoxon rank-sum tests and assessed correlations between continuous variables using Spearman's rho statistic. For all models, the results reported were obtained after fivefold cross validation. RESULTS: The 1,547 adult patients interviewed were younger (age, p = 0.03) and sicker (COPS2, p < 0.0001) than the rest of the hospitalized population. Of the 6 patient-reported social factors measured, 3 (not living with a spouse/partner, transportation difficulties, health or disability-related limitations in daily activities) were significantly associated (p < 0.05) with the main outcomes, while 3 (living situation concerns, problems with food availability, financial problems) were not. Patient-reported cognitive (p = 0.027) and physical function (p = 0.01) were significantly lower in patients with the main outcomes. None of the patient-reported variables, singly or in combination, improved predictive performance of a model that included acute physiology and longitudinal comorbidity burden (area under the receiver operator characteristic curve was 0.716 for both the EHR model and maximal performance of a random forest model including all predictors). CONCLUSIONS: In this insured population, incorporating patient-reported social factors and measures of cognitive and physical function did not improve performance of an EHR-based model predicting 30-day non-elective rehospitalization or mortality. While incorporating patient-reported social and functional status data did not improve ability to predict these outcomes, such data may still be important for improving patient outcomes.

Training in the Conduct of Population-Based Multi-Site and Multi-Disciplinary Studies: the Cancer Research Network's Scholars Program.

Expanding research capacity of large research networks within health care delivery systems requires strategically training both embedded and external investigators in necessary skills for this purpose. Researchers new to these settings frequently lack the skills and specialized knowledge conducive to multi-site and multi-disciplinary research set in delivery systems. This report describes the goals and components of the Cancer Research Network (CRN) Scholars Program, a 26-month training program developed to increase the capacity for cancer research conducted within the network's participating sites, its progression from training embedded investigators to a mix of internal and external investigators, and the content evolution of the training program. The CRN Scholars program was launched in 2007 to assist junior investigators from member sites develop independent and sustainable research programs within the CRN. Resulting from CRN's increased emphasis on promoting external collaborations, the 2013 Scholars program began recruiting junior investigators from external institutions committed to conducting delivery system science. Based on involvement of this broader population and feedback from prior Scholar cohorts, the program has honed its focus on specific opportunities and issues encountered in conducting cancer research within health care delivery systems. Efficiency and effectiveness of working within networks is accelerated by strategic and mentored navigation of these networks. Investing in training programs specific to these settings provides the opportunity to improve multi-disciplinary and multi-institutional collaboration, particularly for early-stage investigators. Aspects of the CRN Scholars Program may help inform others considering developing similar programs to expand delivery system research or within large, multi-disciplinary research networks.

The Cancer Research Network: a platform for epidemiologic and health services research on cancer prevention, care, and outcomes in large, stable populations.

PURPOSE: The ability to collect data on patients for long periods prior to, during, and after a cancer diagnosis is critical for studies of cancer etiology, prevention, treatment, outcomes, and costs. We describe such data capacities within the Cancer Research Network (CRN), a cooperative agreement between the National Cancer Institute (NCI) and organized health care systems across the United States. METHODS: Data were extracted from each CRN site's virtual data warehouse using a centrally written and locally executed program. We computed the percent of patients continuously enrolled ≥1, ≥5, and ≥10 years before cancer diagnosis in 2012-2015 (year varied by CRN site). To describe retention after diagnosis, we computed the cumulative percentages enrolled, deceased, and disenrolled each year after the diagnosis for patients diagnosed in 2000. RESULTS: Approximately 8 million people were enrolled in ten CRN health plans on December 31, 2014 or 2015 (year varied by CRN site). Among more than 30,000 recent cancer diagnoses, 70 % were enrolled for ≥5 years and 56 % for ≥10 years before diagnosis. Among 25,274 cancers diagnosed in 2000, 28 % were still enrolled in 2010, 45 % had died, and 27 % had disenrolled from CRN health systems. CONCLUSIONS: Health plan enrollment before cancer diagnosis was generally long in the CRN, and the proportion of patients lost to follow-up after diagnosis was low. With long enrollment histories among cancer patients pre-diagnosis and low post-diagnosis disenrollment, the CRN provides an excellent platform for epidemiologic and health services research on cancer incidence, outcomes, and costs.

Comparison of Interviewer-Administered and Automated Self-Administered 24-Hour Dietary Recalls in 3 Diverse Integrated Health Systems.

Twenty-four-hour dietary recalls provide high-quality intake data but have been prohibitively expensive for large epidemiologic studies. This study's goal was to assess whether the web-based Automated Self-Administered 24-Hour Recall (ASA24) performs similarly enough to the standard interviewer-administered, Automated Multiple-Pass Method (AMPM) 24-hour dietary recall to be considered a viable alternative. In 2010-2011, 1,081 adults from 3 integrated health systems in Detroit, Michigan; Marshfield, Wisconsin; and Kaiser-Permanente Northern California participated in a field trial. A quota design ensured a diverse sample by sex, age, and race/ethnicity. Each participant was asked to complete 2 recalls and was randomly assigned to 1 of 4 protocols differing by type of recall and administration order. For energy, the mean intakes were 2,425 versus 2,374 kcal for men and 1,876 versus 1,906 kcal for women by AMPM and ASA24, respectively. Of 20 nutrients/food groups analyzed and controlling for false discovery rate, 87% were judged equivalent at the 20% bound. ASA24 was preferred over AMPM by 70% of the respondents. Attrition was lower in the ASA24/AMPM study group than in the AMPM/ASA24 group, and it was lower in the ASA24/ASA24 group than in the AMPM/AMPM group. ASA24 offers the potential to collect high-quality dietary intake information at low cost with less attrition.

Validation of AJCC TNM staging for breast tumors diagnosed before 2004 in cancer registries.

PURPOSE: American Joint Committee on Cancer (AJCC) Tumor (T), Nodal (N), and Metastatic (M) staging is commonly used in clinical practice for treatment decisions, yet before 2004, Surveillance Epidemiology and End Results (SEER)-affiliated cancer registries did not routinely include TNM staging defined by AJCC criteria, reporting instead SEER Summary Staging. METHODS: We developed and validated an algorithm to determine AJCC TNM staging from Extent of Disease information for 17,133 female breast cancer cases diagnosed from 1988 to 2003 in the cancer registries of Kaiser Permanente Northern and Southern California. Test characteristics (percent agreement, Cohen's kappa, sensitivity, specificity) were calculated to compare derived TNM with gold-standard TNM available in the registry. RESULTS: Agreement for TNM variables was excellent (range 0.91-1.00 for percent agreement and Cohen's kappa). The sensitivity and specificity, respectively, of the algorithm for AJCC TNM Version 6 staging were as follows: Stage 0 (0.99, 1.00), Stage I (0.97, 0.98), Stage II (0.91, 0.96), Stage III (0.69, 0.99), and Stage IV (0.92, 1.00). Stage III had lower sensitivity due to reclassification of supraclavicular lymph node positivity from M1 (Stage IV) to N3 (Stage IIIC) in AJCC Version 6. CONCLUSIONS: Derived AJCC staging for breast tumors diagnosed before 2004 is feasible and accurate using cancer registry data.

OBAYA (obesity and adverse health outcomes in young adults): feasibility of a population-based multiethnic cohort study using electronic medical records.

BACKGROUND: Although obesity is a risk factor for many chronic diseases, we have only limited knowledge of the magnitude of these associations in young adults. A multiethnic cohort of young adults was established to close current knowledge gaps; cohort demographics, cohort retention, and the potential influence of migration bias were investigated. METHODS: For this population-based cross-sectional study, demographics, and measured weight and height were extracted from electronic medical records of 1,929,470 patients aged 20 to 39 years enrolled in two integrated health plans in California from 2007 to 2009. RESULTS: The cohort included about 84.4% of Kaiser Permanente California members in this age group who had a medical encounter during the study period and represented about 18.2% of the underlying population in the same age group in California. The age distribution of the cohort was relatively comparable to the underlying population in California Census 2010 population, but the proportion of women and ethnic/racial minorities was slightly higher. The three-year retention rate was 68.4%. CONCLUSION: These data suggest the feasibility of our study for medium-term follow-up based on sufficient membership retention rates. While nationwide 6% of young adults are extremely obese, we know little to adequately quantify the health burden attributable to obesity, especially extreme obesity, in this age group. This cohort of young adults provides a unique opportunity to investigate associations of obesity-related factors and risk of cancer in a large multiethnic population.

Trends and Risk Factors for Venous Thromboembolism Among Hospitalized Medical Patients.

Importance: While hospital-associated venous thromboembolism (HA-VTE) is a known complication of hospitalization, contemporary incidence and outcomes data are scarce and methodologically contested. Objective: To define and validate an automated electronic health record (EHR)-based algorithm for retrospective detection of HA-VTE and examine contemporary HA-VTE incidence, previously reported risk factors, and outcomes. Design, Setting, and Participants: This cohort study was conducted using hospital admissions between January 1, 2013, and June 30, 2021, with follow-up until December 31, 2021. All medical (non-intensive care unit) admissions at an integrated health care delivery system with 21 hospitals in Northern California during the study period were included. Data were analyzed from January to June 2022. Exposures: Previously reported risk factors associated with HA-VTE and administration of pharmacological prophylaxis were evaluated as factors associated with HA-VTE. Main Outcomes and Measures: Yearly incidence rates and timing of HA-VTE events overall and by subtype (deep vein thrombosis, pulmonary embolism, both, or unknown), as well as readmissions and mortality rates. Results: Among 1 112 014 hospitalizations involving 529 492 patients (268 797 [50.8%] women; 75 238 Asian [14.2%], 52 697 Black [10.0%], 79 398 Hispanic [15.0%], and 307 439 non-Hispanic White [58.1%]; median [IQR] age, 67.0 [54.0-79.0] years), there were 13 843 HA-VTE events (1.2% of admissions) occurring in 10 410 patients (2.0%). HA-VTE events increased from 307 of 29 095 hospitalizations (1.1%) in the first quarter of 2013 to 551 of 33 729 hospitalizations (1.6%) in the first quarter of 2021. Among all HA-VTE events, 10 746 events (77.6%) were first noted after discharge. In multivariable analyses, several factors were associated with increased odds of HA-VTE, including active cancer (adjusted odds ratio [aOR], 1.96; 95% CI, 1.85-2.08), prior VTE (aOR, 1.71; 95% CI, 1.63-1.79), and reduced mobility (aOR, 1.63; 95% CI, 1.50-1.77). Factors associated with decreased likelihood of HA-VTE included Asian race (vs non-Hispanic White: aOR, 0.65; 95% CI, 0.61-0.69), current admission for suspected stroke (aOR, 0.73; 95% CI, 0.65-0.81), and Hispanic ethnicity (vs non-Hispanic White: aOR, 0.81; 95% CI, 0.77-0.86). HA-VTE events were associated with increased risk of readmission (hazard ratio [HR], 3.33; 95% CI, 3.25-3.41) and mortality (HR, 1.63; 95% CI, 1.57-1.70). Conclusions and Relevance: This study found that HA-VTE events occurred in 1.2% of medical admissions, increased over time, and were associated with increased adverse outcomes. These findings suggest that approaches designed to mitigate occurrence and outcomes associated with HA-VTE may remain needed.

Team is brain: leveraging EHR audit log data for new insights into acute care processes.

OBJECTIVE: To determine whether novel measures of contextual factors from multi-site electronic health record (EHR) audit log data can explain variation in clinical process outcomes. MATERIALS AND METHODS: We selected one widely-used process outcome: emergency department (ED)-based team time to deliver tissue plasminogen activator (tPA) to patients with acute ischemic stroke (AIS). We evaluated Epic audit log data (that tracks EHR user-interactions) for 3052 AIS patients aged 18+ who received tPA after presenting to an ED at three Northern California health systems (Stanford Health Care, UCSF Health, and Kaiser Permanente Northern California). Our primary outcome was door-to-needle time (DNT) and we assessed bivariate and multivariate relationships with six audit log-derived measures of treatment team busyness and prior team experience. RESULTS: Prior team experience was consistently associated with shorter DNT; teams with greater prior experience specifically on AIS cases had shorter DNT (minutes) across all sites: (Site 1: -94.73, 95% CI: -129.53 to 59.92; Site 2: -80.93, 95% CI: -130.43 to 31.43; Site 3: -42.95, 95% CI: -62.73 to 23.17). Teams with greater prior experience across all types of cases also had shorter DNT at two sites: (Site 1: -6.96, 95% CI: -14.56 to 0.65; Site 2: -19.16, 95% CI: -36.15 to 2.16; Site 3: -11.07, 95% CI: -17.39 to 4.74). Team busyness was not consistently associated with DNT across study sites. CONCLUSIONS: EHR audit log data offers a novel, scalable approach to measure key contextual factors relevant to clinical process outcomes across multiple sites. Audit log-based measures of team experience were associated with better process outcomes for AIS care, suggesting opportunities to study underlying mechanisms and improve care through deliberate training, team-building, and scheduling to maximize team experience.

Collaborating on Data, Science, and Infrastructure: The 20-Year Journey of the Cancer Research Network.

The Cancer Research Network (CRN) is a consortium of 12 research groups, each affiliated with a nonprofit integrated health care delivery system, that was first funded in 1998. The overall goal of the CRN is to support and facilitate collaborative cancer research within its component delivery systems. This paper describes the CRN's 20-year experience and evolution. The network combined its members' scientific capabilities and data resources to create an infrastructure that has ultimately supported over 275 projects. Insights about the strengths and limitations of electronic health data for research, approaches to optimizing multidisciplinary collaboration, and the role of a health services research infrastructure to complement traditional clinical trials and large observational datasets are described, along with recommendations for other research consortia.

Comparison of recruitment and retention among demographic subgroups in a large diverse population study of diet.

OBJECTIVE: We examined the feasibility of conducting a longitudinal study of diet among diverse populations by comparing rates of response throughout recruitment and retention phases by demographic and other characteristics. METHODS: Using quota sampling, participants were recruited from 3 geographically and demographically diverse integrated health systems in the United States. Overall, 12,860 adults, ages 20-70, were invited to participate via mail. Participation first required accessing the study's website and later meeting eligibility criteria via telephone interview. Enrollees were asked to provide two 24-hour dietary recalls, either interviewer-administered or self-administered on the web, over 6 weeks. Stepped monetary incentives were provided. RESULTS: Rates for accessing the study website ranged from 6% to 23% (9% overall) across sites. Site differences may reflect differences in recruitment strategy or target samples. Of those accessing the website, enrollment was high (≥ 87%). Of the 1185 enrollees, 42% were non-Hispanic white, 34% were non-Hispanic black, and 24% were Hispanic. Men and minorities had lower enrollment rates than women and non-Hispanic whites, partially due to less successful telephone contact for eligibility screening. Once enrolled, 90% provided 1 recall and 80% provided both. Women had higher retention rates than men, as did older compared to younger participants. Retention rates were similar across race/ethnicity groups. CONCLUSIONS: While study recruitment remains challenging, once recruited most participants, regardless of race/ethnicity, completed two 24-hour dietary recalls, both interviewer-administered and self-administered on the web. This study demonstrates the feasibility of collecting multiple 24-hour recalls including less expensive automated self-administered recalls among diverse populations.

The prevalence of obesity and obesity-related health conditions in a large, multiethnic cohort of young adults in California.

PURPOSE: To identify population groups that are most susceptible to obesity-related health conditions at young age. METHODS: For this population-based cross-sectional study, measured weight and height, diagnosis, laboratory, and drug prescription information were extracted from electronic medical records of 1,819,205 patients aged 20 to 39 years enrolled in two integrated health plans in California in 2007 through 2009. RESULTS: Overall, 29.9% of young adults were obese. Extreme obesity (body mass index [BMI] ≥ 40 kg/m(2)) was observed in 6.1% of women and 4.5% of men. The adjusted relative risk (RR) for diabetes, hypertension, dyslipidemia, and the metabolic syndrome increased sharply for those individuals with a BMI of 40 or greater, with the sharpest increase in the adjusted RR for hypertension and the metabolic syndrome. The association between weight class and dyslipidemia, hypertension, and the metabolic syndrome but not diabetes was stronger among 20.0- to 29.9-year-olds compared with 30.0- to 39.9-year-olds (P for interaction < .05). For example, compared with their normal weight counterparts of the same age group, young adults with a BMI of 40.0 to 49.9, 50.0 to 59.9, and 60 or greater kg/m(2) had a RR for hypertension of 11.73, 19.88, and 30.47 (95% confidence interval [CI], 26.39-35.17) at 20 to 29 years old, and 9.31, 12.41, and 15.43 (95% CI, 14.32-16.63) at 30 to 39 years old. CONCLUSIONS: Although older individuals were more likely to be extremely obese, the association between obesity-related health conditions was stronger in younger individuals. Hispanics and Blacks are also more likely to be obese, including extremely obese, putting them at an elevated risk for premature cardiovascular disease and some cancers relative to non-Hispanic Whites.