Diversity, Equity, and Inclusion in Clinical Research: A Path Toward Precision Health for Everyone.

Healthcare disparities are a persistent societal problem. One of the contributing factors to this status quo is the lack of diversity and representativeness of research efforts, which result in nongeneralizable evidence that, in turn, provides suboptimal means to enable the best possible outcomes at the individual level. There are several strategies that research teams can adopt to improve the diversity, equity, and inclusion (DEI) of their efforts; these strategies span the totality of the research path, from initial design to the shepherding of clinical data through a potential regulatory process. These strategies include more intentionality and DEI-based goal-setting, more diverse research and leadership teams, better community engagement to set study goals and approaches, better tailored outreach interventions, decentralization of study procedures and incorporation of innovative technology for more flexible data collection, and self-surveillance to identify and prevent biases. Within their remit of overlooking research efforts, regulatory authorities, as stakeholders, also have the potential for a positive effect on the DEI of emerging clinical evidence. All these are implementable tools and mechanisms that can make study participation more approachable to diverse communities, and ultimately generate evidence that is more generalizable and a conduit for better outcomes. The research community has an imperative to make DEI principles key foundational aspects in study conduct in order to pursue better personalized medicine for diverse patient populations.

Leveraging the health information technology infrastructure to advance federal research priorities.

Ensuring that federally funded health research keeps pace with the explosion of health data depends on better information technology (IT), access to high-quality electronic health data, and supportive policies. Because it prominently funds and conducts health research, the U.S. federal government needs health IT to rapidly evolve and has the ability to drive that evolution. The Office of the National Coordinator for Health Information Technology developed the National Health IT Priorities for Research: A Policy and Development Agenda (the Agenda) that identifies health IT priorities for research in consultation with relevant federal agencies. This article describes support for the Agenda from the Food and Drug Administration, the National Institutes of Health, and the Veterans Health Administration. Advancing the Agenda will benefit these agencies and support their missions as well as the entire ecosystem leveraging the health IT infrastructure or using data from health IT systems for research.

Characterizing the Feasibility and Performance of Real-World Tumor Progression End Points and Their Association With Overall Survival in a Large Advanced Non-Small-Cell Lung Cancer Data Set.

PURPOSE: Large, generalizable real-world data can enhance traditional clinical trial results. The current study evaluates reliability, clinical relevance, and large-scale feasibility for a previously documented method with which to characterize cancer progression outcomes in advanced non-small-cell lung cancer from electronic health record (EHR) data. METHODS: Patients who were diagnosed with advanced non-small-cell lung cancer between January 1, 2011, and February 28, 2018, with two or more EHR-documented visits and one or more systemic therapy line initiated were identified in Flatiron Health's longitudinal EHR-derived database. After institutional review board approval, we retrospectively characterized real-world progression (rwP) dates, with a random duplicate sample to ascertain interabstractor agreement. We calculated real-world progression-free survival, real-world time to progression, real-world time to next treatment, and overall survival (OS) using the Kaplan-Meier method (index date was the date of first-line therapy initiation), and correlations between OS and other end points were assessed at the patient level (Spearman's ρ). RESULTS: Of 30,276 eligible patients,16,606 (55%) had one or more rwP event. Of these patients, 11,366 (68%) had subsequent death, treatment discontinuation, or new treatment initiation. Correlation of real-world progression-free survival with OS was moderate to high (Spearman's ρ, 0.76; 95% CI, 0.75 to 0.77; evaluable patients, n = 20,020), and for real-world time to progression correlation with OS was lower (Spearman's ρ, 0.69; 95% CI, 0.68 to 0.70; evaluable patients, n = 11,902). Interabstractor agreement on rwP occurrence was 0.94 (duplicate sample, n = 1,065) and on rwP date 0.85 (95% CI, 0.81 to 0.89; evaluable patients n = 358 [patients with two independent event captures within 30 days]). Median rwP abstraction time from individual EHRs was 18.0 minutes (interquartile range, 9.7 to 34.4 minutes). CONCLUSION: We demonstrated that rwP-based end points correlate with OS, and that rwP curation from a large, contemporary EHR data set can be reliable, clinically relevant, and feasible on a large scale.

Real-world progression, treatment, and survival outcomes during rapid adoption of immunotherapy for advanced non-small cell lung cancer.

BACKGROUND: Despite the rapid adoption of immunotherapies in advanced non-small cell lung cancer (advNSCLC), knowledge gaps remain about their real-world (rw) performance. METHODS: This retrospective, observational, multicenter analysis used the Flatiron Health deidentified electronic health record-derived database of rw patients with advNSCLC who received treatment with PD-1 and/or PD-L1 (PD-[L]1) inhibitors before July 1, 2017 (N = 5257) and had ≥6 months of follow-up. The authors investigated PD-(L)1 line of treatment and PD-L1 testing rates and the relationship between overall survival (OS) and rw intermediate endpoints: progression-free survival (rwPFS), rw time to progression (rwTTP), rw time to next treatment (rwTTNT), and rw time to discontinuation (rwTTD). RESULTS: First-line PD-(L)1 inhibitor use increased from 0% (in the third quarter of 2014 [Q3 2014]) to 42% (Q2 2017) over the study period. PD-L1 testing also increased (from 3% in Q3 2015 to 70% in Q2 2017). The estimated median OS was 9.3 months (95% CI, 8.9-9.8 months), and the estimated rwPFS was 3.2 months (95% CI, 3.1-3.3 months). Longer OS and rwPFS were associated with ≥50% PD-L1 percentage staining results. Correlations (⍴) between OS and intermediate endpoints were ⍴ = 0.75 (95% CI, 0.73-0.76) for rwPFS and ⍴ = 0.60 (95% CI, 0.57-0.63) for rwTTP, and, for treatment-based intermediate endpoints, correlations were ⍴ = 0.60 (95% CI, 0.56-0.64) for rwTTNT (N = 856) and ⍴ = 0.81 (95% CI, 0.80-0.82) for rwTTD. CONCLUSIONS: The use of first-line PD-(L)1 inhibitors and PD-L1 testing has substantially increased, with better outcomes for patients who have ≥50% PD-L1 percentage staining. Intermediate rw tumor-dynamics estimates were moderately correlated with OS in patients with advNSCLC who received immunotherapy, highlighting the need for optimizing and standardizing rw endpoints to enhance the understanding of patient outcomes outside clinical trials.

An Exploratory Analysis of Real-World End Points for Assessing Outcomes Among Immunotherapy-Treated Patients With Advanced Non-Small-Cell Lung Cancer.

PURPOSE: This pilot study examined the ability to operationalize the collection of real-world data to explore the potential use of real-world end points extracted from data from diverse health care data organizations and to assess how these relate to similar end points in clinical trials for immunotherapy-treated advanced non-small-cell lung cancer. PATIENTS AND METHODS: Researchers from six organizations followed a common protocol using data from administrative claims and electronic health records to assess real-world end points, including overall survival (rwOS), time to next treatment, time to treatment discontinuation (rwTTD), time to progression, and progression-free survival, among patients with advanced non-small-cell lung cancer treated with programmed death 1/programmed death-ligand 1 inhibitors in real-world settings. Data sets included from 269 to 6,924 patients who were treated between January 2011 and October 2017. Results from contributors were anonymized. RESULTS: Correlations between real-world intermediate end points (rwTTD and time to next treatment) and rwOS were moderate to high (range, 0.6 to 0.9). rwTTD was the most consistent end points as treatment detail was available in all data sets. rwOS at 1 year post-programmed death-ligand 1 initiation ranged from 40% to 57%. In addition, rwOS as assessed via electronic health records and claims data fell within the range of median OS values observed in relevant clinical trials. Data sources had been used extensively for research with ongoing data curation to assure accuracy and practical completeness before the initiation of this research. CONCLUSION: These findings demonstrate that real-world end points are generally consistent with each other and with outcomes observed in randomized clinical trials, which substantiates the potential validity of real-world data to support regulatory and payer decision making. Differences observed likely reflect true differences between real-world and protocol-driven practices.

A behavioral cancer pain intervention: A randomized noninferiority trial comparing in-person with videoconference delivery.

OBJECTIVE: Behavioral cancer pain interventions are efficacious for improving important pain outcomes; yet, traditional in-person delivery limits patient access. This study compared videoconference-delivered mobile health pain coping skills training (mPCST) to in-person pain coping skills training (PCST-traditional). METHODS: This study was a randomized, noninferiority trial with cancer patients. Participants (N = 178) were randomly assigned to four, 45-minute sessions of mPCST or PCST-traditional. Session content focused on evidence-based cognitive and behavioral pain management skills. Assessments were completed at baseline, posttreatment, and 3-month posttreatment, and included measures of primary intervention outcomes (ie, pain severity and pain interference) and secondary intervention outcomes (ie, physical symptoms, psychological distress, physical well-being, and self-efficacy). The main study aim tested whether mPCST was more accessible (defined as feasibility, acceptability, patient burden, and engagement) than PCST-traditional. The second aim tested whether mPCST was noninferior to PCST-traditional. RESULTS: mPCST demonstrated significantly greater feasibility (ie, attrition, adherence, and time to completion) than PCST-traditional. Both groups reported similar patient burden and engagement as well as a high degree of acceptability. All intervention outcomes demonstrated noninferiority at posttreatment and, with the exception of physical symptoms, 3-month posttreatment. Concerning the primary intervention outcomes, 95% CIs for the mean differences (d) were below the noninferiority margin of 1 for pain severity (posttreatment d = 0.09, 95% CI, -0.63-0.81; 3 months d = -0.43 95% CI, -1.22-0.36) and pain interference (posttreatment d = -0.11, 95% CI, -0.99-0.76; 3 months d = -0.26 95% CI, -1.14-0.62). CONCLUSION: mPCST is highly accessible and noninferior to PCST-traditional.

Association of Patient Characteristics and Tumor Genomics With Clinical Outcomes Among Patients With Non-Small Cell Lung Cancer Using a Clinicogenomic Database.

Importance: Data sets linking comprehensive genomic profiling (CGP) to clinical outcomes may accelerate precision medicine. Objective: To assess whether a database that combines EHR-derived clinical data with CGP can identify and extend associations in non-small cell lung cancer (NSCLC). Design, Setting, and Participants: Clinical data from EHRs were linked with CGP results for 28 998 patients from 275 US oncology practices. Among 4064 patients with NSCLC, exploratory associations between tumor genomics and patient characteristics with clinical outcomes were conducted, with data obtained between January 1, 2011, and January 1, 2018. Exposures: Tumor CGP, including presence of a driver alteration (a pathogenic or likely pathogenic alteration in a gene shown to drive tumor growth); tumor mutation burden (TMB), defined as the number of mutations per megabase; and clinical characteristics gathered from EHRs. Main Outcomes and Measures: Overall survival (OS), time receiving therapy, maximal therapy response (as documented by the treating physician in the EHR), and clinical benefit rate (fraction of patients with stable disease, partial response, or complete response) to therapy. Results: Among 4064 patients with NSCLC (median age, 66.0 years; 51.9% female), 3183 (78.3%) had a history of smoking, 3153 (77.6%) had nonsquamous cancer, and 871 (21.4%) had an alteration in EGFR, ALK, or ROS1 (701 [17.2%] with EGFR, 128 [3.1%] with ALK, and 42 [1.0%] with ROS1 alterations). There were 1946 deaths in 7 years. For patients with a driver alteration, improved OS was observed among those treated with (n = 575) vs not treated with (n = 560) targeted therapies (median, 18.6 months [95% CI, 15.2-21.7] vs 11.4 months [95% CI, 9.7-12.5] from advanced diagnosis; P < .001). TMB (in mutations/Mb) was significantly higher among smokers vs nonsmokers (8.7 [IQR, 4.4-14.8] vs 2.6 [IQR, 1.7-5.2]; P < .001) and significantly lower among patients with vs without an alteration in EGFR (3.5 [IQR, 1.76-6.1] vs 7.8 [IQR, 3.5-13.9]; P < .001), ALK (2.1 [IQR, 0.9-4.0] vs 7.0 [IQR, 3.5-13.0]; P < .001), RET (4.6 [IQR, 1.7-8.7] vs 7.0 [IQR, 2.6-13.0]; P = .004), or ROS1 (4.0 [IQR, 1.2-9.6] vs 7.0 [IQR, 2.6-13.0]; P = .03). In patients treated with anti-PD-1/PD-L1 therapies (n = 1290, 31.7%), TMB of 20 or more was significantly associated with improved OS from therapy initiation (16.8 months [95% CI, 11.6-24.9] vs 8.5 months [95% CI, 7.6-9.7]; P < .001), longer time receiving therapy (7.8 months [95% CI, 5.5-11.1] vs 3.3 months [95% CI, 2.8-3.7]; P < .001), and increased clinical benefit rate (80.7% vs 56.7%; P < .001) vs TMB less than 20. Conclusions and Relevance: Among patients with NSCLC included in a longitudinal database of clinical data linked to CGP results from routine care, exploratory analyses replicated previously described associations between clinical and genomic characteristics, between driver mutations and response to targeted therapy, and between TMB and response to immunotherapy. These findings demonstrate the feasibility of creating a clinicogenomic database derived from routine clinical experience and provide support for further research and discovery evaluating this approach in oncology.

Patient free text reporting of symptomatic adverse events in cancer clinical research using the National Cancer Institute's Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE).

OBJECTIVE: The study sought to describe patient-entered supplemental information on symptomatic adverse events (AEs) in cancer clinical research reported via a National Cancer Institute software system and examine the feasibility of mapping these entries to established terminologies. MATERIALS AND METHODS: Patients in 3 multicenter trials electronically completed surveys during cancer treatment. Each survey included a prespecified subset of items from the National Cancer Institute's Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). Upon completion of the survey items, patients could add supplemental symptomatic AE information in a free text box. As patients typed into the box, structured dropdown terms could be selected from the PRO-CTCAE item library or Medical Dictionary for Regulatory Activities (MedDRA), or patients could type unstructured free text for submission. RESULTS: Data were pooled from 1760 participants (48% women; 78% White) who completed 8892 surveys, of which 2387 (26.8%) included supplemental symptomatic AE information. Overall, 1024 (58%) patients entered supplemental information at least once, with an average of 2.3 per patient per study. This encompassed 1474 of 8892 (16.6%) dropdowns and 913 of 8892 (10.3%) unstructured free text entries. One-third of the unstructured free text entries (32%) could be mapped post hoc to a PRO-CTCAE term and 68% to a MedDRA term. DISCUSSION: Participants frequently added supplemental information beyond study-specific survey items. Almost half selected a structured dropdown term, although many opted to submit unstructured free text entries. Most free text entries could be mapped post hoc to PRO-CTCAE or MedDRA terms, suggesting opportunities to enhance the system to perform real-time mapping for AE reporting. CONCLUSIONS: Patient reporting of symptomatic AEs using a text box functionality with mapping to existing terminologies is both feasible and informative.

Pruritus in patients with solid tumors: an overlooked supportive care need.

PURPOSE: Pruritus is a common symptom in cutaneous malignancies, but its impact on patients with solid tumors is unclear. We explored the impact and management of pruritus in patients with solid tumors, using patient-reported outcomes (PRO) data from a real-world registry. METHODS: From 2006 to 2011, patients seen in the Duke Cancer Institute reported their symptoms via the Patient Care Monitor v2.0, a validated PRO tool that includes a 0-10-point question about pruritus severity. From > 25,000 encounters, 203 patients reported severe pruritus (> 6/10) on at least one visit and 506 total visits were abstracted where patients reported either moderate or severe pruritus (> 3/10). From this cohort, we abstracted demographics, diagnosis, stage, cancer therapy, anti-pruritic therapy, and clinicians' responses. RESULTS: Mean age was 59.8 (SD 13.3), 134 (66%) were female, 125 (62%) were Caucasian, and 65 (32%) were African American. Breast cancer was the most common tumor (36.5%), followed by lung cancer (23.2%). Mean pruritus severity score was 6.8 (SD 1.8) for patients on chemotherapy, 6.9 (SD 1.8) for patients on targeted therapy alone or in combination, and 7.1(SD 1.8) for patients off treatment. Overall, 67% of patients reported at least two episodes of moderate-severe pruritus (mean # of visits 4.2 (SD 2.7)). Despite frequent report of severe and persistent pruritus, this was mentioned in just 28% of clinician notes and an intervention was recommended/prescribed in only 7% of visits. CONCLUSIONS: Pruritus is an under-addressed symptom in patients with solid tumors. Additional research is needed to understand the burden of pruritus in affected populations.

Treatment patterns and outcomes for patients with advanced melanoma in US oncology clinical practices.

AIM: To describe recent evolution in treatment patterns and outcomes for advanced melanoma (AMel). METHODS: This retrospective observational study analyzed de-identified electronic health record data from the Flatiron Health database for 1140 adult patients who initiated first-line therapy for AMel from 1 January 2014 to 30 June 2016 with follow-up through 28 February 2017. RESULTS: The most common first-line regimens were ipilimumab-based therapies (34%), anti-PD-1 monotherapy (26%) and BRAF/MEK inhibitor(s) (20%). First-line ipilimumab-based and BRAF inhibitor regimens decreased after the third quarter of 2014 (3Q2014), and by 2Q2016, 55 and 91% of BRAF-mutant and BRAF wild-type cohorts, respectively, received a first-line anti-PD-1 regimen. Median overall survival from first-line initiation for all patients was 18.8 months (95% CI: 16.3-23.3). CONCLUSION: Results illustrate changing paradigms of therapy and real-world patient outcomes for AMel.

Sertraline in symptomatic chronic breathlessness: a double blind, randomised trial.

Does sertraline provide symptomatic relief for chronic breathlessness in people with advanced disease whose underlying cause(s) are optimally treated?223 participants with chronic breathlessness (modified Medical Research Council breathlessness scale ≥2) who had optimal treatment of underlying cause(s) were randomised 1:1 to sertraline 25-100 mg (titrated upwards over 9 days) or placebo for 4 weeks. The primary outcome was the proportion who had an improvement in intensity of current breathlessness >15% from baseline on a 100-mm visual analogue scale.The proportion of people responding to sertraline was similar to placebo for current breathlessness on days 26-28 (OR 1.00, 95% CI 0.71-1.40) and for other measures of breathlessness. Quality of life in the sertraline arm had a higher likelihood of improving than in the placebo arm over the 4 weeks (OR 0.21, 95% CI 0.01-0.41; p=0.044). No differences in performance status, anxiety and depression, or survival were observed. Adverse event rates were similar between arms.Sertraline does not appear to provide any benefit over placebo in the symptomatic relief of chronic breathlessness in this patient population.

Real-World Outcomes of Patients with Metastatic Non-Small Cell Lung Cancer Treated with Programmed Cell Death Protein 1 Inhibitors in the Year Following U.S. Regulatory Approval.

BACKGROUND: Evidence from cancer clinical trials has strong internal validity but can be difficult to generalize to real-world patient populations. Here we analyzed real-world outcomes of patients with metastatic non-small cell lung cancer (mNSCLC) treated with programmed cell death protein 1 (PD-1) inhibitors in the first year following U.S. regulatory approval. MATERIALS AND METHODS: This retrospective study leveraged electronic health record (EHR) data collected during routine patient care in community cancer care clinics. The cohort included patients with mNSCLC who had received nivolumab or pembrolizumab for metastatic disease (n = 1,344) with >1 EHR-documented visit from January 1, 2011, to March 31, 2016. Patients with a > 90-day gap between advanced disease diagnosis and first EHR structured data entry were excluded. RESULTS: Estimated median overall survival (OS) was 8.0 months (95% confidence interval 7.4-9.0 months). Estimated median OS was 4.7 months (3.4-6.6) for patients with anaplastic lymphoma kinase rearrangement- and epidermal growth factor receptor mutation-positive tumors, and 8.6 months (7.7-10.6) for patients without such mutations. Age at PD-1 inhibitor initiation or line of therapy did not impact OS. CONCLUSION: This analysis suggests OS in real-world patients may be shorter than in conventional clinical trial patient cohorts, potentially due to narrow trial eligibility criteria. The lack of difference in OS by line of therapy or age at immunotherapy initiation suggests sustained benefit of PD-1 inhibitors in multitreated patients with mNSCLC and that age is not a predictor of outcome. Further studies are underway in patients with comorbidities, organ dysfunction, and multiple prior therapies. IMPLICATIONS FOR PRACTICE: This study evaluated data derived from electronic health records of patients with metastatic non-small cell lung cancer treated with programmed cell death protein 1 (PD-1) inhibitors in the year following regulatory approval. This real-world cohort had shorter overall survival (OS) indexed to PD-1 inhibitor initiation than reported in clinical trials. Late-line treatment did not influence OS, and patients aged >75 at immunotherapy initiation did not have worse outcomes than younger patients. As new therapies enter clinical practice, real-world data can complement clinical trial evidence providing information on generalizability and helping inform clinical treatment decisions.

Association of Broad-Based Genomic Sequencing With Survival Among Patients With Advanced Non-Small Cell Lung Cancer in the Community Oncology Setting.

Importance: Broad-based genomic sequencing is being used more frequently for patients with advanced non-small cell lung cancer (NSCLC). However, little is known about the association between broad-based genomic sequencing and treatment selection or survival among patients with advanced NSCLC in a community oncology setting. Objective: To compare clinical outcomes between patients with advanced NSCLC who received broad-based genomic sequencing vs a control group of patients who received routine testing for EGFR mutations and/or ALK rearrangements alone. Design, Setting, and Participants: Retrospective cohort study of patients with chart-confirmed advanced NSCLC between January 1, 2011, and July 31, 2016, and who received care at 1 of 191 oncology practices across the United States using the Flatiron Health Database. Patients were diagnosed with stage IIIB/IV or unresectable nonsquamous NSCLC who received at least 1 line of antineoplastic treatment. Exposures: Receipt of either broad-based genomic sequencing or routine testing (EGFR and/or ALK only). Broad-based genomic sequencing included any multigene panel sequencing assay examining more than 30 genes prior to third-line treatment. Main Outcomes and Measures: Primary outcomes were 12-month mortality and overall survival from the start of first-line treatment. Secondary outcomes included frequency of genetic alterations and treatments received. Results: Among 5688 individuals with advanced NSCLC (median age, 67 years [interquartile range, 41-85], 63.6% white, 80% with a history of smoking); 875 (15.4%) received broad-based genomic sequencing and 4813 (84.6%) received routine testing. Among patients who received broad-based genomic sequencing, 4.5% received targeted treatment based on testing results, 9.8% received routine EGFR/ALK targeted treatment, and 85.1% received no targeted treatment. Unadjusted mortality rates at 12 months were 49.2% for patients undergoing broad-based genomic sequencing and 35.9% for patients undergoing routine testing. Using an instrumental variable analysis, there was no significant association between broad-based genomic sequencing and 12-month mortality (predicted probability of death at 12 months, 41.1% for broad-based genomic sequencing vs 44.4% for routine testing; difference -3.6% [95% CI, -18.4% to 11.1%]; P = .63). The results were consistent in the propensity score-matched survival analysis (42.0% vs 45.1%; hazard ratio, 0.92 [95% CI, 0.73 to 1.11]; P = .40) vs unmatched cohort (hazard ratio, 0.69 [95% CI, 0.62 to 0.77]; log-rank P < .001). Conclusions and Relevance: Among patients with advanced non-small cell lung cancer receiving care in the community oncology setting, broad-based genomic sequencing directly informed treatment in a minority of patients and was not independently associated with better survival.

Software for Administering the National Cancer Institute's Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events: Usability Study.

BACKGROUND: The US National Cancer Institute (NCI) developed software to gather symptomatic adverse events directly from patients participating in clinical trials. The software administers surveys to patients using items from the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) through Web-based or automated telephone interfaces and facilitates the management of survey administration and the resultant data by professionals (clinicians and research associates). OBJECTIVE: The purpose of this study was to iteratively evaluate and improve the usability of the PRO-CTCAE software. METHODS: Heuristic evaluation of the software functionality was followed by semiscripted, think-aloud protocols in two consecutive rounds of usability testing among patients with cancer, clinicians, and research associates at 3 cancer centers. We conducted testing with patients both in clinics and at home (remotely) for both Web-based and telephone interfaces. Furthermore, we refined the software between rounds and retested. RESULTS: Heuristic evaluation identified deviations from the best practices across 10 standardized categories, which informed initial software improvement. Subsequently, we conducted user-based testing among 169 patients and 47 professionals. Software modifications between rounds addressed identified issues, including difficulty using radio buttons, absence of survey progress indicators, and login problems (for patients) as well as scheduling of patient surveys (for professionals). The initial System Usability Scale (SUS) score for the patient Web-based interface was 86 and 82 (P=.22) before and after modifications, respectively, whereas the task completion score was 4.47, which improved to 4.58 (P=.39) after modifications. Following modifications for professional users, the SUS scores improved from 71 to 75 (P=.47), and the mean task performance improved significantly (4.40 vs 4.02; P=.001). CONCLUSIONS: Software modifications, informed by rigorous assessment, rendered a usable system, which is currently used in multiple NCI-sponsored multicenter cancer clinical trials. TRIAL REGISTRATION: ClinicalTrials.gov NCT01031641; https://clinicaltrials.gov/ct2/show/NCT01031641 (Archived by WebCite at http://www.webcitation.org/708hTjlTl).

Development and Validation of a High-Quality Composite Real-World Mortality Endpoint.

OBJECTIVE: To create a high-quality electronic health record (EHR)-derived mortality dataset for retrospective and prospective real-world evidence generation. DATA SOURCES/STUDY SETTING: Oncology EHR data, supplemented with external commercial and US Social Security Death Index data, benchmarked to the National Death Index (NDI). STUDY DESIGN: We developed a recent, linkable, high-quality mortality variable amalgamated from multiple data sources to supplement EHR data, benchmarked against the highest completeness U.S. mortality data, the NDI. Data quality of the mortality variable version 2.0 is reported here. PRINCIPAL FINDINGS: For advanced non-small-cell lung cancer, sensitivity of mortality information improved from 66 percent in EHR structured data to 91 percent in the composite dataset, with high date agreement compared to the NDI. For advanced melanoma, metastatic colorectal cancer, and metastatic breast cancer, sensitivity of the final variable was 85 to 88 percent. Kaplan-Meier survival analyses showed that improving mortality data completeness minimized overestimation of survival relative to NDI-based estimates. CONCLUSIONS: For EHR-derived data to yield reliable real-world evidence, it needs to be of known and sufficiently high quality. Considering the impact of mortality data completeness on survival endpoints, we highlight the importance of data quality assessment and advocate benchmarking to the NDI.

Speed of Adoption of Immune Checkpoint Inhibitors of Programmed Cell Death 1 Protein and Comparison of Patient Ages in Clinical Practice vs Pivotal Clinical Trials.

Importance: The US Food and Drug Administration (FDA) is increasing its pace of approvals for novel cancer therapeutics, including for immune checkpoint inhibitors of programmed cell death 1 protein (anti-PD-1 agents). However, little is known about how quickly anti-PD-1 agents agents reach eligible patients in practice or whether such patients differ from those studied in clinical trials that lead to FDA approval (pivotal clinical trials). Objectives: To assess the speed with which anti-PD-1 agents agents reached eligible patients in practice and to compare the ages of patients treated in clinical practice with the ages of those treated in pivotal clinical trials. Design, Setting, and Participants: This retrospective cohort study, performed from January 1, 2011, through August 31, 2016, included patients from the Flatiron Health Network who were eligible for anti-PD-1 agents treatment of selected cancer types, which included melanoma, non-small cell lung cancer (NSCLC), and renal cell carcinoma (RCC). Main Outcomes and Measures: Cumulative proportions of eligible patients receiving anti-PD-1 agents treatment and their age distributions. Results: The study identified 3089 patients who were eligible for anti-PD-1 agents treatment (median age, 66 [interquartile range, 56-75] years for patients with melanoma, 66 [interquartile range, 58-72] years for patients with RCC, and 67 [interquartile range, 59-74] years for patients with NSCLC; 1742 male [56.4%] and 1347 [43.6%] female; 2066 [66.9%] white). Of these patients, 2123 (68.7%) received anti-PD-1 agents treatment, including 439 eligible patients with melanoma (79.1%), 1417 eligible patients with NSCLC (65.6%), and 267 eligible patients with RCC (71.2%). Within 4 months after FDA approval, greater than 60% of eligible patients in each cohort had received anti-PD-1 agents treatment. Overall, similar proportions of older and younger patients received anti-PD-1 agents treatment during the first 9 months after FDA approval. However, there were significant differences in age between clinical trial participants and patients receiving anti-PD-1 agents treatment in clinical practice, with more patients being older than 65 years in clinical practice (range, 327 of 1365 [60.6%] to 46 of 72 [63.9%]) than in pivotal clinical trials (range, 38 of 120 [31.7%] to 223 of 544 [41.0%]; all P < .001). Conclusions and Relevance: Anti-PD-1 agents rapidly reached patients in clinical practice, and patients treated in clinical practice differed significantly from patients treated in pivotal clinical trials. Future actions are needed to ensure that rapid adoption occurs on the basis of representative trial evidence.