ABSTRACT
Remote health assessments that gather real-world data (RWD) outside clinic settings require a clear understanding of appropriate methods for data collection, quality assessment, analysis and interpretation. Here we examine the performance and limitations of smartphones in collecting RWD in the remote mPower observational study of Parkinson's disease (PD). Within the first 6 months of study commencement, 960 participants had enrolled and performed at least five self-administered active PD symptom assessments (speeded tapping, gait/balance, phonation or memory). Task performance, especially speeded tapping, was predictive of self-reported PD status (area under the receiver operating characteristic curve (AUC) = 0.8) and correlated with in-clinic evaluation of disease severity (r = 0.71; P < 1.8 × 10-6) when compared with motor Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS). Although remote assessment requires careful consideration for accurate interpretation of RWD, our results support the use of smartphones and wearables in objective and personalized disease assessments.
Subject(s)
Parkinson Disease , Smartphone , Gait , Humans , Movement , Parkinson Disease/diagnosis , Severity of Illness IndexABSTRACT
Collection of high-dimensional, longitudinal digital health data has the potential to support a wide-variety of research and clinical applications including diagnostics and longitudinal health tracking. Algorithms that process these data and inform digital diagnostics are typically developed using training and test sets generated from multiple repeated measures collected across a set of individuals. However, the inclusion of repeated measurements is not always appropriately taken into account in the analytical evaluations of predictive performance. The assignment of repeated measurements from each individual to both the training and the test sets ("record-wise" data split) is a common practice and can lead to massive underestimation of the prediction error due to the presence of "identity confounding." In essence, these models learn to identify subjects, in addition to diagnostic signal. Here, we present a method that can be used to effectively calculate the amount of identity confounding learned by classifiers developed using a record-wise data split. By applying this method to several real datasets, we demonstrate that identity confounding is a serious issue in digital health studies and that record-wise data splits for machine learning- based applications need to be avoided.
Subject(s)
Career Mobility , Forecasting , Radiation Oncologists/trends , Biology/trends , Diffusion of Innovation , Global Health , Health Policy , Humans , Industrial Development , Medical Informatics , Medical Informatics Applications , Palliative Care , Radiation Oncologists/education , Radiation Oncologists/legislation & jurisprudence , Radiation Oncologists/supply & distribution , Radioactive Hazard Release/psychology , Rural Health Services , United StatesABSTRACT
Sensor-embedded phones are an emerging facilitator for participant-driven research studies. Skin cancer research is particularly amenable to this approach, as phone cameras enable self-examination and documentation of mole abnormalities that may signal a progression towards melanoma. Aggregation and open sharing of this participant-collected data can be foundational for research and the development of early cancer detection tools. Here we describe data from Mole Mapper, an iPhone-based observational study built using the Apple ResearchKit framework. The Mole Mapper app was designed to collect participant-provided images and measurements of moles, together with demographic and behavioral information relating to melanoma risk. The study cohort includes 2,069 participants who contributed 1,920 demographic surveys, 3,274 mole measurements, and 2,422 curated mole images. Survey data recapitulates associations between melanoma and known demographic risks, with red hair as the most significant factor in this cohort. Participant-provided mole measurements indicate an average mole size of 3.95 mm. These data have been made available to engage researchers in a collaborative, multidisciplinary effort to better understand and prevent melanoma.
Subject(s)
Melanoma , Skin Neoplasms , Cell Phone , Cohort Studies , Humans , Melanoma/epidemiology , Melanoma/prevention & control , Observational Studies as Topic , Self-Examination/methods , Skin Neoplasms/epidemiology , Skin Neoplasms/prevention & controlABSTRACT
Because of their growing popularity and functionality, smartphones are increasingly valuable potential tools for health and medical research. Using ResearchKit, Apple's open-source platform to build applications ("apps") for smartphone research, collaborators have developed apps for researching asthma, breast cancer, cardiovascular disease, type 2 diabetes, and Parkinson disease. These research apps enhance widespread participation by removing geographical barriers to participation, provide novel ways to motivate healthy behaviors, facilitate high-frequency assessments, and enable more objective data collection. Although the studies have great potential, they also have notable limitations. These include selection bias, identity uncertainty, design limitations, retention, and privacy. As smartphone technology becomes increasingly available, researchers must recognize these factors to ensure that medical research is conducted appropriately. Despite these limitations, the future of smartphones in health research is bright. Their convenience grants unprecedented geographic freedom to researchers and participants alike and transforms the way clinical research can be conducted.
Subject(s)
Biomedical Research/methods , Diagnostic Techniques and Procedures , Disease/classification , Mobile Applications/statistics & numerical data , Smartphone/statistics & numerical data , HumansABSTRACT
Current measures of health and disease are often insensitive, episodic, and subjective. Further, these measures generally are not designed to provide meaningful feedback to individuals. The impact of high-resolution activity data collected from mobile phones is only beginning to be explored. Here we present data from mPower, a clinical observational study about Parkinson disease conducted purely through an iPhone app interface. The study interrogated aspects of this movement disorder through surveys and frequent sensor-based recordings from participants with and without Parkinson disease. Benefitting from large enrollment and repeated measurements on many individuals, these data may help establish baseline variability of real-world activity measurement collected via mobile phones, and ultimately may lead to quantification of the ebbs-and-flows of Parkinson symptoms. App source code for these data collection modules are available through an open source license for use in studies of other conditions. We hope that releasing data contributed by engaged research participants will seed a new community of analysts working collaboratively on understanding mobile health data to advance human health.
Subject(s)
Data Collection , Datasets as Topic , Parkinson Disease , Cell Phone , Humans , TelemedicineABSTRACT
We propose hypothesis tests for detecting dopaminergic medication response in Parkinson disease patients, using longitudinal sensor data collected by smartphones. The processed data is composed of multiple features extracted from active tapping tasks performed by the participant on a daily basis, before and after medication, over several months. Each extracted feature corresponds to a time series of measurements annotated according to whether the measurement was taken before or after the patient has taken his/her medication. Even though the data is longitudinal in nature, we show that simple hypothesis tests for detecting medication response, which ignore the serial correlation structure of the data, are still statistically valid, showing type I error rates at the nominal level. We propose two distinct personalized testing approaches. In the first, we combine multiple feature-specific tests into a single union-intersection test. In the second, we construct personalized classifiers of the before/after medication labels using all the extracted features of a given participant, and test the null hypothesis that the area under the receiver operating characteristic curve of the classifier is equal to 1/2. We compare the statistical power of the personalized classifier tests and personalized union-intersection tests in a simulation study, and illustrate the performance of the proposed tests using data from mPower Parkinsons disease study, recently launched as part of Apples ResearchKit mobile platform. Our results suggest that the personalized tests, which ignore the longitudinal aspect of the data, can perform well in real data analyses, suggesting they might be used as a sound baseline approach, to which more sophisticated methods can be compared to.
Subject(s)
Drug Monitoring/methods , Parkinson Disease/drug therapy , Precision Medicine/methods , Remote Sensing Technology/methods , Algorithms , Cell Phone , Computational Biology/methods , Computer Simulation , Data Interpretation, Statistical , Dopamine Agents/therapeutic use , Drug Monitoring/statistics & numerical data , Humans , Models, Statistical , Precision Medicine/statistics & numerical data , Remote Sensing Technology/statistics & numerical dataABSTRACT
PURPOSE: To conduct a nationwide survey to evaluate the current status of resident mentorship in radiation oncology. METHODS AND MATERIALS: An anonymous electronic questionnaire was sent to all residents and recent graduates at US Accreditation Council for Graduate Medical Education-accredited radiation oncology residency programs, identified in the member directory of the Association of Residents in Radiation Oncology. Factors predictive of having a mentor and satisfaction with the mentorship experience were identified using univariate and multivariate analyses. RESULTS: The survey response rate was 25%, with 85% of respondents reporting that mentorship plays a critical role in residency training, whereas only 53% had a current mentor. Larger programs (≥ 10 faculty, P=.004; and ≥ 10 residents, P<.001) were more likely to offer a formal mentorship program, which makes it more likely for residents to have an active mentor (88% vs 44%). Residents in a formal mentoring program reported being more satisfied with the overall mentorship experience (univariate odds ratio 8.77, P<.001; multivariate odds ratio 5, P<.001). On multivariate analysis, women were less likely to be satisfied with the mentorship experience. CONCLUSIONS: This is the first survey focusing on the status of residency mentorship in radiation oncology. Our survey highlights the unmet need for mentorship in residency programs.
Subject(s)
Internship and Residency/statistics & numerical data , Mentors/statistics & numerical data , Radiation Oncology/statistics & numerical data , Adult , Analysis of Variance , Female , Humans , Interprofessional Relations , Male , Personal Satisfaction , Sex Factors , Surveys and Questionnaires , United StatesABSTRACT
In many cancers, intratumoral heterogeneity has been found in histology, genetic variation and vascular structure. We developed an algorithm to interrogate different scales of heterogeneity using clinical imaging. We hypothesize that heterogeneity of perfusion at coarse scale may correlate with treatment resistance and propensity for disease recurrence. The algorithm recursively segments the tumor image into increasingly smaller regions. Each dividing line is chosen so as to maximize signal intensity difference between the two regions. This process continues until the tumor has been divided into single voxels, resulting in segments at multiple scales. For each scale, heterogeneity is measured by comparing each segmented region to the adjacent region and calculating the difference in signal intensity histograms. Using digital phantom images, we showed that the algorithm is robust to image artifacts and various tumor shapes. We then measured the primary tumor scales of contrast enhancement heterogeneity in MRI of 18 rhabdomyosarcoma patients. Using Cox proportional hazards regression, we explored the influence of heterogeneity parameters on relapse-free survival. Coarser scale of maximum signal intensity heterogeneity was prognostic of shorter survival (p = 0.05). By contrast, two fractal parameters and three Haralick texture features were not prognostic. In summary, our algorithm produces a biologically motivated segmentation of tumor regions and reports the amount of heterogeneity at various distance scales. If validated on a larger dataset, this prognostic imaging biomarker could be useful to identify patients at higher risk for recurrence and candidates for alternative treatment.
Subject(s)
Algorithms , Head and Neck Neoplasms/diagnosis , Image Enhancement/methods , Magnetic Resonance Imaging/methods , Rhabdomyosarcoma/diagnosis , Adolescent , Adult , Child , Child, Preschool , Humans , Infant , MaleABSTRACT
Glioblastoma multiforme (GBM) is a highly invasive primary brain tumour that has poor prognosis despite aggressive treatment. A hallmark of these tumours is diffuse invasion into the surrounding brain, necessitating a multi-modal treatment approach, including surgery, radiation and chemotherapy. We have previously demonstrated the ability of our model to predict radiographic response immediately following radiation therapy in individual GBM patients using a simplified geometry of the brain and theoretical radiation dose. Using only two pre-treatment magnetic resonance imaging scans, we calculate net rates of proliferation and invasion as well as radiation sensitivity for a patient's disease. Here, we present the application of our clinically targeted modelling approach to a single glioblastoma patient as a demonstration of our method. We apply our model in the full three-dimensional architecture of the brain to quantify the effects of regional resistance to radiation owing to hypoxia in vivo determined by [(18)F]-fluoromisonidazole positron emission tomography (FMISO-PET) and the patient-specific three-dimensional radiation treatment plan. Incorporation of hypoxia into our model with FMISO-PET increases the model-data agreement by an order of magnitude. This improvement was robust to our definition of hypoxia or the degree of radiation resistance quantified with the FMISO-PET image and our computational model, respectively. This work demonstrates a useful application of patient-specific modelling in personalized medicine and how mathematical modelling has the potential to unify multi-modality imaging and radiation treatment planning.
Subject(s)
Brain Neoplasms , Glioma , Hypoxia , Misonidazole/analogs & derivatives , Models, Biological , Positron-Emission Tomography , Radiation-Sensitizing Agents/administration & dosage , Aged , Brain Neoplasms/blood supply , Brain Neoplasms/diagnostic imaging , Brain Neoplasms/radiotherapy , Glioma/blood supply , Glioma/diagnostic imaging , Glioma/radiotherapy , Humans , Hypoxia/diagnostic imaging , Hypoxia/radiotherapy , Male , Misonidazole/administration & dosage , Precision Medicine , RadiographyABSTRACT
BACKGROUND: Periostin is a secreted matricellular protein critical for epithelial-mesenchymal transition and carcinoma metastasis. In glioblastoma, it is highly upregulated compared with normal brain, and existing reports indicate potential prognostic and functional importance in glioma. However, the clinical implications of periostin expression and function related to its therapeutic potential have not been fully explored. METHODS: Periostin expression levels and patterns were examined in human glioma cells and tissues by quantitative real-time PCR and immunohistochemistry and correlated with glioma grade, type, recurrence, and survival. Functional assays determined the impact of altering periostin expression and function on cell invasion, migration, adhesion, and glioma stem cell activity and tumorigenicity. The prognostic and functional relevance of periostin and its associated genes were analyzed using the TCGA and REMBRANDT databases and paired recurrent glioma samples. RESULTS: Periostin expression levels correlated directly with tumor grade and recurrence, and inversely with survival, in all grades of adult human glioma. Stromal deposition of periostin was detected only in grade IV gliomas. Secreted periostin promoted glioma cell invasion and adhesion, and periostin knockdown markedly impaired survival of xenografted glioma stem cells. Interactions with αvß3 and αvß5 integrins promoted adhesion and migration, and periostin abrogated cytotoxicity of the αvß3/ß5 specific inhibitor cilengitide. Periostin-associated gene signatures, predominated by matrix and secreted proteins, corresponded to patient prognosis and functional motifs related to increased malignancy. CONCLUSION: Periostin is a robust marker of glioma malignancy and potential tumor recurrence. Abrogation of glioma stem cell tumorigenicity after periostin inhibition provides support for exploring the therapeutic impact of targeting periostin.
Subject(s)
Biomarkers, Tumor/metabolism , Brain Neoplasms/metabolism , Cell Adhesion Molecules/metabolism , Glioma/metabolism , Brain Neoplasms/mortality , Brain Neoplasms/pathology , Brain Neoplasms/prevention & control , Cell Adhesion , Cell Adhesion Molecules/antagonists & inhibitors , Cell Line, Tumor , Glioma/mortality , Glioma/pathology , Glioma/prevention & control , Humans , Integrins/metabolism , Kaplan-Meier Estimate , Neoplasm Grading , Neoplasm Invasiveness , Up-RegulationABSTRACT
OBJECT: Malignant gliomas are incurable, primary brain neoplasms noted for their potential to extensively invade brain parenchyma. Current methods of clinical imaging do not elucidate the full extent of brain invasion, making it difficult to predict which, if any, patients are likely to benefit from gross total resection. Our goal was to apply a mathematical modeling approach to estimate the overall tumor invasiveness on a patient-by-patient basis and determine whether gross total resection would improve survival in patients with relatively less invasive gliomas. METHODS: In 243 patients presenting with contrast-enhancing gliomas, estimates of the relative invasiveness of each patient's tumor, in terms of the ratio of net proliferation rate of the glioma cells to their net dispersal rate, were derived by applying a patient-specific mathematical model to routine pretreatment MR imaging. The effect of varying degrees of extent of resection on overall survival was assessed for cohorts of patients grouped by tumor invasiveness. RESULTS: We demonstrate that patients with more diffuse tumors showed no survival benefit (Pâ=â0.532) from gross total resection over subtotal/biopsy, while those with nodular (less diffuse) tumors showed a significant benefit (Pâ=â0.00142) with a striking median survival benefit of over eight months compared to sub-totally resected tumors in the same cohort (an 80% improvement in survival time for GTR only seen for nodular tumors). CONCLUSIONS: These results suggest that our patient-specific, model-based estimates of tumor invasiveness have clinical utility in surgical decision making. Quantification of relative invasiveness assessed from routinely obtained pre-operative imaging provides a practical predictor of the benefit of gross total resection.
Subject(s)
Brain Neoplasms/pathology , Glioblastoma/pathology , Glioma/pathology , Adult , Aged , Biopsy , Brain/pathology , Brain Neoplasms/diagnosis , Cell Proliferation , Cohort Studies , Contrast Media/chemistry , Disease Progression , Female , Glioblastoma/diagnosis , Glioma/diagnosis , Humans , Magnetic Resonance Imaging , Male , Middle Aged , Models, Theoretical , Neoplasm Invasiveness , PrognosisABSTRACT
BACKGROUND: Glioblastomas with a specific mutation in the isocitrate dehydrogenase 1 (IDH1) gene have a better prognosis than gliomas with wild-type IDH1. METHODS: Here we compare the IDH1 mutational status in 172 contrast-enhancing glioma patients with the invasion profile generated by a patient-specific mathematical model we developed based on MR imaging. RESULTS: We show that IDH1-mutated contrast-enhancing gliomas were relatively more invasive than wild-type IDH1 for all 172 contrast-enhancing gliomas as well as the subset of 158 histologically confirmed glioblastomas. The appearance of this relatively increased, model-predicted invasive profile appears to be determined more by a lower model-predicted net proliferation rate rather than an increased model-predicted dispersal rate of the glioma cells. Receiver operator curve analysis of the model-predicted MRI-based invasion profile revealed an area under the curve of 0.91, indicative of a predictive relationship. The robustness of this relationship was tested by cross-validation analysis of the invasion profile as a predictive metric for IDH1 status. CONCLUSIONS: The strong correlation between IDH1 mutation status and the MRI-based invasion profile suggests that use of our tumor growth model may lead to noninvasive clinical detection of IDH1 mutation status and thus lead to better treatment planning, particularly prior to surgical resection, for contrast-enhancing gliomas.
Subject(s)
Brain Neoplasms/genetics , Brain Neoplasms/pathology , Glioblastoma/genetics , Glioblastoma/pathology , Isocitrate Dehydrogenase/genetics , Humans , Kinetics , Mutation , Neoplasm InvasivenessABSTRACT
OBJECTIVES: The objective of this study was to identify predictive factors of occult mediastinal nodal involvement on staging positron emission tomography with F-fluorodeoxyglucose in patients with non-small cell lung cancer. METHODS: We performed a retrospective review of 665 patients with suspected non-small cell lung cancer who underwent staging positron emission tomography with F-fluorodeoxyglucose from January 1, 2000 through August 31, 2010 at the Hospital of the University of Pennsylvania with clinical stage I or II disease and no evidence of N2 or N3 involvement on staging positron emission tomography (PET). A total of 201 of these patients underwent invasive pathologic staging of the mediastinum at the Hospital of the University of Pennsylvania with pathology reports available at the time of review. RESULTS: A total of 63 of the 201 patients were found to have N2 disease at the time of pathologic staging. The mean standardized uptake value (SUV) of the primary tumor for patients with occult N2 metastases was significantly higher than the node-negative patients (SUV 9.31 vs. 7.24, P=0.04). Histology, tumor location (central vs. peripheral), sex, and age were not predictive for occult N2 disease. A multivariate analysis was performed and identified primary tumor SUV>6 was the only significant predictor (P=0.02). An analysis by quartile identified a primary tumor SUV>10 to have an odds ratio of 1.72 compared with an SUV<4 of occult N2 involvement. CONCLUSIONS: Increased primary tumor SUV predicted for increased risk of mediastinal nodal disease. Tumor location was not predictive of PET-occult mediastinal nodal involvement, in contrast to previous publications. Pathologic staging of the mediastinum should be strongly considered in these patients even with a negative mediastinum on PET.
Subject(s)
Carcinoma, Non-Small-Cell Lung/diagnostic imaging , Carcinoma, Non-Small-Cell Lung/pathology , Fluorodeoxyglucose F18/pharmacokinetics , Lung Neoplasms/pathology , Lymph Nodes/diagnostic imaging , Lymph Nodes/pathology , Mediastinum/pathology , Adult , Aged , Aged, 80 and over , Carcinoma, Non-Small-Cell Lung/mortality , Female , Humans , Kaplan-Meier Estimate , Lung Neoplasms/diagnostic imaging , Lung Neoplasms/mortality , Male , Mediastinum/diagnostic imaging , Middle Aged , Multivariate Analysis , Positron-Emission Tomography , Predictive Value of Tests , Prognosis , Radiopharmaceuticals , Retrospective StudiesABSTRACT
PURPOSE: To demonstrate a method of generating patient-specific, biologically-guided radiotherapy dose plans and compare them to the standard-of-care protocol. METHODS AND MATERIALS: We integrated a patient-specific biomathematical model of glioma proliferation, invasion and radiotherapy with a multiobjective evolutionary algorithm for intensity-modulated radiation therapy optimization to construct individualized, biologically-guided plans for 11 glioblastoma patients. Patient-individualized, spherically-symmetric simulations of the standard-of-care and optimized plans were compared in terms of several biological metrics. RESULTS: The integrated model generated spatially non-uniform doses that, when compared to the standard-of-care protocol, resulted in a 67% to 93% decrease in equivalent uniform dose to normal tissue, while the therapeutic ratio, the ratio of tumor equivalent uniform dose to that of normal tissue, increased between 50% to 265%. Applying a novel metric of treatment response (Days Gained) to the patient-individualized simulation results predicted that the optimized plans would have a significant impact on delaying tumor progression, with increases from 21% to 105% for 9 of 11 patients. CONCLUSIONS: Patient-individualized simulations using the combination of a biomathematical model with an optimization algorithm for radiation therapy generated biologically-guided doses that decreased normal tissue EUD and increased therapeutic ratio with the potential to improve survival outcomes for treatment of glioblastoma.