The scalable precision medicine open knowledge engine (SPOKE): a massive knowledge graph of biomedical information.

MOTIVATION: Knowledge graphs (KGs) are being adopted in industry, commerce and academia. Biomedical KG presents a challenge due to the complexity, size and heterogeneity of the underlying information. RESULTS: In this work, we present the Scalable Precision Medicine Open Knowledge Engine (SPOKE), a biomedical KG connecting millions of concepts via semantically meaningful relationships. SPOKE contains 27 million nodes of 21 different types and 53 million edges of 55 types downloaded from 41 databases. The graph is built on the framework of 11 ontologies that maintain its structure, enable mappings and facilitate navigation. SPOKE is built weekly by python scripts which download each resource, check for integrity and completeness, and then create a 'parent table' of nodes and edges. Graph queries are translated by a REST API and users can submit searches directly via an API or a graphical user interface. Conclusions/Significance: SPOKE enables the integration of seemingly disparate information to support precision medicine efforts. AVAILABILITY AND IMPLEMENTATION: The SPOKE neighborhood explorer is available at https://spoke.rbvi.ucsf.edu. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Interpersonal Abortion Conversations: Communication Characteristics Post-Roe.

Abortion is a politicized and stigmatized health procedure that has received considerable attention in popular discourse in the past year. The present study investigated how often people (N = 235) talk about abortion throughout their lifespan and within the past 12 months, with whom they have these conversations, and which conversations were most memorable. Key findings from the present study, framed through the Theory of Memorable Messages and the Social Ecological Model, include that most participants had at least one conversation about abortion in the past 12 months. Within the past 12 months, the most common conversation partners for abortion-related communication were friends, followed by mothers and romantic partners. Over the lifespan, but prior to the past 12 months, a majority of participants had at least one conversation about abortion. Similarly, friends were the most frequent source of abortion-related communication over the lifespan, followed by mothers and romantic partners. Many of the conversations within the past 12 months focused heavily on the overturn of Roe v. Wade or navigating a post-Roe world with a body that could become pregnant, or as someone who cared about people who could become pregnant. Prior to the past 12 months, participants characterized abortion communication as tense, religious, pro-choice, descriptive of the women who might have abortions, relating to specific abortion disclosures, or political. Within the past 12 months, memorable conversations about abortion were personal or relational, and were often prompted by discussions surrounding Roe.

Predictive factors of long-term follow-up attendance in very long-term childhood cancer survivors.

BACKGROUND: Long-term follow-up (LTFU) clinics have been developed but only some childhood cancer survivors (CCS) attend long-term follow-up (LTFU). OBJECTIVE: To identify factors that influence LTFU attendance. METHODS: Five-year CCS treated for a solid tumor or lymphoma in Gustave Roussy before 2000, included in the FCCSS cohort (French Childhood Cancer Survivor Study), aged >18 years and alive at the date of the LTFU Clinic opening (January 2012) were invited to a LTFU visit. Factors associated with attendance at the LTFU clinic between 2012 and 2020 were estimated using logistic regression analyses. Analyses included different types of factors: clinical (tumor characteristics, cancer treatments, late effects), medical (medical expenses were used as a proxy of survivor's health status), social (deprivation index based on census-tract data relating to income, educational level, proportion of blue-collar workers, and unemployed people living in the area of residence), and spatial (distance to the LTFU clinic). RESULTS: Among 2341 CCS contacted (55% males, mean age at study, 45 years; SD ± 10 years; mean age at diagnosis, 6 years; SD ± 5 years), 779 (33%) attended at least one LTFU visit. Initial cancer-related factors associated with LTFU visit attendance were: treatment with both radiotherapy and chemotherapy (odds ratio [OR], 4.02; 95% CI, 2.11-7.70), bone sarcoma (OR, 2.43; 95% CI, 1.56-3.78), central nervous system primitive tumor (OR, 1.65; 95% CI, 1.02-2.67), and autologous hematopoietic cell transplant (OR, 2.07; 95% CI, 1.34-3.20). Late effects (OR, 1.70; 95% CI, 1.31-2.20), highest medical expenses (OR, 1.65; 95% CI, 1.22-2.22), living in the most advantaged area (OR vs. the most deprived area = 1.60; 95% CI, 1.15-2.22), and shorter distance from LTFU care center (<12 miles) also increased attendance. CONCLUSIONS: Patients who are apparently healthy as well as socially disadvantaged and living far away from the center are less likely to attend LTFU care. PLAIN LANGUAGE SUMMARY: Among 2341 adult childhood cancer survivors contacted between 2012 and 2020, 33% attended at least one long-term follow-up visit. Clinical factors related to attendance were multimodal treatment of first cancer (combining chemotherapy and radiotherapy), stem cell transplant, type of diagnosis (bone tumor and central nervous system primitive tumor), late effects (at least one disease among second malignancy, heart disease, or stroke), and highest medical expenses. In addition, the study identified social and spatial inequalities related to attendance, with independent negative effects of distance and social deprivation on attendance, even though the medical costs related to the long-term follow-up examinations are covered by the French social security system.

Surveillance after childhood cancer: are survivors with an increased risk for cardiomyopathy regularly followed-up?

BACKGROUND: We aimed to study adherence to cardiac screening in long-term childhood cancer survivors (CCS) at high risk of cardiomyopathy. METHODS: This study involved 976 5-year CCS at high risk for cardiomyopathy from the French Childhood Cancer Survivor Study. Determinants of adherence to recommended surveillance were studied using multivariable logistic regression models. Association of attendance to a long-term follow-up (LTFU) visit with completion of an echocardiogram was estimated using a Cox regression model. RESULTS: Among participants, 32% had an echocardiogram within the 5 previous years. Males (adjusted RR [aRR] 0.71, 95% CI 0.58-0.86), survivors aged 36-49 (aRR 0.79, 95% CI 0.64-0.98), Neuroblastoma (aRR 0.53, 95% CI 0.30-0.91) and CNS tumour survivors (aRR 0.43, 95% CI 0.21-0.89) were less likely to adhere to recommended surveillance. Attendance to an LTFU visit was associated with completion of an echocardiogram in patients who were not previously adherent to recommendations (HR 8.20, 95% CI 5.64-11.93). CONCLUSIONS: The majority of long-term survivors at high risk of cardiomyopathy did not adhere to the recommended surveillance. Attendance to an LTFU visit greatly enhanced the completion of echocardiograms, but further interventions need to be developed to reach more survivors.

Proteomic Portraits Reveal Evolutionarily Conserved and Divergent Responses to Spinal Cord Injury.

Despite the emergence of promising therapeutic approaches in preclinical studies, the failure of large-scale clinical trials leaves clinicians without effective treatments for acute spinal cord injury (SCI). These trials are hindered by their reliance on detailed neurological examinations to establish outcomes, which inflate the time and resources required for completion. Moreover, therapeutic development takes place in animal models whose relevance to human injury remains unclear. Here, we address these challenges through targeted proteomic analyses of cerebrospinal fluid and serum samples from 111 patients with acute SCI and, in parallel, a large animal (porcine) model of SCI. We develop protein biomarkers of injury severity and recovery, including a prognostic model of neurological improvement at 6 months with an area under the receiver operating characteristic curve of 0.91, and validate these in an independent cohort. Through cross-species proteomic analyses, we dissect evolutionarily conserved and divergent aspects of the SCI response and establish the cerebrospinal fluid abundance of glial fibrillary acidic protein as a biochemical outcome measure in both humans and pigs. Our work opens up new avenues to catalyze translation by facilitating the evaluation of novel SCI therapies, while also providing a resource from which to direct future preclinical efforts.

Extending the Roots of Memorable Messages: A Comprehensive Review and Forecast of Memorable Message Literature and Theory.

Five years ago, we reviewed the state of memorable message scholarship in communication, with special attention to the utility of memorable message research in health communication. Since then, works advancing the theoretical and practical applicability of the construct have continued to emerge. In this article, we discuss the trends in published memorable message research over the last five years. Since 2017, thirty-four additional peer-reviewed articles focusing on memorable messages as a central concept have been published. Health communication as a subset of the field (as well as the journal Health Communication) see a higher concentration of these publications than other areas. In this review, we concentrate on the use of theory within recent memorable message work. Although much of the memorable message research continues to be atheoretical, more work utilizing control theory, the theory of memorable messages, and communicated narrative sense-making characterize the recent literature. Additionally, more research has emerged that highlights the theoretically driven investigations about the nature of memorable messages. We review the scholarship utilizing these and other theories and suggest avenues for future research.

"Wish I Would Have Known that before I Started Using It": Contraceptive Messages and Information Seeking among Young Women.

In recent decades, women's use of contraception has evolved. Women not only utilize contraceptives to prevent pregnancy, but also to manage menstruation and other factors related to their personal agency. Despite an abundance of available contraceptive options, many women struggle to navigate and address their contraceptive needs. A hundred and thirty-four female participants responded to an open-ended questionnaire about contraceptive messages and decision making in an online survey. Using Uncertainty Management Theory as a framework, we illustrate how the women make sense of and manage uncertainty from multiple contraceptive messages. Results highlighted the absence of desired information, and identified messages that women wish they had received from healthcare providers and others. Our findings suggest that women's understanding of contraceptives' side effects is a communicative process in which anecdotal evidence is often treated as medical fact and healthcare providers are viewed as ineffective and dismissive in relaying and addressing information about contraception. In the absence of satisfying healthcare interactions, women seek information elsewhere to make their contraceptive choices.

A Preliminary Investigation into Intersections of Sexual Communication in Bondage, Domination, Sadomasochism and Disability.

Extending prior research on the communicative intersections of bondage, domination, and sadomasochism (BDSM) and disability communities, the present article presents preliminary findings on sexual and boundary-setting communication overlaps in relational minority groups and partnerships with disabilities. Both disability and BDSM communities engage in preparatory, open, and boundary-setting sexual communication that prioritizes shifting physical, emotional, and relational needs. Highlighting reflections from partnerships navigating chronic illness, pain, and neurodivergence, our findings extend previous recommendations for boundary-setting to focus on relationships with disability, identifying intersections as including (1) reflecting upon needs and boundaries amidst shifting symptomatology, (2) (re)write sexual and intimate scripts to prioritize (dis)ability, (3) (re)negotiate relational needs and set expectations, and (4) bring awareness to the role of mental health and medication. Findings focus on implications for disability and sexual communication, the disruption of traditional sexual scripts, and therapeutic and clinical application. Limitations and future research are discussed.

Whose mental health declines during economic downturns?

Prior research shows that economic downturns are associated with increases in mental illness. However, we know little about whose mental health is most negatively affected. Is it the young or old, men or women, employed or non-employed, rich or poor? Using an 18-year panel dataset of Australians, we contribute to this understanding by estimating the impact of changes in unemployment on mental health, separately by population subgroups. Our mental health measure captures psychological distress and emotional difficulties, which are often missed by infrequent event indicators such as suicides. We find that young women suffer most during economic downturns. Men and women of older ages are not significantly affected. The effects for young women are driven by those in insecure employment, and those from low socioeconomic backgrounds. Our results suggest that public health programs should emphasize the mental health of young women during economic downturns.

Risk perceptions and health care use in the era of the COVID-19 pandemic in adults treated for childhood cancer.

PURPOSE: During the COVID-19 pandemic, childhood cancer survivors (CCS) may have felt more at risk of having severe consequences of COVID-19 and therefore may have been more likely to defer their health care use. We aimed to assess the risk perceptions of CCS related to COVID-19 (perceived infection risk, perceived risk of experiencing a severe illness in the event of infection), and their forgoing of health care during the year 2020. METHODS: In December 2020, we interviewed through an online self-report questionnaire 580 5-year CCS participating in the French Childhood Cancer Survivor Study (FCCSS) cohort. Combining clinical and patient-reported outcomes, we studied predictors of perceived risks related to COVID-19 and forgoing health care. RESULTS: Overall, 60% of respondents stated that COVID-19 could have severe consequences for their health if infected. Survivors with a cardiovascular disease and those who felt more at risk of being infected were more likely to think that COVID-19 could have severe health consequences for them. Moreover, 30% of respondents seeking care declared they had forgone at least one medical appointment in 2020. Forgoing medical appointments was more common among CCS who reported a deterioration in their financial situation in 2020 and those who felt more at risk of being infected. CONCLUSIONS: This study shows that a considerable proportion of survivors had forgone medical appointments because of the pandemic; forgoing care was more frequent among the most socioeconomically disadvantaged survivors. IMPLICATIONS FOR CANCER SURVIVORS: This study presents data hitherto absent in the literature and suggests the need to develop telehealth to ensure appropriate long-term follow-up of CCS.

Emergent Health Communication Scholarship from and about African American, Latino/a/x, and American Indian/Alaskan Native Peoples.

It is a privilege and honor to welcome you to this special issue of Health Communication which is based on scholarship that advances various divergent health issues pertinent to African American, Latino/a/x, and American Indian/Alaskan Native (AI/AN) peoples. The vision for this special issue which is a microcosm of the impactful research literature emerging from our field by Black, Latino/a/x, and American Indian peoples was to call attention to and acknowledge the breath of theoretically grounded and methodologically appropriate research in health communication. The 16 original articles featured in this issue reflect a robust compilation of topics from medical mistrust to tribal and elder leaders as health communicators and health promoters. The vision for the issue is that these articles serve as a platform that starts a meaningful and needed dialog within the field of health communication about the need for accessible and diverse scholarship from often-absent voices and/or narratives.

A biomedical open knowledge network harnesses the power of AI to understand deep human biology.

Knowledge representation and reasoning (KR&R) has been successfully implemented in many fields to enable computers to solve complex problems with AI methods. However, its application to biomedicine has been lagging in part due to the daunting complexity of molecular and cellular pathways that govern human physiology and pathology. In this article we describe concrete uses of SPOKE, an open knowledge network that connects curated information from 37 specialized and human-curated databases into a single property graph, with 3 million nodes and 15 million edges to date. Applications discussed in this article include drug discovery, COVID-19 research and chronic disease diagnosis and management.

"It Strengthened My Core Relationships, and Filtered Out the Rest:" Intimacy Communication During COVID-19.

Informed by scripting theories and Relational Dialectics Theory, this qualitative study used interviews, focus groups, and friendship pods conducted during the summer of 2020 in the COVID-19 pandemic to explore how 29 cisgender women and gender minorities made sense of, communicated about, and maintained their intimate relationships during COVID-19. Findings reveal a discourse of scripted intimacy reflecting normative relational patterns such as the heterosexual life script and the discourse of co-created intimacy, both of which legitimized and challenged the existing relational scripts by generating new ideas of what intimacy could look like in a relationship. Sub-themes included tensions of stability v. growth, comfort v. discomfort, and physical risk v. relational risk. Implications and avenues for future research are discussed.

Process and Workflow for Preparation of Disparate Mouse Tissues for Proteomic Analysis.

We investigated the effect of homogenization strategy and protein precipitation on downstream protein quantitation using multiple reaction monitoring mass spectrometry (MRM-MS). Our objective was to develop a workflow capable of processing disparate tissue types with high throughput, minimal variability, and maximum purity. Similar abundances of endogenous proteins were measured in nine different mouse tissues regardless of the homogenization method used; however, protein precipitation had strong positive effects on several targets. The best throughput was achieved by lyophilizing tissues to dryness, followed by homogenization via bead-beating without sample buffer. Finally, the effect of tissue perfusion prior to dissection and collection was explored in 20 mouse tissues. MRM-MS showed decreased abundances of blood-related proteins in perfused tissues; however, complete removal was not achieved. Concentrations of nonblood proteins were largely unchanged, although significantly higher variances were observed for proteins from the perfused lung, indicating that perfusion may not be suitable for this organ. We present a simple yet effective tissue processing workflow consisting of harvest of fresh nonperfused tissue, novel lyophilization and homogenization by bead-beating, and protein precipitation. This workflow can be applied to a range of mouse tissues with the advantages of simplicity, minimal manual manipulation of samples, use of commonly available equipment, and high sample quality.

Results of the patient report of intermittent catheterization experience (PRICE) study.

AIMS: Patient satisfaction is paramount to health-related quality of life (HR-QoL) outcomes. High quality, quantitative data from the US describing patients' actual experiences, difficulties, and HR-QoL while on an intermittent self-catheterization (ISC) regimen is very scarce. Our objective was to better understand patient practices with and attitudes towards ISC. METHODS: This is a cross-sectional, multi-centered, clinical study of adult men and women performing ISC in the United States. Data collected included demographics, medical history, catheter characteristics, specific self-catheterization habits and two validated HR-QoL questionnaires: The Intermittent Self-Catheterization Questionnaire (ISC-Q) and the Intermittent Catheterization Difficulty Questionnaire (ICDQ). RESULTS: Two hundred participants were recruited from six sites; 70.0% were male, 73.5% were Caucasian with a median age was 51.0 years (range 19-90 years). The ISC-Q showed that the vast majority of participants reported ease with ISC (82.0% satisfaction score) had confidence in their ability to perform ISC (91.9% satisfaction score); yet, many felt self-conscious about doing so (58.3% satisfaction score) and had concerns about long-term adverse effects (58.1% satisfaction score). The ICDQ indicated little to no difficulty for most participants with all routine ISC practices. A small minority of participants reported some difficulty with a "blocking sensation" during initiation of catheterization, leg spasticity, and painful catheterization. Multivariate linear regression results are also reported. DISCUSSION/CONCLUSION: Participants are confident with ISC and have little overall difficulty, which may be a product of successful education and/or catheter design. urinary tract infections (UTIs) were common (yet variable) and may contribute to the noted long-term ISC concerns. Limitations exist including various selection biases leading to concerns of external validity. Future educational interventions in this population may further improve HR-QoL, optimize UTIs prevention, and diminish concerns with long-term ISC.

Identifying clusters of health risk behaviors and their predictors in adult survivors of childhood cancer: A report from the French Childhood Cancer Survivor Study.

OBJECTIVE: Health risk behaviors (HRB) of childhood cancer survivors (CCS) are generally studied separately, despite the evidence suggesting that HRB are not independent. To our knowledge, few studies have examined HRB profiles in the former pediatric cancer patients. In this study, we identified HRB profiles and examined predictors engaging in unhealthy behaviors in CCS. METHODS: We used data from a French cohort of CCS that includes five-year survivors diagnosed between 1945 and 2000 and treated before reaching age 18, in five centers in France. A total of 2961 adult CCS answered a self-reported questionnaire pertaining to HRB. Latent class analysis was used to identify HRB profiles combining physical activity, smoking, cannabis use, and alcohol drinking. Multinomial logistic analyses examined predictors for engaging in unhealthy behaviors. RESULTS: Three HRB patterns emerged: "Low-risk" (n = 1846, 62.3%) included CCS who exhibited the highest frequency for usual physical activity and the lowest probabilities for current smoking or cannabis use, but most drank at least moderately; "Moderate-risk behaviors" (n = 291, 9.8%), and "High-risk behaviors" (n = 824, 27.8%) for CCS who exhibited the highest frequencies for current smoking, cannabis use, and heavy drinking. The multivariable regression revealed that male CCS, less educated or not married were significantly more likely to be in the high-risk behaviors group than the low-risk group. CONCLUSIONS: As CCS remain a vulnerable population, screening for HRB should be routinized in long-term follow-up care and interventions targeting multiple HRB simultaneously among survivors should be developed.

"I Thought I Was Dying:" (Un)Supportive Communication Surrounding Early Menstruation Experiences.

Menstruation is a salient, and sometimes scary, communication topic for young women. The present study reports on the early communication experiences about menstruation from 165 women using open-ended survey data. Through the framework of supportive communication, findings reveal that a discrepancy occurs between the health and practical information and needs to which young people who menstruate desire access, and their social and emotional needs. The present study indicates an inadequacy of both aspects of menstruation communication from important others in childhood and adolescence. Themes of boundary management, impersonal, silence, and accidents also characterize early communication experiences about menstruation. Our participants identified a desire for conversations that normalize menstruation as typical and acceptable, validate period pain and prescribe management tactics, and describe the existence of feminine hygiene products other than pads and tampons. Limitations and directions for future research are discussed.

Utilizing a Faculty Development Program to Promote Safer Opioid Prescribing for Chronic Pain in Internal Medicine Resident Practices.

OBJECTIVE: To implement a skills-based faculty development program (FDP) to improve Internal Medicine faculty's clinical skills and resident teaching about safe opioid prescribing. DESIGN: An FDP for Internal Medicine attendings that included a one-hour didactic presentation followed immediately by an Objective Structured Clinical Examination (OSCE) that focused on assessing and managing opioid misuse risk, opioid treatment outcomes (benefits and harms), and aberrant opioid use behaviors. The evaluation compared pre- and three-months-post-FDP changes in faculty's safe opioid prescribing knowledge, attitudes, confidence (clinical and teaching), and self-reported resident teaching. RESULTS: The 25 Internal Medicine faculty participants had a mean of 13 years in clinical practice, including 10 years precepting residents. During the three months post-FDP, faculty treated a mean of 22 patients with chronic pain on long-term opioids and precepted a mean of seven residents caring for patients on long-term opioids. At three months post-FDP, there were significant improvements in correct responses to knowledge questions (68% to 79% P = 0.008), "high-level" confidence in safer opioid prescribing clinical practice (43.5% to 82.6% P = 0.007) and resident teaching (45.8% to 83.3%, P = 0.007), and improvements in alignment of desired attitudes toward safer opioid prescribing. There were nonsignificant increases in self-reported safe opioid prescribing resident teaching. CONCLUSIONS: A skills-based faculty development program that includes a lecture followed by an OSCE can improve Internal Medicine faculty safe opioid prescribing knowledge, attitudes, and clinical and teaching confidence. Improving resident teaching may require additional training in safe opioid prescribing teaching skills.

Verification of a proteomic biomarker panel to diagnose minor stroke and transient ischaemic attack: phase 1 of SpecTRA, a large scale translational study.

OBJECTIVE: To derive a plasma biomarker protein panel from a list of 141 candidate proteins which can differentiate transient ischaemic attack (TIA)/minor stroke from non-cerebrovascular (mimic) conditions in emergency department (ED) settings. DESIGN: Prospective clinical study (#NCT03050099) with up to three timed blood draws no more than 36 h following symptom onset. Plasma samples analysed by multiple reaction monitoring-mass spectrometry (MRM-MS). PARTICIPANTS: Totally 545 participants suspected of TIA enrolled in the EDs of two urban medical centres. OUTCOMES: 90-day, neurologist-adjudicated diagnosis of TIA informed by clinical and radiological investigations. RESULTS: The final protein panel consists of 16 proteins whose patterns show differential abundance between TIA and mimic patients. Nine of the proteins were significant univariate predictors of TIA [odds ratio (95% confidence interval)]: L-selectin [0.726 (0.596-0.883)]; Insulin-like growth factor-binding protein 3 [0.727 (0.594-0.889)]; Coagulation factor X [0.740 (0.603-0.908)]; Serum paraoxonase/lactonase 3 [0.763 (0.630-0.924)]; Thrombospondin-1 [1.313 (1.081-1.595)]; Hyaluronan-binding protein 2 [0.776 (0.637-0.945)]; Heparin cofactor 2 [0.775 (0.634-0.947)]; Apolipoprotein B-100 [1.249 (1.037-1.503)]; and von Willebrand factor [1.256 (1.034-1.527)]. The scientific plausibility of the panel proteins is discussed. CONCLUSIONS: Our panel has the potential to assist ED physicians in distinguishing TIA from mimic patients.

Validation of a proteomic biomarker panel to diagnose minor-stroke and transient ischaemic attack: phase 2 of SpecTRA, a large scale translational study.

OBJECTIVE: To validate our previously developed 16 plasma-protein biomarker panel to differentiate between transient ischaemic attack (TIA) and non-cerebrovascular emergency department (ED) patients. METHOD: Two consecutive cohorts of ED patients prospectively enrolled at two urban medical centers into the second phase of SpecTRA study (training, cohort 2A, n = 575; test, cohort 2B, n = 528). Plasma samples were analyzed using liquid chromatography/multiple reaction monitoring-mass spectrometry. Logistic regression models which fit cohort 2A were validated on cohort 2B. RESULTS: Three of the panel proteins failed quality control and were removed from the panel. During validation, panel models did not outperform a simple motor/speech (M/S) deficit variable. Post-hoc analyses suggested the measured behaviour of L-selectin and coagulation factor V contributed to poor model performance. Removal of these proteins increased the external performance of a model containing the panel and the M/S variable. CONCLUSIONS: Univariate analyses suggest insulin-like growth factor-binding protein 3 and serum paraoxonase/lactonase 3 are reliable and reproducible biomarkers for TIA status. Logistic regression models indicated L-selectin, apolipoprotein B-100, coagulation factor IX, and thrombospondin-1 to be significant multivariate predictors of TIA. We discuss multivariate feature subset analyses as an exploratory technique to better understand a panel's full predictive potential.