Learning from the CO-CREATE project: A protocol for systems thinking across research (STAR).

The CO-CREATE project aimed to work with young people to create, inform, and disseminate obesity-preventive evidence-based policies using a complex systems perspective. This paper draws lessons from this experience and proposes a protocol for embedding systems thinking within a research project. We first draw on existing systems thinking frameworks to analyze how systems thinking was translated across CO-CREATE, including the flow and relationship between the work packages and in the methods used. We then take the lessons from CO-CREATE and the principles of existing systems thinking frameworks-which focus on various points of intervention planning and delivery but not on research projects as a whole-to formulate a protocol for embedding systems thinking across a research project. Key lessons for future planning and delivery of systems-oriented research projects include incorporating "boundary critique" by capturing key stakeholder (adolescent) values and concerns; working to avoid social exclusion; ensuring methodological pluralism to allow for reflection and responsiveness (with methods ranging from group model building, Photovoice, and small group engagement); getting policy recipients to shape key questions by understanding their views on the critical drivers of obesity early on in the project; and providing opportunity for intraproject reflection along the way.

Bringing Multisectoral and Multidisciplinary Stakeholders Together to Optimize Environmental Health Research.

Incorporating multisectoral and multidisciplinary stakeholder perspectives into environmental health research planning and implementation can help increase the utility of the research. It can also enhance the likelihood of stakeholders using the research to inform decisions. Health Effects Institute (HEI) Energy, a funding and research organization, undertook a multiyear research planning process to build its stakeholder network and integrate their perspectives, knowledge, and priorities into research on potential exposures and health effects associated with unconventional oil and gas development. This commentary describes that process, lessons learned, and how stakeholder involvement shaped HEI Energy's inaugural program of research and associated stakeholder engagement.

Predicting Phase 1 Lymphoma Clinical Trial Durations Using Machine Learning: An In-Depth Analysis and Broad Application Insights.

Lymphoma diagnoses in the US are substantial, with an estimated 89,380 new cases in 2023, necessitating innovative treatment approaches. Phase 1 clinical trials play a pivotal role in this context. We developed a binary predictive model to assess trial adherence to expected average durations, analyzing 1089 completed Phase 1 lymphoma trials from clinicaltrials.gov. Using machine learning, the Random Forest model demonstrated high efficacy with an accuracy of 0.7248 and an ROC-AUC of 0.7677 for lymphoma trials. The difference in the accuracy level of the Random Forest is statistically significant compared to the other alternative models, as determined by a 95% confidence interval on the testing set. Importantly, this model maintained an ROC-AUC of 0.7701 when applied to lung cancer trials, showcasing its versatility. A key insight is the correlation between higher predicted probabilities and extended trial durations, offering nuanced insights beyond binary predictions. Our research contributes to enhanced clinical research planning and potential improvements in patient outcomes in oncology.

Measuring the benefits of occupational safety and health research with economic metrics: Insights from the National Institute for Occupational Safety and Health.

Measuring the ultimate impact of research on health and economic well-being has presented challenges that have rarely been surmounted, and research on preventing occupational injuries and illnesses is no exception. Nevertheless, there is an increasing need to demonstrate the value of publicly funded research. The National Institute for Occupational Safety and Health (NIOSH) recently contracted with the RAND Corporation to conduct six in-depth case studies that aimed to quantify the benefits of key NIOSH research efforts using economic metrics. These case studies focused on silica exposure in asphalt pavement milling, firefighter cancer risks, a multi-industry matching-grant program for purchase of safety equipment, personal coal dust monitors for coal miners, re-design of ambulance patient compartments for safety, and workplace amputation surveillance. In this article, we summarize what we learned about how measurement of research benefits may be pursued. We summarize the benefit measurement methods that were used and the results of these research efforts in terms of costs saved, injuries and illnesses prevented, and the statistical value of reductions in risk of death or illness. We then distill some observations about the characteristics of research efforts that make measurement of research benefits feasible and suggest steps that could make it feasible to apply the same methods more widely. We also outline key NIOSH activities that appear not to be amenable to benefit measurement but suggest potentials for progress toward at least partial or qualitative benefit assessment. Finally, we discuss implications of the benefit measurement case studies for strategic research planning.

Advance Research Directives: Legal and Ethical Issues and Insights from a National Survey of Dementia Researchers in Australia.

Advance research directives (ARDs) are a means by which people can document their wishes about research participation in the event of future incapacity. ARDs have been endorsed in some ethics guidelines and position statements, however, formal legal recognition is limited. A few empirical studies have investigated the views of researchers and other stakeholders on ARDs and tested strategies to implement such directives. To further knowledge in this area, we undertook a survey of dementia researchers in Australia (n= 63) to examine their views on ARDs. Most of the survey respondents (>80%) thought ARDs would promote autonomy in decision-making and enable opportunities for people with cognitive impairment to be included in research. Respondents indicated concern about directives not being available when needed (71%) and that ethics committees would not accept ARDs (60%). Few respondents had used ARDs, but a majority (from 57-80%) would be willing to offer ARDs for a range of research activities, such as observing behaviour and taking measures, blood samples or scans. Nearly all respondents (92%) agreed that current dissent should override prior wishes stated in an ARD. The survey findings are contextualised with attention to ethics guidelines, laws and practices to support advance research planning.

From Competition to Collaboration: How a Multi-Firm Research Coalition Is Realizing Rigorous Facility Evaluation at Parkland Hospital.

This case study presents the process of developing a multi-entity Research Coalition to evaluate the new Parkland Hospital. The field of evidence-based design has made progress in systematically investigating relationships between healthcare facility design and a range of human outcomes. Yet healthcare facility evaluation is not typically included in the scope of building contracts. Lack of clear responsibility for evaluation and limited funding have been long-term barriers that the industry has yet to overcome. Firms engaged in design research at Parkland Hospital agreed with hospital representatives to collaborate on an integrated facility evaluation. Each participating entity contributed resources toward the effort. To formalize shared goals and priorities, the group developed a Research Coalition Charter. Goals included streamlining evaluation efforts to minimize burden on the hospital, leveraging multiple expertise areas to vet research aims and approaches, contributing knowledge to inform healthcare design, and innovating a model for multi-firm collaboration. The Coalition also developed guidelines for sharing data and disseminating research findings. To date, the Research Coalition has achieved key milestones including institutional review board exemption, data use and research collaboration agreements, and data collection. The research aims encompass patient and staff outcomes hypothesized to improve in the new facility. Both primary and secondary data are being analyzed to test the hypotheses. Publications of findings are forthcoming. Collaborative research among competitors may be a viable approach to realizing evaluation that is critical to learning for healthcare facility decision makers and design practitioners.

The emergence of team science: Understanding the state of adoption research through social network analysis.

The notion of team science has recently gained popularity in European and American health sciences considering increasing evidence that scientific collaboration produces higher-impact research and that complex scientific problems are better investigated by interdisciplinary teams. While publication metrics indicate adoption research is expanding, the comprehensive structure of adoption studies as a scientific field has not been formally evaluated for collaborative and cross-disciplinary activity. This article aims to elucidate the structure, composition, and dynamics of scientific relationships within adoption research that may inform research and practice strategies, competencies, and cohesion within the field. Using social network analysis, we extracted bibliographic data on 2767 peer-reviewed adoption-related articles from 1930s to 2014 and evaluated the resulting co-authorship and co-citation networks. We found that adoption research has grown substantially over the last 25 years, and is conducted in varied disciplines, with increasing collaboration across geography and disciplinary areas. The co-authorship and co-citation networks are approaching numeric thresholds and structural configurations distinctive of well-established and more institutionalized fields of study. These findings reveal the maturation of adoption studies as a team science and argue for the development of institutional mechanisms that support such evolution. Implications for professional and research planning are discussed.

Literature search for research planning and identification of research problem.

Literature search is a key step in performing good authentic research. It helps in formulating a research question and planning the study. The available published data are enormous; therefore, choosing the appropriate articles relevant to your study in question is an art. It can be time-consuming, tiring and can lead to disinterest or even abandonment of search in between if not carried out in a step-wise manner. Various databases are available for performing literature search. This article primarily stresses on how to formulate a research question, the various types and sources for literature search, which will help make your search specific and time-saving.

Applying comprehensive environmental assessment to research planning for multiwalled carbon nanotubes: Refinements to inform future stakeholder engagement.

Risk assessments and risk management efforts to protect human health and the environment can benefit from early, coordinated research planning by researchers, risk assessors, and risk managers. However, approaches for engaging these and other stakeholders in research planning have not received much attention in the environmental scientific literature. The Comprehensive Environmental Assessment (CEA) approach under development by the United States Environmental Protection Agency (USEPA) is a means to manage complex information and input from diverse stakeholder perspectives on research planning that will ultimately support environmental and human health decision making. The objectives of this article are to 1) describe the outcomes of applying lessons learned from previous CEA applications to planning research on engineered nanomaterial, multiwalled carbon nanotubes (MWCNTs) and 2) discuss new insights and refinements for future efforts to engage stakeholders in research planning for risk assessment and risk management of environmental issues. Although framed in terms of MWCNTs, this discussion is intended to enhance research planning to support assessments for other environmental issues as well. Key insights for research planning include the potential benefits of 1) ensuring that participants have research, risk assessment, and risk management expertise in addition to diverse disciplinary backgrounds; 2) including an early scoping step before rounds of formal ratings; 3) using a familiar numeric scale (e.g., US dollars) versus ordinal rating scales of "importance"; 4) applying virtual communication tools to supplement face-to-face interaction between participants; and 5) refining criteria to guide development of specific, actionable research questions.

Review of existing terrestrial bioaccumulation models and terrestrial bioaccumulation modeling needs for organic chemicals.

Protocols for terrestrial bioaccumulation assessments are far less-developed than for aquatic systems. This article reviews modeling approaches that can be used to assess the terrestrial bioaccumulation potential of commercial organic chemicals. Models exist for plant, invertebrate, mammal, and avian species and for entire terrestrial food webs, including some that consider spatial factors. Limitations and gaps in terrestrial bioaccumulation modeling include the lack of QSARs for biotransformation and dietary assimilation efficiencies for terrestrial species; the lack of models and QSARs for important terrestrial species such as insects, amphibians and reptiles; the lack of standardized testing protocols for plants with limited development of plant models; and the limited chemical domain of existing bioaccumulation models and QSARs (e.g., primarily applicable to nonionic organic chemicals). There is an urgent need for high-quality field data sets for validating models and assessing their performance. There is a need to improve coordination among laboratory, field, and modeling efforts on bioaccumulative substances in order to improve the state of the science for challenging substances.

Sparking connections: toward better linkages between research and human health policy-an example with multiwalled carbon nanotubes.

Risk assessment and subsequent risk management of environmental contaminants can benefit from early collaboration among researchers, risk assessors, and risk managers. The benefits of collaboration in research planning are particularly evident in light of (1) increasing calls to expand upon the risk assessment paradigm to include a greater focus on problem formulation and consideration of potential tradeoffs between risk management options, and (2) decreasing research budgets. Strategically connecting research planning to future decision making may be most critical in areas of emerging science for which data are often insufficient to clearly direct targeted research to support future risk assessment and management efforts. This article illustrates an application of the comprehensive environmental assessment approach to inform research planning for future risk assessment and management of one emerging material, multiwalled carbon nanotubes (MWCNTs). High-priority research areas identified for MWCNTs in flame-retardant coatings applied to upholstery textiles included the following: release across the product life cycle; environmental transport, transformation and fate in air, wastewater and sediment; exposure in human occupational and consumer groups; kinetics in the human body; impacts on human health and aquatic populations; and impacts on economic, social, and environmental resources. This article focuses on specific research questions related to human health and how these may connect to future risk assessments and risk management efforts. Such connections will support more effective collaborations across the scientific community and may inform the prioritization of research funding opportunities for emerging materials like MWCNTs.

Transparent stakeholder engagement in practice: Lessons learned from applying comprehensive environmental assessment to research planning for nanomaterials.

As efforts to develop new applications of engineered nanoscale materials (ENMs) continue to grow, so too has interest in the environmental, health, and safety (EHS) implications of these materials. However, thorough evaluation and interpretation of such implications could require substantial resources (e.g., estimated as >$120 million per year in federal funding 2013-2017). A structured, strategic approach for transparently planning research would support improved linkages between ENM research and risk assessments, and thereby enhance the utility of financial and other resources for EHS studies of ENMs. For this reason, we applied Comprehensive Environmental Assessment (CEA) as an approach to provide transparent input into research planning for 2 types of ENMs: nanoscale titanium dioxide and nanoscale silver. For each of these CEA applications, we employed a collective judgment method known as Nominal Group Technique (NGT) in 2 workshops sponsored by the US Environmental Protection Agency (USEPA). The objective of this paper is to present the outcomes of these CEA applications in the context of how our methodology can inform future efforts to identify collective goals in science (e.g., research priorities) through structured decision support approaches. Outcomes include clear lists of research priorities for each ENM developed through transparently engaging stakeholders having diverse technical and sector perspectives. In addition, we identified several procedural aspects that could be refined, including emphasizing breakout group interactions, identifying broad information priorities before more detailed research questions, and using rating rather than ranking prioritization methods. Beyond the research directions identified for specific ENMs, lessons learned about engaging stakeholders in research planning are expected to inform future research planning efforts for ENMs and other emerging materials across the scientific community.

A web-based tool to engage stakeholders in informing research planning for future decisions on emerging materials.

Prioritizing and assessing risks associated with chemicals, industrial materials, or emerging technologies is a complex problem that benefits from the involvement of multiple stakeholder groups. For example, in the case of engineered nanomaterials (ENMs), scientific uncertainties exist that hamper environmental, health, and safety (EHS) assessments. Therefore, alternative approaches to standard EHS assessment methods have gained increased attention. The objective of this paper is to describe the application of a web-based, interactive decision support tool developed by the U.S. Environmental Protection Agency (U.S. EPA) in a pilot study on ENMs. The piloted tool implements U.S. EPA's comprehensive environmental assessment (CEA) approach to prioritize research gaps. When pursued, such research priorities can result in data that subsequently improve the scientific robustness of risk assessments and inform future risk management decisions. Pilot results suggest that the tool was useful in facilitating multi-stakeholder prioritization of research gaps. Results also provide potential improvements for subsequent applications. The outcomes of future CEAWeb applications with larger stakeholder groups may inform the development of funding opportunities for emerging materials across the scientific community (e.g., National Science Foundation Science to Achieve Results [STAR] grants, National Institutes of Health Requests for Proposals).

Planning for a research future: a commentary.

This paper outlines the urgent need for implementing a strategy for clinical chiropractic research to improve patient care and perhaps support the active promotion of chiropractic in the community. It addresses the cost of scientific research, and the need to develop a scientific chiropractic community which can address the diverse needs of the chiropractic profession and maintain parity with professions in similar fields.