ChatGPT as Research Scientist: Probing GPT's capabilities as a Research Librarian, Research Ethicist, Data Generator, and Data Predictor.

How good a research scientist is ChatGPT? We systematically probed the capabilities of GPT-3.5 and GPT-4 across four central components of the scientific process: as a Research Librarian, Research Ethicist, Data Generator, and Novel Data Predictor, using psychological science as a testing field. In Study 1 (Research Librarian), unlike human researchers, GPT-3.5 and GPT-4 hallucinated, authoritatively generating fictional references 36.0% and 5.4% of the time, respectively, although GPT-4 exhibited an evolving capacity to acknowledge its fictions. In Study 2 (Research Ethicist), GPT-4 (though not GPT-3.5) proved capable of detecting violations like p-hacking in fictional research protocols, correcting 88.6% of blatantly presented issues, and 72.6% of subtly presented issues. In Study 3 (Data Generator), both models consistently replicated patterns of cultural bias previously discovered in large language corpora, indicating that ChatGPT can simulate known results, an antecedent to usefulness for both data generation and skills like hypothesis generation. Contrastingly, in Study 4 (Novel Data Predictor), neither model was successful at predicting new results absent in their training data, and neither appeared to leverage substantially new information when predicting more vs. less novel outcomes. Together, these results suggest that GPT is a flawed but rapidly improving librarian, a decent research ethicist already, capable of data generation in simple domains with known characteristics but poor at predicting novel patterns of empirical data to aid future experimentation.

Biologically grounded scientific methods: The challenges ahead for combating epidemics.

The protracted COVID 19 pandemic may indicate failures of scientific methodologies. Hoping to facilitate the evaluation and/or update of methods relevant in Biomedicine, several aspects of scientific processes are here explored. First, the background is reviewed. In particular, eight topics are analyzed: (i) the history of Higher Education models in reference to the pursuit of science and the type of student cognition pursued, (ii) whether explanatory or actionable knowledge is emphasized depending on the well- or ill-defined nature of problems, (iii) the role of complexity and dynamics, (iv) how differences between Biology and other fields influence methodologies, (v) whether theory, hypotheses or data drive scientific research, (vi) whether Biology is reducible to one or a few factors, (vii) the fact that data, to become actionable knowledge, require structuring, and (viii) the need of inter-/trans-disciplinary knowledge integration. To illustrate how these topics interact, a second section describes four temporal stages of scientific methods: conceptualization, operationalization, validation and evaluation. They refer to the transition from abstract (non-measurable) concepts (such as 'health') to the selection of concrete (measurable) operations (such as 'quantification of ́anti-virus specific antibody titers'). Conceptualization is the process that selects concepts worth investigating, which continues as operationalization when data-producing variables viewed to reflect critical features of the concepts are chosen. Because the operations selected are not necessarily valid, informative, and may fail to solve problems, validations and evaluations are critical stages, which require inter/trans-disciplinary knowledge integration. It is suggested that data structuring can substantially improve scientific methodologies applicable in Biology, provided that other aspects here mentioned are also considered. The creation of independent bodies meant to evaluate biologically oriented scientific methods is recommended.

Design in biology and rational design in vaccinology: A conceptual analysis.

This review discusses the philosophical foundations of what used to be called "the scientific method" and is nowadays often known as the scientific attitude. It used to be believed that scientific theories and methods aimed at the truth especially in the case of physics, chemistry and astronomy because these sciences were able to develop numerous scientific laws that made it possible to understand and predict many physical phenomena. The situation is different in the case of the biological sciences which deal with highly complex living organisms made up of huge numbers of constituents that undergo continuous dynamic processes; this leads to novel emergent properties in organisms that cannot be predicted because they are not present in the constituents before they have interacted with each other. This is one of the reasons why there are no universal scientific laws in biology. Furthermore, all scientific theories can only achieve a restricted level of predictive success because they remain valid only under the limited range of conditions that were used for establishing the theory' in the first place. Many theories that used to be accepted were subsequently shown to be false, demonstrating that scientific theories always remain tentative and can never be proven beyond and doubt. It is ironical that as scientists have finally accepted that approximate truths are perfectly adequate and that absolute truth is an illusion, a new irrational sociological phenomenon called Post-Truth conveyed by social media, the Internet and fake news has developed in the Western world that is convincing millions of people that truth simply does not exist. Misleading information is circulated with the intention to deceive and science denialism is promoted by denying the remarkable achievements of science and technology during the last centuries. Although the concept of intentional design is widely used to describe the methods that biologists use to make discoveries and inventions, it will be argued that the term is not appropriate for explaining the appearance of life on our planet nor for describing the scientific creativity of scientific investigators. The term rational for describing the development of new vaccines is also unjustified. Because the analysis of the COVID-19 pandemic requires contributions from biomedical and psycho-socioeconomic sciences, one scientific method alone would be insufficient for combatting the pandemic.

Independent discussion sections for improving inferential reproducibility in published research.

There is a reproducibility crisis in science. There are many potential contributors to replication failure in research across the translational continuum. In this perspective piece, we focus on the narrow topic of inferential reproducibility. Although replication of methods and results is necessary to demonstrate reproducibility, it is not sufficient. Also fundamental is consistent interpretation in the Discussion section. Current deficiencies in the Discussion sections of manuscripts might limit the inferential reproducibility of scientific research. Lack of contextualisation using systematic reviews, overinterpretation and misinterpretation of results, and insufficient acknowledgement of limitations are common problems in Discussion sections; these deficiencies can harm the translational process. Proposed solutions include eliminating or not reading Discussions, writing accompanying editorials, and post-publication review and comments; however, none of these solutions works very well. A second Discussion written by an independent author with appropriate expertise in research methodology is a new testable solution that could help probe inferential reproducibility, and address some deficiencies in primary Discussion sections.

How to succeed with high quality randomised clinical trials in clinical orthodontic research.

One goal of producing relevant clinical research is to ensure that evidence-based research results are transformed into everyday clinical practice that help clinicians deliver high quality care. It also involves ensuring that the individual patient receives the most effective and least risky treatment, ultimately leading to an optimal treatment outcome both in the short and long term. Some fundamentals of evidence-based dentistry are highlighted with focus on performing orthodontic randomised controlled trials.

CAPTIVE MANAGEMENT OF WILD IMPALA ( AEPYCEROS MELAMPUS) DURING INTENSIVE IMMOBILIZATION AND GENERAL ANESTHESIA STUDY TRIALS.

Immobilization and anesthesia of impala ( Aepyceros melampus) has become a popular research theme. This demand is brought about by the increased need to immobilize and anesthetize impala and other medium-sized wild ungulates because of their increased value in game ranching and zoological collections. To improve our understanding of immobilization and general anesthesia in these species, it is paramount to be able to study them in a practical, safe research environment that does not cause harm or unnecessary stress to the animals. This study aimed to scrutinize our management and welfare practices and scientific methods of 15 wild-caught impala placed in captive confinement during a 16-wk intensive research project. The scientific methods of the project were scrutinized to identify procedures that attributed to morbidity and mortality. Indicators of impala welfare during captivity were monitored by documenting serial physical (body weight, coat condition), physiological (biochemistry and hematology), and psychologic (behavioral) aspects. Two impala suffered irreparable femoral fractures during darting and were humanly euthanized. One impala suffered cardiovascular collapse during immobilization and could not be resuscitated. The procedure of chemical capture had a morbidity and mortality rate of 14.8% and 4.4%, respectively. The impala maintained acceptable physical and physiologic parameters, including stable body weights, well-groomed coats, and values for total serum protein, serum creatinine, and hematologic parameters that were within reference ranges for the species. There were improvements in the impalas' psychological parameters, which included a decrease in the number of aggressive interactions (head butting and ramming) and an increase in the number of reciprocal allogrooming interactions. The monitored welfare indicators suggest adaptation to captivity. The study showed that impala could be successfully managed in captivity for 16 wk. However, scientific methods (namely darting) increased the risk of injury and caused fatalities.

Repertoires: How to Transform a Project into a Research Community.

How effectively communities of scientists come together and co-operate is crucial both to the quality of research outputs and to the extent to which such outputs integrate insights, data and methods from a variety of fields, laboratories and locations around the globe. This essay focuses on the ensemble of material and social conditions that makes it possible for a short-term collaboration, set up to accomplish a specific task, to give rise to relatively stable communities of researchers. We refer to these distinctive features as repertoires, and investigate their development and implementation across three examples of collaborative research in the life sciences. We conclude that whether a particular project ends up fostering the emergence of a resilient research community is partly determined by the degree of attention and care devoted by researchers to material and social elements beyond the specific research questions under consideration.

The impact of epistemic framing of teaching videos and summative assessments on students' learning of scientific methods.

The incorporation of epistemic aspects of science in science education continues to be a challenge for researchers and practitioners. The paper presents an empirical study investigating how epistemic framing of scientific methods can be incorporated in science teaching, learning and summative assessment, and what impact such framing has on student learning outcomes. The study was conducted with 969 secondary students taught by 152 teachers from a national sample in England. Teaching videos and summative assessments were framed by Brandon's Matrix, a theoretical framework derived from the work of a philosopher of science and focusing on the diversity of scientific methods ranging from hypothesis testing to non-manipulative parameter measurement. The findings are discussed, including (a) the students' views on the teaching videos and summative assessments, (b) the impact of the teaching videos on students' understanding of the epistemic aspects of scientific methods and (c) students' performance on summative assessments in the context of science topics covered in high-stakes examinations in England. The findings suggest that the students' understanding of scientific methods significantly improved after watching the videos. Furthermore, the students' performance on the summative assessment items indicated a high level of accuracy in responses.

Emotional and Cognitive Preservice Science Teachers' Engagement While Living a Model-Based Inquiry Science Technology Engineering Mathematics Sequence About Acid-Base.

Science inquiry and modeling activities have been proved to heighten emotional situations; therefore, research about emotions should aim to identify which activities promote student engagement with Science, Technology, Engineering and Mathematics fields through multidimensional models that include emotional and cognitive engagement. This research is focused on science teachers' need to carefully review their classroom instructions to ensure that students are provided with opportunities to develop appropriate understandings of acid/base models (and their concepts). To achieve this, we have implemented a short model-based inquiry acid-base instructional sequence in the context of a TV-spot about chewing gum. A descriptive, non-experimental quantitative methodology with a heuristic (emotional: self-report questionnaire; and cognitive: self-regulation questionnaire) has been used to analyze what Pre-Service Secondary Education Teachers from several Spanish universities recognize to have learned and felt in each activity. Differences regarding knowledge declared by the participants were identified in all the tasks from before to after carrying them out. Furthermore, the results seem to indicate that there are significant relationships between the knowledge and the emotions, being different depending on the skill involved. Significant correlations between emotions have been found. However, there were no significant correlations with either rejection and knowledge or with other emotions, which points to emotional engagement. Generally, no significant differences were identified between emotions and gender or universities, with some exceptions between genders in two tasks. Thus, the results led us to reflect on the instructional sequence implementation's ability to bring awareness to the learning process and how it produces multidimensional engagements.

Summary of Scientific and Statistical Methods, Study Endpoints and Definitions for Observational and Registry-Based Studies in Hematopoietic Cell Transplantation.

Due to the increasingly strict word/character restrictions enforced by most scientific publications, we identified a need for a master document illustrating the "Scientific Methods" that may be applicable to the majority of observational and registry-based studies in hematopoietic cell transplantation (HCT). The purpose of this study is to serve as a reference document that describes the data source, study endpoints and statistical analyses utilized most commonly in retrospective studies in HCT. To this end we compile, define and reference the methodology commonly used in HCT research. While it is recognized that the scientific methodology may periodically require updates due to the evolving landscape of transplant research, such as newer study endpoints and statistical methods, this manuscript describes frequently used methodologies.

The Need for Theory to Inform Clinical Information Systems and Professionalise the Health Informatics Discipline.

This chapter introduces the idea of theories in health informatics, defines what we mean by theory and distinguishes theories from models, frameworks and predictive principles. After explaining why theories and predictive principles are needed to help us professionalize our discipline, the chapter offers five criteria for a successful predictive principle, discusses how to evaluate predictive principles and theories and links this with the emerging field of evidence-based health informatics. The chapter concludes with three actions needed to move the discipline of theory-based health informatics forward.

Information Processing: The Language and Analytical Tools for Cognitive Psychology in the Information Age.

The information age can be dated to the work of Norbert Wiener and Claude Shannon in the 1940s. Their work on cybernetics and information theory, and many subsequent developments, had a profound influence on reshaping the field of psychology from what it was prior to the 1950s. Contemporaneously, advances also occurred in experimental design and inferential statistical testing stemming from the work of Ronald Fisher, Jerzy Neyman, and Egon Pearson. These interdisciplinary advances from outside of psychology provided the conceptual and methodological tools for what is often called the cognitive revolution but is more accurately described as the information-processing revolution. Cybernetics set the stage with the idea that everything ranging from neurophysiological mechanisms to societal activities can be modeled as structured control systems with feedforward and feedback loops. Information theory offered a way to quantify entropy and information, and promoted theorizing in terms of information flow. Statistical theory provided means for making scientific inferences from the results of controlled experiments and for conceptualizing human decision making. With those three pillars, a cognitive psychology adapted to the information age evolved. The growth of technology in the information age has resulted in human lives being increasingly interweaved with the cyber environment, making cognitive psychology an essential part of interdisciplinary research on such interweaving. Continued engagement in interdisciplinary research at the forefront of technology development provides a chance for psychologists not only to refine their theories but also to play a major role in the advent of a new age of science.

A science confidence gap: Education, trust in scientific methods, and trust in scientific institutions in the United States, 2014.

Following up on suggestions that attitudes toward science are multi-dimensional, we analyze nationally representative survey data collected in the United States in 2014 ( N = 2006), and demonstrate the existence of a science confidence gap: some people place great trust in scientific methods and principles, but simultaneously distrust scientific institutions. This science confidence gap is strongly associated with level of education: it is larger among the less educated than among the more educated. We investigate explanations for these educational differences. Whereas hypotheses deduced from reflexive-modernization theory do not pass the test, those derived from theorizing on the role of anomie are corroborated. The less educated are more anomic (they have more modernity-induced cultural discontents), which not only underlies their distrust in scientific institutions, but also fuels their trust in scientific methods and principles. This explains why this science confidence gap is most pronounced among the less educated.

Illusions of causality: how they bias our everyday thinking and how they could be reduced.

Illusions of causality occur when people develop the belief that there is a causal connection between two events that are actually unrelated. Such illusions have been proposed to underlie pseudoscience and superstitious thinking, sometimes leading to disastrous consequences in relation to critical life areas, such as health, finances, and wellbeing. Like optical illusions, they can occur for anyone under well-known conditions. Scientific thinking is the best possible safeguard against them, but it does not come intuitively and needs to be taught. Teaching how to think scientifically should benefit from better understanding of the illusion of causality. In this article, we review experiments that our group has conducted on the illusion of causality during the last 20 years. We discuss how research on the illusion of causality can contribute to the teaching of scientific thinking and how scientific thinking can reduce illusion.

Agriscience Student Engagement in Scientific Inquiry: Representations of Scientific Processes and Nature of Science.

Students' experiences with science integrated into agriscience courses contribute to their developing epistemologies of science. The purpose of this case study was to gain insight into the implementation of scientific inquiry in an agriscience classroom. Also of interest was how the tenets of the nature of science were reflected in the students' experiments. Participants included an agriscience teacher and her fifteen students who were conducting plant experiments to gain insight into the role of a gene disabled by scientists. Data sources included classroom observations, conversations with students, face-to-face interviews with the teacher, and students' work. Analysis of the data indicated that the teacher viewed scientific inquiry as a mechanical process with little emphasis on the reasoning that typifies scientific inquiry. Students' participation in their experiments also centered on the procedural aspects of inquiry with little attention to scientific reasoning. There was no explicit attention to the nature of science during the experiments, but the practice implied correct, incorrect, and underdeveloped conceptions of the nature of science. Evidence from the study suggests a need for collaboration between agriscience and science teacher educators to design and conduct professional development focused on scientific inquiry and nature of science for preservice and practicing teachers.

Frequência do uso adequado dos testes estatísticos nos artigos originais publicados na Revista Brasileira de Anestesiologia entre janeiro de 2008 e dezembro de 2009 / Frequency of the adequate use of statistical tests of hypothesis in original articles published in the Revista Brasileira de Anestesiologia between January 2008 and December 2009 / Frecuencia del uso adecuado de los test estadísticos en los artículos originales publicados en la Revista Brasileña de Anestesiología entre enero de 2008 y diciembre de 2009

JUSTIFICATIVA E OBJETIVOS: A realização de uma análise estatística é necessária para uma avaliação adequada do artigo original por parte do leitor, possibilitando-lhe melhor visualização e compreensão dos resultados. O objetivo desta pesquisa foi determinar a frequência do uso adequado dos testes estatísticos de hipóteses presentes nos artigos originais publicados na Revista Brasileira de Anestesiologia no período entre janeiro de 2008 e dezembro de 2009. MÉTODOS: Foram selecionados artigos originais publicados na Revista Brasileira de Anestesiologia entre janeiro de 2008 a dezembro de 2009. O uso dos testes estatísticos foi avaliado como apropriado quando a seleção dos testes foi adequada para variáveis contínuas e categóricas e para testes paramétricos e não paramétricos; houve descrição do fator de correção quando se relatou o uso de múltiplas comparações; foi mencionado o uso específico de um teste estatístico para a análise de uma variável. RESULTADOS: Foram selecionados 76 artigos originais, com um total de 179 testes estatísticos de hipóteses. A frequência dos testes estatísticos mais utilizados foi: 20,11 por cento para o qui-quadrado, 19,55 por cento para o teste t de student, 10,05 por cento para o teste de ANOVA e 9,49 por cento para o teste exato de Fisher. A frequência de uso adequado dos testes estatísticos de hipóteses foi de 56,42 por cento (IC 95 por cento 49,16 por cento a 63,68 por cento), de uso inadequado 13,41 por cento (IC 95 por cento 8,42 por cento a 18,40 por cento), ocorrendo resultado inconclusivo em 30,16 por cento (IC 95 por cento 23,44 por cento a 36,88 por cento). CONCLUSÕES: A frequência do uso adequado dos testes estatísticos utilizados nos artigos originais publicados na Revista Brasileira de Anestesiologia entre janeiro de 2008 e dezembro de 2009 foi de 56,42 por cento.

BACKGROUND AND OBJECTIVES: Statistical analysis is necessary for adequate evaluation of the original article by the reader allowing him/her to better visualize and comprehend the results. The objective of the present study was to determine the frequency of the adequate use of statistical tests in original articles published in the Revista Brasileira de Anestesiologia from January 2008 to December 2009. METHODS: Original articles published in the Revista Brasileira de Anestesiologia between January 2008 and December 2009 were selected. The use of statistical tests was deemed appropriate when the selection of the tests was adequate for continuous and categorical variables and for parametric and non-parametric tests, the correction factor was described when the use of multiple comparisons was reported, and the specific use of a statistical test for analysis of one variable was mentioned. RESULTS: Seventy-six original articles from a total of 179 statistical tests were selected. The frequency of the statistical tests used more often was: Chi-square 20.11 percent, Student t test 19.55 percent, ANOVA 10.05 percent, and Fisher exact test 9.49 percent. The frequency of the adequate use of statistical tests was 56.42 percent (95 percent CI 49.16 percent to 63.68 percent), erroneous use in 13.41 percent (95 percent CI 8.42 percent to 18.40 percent), and an inconclusive result in 30.16 percent (95 percent CI 23.44 percent to 36.88 percent). CONCLUSIONS: The frequency of inadequate use of statistical tests in the articles published by the Revista Brasileira de Anestesiologia between January 2008 and December 2009 was 56.42 percent.

JUSTIFICATIVA Y OBJETIVOS: La realización de un análisis estadístico se hace necesario para una evaluación pertinente del artículo original por parte del lector, ayudándolo a obtener una mejor visualización y comprensión de los resultados. El objetivo de esta investigación fue determinar la frecuencia del uso adecuado de los test estadísticos de hipótesis presentes en los artículos originales publicados en la Revista Brasileña de Anestesiología, entre enero de 2008 y diciembre de 2009. MÉTODOS: Se seleccionaron artículos originales publicados en la Revista Brasileña de Anestesiología entre enero de 2008 a diciembre de 2009. El uso de los test estadísticos se evaluó como apropiado cuando: la selección de los test fue satisfactoria para las variables continuas y categóricas y para el test paramétrico y no paramétrico; hubo una descripción del factor de corrección cuando se relató el uso de múltiples comparaciones; fue mencionado el uso específico de un test estadístico para el análisis de una variable. RESULTADOS: Se seleccionaron 76 artículos originales, con un total de 179 test estadísticos de hipótesis. La frecuencia de los test estadísticos más utilizados fue: 20,11 por ciento para el Chi-Cuadrado, 19,55 por ciento, para el test t de Student, 10,05 por ciento para el test de ANOVA y 9,49 por ciento para el test exacto de Fisher. La frecuencia de uso adecuado de los test estadísticos de hipótesis fue de un 56,42 por ciento (IC 95 por ciento 49,16 por ciento a 63,68 por ciento), de uso inadecuado, 13,41 por ciento (IC 95 por ciento 8,42 por ciento a 18,40 por ciento), con un resultado sin conclusiones en un 30,16 por ciento (IC 95 por ciento 23,44 por ciento a 36,88 por ciento). CONCLUSIONES: La frecuencia del uso adecuado de los test estadísticos utilizados en los artículos originales publicados en la Revista Brasileña de Anestesiología entre enero de 2008 y diciembre de 2009, fue de un 56,42 por ciento.

As pesquisas etnodirigidas na descoberta de novos fármacos de interesse médico e farmacêutico: fragilidades e pespectivas / Ethnodirected research in the discovery of new drugs of medical and pharmaceutical interest: flaws and perspectives

As investigações etnofarmacológicas e etnobotânicas têm sido a principal abordagem reconhecida por cientistas em todo o mundo, como uma estratégia de seleção de plantas medicinais. As qualidades e fortalezas dessas abordagens já foram suficientemente discutidas, restando poucas dúvidas de seu potencial e impactos biológicos, econômicos e sociais. Este artigo focaliza os estudos etnodirigidos (etnobotânicos e etnofarmacológicos) levantando os problemas encontrados na qualidade das pesquisas, que podem afetar a sua aplicação na descoberta de novos fármacos de interesse médico e farmacêutico. Adicionalmente, apontamos alguns elementos que podem colaborar para a melhoria da qualidade das abordagens e publicações e que podem ser aplicados a diferentes estudos etnodirigidos. Nós também sugerimos que os investigadores reconsiderem algumas das abordagens dominantes, bem como a visão, não raro simplista, desses estudos.

Ethnopharmacological and ethnobotanical investigations have been the main approach used by scientists all over the world as a strategy to select medicinal plants. The qualities and strengths of these approaches have been sufficiently discussed, and there are a few doubts left in relation to their potential and biological, economic, and social impacts. This article focuses on ethnodirected studies (ethnopharmacological and ethnobotanical), raising problems found in the quality of these studies. In addition, we point out some elements that might contribute to the improvement of approaches and publications that can be applied to different ethnodirected studies. We also suggest that researchers reconsider some of the dominant approaches, as well as the view of these studies, which is often simplistic.