An inclusive Research Education Community (iREC): Impact of the SEA-PHAGES program on research outcomes and student learning.

Engaging undergraduate students in scientific research promises substantial benefits, but it is not accessible to all students and is rarely implemented early in college education, when it will have the greatest impact. An inclusive Research Education Community (iREC) provides a centralized scientific and administrative infrastructure enabling engagement of large numbers of students at different types of institutions. The Science Education Alliance-Phage Hunters Advancing Genomics and Evolutionary Science (SEA-PHAGES) is an iREC that promotes engagement and continued involvement in science among beginning undergraduate students. The SEA-PHAGES students show strong gains correlated with persistence relative to those in traditional laboratory courses regardless of academic, ethnic, gender, and socioeconomic profiles. This persistent involvement in science is reflected in key measures, including project ownership, scientific community values, science identity, and scientific networking.

Broadening Access to STEM through the Community College: Investigating the Role of Course-Based Research Experiences (CREs).

Broadening access to science, technology, engineering, and mathematics (STEM) professions through the provision of early-career research experiences for a wide range of demographic groups is important for the diversification of the STEM workforce. The size and diversity of the community college system make it a prime educational site for achieving this aim. However, some evidence shows that women and Black, Latinx, and Native American student groups have been hindered in STEM at the community college level. One option for enhancing persistence in STEM is to incorporate the course-based research experiences (CREs) into the curriculum as a replacement for the prevalent traditional laboratory. This can be achieved through the integration of community colleges within extant, multi-institutional CREs such as the SEA-PHAGES program. Using a propensity score-matching technique, students in a CRE and traditional laboratory were compared on a range of psychosocial variables (project ownership, self-efficacy, science identity, scientific community values, and networking). Results revealed higher ratings for women and persons excluded because of their ethnicity or race (PEERs) in the SEA-PHAGES program on important predictors of persistence such as project ownership and science identity. This suggests that the usage of CREs at community colleges could have positive effects in addressing the gender gap for women and enhance inclusiveness for PEER students in STEM.

Instructional Models for Course-Based Research Experience (CRE) Teaching.

The course-based research experience (CRE) with its documented educational benefits is increasingly being implemented in science, technology, engineering, and mathematics education. This article reports on a study that was done over a period of 3 years to explicate the instructional processes involved in teaching an undergraduate CRE. One hundred and two instructors from the established and large multi-institutional SEA-PHAGES program were surveyed for their understanding of the aims and practices of CRE teaching. This was followed by large-scale feedback sessions with the cohort of instructors at the annual SEA Faculty Meeting and subsequently with a small focus group of expert CRE instructors. Using a qualitative content analysis approach, the survey data were analyzed for the aims of inquiry instruction and pedagogical practices used to achieve these goals. The results characterize CRE inquiry teaching as involving three instructional models: 1) being a scientist and generating data; 2) teaching procedural knowledge; and 3) fostering project ownership. Each of these models is explicated and visualized in terms of the specific pedagogical practices and their relationships. The models present a complex picture of the ways in which CRE instruction is conducted on a daily basis and can inform instructors and institutions new to CRE teaching.

A Framework of College Student Buy-in to Evidence-Based Teaching Practices in STEM: The Roles of Trust and Growth Mindset.

Evidence-based teaching practices (EBPs) foster college science, technology, engineering, and mathematics (STEM) students' engagement and performance, yet our knowledge of what contributes to the effectiveness of these practices is less established. We propose a framework that links four social-cognitive variables-students' trust in their instructors, growth mindset, buy-in to instructional practices, and course engagement-to long-standing desired student outcomes of academic performance and intent to persist in science. This framework was tested in classrooms identified as having a high level of EBP implementation with a multi-institutional sample of 2102 undergraduates taught by 14 faculty members. Results indicate that the buy-in framework is a valid representation of college students' learning experiences within EBP contexts overall as well as across underrepresented student groups. In comparison to students' level of growth mindset, students' trust in their instructors was more than twice as predictive of buy-in to how the course was being taught, suggesting that students' views of their instructors are more associated with thriving in a high-EBP course environment than their views of intelligence. This study contributes to the dialogue on transforming undergraduate STEM education by providing a validated student buy-in framework as a lens to understand how EBPs enhance student outcomes.

Short-Term Research Experience (SRE) in the Traditional Lab: Qualitative and Quantitative Data on Outcomes.

The San Diego Biodiversity Project introduces undergraduate students at four different 2- and 4-year schools to a short-term research experience (SRE) that was implemented as a module in the last third of a traditional laboratory course. The study assesses the qualities of this SRE for students using three different methods. Twenty-one participants were interviewed about their experiences in the traditional and research components of their course. In a repeated-measures design, 124 participants took the Persistence in the Sciences (PITS) survey immediately before and after their participation in the SRE. Finally, using a propensity score matching technique, PITS survey results for SRE students were compared with those for students in a course-based research experience (CRE). Student perceptions of the traditional lab and the SRE are different-students appreciate learning basic processes and procedures in the traditional lab, but they express having personal investment in and a sense of participating in science in the SRE. Significant increases were found for the variable of Project Ownership in the SRE condition over the traditional lab, but SRE outcomes were lower than CRE outcomes. Although the SRE may not provide the benefits of a CRE, it is a serious option for expanding access to authentic research.

Trust, Growth Mindset, and Student Commitment to Active Learning in a College Science Course.

There is growing consensus regarding the effectiveness of active-learning pedagogies in college science courses. Less is known about ways that student-level factors contribute to positive outcomes in these contexts. The present study examines students' (N = 245) trust in the instructor-defined as perceptions of their instructor's understanding, acceptance, and care-and students' attitudes toward learning within an anatomy and physiology course featuring active learning. Analyses indicate that student trust of instructor and students' views of their own intelligence are both associated with student commitment to, and engagement in, active learning. Student-reported trust of the instructor corresponded to final grade, while students' views of their own intelligence did not. In an active-learning context in which students are more fully engaged in the learning process, student trust of the instructor was an important contributor to desired student outcomes.

A Measure of College Student Persistence in the Sciences (PITS).

Curricular changes that promote undergraduate persistence in science, technology, engineering, and mathematics (STEM) disciplines are likely associated with particular student psychological outcomes, and tools are needed that effectively assess these developments. Here, we describe the theoretical basis, psychometric properties, and predictive abilities of the Persistence in the Sciences (PITS) assessment survey designed to measure these in course-based research experiences (CREs). The survey is constructed from existing psychological assessment instruments, incorporating a six-factor structure consisting of project ownership (emotion and content), self-efficacy, science identity, scientific community values, and networking, and is supported by a partial confirmatory factor analysis. The survey has strong internal consistency (Cronbach's alpha: α = 0.96) and was validated using standard simple and multiple regression analyses. The regression analyses demonstrated that the factors of the PITS survey were significant predictors of the intent to become a research scientist and, as such, potentially valid for the measurement of persistence in the sciences. The PITS survey provides an effective method for measuring the psychological outcomes of undergraduate research experiences relevant to persistence in STEM and offers an approach to the development and validation of more sophisticated assessment tools that recognize the specificities of the type of educational opportunities embedded in a CRE.

Student Buy-In to Active Learning in a College Science Course.

The benefits of introducing active learning in college science courses are well established, yet more needs to be understood about student buy-in to active learning and how that process of buy-in might relate to student outcomes. We test the exposure-persuasion-identification-commitment (EPIC) process model of buy-in, here applied to student (n = 245) engagement in an undergraduate science course featuring active learning. Student buy-in to active learning was positively associated with engagement in self-regulated learning and students' course performance. The positive associations among buy-in, self-regulated learning, and course performance suggest buy-in as a potentially important factor leading to student engagement and other student outcomes. These findings are particularly salient in course contexts featuring active learning, which encourage active student participation in the learning process.

Measuring Networking as an Outcome Variable in Undergraduate Research Experiences.

The aim of this paper is to propose, present, and validate a simple survey instrument to measure student conversational networking. The tool consists of five items that cover personal and professional social networks, and its basic principle is the self-reporting of degrees of conversation, with a range of specific discussion partners. The networking instrument was validated in three studies. The basic psychometric characteristics of the scales were established by conducting a factor analysis and evaluating internal consistency using Cronbach's alpha. The second study used a known-groups comparison and involved comparing outcomes for networking scales between two different undergraduate laboratory courses (one involving a specific effort to enhance networking). The final study looked at potential relationships between specific networking items and the established psychosocial variable of project ownership through a series of binary logistic regressions. Overall, the data from the three studies indicate that the networking scales have high internal consistency (α = 0.88), consist of a unitary dimension, can significantly differentiate between research experiences with low and high networking designs, and are related to project ownership scales. The ramifications of the networking instrument for student retention, the enhancement of public scientific literacy, and the differentiation of laboratory courses are discussed.

The Faculty Self-Reported Assessment Survey (FRAS): differentiating faculty knowledge and experience in assessment.

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment.

The project ownership survey: measuring differences in scientific inquiry experiences.

A growing body of research documents the positive outcomes of research experiences for undergraduates, including increased persistence in science. Study of undergraduate lab learning experiences has demonstrated that the design of the experience influences the extent to which students report ownership of the project and that project ownership is one of the psychosocial factors involved in student retention in the sciences. To date, methods for measuring project ownership have not been suitable for the collection of larger data sets. The current study aims to rectify this by developing, presenting, and evaluating a new instrument for measuring project ownership. Eighteen scaled items were generated based on prior research and theory related to project ownership and combined with 30 items shown to measure respondents' emotions about an experience, resulting in the Project Ownership survey (POS). The POS was analyzed to determine its dimensionality, reliability, and validity. The POS had a coefficient alpha of 0.92 and thus has high internal consistency. Known-groups validity was analyzed through the ability of the instrument to differentiate between students who studied in traditional versus research-based laboratory courses. The POS scales as differentiated between the groups and findings paralleled previous results in relation to the characteristics of project ownership.

Assessment of course-based undergraduate research experiences: a meeting report.

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a "research experience"; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.