Preparing future STEM faculty through flexible teaching professional development.

We have prepared thousands of future STEM faculty around the world to adopt evidence-based instructional practices through their participation in two massive open online courses (MOOCs) and facilitated in-person learning communities. Our novel combination of asynchronous online and coordinated, structured face-to-face learning community experiences provides flexible options for STEM graduate students and postdoctoral fellows to pursue teaching professional development. A total of 14,977 participants enrolled in seven offerings of the introductory course held 2014-2018, with 1,725 participants (11.5% of enrolled) completing the course. Our results of high levels of engagement and learning suggest that leveraging the affordances of educational technologies and the geographically clustered nature of this learner demographic in combination with online flexible learning could be a sustainable model for large scale professional development in higher education. The preparation of future STEM faculty makes an important difference in establishing high-quality instruction that meets the diverse needs of all undergraduate students, and the initiative described here can serve as a model for increasing access to such preparation.

Investigating the linkage between professional development and mathematics instructors' use of teaching practices using the theory of planned behavior.

Professional development has been identified as an effective way to increase college STEM instructors' use of research-based instructional strategies (RBIS) known to benefit student learning and persistence in STEM. Yet only a few studies relate professional development experiences to later teaching behaviors of higher education instructors. This study of 361 undergraduate mathematics instructors, all of whom participated in multi-day, discipline-based workshops on teaching held in 2010-2019, examined the relationship between such participation and later use of RBIS. We found that instructors' RBIS attitudes, knowledge, and skills strengthened after participating in professional development, and their self-reported use of RBIS became more frequent in the first year after the workshop. Applying the Theory of Planned Behavior as a conceptual framework, we used a structural equation model to test whether this theory could explain the roles of workshop participation and other personal, professional and contextual factors in fostering RBIS use. Findings indicated that, along with workshop participation, prior RBIS experience, class size, and course coordination affected RBIS use. That is, both targeted professional development and elements of the local context for implementation were important in supporting instructors' uptake of RBIS-but, remarkably, both immediate and longer-term outcomes of professional development did not depend on other individual or institutional characteristics. In this study, the large sample size, longitudinal measurement approach, and consistency of the form and quality of professional development make it possible to distinguish the importance of multiple possible influences on instructors' uptake of RBIS. We discuss implications for professional development and for institutional structures that support instructors as they apply what they learned, and we offer suggestions for the use of theory in future research on this topic.

Supporting instructional change in mathematics: using social network analysis to understand online support processes following professional development workshops.

BACKGROUND: Studies continually show benefits of active learning in college classrooms, yet it is difficult to get faculty to adopt these methods. Particularly challenging is the final step of the instructional change process, "refreezing," when after making initial changes in instructional methods, instructors decide whether to continue with new instructional methods or return to their previous methods. Though this stage is important, it is not well studied. Most available studies about ongoing support following professional development on teaching merely state that facilitators made an effort to offer support, or report how frequently participants engaged with online support mechanisms through counting postings on listservs or message boards. Such measures do not show evidence that participants actually received positive reinforcement or intellectual and emotional support, which are crucial to refreezing, nor do these frequency analyses help other professional developers learn how to create productive ongoing support mechanisms that yield high participant engagement. RESULTS: This workshop for 35 college mathematics instructors used online and in-person communities to provide support to participants during the post-workshop period of "refreezing." Almost all workshop attendees participated in "e-mentoring" (94%), primarily through a productive, engaging group email listserv. By combining qualitative coding of message content with the techniques of social network analysis, we reveal how facilitators and participants on the group listserv provided intellectual and emotional support, as well as positive reinforcement through feedback loops. The analysis also shows how the facilitators made this a helpful group and maintained participant engagement through frequent encouragement, deliberate community building, and thoughtfully timed responses. CONCLUSIONS: Though many professional development workshops offer online support through email listservs, there is little evidence that these listservs successfully engage and support participants. Applying the analytic approach of social network analysis allowed us to model the conversation threads in one highly engaged and supportive listserv following a mathematics professional development workshop. This method revealed the processes of ongoing support in ways that traditional frequency-based analyses cannot. This method also revealed lessons for how other professional developers can create productive, helpful online support listservs. Since this is an innovative application of social network analysis, we describe the method in detail.

Why Work with Undergraduate Researchers? Differences in Research Advisors' Motivations and Outcomes by Career Stage.

Undergraduate research is often hailed as a solution to increasing the number and quality of science, technology, engineering, and mathematics graduates needed to fill the high-tech jobs of the future. Student benefits of research are well documented but the emerging literature on advisors' perspectives is incomplete: only a few studies have included the graduate students and postdocs who often serve as research advisors, and not much is known about why research advisors choose to work with undergraduate researchers. We report the motivations for advising undergraduate researchers, and the related costs and benefits of doing so, from 30 interviews with research advisors at various career stages. Many advisors stated intrinsic motivations, but a small group of early-career advisors expressed only instrumental motivations. We explore what this means for how advisors work with student researchers, the benefits students may or may not gain from the experience, and the implications for training and retaining research advisors who can provide high-quality research experiences for undergraduate students.

The Undergraduate Research Student Self-Assessment (URSSA): Validation for Use in Program Evaluation.

This article examines the validity of the Undergraduate Research Student Self-Assessment (URSSA), a survey used to evaluate undergraduate research (UR) programs. The underlying structure of the survey was assessed with confirmatory factor analysis; also examined were correlations between different average scores, score reliability, and matches between numerical and textual item responses. The study found that four components of the survey represent separate but related constructs for cognitive skills and affective learning gains derived from the UR experience. Average scores from item blocks formed reliable but moderate to highly correlated composite measures. Additionally, some questions about student learning gains (meant to assess individual learning) correlated to ratings of satisfaction with external aspects of the research experience. The pattern of correlation among individual items suggests that items asking students to rate external aspects of their environment were more like satisfaction ratings than items that directly ask about student skills attainment. Finally, survey items asking about student aspirations to attend graduate school in science reflected inflated estimates of the proportions of students who had actually decided on graduate education after their UR experiences. Recommendations for revisions to the survey include clarified item wording and increasing discrimination between item blocks through reorganization.

Assessment of course-based undergraduate research experiences: a meeting report.

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a "research experience"; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.

The benefits of multi-year research experiences: differences in novice and experienced students' reported gains from undergraduate research.

This mixed-methods study explores differences in novice and experienced undergraduate students' perceptions of their cognitive, personal, and professional gains from engaging in scientific research. The study was conducted in four different undergraduate research (UR) programs at two research-extensive universities; three of these programs had a focus on the biosciences. Seventy-three entry-level and experienced student researchers participated in in-depth, semi-structured interviews and completed the quantitative Undergraduate Research Student Self-Assessment (URSSA) instrument. Interviews and surveys assessed students' developmental outcomes from engaging in UR. Experienced students reported distinct personal, professional, and cognitive outcomes relative to their novice peers, including a more sophisticated understanding of the process of scientific research. Students also described the trajectories by which they developed not only the intellectual skills necessary to advance in science, but also the behaviors and temperament necessary to be a scientist. The findings suggest that students benefit from multi-year UR experiences. Implications for UR program design, advising practices, and funding structures are discussed.