Utility-value intervention promotes persistence and diversity in STEM.

We tested the long-term effects of a utility-value intervention administered in a gateway chemistry course, with the goal of promoting persistence and diversity in STEM. In a randomized controlled trial (N = 2,505), students wrote three essays about course content and its personal relevance or three control essays. The intervention significantly improved STEM persistence overall (74% vs. 70% were STEM majors 2.5 y later). Effects were larger for students from marginalized and underrepresented racial/ethnic groups, who were 14 percentage points more likely to persist in STEM fields in the intervention condition (69% vs. 55%). Mediation analysis suggests that the intervention promoted persistence for these students by bolstering their motivation to attain a STEM degree and by promoting engagement with course assignments. This theory-informed curricular intervention is a promising tool for educators committed to retaining students in STEM.

Open science, communal culture, and women's participation in the movement to improve science.

Science is undergoing rapid change with the movement to improve science focused largely on reproducibility/replicability and open science practices. This moment of change-in which science turns inward to examine its methods and practices-provides an opportunity to address its historic lack of diversity and noninclusive culture. Through network modeling and semantic analysis, we provide an initial exploration of the structure, cultural frames, and women's participation in the open science and reproducibility literatures (n = 2,926 articles and conference proceedings). Network analyses suggest that the open science and reproducibility literatures are emerging relatively independently of each other, sharing few common papers or authors. We next examine whether the literatures differentially incorporate collaborative, prosocial ideals that are known to engage members of underrepresented groups more than independent, winner-takes-all approaches. We find that open science has a more connected, collaborative structure than does reproducibility. Semantic analyses of paper abstracts reveal that these literatures have adopted different cultural frames: open science includes more explicitly communal and prosocial language than does reproducibility. Finally, consistent with literature suggesting the diversity benefits of communal and prosocial purposes, we find that women publish more frequently in high-status author positions (first or last) within open science (vs. reproducibility). Furthermore, this finding is further patterned by team size and time. Women are more represented in larger teams within reproducibility, and women's participation is increasing in open science over time and decreasing in reproducibility. We conclude with actionable suggestions for cultivating a more prosocial and diverse culture of science.

College Students' Reasons for Leaving Biomedical Fields: Disenchantment with Biomedicine or Attraction to Other Fields?

This study examined whether students who left biomedical fields of study during college did so primarily because they became disenchanted with those fields or because they felt attracted to alternative fields of study. We identified 1193 students intending to pursue biomedical fields of study early in college, collected data about their beliefs and performance throughout college, and interviewed them near graduation about their future plans. Descriptively, we examined the topics students discussed as affecting their attrition decisions. Predictive research aims were to determine how academic performance, interest, and demographic factors predicted students' likelihood of overall attrition and likelihood of reporting distinct reasons for attrition. Among the 192 students who left biomedical fields, 62.5% described leaving only in terms of feeling disenchanted, whereas 37.4% expressed that they left at least in part due to feeling attracted towards non-biomedical fields. Most students who left biomedical fields expressed changing plans for reasons related to interest; this was especially prevalent among students who reported leaving due to attraction towards non-biomedical fields. Predictive analyses showed that interest in biology and grades at the end of an introductory biology course predicted the likelihood of overall attrition and likelihood of leaving due to feeling disenchantment, whereas underrepresented ethnic minority status predicted these outcomes positively. Interest and course grades also predicted the likelihood of students leaving due to feeling attraction towards other fields, but interest was a stronger predictor relative to grades. Results highlight distinct types of attrition that may have implications for policies to promote STEM retention.

Utility-value intervention with parents increases students' STEM preparation and career pursuit.

During high school, developing competence in science, technology, engineering, and mathematics (STEM) is critically important as preparation to pursue STEM careers, yet students in the United States lag behind other countries, ranking 35th in mathematics and 27th in science achievement internationally. Given the importance of STEM careers as drivers of modern economies, this deficiency in preparation for STEM careers threatens the United States' continued economic progress. In the present study, we evaluated the long-term effects of a theory-based intervention designed to help parents convey the importance of mathematics and science courses to their high-school-aged children. A prior report on this intervention showed that it promoted STEM course-taking in high school; in the current follow-up study, we found that the intervention improved mathematics and science standardized test scores on a college preparatory examination (ACT) for adolescents by 12 percentile points. Greater high-school STEM preparation (STEM course-taking and ACT scores) was associated with increased STEM career pursuit (i.e., STEM career interest, the number of college STEM courses, and students' attitudes toward STEM) 5 y after the intervention. These results suggest that the intervention can affect STEM career pursuit indirectly by increasing high-school STEM preparation. This finding underscores the importance of targeting high-school STEM preparation to increase STEM career pursuit. Overall, these findings demonstrate that a motivational intervention with parents can have important effects on STEM preparation in high school, as well as downstream effects on STEM career pursuit 5 y later.

Improving Student Outcomes in Higher Education: The Science of Targeted Intervention.

Many theoretically based interventions have been developed over the past two decades to improve educational outcomes in higher education. Based in social-psychological and motivation theories, well-crafted interventions have proven remarkably effective because they target specific educational problems and the processes that underlie them. In this review, we evaluate the current state of the literature on targeted interventions in higher education with an eye to emerging theoretical and conceptual questions about intervention science. We review three types of interventions, which focus on the value students perceive in academic tasks, their framing of academic challenges, and their personal values, respectively. We consider interventions that (a) target academic outcomes (e.g., grades, major or career plans, course taking, retention) in higher education, as well as the pipeline to college, and (b) have been evaluated in at least two studies. Finally, we discuss implications for intervention science moving forward.

Promoting Persistence in the Biological and Medical Sciences: An Expectancy-Value Approach to Intervention.

A wide range of occupations require science, technology, engineering, and mathematics (STEM) skills, yet almost half of students who intend to pursue a post-secondary STEM education abandon these plans before graduating from college. This attrition is especially pronounced among underrepresented groups (i.e., racial/ethnic minorities and first-generation college students). We conducted a two-year follow-up of a utility-value intervention that had been implemented in an introductory biology course. This intervention was previously shown to improve performance in the course, on average and especially among underrepresented students, reducing the achievement gap. The goal of the present study was to examine whether the intervention also impacted persistence in the biomedical track throughout college. The intervention had a more positive impact on long-term persistence for students who were more confident that they could succeed at the beginning of the course, and this effect was partially driven by the extent to which students reflected on the personal relevance of biological topics in their essays. This mechanism was distinct from the process that had been found to underlie intervention effects on performance - engagement with course material - suggesting that utility-value interventions may affect different academic outcomes by initiating distinct psychological processes. Although we did not find that the intervention was differentially effective for underrepresented students in terms of persistence, we found that positive effects on performance were associated with increased persistence for these students. Results suggest that utility-value interventions in an introductory course can be an effective strategy to promote persistence in the biomedical sciences throughout college.

The Benefits of Combining Value for the Self and Others in Utility-Value Interventions.

Utility-value interventions, in which students complete writing assignments about the personal usefulness of course material, show great promise for promoting interest and performance in introductory college science courses, as well as persistence in STEM fields. As researchers move toward scaling up this intervention, it's important to understand which features are key to its effectiveness. For example, prior studies have used different types of utility-value assignments (i.e., self-focused essays and other-focused letters) and different assignment structures (i.e., over time, researchers provided a variety of tasks or choices between tasks), without comparing them. It is not known whether these assignment features are incidental details or key aspects of the intervention that impact its effectiveness. In the current study, we systematically compared different utility-value assignments, as well as ways of combining them, in a randomized controlled trial in an introductory college biology course (N = 590). Specifically, we compared different versions of the intervention in terms of their relative effectiveness for promoting course performance and the motivational mechanisms through which they operated. The intervention was most effective when students had opportunities to write about utility for both the self and others. Grades were higher in conditions in which students were either assigned a variety of self-focused and other-focused assignments or given the choice between the two. Among students with low performance expectations, grades were higher when students were assigned a specific combination: a self-focused assignment followed by other-focused assignments. Results suggest that different versions of the intervention may work through different mechanisms.

Improving Performance and Retention in Introductory Biology with a Utility-Value Intervention.

One way to encourage performance and persistence in STEM fields is to have students write about the utility value (UV) or personal relevance of course topics to their life. This intervention has been shown to increase engagement and performance in introductory courses. However, questions remain about the longevity of the effects and how best to implement the intervention in terms of dosage and timing. We tested a UV intervention in the first semester of a two-semester introductory biology sequence. For each of three units across the semester, students (N = 577) were randomly assigned to receive either a UV writing assignment, in which they explained why course material was useful to them personally, or a control assignment, in which they summarized course material. This fully crossed design tested the effect of UV dosage level (0, 1, 2, or 3 UV assignments) as well as the effect of timing (e.g., UV first, control first). We found that students exposed to any dosage of UV earned higher grades in the course, were more likely to enroll in the second course of the biology sequence, and were less likely to abandon their STEM major than students who did not receive any UV assignments. In terms of timing, students with a history of poor performance benefitted from writing a UV essay in the beginning of the semester, whereas higher-performing students benefitted from a UV essay at the end of the semester. Recommendations for practice are discussed.

Making Learning Personally Meaningful: A New Framework for Relevance Research.

Personal relevance goes by many names in the motivation literature, stemming from a number of theoretical frameworks. Currently these lines of research are being conducted in parallel with little synthesis across them, perhaps because there is no unifying definition of the relevance construct within which this research can be situated. In this paper we propose a new framework to synthesize existing research on relevance and provide a common platform for researchers to communicate and collaborate. In light of this new framework we review the role of relevance in three prominent theories in the motivation literature: the four-phase model of interest development (Hidi & Renninger, 2006), expectancy-value theory (Eccles et al., 1983), and self-determination theory (Deci & Ryan, 1985). We then explore eight relevance constructs commonly used in the literature and the educational interventions that derive from them. Finally, we offer a synthesis of these constructs and suggest some directions for future research.

The Role of Mothers' Communication in Promoting Motivation for Math and Science Course-Taking in High School.

In the context of concerns about American youths' failure to take advanced math and science (MS) courses in high school, we examined mothers' communication with their adolescent about taking MS courses. At ninth grade, U.S. mothers (n = 130) were interviewed about their responses to hypothetical questions from their adolescent about the usefulness of algebra, geometry, calculus, biology, chemistry, and physics. Responses were coded for elaboration and making personal connections to the adolescent. The number of science, technology, engineering, and mathematics courses taken in 12th grade was obtained from school records. Mothers' use of personal connections predicted adolescents' MS interest and utility value, as well as actual MS course-taking. Parents can play an important role in motivating their adolescent to take MS courses.

Closing the Social Class Achievement Gap for First-Generation Students in Undergraduate Biology.

Many students start college intending to pursue a career in the biosciences, but too many abandon this goal because they struggle in introductory biology. Interventions have been developed to close achievement gaps for underrepresented minority students and women, but no prior research has attempted to close the gap for first-generation students, a population that accounts for nearly a fifth of college students. We report a values affirmation intervention conducted with 798 U.S. students (154 first-generation) in an introductory biology course for majors. For first-generation students, values affirmation significantly improved final course grades and retention in the second course in the biology sequence, as well as overall GPA for the semester. This brief intervention narrowed the achievement gap between first-generation and continuing generation students for course grades by 50% and increased retention in a critical gateway course by 20%. Our results suggest that educators can expand the pipeline for first-generation students to continue studying in the biosciences with psychological interventions.

The Utility Value of a Broad, Comprehensive Theory of Motivation.

We provide a brief commentary on the scope and impact of situated expectancy-value theory, as articulated by Eccles and Wigfield in many influential papers. In particular, we consider the long history and legacy of this theory as discussed in their legacy paper (Eccles & Wigfield, 2022).

Using latent variable models to make gaming-the-system detection robust to context variations.

Gaming the system, a behavior in which learners exploit a system's properties to make progress while avoiding learning, has frequently been shown to be associated with lower learning. However, when we applied a previously validated gaming detector across conditions in experiments with an algebra tutor, the detected gaming was not associated with reduced learning, challenging its validity in our study context. Our exploratory data analysis suggested that varying contextual factors across and within conditions contributed to this lack of association. We present a new approach, latent variable-based gaming detection (LV-GD), that controls for contextual factors and more robustly estimates student-level latent gaming tendencies. In LV-GD, a student is estimated as having a high gaming tendency if the student is detected to game more than the expected level of the population given the context. LV-GD applies a statistical model on top of an existing action-level gaming detector developed based on a typical human labeling process, without additional labeling effort. Across three datasets, we find that LV-GD consistently outperformed the original detector in validity measured by association between gaming and learning as well as reliability. LV-GD also afforded high practical utility: it more accurately revealed intervention effects on gaming, revealed a correlation between gaming and perceived competence in math and helped understand productive detected gaming behaviors. Our approach is not only useful for others wanting a cost-effective way to adapt a gaming detector to their context but is also generally applicable in creating robust behavioral measures.

A prosocial value intervention in gateway STEM courses.

Many college students, especially first-generation and underrepresented racial/ethnic minority students, desire courses and careers that emphasize helping people and society. Can instructors of introductory science, technology, engineering, and math (STEM) courses promote motivation, performance, and equity in STEM fields by emphasizing the prosocial relevance of course material? We developed, implemented, and evaluated a prosocial utility-value intervention (UVI): A course assignment in which students were asked to reflect on the prosocial value of biology or chemistry course content; our focus was on reducing performance gaps between first-generation and continuing generation college students. In Studies 1a and 1b, we piloted two versions of a prosocial UVI in introductory biology (N = 282) and chemistry classes (N = 1,705) to test whether we could encourage students to write about the prosocial value of course content. In Study 2, we tested a version of the UVI that combines personal and prosocial values, relative to a standard UVI, which emphasizes personal values, using a randomized controlled trial in an introductory chemistry course (N = 2,505), and examined effects on performance and motivation in the course. In Study 3, we tested the prosocial UVI against a standard UVI in an introductory biology course (N = 712). Results suggest that the prosocial UVI may be particularly effective in promoting motivation and performance for first-generation college students, especially those who are more confident that they can perform well in the class, reflecting a classic expectancy-value interaction. Mediation analyses suggest that this intervention worked by promoting interest in chemistry. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Helping parents to motivate adolescents in mathematics and science: an experimental test of a utility-value intervention.

The pipeline toward careers in science, technology, engineering, and mathematics (STEM) begins to leak in high school, when some students choose not to take advanced mathematics and science courses. We conducted a field experiment testing whether a theory-based intervention that was designed to help parents convey the importance of mathematics and science courses to their high school-aged children would lead them to take more mathematics and science courses in high school. The three-part intervention consisted of two brochures mailed to parents and a Web site, all highlighting the usefulness of STEM courses. This relatively simple intervention led students whose parents were in the experimental group to take, on average, nearly one semester more of science and mathematics in the last 2 years of high school, compared with the control group. Parents are an untapped resource for increasing STEM motivation in adolescents, and the results demonstrate that motivational theory can be applied to this important pipeline problem.

The Role of Utility Value in Promoting Interest Development.

An individual's initial interest in a topic may quickly fade, or it may become deeper and more enduring. One factor that may support an emerging interest is to discover utility value (or usefulness) in the topic. Instructional materials that emphasize the utility value of a topic can enhance learning and motivation, but whether these materials can foster interest development among individuals who show initial interest in a topic is uncertain. Across two studies, we tested utility-value manipulations under conditions in which we expected the manipulations to promote the development of interest. In Study 1, we manipulated whether participants received utility-value information during a learning session and found that such information triggered a state of interest for participants who had reported higher levels of interest at the outset of the session. In Study 2, we provided all participants with the same utility-value information provided to some students in Study 1, and then manipulated whether they wrote one of three kinds of essays about the utility value of the task (or a control topic). For participants with higher interest, we found that subsequent reflection on the usefulness of the material for the distant future in a writing activity (rather than the present or near future) further promoted interest development. In addition, engaging in any type of utility-value writing improved performance on a test of the material - overall, and specifically for less confident participants - replicating previous research. Findings suggest that, under the right conditions, emphasizing utility value can catalyze the interest-development process.

Inside the STEM pipeline: Changes in students' biomedical career plans across the college years.

Researchers often invoke the metaphor of a pipeline when studying participation in careers in science, technology, engineering, and mathematics (STEM), focusing on the important issue of students who "leak" from the pipeline, but largely ignoring students who persist in STEM. Using interview, survey, and institutional data over 6 years, we examined the experiences of 921 students who persisted in biomedical fields through college graduation and planned to pursue biomedical careers. Despite remaining in the biomedical pipeline, almost half of these students changed their career plans, which was almost twice the number of students who abandoned biomedical career paths altogether. Women changed plans more often and were more likely than men to change to a career requiring fewer years of post-graduate education. Results highlight the importance of studying within-pipeline patterns rather than focusing only on why students leave STEM fields.

Understanding Long-Term Effects of Motivation Interventions in a Changing World.

As intervention science develops, researchers are increasingly attending to the long-term effects of interventions in academic settings. Currently, however, there is no common taxonomy for understanding the complex processes through which interventions can produce long-lasting effects. The lack of a common framework results in a number of challenges that limit the ability of intervention scientists to effectively work toward their goal of preparing students to effectively navigate a changing and uncertain world. A comprehensive framework is presented to aid understanding of how interventions that target motivational processes in education produce downstream effects years after implementation. This framework distinguishes between three types of processes through which interventions may produce long-term effects: recursive processes (feedback loops by which positive effects can build on themselves over time), non-recursive chains of effects ("domino effects" in which proximal outcomes affect distinct distal outcomes), and latent intrapersonal effects (changed habits, knowledge, or perceptions that affect how students respond in different situations in the future). The framework is applied to intervention research that has reported long-term effects of motivation interventions, evidence for the processes described in this framework is evaluated, and suggestions are presented for how researchers can use the framework to improve intervention design. The chapter concludes with a discussion of how application of this framework can help intervention scientists to achieve their goal of positively influencing students' lifelong trajectories, especially in times of change and uncertainty.

Choose Your Own Intervention: Using Choice to Enhance the Effectiveness of a Utility-Value Intervention.

Utility-value interventions, in which students are asked to make connections between course material and their lives, are useful for improving students' academic outcomes in science courses. These interventions are thought to be successful in part because the intervention activities afford students autonomy while they complete them, but no research has explored directly whether interventions that include more support for autonomy are more effective. In this study, the degree of choice incorporated in a utility-value intervention was systematically varied in order to test this possibility. We assigned college biology students (n = 406) to a high-choice utility-value intervention condition (choose between two formats- essay or letter- for each of 3 writing assignments), one of two low-choice intervention conditions (complete either an essay and then a letter, or vice versa, and choose a format for the third assignment), or a control condition (summarize course material 3 times). Students in the high-choice condition reported significantly higher perceived utility value and interest for biology course content compared to students in the low-choice conditions. There were also significant, but small, indirect effects of choice on students' final course grades and enrollment in the next course in the biology sequence via perceived utility value and interest. Results suggest that social-psychological interventions which include more choice are likely to be more effective than those which include less choice.

Personalized Education to Increase Interest.

A long-standing ideal of school education has been to connect instruction to a student's life outside school in order to render subject matter interesting. New technologies enable instructors to personalize learning materials to increase situational interest. After distinguishing three main methods to personalize education (context personalization, choice, and active personalization), we review recent intervention studies designed to increase situational interest, which is necessary for the emergence of individual interest. Across all three kinds of interventions, some studies point to the possibility of increasing interest for students low in initial interest. Despite progress in developing personalized interventions for school practice, research on the theoretical mechanisms behind the success of the interventions has just begun.