Designing Activities to Teach Higher-Order Skills: How Feedback and Constraint Affect Learning of Experimental Design.

Active learning approaches to biology teaching, including simulation-based activities, are known to enhance student learning, especially of higher-order skills; nonetheless, there are still many open questions about what features of an activity promote optimal learning. Here we designed three versions of a simulation-based tutorial called Understanding Experimental Design that asks students to design experiments and collect data to test their hypotheses. The three versions vary the experimental design task along the axes of feedback and constraint, where constraint measures how much choice students have in performing a task. Using a variety of assessments, we ask whether each of those features affects student learning of experimental design. We find that feedback has a direct positive effect on learning. We further find that small changes in constraint have only subtle and mostly indirect effects on learning. This work suggests that designers of tools for teaching higher-order skills should strive to include feedback to increase impact and may feel freer to vary the degree of constraint within a range to optimize for other features such as the ability to provide immediate feedback and time-on-task.

Reframing Educational Outcomes: Moving beyond Achievement Gaps.

The term "achievement gap" has a negative and racialized history, and using the term reinforces a deficit mindset that is ingrained in U.S. educational systems. In this essay, we review the literature that demonstrates why "achievement gap" reflects deficit thinking. We explain why biology education researchers should avoid using the phrase and also caution that changing vocabulary alone will not suffice. Instead, we suggest that researchers explicitly apply frameworks that are supportive, name racially systemic inequities and embrace student identity. We review four such frameworks-opportunity gaps, educational debt, community cultural wealth, and ethics of care-and reinterpret salient examples from biology education research as an example of each framework. Although not exhaustive, these descriptions form a starting place for biology education researchers to explicitly name systems-level and asset-based frameworks as they work to end educational inequities.

A Community-Building Framework for Collaborative Research Coordination across the Education and Biology Research Disciplines.

Since 2009, the U.S. National Science Foundation Directorate for Biological Sciences has funded Research Coordination Networks (RCN) aimed at collaborative efforts to improve participation, learning, and assessment in undergraduate biology education (UBE). RCN-UBE projects focus on coordination and communication among scientists and educators who are fostering improved and innovative approaches to biology education. When faculty members collaborate with the overarching goal of advancing undergraduate biology education, there is a need to optimize collaboration between participants in order to deeply integrate the knowledge across disciplinary boundaries. In this essay we propose a novel guiding framework for bringing colleagues together to advance knowledge and its integration across disciplines, the "Five 'C's' of Collaboration: Commitment, Collegiality, Communication, Consensus, and Continuity." This guiding framework for professional network practice is informed by both relevant literature and empirical evidence from community-building experience within the RCN-UBE Advancing Competencies in Experimentation-Biology (ACE-Bio) Network. The framework is presented with practical examples to illustrate how it might be used to enhance collaboration between new and existing participants in the ACE-Bio Network as well as within other interdisciplinary networks.

The Dominance Concept Inventory: A Tool for Assessing Undergraduate Student Alternative Conceptions about Dominance in Mendelian and Population Genetics.

Despite the impact of genetics on daily life, biology undergraduates understand some key genetics concepts poorly. One concept requiring attention is dominance, which many students understand as a fixed property of an allele or trait and regularly conflate with frequency in a population or selective advantage. We present the Dominance Concept Inventory (DCI), an instrument to gather data on selected alternative conceptions about dominance. During development of the 16-item test, we used expert surveys (n = 12), student interviews (n = 42), and field tests (n = 1763) from introductory and advanced biology undergraduates at public and private, majority- and minority-serving, 2- and 4-yr institutions in the United States. In the final field test across all subject populations (n = 709), item difficulty ranged from 0.08 to 0.84 (0.51 ± 0.049 SEM), while item discrimination ranged from 0.11 to 0.82 (0.50 ± 0.048 SEM). Internal reliability (Cronbach's alpha) was 0.77, while test-retest reliability values were 0.74 (product moment correlation) and 0.77 (intraclass correlation). The prevalence of alternative conceptions in the field tests shows that introductory and advanced students retain confusion about dominance after instruction. All measures support the DCI as a useful instrument for measuring undergraduate biology student understanding and alternative conceptions about dominance.

The genetic drift inventory: a tool for measuring what advanced undergraduates have mastered about genetic drift.

Understanding genetic drift is crucial for a comprehensive understanding of biology, yet it is difficult to learn because it combines the conceptual challenges of both evolution and randomness. To help assess strategies for teaching genetic drift, we have developed and evaluated the Genetic Drift Inventory (GeDI), a concept inventory that measures upper-division students' understanding of this concept. We used an iterative approach that included extensive interviews and field tests involving 1723 students across five different undergraduate campuses. The GeDI consists of 22 agree-disagree statements that assess four key concepts and six misconceptions. Student scores ranged from 4/22 to 22/22. Statements ranged in mean difficulty from 0.29 to 0.80 and in discrimination from 0.09 to 0.46. The internal consistency, as measured with Cronbach's alpha, ranged from 0.58 to 0.88 across five iterations. Test-retest analysis resulted in a coefficient of stability of 0.82. The true-false format means that the GeDI can test how well students grasp key concepts central to understanding genetic drift, while simultaneously testing for the presence of misconceptions that indicate an incomplete understanding of genetic drift. The insights gained from this testing will, over time, allow us to improve instruction about this key component of evolution.

Short lesson plan associated with increased acceptance of evolutionary theory and potential change in three alternate conceptions of macroevolution in undergraduate students.

Undergraduates commonly harbor alternate conceptions about evolutionary biology; these alternate conceptions often persist, even after intensive instruction, and may influence acceptance of evolution. We interviewed undergraduates to explore their alternate conceptions about macroevolutionary patterns and designed a 2-h lesson plan to present evidence that life has evolved. We identified three alternate conceptions during our interviews: that newly derived traits would be more widespread in extant species than would be ancestral traits, that evolution proceeds solely by anagenesis, and that lineages must become more complex over time. We also attempted to measure changes in the alternate conceptions and levels of acceptance of evolutionary theory in biology majors and nonmajors after exposure to the lesson plan. The instrument used to assess understanding had flaws, but our results are suggestive of mixed effects: we found a reduction in the first alternate conception, no change in the second, and reinforcement of the third. We found a small, but significant, increase in undergraduate acceptance of evolutionary theory in two trials of the lesson plan (Cohen's d effect sizes of 0.51 and 0.19). These mixed results offer guidance on how to improve the lesson and show the potential of instructional approaches for influencing acceptance of evolution.