Formative assessment and student understanding of structure-function.

The structure and function relationship is a core concept identified by physiology faculty. Prior research has shown this may be a difficult concept for students to understand. Formative written assessments, such as short answer essay questions, allow students to demonstrate their thinking by encouraging students to use their diverse ideas to construct their responses. Varying the context of a question, such as the inclusion of a scenario, may be used to provide insight into the different stages of students' emerging biological expertise. Short answer questions based on the core concept structure↔function were administered to students in a junior level General Physiology course and a sophomore level Human Anatomy and Physiology course at a large southeastern public university. Questions were based on the integumentary, muscular, digestive, and cardiovascular systems. Student responses were scored with a conceptual rubric developed for each question prompt as well as each organ system represented in the question prompts. Students were interviewed to determine if their responses to the short answer questions accurately reflected their thinking. Less than half of the student responses in this study demonstrated a conceptual understanding of the structure-function relationship. Students demonstrated different conceptual understanding of structure↔function concepts depending on the question prompt with a scenario versus the question prompt without a scenario. The question prompts with scenarios versus non-scenarios provided a different context, which may have influenced student explanations. These results suggest that instructors should provide students with questions in varying contexts to allow students to demonstrate their heterogeneous ideas about a concept.NEW & NOTEWORTHY Formative assessment provides feedback to both students and instructors about the process of learning. The core concept structure-function provides a foundation upon which many topics in anatomy and physiology can be built across all levels of organization. This study contributes to existing research about student conceptual understanding of the core concepts. Implications for practitioners include the design of formative assessments and a suite of questions to be used to gauge student understanding of structure-function.

Moving towards More Diverse and Welcoming Conference Spaces: Data-Driven Perspectives from Biology Education Research Scholars.

Academic conferences are integral to the dissemination of novel research findings and discussion of pioneering ideas across all postsecondary disciplines. For some participants, these environments are spaces to develop new collaborations, research projects, and social bonds; however, for others, conferences can be a place of marginalization and outright hostility. To assess how diverse individuals experience conference spaces, we interpreted results from a conference climate survey filled out by 198 of 482 registrants of the Society for the Advancement of Biology Education Research (SABER) West 2021 conference. Analysis of the survey data was conducted by six biology education researchers, who in addition to raising conference participant voices, provide insights, and next steps whose implementation can promote greater participant equity, representation, and engagement in future science, technology, engineering, and math (STEM) education conferences specifically and potentially all academic conference spaces more broadly.

Innovative teaching knowledge stays with users.

Programs seeking to transform undergraduate science, technology, engineering, and mathematics courses often strive for participating faculty to share their knowledge of innovative teaching practices with other faculty in their home departments. Here, we provide interview, survey, and social network analyses revealing that faculty who use innovative teaching practices preferentially talk to each other, suggesting that greater steps are needed for information about innovative practices to reach faculty more broadly.

Through the Eyes of Faculty: Using Personas as a Tool for Learner-Centered Professional Development.

College science instructors need continuous professional development (PD) to meet the call to evidence-based practice. New PD efforts need to focus on the nuanced blend of factors that influence instructors' teaching practices. We used persona methodology to describe the diversity among instructors who were participating in a long-term PD initiative. Persona methodology originates from ethnography. It takes data from product users and compiles those data in the form of fictional characters. Personas facilitate user-centered design. We identified four personas among our participants: Emma the Expert views herself as the subject-matter expert in the classroom and values her hard-earned excellence in lecturing. Ray the Relater relates to students and focuses on their points of view about innovative pedagogies. Carmen the Coach coaches her students by setting goals for them and helping them develop skill in scientific practices. Beth the Burdened owns the responsibility for her students' learning and feels overwhelmed that students still struggle despite her use of evidence-based practice. Each persona needs unique PD. We suggest ways that PD facilitators can use our personas as a reflection tool to determine how to approach the learners in their PD. We also suggest further avenues of research on learner-centered PD.

Question order and student understanding of structure and function.

The relationship between structure and function is a core concept in physiology education. Written formative assessments can provide insight into student learning of the structure and function relationship, which can then inform pedagogy. However, question order may influence student explanations. We explored how the order of questions from different cognitive levels affects student explanations. A junior level General Physiology class was randomly split in half. One-half of the students answered, "Define the principle: form reflects function," followed by "Give an example of the principle: form reflects function" (format DX), whereas the other half answered, "Give an example of the principle: form reflects function," followed by "Define the principle: form reflects function" (format XD). Human grading and computerized lexical analysis were used to evaluate student responses. Two percent of students in the format DX group related structure and function in their definition, whereas 48% of students related structure and function in their examples. In the format XD group, 17% related structure and function in their definition, and 26% related structure and function in their example of the principle. Overall, students performed better on the last question in the sequence, which may be evidence for conceptual priming. Computerized lexical analysis revealed that students draw on only a few levels of organization and may be used by instructors to quickly assess the levels of organization students use in their responses. Written assessment coupled with lexical analysis has the potential to reveal student understanding of core concepts in anatomy and physiology education.

A Faculty Professional Development Model That Improves Student Learning, Encourages Active-Learning Instructional Practices, and Works for Faculty at Multiple Institutions.

Helping faculty develop high-quality instruction that positively affects student learning can be complicated by time limitations, a lack of resources, and inexperience using student data to make iterative improvements. We describe a community of 16 faculty from five institutions who overcame these challenges and collaboratively designed, taught, iteratively revised, and published an instructional unit about the potential effect of mutations on DNA replication, transcription, and translation. The unit was taught to more than 2000 students in 18 courses, and student performance improved from preassessment to postassessment in every classroom. This increase occurred even though faculty varied in their instructional practices when they were teaching identical materials. We present information on how this faculty group was organized and facilitated, how members used student data to positively affect learning, and how they increased their use of active-learning instructional practices in the classroom as a result of participation. We also interviewed faculty to learn more about the most useful components of the process. We suggest that this professional development model can be used for geographically separated faculty who are interested in working together on a known conceptual difficulty to improve student learning and explore active-learning instructional practices.

What Motivates Biology Instructors to Engage and Persist in Teaching Professional Development?

We conducted a study of 19 biology instructors participating in small, local groups at six research-intensive universities connected to the Automated Analysis of Constructed Response (AACR) project (www.msu.edu/∼aacr). Our aim was to uncover participants' motivation to persist in a long-term teaching professional development effort, a topic that is understudied in discipline-based educational research. We interviewed each participant twice over a 2-year period and conducted qualitative analyses on the data, using expectancy-value theory as a framework for considering motivation. Our analyses revealed that motivation among instructors was high due to their enjoyment of the AACR groups. The high level of motivation is further explained by the fact that AACR groups facilitated instructor involvement with the larger AACR project. We also found that group dynamics encouraged persistence; instructors thought they might never talk with colleagues about teaching in the absence of AACR groups; and groups were perceived to have a low-enough time requirement to warrant sustained involvement. We conclude that instructors have persisted in AACR groups because the groups provided great value with limited cost. The characterization of instructor experiences described here can contribute to a better understanding of faculty needs in teaching professional development.

Using Student Writing and Lexical Analysis to Reveal Student Thinking about the Role of Stop Codons in the Central Dogma.

Previous work has shown that students have persistent difficulties in understanding how central dogma processes can be affected by a stop codon mutation. To explore these difficulties, we modified two multiple-choice questions from the Genetics Concept Assessment into three open-ended questions that asked students to write about how a stop codon mutation potentially impacts replication, transcription, and translation. We then used computer-assisted lexical analysis combined with human scoring to categorize student responses. The lexical analysis models showed high agreement with human scoring, demonstrating that this approach can be successfully used to analyze large numbers of student written responses. The results of this analysis show that students' ideas about one process in the central dogma can affect their thinking about subsequent and previous processes, leading to mixed models of conceptual understanding.

Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment.

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors.

Examining the impact of question surface features on students' answers to constructed-response questions on photosynthesis.

One challenge in science education assessment is that students often focus on surface features of questions rather than the underlying scientific principles. We investigated how student written responses to constructed-response questions about photosynthesis vary based on two surface features of the question: the species of plant and the order of two question prompts. We asked four versions of the question with different combinations of the two plant species and order of prompts in an introductory cell biology course. We found that there was not a significant difference in the content of student responses to versions of the question stem with different species or order of prompts, using both computerized lexical analysis and expert scoring. We conducted 20 face-to-face interviews with students to further probe the effects of question wording on student responses. During the interviews, we found that students thought that the plant species was neither relevant nor confusing when answering the question. Students identified the prompts as both relevant and confusing. However, this confusion was not specific to a single version.

What are they thinking? Automated analysis of student writing about acid-base chemistry in introductory biology.

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an introductory biology course. Students were asked to predict acid-base behavior of biological functional groups and to explain their answers. Student explanations were rated by two independent raters. Responses were also analyzed using SPSS Text Analysis for Surveys and a custom library of science-related terms and lexical categories relevant to the assessment item. These analyses revealed conceptual connections made by students, student difficulties explaining these topics, and the heterogeneity of student ideas. We validated the lexical analysis by correlating student interviews with the lexical analysis. We used discriminant analysis to create classification functions that identified seven key lexical categories that predict expert scoring (interrater reliability with experts = 0.899). This study suggests that computerized lexical analysis may be useful for automatically categorizing large numbers of student open-ended responses. Lexical analysis provides instructors unique insights into student thinking and a whole-class perspective that are difficult to obtain from multiple-choice questions or reading individual responses.