Are all hands-on activities equally effective? Effect of using plastic models, organ dissections, and virtual dissections on student learning and perceptions.

This study investigated the impact of three commonly used cardiovascular model-assisted activities on student learning and student attitudes and perspectives about science. College students enrolled in a Human Anatomy and Physiology course were randomly assigned to one of three experimental groups (organ dissections, virtual dissections, or plastic models). Each group received a 15-min lecture followed by a 45-min activity with one of the treatments. Immediately after the lesson and then 2 mo later, students were tested on anatomy and physiology knowledge and completed an attitude survey. Students who used plastic models achieved significantly higher overall scores on both the initial and followup exams than students who performed organ or virtual dissections. On the initial exam, students in the plastic model and organ dissection treatments scored higher on anatomy questions than students who performed virtual dissections. Students in the plastic model group scored higher than students who performed organ dissections on physiology questions. On the followup exam, when asked anatomy questions, students in the plastic model group scored higher than dissection students and virtual dissection students. On attitude surveys, organ dissections had higher perceived value and were requested for inclusion in curricula twice as often as any other activity. Students who performed organ dissections were more likely than the other treatment groups to agree with the statement that "science is fun," suggesting that organ dissections may promote positive attitudes toward science. The findings of this study provide evidence for the importance of multiple types of hands-on activities in anatomy laboratory courses.

Factors Predicting the Extent to which STEM Students Value Cross-Disciplinary Skills: A Study across Four Institutions.

Expectancy-value theory of motivation (EVT) suggests that student values influence their likelihood of putting in the effort required to learn, and these values can be shaped by student characteristics, such as their experiences, sociodemographics, and disciplinary norms. To understand the extent to which these characteristics relate to students' values, we surveyed 1162 graduating science, technology, engineering, and mathematics (STEM) students across four universities using the previously developed and validated Survey of Teaching Beliefs and Practices for Undergraduates (STEP-U). The STEP-U survey included Likert questions to capture students' values of 27 cross-disciplinary skills and the frequency with which they experienced 27 instructional methods thought to develop particular skills. Exploratory factor analyses (EFA) showed an understandable factor structure for both students' perceived value of cross-disciplinary skills and frequency of classroom experiences. Using multiple regression, we identified differences in values that were associated with classroom experiences, STEM discipline, participation in undergraduate research, and student sociodemographics. Findings were generalizable across institutions and disciplines. The theoretical framework (EVT), the broad data collection (four institutions with multiple disciplines), and the type of data analyses (e.g., EFA) used provide theoretical, methodological, and practical contributions and suggest additional directions for future research.

The Conceptualization of Quantitative Reasoning among Introductory Biology Faculty.

Quantitative reasoning (QR) skills have become a critical competency for undergraduate biology students, and recommendations for curricular reform urge QR training throughout undergraduate biology programs. Much research has been directed at course design, pedagogy, and student challenges in QR, but less research has been directed toward understanding how biology faculty conceptualize the QR skills they are called upon to teach. We conducted in-depth, semistructured interviews with 15 participants teaching introductory biology courses to learn how faculty conceptualize QR at the introductory level. Using phenomenology, responses were coded to establish inductive codes. We found that two themes emerged from the coded conceptualizations: sophisticated, cognitively complex QR skills and basic QR skills. Participants placed emphasis on the more complex QR skills as being important in the undergraduate curriculum, beginning at the introductory level. Participants' conceptualizations of QR aligned with skills called for in curriculum reform, but the perceived notion of "basic" for some skills may not align with the literature. This suggests that more is needed in aligning faculty conceptualization of QR with curriculum, pedagogy, and assessment.

An integrated model for interdisciplinary graduate education: Computation and mathematics for biological networks.

The current challenges at the forefront of data-enabled science and engineering require interdisciplinary solutions. Yet most traditional doctoral programs are not structured to support successful interdisciplinary research. Here we describe the design of and students' experiences in the COMBINE (Computation and Mathematics for Biological Networks) interdisciplinary graduate program at the University of Maryland. COMBINE focuses on the development and application of network science methods to biological systems for students from three primary domains: life sciences, computational/engineering sciences, and mathematical/physical sciences. The program integrates three established models (T-shaped, pi-shaped and shield-shaped) for interdisciplinary training. The program components largely fall into three categories: (1) core coursework that provides content expertise, communication, and technical skills, (2) discipline-bridging elective courses in the two COMBINE domains that complement the student's home domain, (3) broadening activities such as workshops, symposiums, and formal peer-mentoring groups. Beyond these components, the program builds community through both formal and informal networking and social events. In addition to the interactions with other program participants, students engage with faculty in several ways beyond the conventional adviser framework, such as the requirement to select a second out-of-field advisor, listening to guest speakers, and networking with faculty through workshops. We collected data through post-program surveys, interviews and focus groups with students, alumni and faculty advisors. Overall, COMBINE students and alumni reported feeling that the program components supported their growth in the three program objectives of Network Science & Interdisciplinarity, Communication, and Career Preparation, but also recommended ways to improve the program. The value of the program can be seen not only through the student reports, but also through the students' research products in network science which include multiple publications and presentations. We believe that COMBINE offers an effective model for integrated interdisciplinary training that can be readily applied in other fields.

Enhancing Graduate Students' Ability to Conduct and Communicate Research through an Interdisciplinary Lens.

This research is a part of a longitudinal study of the Computation and Mathematics for Biological Networks (COMBINE) program at the University of Maryland. The mission of COMBINE is to train doctoral students from a wide range of fields to pursue interdisciplinary research. Here, we focus on one component of COMBINE, a semester-long course titled Data Practicum at the Intersection of the Physical, Computer, and Life Sciences. The goal of this study was to explore the effectiveness of the teaching practices that were used in the Data Practicum. We investigated their impact on graduate students' confidence to conduct research through an interdisciplinary lens and to communicate their research to diverse audiences. We used validated pre- and post-course online surveys, in-class observations, collection of artifacts, and interviews. Interviewed students and instructors highlighted the course's iterative process, peer review system, and unique incorporation of outside research already being conducted by students as the most impactful aspects of the course. Based on students' reports and artifacts, the Data Practicum was successful in helping them to communicate their research visually, orally, and in text to a wide and varied audience, to critically review others' work, inside and outside their discipline, and to develop awareness of research in other disciplines. We observed that it is possible to enhance interdisciplinary communication skills through an iterative teaching approach that gives students a chance to incorporate feedback from multiple sources. This course could serve as a model for other graduate programs wishing to increase training in interdisciplinary skills.

Using a Concept Inventory to Reveal Student Thinking Associated with Common Misconceptions about Antibiotic Resistance.

Misconceptions, also known as alternate conceptions, about key concepts often hinder the ability of students to learn new knowledge. Concept inventories (CIs) are designed to assess students' understanding of key concepts, especially those prone to misconceptions. Two-tiered CIs include prompts that ask students to explain the logic behind their answer choice. Such two-tiered CIs afford an opportunity for faculty to explore the student thinking behind the common misconceptions represented by their choice of a distractor. In this study, we specifically sought to probe the misconceptions that students hold prior to beginning an introductory microbiology course (i.e., preconceptions). Faculty-learning communities at two research-intensive universities used the validated Host-Pathogen Interaction Concept Inventory (HPI-CI) to reveal student preconceptions. Our method of deep analysis involved communal review and discussion of students' explanations for their CI answer choice. This approach provided insight valuable for curriculum development. Here the process is illustrated using one question from the HPI-CI related to the important topic of antibiotic resistance. The frequencies with which students chose particular multiple-choice responses for this question were highly correlated between institutions, implying common underlying misconceptions. Examination of student explanations using our analysis approach, coupled with group discussions within and between institutions, revealed patterns in student thinking to the participating faculty. Similar application of a two-tiered concept inventory by general microbiology instructors, either individually or in groups, at other institutions will allow them to better understand student thinking related to key concepts in their curriculum.

A Case Study Documenting the Process by Which Biology Instructors Transition from Teacher-Centered to Learner-Centered Teaching.

In this study, we used a case study approach to obtain an in-depth understanding of the change process of two university instructors who were involved with redesigning a biology course. Given the hesitancy of many biology instructors to adopt evidence-based, learner-centered teaching methods, there is a critical need to understand how biology instructors transition from teacher-centered (i.e., lecture-based) instruction to teaching that focuses on the students. Using the innovation-decision model for change, we explored the motivation, decision-making, and reflective processes of the two instructors through two consecutive, large-enrollment biology course offerings. Our data reveal that the change process is somewhat unpredictable, requiring patience and persistence during inevitable challenges that arise for instructors and students. For example, the change process requires instructors to adopt a teacher-facilitator role as opposed to an expert role, to cover fewer course topics in greater depth, and to give students a degree of control over their own learning. Students must adjust to taking responsibility for their own learning, working collaboratively, and relinquishing the anonymity afforded by lecture-based teaching. We suggest implications for instructors wishing to change their teaching and administrators wishing to encourage adoption of learner-centered teaching at their institutions.

Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers.

Most discipline-based education researchers (DBERs) were formally trained in the methods of scientific disciplines such as biology, chemistry, and physics, rather than social science disciplines such as psychology and education. As a result, DBERs may have never taken specific courses in the social science research methodology--either quantitative or qualitative--on which their scholarship often relies so heavily. One particular aspect of (quantitative) social science research that differs markedly from disciplines such as biology and chemistry is the instrumentation used to quantify phenomena. In response, this Research Methods essay offers a contemporary social science perspective on test validity and the validation process. The instructional piece explores the concepts of test validity, the validation process, validity evidence, and key threats to validity. The essay also includes an in-depth example of a validity argument and validation approach for a test of student argument analysis. In addition to DBERs, this essay should benefit practitioners (e.g., lab directors, faculty members) in the development, evaluation, and/or selection of instruments for their work assessing students or evaluating pedagogical innovations.

Validation and Application of the Survey of Teaching Beliefs and Practices for Undergraduates (STEP-U): Identifying Factors Associated with Valuing Important Workplace Skills among Biology Students.

We present a novel assessment tool for measuring biology students' values and experiences across their undergraduate degree program. Our Survey of Teaching Beliefs and Practices for Undergraduates (STEP-U) assesses the extent to which students value skills needed for the workplace (e.g., ability to work in groups) and their experiences with teaching practices purported to promote such skills (e.g., group work). The survey was validated through factor analyses in a large sample of biology seniors (n = 1389) and through response process analyses (five interviewees). The STEP-U skills items were characterized by two underlying factors: retention (e.g., memorization) and transfer (e.g., knowledge application). Multiple linear regression models were used to examine relationships between classroom experiences, values, and student characteristics (e.g., gender, cumulative grade point average [GPA], and research experience). Student demographic and experiential factors predicted the extent to which students valued particular skills. Students with lower GPAs valued retention skills more than those with higher GPAs. Students with research experience placed greater value on scientific writing and interdisciplinary understanding. Greater experience with specific teaching practices was associated with valuing the corresponding skills more highly. The STEP-U can provide feedback vital for designing curricula that better prepare students for their intended postgraduate careers.

Enhancing Scientific Literacy in the Undergraduate Cell Biology Laboratory Classroom.

This paper describes the implementation of the Scientific Literacy in Cell Biology (SLCB) curriculum in an undergraduate biology laboratory course. The SLCB curriculum incorporated the reading and discussion of primary literature into hands-on and collaborative practical experiences. It was implemented in five stages over an 11-week period, during which students were also introduced to the theory and practice of common cell biology techniques. We report on the effectiveness of the course, as measured by pre- and post-course survey data probing students' content knowledge and their level of familiarity, confidence, and experience with different skills pertaining to analyzing (reading, interpreting, and discussing) primary literature. In the spring 2015 semester, 287 (72%) of the 396 students who were enrolled in the laboratory completed both the pre- and post-course survey. The average score on the content questions of the post-course survey was significantly higher (p < 0.0001) than the average score on the pre-course survey. Students reported that they gained greater familiarity, experience, and confidence in the skills that were measured. Our findings may aid in reforming higher-education science laboratory courses to better promote writing, reading, data processing, and presentation skills. Journal of Microbiology & Biology Education.

The Use of Group Activities in Introductory Biology Supports Learning Gains and Uniquely Benefits High-Achieving Students.

This study describes the implementation and effectiveness of small-group active engagement (GAE) exercises in an introductory biology course (BSCI207) taught in a large auditorium setting. BSCI207 (Principles of Biology III-Organismal Biology) is the third introductory core course for Biological Sciences majors. In fall 2014, the instructors redesigned one section to include GAE activities to supplement lecture content. One section (n = 198) employed three lectures per week. The other section (n = 136) replaced one lecture per week with a GAE class. We explored the benefits and challenges associated with implementing GAE exercises and their relative effectiveness for unique student groups (e.g., minority students, high- and low-grade point average [GPA] students). Our findings show that undergraduates in the GAE class exhibited greater improvement in learning outcomes than undergraduates in the traditional class. Findings also indicate that high-achieving students experienced the greatest benefit from GAE activities. Some at-risk student groups (e.g., two-year transfer students) showed comparably low learning gains in the course, despite the additional support that may have been afforded by active learning. Collectively, these findings provide valuable feedback that may assist other instructors who wish to revise their courses and recommendations for institutions regarding prerequisite coursework approval policies.

A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research.

Biology graduate teaching assistants (GTAs) are significant contributors to the educational mission of universities, particularly in introductory courses, yet there is a lack of empirical data on how to best prepare them for their teaching roles. This essay proposes a conceptual framework for biology GTA teaching professional development (TPD) program evaluation and research with three overarching variable categories for consideration: outcome variables, contextual variables, and moderating variables. The framework's outcome variables go beyond GTA satisfaction and instead position GTA cognition, GTA teaching practice, and undergraduate learning outcomes as the foci of GTA TPD evaluation and research. For each GTA TPD outcome variable, key evaluation questions and example assessment instruments are introduced to demonstrate how the framework can be used to guide GTA TPD evaluation and research plans. A common conceptual framework is also essential to coordinating the collection and synthesis of empirical data on GTA TPD nationally. Thus, the proposed conceptual framework serves as both a guide for conducting GTA TPD evaluation at single institutions and as a means to coordinate research across institutions at a national level.

Preparing Biology Graduate Teaching Assistants for Their Roles as Instructors: An Assessment of Institutional Approaches.

The inconsistency of professional development (PD) in teaching for graduate teaching assistants (GTAs) is a widespread problem in higher education. Although GTAs serve an important role in retention of undergraduate science majors and in promotion of scientific literacy in nonmajors, they often lack preparation and ongoing support for teaching. Given the recent national focus on instructional quality in introductory courses, our goal was to use an online survey to identify current practices of teaching PD for biology GTAs and compare these results with the last national survey on this topic. In responses from 71 participant institutions, 96% reported some mandatory teaching preparation for biology GTAs; however, 52% of these programs required 10 or fewer hours per year. Respondents wanted to change their programs to include more pedagogical information and teaching observations with feedback to their GTAs. Programmatic self-ratings of satisfaction with GTA PD were positively correlated with the number of topics discussed during PD. Although more schools are requiring GTA PD for teaching compared with the last national survey, the lack of program breadth at many schools warrants a national conversation with regard to recent calls for improving undergraduate instruction.

Antiviral drug research proposal activity.

The development of antiviral drugs provides an excellent example of how basic and clinical research must be used together in order to achieve the final goal of treating disease. A Research Oriented Learning Activity was designed to help students to better understand how basic and clinical research can be combined toward a common goal. Through this project students gained a better understanding of the process of scientific research and increased their information literacy in the field of virology. The students worked as teams to research the many aspects involved in the antiviral drug design process, with each student becoming an "expert" in one aspect of the project. The Antiviral Drug Research Proposal (ADRP) culminated with students presenting their proposals to their peers and local virologists in a poster session. Assessment data showed increased student awareness and knowledge of the research process and the steps involved in the development of antiviral drugs as a result of this activity.

Improving Scientific Research and Writing Skills through Peer Review and Empirical Group Learning.

Here we describe a semester-long, multipart activity called "Read and wRite to reveal the Research process" (R(3)) that was designed to teach students the elements of a scientific research paper. We implemented R(3) in an advanced immunology course. In R(3), we paralleled the activities of reading, discussion, and presentation of relevant immunology work from primary research papers with student writing, discussion, and presentation of their own lab findings. We used reading, discussing, and writing activities to introduce students to the rationale for basic components of a scientific research paper, the method of composing a scientific paper, and the applications of course content to scientific research. As a final part of R(3), students worked collaboratively to construct a Group Research Paper that reported on a hypothesis-driven research project, followed by a peer review activity that mimicked the last stage of the scientific publishing process. Assessment of student learning revealed a statistically significant gain in student performance on writing in the style of a research paper from the start of the semester to the end of the semester.

Investigating how streptococcus responds to their environment: bringing together current research, a case study and laboratory investigation.

Understanding the link between course work and unanswered authentic research questions being explored in the research lab is an important goal in undergraduate science teaching. The activity presented here focuses on current research regarding the virulence characteristics of Streptococcus pyogenes particularly targeting the control of sugar uptake regulated via catabolite repression. Students were challenged to formulate a research question and use higher-order thinking skills to analyze data, work collaboratively to solve problems, and pose and test a hypothesis in the laboratory setting. The activity employed an interrupted case study approach using both online and face-to-face settings. The case story and problems were distributed online and were followed by in-class discussions and lab work. Aspects of the activity required independent thinking, as well as collaborative work. Student learning gains were demonstrated via comparison of pre- and postscores on the Host Pathogen Interactions (HPI) concept inventory, results from an end of semester Student Perception Survey, and from analysis of students' work.

Learning Outcomes with Linked Assessments - an Essential Part of our Regular Teaching Practice.

Setting up learning outcomes with linked assessments is a best practice in science education. In biology teaching, faculty are beginning to establish learning outcomes and assessments in the style of concept inventories. At a recent meeting of biology faculty who have designed concept inventories, the characteristics and uses of concept inventories were defined. Concept inventories used as pre- and post-measures of student learning provide a window into students' understanding of key concepts of a discipline and serve as a tool to motivate faculty toward evidence-based teaching habits. A movement for the development of a microbiology concept inventory is suggested.