Chemistry Education Research-From Personal Empiricism to Evidence, Theory, and Informed Practice.

This Review of Chemistry Education Research (CER) provides an overview of the development of research in chemistry education from the early days, when ideas about how to teach chemistry and help students learn were guided by practitioner wisdom, to current research that is based on theories of learning and provides evidence from which to make arguments about improving teaching and learning. We introduce the dominant learning theories that have guided CER over the years and attempt to show how they have been integrated into modern research in chemistry education. We also provide examples of how this research can be used to inform the development and use of educational materials. Because CER literature is vast, we chose to limit the research we reviewed to those studies that help us answer three driving questions: (1) What should students know and be able to do with that knowledge? (2) How will we know that students have developed a coherent and useful understanding of chemistry? (3) What evidence do we have about how to help students develop a deep and robust understanding of chemistry?

Evidence-based reform of teaching and learning.

Over the years a great deal of time and attention has been devoted to reform of teaching and learning in chemistry. However, many of these efforts have focused on individual faculty's experiences and intuition, rather than our understanding of how people learn or evidence about the effects of such reforms. For example, while it is widely known that students emerge from our courses with non-scientific ideas about core concepts, the reasons why this happens are often ascribed to the students' lack of ability or work ethic. However, there is emerging evidence that both the traditional pedagogical approach and the structure of the curriculum contribute to this problem. Students must be provided both with a strong foundation on which to build and link new knowledge, and an understanding of what that knowledge will be used for. In order to achieve this we need to rely on the research base and evidence emerging from discipline-based education research (DBER)-a field that combines deep disciplinary expertise with knowledge and understanding of the science of teaching and learning. This paper presents a short overview of these ideas.

Beyond active learning: Using 3-Dimensional learning to create scientifically authentic, student-centered classrooms.

In recent years, much of the emphasis for transformation of introductory STEM courses has focused on "active learning", and while this approach has been shown to produce more equitable outcomes for students, the construct of "active learning" is somewhat ill-defined and is often used as a "catch-all" that can encompass a wide range of pedagogical techniques. Here we present an alternative approach for how to think about the transformation of STEM courses that focuses instead on what students should know and what they can do with that knowledge. This approach, known as three-dimensional learning (3DL), emerged from the National Academy's "A Framework for K-12 Science Education", which describes a vision for science education that centers the role of constructing productive causal accounts for phenomena. Over the past 10 years, we have collected data from introductory biology, chemistry, and physics courses to assess the impact of such a transformation on higher education courses. Here we report on an analysis of video data of class sessions that allows us to characterize these sessions as active, 3D, neither, or both 3D and active. We find that 3D classes are likely to also involve student engagement (i.e. be active), but the reverse is not necessarily true. That is, focusing on transformations involving 3DL also tends to increase student engagement, whereas focusing solely on student engagement might result in courses where students are engaged in activities that do not involve meaningful engagement with core ideas of the discipline.

How Do Instructors Explain The Mechanism by which ATP Drives Unfavorable Processes?

Concerns regarding students' difficulties with the concept of energy date back to the 1970s. They become particularly apparent for systems involving adenosine triphosphate (ATP), which plays a central role in maintaining the nonequilibrium state of biological systems and in driving energetically unfavorable processes. One of the most well-documented misconceptions related to ATP is the idea that breaking bonds releases energy, when the opposite is true. This misconception is often attributed to language used in biology referring to the "high-energy bonds" in ATP. We interviewed chemistry, biology, and biochemistry instructors to learn how they think about and teach the mechanism(s) by which ATP is used as an energy source in biological systems. Across 15 interviews, we found that instructors relied primarily on two mechanisms to explain the role of ATP: 1) energy release, focused on ATP hydrolysis and bond energies; and/or 2) energy transfer, focused on phosphorylation and common intermediates. Many instructors shared negative and uncomfortable experiences related to teaching ATP and energy release. Based on these findings, we suggest instructional strategies that: 1) aim to ease the concerns expressed by introductory biology instructors, and 2) emphasize the role of ATP so as to support students' understanding of molecular mechanisms.

"Big Ideas" of Introductory Chemistry and Biology Courses and the Connections between Them.

Introductory courses are often designed to cover a range of topics with the intent to offer students exposure to the given discipline as preparation to further their study in the same or related disciplines. Unfortunately, students in these courses are often presented with an overwhelming amount of information that may not support their formation of a usable coherent network of knowledge. In this study we conducted a mixed-method sequential exploratory study with students co-enrolled in General Chemistry II and Introductory Biology I to better understand what students perceived to be the "take-home" messages of these courses (i.e., core ideas) and the connections between these courses. We found that students identified a range of ideas from both courses; further analysis of students' explanations and reasoning revealed that, when students talked about their chemistry ideas, they were more likely to talk about them as having predictive and explanatory power in comparison with reasons provided for their biology big ideas. Furthermore, students identified a number of overlapping ideas between their chemistry and biology courses, such as interactions, reactions, and structures, which have the potential to be used as a starting place to support students building a more coherent network of knowledge.

Characterizing college science instruction: The Three-Dimensional Learning Observation Protocol.

The importance of improving STEM education is of perennial interest, and to this end, the education community needs ways to characterize transformation efforts. Three-dimensional learning (3DL) is one such approach to transformation, in which core ideas of the discipline, scientific practices, and crosscutting concepts are combined to support student development of disciplinary expertise. We have previously reported on an approach to the characterization of assessments, the Three-Dimensional Learning Assessment Protocol (3D-LAP), that can be used to identify whether assessments have the potential to engage students in 3DL. Here we present the development of a companion, the Three-Dimensional Learning Observation Protocol (3D-LOP), an observation protocol that can reliably distinguish between instruction that has potential for engagement with 3DL and instruction that does not. The 3D-LOP goes beyond other observation protocols, because it is intended not only to characterize the pedagogical approaches being used in the instructional environment, but also to identify whether students are being asked to engage with scientific practices, core ideas, and crosscutting concepts. We demonstrate herein that the 3D-LOP can be used reliably to code for the presence of 3DL; further, we present data that show the utility of the 3D-LOP in differentiating between instruction that has the potential to promote 3DL from instruction that does not. Our team plans to continue using this protocol to evaluate outcomes of instructional transformation projects. We also propose that the 3D-LOP can be used to support practitioners in developing curricular materials and selecting instructional strategies to promote engagement in three-dimensional instruction.

Energy Connections and Misconnections across Chemistry and Biology.

Despite the number of university students who take courses in multiple science disciplines, little is known about how they connect concepts between disciplines. Energy is a concept that underlies all scientific phenomena and, as such, provides an appropriate context in which to investigate student connections and misconnections across disciplines. In this study, university students concurrently enrolled in introductory chemistry and biology were interviewed to explore their perceptions of the integration of energy both within and across the disciplines, and how they attempted to accommodate and reconcile different disciplinary approaches to energy, to inform future, interdisciplinary course reform. Findings suggest that, while students believed energy to be important to the scientific world and to the disciplines of biology and chemistry, the extent to which it was seen as central to success in their courses varied. Differences were also apparent in students' descriptions of the molecular-level mechanisms by which energy transfer occurs. These findings reveal a disconnect between how energy is understood and used in introductory science course work and uncovers opportunities to make stronger connections across the disciplines. We recommend that instructors engage in interdisciplinary conversations and consider the perspectives and goals of other disciplines when teaching introductory science courses.

Connecting Structure-Property and Structure-Function Relationships across the Disciplines of Chemistry and Biology: Exploring Student Perceptions.

While many university students take science courses in multiple disciplines, little is known about how they perceive common concepts from different disciplinary perspectives. Structure-property and structure-function relationships have long been considered important explanatory concepts in the disciplines of chemistry and biology, respectively. Fourteen university students concurrently enrolled in introductory chemistry and biology courses were interviewed to explore their perceptions regarding 1) the meaning of structure, properties, and function; 2) the presentation of these concepts in their courses; and 3) how these concepts might be related. Findings suggest that the concepts of structure and properties were interpreted similarly between chemistry and biology, but students more closely associated the discussion of structure-property relationships with their chemistry courses and structure-function with biology. Despite receiving little in the way of instructional support, nine students proposed a coherent conceptual relationship, indicating that structure determines properties, which determine function. Furthermore, students described ways in which they connected and benefited from their understanding. Though many students are prepared to make these connections, we would encourage instructors to engage in cross-disciplinary conversations to understand the shared goals and disciplinary distinctions regarding these important concepts in an effort to better support students unable to construct these connections for themselves.

Evaluating the extent of a large-scale transformation in gateway science courses.

We evaluate the impact of an institutional effort to transform undergraduate science courses using an approach based on course assessments. The approach is guided by A Framework for K-12 Science Education and focuses on scientific and engineering practices, crosscutting concepts, and core ideas, together called three-dimensional learning. To evaluate the extent of change, we applied the Three-dimensional Learning Assessment Protocol to 4 years of chemistry, physics, and biology course exams. Changes in exams differed by discipline and even by course, apparently depending on an interplay between departmental culture, course organization, and perceived course ownership, demonstrating the complex nature of transformation in higher education. We conclude that while transformation must be supported at all organizational levels, ultimately, change is controlled by factors at the course and departmental levels.

Sketching the Invisible to Predict the Visible: From Drawing to Modeling in Chemistry.

Sketching as a scientific practice goes beyond the simple act of inscribing diagrams onto paper. Scientists produce a wide range of representations through sketching, as it is tightly coupled to model-based reasoning. Chemists in particular make extensive use of sketches to reason about chemical phenomena and to communicate their ideas. However, the chemical sciences have a unique problem in that chemists deal with the unseen world of the atomic-molecular level. Using sketches, chemists strive to develop causal mechanisms that emerge from the structure and behavior of molecular-level entities, to explain observations of the macroscopic visible world. Interpreting these representations and constructing sketches of molecular-level processes is a crucial component of student learning in the modern chemistry classroom. Sketches also serve as an important component of assessment in the chemistry classroom as student sketches give insight into developing mental models, which allows instructors to observe how students are thinking about a process. In this paper we discuss how sketching can be used to promote such model-based reasoning in chemistry and discuss two case studies of curricular projects, CLUE and The Connected Chemistry Curriculum, that have demonstrated a benefit of this approach. We show how sketching activities can be centrally integrated into classroom norms to promote model-based reasoning both with and without component visualizations. Importantly, each of these projects deploys sketching in support of other types of inquiry activities, such as making predictions or depicting models to support a claim; sketching is not an isolated activity but is used as a tool to support model-based reasoning in the discipline.

The Design and Transformation of Biofundamentals: A Nonsurvey Introductory Evolutionary and Molecular Biology Course.

Many introductory biology courses amount to superficial surveys of disconnected topics. Often, foundational observations and the concepts derived from them and students' ability to use these ideas appropriately are overlooked, leading to unrealistic expectations and unrecognized learning obstacles. The result can be a focus on memorization at the expense of the development of a meaningful framework within which to consider biological phenomena. About a decade ago, we began a reconsideration of what an introductory course should present to students and the skills they need to master. The original Web-based course's design presaged many of the recommendations of the Vision and Change report; in particular, a focus on social evolutionary mechanisms, stochastic (evolutionary and molecular) processes, and core ideas (cellular continuity, evolutionary homology, molecular interactions, coupled chemical reactions, and molecular machines). Inspired by insights from the Chemistry, Life, the Universe & Everything general chemistry project, we transformed the original Web version into a (freely available) book with a more unified narrative flow and a set of formative assessments delivered through the beSocratic system. We outline how student responses to course materials are guiding future course modifications, in particular a more concerted effort at helping students to construct logical, empirically based arguments, explanations, and models.

Characterizing College Science Assessments: The Three-Dimensional Learning Assessment Protocol.

Many calls to improve science education in college and university settings have focused on improving instructor pedagogy. Meanwhile, science education at the K-12 level is undergoing significant changes as a result of the emphasis on scientific and engineering practices, crosscutting concepts, and disciplinary core ideas. This framework of "three-dimensional learning" is based on the literature about how people learn science and how we can help students put their knowledge to use. Recently, similar changes are underway in higher education by incorporating three-dimensional learning into college science courses. As these transformations move forward, it will become important to assess three-dimensional learning both to align assessments with the learning environment, and to assess the extent of the transformations. In this paper we introduce the Three-Dimensional Learning Assessment Protocol (3D-LAP), which is designed to characterize and support the development of assessment tasks in biology, chemistry, and physics that align with transformation efforts. We describe the development process used by our interdisciplinary team, discuss the validity and reliability of the protocol, and provide evidence that the protocol can distinguish between assessments that have the potential to elicit evidence of three-dimensional learning and those that do not.

The trouble with chemical energy: why understanding bond energies requires an interdisciplinary systems approach.

Helping students understand "chemical energy" is notoriously difficult. Many hold inconsistent ideas about what energy is, how and why it changes during the course of a chemical reaction, and how these changes are related to bond energies and reaction dynamics. There are (at least) three major sources for this problem: 1) the way biologists talk about chemical energy (which is also the way we talk about energy in everyday life); 2) the macroscopic approach to energy concepts that is common in physics and physical sciences; and 3) the failure of chemistry courses to explicitly link molecular with macroscopic energy ideas. From a constructivist perspective, it is unlikely that students can, without a coherent understanding of such a central concept, attain a robust and accurate understanding of new concepts. However, changes are on the horizon, guided by the increasing understanding that difficult concepts require coherent, well-designed learning progressions and the new National Research Council Framework for K-12 Science Education. We provide supporting evidence for our assertions and suggestions for an interdisciplinary learning progression designed to better approach the concept of bond energies, a first step in an understanding chemical energy and behavior of reaction systems that is central to biological systems.

Using graph-based assessments within socratic tutorials to reveal and refine students' analytical thinking about molecular networks.

Biological systems, from the molecular to the ecological, involve dynamic interaction networks. To examine student thinking about networks we used graphical responses, since they are easier to evaluate for implied, but unarticulated assumptions. Senior college level molecular biology students were presented with simple molecular level scenarios; surprisingly, most students failed to articulate the basic assumptions needed to generate reasonable graphical representations; their graphs often contradicted their explicit assumptions. We then developed a tiered Socratic tutorial based on leading questions designed to provoke metacognitive reflection. The activity is characterized by leading questions (prompts) designed to provoke meta-cognitive reflection. When applied in a group or individual setting, there was clear improvement in targeted areas. Our results highlight the promise of using graphical responses and Socratic prompts in a tutorial context as both a formative assessment for students and an informative feedback system for instructors, in part because graphical responses are relatively easy to evaluate for implied, but unarticulated assumptions.

Turning randomness into meaning at the molecular level using Muller's morphs.

While evolutionary theory follows from observable facts and logical inferences (Mayr, 1985), historically, the origin of novel inheritable variations was a major obstacle to acceptance of natural selection (Bowler, 1992; Bowler, 2005). While molecular mechanisms address this issue (Jablonka and Lamb, 2005), analysis of responses to the Biological Concept Inventory (BCI) (Klymkowsky et al., 2010), revealed that molecular biology majors rarely use molecular level ideas in their discourse, implying that they do not have an accessible framework within which to place evolutionary variation. We developed a "Socratic tutorial" focused on Muller's categorization of mutations' phenotypic effects (Muller, 1932). Using a novel vector-based method to analyzed students' essay responses, we found that a single interaction with this tutorial led to significant changes in thinking toward a clearer articulation of the effects of mutational change. We suggest that Muller's morphs provides an effective framework for facilitating student learning about mutational effects and evolutionary mechanisms.