Ensuring scientific reproducibility in bio-macromolecular modeling via extensive, automated benchmarks.

Each year vast international resources are wasted on irreproducible research. The scientific community has been slow to adopt standard software engineering practices, despite the increases in high-dimensional data, complexities of workflows, and computational environments. Here we show how scientific software applications can be created in a reproducible manner when simple design goals for reproducibility are met. We describe the implementation of a test server framework and 40 scientific benchmarks, covering numerous applications in Rosetta bio-macromolecular modeling. High performance computing cluster integration allows these benchmarks to run continuously and automatically. Detailed protocol captures are useful for developers and users of Rosetta and other macromolecular modeling tools. The framework and design concepts presented here are valuable for developers and users of any type of scientific software and for the scientific community to create reproducible methods. Specific examples highlight the utility of this framework, and the comprehensive documentation illustrates the ease of adding new tests in a matter of hours.

Membrane Protein Engineering with Rosetta.

Protein engineering can yield new molecular tools for nanotechnology and therapeutic applications through modulating physiochemical and biological properties. Engineering membrane proteins is especially attractive because they perform key cellular processes including transport, nutrient uptake, removal of toxins, respiration, motility, and signaling. In this chapter, we describe two protocols for membrane protein engineering with the Rosetta software: (1) ΔΔG calculations for single point mutations and (2) sequence optimization in different membrane lipid compositions. These modular protocols are easily adaptable for more complex problems and serve as a foundation for efficient membrane protein engineering calculations.

Diverse Scientific Benchmarks for Implicit Membrane Energy Functions.

Energy functions are fundamental to biomolecular modeling. Their success depends on robust physical formalisms, efficient optimization, and high-resolution data for training and validation. Over the past 20 years, progress in each area has advanced soluble protein energy functions. Yet, energy functions for membrane proteins lag behind due to sparse and low-quality data, leading to overfit tools. To overcome this challenge, we assembled a suite of 12 tests on independent data sets varying in size, diversity, and resolution. The tests probe an energy function's ability to capture membrane protein orientation, stability, sequence, and structure. Here, we present the tests and use the franklin2019 energy function to demonstrate them. We then identify areas for energy function improvement and discuss potential future integration with machine-learning-based optimization methods. The tests are available through the Rosetta Benchmark Server (https://benchmark.graylab.jhu.edu/) and GitHub (https://github.com/rfalford12/Implicit-Membrane-Energy-Function-Benchmark).

PyRosetta Jupyter Notebooks Teach Biomolecular Structure Prediction and Design.

Biomolecular structure drives function, and computational capabilities have progressed such that the prediction and computational design of biomolecular structures is increasingly feasible. Because computational biophysics attracts students from many different backgrounds and with different levels of resources, teaching the subject can be challenging. One strategy to teach diverse learners is with interactive multimedia material that promotes self-paced, active learning. We have created a hands-on education strategy with a set of sixteen modules that teach topics in biomolecular structure and design, from fundamentals of conformational sampling and energy evaluation to applications like protein docking, antibody design, and RNA structure prediction. Our modules are based on PyRosetta, a Python library that encapsulates all computational modules and methods in the Rosetta software package. The workshop-style modules are implemented as Jupyter Notebooks that can be executed in the Google Colaboratory, allowing learners access with just a web browser. The digital format of Jupyter Notebooks allows us to embed images, molecular visualization movies, and interactive coding exercises. This multimodal approach may better reach students from different disciplines and experience levels as well as attract more researchers from smaller labs and cognate backgrounds to leverage PyRosetta in their science and engineering research. All materials are freely available at https://github.com/RosettaCommons/PyRosetta.notebooks.

Protein docking and steered molecular dynamics suggest alternative phospholamban-binding sites on the SERCA calcium transporter.

The transport activity of the sarco(endo)plasmic reticulum calcium ATPase (SERCA) in cardiac myocytes is modulated by an inhibitory interaction with a transmembrane peptide, phospholamban (PLB). Previous biochemical studies have revealed that PLB interacts with a specific inhibitory site on SERCA, and low-resolution structural evidence suggests that PLB interacts with distinct alternative sites on SERCA. High-resolution details of the structural determinants of SERCA regulation have been elusive because of the dynamic nature of the regulatory complex. In this study, we used computational approaches to develop a structural model of SERCA-PLB interactions to gain a mechanistic understanding of PLB-mediated SERCA transport regulation. We combined steered molecular dynamics and membrane protein-protein docking experiments to achieve both a global search and all-atom force calculations to determine the relative affinities of PLB for candidate sites on SERCA. We modeled the binding of PLB to several SERCA conformations, representing different enzymatic states sampled during the calcium transport catalytic cycle. The results of the steered molecular dynamics and docking experiments indicated that the canonical PLB-binding site (comprising transmembrane helices M2, M4, and M9) is the preferred site. This preference was even more stringent for a superinhibitory PLB variant. Interestingly, PLB-binding specificity became more ambivalent for other SERCA conformers. These results provide evidence for polymorphic PLB interactions with novel sites on M3 and with the outside of the SERCA helix M9. Our findings are compatible with previous physical measurements that suggest that PLB interacts with multiple binding sites, conferring dynamic responsiveness to changing physiological conditions.

Macromolecular modeling and design in Rosetta: recent methods and frameworks.

The Rosetta software for macromolecular modeling, docking and design is extensively used in laboratories worldwide. During two decades of development by a community of laboratories at more than 60 institutions, Rosetta has been continuously refactored and extended. Its advantages are its performance and interoperability between broad modeling capabilities. Here we review tools developed in the last 5 years, including over 80 methods. We discuss improvements to the score function, user interfaces and usability. Rosetta is available at http://www.rosettacommons.org.

Protein Structure Prediction and Design in a Biologically Realistic Implicit Membrane.

Protein design is a powerful tool for elucidating mechanisms of function and engineering new therapeutics and nanotechnologies. Although soluble protein design has advanced, membrane protein design remains challenging because of difficulties in modeling the lipid bilayer. In this work, we developed an implicit approach that captures the anisotropic structure, shape of water-filled pores, and nanoscale dimensions of membranes with different lipid compositions. The model improves performance in computational benchmarks against experimental targets, including prediction of protein orientations in the bilayer, ΔΔG calculations, native structure discrimination, and native sequence recovery. When applied to de novo protein design, this approach designs sequences with an amino acid distribution near the native amino acid distribution in membrane proteins, overcoming a critical flaw in previous membrane models that were prone to generating leucine-rich designs. Furthermore, the proteins designed in the new membrane model exhibit native-like features including interfacial aromatic side chains, hydrophobic lengths compatible with bilayer thickness, and polar pores. Our method advances high-resolution membrane protein structure prediction and design toward tackling key biological questions and engineering challenges.

A humanized yeast system to analyze cleavage of prelamin A by ZMPSTE24.

The nuclear lamins A, B, and C are intermediate filament proteins that form a nuclear scaffold adjacent to the inner nuclear membrane in higher eukaryotes, providing structural support for the nucleus. In the past two decades it has become evident that the final step in the biogenesis of the mature lamin A from its precursor prelamin A by the zinc metalloprotease ZMPSTE24 plays a critical role in human health. Defects in prelamin A processing by ZMPSTE24 result in premature aging disorders including Hutchinson Gilford Progeria Syndrome (HGPS) and related progeroid diseases. Additional evidence suggests that defects in prelamin A processing, due to diminished ZMPSTE24 expression or activity, may also drive normal physiological aging. Because of the important connection between prelamin A processing and human aging, there is increasing interest in how ZMPSTE24 specifically recognizes and cleaves its substrate prelamin A, encoded by LMNA. Here, we describe two humanized yeast systems we have recently developed to examine ZMPSTE24 processing of prelamin A. These systems differ from one another slightly. Version 1.0 is optimized to analyze ZMPSTE24 mutations, including disease alleles that may affect the function or stability of the protease. Using this system, we previously showed that some ZMPSTE24 disease alleles that affect stability can be rescued by the proteasome inhibitor bortezomib, which may have therapeutic implications. Version 2.0 is designed to analyze LMNA mutations at or near the ZMPSTE24 processing site to assess whether they permit or impede prelamin A processing. Together these systems offer powerful methodology to study ZMPSTE24 disease alleles and to dissect the specific residues and features of the lamin A tail that are required for recognition and cleavage by the ZMPSTE24 protease.

A cyber-linked undergraduate research experience in computational biomolecular structure prediction and design.

Computational biology is an interdisciplinary field, and many computational biology research projects involve distributed teams of scientists. To accomplish their work, these teams must overcome both disciplinary and geographic barriers. Introducing new training paradigms is one way to facilitate research progress in computational biology. Here, we describe a new undergraduate program in biomolecular structure prediction and design in which students conduct research at labs located at geographically-distributed institutions while remaining connected through an online community. This 10-week summer program begins with one week of training on computational biology methods development, transitions to eight weeks of research, and culminates in one week at the Rosetta annual conference. To date, two cohorts of students have participated, tackling research topics including vaccine design, enzyme design, protein-based materials, glycoprotein modeling, crowd-sourced science, RNA processing, hydrogen bond networks, and amyloid formation. Students in the program report outcomes comparable to students who participate in similar in-person programs. These outcomes include the development of a sense of community and increases in their scientific self-efficacy, scientific identity, and science values, all predictors of continuing in a science research career. Furthermore, the program attracted students from diverse backgrounds, which demonstrates the potential of this approach to broaden the participation of young scientists from backgrounds traditionally underrepresented in computational biology.

The Rosetta All-Atom Energy Function for Macromolecular Modeling and Design.

Over the past decade, the Rosetta biomolecular modeling suite has informed diverse biological questions and engineering challenges ranging from interpretation of low-resolution structural data to design of nanomaterials, protein therapeutics, and vaccines. Central to Rosetta's success is the energy function: a model parametrized from small-molecule and X-ray crystal structure data used to approximate the energy associated with each biomolecule conformation. This paper describes the mathematical models and physical concepts that underlie the latest Rosetta energy function, called the Rosetta Energy Function 2015 (REF15). Applying these concepts, we explain how to use Rosetta energies to identify and analyze the features of biomolecular models. Finally, we discuss the latest advances in the energy function that extend its capabilities from soluble proteins to also include membrane proteins, peptides containing noncanonical amino acids, small molecules, carbohydrates, nucleic acids, and other macromolecules.

Robust classification of protein variation using structural modelling and large-scale data integration.

Existing methods for interpreting protein variation focus on annotating mutation pathogenicity rather than detailed interpretation of variant deleteriousness and frequently use only sequence-based or structure-based information. We present VIPUR, a computational framework that seamlessly integrates sequence analysis and structural modelling (using the Rosetta protein modelling suite) to identify and interpret deleterious protein variants. To train VIPUR, we collected 9477 protein variants with known effects on protein function from multiple organisms and curated structural models for each variant from crystal structures and homology models. VIPUR can be applied to mutations in any organism's proteome with improved generalized accuracy (AUROC .83) and interpretability (AUPR .87) compared to other methods. We demonstrate that VIPUR's predictions of deleteriousness match the biological phenotypes in ClinVar and provide a clear ranking of prediction confidence. We use VIPUR to interpret known mutations associated with inflammation and diabetes, demonstrating the structural diversity of disrupted functional sites and improved interpretation of mutations associated with human diseases. Lastly, we demonstrate VIPUR's ability to highlight candidate variants associated with human diseases by applying VIPUR to de novo variants associated with autism spectrum disorders.

An Integrated Framework Advancing Membrane Protein Modeling and Design.

Membrane proteins are critical functional molecules in the human body, constituting more than 30% of open reading frames in the human genome. Unfortunately, a myriad of difficulties in overexpression and reconstitution into membrane mimetics severely limit our ability to determine their structures. Computational tools are therefore instrumental to membrane protein structure prediction, consequently increasing our understanding of membrane protein function and their role in disease. Here, we describe a general framework facilitating membrane protein modeling and design that combines the scientific principles for membrane protein modeling with the flexible software architecture of Rosetta3. This new framework, called RosettaMP, provides a general membrane representation that interfaces with scoring, conformational sampling, and mutation routines that can be easily combined to create new protocols. To demonstrate the capabilities of this implementation, we developed four proof-of-concept applications for (1) prediction of free energy changes upon mutation; (2) high-resolution structural refinement; (3) protein-protein docking; and (4) assembly of symmetric protein complexes, all in the membrane environment. Preliminary data show that these algorithms can produce meaningful scores and structures. The data also suggest needed improvements to both sampling routines and score functions. Importantly, the applications collectively demonstrate the potential of combining the flexible nature of RosettaMP with the power of Rosetta algorithms to facilitate membrane protein modeling and design.