Outcomes of the EMDataResource cryo-EM Ligand Modeling Challenge.

The EMDataResource Ligand Model Challenge aimed to assess the reliability and reproducibility of modeling ligands bound to protein and protein-nucleic acid complexes in cryogenic electron microscopy (cryo-EM) maps determined at near-atomic (1.9-2.5 Å) resolution. Three published maps were selected as targets: Escherichia coli beta-galactosidase with inhibitor, SARS-CoV-2 virus RNA-dependent RNA polymerase with covalently bound nucleotide analog and SARS-CoV-2 virus ion channel ORF3a with bound lipid. Sixty-one models were submitted from 17 independent research groups, each with supporting workflow details. The quality of submitted ligand models and surrounding atoms were analyzed by visual inspection and quantification of local map quality, model-to-map fit, geometry, energetics and contact scores. A composite rather than a single score was needed to assess macromolecule+ligand model quality. These observations lead us to recommend best practices for assessing cryo-EM structures of liganded macromolecules reported at near-atomic resolution.

Community recommendations on cryoEM data archiving and validation.

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for the deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and the resulting consensus recommendations. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

Outcomes of the EMDataResource Cryo-EM Ligand Modeling Challenge.

The EMDataResource Ligand Model Challenge aimed to assess the reliability and reproducibility of modeling ligands bound to protein and protein/nucleic-acid complexes in cryogenic electron microscopy (cryo-EM) maps determined at near-atomic (1.9-2.5 Å) resolution. Three published maps were selected as targets: E. coli beta-galactosidase with inhibitor, SARS-CoV-2 RNA-dependent RNA polymerase with covalently bound nucleotide analog, and SARS-CoV-2 ion channel ORF3a with bound lipid. Sixty-one models were submitted from 17 independent research groups, each with supporting workflow details. We found that (1) the quality of submitted ligand models and surrounding atoms varied, as judged by visual inspection and quantification of local map quality, model-to-map fit, geometry, energetics, and contact scores, and (2) a composite rather than a single score was needed to assess macromolecule+ligand model quality. These observations lead us to recommend best practices for assessing cryo-EM structures of liganded macromolecules reported at near-atomic resolution.

Community recommendations on cryoEM data archiving and validation: Outcomes of a wwPDB/EMDB workshop on cryoEM data management, deposition and validation.

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and consensus recommendations resulting from the workshop. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

AlphaFold predictions are valuable hypotheses and accelerate but do not replace experimental structure determination.

Artificial intelligence-based protein structure prediction methods such as AlphaFold have revolutionized structural biology. The accuracies of these predictions vary, however, and they do not take into account ligands, covalent modifications or other environmental factors. Here, we evaluate how well AlphaFold predictions can be expected to describe the structure of a protein by comparing predictions directly with experimental crystallographic maps. In many cases, AlphaFold predictions matched experimental maps remarkably closely. In other cases, even very high-confidence predictions differed from experimental maps on a global scale through distortion and domain orientation, and on a local scale in backbone and side-chain conformation. We suggest considering AlphaFold predictions as exceptionally useful hypotheses. We further suggest that it is important to consider the confidence in prediction when interpreting AlphaFold predictions and to carry out experimental structure determination to verify structural details, particularly those that involve interactions not included in the prediction.

The bad and the good of trends in model building and refinement for sparse-data regions: pernicious forms of overfitting versus good new tools and predictions.

Model building and refinement, and the validation of their correctness, are very effective and reliable at local resolutions better than about 2.5 Šfor both crystallography and cryo-EM. However, at local resolutions worse than 2.5 Šboth the procedures and their validation break down and do not ensure reliably correct models. This is because in the broad density at lower resolution, critical features such as protein backbone carbonyl O atoms are not just less accurate but are not seen at all, and so peptide orientations are frequently wrongly fitted by 90-180°. This puts both backbone and side chains into the wrong local energy minimum, and they are then worsened rather than improved by further refinement into a valid but incorrect rotamer or Ramachandran region. On the positive side, new tools are being developed to locate this type of pernicious error in PDB depositions, such as CaBLAM, EMRinger, Pperp diagnosis of ribose puckers, and peptide flips in PDB-REDO, while interactive modeling in Coot or ISOLDE can help to fix many of them. Another positive trend is that artificial intelligence predictions such as those made by AlphaFold2 contribute additional evidence from large multiple sequence alignments, and in high-confidence parts they provide quite good starting models for loops, termini or whole domains with otherwise ambiguous density.

VectorNet: collaborative mapping of arthropod disease vectors in Europe and surrounding areas since 2010.

BackgroundArthropod vectors such as ticks, mosquitoes, sandflies and biting midges are of public and veterinary health significance because of the pathogens they can transmit. Understanding their distributions is a key means of assessing risk. VectorNet maps their distribution in the EU and surrounding areas.AimWe aim to describe the methodology underlying VectorNet maps, encourage standardisation and evaluate output.Methods: Vector distribution and surveillance activity data have been collected since 2010 from a combination of literature searches, field-survey data by entomologist volunteers via a network facilitated for each participating country and expert validation. Data were collated by VectorNet members and extensively validated during data entry and mapping processes.ResultsAs of 2021, the VectorNet archive consisted of ca 475,000 records relating to > 330 species. Maps for 42 species are routinely produced online at subnational administrative unit resolution. On VectorNet maps, there are relatively few areas where surveillance has been recorded but there are no distribution data. Comparison with other continental databases, namely the Global Biodiversity Information Facility and VectorBase show that VectorNet has 5-10 times as many records overall, although three species are better represented in the other databases. In addition, VectorNet maps show where species are absent. VectorNet's impact as assessed by citations (ca 60 per year) and web statistics (58,000 views) is substantial and its maps are widely used as reference material by professionals and the public.ConclusionVectorNet maps are the pre-eminent source of rigorously validated arthropod vector maps for Europe and its surrounding areas.

OECD harmonised template 201: Structuring and reporting mechanistic information to foster the integration of new approach methodologies for hazard and risk assessment of chemicals.

In the European Union, the Chemicals Strategy for Sustainability (CSS) highlights the need to enhance the identification and assessment of substances of concern while reducing animal testing, thus fostering the development and use of New Approach Methodologies (NAMs) such as in silico, in vitro and in chemico. In the United States, the Tox21 strategy aims at shifting toxicological assessments away from traditional animal studies towards target-specific, mechanism-based and biological observations mainly obtained by using NAMs. Many other jurisdictions around the world are also increasing the use of NAMs. Hence, the provision of dedicated non-animal toxicological data and reporting formats as a basis for chemical risk assessment is necessary. Harmonising data reporting is crucial when aiming at re-using and sharing data for chemical risk assessment across jurisdictions. The OECD has developed a series of OECD Harmonised Templates (OHT), which are standard data formats designed for reporting information used for the risk assessment of chemicals relevant to their intrinsic properties, including effects on human health (e.g., toxicokinetics, skin sensitisation, repeated dose toxicity) and the environment (e.g., toxicity to test species and wildlife, biodegradation in soil, metabolism of residues in crops). The objective of this paper is to demonstrate the applicability of the OHT standard format for reporting information under various chemical risk assessment regimes, and to provide users with practical guidance on the use of OHT 201, in particular to report test results on intermediate effects and mechanistic information.

Accelerating crystal structure determination with iterative AlphaFold prediction.

Experimental structure determination can be accelerated with artificial intelligence (AI)-based structure-prediction methods such as AlphaFold. Here, an automatic procedure requiring only sequence information and crystallographic data is presented that uses AlphaFold predictions to produce an electron-density map and a structural model. Iterating through cycles of structure prediction is a key element of this procedure: a predicted model rebuilt in one cycle is used as a template for prediction in the next cycle. This procedure was applied to X-ray data for 215 structures released by the Protein Data Bank in a recent six-month period. In 87% of cases our procedure yielded a model with at least 50% of Cα atoms matching those in the deposited models within 2 Å. Predictions from the iterative template-guided prediction procedure were more accurate than those obtained without templates. It is concluded that AlphaFold predictions obtained based on sequence information alone are usually accurate enough to solve the crystallographic phase problem with molecular replacement, and a general strategy for macromolecular structure determination that includes AI-based prediction both as a starting point and as a method of model optimization is suggested.

A Reflection on the Tensions of Acting in Dual Roles of Doctoral Researcher and Practitioner when Evaluating a Lifestyle Intervention for Breast Cancer Patients.

This reflection was completed as part of a doctoral project to develop and trial a lifestyle intervention for people following the completion of their treatment for breast cancer. In this study the graduate student acted in the dual roles of nutrition practitioner and researcher. This article uses the experience, reflection, action (ERA) cycle of reflection to consider some of the tensions faced due to the divergent priorities and requirements of these two roles. One challenge occurred during study recruitment when a few potential participants did not meet the inclusion criteria for the study but still wished to attend the intervention sessions. It was also a challenge to mitigate the risks of distress of potentially vulnerable participants during group intervention sessions. In both instances there was a potential conflict between the needs of patients and research requirements. This reflection concluded that the obligations of both roles should be adhered to where possible, but if in doubt, the needs of the participants were paramount.

Improved AlphaFold modeling with implicit experimental information.

Machine-learning prediction algorithms such as AlphaFold and RoseTTAFold can create remarkably accurate protein models, but these models usually have some regions that are predicted with low confidence or poor accuracy. We hypothesized that by implicitly including new experimental information such as a density map, a greater portion of a model could be predicted accurately, and that this might synergistically improve parts of the model that were not fully addressed by either machine learning or experiment alone. An iterative procedure was developed in which AlphaFold models are automatically rebuilt on the basis of experimental density maps and the rebuilt models are used as templates in new AlphaFold predictions. We show that including experimental information improves prediction beyond the improvement obtained with simple rebuilding guided by the experimental data. This procedure for AlphaFold modeling with density has been incorporated into an automated procedure for interpretation of crystallographic and electron cryo-microscopy maps.

The importance of residue-level filtering and the Top2018 best-parts dataset of high-quality protein residues.

We have curated a high-quality, "best-parts" reference dataset of about 3 million protein residues in about 15,000 PDB-format coordinate files, each containing only residues with good electron density support for a physically acceptable model conformation. The resulting prefiltered data typically contain the entire core of each chain, in quite long continuous fragments. Each reference file is a single protein chain, and the total set of files were selected for low redundancy, high resolution, good MolProbity score, and other chain-level criteria. Then each residue was critically tested for adequate local map quality to firmly support its conformation, which must also be free of serious clashes or covalent-geometry outliers. The resulting Top2018 prefiltered datasets have been released on the Zenodo online web service and are freely available for all uses under a Creative Commons license. Currently, one dataset is residue filtered on main chain plus Cß atoms, and a second dataset is full-residue filtered; each is available at four different sequence-identity levels. Here, we illustrate both statistics and examples that show the beneficial consequences of residue-level filtering. That process is necessary because even the best of structures contain a few highly disordered local regions with poor density and low-confidence conformations that should not be included in reference data. Therefore, the open distribution of these very large, prefiltered reference datasets constitutes a notable advance for structural bioinformatics and the fields that depend upon it.

'It's just a great muddle when it comes to food': a qualitative exploration of patient decision-making around diet and gout.

OBJECTIVE: Our aim was to understand whether, why and how patients choose to modify their diets after developing gout. METHODS: We conducted an inductive thematic secondary analysis of qualitative data from 43 interviews and four focus groups with UK participants with gout (n = 61). RESULTS: Participants commonly initiated dietary changes as part of a self-management strategy for gout. Reasons for making such dietary changes included: desperation; a desire for control; and belief that it would be possible to achieve successful management through diet alone; but not weight loss. Participants who did not make changes or who reverted to previous dietary patterns did so because: they believed urate-lowering therapy was successfully managing their gout; medication allowed normal eating; they did not find 'proof' that diet would be an effective treatment; or the dietary advice they found was unrealistic, unmanageable or irrelevant. Dietary modification was patient led, but patients would have preferred the support of a health-care professional. Beliefs that diet could potentially explain and modify the timing of flares gave patients a sense of control over the condition. However, the belief that gout could be controlled through dietary modification appeared to be a barrier to acceptance of management with urate-lowering therapy. CONCLUSIONS: Perceptions about gout and diet play a large role in the way patients make decisions about how to manage gout in their everyday lives. Addressing the reasons why patients explore dietary solutions, promoting the value of urate-lowering therapy and weight loss and drawing on strong evidence to communicate clearly will be crucial in improving long-term clinical management and patient experience.

Seeing the PDB.

Ever since the first structures of proteins were determined in the 1960s, structural biologists have required methods to visualize biomolecular structures, both as an essential tool for their research and also to promote 3D comprehension of structural results by a wide audience of researchers, students, and the general public. In this review to celebrate the 50th anniversary of the Protein Data Bank, we present our own experiences in developing and applying methods of visualization and analysis to the ever-expanding archive of protein and nucleic acid structures in the worldwide Protein Data Bank. Across that timespan, Jane and David Richardson have concentrated on the organization inside and between the macromolecules, with ribbons to show the overall backbone "fold" and contact dots to show how the all-atom details fit together locally. David Goodsell has explored surface-based representations to present and explore biological subjects that range from molecules to cells. This review concludes with some ideas about the current challenges being addressed by the field of biomolecular visualization.

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge.

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

Improving SARS-CoV-2 structures: Peer review by early coordinate release.

This work builds upon the record-breaking speed and generous immediate release of new experimental three-dimensional structures of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) proteins and complexes, which are crucial to downstream vaccine and drug development. We have surveyed those structures to catch the occasional errors that could be significant for those important uses and for which we were able to provide demonstrably higher-accuracy corrections. This process relied on new validation and correction methods such as CaBLAM and ISOLDE, which are not yet in routine use. We found such important and correctable problems in seven early SARS-CoV-2 structures. Two of the structures were soon superseded by new higher-resolution data, confirming our proposed changes. For the other five, we emailed the depositors a documented and illustrated report and encouraged them to make the model corrections themselves and use the new option at the worldwide Protein Data Bank for depositors to re-version their coordinates without changing the Protein Data Bank code. This quickly and easily makes the better-accuracy coordinates available to anyone who examines or downloads their structure, even before formal publication. The changes have involved sequence misalignments, incorrect RNA conformations near a bound inhibitor, incorrect metal ligands, and cis-trans or peptide flips that prevent good contact at interaction sites. These improvements have propagated into nearly all related structures done afterward. This process constitutes a new form of highly rigorous peer review, which is actually faster and more strict than standard publication review because it has access to coordinates and maps; journal peer review would also be strengthened by such access.

Making the invisible enemy visible.

During the COVID-19 pandemic, structural biologists rushed to solve the structures of the 28 proteins encoded by the SARS-CoV-2 genome in order to understand the viral life cycle and enable structure-based drug design. In addition to the 204 previously solved structures from SARS-CoV-1, 548 structures covering 16 of the SARS-CoV-2 viral proteins have been released in a span of only 6 months. These structural models serve as the basis for research to understand how the virus hijacks human cells, for structure-based drug design, and to aid in the development of vaccines. However, errors often occur in even the most careful structure determination - and may be even more common among these structures, which were solved quickly and under immense pressure. The Coronavirus Structural Task Force has responded to this challenge by rapidly categorizing, evaluating and reviewing all of these experimental protein structures in order to help downstream users and original authors. In addition, the Task Force provided improved models for key structures online, which have been used by Folding@Home, OpenPandemics, the EU JEDI COVID-19 challenge and others.