Data Analysis WorkbeNch (DAWN).

Synchrotron light source facilities worldwide generate terabytes of data in numerous incompatible data formats from a wide range of experiment types. The Data Analysis WorkbeNch (DAWN) was developed to address the challenge of providing a single visualization and analysis platform for data from any synchrotron experiment (including single-crystal and powder diffraction, tomography and spectroscopy), whilst also being sufficiently extensible for new specific use case analysis environments to be incorporated (e.g. ARPES, PEEM). In this work, the history and current state of DAWN are presented, with two case studies to demonstrate specific functionality. The first is an example of a data processing and reduction problem using the generic tools, whilst the second shows how these tools can be targeted to a specific scientific area.

SynchLink: an iOS app for ISPyB.

The macromolecular crystallography (MX) user experience at synchrotron radiation facilities continues to evolve, with the impact of developments in X-ray detectors, computer hardware and automation methods making it possible for complete data sets to be collected on timescales of tens of seconds. Data can be reduced in a couple of minutes and in favourable cases structures solved and refined shortly after. The information-rich database ISPyB, automatically populated by data acquisition software, data processing and structure solution pipelines at the Diamond Light Source beamlines, allows users to automatically track MX experiments in real time. In order to improve the synchrotron users' experience, efficient access to the data contained in ISPyB is now provided via an iOS 6.0+ app for iPhones and iPads. This provides users, both local and remote, with a succinct summary of data collection, visualization of diffraction images and crystals, and key metrics for data quality in real time.

ISPyB: an information management system for synchrotron macromolecular crystallography.

MOTIVATION: Individual research groups now analyze thousands of samples per year at synchrotron macromolecular crystallography (MX) resources. The efficient management of experimental data is thus essential if the best possible experiments are to be performed and the best possible data used in downstream processes in structure determination pipelines. Information System for Protein crystallography Beamlines (ISPyB), a Laboratory Information Management System (LIMS) with an underlying data model allowing for the integration of analyses down-stream of the data collection experiment was developed to facilitate such data management. RESULTS: ISPyB is now a multisite, generic LIMS for synchrotron-based MX experiments. Its initial functionality has been enhanced to include improved sample tracking and reporting of experimental protocols, the direct ranking of the diffraction characteristics of individual samples and the archiving of raw data and results from ancillary experiments and post-experiment data processing protocols. This latter feature paves the way for ISPyB to play a central role in future macromolecular structure solution pipelines and validates the application of the approach used in ISPyB to other experimental techniques, such as biological solution Small Angle X-ray Scattering and spectroscopy, which have similar sample tracking and data handling requirements.

High-speed crystal detection and characterization using a fast-readout detector.

A novel raster-scanning method combining continuous sample translation with the fast readout of a Pilatus P6M detector has been developed on microfocus beamline I24 at Diamond Light Source. This fast grid-scan tool allows the rapid evaluation of large sample volumes without the need to increase the beam size at the sample through changes in beamline hardware. A slow version is available for slow-readout detectors. Examples of grid-scan use in centring optically invisible samples and in detecting and characterizing numerous microcrystals on a mesh-like holder illustrate the most common applications of the grid scan now in routine use on I24.

EDNA: a framework for plugin-based applications applied to X-ray experiment online data analysis.

EDNA is a framework for developing plugin-based applications especially for online data analysis in the X-ray experiments field. This article describes the features provided by the EDNA framework to ease the development of extensible scientific applications. This framework includes a plugins class hierarchy, configuration and application facilities, a mechanism to generate data classes and a testing framework. These utilities allow rapid development and integration in which robustness and quality play a fundamental role. A first prototype, designed for macromolecular crystallography experiments and tested at several synchrotrons, is presented.