openFrame: A modular, sustainable, open microscopy platform with single-shot, dual-axis optical autofocus module providing high precision and long range of operation.

'openFrame' is a modular, low-cost, open-hardware microscopy platform that can be configured or adapted to most light microscopy techniques and is easily upgradeable or expandable to multiple modalities. The ability to freely mix and interchange both open-source and proprietary hardware components or software enables low-cost, yet research-grade instruments to be assembled and maintained. It also enables rapid prototyping of advanced or novel microscope systems. For long-term time-lapse image data acquisition, slide-scanning or high content analysis, we have developed a novel optical autofocus incorporating orthogonal cylindrical optics to provide robust single-shot closed-loop focus lock, which we have demonstrated to accommodate defocus up to ±37 µm with <200 nm accuracy, and a two-step autofocus mode which we have shown can operate with defocus up to ±68 µm. We have used this to implement automated single molecule localisation microscopy (SMLM) in a relatively low-cost openFrame-based instrument using multimode diode lasers for excitation and cooled CMOS cameras.

Accelerating single molecule localization microscopy through parallel processing on a high-performance computing cluster.

Super-resolved microscopy techniques have revolutionized the ability to study biological structures below the diffraction limit. Single molecule localization microscopy (SMLM) techniques are widely used because they are relatively straightforward to implement and can be realized at relatively low cost, e.g. compared to laser scanning microscopy techniques. However, while the data analysis can be readily undertaken using open source or other software tools, large SMLM data volumes and the complexity of the algorithms used often lead to long image data processing times that can hinder the iterative optimization of experiments. There is increasing interest in high throughput SMLM, but its further development and application is inhibited by the data processing challenges. We present here a widely applicable approach to accelerating SMLM data processing via a parallelized implementation of ThunderSTORM on a high-performance computing (HPC) cluster and quantify the speed advantage for a four-node cluster (with 24 cores and 128 GB RAM per node) compared to a high specification (28 cores, 128 GB RAM, SSD-enabled) desktop workstation. This data processing speed can be readily scaled by accessing more HPC resources. Our approach is not specific to ThunderSTORM and can be adapted for a wide range of SMLM software. LAY DESCRIPTION: Optical microscopy is now able to provide images with a resolution far beyond the diffraction limit thanks to relatively new super-resolved microscopy (SRM) techniques, which have revolutionized the ability to study biological structures. One approach to SRM is to randomly switch on and off the emission of fluorescent molecules in an otherwise conventional fluorescence microscope. If only a sparse subset of the fluorescent molecules labelling a sample can be switched on at a time, then each emitter will be, on average, spaced further apart than the diffraction-limited resolution of the conventional microscope and the separate bright spots in the image corresponding to each emitter can be localised to high precision by finding the centre of each feature using a computer program. Thus, a precise map of the emitter positions can be recorded by sequentially mapping the localisation of different subsets of emitters as they are switched on and others switched off. Typically, this approach, described as single molecule localisation microscopy (SMLM), results in large image data sets that can take many minutes to hours to process, depending on the size of the field of view and whether the SMLM analysis employs a computationally-intensive iterative algorithm. Such a slow workflow makes it difficult to optimise experiments and to analyse large numbers of samples. Faster SMLM experiments would be generally useful and automated high throughput SMLM studies of arrays of samples, such as cells, could be applied to drug discovery and other applications. However, the time required to process the resulting data would be prohibitive on a normal computer. To address this, we have developed a method to run standard SMLM data analysis software tools in parallel on a high-performance computing cluster (HPC). This can be used to accelerate the analysis of individual SMLM experiments or it can be scaled to analyse high throughput SMLM data by extending it to run on an arbitrary number of HPC processors in parallel. In this paper we outline the design of our parallelised SMLM software for HPC and quantify the speed advantage when implementing it on four HPC nodes compared to a powerful desktop computer.

Optical alignment of pixelated 4f optical system using multiplexed filter.

Novel optical alignment techniques to perform precise alignment of a typical pixelated 4f optical system are presented in this paper. These techniques use optical multiplexed matched filters, which were designed using a simple, efficient iterative optimization algorithm, known as direct binary search. Three alignment challenges are identified: positioning, focusing, and magnification. The first two alignments were performed using the optical multiplexed matched filtering technique, and the last one was performed using a new optical arrangement. Experimental results of the new alignment techniques and a simple optical pattern recognition problem to demonstrate the benefits of the new alignment techniques are also presented. Two pixelated, electrically addressed spatial light modulators (128 × 128 pixels and one pixel width is 80 µm) were used to represent the input and filter planes. The results clearly show that the new alignment techniques allow the 4f system to be aligned to a precision of 80 µm in the x-y direction and 0.716 mm in the z direction.

Fluorescence lifetime imaging distinguishes basal cell carcinoma from surrounding uninvolved skin.

BACKGROUND: Fluorescence lifetime imaging (FLIM) is a novel imaging technique that generates image contrast between different states of tissue due to differences in fluorescence decay rates. OBJECTIVES: To establish whether FLIM of skin autofluorescence can provide useful contrast between basal cell carcinomas (BCCs) and surrounding uninvolved skin. METHODS: Unstained excision biopsies of 25 BCCs were imaged en face with FLIM following excitation of autofluorescence with a 355 nm pulsed ultraviolet laser. RESULTS: Using FLIM we were able to distinguish areas of BCC from surrounding skin in an ex vivo study. Significant reductions in mean fluorescence lifetimes between areas of BCC and areas of surrounding uninvolved skin were demonstrated (P < 0.0001). These differences were apparent irrespective of the decay model used to calculate the fluorescence lifetimes (single vs. stretched exponential) or the long-pass filter through which the emitted autofluorescence was collected (375 vs. 455 nm). Conversely, there was no significant difference between the BCC and uninvolved areas of each sample when mean autofluorescence intensities were examined. Moreover, wide-field false-colour images of fluorescence lifetimes clearly discriminated areas of BCC from the surrounding uninvolved skin. CONCLUSIONS: We therefore believe that FLIM has a potential future clinical role in imaging BCCs for rapid and noninvasive tumour delineation and as an aid to determine adequate excision margins with best preservation of normal tissue.

Spatially selective sampling of single cells using optically trapped fusogenic emulsion droplets: a new single-cell proteomic tool.

We present a platform for the spatially selective sampling of the plasma membrane of single cells. Optically trapped lipid-coated oil droplets (smart droplet microtools, SDMs), typically 0.5-5 microm in size, composed of a hexadecane hydrocarbon core and fusogenic lipid outer coating (mixture of 1,2-dioleoyl-phosphatidylethanolamine and 1,2-dioleoyl-sn-glycero-3-phosphatidylcholine) were brought into controlled contact with target colon cancer cells leading to the formation of connecting membrane tethers. Material transfer from the cell to the SDM across the membrane tether was monitored by tracking membrane-localized enhanced green fluorescent protein.

Multifocal multiphoton excitation and time correlated single photon counting detection for 3-D fluorescence lifetime imaging.

We report a multifocal multiphoton time-correlated single photon counting (TCSPC) fluorescence lifetime imaging (FLIM) microscope system that uses a 16 channel multi-anode PMT detector. Multiphoton excitation minimizes out-of-focus photobleaching, multifocal excitation reduces non-linear in-plane photobleaching effects and TCSPC electronics provide photon-efficient detection of the fluorescence decay profile. TCSPC detection is less prone to bleaching- and movement-induced artefacts compared to wide-field time-gated or frequency-domain FLIM. This microscope is therefore capable of acquiring 3-D FLIM images at significantly increased speeds compared to single beam multiphoton microscopy and we demonstrate this with live cells expressing a GFP tagged protein. We also apply this system to time-lapse FLIM of NAD(P)H autofluorescence in single live cells and report measurements on the change in the fluorescence decay profile following the application of a known metabolic inhibitor.

High speed optically sectioned fluorescence lifetime imaging permits study of live cell signaling events.

We present a time domain optically sectioned fluorescence lifetime imaging (FLIM) microscope developed for high-speed live cell imaging. This single photon excited system combines wide field parallel pixel detection with confocal sectioning utilizing spinning Nipkow disc microscopy. It can acquire fluorescence lifetime images of live cells at up to 10 frames per second (fps), permitting high-speed FLIM of cell dynamics and protein interactions with potential for high throughput cell imaging and screening applications. We demonstrate the application of this FLIM microscope to real-time monitoring of changes in lipid order in cell membranes following cholesterol depletion using cyclodextrin and to the activation of the small GTP-ase Ras in live cells using FRET.

Characterisation of new gated optical image intensifiers for fluorescence lifetime imaging.

We report the characterisation of gated optical image intensifiers for fluorescence lifetime imaging, evaluating the performance of several different prototypes that culminate in a new design that provides improved spatial resolution conferred by the addition of a magnetic field to reduce the lateral spread of photoelectrons on their path between the photocathode and microchannel plate, and higher signal to noise ratio conferred by longer time gates. We also present a methodology to compare these systems and their capabilities, including the quantitative readouts of Förster resonant energy transfer.

Toward the clinical application of time-domain fluorescence lifetime imaging.

High-speed (video-rate) fluorescence lifetime imaging (FLIM) through a flexible endoscope is reported based on gated optical image intensifier technology. The optimization and potential application of FLIM to tissue autofluorescence for clinical applications are discussed.

Dynamical hologram generation for high speed optical trapping of smart droplet microtools.

This paper demonstrates spatially selective sampling of the plasma membrane by the implementation of time-multiplexed holographic optical tweezers for Smart Droplet Microtools (SDMs). High speed (>1000fps) dynamical hologram generation was computed on the graphics processing unit of a standard display card and controlled by a user friendly LabView interface. Time multiplexed binary holograms were displayed in real time and mirrored to a ferroelectric Spatial Light Modulator. SDMs were manufactured with both liquid cores (as previously described) and solid cores, which confer significant advantages in terms of stability, polydispersity and ease of use. These were coated with a number of detergents, the most successful based upon lipids doped with transfection reagents. In order to validate these, trapped SDMs were maneuvered up to the plasma membrane of giant vesicles containing Nile Red and human biliary epithelial (BE) colon cancer cells with green fluorescent labeled protein (GFP)-labeled CAAX (a motif belonging to the Ras protein). Bright field and fluorescence images showed that successful trapping and manipulation of multiple SDMs in x, y, z was achieved with success rates of 30-50% and that subsequent membrane-SDM interactions led to the uptake of Nile Red or GFP-CAAX into the SDM.

A New Individually Addressable Micro-LED Array for Photogenetic Neural Stimulation.

Here, we demonstrate the use of a micro light emitting diode (LED) array as a powerful tool for complex spatiotemporal control of photosensitized neurons. The array can generate arbitrary, 2-D, excitation patterns with millisecond and micrometer resolution. In particular, we describe an active matrix control address system to allow simultaneous control of 256 individual micro LEDs. We present the system optically integrated into a microscope environment and patch clamp electrophysiology. The results show that the emitters have sufficient radiance at the required wavelength to stimulate neurons expressing channelrhodopsin-2 (ChR2).

Laser scanning confocal microscope with programmable amplitude, phase, and polarization of the illumination beam.

We describe the design and construction of a laser scanning confocal microscope with programmable beam forming optics. The amplitude, phase, and polarization of the laser beam used in the microscope can be controlled in real time with the help of a liquid crystal spatial light modulator, acting as a computer generated hologram, in conjunction with a polarizing beam splitter and two right angled prisms assembly. Two scan mirrors, comprising an on-axis fast moving scan mirror for line scanning and an off-axis slow moving scan mirror for frame scanning, configured in a way to minimize the movement of the scanned beam over the pupil plane of the microscope objective, form the XY scan unit. The confocal system, that incorporates the programmable beam forming unit and the scan unit, has been implemented to image in both reflected and fluorescence light from the specimen. Efficiency of the system to programmably generate custom defined vector beams has been demonstrated by generating a bottle structured focal volume, which in fact is the overlap of two cross polarized beams, that can simultaneously improve both the lateral and axial resolutions if used as the de-excitation beam in a stimulated emission depletion confocal microscope.

Imaging fluorescence lifetime heterogeneity applied to GFP-tagged MHC protein at an immunological synapse.

Fluorescence imaging of green fluorescent protein (GFP) may be used to locate proteins in live cells and fluorescence lifetime imaging (FLIM) may be employed to probe the local microenvironment of proteins. Here we apply FLIM to GFP-tagged proteins at the cell surface and at an inhibitory natural killer (NK) cell immunological synapse (IS). We present a novel quantitative analysis of fluorescence lifetime images that we believe is useful to determine whether apparent FLIM heterogeneity is statistically significant. We observe that, although the variation of observed fluorescence lifetime of GFP-tagged proteins at the cell surface is close to the expected statistical range, the lifetime of GFP-tagged proteins in cells is shorter than recombinant GFP in solution. Furthermore the lifetime of GFP-tagged major histocompatibility complex class I protein is shortened at the inhibitory NK cell IS compared with the unconjugated membrane. Following our previous work demonstrating the ability of FLIM to report the local refractive index of GFP in solution, we speculate that these lifetime variations may indicate local refractive index changes. This application of our method for detecting small but significant differences in fluorescence lifetimes shows how FLIM could be broadly useful in imaging discrete membrane environments for a given protein.

Optically sectioned fluorescence lifetime imaging using a Nipkow disk microscope and a tunable ultrafast continuum excitation source.

We demonstrate an optically sectioned fluorescence lifetime imaging microscope with a wide-field detector, using a convenient, continuously tunable (435-1150 nm) ultrafast source for fluorescence imaging applications that is derived from a visible supercontinuum generated in a microstructured fiber.

Measurement of specimen-induced aberrations of biological samples using phase stepping interferometry.

Confocal or multiphoton microscopes, which deliver optical sections and three-dimensional (3D) images of thick specimens, are widely used in biology. These techniques, however, are sensitive to aberrations that may originate from the refractive index structure of the specimen itself. The aberrations cause reduced signal intensity and the 3D resolution of the instrument is compromised. It has been suggested to correct for aberrations in confocal microscopes using adaptive optics. In order to define the design specifications for such adaptive optics systems, one has to know the amount of aberrations present for typical applications such as with biological samples. We have built a phase stepping interferometer microscope that directly measures the aberration of the wavefront. The modal content of the wavefront is extracted by employing Zernike mode decomposition. Results for typical biological specimens are presented. It was found for all samples investigated that higher order Zernike modes give only a small contribution to the overall aberration. Therefore, these higher order modes can be neglected in future adaptive optics sensing and correction schemes implemented into confocal or multiphoton microscopes, leading to more efficient designs.

Quantitative polarized light microscopy.

We describe a simple modification to a confocal microscope, which analyses the state of polarization of light emerging from the specimen so as to permit quantitative polarized light microscopy to be performed. The system uses a novel form of rotating analyser which, together with lock-in detection, permits images to be obtained where the image contrast corresponds to both specimen retardance and orientation (e.g. in the case of a birefringent specimen). Images are presented from a wide range of specimens and the origin of the contrast observed from simple point scatterers is investigated both theoretically and experimentally.

Video-rate confocal endoscopy.

Rigid endoscopes provide high quality optical images of reasonably accessible regions of the inner body, especially regions such as the aero-digestive and genital tracts. In order to enhance the versatility of these instruments we describe a development that permits confocal endoscopic images to be obtained - along with traditional endoscopic images - in real-time, from within the living patient. The system is based around a host lenslet-array tandem scanning microscope, which is capable of producing images viewed directly by eye. These types of confocal microscope are configured for fluorescence imaging together with laser illumination. Hard and soft tissues in the mouth were imaged using this combined system.

High-speed wide-field time-gated endoscopic fluorescence-lifetime imaging.

We report the development of a high-speed wide-field fluorescence-lifetime imaging (FLIM) system that provides fluorescence-lifetime images at rates of as many as 29 frames/s. A FLIM multiwell plate reader and a potentially portable FLIM endoscopic system operating at 355-nm excitation have been demonstrated.