Digital cameras with designs inspired by the arthropod eye.

In arthropods, evolution has created a remarkably sophisticated class of imaging systems, with a wide-angle field of view, low aberrations, high acuity to motion and an infinite depth of field. A challenge in building digital cameras with the hemispherical, compound apposition layouts of arthropod eyes is that essential design requirements cannot be met with existing planar sensor technologies or conventional optics. Here we present materials, mechanics and integration schemes that afford scalable pathways to working, arthropod-inspired cameras with nearly full hemispherical shapes (about 160 degrees). Their surfaces are densely populated by imaging elements (artificial ommatidia), which are comparable in number (180) to those of the eyes of fire ants (Solenopsis fugax) and bark beetles (Hylastes nigrinus). The devices combine elastomeric compound optical elements with deformable arrays of thin silicon photodetectors into integrated sheets that can be elastically transformed from the planar geometries in which they are fabricated to hemispherical shapes for integration into apposition cameras. Our imaging results and quantitative ray-tracing-based simulations illustrate key features of operation. These general strategies seem to be applicable to other compound eye devices, such as those inspired by moths and lacewings (refracting superposition eyes), lobster and shrimp (reflecting superposition eyes), and houseflies (neural superposition eyes).

Adaptive optoelectronic camouflage systems with designs inspired by cephalopod skins.

Octopus, squid, cuttlefish, and other cephalopods exhibit exceptional capabilities for visually adapting to or differentiating from the coloration and texture of their surroundings, for the purpose of concealment, communication, predation, and reproduction. Long-standing interest in and emerging understanding of the underlying ultrastructure, physiological control, and photonic interactions has recently led to efforts in the construction of artificial systems that have key attributes found in the skins of these organisms. Despite several promising options in active materials for mimicking biological color tuning, existing routes to integrated systems do not include critical capabilities in distributed sensing and actuation. Research described here represents progress in this direction, demonstrated through the construction, experimental study, and computational modeling of materials, device elements, and integration schemes for cephalopod-inspired flexible sheets that can autonomously sense and adapt to the coloration of their surroundings. These systems combine high-performance, multiplexed arrays of actuators and photodetectors in laminated, multilayer configurations on flexible substrates, with overlaid arrangements of pixelated, color-changing elements. The concepts provide realistic routes to thin sheets that can be conformally wrapped onto solid objects to modulate their visual appearance, with potential relevance to consumer, industrial, and military applications.

A hemispherical electronic eye camera based on compressible silicon optoelectronics.

The human eye is a remarkable imaging device, with many attractive design features. Prominent among these is a hemispherical detector geometry, similar to that found in many other biological systems, that enables a wide field of view and low aberrations with simple, few-component imaging optics. This type of configuration is extremely difficult to achieve using established optoelectronics technologies, owing to the intrinsically planar nature of the patterning, deposition, etching, materials growth and doping methods that exist for fabricating such systems. Here we report strategies that avoid these limitations, and implement them to yield high-performance, hemispherical electronic eye cameras based on single-crystalline silicon. The approach uses wafer-scale optoelectronics formed in unusual, two-dimensionally compressible configurations and elastomeric transfer elements capable of transforming the planar layouts in which the systems are initially fabricated into hemispherical geometries for their final implementation. In a general sense, these methods, taken together with our theoretical analyses of their associated mechanics, provide practical routes for integrating well-developed planar device technologies onto the surfaces of complex curvilinear objects, suitable for diverse applications that cannot be addressed by conventional means.

Dynamically tunable hemispherical electronic eye camera system with adjustable zoom capability.

Imaging systems that exploit arrays of photodetectors in curvilinear layouts are attractive due to their ability to match the strongly nonplanar image surfaces (i.e., Petzval surfaces) that form with simple lenses, thereby creating new design options. Recent work has yielded significant progress in the realization of such "eyeball" cameras, including examples of fully functional silicon devices capable of collecting realistic images. Although these systems provide advantages compared to those with conventional, planar designs, their fixed detector curvature renders them incompatible with changes in the Petzval surface that accompany variable zoom achieved with simple lenses. This paper describes a class of digital imaging device that overcomes this limitation, through the use of photodetector arrays on thin elastomeric membranes, capable of reversible deformation into hemispherical shapes with radii of curvature that can be adjusted dynamically, via hydraulics. Combining this type of detector with a similarly tunable, fluidic plano-convex lens yields a hemispherical camera with variable zoom and excellent imaging characteristics. Systematic experimental and theoretical studies of the mechanics and optics reveal all underlying principles of operation. This type of technology could be useful for night-vision surveillance, endoscopic imaging, and other areas that require compact cameras with simple zoom optics and wide-angle fields of view.

Waterproof AlInGaP optoelectronics on stretchable substrates with applications in biomedicine and robotics.

Inorganic light-emitting diodes and photodetectors represent important, established technologies for solid-state lighting, digital imaging and many other applications. Eliminating mechanical and geometrical design constraints imposed by the supporting semiconductor wafers can enable alternative uses in areas such as biomedicine and robotics. Here we describe systems that consist of arrays of interconnected, ultrathin inorganic light-emitting diodes and photodetectors configured in mechanically optimized layouts on unusual substrates. Light-emitting sutures, implantable sheets and illuminated plasmonic crystals that are compatible with complete immersion in biofluids illustrate the suitability of these technologies for use in biomedicine. Waterproof optical-proximity-sensor tapes capable of conformal integration on curved surfaces of gloves and thin, refractive-index monitors wrapped on tubing for intravenous delivery systems demonstrate possibilities in robotics and clinical medicine. These and related systems may create important, unconventional opportunities for optoelectronic devices.

Micromechanics and advanced designs for curved photodetector arrays in hemispherical electronic-eye cameras.

The fabrication of a hemispherical electronic-eye camera with optimized designs based upon micromechanical analysis is reported. The photodetector arrays combine layouts with multidevice tiles and extended, non-coplanar interconnects to improve the fill factor and deformability, respectively. Quantitative comparison to micromechanics analysis reveals the key features of these designs. Color images collected with working cameras demonstrate the utility of these approaches.

Experimental and modeling studies of imaging with curvilinear electronic eye cameras.

Model calculations and the experimental measurements of the imaging properties of planar, hemispherical, and elliptic parabolic electronic eye cameras are compared. Numerical methods for comprehensive full field calculations of image formation are enabled by use computationally efficient modes. Quantitative agreement between these calculations and experimentally measured images of test patterns reveals advantages of curvilinear camera systems, and provides guidelines for future designs.

Leaky-mode assisted fluorescence extraction: application to fluorescence enhancement biosensors.

Efficient recovery of light emitted by fluorescent molecules by employing photonic structures can result in high signal-to-noise ratio detection for biological applications including DNA microarrays, fluorescence microscopy and single molecule detection. By employing a model system comprised of colloidal quantum dots, we consider the physical basis of the extraction effect as provided by photonic crystals. Devices with different lattice symmetry are fabricated ensuring spectral and spatial coupling of quantum dot emission with leaky eigenmodes and the emission characteristics are studied using angle-resolved and angle-integrated measurements. Comparison with numerical calculations and lifetime measurements reveals that the enhancement occurs via resonant redirection of the emitted radiation. Comparison of various lattices reveals differences in the enhancement factor with a maximum enhancement factor approaching 220. We also demonstrate the first enhanced extraction biosensor that allows for over 20-fold enhancement of the fluorescence signal in detection of the cytokine TNF-alpha by a fluorescence sandwich immunoassay.

Fabricating three-dimensional nanostructures using two photon lithography in a single exposure step.

Conformable phase masks, transparent photopolymers and two photon effects provide the basis for a simple, parallel lithographic technique that can form complex, but well defined three-dimensional (3D) nanostructures in a single exposure step. This paper describes the method, presents examples of its ability to form 3D nanostructures (including freestanding particles with controlled shapes) and comprehensive modeling of the associated optics. Single step, large area 3D pattern definition, subwavelength resolution and experimental simplicity represent features that make this method potentially useful for applications in photonics, biotechnology and other areas.

High performance plasmonic crystal sensor formed by soft nanoimprint lithography.

This paper describes a new type of plasmonic sensor fabricated by imprint lithography using a soft, elastomeric mold. Angle-dependent, zero-order transmission experiments demonstrate the sensing potential of this device, which uses a two dimensional plasmonic crystal. Full angle-dependent mapping shows that the sensitivity to surface chemical binding events reaches maxima near regions of the plasmonic Brillouin zone where the dispersion curves of multiple surface plasmon polariton modes converge. This behavior, together with the simple, low cost procedures for building the structures, suggests a potentially important role for these devices in high performance chemical and biological sensing.

Epidermal photonic devices for quantitative imaging of temperature and thermal transport characteristics of the skin.

Characterization of temperature and thermal transport properties of the skin can yield important information of relevance to both clinical medicine and basic research in skin physiology. Here we introduce an ultrathin, compliant skin-like, or 'epidermal', photonic device that combines colorimetric temperature indicators with wireless stretchable electronics for thermal measurements when softly laminated on the skin surface. The sensors exploit thermochromic liquid crystals patterned into large-scale, pixelated arrays on thin elastomeric substrates; the electronics provide means for controlled, local heating by radio frequency signals. Algorithms for extracting patterns of colour recorded from these devices with a digital camera and computational tools for relating the results to underlying thermal processes near the skin surface lend quantitative value to the resulting data. Application examples include non-invasive spatial mapping of skin temperature with milli-Kelvin precision (±50 mK) and sub-millimetre spatial resolution. Demonstrations in reactive hyperaemia assessments of blood flow and hydration analysis establish relevance to cardiovascular health and skin care, respectively.

Optical transduction of chemical forces.

We describe a plasmonic crystal device possessing utility for optically transducing chemical forces. The device couples complex plasmonic fields to chemical changes via a chemoresponsive, surface-bound hydrogel. We find that this architecture significantly enhances the spectroscopic responses seen at visible wavelengths while enabling capacities for sensitive signal transduction, even in cases that involve essentially no change in refractive index, thus allowing analytical detection via colorimetric assays in both imaging and spectroscopic modes.

Enhanced fluorescence emission from quantum dots on a photonic crystal surface.

Colloidal quantum dots display a wide range of novel optical properties that could prove useful for many applications in photonics. Here, we report the enhancement of fluorescence emission from colloidal quantum dots on the surface of two-dimensional photonic crystal slabs. The enhancement is due to a combination of high-intensity near fields and strong coherent scattering effects, which we attribute to leaky eigenmodes of the photonic crystal. By fabricating two-dimensional photonic crystal slabs that operate at visible wavelengths and engineering their leaky modes so that they overlap with the absorption and emission wavelengths of the quantum dots, we demonstrate that the fluorescence intensity can be enhanced by a factor of up to 108 compared with quantum dots on an unpatterned surface.

Quantitative multispectral biosensing and 1D imaging using quasi-3D plasmonic crystals.

We developed a class of quasi-3D plasmonic crystal that consists of multilayered, regular arrays of subwavelength metal nanostructures. The complex, highly sensitive structure of the optical transmission spectra of these crystals makes them especially well suited for sensing applications. Coupled with quantitative electrodynamics modeling of their optical response, they enable full multiwavelength spectroscopic detection of molecular binding events with sensitivities that correspond to small fractions of a monolayer. The high degree of spatial uniformity of the crystals, formed by a soft nanoimprint technique, provides the ability to image binding events over large areas with micrometer spatial resolution. These features, together with compact form factors, low-cost fabrication procedures, simple readout apparatus, and ability for direct integration into microfluidic networks and arrays, suggest promise for these devices in label-free bioanalytical detection systems.

Optically fabricated three dimensional nanofluidic mixers for microfluidic devices.

This paper describes a simple technique for fabricating complex, but well defined, three-dimensional (3D) networks of nanoscale flow paths in the channels of microfluidic systems. Near field scanning optical measurements reveal the optics associated with the fabrication process and the key features that enable its application to the area of microfluidics. Confocal studies of microfluidic devices that incorporate 3D nanostructures formed using this approach show that they function as efficient passive mixing elements, particularly at low Reynolds numbers. This application and others such as separation and extraction inmicrofluidic total analysis systems or lab on a chip devices represent promising areas for 3D nanostructures of this general type.