Rapid single-photon color imaging of moving objects.

This paper outlines an experimental demonstration of a Bayesian image reconstruction approach to achieve rapid single-photon color imaging of moving objects. The capacity to extract the color of objects is important in a variety of target identification and computer vision applications. Nonetheless, it remains challenging to achieve high-speed color imaging of moving objects in low-photon flux environments. The low-photon regime presents particular challenges for efficient spectral separation and identification, while unsupervised image reconstruction algorithms are often slow and computationally expensive. In this paper, we address both of these difficulties using a combination of hardware and computational solutions. We demonstrate color imaging using a Single-Photon Avalanche Diode (SPAD) detector array for rapid, low-light-level data acquisition, with an integrated color filter array (CFA) for efficient spectral unmixing. High-speed image reconstruction is achieved using a bespoke Bayesian algorithm to produce high-fidelity color videos. The analysis is conducted first on simulated data allowing different pixel formats and photon flux scenarios to be investigated. Experiments are then performed using a plasmonic metasurface-based CFA, integrated with a 64 × 64 pixel format SPAD array. Passive imaging is conducted using white-light illumination of multi-colored, moving targets. Intensity information is recorded in a series of 2D photon-counting SPAD frames, from which accurate color information is extracted using the fast Bayesian method introduced herein. The per-frame reconstruction rate proves to be hundreds of times faster than the previous computational method. Furthermore, this approach yields additional information in the form of uncertainty measures, which can be used to assist with imaging system optimization and decision-making in real-world applications. The techniques demonstrated point the way towards rapid video-rate single-photon color imaging. The developed Bayesian algorithm, along with more advanced SPAD technology and utilization of time-correlated single-photon counting (TCSPC) will permit live 3D, color videography in extremely low-photon flux environments.

On-chip ultrasensitive and rapid hydrogen sensing based on plasmon-induced hot electron-molecule interaction.

Hydrogen energy is a zero-carbon replacement for fossil fuels. However, hydrogen is highly flammable and explosive hence timely sensitive leak detection is crucial. Existing optical sensing techniques rely on complex instruments, while electrical sensing techniques usually operate at high temperatures and biasing condition. In this paper an on-chip plasmonic-catalytic hydrogen sensing concept with a concentration detection limit down to 1 ppm is presented that is based on a metal-insulator-semiconductor (MIS) nanojunction operating at room temperature and zero bias. The sensing signal of the device was enhanced by three orders of magnitude at a one-order of magnitude higher response speed compared to alternative non-plasmonic devices. The excellent performance is attributed to the hydrogen induced interfacial dipole charge layer and the associated plasmonic hot electron modulated photoelectric response. Excellent agreements were achieved between experiment and theoretical calculations based on a quantum tunneling model. Such an on-chip combination of plasmonic optics, photoelectric detection and photocatalysis offers promising strategies for next-generation optical gas sensors that require high sensitivity, low time delay, low cost, high portability and flexibility.

Point-of-Care Platform for Diagnosis of Venous Thrombosis by Simultaneous Detection of Thrombin Generation and D-Dimer in Human Plasma.

Venous thromboembolism (VTE) refers to a blood clot that starts in a vein. The risk of developing VTE is highest after major surgery or a major injury, or when someone has heart failure, cancer, or infectious disease (e.g., COVID-19). Without prompt treatment to break up clots and prevent more from forming, VTE can restrict or block blood flow and oxygen, which can damage the body tissue or organs. VTE can occur without any obvious signs, and imaging technologies are used. Alternatively rapid measurement of thrombin generation (TG) and D-dimer could be used to make a fast, portable, and easy-to-use diagnostic platform for VTE. Here, we have demonstrated a diagnostic sensing platform with the ability of simultaneous detection of TG and D-dimer in human plasma. Modifications were made to both the assay protocols to eliminate the need for sample dilution and incubation steps. Using a substantially reduced sample volume, the measurement results show comparable performance to the gold standard method. Our platform is able to deliver accurate and cost-effective results for both TG and D-dimer assays when using undiluted plasma in under 15 min. The assays presented are therefore a good candidate technology for use in a point-of-care platform to diagnose VTE.

Factor VIII companion diagnostic for haemophilia.

Haemophilia is predominantly an inherited disorder that impairs the body's ability to make blood clots, a process needed to stop bleeding. The condition of this disease is complex to manage, but many patients do so through home therapy and often only see their core multidisciplinary healthcare team annually. There is an increasing need for patients to be able to monitor their condition efficiently at home while staying connected with their healthcare team. As a consequence, a low-cost handheld self-monitoring solution for clotting factor is required. Here we have demonstrated a suitable one-step Factor VIII companion diagnostic sensing approach based on a chromogenic assay for haemophilia A. The results show comparable performance to the gold standard method. Our approach is able to deliver accurate cost-effective results in under 5 min from undiluted human plasma. It has the potential to be able to reduce the human and monetary costs of over- or under-medication for haemophiliacs.

An All-Dielectric Metasurface Polarimeter.

The polarization state of light is a key parameter in many imaging systems. For example, it can image mechanical stress and other physical properties that are not seen with conventional imaging and can also play a central role in quantum sensing. However, polarization is more difficult to image, and polarimetry typically involves several independent measurements with moving parts in the measurement device. Metasurfaces with interleaved designs have demonstrated sensitivity to either linear or circular/elliptical polarization states. Here, we present an all-dielectric meta-polarimeter for direct measurement of any arbitrary polarization state from a single-unit-cell design. By engineering a completely asymmetric design, we obtained a metasurface that can excite eigenmodes of the nanoresonators, thus displaying a unique diffraction pattern for not only any linear polarization state but all elliptical polarization states (and handedness) as well. The unique diffraction patterns are quantified into Stokes parameters with a resolution of 5° and with a polarization state fidelity of up to 99 ± 1%. This holds promise for applications in polarization imaging and quantum state tomography.

A monolithic single-chip point-of-care platform for metabolomic prostate cancer detection.

There is a global unmet need for rapid and cost-effective prognostic and diagnostic tools that can be used at the bedside or in the doctor's office to reduce the impact of serious disease. Many cancers are diagnosed late, leading to costly treatment and reduced life expectancy. With prostate cancer, the absence of a reliable test has inhibited the adoption of screening programs. We report a microelectronic point-of-care metabolite biomarker measurement platform and use it for prostate cancer detection. The platform, using an array of photodetectors configured to operate with targeted, multiplexed, colorimetric assays confined in monolithically integrated passive microfluidic channels, completes a combined assay of 4 metabolites in a drop of human plasma in under 2 min. A preliminary clinical study using l-amino acids, glutamate, choline, and sarcosine was used to train a cross-validated random forest algorithm. The system demonstrated sensitivity to prostate cancer of 94% with a specificity of 70% and an area under the curve of 0.78. The technology can implement many similar assay panels and hence has the potential to revolutionize low-cost, rapid, point-of-care testing.

Miniaturized spectroscopy with tunable and sensitive plasmonic structures.

A broad linewidth and a lack of spectral analysis limit the applications of plasmonic sensors. In this Letter, a plasmonic sensor with a large sensitivity in the terahertz (THz) range is proposed based on high-quality factor (>1000) surface lattice resonance in subwavelength near-flat metallic gratings. Moreover, such a highly selective spectral manipulating scheme, plus the greatly localized plasmonic resonance, enables miniaturized spectroscopy based on a single detector by integrating an electro-optical material with the gratings. A spectral resolution of 0.1 GHz at a center frequency of 1.1 THz is predicted showing a four times improvement of measuring efficiency. This technique shows promising potential in on-site matter inspection and point-of-care testing.

Full-color nanorouter for high-resolution imaging.

Pixel scaling effects have been a major issue in the development of high-resolution color image sensors due to the reduced photoelectric signal and color crosstalk. Various structural color techniques have been proposed, and the large freedom in color manipulation by the structure design has been demonstrated. However, the optical efficiency and color distortion limit the practical applications due to their intrinsic filtering mechanism. Instead, the on-chip full-color routing is quite desirable for improving the signal-to-noise ratio. In this study, a single-layer quick response code-like nanorouter is proposed for the full-color light routing in a pixel level of image sensors. It shows much higher routing efficiency than various planar lens schemes for signal wavelength focusing. Moreover, over 60% signal enhancement with robust polarization insensitivity is obtained in all three primary color bands with the same nanorouter by a multi-objective optimization method. Negligible color distortion is observed from the reconstructed color image. Such a simple nanorouter scheme is promising for the development of image sensors, photovoltaics and displays.

Simultaneous multi-spectral, single-photon fluorescence imaging using a plasmonic colour filter array.

We present the first realisation of simultaneous multi-spectral fluorescence imaging using a single-photon avalanche diode (SPAD) array, where the spectral unmixing is facilitated by a plasmonic metasurface mosaic colour filter array (CFA). A 64 × 64 pixel format silicon SPAD array is used to record widefield fluorescence and brightfield data from four biological samples. A plasmonic metasurface composed of an arrangement of circular and elliptical nanoholes etched into an aluminium thin film deposited on a glass substrate provides the high transmission efficiency CFA, enabling a bespoke spectral unmixing algorithm to reconstruct high fidelity, full colour images from as few as ∼3 photons per pixel. This approach points the way toward real-time, single-photon sensitive multi-spectral fluorescence imaging. Furthermore, this is possible without additional bulky components such as a filter wheel, prism or diffraction grating, nor the need for multiple sample exposures or multiple detectors.

Disposable Paper-on-CMOS Platform for Real-Time Simultaneous Detection of Metabolites.

OBJECTIVE: Early stage diagnosis of sepsis without overburdening health services is essential to improving patient outcomes. METHODS: A fast and simple-to-use platform that combines an integrated circuit with paper microfluidics for simultaneous detection of multiple-metabolites appropriate for diagnostics was presented. Paper based sensors are a primary candidate for widespread deployment of diagnostic or test devices. However, the majority of devices today use a simple paper strip to detect a single marker using the reflectance of light. However, for many diseases such as sepsis, one biomarker is not sufficient to make a unique diagnosis. In this work multiple measurements are made on patterned paper simultaneously. Using laser ablation to fabricate microfluidic channels on paper provides a flexible and direct approach for mass manufacture of disposable paper strips. A reusable photodiode array on a complementary metal oxide semiconductor chip is used as the transducer. RESULTS: The system measures changes in optical absorbance in the paper to achieve a cost-effective and easily implemented system that is capable of multiple simultaneous assays. Potential sepsis metabolite biomarkers glucose and lactate have been studied and quantified with the platform, achieving sensitivity within the physiological range in human serum. CONCLUSION: We have detailed a disposable paper-based CMOS photodiode sensor platform for real-time simultaneous detection of metabolites for diseases such as sepsis. SIGNIFICANCE: A combination of a low-cost paper strip with microfluidic channels and a sensitive CMOS photodiode sensor array makes our platform a robust portable and inexpensive biosensing device for multiple diagnostic tests in many different applications.

Multimodal Integrated Sensor Platform for Rapid Biomarker Detection.

Precision metabolomics and quantification for cost-effective rapid diagnosis of disease are the key goals in personalized medicine and point-of-care testing. At present, patients are subjected to multiple test procedures requiring large laboratory equipment. Microelectronics has already made modern computing and communications possible by integration of complex functions within a single chip. As More than Moore technology increases in importance, integrated circuits for densely patterned sensor chips have grown in significance. Here, we present a versatile single complementary metal-oxide-semiconductor chip forming a platform to address personalized needs through on-chip multimodal optical and electrochemical detection that will reduce the number of tests that patients must take. The chip integrates interleaved sensing subsystems for quadruple-mode colorimetric, chemiluminescent, surface plasmon resonance, and hydrogen ion measurements. These subsystems include a photodiode array and a single photon avalanche diode array with some elements functionalized to introduce a surface plasmon resonance mode. The chip also includes an array of ion sensitive field-effect transistors. The sensor arrays are distributed uniformly over an active area on the chip surface in a scalable and modular design. Bio-functionalization of the physical sensors yields a highly selective simultaneous multiple-assay platform in a disposable format. We demonstrate its versatile capabilities through quantified bio-assays performed on-chip for glucose, cholesterol, urea, and urate, each within their naturally occurring physiological range.

Alignment-insensitive bilayer THz metasurface absorbers exceeding 100% bandwidth.

Metamaterial absorbers have been a topic of considerable interest in recent years, with a particular focus on Terahertz (THz) frequencies due to many natural materials having a weak interaction with THz light. Great efforts have aimed to expand such THz absorbers to cover a wide bandwidth whilst also being highly efficient. However, many of these require cascaded or stacked multilayer resonant elements, where even a small deviation in the alignment between layers is extremely detrimental to the performance. Here, we propose a bilayer metasurface absorber (thickness ∼ λ/6) that is immune to such layer misalignments capable of exceeding a fractional bandwidth (FWHM) of 100% of the central frequency. The design works due to a novel absorption mechanism based on Salisbury Screen and anti-reflection absorption mechanisms, using fractal cross absorbers to expand the bandwidth. Our work is of particular benefit to developing devices which require ultra-wide bandwidth, such as bolometric sensing and planar blackbody absorbers, with the extremely robust absorption responses being unaffected by any misalignments between layers - a limiting factor of previous absorbers.

Towards Portable Nanophotonic Sensors.

A range of nanophotonic sensors composed of different materials and device configurations have been developed over the past two decades. These sensors have achieved high performance in terms of sensitivity and detection limit. The size of onchip nanophotonic sensors is also small and they are regarded as a strong candidate to provide the next generation sensors for a range of applications including chemical and biosensing for point-of-care diagnostics. However, the apparatus used to perform measurements of nanophotonic sensor chips is bulky, expensive and requires experts to operate them. Thus, although integrated nanophotonic sensors have shown high performance and are compact themselves their practical applications are limited by the lack of a compact readout system required for their measurements. To achieve the aim of using nanophotonic sensors in daily life it is important to develop nanophotonic sensors which are not only themselves small, but their readout system is also portable, compact and easy to operate. Recognizing the need to develop compact readout systems for onchip nanophotonic sensors, different groups around the globe have started to put efforts in this direction. This review article discusses different works carried out to develop integrated nanophotonic sensors with compact readout systems, which are divided into two categories; onchip nanophotonic sensors with monolithically integrated readout and onchip nanophotonic sensors with separate but compact readout systems.

An integrated portable system for single chip simultaneous measurement of multiple disease associated metabolites.

Metabolites, the small molecules that underpin life, can act as indicators of the physiological state of the body when their abundance varies, offering routes to diagnosis of many diseases. The ability to assay for multiple metabolites simultaneously will underpin a new generation of precision diagnostic tools. Here, we report the development of a handheld device based on complementary metal oxide semiconductor (CMOS) technology with multiple isolated micro-well reaction zones and integrated optical sensing allowing simultaneous enzyme-based assays of multiple metabolites (choline, xanthine, sarcosine and cholesterol) associated with multiple diseases. These metabolites were measured in clinically relevant concentration range with minimum concentrations measured: 25 µM for choline, 100 µM for xanthine, 1.25 µM for sarcosine and 50 µM for cholesterol. Linking the device to an Android-based user interface allows for quantification of metabolites in serum and urine within 2 min of applying samples to the device. The quantitative performance of the device was validated by comparison to accredited tests for cholesterol and glucose.

CMOS compatible metamaterial absorbers for hyperspectral medium wave infrared imaging and sensing applications.

We experimentally demonstrate a CMOS compatible medium wave infrared metal-insulator-metal (MIM) metamaterial absorber structure where for a single dielectric spacer thickness at least 93% absorption is attained for 10 separate bands centred at 3.08, 3.30, 3.53, 3.78, 4.14, 4.40, 4.72, 4.94, 5.33, 5.60 µm. Previous hyperspectral MIM metamaterial absorber designs required that the thickness of the dielectric spacer layer be adjusted in order to attain selective unity absorption across the band of interest thereby increasing complexity and cost. We show that the absorption characteristics of the hyperspectral metamaterial structures are polarization insensitive and invariant for oblique incident angles up to 25° making them suitable for practical implementation in an imaging system. Finally, we also reveal that under TM illumination and at certain oblique incident angles there is an extremely narrowband Fano resonance (Q > 50) between the MIM absorber mode and the surface plasmon polariton mode that could have applications in hazardous/toxic gas identification and biosensing.

Immunoassay Multiplexing on a Complementary Metal Oxide Semiconductor Photodiode Array.

Scalable immunoassay multiplexing offers a route to creating rapid point-of-care (POC) diagnostics. We present a method for multiplexing immunoassays on the surface of a complementary metal oxide semiconductor (CMOS) sensor array integrated circuit (IC) without the use of physical separators such as wells or channels. Major advantages of using a CMOS sensor array include low mass-manufacturing costs, the possibility to multiplex multiple assays on a single IC, and improved signal when averaging multiple sensors, along with providing a platform where wash steps can be incorporated to maximize selectivity and sensitivity compared to paper based lateral flow immunoassay. The device was able to differentiate between samples containing either, neither, or both rabbit anti-mouse (RAM) antibodies and/or anti-HIV gp120 antibodies in serum using a gold-nanoparticle promoted silver enhancement immunoassay. HIV antibody concentrations down to 100 µg/mL were readily detected, which is three times lower than those typically found in infected humans (300-500 µg/mL), and the limit of detection was 10 µg/mL.

Hybrid localized surface plasmon resonance and quartz crystal microbalance sensor for label free biosensing.

We report on the design and fabrication of a hybrid sensor that integrates transmission-mode localized surface plasmonic resonance (LSPR) into a quartz crystal microbalance (QCM) for studying biochemical surface reactions. The coupling of LSPR nanostructures and a QCM allows optical spectra and QCM resonant frequency shifts to be recorded simultaneously and analyzed in real time for a given surface adsorption process. This integration simplifies the conventional combination of SPR and QCM and has the potential to be miniaturized for application in point-of-care (POC) diagnostics. The influence of antibody-antigen recognition effect on both the QCM and LSPR has been analyzed and discussed.

Acoustic Sensing and Ultrasonic Drug Delivery in Multimodal Theranostic Capsule Endoscopy.

Video capsule endoscopy (VCE) is now a clinically accepted diagnostic modality in which miniaturized technology, an on-board power supply and wireless telemetry stand as technological foundations for other capsule endoscopy (CE) devices. However, VCE does not provide therapeutic functionality, and research towards therapeutic CE (TCE) has been limited. In this paper, a route towards viable TCE is proposed, based on multiple CE devices including important acoustic sensing and drug delivery components. In this approach, an initial multimodal diagnostic device with high-frequency quantitative microultrasound that complements video imaging allows surface and subsurface visualization and computer-assisted diagnosis. Using focused ultrasound (US) to mark sites of pathology with exogenous fluorescent agents permits follow-up with another device to provide therapy. This is based on an US-mediated targeted drug delivery system with fluorescence imaging guidance. An additional device may then be utilized for treatment verification and monitoring, exploiting the minimally invasive nature of CE. While such a theranostic patient pathway for gastrointestinal treatment is presently incomplete, the description in this paper of previous research and work under way to realize further components for the proposed pathway suggests it is feasible and provides a framework around which to structure further work.

Uncooled CMOS terahertz imager using a metamaterial absorber and pn diode.

We demonstrate a low-cost uncooled terahertz (THz) imager fabricated in a standard 180 nm CMOS process. The imager is composed of a broadband THz metamaterial absorber coupled with a diode microbolometer sensor where the pn junction is used as a temperature sensitive device. The metamaterial absorber array is integrated in the top metallic layers of a six metal layer process allowing for complete monolithic integration of the metamaterial absorber and sensor. We demonstrate the capability of the detector for stand-off imaging applications by using it to form transmission and reflection images of a metallic object hidden in a manila envelope.

Nanophotonic Image Sensors.

The increasing miniaturization and resolution of image sensors bring challenges to conventional optical elements such as spectral filters and polarizers, the properties of which are determined mainly by the materials used, including dye polymers. Recent developments in spectral filtering and optical manipulating techniques based on nanophotonics have opened up the possibility of an alternative method to control light spectrally and spatially. By integrating these technologies into image sensors, it will become possible to achieve high compactness, improved process compatibility, robust stability and tunable functionality. In this Review, recent representative achievements on nanophotonic image sensors are presented and analyzed including image sensors with nanophotonic color filters and polarizers, metamaterial-based THz image sensors, filter-free nanowire image sensors and nanostructured-based multispectral image sensors. This novel combination of cutting edge photonics research and well-developed commercial products may not only lead to an important application of nanophotonics but also offer great potential for next generation image sensors beyond Moore's Law expectations.