Flexible and Stretchable Light-Emitting Diodes and Photodetectors for Human-Centric Optoelectronics.

Optoelectronic devices with unconventional form factors, such as flexible and stretchable light-emitting or photoresponsive devices, are core elements for the next-generation human-centric optoelectronics. For instance, these deformable devices can be utilized as closely fitted wearable sensors to acquire precise biosignals that are subsequently uploaded to the cloud for immediate examination and diagnosis, and also can be used for vision systems for human-interactive robotics. Their inception was propelled by breakthroughs in novel optoelectronic material technologies and device blueprinting methodologies, endowing flexibility and mechanical resilience to conventional rigid optoelectronic devices. This paper reviews the advancements in such soft optoelectronic device technologies, honing in on various materials, manufacturing techniques, and device design strategies. We will first highlight the general approaches for flexible and stretchable device fabrication, including the appropriate material selection for the substrate, electrodes, and insulation layers. We will then focus on the materials for flexible and stretchable light-emitting diodes, their device integration strategies, and representative application examples. Next, we will move on to the materials for flexible and stretchable photodetectors, highlighting the state-of-the-art materials and device fabrication methods, followed by their representative application examples. At the end, a brief summary will be given, and the potential challenges for further development of functional devices will be discussed as a conclusion.

Compact wide-angle capsule endoscopic lens design.

Capsule endoscopes require a high-quality imaging system in terms of the wide field of view (FOV), image brightness, and resolution to provide accurate diagnostic information. However, because of the wide-angle lens design, the first element of the lens inevitably becomes larger in diameter, making it difficult to reduce the overall size of the lens. In this study, the compact wide-angle lens for a capsule endoscope is reported. The proposed system allows the first element to be compact in diameter and increases image quality by utilizing all aspheric surfaces for optical aberration control. The specification of the proposed capsule endoscope lens shows the wide FOV of 160 deg, F-number 2.8, and total track length of 5 mm. In the overall FOV, relative illumination is still over 60%. To achieve a high image quality in the proposed system, the modulation transfer function is over 30% at 180 lp/mm for a${1920} \times {1080}$1920×1080 1/6 inch CMOS image sensor in a pixel size of 1.4 µm.

Nanomaterial-Based Artificial Vision Systems: From Bioinspired Electronic Eyes to In-Sensor Processing Devices.

High-performance robotic vision empowers mobile and humanoid robots to detect and identify their surrounding objects efficiently, which enables them to cooperate with humans and assist human activities. For error-free execution of these robots' tasks, efficient imaging and data processing capabilities are essential, even under diverse and complex environments. However, conventional technologies fall short of meeting the high-standard requirements of robotic vision under such circumstances. Here, we discuss recent progress in artificial vision systems with high-performance imaging and data processing capabilities enabled by distinctive electrical, optical, and mechanical characteristics of nanomaterials surpassing the limitations of traditional silicon technologies. In particular, we focus on nanomaterial-based electronic eyes and in-sensor processing devices inspired by biological eyes and animal visual recognition systems, respectively. We provide perspectives on key nanomaterials, device components, and their functionalities, as well as explain the remaining challenges and future prospects of the artificial vision systems.

Avian eye-inspired perovskite artificial vision system for foveated and multispectral imaging.

Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye-inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.

Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array.

The bioinspired camera, comprising a single lens and a curved image sensor-a photodiode array on a curved surface-, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.

Cuttlefish eye-inspired artificial vision for high-quality imaging under uneven illumination conditions.

With the rise of mobile robotics, including self-driving automobiles and drones, developing artificial vision for high-contrast and high-acuity imaging in vertically uneven illumination conditions has become an important goal. In such situations, balancing uneven illumination, improving image contrast for facile object detection, and achieving high visual acuity in the main visual fields are key requirements. Meanwhile, in nature, cuttlefish (genus Sepia) have evolved an eye optimized for vertically uneven illumination conditions, which consists of a W-shaped pupil, a single spherical lens, and a curved retina with a high-density photoreceptor arrangement and polarized light sensitivity. Here, inspired by the cuttlefish eye, we report an artificial vision system consisting of a W-shaped pupil, a single ball lens, a surface-integrated flexible polarizer, and a cylindrical silicon photodiode array with a locally densified pixel arrangement. The W-shaped pupil integrated on the ball lens balances vertically uneven illumination, and the cylindrical silicon photodiode array integrated with the flexible polarizer enables high-contrast and high-acuity imaging.

Full-Control and Switching of Optical Fano Resonance by Continuum State Engineering.

Fano resonance, known for its unique asymmetric line shape, has gained significant attention in photonics, particularly in sensing applications. However, it remains difficult to achieve controllable Fano parameters with a simple geometric structure. Here, a novel approach of using a thin-film optical Fano resonator with a porous layer to generate entire spectral shapes from quasi-Lorentzian to Lorentzian to Fano is proposed and experimentally demonstrated. The glancing angle deposition technique is utilized to create a polarization-dependent Fano resonator. By altering the linear polarization between s- and p-polarization, a switchable Fano device between quasi-Lorentz state and negative Fano state is demonstrated. This change in spectral shape is advantageous for detecting materials with a low-refractive index. A bio-particle sensing experiment is conducted that demonstrates an enhanced signal-to-noise ratio and prediction accuracy. Finally, the challenge of optimizing the film-based Fano resonator due to intricate interplay among numerous parameters, including layer thicknesses, porosity, and materials selection, is addressed. The inverse design tool is developed based on a multilayer perceptron model that allows fast computation for all ranges of Fano parameters. The method provides improved accuracy of the mean validation factor (MVF = 0.07, q-q') compared to the conventional exhaustive enumeration method (MVF = 0.37).

Vari-Focal Light Field Camera for Extended Depth of Field.

The light field camera provides a robust way to capture both spatial and angular information within a single shot. One of its important applications is in 3D depth sensing, which can extract depth information from the acquired scene. However, conventional light field cameras suffer from shallow depth of field (DoF). Here, a vari-focal light field camera (VF-LFC) with an extended DoF is newly proposed for mid-range 3D depth sensing applications. As a main lens of the system, a vari-focal lens with four different focal lengths is adopted to extend the DoF up to ~15 m. The focal length of the micro-lens array (MLA) is optimized by considering the DoF both in the image plane and in the object plane for each focal length. By dividing measurement regions with each focal length, depth estimation with high reliability is available within the entire DoF. The proposed VF-LFC is evaluated by the disparity data extracted from images with different distances. Moreover, the depth measurement in an outdoor environment demonstrates that our VF-LFC could be applied in various fields such as delivery robots, autonomous vehicles, and remote sensing drones.

Recent Advances in Vertically Aligned Nanowires for Photonics Applications.

Over the past few decades, nanowires have arisen as a centerpiece in various fields of application from electronics to photonics, and, recently, even in bio-devices. Vertically aligned nanowires are a particularly decent example of commercially manufacturable nanostructures with regard to its packing fraction and matured fabrication techniques, which is promising for mass-production and low fabrication cost. Here, we track recent advances in vertically aligned nanowires focused in the area of photonics applications. Begin with the core optical properties in nanowires, this review mainly highlights the photonics applications such as light-emitting diodes, lasers, spectral filters, structural coloration and artificial retina using vertically aligned nanowires with the essential fabrication methods based on top-down and bottom-up approaches. Finally, the remaining challenges will be briefly discussed to provide future directions.

High-Identical Numerical Aperture, Multifocal Microlens Array through Single-Step Multi-Sized Hole Patterning Photolithography.

Imaging applications based on microlens arrays (MLAs) have a great potential for the depth sensor, wide field-of-view camera and the reconstructed hologram. However, the narrow depth-of-field remains the challenge for accurate, reliable depth estimation. Multifocal microlens array (Mf-MLAs) is perceived as a major breakthrough, but existing fabrication methods are still hindered by the expensive, low-throughput, and dissimilar numerical aperture (NA) of individual lenses due to the multiple steps in the photolithography process. This paper reports the fabrication method of high NA, Mf-MLAs for the extended depth-of-field using single-step photolithography assisted by chemical wet etching. The various lens parameters of Mf-MLAs are manipulated by the multi-sized hole photomask and the wet etch time. Theoretical and experimental results show that the Mf-MLAs have three types of lens with different focal lengths, while maintaining the uniform and high NA irrespective of the lens type. Additionally, we demonstrate the multi-focal plane image acquisition via Mf-MLAs integrated into a microscope.