Perovskite-Doped Modulated Color-Selective Photosynaptic Transistors for Target Object Recognition.

The processing of multicolor noisy images in visual neuromorphic devices requires selective absorption at specific wavelengths; however, it is difficult to achieve this because the spectral absorption range of the device is affected by the type of material. Surprisingly, the absorption range of perovskite materials can be adjusted by doping. Herein, a CdCl2 co-doped CsPbBr3 nanocrystal-based photosensitive synaptic transistor (PST) is reported. By decreasing the doping concentration, the response of the PST to short-wavelength light is gradually enhanced, and even weak light of 40 µW·cm-2 can be detected. Benefiting from the excellent color selectivity of the PST device, the device array is applied to feature extraction of target blue items and removal of red and green noise, which results in the recognition accuracy of 95% for the noisy MNIST data set. This work provides new ideas for the application of novel transistors integrating sensors and storage computing.

A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures.

Some recent studies show that filters in convolutional neural networks (CNNs) have low color selectivity in datasets of natural scenes such as Imagenet. CNNs, bio-inspired by the visual cortex, are characterized by their hierarchical learning structure which appears to gradually transform the representation space. Inspired by the direct connection between the LGN and V4, which allows V4 to handle low-level information closer to the trichromatic input in addition to processed information that comes from V2/V3, we propose the addition of a long skip connection (LSC) between the first and last blocks of the feature extraction stage to allow deeper parts of the network to receive information from shallower layers. This type of connection improves classification accuracy by combining simple-visual and complex-abstract features to create more color-selective ones. We have applied this strategy to classic CNN architectures and quantitatively and qualitatively analyzed the improvement in accuracy while focusing on color selectivity. The results show that, in general, skip connections improve accuracy, but LSC improves it even more and enhances the color selectivity of the original CNN architectures. As a side result, we propose a new color representation procedure for organizing and filtering feature maps, making their visualization more manageable for qualitative color selectivity analysis.

A Molecular-Switch-Embedded Organic Photodiode for Capturing Images against Strong Backlight.

When the intensity of the incident light increases, the photocurrents of organic photodiodes (OPDs) exhibit relatively early saturation, due to which OPDs cannot easily detect objects against strong backlights, such as sunlight. In this study, this problem is addressed by introducing a light-intensity-dependent transition of the operation mode, such that the operation mode of the OPD autonomously changes to overcome early photocurrent saturation as the incident light intensity passes the threshold intensity. The photoactive layer is doped with a strategically designed and synthesized molecular switch, 1,2-bis-(2-methyl-5-(4-cyanobiphenyl)-3-thienyl)tetrafluorobenzene (DAB). The proposed OPD exhibits a typical OPD performance with an external quantum efficiency (EQE) of <100% and a photomultiplication behavior with an EQE of >100% under low-intensity and high-intensity light illuminations, respectively, thereby resulting in an extension of the photoresponse linearity to a light intensity of 434 mW cm-2 . This unique and reversible transition of the operation mode can be explained by the unbalanced quantum yield of photocyclization/photocycloreversion of the molecular switch. The details of the operation mechanism are discussed in conjunction with various photophysical analyses. Furthermore, they establish a prototype image sensor with an array of molecular-switch-embedded OPD pixels to demonstrate their extremely high sensitivity against strong light illumination.

Color-Selective Printed Organic Photodiodes for Filterless Multichannel Visible Light Communication.

Future lightweight, flexible, and wearable electronics will employ visible-light-communication schemes to interact within indoor environments. Organic photodiodes are particularly well suited for such technologies as they enable chemically tailored optoelectronic performance and fabrication by printing techniques on thin and flexible substrates. However, previous methods have failed to address versatile functionality regarding wavelength selectivity without increasing fabrication complexity. This work introduces a general solution for printing wavelength-selective bulk-heterojunction photodetectors through engineering of the ink formulation. Nonfullerene acceptors are incorporated in a transparent polymer donor matrix to narrow and tune the response in the visible range without optical filters or light-management techniques. This approach effectively decouples the optical response from the viscoelastic ink properties, simplifying process development. A thorough morphological and spectroscopic investigation finds excellent charge-carrier dynamics enabling state-of-the-art responsivities >102 mA W-1 and cutoff frequencies >1.5 MHz. Finally, the color selectivity and high performance are demonstrated in a filterless visible-light-communication system capable of demultiplexing intermixed optical signals.

Organic Photodiodes: The Future of Full Color Detection and Image Sensing.

Major growth in the image sensor market is largely as a result of the expansion of digital imaging into cameras, whether stand-alone or integrated within smart cellular phones or automotive vehicles. Applications in biomedicine, education, environmental monitoring, optical communications, pharmaceutics and machine vision are also driving the development of imaging technologies. Organic photodiodes (OPDs) are now being investigated for existing imaging technologies, as their properties make them interesting candidates for these applications. OPDs offer cheaper processing methods, devices that are light, flexible and compatible with large (or small) areas, and the ability to tune the photophysical and optoelectronic properties - both at a material and device level. Although the concept of OPDs has been around for some time, it is only relatively recently that significant progress has been made, with their performance now reaching the point that they are beginning to rival their inorganic counterparts in a number of performance criteria including the linear dynamic range, detectivity, and color selectivity. This review covers the progress made in the OPD field, describing their development as well as the challenges and opportunities.

Color opponent receptive fields self-organize in a biophysical model of visual cortex via spike-timing dependent plasticity.

Although many computational models have been proposed to explain orientation maps in primary visual cortex (V1), it is not yet known how similar clusters of color-selective neurons in macaque V1/V2 are connected and develop. In this work, we address the problem of understanding the cortical processing of color information with a possible mechanism of the development of the patchy distribution of color selectivity via computational modeling. Each color input is decomposed into a red, green, and blue representation and transmitted to the visual cortex via a simulated optic nerve in a luminance channel and red-green and blue-yellow opponent color channels. Our model of the early visual system consists of multiple topographically-arranged layers of excitatory and inhibitory neurons, with sparse intra-layer connectivity and feed-forward connectivity between layers. Layers are arranged based on anatomy of early visual pathways, and include a retina, lateral geniculate nucleus, and layered neocortex. Each neuron in the V1 output layer makes synaptic connections to neighboring neurons and receives the three types of signals in the different channels from the corresponding photoreceptor position. Synaptic weights are randomized and learned using spike-timing-dependent plasticity (STDP). After training with natural images, the neurons display heightened sensitivity to specific colors. Information-theoretic analysis reveals mutual information between particular stimuli and responses, and that the information reaches a maximum with fewer neurons in the higher layers, indicating that estimations of the input colors can be done using the output of fewer cells in the later stages of cortical processing. In addition, cells with similar color receptive fields form clusters. Analysis of spiking activity reveals increased firing synchrony between neurons when particular color inputs are presented or removed (ON-cell/OFF-cell).