Contrast Enhancement Method Using Region-Based Dynamic Clipping Technique for LWIR-Based Thermal Camera of Night Vision Systems.

In the autonomous driving industry, there is a growing trend to employ long-wave infrared (LWIR)-based uncooled thermal-imaging cameras, capable of robustly collecting data even in extreme environments. Consequently, both industry and academia are actively researching contrast-enhancement techniques to improve the quality of LWIR-based thermal-imaging cameras. However, most research results only showcase experimental outcomes using mass-produced products that already incorporate contrast-enhancement techniques. Put differently, there is a lack of experimental data on contrast enhancement post-non-uniformity (NUC) and temperature compensation (TC) processes, which generate the images seen in the final products. To bridge this gap, we propose a histogram equalization (HE)-based contrast enhancement method that incorporates a region-based clipping technique. Furthermore, we present experimental results on the images obtained after applying NUC and TC processes. We simultaneously conducted visual and qualitative performance evaluations on images acquired after NUC and TC processes. In the visual evaluation, it was confirmed that the proposed method improves image clarity and contrast ratio compared to conventional HE-based methods, even in challenging driving scenarios such as tunnels. In the qualitative evaluation, the proposed method demonstrated upper-middle-class rankings in both image quality and processing speed metrics. Therefore, our proposed method proves to be effective for the essential contrast enhancement process in LWIR-based uncooled thermal-imaging cameras intended for autonomous driving platforms.

Assessing the influence of cannabis and alcohol use on different visual functions: A comparative study.

This study aimed to assess and compare the influence of alcohol intake and cannabis smoking on different visual functions. A total of 64 young and healthy volunteers took part in the study. All undertook several randomised experimental sessions in which different visual functions, namely distance stereopsis, retinal straylight, visual discrimination capacity, and contrast sensitivity, were tested. Cannabis smokers (N = 30) took a baseline session and a session after smoking a cannabis cigarette, whereas alcohol users (N = 34) underwent a baseline session, a session after a low alcohol intake (Alcohol 1), and a session after a moderate to high alcohol intake (Alcohol 2). All visual functions were impaired by cannabis and alcohol use, particularly for the Cannabis and Alcohol 2 groups. The deterioration of all visual variables was higher for the Alcohol 2 than for the Alcohol 1 and Cannabis groups, except for retinal straylight, the deterioration of which was equal for the Cannabis group, and distant stereopsis, which was more impaired for the Cannabis group. The Alcohol 2 group experienced the most impairing conditions, although very similar to the cannabis group, and that factors other than the experimental conditions, such as sex and age, also influenced these visual changes. Alcohol and cannabis use clearly impair vision. The deterioration caused by cannabis is similar to, but slightly lower than, that produced by a moderate to high alcohol intake, with the experimental conditions, sex and age all having an impact on the variability of visual deterioration.

A randomized phase 2 clinical trial of phentolamine mesylate eye drops in patients with severe night vision disturbances.

PURPOSE: Dim light vision disturbances (DLD) comprise a wide range of symptoms affecting the quality of vision at low illumination including glare, halos, and starbursts. This exploratory study investigated 1.0% phentolamine mesylate ophthalmic solution (PMOS) as a treatment to improve vision and image quality for patients with DLD. METHODS: In this placebo-controlled, randomized, double-masked clinical trial, 24 adult patients with severe DLD were randomized in a 2:1 ratio to receive either one dose of PMOS or placebo. Subjects were eligible if they reported experiencing severe night vision difficulty that was not eliminated by distance spectacle correction and scored ≥0.3 log units below the normal range of contrast sensitivity assessed under mesopic conditions with glare at ≥2 spatial frequencies. Key efficacy outcomes were change from baseline in pupil diameter, contrast sensitivity, and visual acuity. Safety measures including intraocular pressure, conjunctival hyperemia, and systemic effects were also assessed. RESULTS: Eight subjects were randomized to placebo (63% female; mean age 47 years) and 16 were randomized to PMOS (75% female; mean age 42 years). Mean (SD) pupil diameter of PMOS-treated subjects decreased significantly - 1.3 mm (0 to - 2.8 mm) with p < 0.0001. Mean contrast sensitivity with glare in PMOS-treated subjects improved significantly post-treatment at spatial frequencies 3, 6, 12, and 18 cycles per degree (p ≤ 0.03). PMOS also demonstrated improvements in the numbers of letters read for mesopic and photopic, high- and low-contrast visual acuity (LCVA). Importantly, a statistically greater proportion of PMOS-treated eyes registered mesopic LCVA 5 letter (69% vs. 31%, p = 0.029) and 10 letter (34% vs. 6%, p = 0.04) improvement, with a trend at 15 letters (19% vs. 0%, p = 0.16). PMOS was well tolerated with the only reported side effect being a mild increase in conjunctival hyperemia. CONCLUSION: PMOS was well tolerated and effectively reduced pupil size with improvements in contrast sensitivity and visual acuity in adults with severe DLD. Future Phase 3 studies should be conducted to further evaluate its potential to treat DLD. TRIAL REGISTRATION: The trial registration number is NCT04004507 (02/07/2019). Retrospectively registered.

Automated License Plate Recognition for Resource-Constrained Environments.

The incorporation of deep-learning techniques in embedded systems has enhanced the capabilities of edge computing to a great extent. However, most of these solutions rely on high-end hardware and often require a high processing capacity, which cannot be achieved with resource-constrained edge computing. This study presents a novel approach and a proof of concept for a hardware-efficient automated license plate recognition system for a constrained environment with limited resources. The proposed solution is purely implemented for low-resource edge devices and performed well for extreme illumination changes such as day and nighttime. The generalisability of the proposed models has been achieved using a novel set of neural networks for different hardware configurations based on the computational capabilities and low cost. The accuracy, energy efficiency, communication, and computational latency of the proposed models are validated using different license plate datasets in the daytime and nighttime and in real time. Meanwhile, the results obtained from the proposed study have shown competitive performance to the state-of-the-art server-grade hardware solutions as well.

Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion.

In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion.

Simultaneous Broadening and Enhancement of Cr3+ Photoluminescence in LiIn2 SbO6 by Chemical Unit Cosubstitution: Night-Vision and Near-Infrared Spectroscopy Detection Applications.

Near-infrared (NIR)-emitting phosphor materials have been extensively developed for optoelectronic and biomedical applications. Although Cr3+ -activated phosphors have been widely reported, it is challenging to achieve ultra-broad and tunable NIR emission. Here, a new ultra-broadband NIR-emitting LiIn2 SbO6 :Cr3+ phosphor with emission peak at 965 nm and a full-width at half maximum of 217 nm is reported. Controllable emission tuning from 965 to 892 nm is achieved by chemical unit cosubstitution of [Zn2+ -Zn2+ ] for [Li+ -In3+ ], which can be ascribed to the upshift of 4 T2g energy level due to the strengthened crystal field. Moreover, the emission is greatly enhanced, and the FWHM reaches 235 nm. The as-prepared luminescent tunable NIR-emitting phosphors have demonstrated the potential in night-vision and NIR spectroscopy techniques. This work proves the feasibility of chemical unit cosubstitution strategy in emission tuning of Cr3+ -doped phosphors, which can stimulate further studies on the emission-tunable NIR-emitting phosphor materials.

Verifying complaints of difficulties in night vision using electroretinography and dark adaptation tests.

PURPOSE: To determine the electroretinographical and psychophysical parameters that can help to verify patients' complaints of reduced night vision. METHODS: We tested 275 consecutive patients with normal appearing fundi, complaining of visual difficulties at night, using flash electroretinography (ERG) and dark adaptation (DA) test. Two ERG parameters were used to assess a scotopic retinal function: the amplitude of the response to dim blue flash (the rod response) and the b-wave ratio (measured/expected). Dark adaptation was measured with green- and red-light stimuli after exposure to a bright, bleaching light. The psychophysical parameter of night vision was defined as the threshold for detection of the blue-green stimulus that was measured after 40-45 min in complete darkness. RESULTS: Fifty-five patients were excluded from the analysis because of a discrepancy between the two ERG parameters in assessment of scotopic retinal function. The remaining 220 patients were divided into 4 groups: (1) normal ERG and normal DA, (2) subnormal ERG and subnormal DA, (3) normal ERG and subnormal DA and (4) subnormal ERG and normal DA. The ERG and DA tests supported the complaint of visual difficulties at night in 67 patients (group 2), while 34 patients were characterized as having normal scotopic visual function (group 1). The other 119 patients (groups 3 and 4) presented a diagnostic dilemma because one test (ERG or dark adaptation) showed normal scotopic function, while the other indicated subnormal scotopic function. CONCLUSION: Our findings indicate that ERG is an essential, but not sufficient test for verifying patient's complaint on visual difficulties in the dark. We suggest using both electroretinography and psychophysical dark adaptation to test patients complaining of reduced night vision.

Tuning of Classifiers to Speed-Up Detection of Pedestrians in Infrared Images.

This paper presents an experimental evaluation of real-time pedestrian detection algorithms and their tuning using the proposed universal performance index. With this index, the precise choice of various parameters is possible. Moreover, we determined the best resolution of the analysis window, which is much lower than the initial window. By such means, we can speed-up the processing (i.e., reduce the classification time by 74%). There are cases in which we increased both the processing speed and the classification accuracy. We made experiments with various baseline detectors and datasets in order to confirm versatility of the proposed ideas. The analyzed classifiers are those typically applied to detection of pedestrians, namely: aggregated channel feature (ACF), deep convolutional neural network (CNN), and support vector machine (SVM). We used a suite of five precisely chosen night (and day) IR vision datasets.

Development of Marker-Free Night-Vision Displacement Sensor System by Using Image Convex Hull Optimization.

Vision-based displacement sensors (VDSs) have the potential to be widely used in the structural health monitoring field, because the VDSs are generally easier to install and have higher applicability to the existing structures compared to the other conventional displacement sensors. However, the VDS also has disadvantages, in that ancillary markers are needed for extracting displacement data and data reliability is significantly lowered at night. In this study, a night vision displacement sensor (NVDS) was proposed to overcome the aforementioned two limitations. First, a non-contact NVDS system is developed with the installation of the infrared (IR) pass filter. Since it utilizes the wavelength of the infrared region and it is not sensitive to the change of a visible ray, it can precisely extract the shape information of the structure even at night. Second, a technique to extract the feature points from the images without any ancillary marker was formulated through an image convex hull optimization. Finally, the experimental tests of a three-story scaled model were performed to investigate the effectiveness of proposed NVDS at night. The results demonstrate that the NVDS has sufficiently high accuracy even at night and it can precisely measure the dynamic characteristics such as mode shapes and natural frequencies of the structure. The proposed system and formulation would extend the applicability of vision sensor not only into night-time measure but also marker-free measure.

Safest light in a combat area while performing intravenous access in the dark.

INTRODUCTION: Cannulation for the administration of intravenous fluids is integral to the prehospital management of injured military patients. However, this may be technically challenging to undertake during night-time conditions where the use of light to aid cannulation may give the tactical situation away to opponents. The aim of this study was to investigate the success and tactical safety of venepuncture under battlefield conditions with different colour light sources. METHOD: The procedure was carried out with naked eye in a bright room in the absence of a separate light source, with a naked eye in a dark room under red, white, blue and green light sources and under an infrared light source while wearing night vision goggles (NVGs). The success, safety, degree of difficulty and completion time for each procedure were then explored. RESULTS: All interventions made in daylight and in a dark room were found to be 100% successful. Interventions performed under infrared light while wearing NVGs took longer than under other light sources or in daylight. Interventions performed under blue light were tactically safer when compared with interventions performed under different light sources. CONCLUSION: Blue light offered the best tactical safety during intravenous cannulation under night-time conditions and is recommended for future use in tactical casualty care. The use of NVGs using infrared light cannot be recommended if there is the possibility of opponents having access to the technology.

Development of an Automatic Testing Platform for Aviator's Night Vision Goggle Honeycomb Defect Inspection.

Due to the direct influence of night vision equipment availability on the safety of night-time aerial reconnaissance, maintenance needs to be carried out regularly. Unfortunately, some defects are not easy to observe or are not even detectable by human eyes. As a consequence, this study proposed a novel automatic defect detection system for aviator's night vision imaging systems AN/AVS-6(V)1 and AN/AVS-6(V)2. An auto-focusing process consisting of a sharpness calculation and a gradient-based variable step search method is applied to achieve an automatic detection system for honeycomb defects. This work also developed a test platform for sharpness measurement. It demonstrates that the honeycomb defects can be precisely recognized and the number of the defects can also be determined automatically during the inspection. Most importantly, the proposed approach significantly reduces the time consumption, as well as human assessment error during the night vision goggle inspection procedures.

Vision-targeted health related quality of life in older adults: patient-reported visibility problems in low luminance activities are more likely to decline than daytime activities.

BACKGROUND: Commonly used vision-targeted health-related quality of life questionnaires almost exclusively focus items on vision under daytime conditions. Older adults even when in good eye health frequently report experiencing vision problems at night and under low environmental light levels, and psychophysical studies also document these visibility problems. Here we compare the progression of self-reported low luminance visibility problems and self-reported visibility problems under daytime conditions in older adults. METHODS: Trained interviewers administered two questionnaires to older adults in normal eye health: the National Eye Institute Visual Function Questionnaire - 25 (NEI VFQ-25) where items are almost entirely focused on difficulties in daytime activities, and the Low Luminance Questionnaire (LLQ) where items are focused on difficulties seeing at night and under low luminance conditions. The following visual functions were also measured: visual acuity, low luminance visual acuity, low luminance deficit, contrast sensitivity, light sensitivity in the macula, and rod-mediated dark adaptation. The protocol was repeated 3 years later. RESULTS: Scores on the NEI VFQ-25 composite and its subscales were unchanged between baseline and 3-year follow-up, whereas scores on the LLQ composite and 5 of 6 subscales significantly decreased (corresponding to less functionality) at the 3-year follow-up. Participants were more likely to display a ≥ 5 point decrease on the LLQ composite than on the NEI VFQ-25 over 3 years. Visual functional tests were largely unrelated to changes in NEI VFQ-25 and LLQ scores from baseline to follow-up. CONCLUSIONS: Older adults' vision-targeted quality of life as measured by questionnaire is more likely to exhibit a practically significant decrease over 3 years using a questionnaire that focused on low luminance activities (LLQ) than one focused on daytime activities (NEI VFQ-25). That the results of visual functional testing did not correspond to older adults' decline in self-reported problems in low luminance activities emphasizes the importance of questionnaires in understanding visual difficulties from the patients' own perspective.

Isotretinoin and night blindness.

Isotretinoin is an effective and increasingly popular treatment for acne vulgaris. There have been reports of night blindness as a side-effect of treatment although the evidence does not demonstrate a clear causal relationship between isotretinoin therapy and the risk of night blindness. Nevertheless, considering the lack of evidence in this area, it is important to educate patients about this potential consequence, which may become longstanding and even irreversible, and encourage them to promptly report changes in their night vision.

Efficacy of a wearable night-vision aid in patients with concentric peripheral visual field loss: a randomized, crossover trial.

PURPOSE: To investigate the efficacy of our wearable night-vision aid in patients with concentric peripheral visual field loss. STUDY DESIGN: Prospective, single blind, three-group, and three-period crossover clinical study. METHODS: The study included patients with concentric peripheral visual field loss, a best-corrected visual acuity (decimal visual acuity) of 0.1 or higher in the better eye, and the presence of a central visual field. HOYA MW10 HiKARI® (HOYA Corporation), our original wearable night-vision aid, was used as the test device with three types of camera lenses (standard-, middle-, and wide-angle lenses). Under both bright and dark conditions, the angle of the horizontal visual field was measured using each of the three lens types for each group. The baseline angle was measured when each participant wore the night-vision aid (powered off). RESULTS: The study included 21 participants. Under bright condition, the perceived horizontal visual field was significantly wider than the baseline setup when using the standard-angle lens ("the standard lens"); the middle-angle lens ("the middle lens") was significantly wider than both the baseline setup and the standard lens; and the wide-angle lens ("the wide lens") was significantly wider than the other lenses. Under dark condition, the perceived horizontal visual field was again significantly wider when using the middle lens than the baseline setup and the standard lens, and when using the wide lens, the perceived horizontal visual field was again wider than when using the other lenses. The control in the bright condition was significantly wider (p < 0.001) than when used in the dark condition, while the standard-angle lens in the dark condition was significantly wider (p = 0.05) than when used in the bright condition. In regards to the middle and wide lenses, there was no statistically significant result emerging from either of the illumination conditions. CONCLUSION: Our wearable night-vision aid with a middle-angle or wide-angle lens appears to provide wider visual field images in patients with concentric peripheral visual field loss, regardless of whether the illumination conditions are bright or dark.

Near-Infrared Long Afterglow in Fe3+-Activated Mg2SnO4 for Self-Sustainable Night Vision.

The advent of near-infrared (NIR) afterglow in Cr3+-doped materials has stimulated considerable interest in technological applications owing to the sustainable emission of light with good penetrability. However, the development of Cr3+-free NIR afterglow phosphors with high efficiency, low cost, and precise spectral tunability is still an open question. Herein, we report a novel Fe3+-activated NIR long afterglow phosphor composed of Mg2SnO4 (MSO), in which Fe3+ ions occupy the tetrahedral [Mg-O4] and octahedral [Sn/Mg-O6] sites, giving rise to a broadband NIR emission spanning 720-789 nm. On account of energy-level alignment, the electrons released from the traps show a preferential return to the excited energy level of Fe3+ in tetrahedral sites through tunneling, leading to a single-peak NIR afterglow centered at 789 nm with a full-width at half-maximum (fwhm) of 140 nm. The high-efficiency NIR afterglow, showing a record persistent time lasting over 31 h among Fe3+-based phosphors, is demonstrated as a self-sustainable light source for night vision applications. This work not only provides a novel Fe3+-doped high-efficiency NIR afterglow phosphor for technological applications but also establishes practical guidance for rational tuning of afterglow emissions.

Visual resolution under photopic and mesopic conditions in patients with Sjögren's syndrome.

AIM: To focus on different visual resolution tasks under photopic and mesopic conditions in Sjögren's syndrome patients compared to age-matched healthy controls. METHODS: The visual resolution measurements included high and low visual acuities and contrast sensitivity functions. These tests were conducted under photopic and then mesopic conditions. Twenty-one Sjögren's syndrome patients and 21 aged-matched healthy volunteers completed all the measurements in this study. RESULTS: Sjögren's syndrome patients have greater impairment in contrast sensitivity than standardized visual acuity. This reduction was significant under the mesopic condition. Also, Sjögren's syndrome patients treated with pilocarpine suffer more than patients without pilocarpine treatment under low light conditions. CONCLUSION: Sjögren's syndrome patients shows greater impairment in different visual resolution tasks due to dry eye symptoms.

Tunable and Efficient Photoluminescence of Lanthanide-Doped Cs2NaScCl6 Double Perovskite Single Crystals toward Multifunctional Light-Emitting Diode Applications.

Lead-free halide double perovskite, as one of the promising candidates for lead halide perovskite materials, shows great potential in light-emitting diodes (LEDs), benefiting from its environmental friendliness and high chemical stability. However, the poor regulation of the emission spectra severely limits its application range. Herein, various lanthanide ions were successfully doped in Cs2NaScCl6 double perovskite single crystals (DPSCs) to yield effective and stable emissions spanning from visible to near-infrared (NIR) regions. Notably, efficient energy transfer from the host to the dopants enables tunable emissions with good chromaticity, which is rarely reported in the field of lead-free double perovskite. Moreover, density functional theory calculations reveal that the high local electron density around the [LnCl6]3- octahedron in DPSCs plays a key role in the improvement of photoluminescence quantum yields (PLQYs). The optimal PLQYs are up to 84%, which increases around 3 times over that of the undoped sample. Finally, multicolor and NIR LEDs based on Ln3+-doped Cs2NaScCl6 DPSCs were fabricated and had different application functions. Specifically, the single-composite white LED shows adjustable coordinates and correlated color temperatures, while the NIR LED shows good night vision imaging. This work provides new inspiration for the application of efficient multifunctional LEDs based on lead-free double perovskite materials.

A Simple Denoising Algorithm for Real-World Noisy Camera Images.

The noise statistics of real-world camera images are challenging for any denoising algorithm. Here, I describe a modified version of a bionic algorithm that improves the quality of real-word noisy camera images from a publicly available image dataset. In the first step, an adaptive local averaging filter was executed for each pixel to remove moderate sensor noise while preserving fine image details and object contours. In the second step, image sharpness was enhanced by means of an unsharp mask filter to generate output images that are close to ground-truth images (multiple averages of static camera images). The performance of this denoising algorithm was compared with five popular denoising methods: bm3d, wavelet, non-local means (NL-means), total variation (TV) denoising and bilateral filter. Results show that the two-step filter had a performance that was similar to NL-means and TV filtering. Bm3d had the best denoising performance but sometimes led to blurry images. This novel two-step filter only depends on a single parameter that can be obtained from global image statistics. To reduce computation time, denoising was restricted to the Y channel of YUV-transformed images and four image segments were simultaneously processed in parallel on a multi-core processor.

Achieving Broadband NIR-I to NIR-II Emission in an All-Inorganic Halide Double-Perovskite Cs2NaYCl6:Cr3+ Phosphor for Night Vision Imaging.

Near-infrared phosphor-converted light-emitting diodes (NIR pc-LEDs) offer numerous advantages, including compact size, tunable emission spectra, energy efficiency, and high integration potential. These features make them highly promising for various applications, such as night vision monitoring, food safety inspection, biomedical imaging, and theragnostics. All-inorganic halide double-perovskite materials, known for their large absorption cross section, excellent defect tolerance, and long carrier diffusion radius, serve as unique matrices for constructing near-infrared fluorescent materials. In this study, we successfully prepared the all-inorganic metal halide double-perovskite Cs2NaYCl6:Cr3+ using a grinding-sintering method. A small fraction of the [YCl6] octahedra within the host material's lattice was substituted with Cr3+ ions, resulting in the creation of the Cs2NaYCl6:Cr3+ phosphor. When excited with λ = 310 nm UV light, the phosphor exhibited a broad emission range spanning from 800 to 1400 nm, covering the NIR-I and NIR-II regions. It had a broad bandwidth emission of 185 nm and achieved a fluorescence quantum yield of 20.2%. The unique broadband emission of the phosphor originates from the weak crystal field environment provided by the Cs2NaYCl6 host matrix, which enhances the luminescence properties of the Cr3+ ions. To create NIR pc-LEDs, the phosphor was encapsulated onto a commercially available UV LED chip operating at 310 nm. The potential application of these NIR pc-LEDs in night vision imaging was successfully validated.

Functional maturation of the rod bipolar to AII-amacrine cell ribbon synapse in the mouse retina.

Retinal ribbon synapses undergo functional changes after eye opening that remain uncharacterized. Using light-flash stimulation and paired patch-clamp recordings, we examined the maturation of the ribbon synapse between rod bipolar cells (RBCs) and AII-amacrine cells (AII-ACs) after eye opening (postnatal day 14) in the mouse retina at near physiological temperatures. We find that light-evoked excitatory postsynaptic currents (EPSCs) in AII-ACs exhibit a slow sustained component that increases in magnitude with advancing age, whereas a fast transient component remains unchanged. Similarly, paired recordings reveal a dual-component EPSC with a slower sustained component that increases during development, even though the miniature EPSC (mEPSC) amplitude and kinetics do not change significantly. We thus propose that the readily releasable pool of vesicles from RBCs increases after eye opening, and we estimate that a short light flash can evoke the release of ∼4,000 vesicles onto a single mature AII-AC.