Underwater Image Enhancement Based on Luminance Reconstruction by Multi-Resolution Fusion of RGB Channels.

Underwater image enhancement technology is crucial for the human exploration and exploitation of marine resources. The visibility of underwater images is affected by visible light attenuation. This paper proposes an image reconstruction method based on the decomposition-fusion of multi-channel luminance data to enhance the visibility of underwater images. The proposed method is a single-image approach to cope with the condition that underwater paired images are difficult to obtain. The original image is first divided into its three RGB channels. To reduce artifacts and inconsistencies in the fused images, a multi-resolution fusion process based on the Laplace-Gaussian pyramid guided by a weight map is employed. Image saliency analysis and mask sharpening methods are also introduced to color-correct the fused images. The results indicate that the method presented in this paper effectively enhances the visibility of dark regions in the original image and globally improves its color, contrast, and sharpness compared to current state-of-the-art methods. Our method can enhance underwater images in engineering practice, laying the foundation for in-depth research on underwater images.

Informing Endpoints for Clinical Trials of Geographic Atrophy.

Geographic atrophy (GA), the non-neovascular advanced form of age-related macular degeneration, remains an important disease area in which treatment needs are currently unmet. Recent clinical trials using drugs that target the complement pathway have shown modest yet consistent reductions in GA expansion but without commensurate changes in measures of visual function. In this review, we summarize information from the wide range of studies describing the characteristics of GA morphology and enumerate the factors influencing the growth rates of lesions and the directionality of expansion. In addition, we review the relationship between GA growth and the various measures of vision that reflect changes in function. We consider the reasons for the discordance between the anatomical and functional endpoints in current use and discuss methods to align these key outcomes.

Effect of lighting conditions on implantable collamer lens vault: Influence of anterior chamber and lens parameters.

Purpose: To investigate the change in the vault of the implantable collamer lens (ICL) under dark-to-light conditions and its association with anterior chamber and lens parameters in patients undergoing ICL surgery. Methods: In 76 eyes from 40 patients, preoperative anterior chamber volume (ACV), pupil diameter (PD), anterior chamber angle, central corneal thickness (CCT), white-to-white (WTW), lens thickness (LT), axial length (AL), spherical equivalent (SE) and patient's age were collected. Postoperative vault, PD and LT were measured under dark and light conditions using anterior segment optical coherence tomography (CASIA2; TOMEY, Japan), and changes and lens displacement under dark-to-light conditions were calculated. Mixed-effects models were used to analyze the correlation between the vault change and the anterior chamber and lens parameters of all subjects and the high-vault subgroup. Results: The vault under light condition (648.36 ± 304.47 µm) was significantly smaller compared to the vault under dark condition (708.89 ± 316.15 µm). In all patients, vault change increased with the increase of age, lens displacement and PD change; and increased with the decrease of ACV, LT change and baseline vault (under dark condition). In the high-vault subgroup, vault change increased with the increase of CCT, lens displacement and PD change; and increased with the decrease of ACV. Conclusions: ICL vault changes significantly from dark to light, influenced by age, ACV, PD change, LT change, lens displacement, and baseline vault. A higher baseline vault is correlated with a larger LT change, affecting the levels of accommodation under dark-to-light transition.

An Adaptive Vehicle Detection Model for Traffic Surveillance of Highway Tunnels Considering Luminance Intensity.

Vehicle detection is essential for road traffic surveillance and active safety management. Deep learning methods have recently shown robust feature extraction capabilities and achieved improved detection results. However, vehicle detection models often perform poorly under abnormal lighting conditions, especially in highway tunnels. We proposed an adaptive vehicle detection model that accounts for varying luminance intensities to address this issue. The model categorizes the image data into abnormal and normal luminance scenarios. We employ an improved CycleGAN with edge loss as the adaptive luminance adjustment module for abnormal luminance scenarios. This module adjusts the brightness of the images to a normal level through a generative network. Finally, YOLOv7 is utilized for vehicle detection. The experimental results demonstrate that our adaptive vehicle detection model effectively detects vehicles under abnormal luminance scenarios in highway tunnels. The improved CycleGAN can effectively mitigate edge generation distortion. Under abnormal luminance scenarios, our model achieved a 16.3% improvement in precision, a 1.7% improvement in recall, and a 9.8% improvement in mAP_0.5 compared to the original YOLOv7. Additionally, our adaptive luminance adjustment module is transferable and can enhance the detection accuracy of other vehicle detection models.

Task-dependent contribution to edge-based versus region-based texture perception.

Texture segregation studies indicate that some types of textures are processed by edge-based and others by region-based mechanisms. However, studies employing nominally edge-based textures have found evidence for region-based processing mechanisms when the task was to detect rather than segregate the textures. Here we investigate directly whether the nature of the task determines if region-based or edge-based mechanisms are involved in texture perception. Stimuli consisted of randomly positioned Gabor micropattern texture arrays with five types of modulation: orientation modulation, orientation variance modulation, luminance modulation, contrast modulation and contrast variance modulation (CVM). There were four modulation frequencies: 0.1, 0.2, 0.4 and 0.8 cpd. Each modulation type was defined by three types of waveforms: sinewave (SN) with its smooth variations, square-wave (SQ) and cusp-wave (CS) with its sharp texture edges. The CS waveform was constructed by removing a sinewave from an equal amplitude square-wave. Participants performed two tasks: detection in which participants selected which of two stimuli contained the modulation and discrimination in which participants indicated which of two textures had a different modulation orientation. Our results indicate that threshold amplitudes in the detection task followed the ordering SQ < SN < CS across all spatial frequencies, consistent with detection being mediated by the overall energy in the stimulus and hence region based. With the discrimination task at low texture spatial frequencies and with CVM textures at all spatial frequencies the order was CS ≤ SQ with both < SN, consistent with being edge-based. We modeled the data by estimating the spatial frequency of a Difference of Gaussian filter that gave the largest peak amplitude response to the data. We found that the peak amplitude was lower for detection than discrimination across all texture types except for the CVM texture. We conclude that task requirements are critical to whether edges or regions underpin texture processing.

Retinex theory-based nonlinear luminance enhancement and denoising for low-light endoscopic images.

BACKGROUND: The quality of low-light endoscopic images involves applications in medical disciplines such as physiology and anatomy for the identification and judgement of tissue structures. Due to the use of point light sources and the constraints of narrow physiological structures, medical endoscopic images display uneven brightness, low contrast, and a lack of texture information, presenting diagnostic challenges for physicians. METHODS: In this paper, a nonlinear brightness enhancement and denoising network based on Retinex theory is designed to improve the brightness and details of low-light endoscopic images. The nonlinear luminance enhancement module uses higher-order curvilinear functions to improve overall brightness; the dual-attention denoising module captures detailed features of anatomical structures; and the color loss function mitigates color distortion. RESULTS: Experimental results on the Endo4IE dataset demonstrate that the proposed method outperforms existing state-of-the-art methods in terms of Peak Signal-to-Noise Ratio (PSNR), Structural Similarity (SSIM), and Learned Perceptual Image Patch Similarity (LPIPS). The PSNR is 27.2202, SSIM is 0.8342, and the LPIPS is 0.1492. It provides a method to enhance image quality in clinical diagnosis and treatment. CONCLUSIONS: It offers an efficient method to enhance images captured by endoscopes and offers valuable insights into intricate human physiological structures, which can effectively assist clinical diagnosis and treatment.

Ambient lighting alters pattern electroretinogram P50 peak time and spatial sensitivity.

PURPOSE: Our aim was to explore the effect of ambient lighting on the pattern ERG (PERG). METHODS: We compared PERGs recorded in two conditions; room lights on and room lights off. PERGs from 21 adult participants were recorded from each eye to high contrast checks of 50' side width, reversing 3rps in a large (30°) and then standard (15°) field. This was performed first in lights-ON conditions, then 2 min after the room lights were switched off. A minimum of 2 averages of 300 trials were acquired for each condition. A subset of 10 participants had PERGs recorded to a 50' check width with a range of stimulus contrasts (96-18%), also to a range of different check widths (100'-12') at high contrast in both ambient lighting conditions in a 30° field. RESULTS: The lights-ON P50 median peak time (PT) was 3 ms earlier than the lights-OFF P50 from the 30° field (range 0-5 ms) and 15° field (range 0-6 ms). The earlier lights-ON P50 PT was evident at different stimulus contrasts, even after accounting for stimulus contrast reductions associated with stray ambient lighting in lights-ON conditions. Lights-OFF and lights-ON P50 PT were similar to different check widths; the lights-OFF P50 PT to a 50' check width matched the lights-ON P50 PT to a 25' check width. CONCLUSION: PERG P50 PT in lights-ON ambient light conditions can be earlier than in lights-OFF ambient light conditions. The difference in P50 PT with ambient light may reflect alterations in spatial sensitivity associated with retinal adaptation. These results emphasise the clinical importance of consistent ambient lighting for PERG recording and calibration.

Comparing the Representation of a Simple Visual Stimulus across the Cerebellar Network.

The cerebellum is a conserved structure of the vertebrate brain involved in the timing and calibration of movements. Its function is supported by the convergence of fibers from granule cells (GCs) and inferior olive neurons (IONs) onto Purkinje cells (PCs). Theories of cerebellar function postulate that IONs convey error signals to PCs that, paired with the contextual information provided by GCs, can instruct motor learning. Here, we use the larval zebrafish to investigate (1) how sensory representations of the same stimulus vary across GCs and IONs and (2) how PC activity reflects these two different input streams. We use population calcium imaging to measure ION and GC responses to flashes of diverse luminance and duration. First, we observe that GCs show tonic and graded responses, as opposed to IONs, whose activity peaks mostly at luminance transitions, consistently with the notion that GCs and IONs encode context and error information, respectively. Second, we show that GC activity is patterned over time: some neurons exhibit sustained responses for the entire duration of the stimulus, while in others activity ramps up with slow time constants. This activity could provide a substrate for time representation in the cerebellum. Together, our observations give support to the notion of an error signal coming from IONs and provide the first experimental evidence for a temporal patterning of GC activity over many seconds.

The adaptive global effect: Luminance contrast modulates the global effect zone.

When two peripheral objects are presented in close proximity, saccades towards one of these objects land at a weighted average location between the two objects. This phenomenon, known as the 'global effect' or 'saccade averaging', disappears when the distance between the objects increases. When objects are further apart, outside the averaging zone, saccades land on one of the objects with little or no saccade averaging. Although it is known that the strength of the global effect is dependent on the specific features of the two objects, it is unclear if the size of the zone in which averaging can occur (i.e., the averaging zone) is adaptive. The aim of the current study was to investigate whether the size of the averaging zone adapts to variations in object luminance contrast of the objects. In order to systematically assess changes in the averaging zone, in two experiments, observers made saccadic eye movements while the luminance of the target and the distractor varied. We report three major findings: 1) When a distractor was more luminant relative to the target, the averaging zone increased (Exp. 1). Notably, saccade averaging never entirely ceased to exist, even for remote distractors. 2) When target and distractor were equiluminant, the averaging zone did not change with absolute luminance (Exp. 2). 3) Higher (relative and absolute) luminance increased the averaging zone especially for shorter saccadic response times (SRT). We conclude that the averaging zone is adaptive and becomes larger with increasing relative luminance and especially when SRTs are short.

High-luminance one-dimensional integral imaging display based on gradient-width line light sources.

A high-luminance one-dimensional integral imaging display is presented in this paper. A gradient-width line light source array behind an elemental image array is proposed. The widths of the line light sources with equal pitches gradually increased from both sides to center. The viewing ranges generated by the line light sources were enlarged from both sides to the center. The light illuminating the left half of the elemental image array was superimposed on the right side, and the light illuminating the right half of the elemental image array was superimposed on the left side. The viewing zone was related to the leftmost and rightmost line light sources, and the luminance was improved by enlarging the other line light sources.

Human perception of flicker-fused letters that are luminance balanced.

The Talbot-Plateau law specifies what combinations of flash frequency, duration, and intensity will yield a flicker-fused stimulus that matches the brightness of a steady stimulus. It has proven to be remarkably robust in its predictions, and here we provide additional support though the use of a contrast discrimination task. However, we also find that the visual system can register flicker-fused letters when the combination of frequency and duration is relatively low. The letters are recognized even though they have the same physical luminance as background. We hypothesize that the letters elicit synchronous oscillations that encode for stimulus attributes, which prevents the letter from blending into the background.

Low luminance contrast's effect on the color appearance of S-cone patterns.

There is a surprisingly strong effect on color appearance when low levels of luminance contrast are added to visual targets in which only S-cones are modulated. This phenomenon can be studied with checkerboard patterns composed of alternating S-cone-modulated checks and gray checks. + S checks look purple when surrounded by slightly brighter gray checks but look highly desaturated (lavender, almost white) when surrounded by darker gray checks. -S checks change in hue with luminance contrast; they look yellow when surrounded by darker gray checks but are greener when surrounded by lighter checks. Psychophysical paired comparisons confirm these perceptions. Furthermore, visual evoked potentials (VEPs) recorded from human posterior cortex indicate that signals evoked by low luminance contrast interact nonlinearly with S-cone-evoked signals in early cortical color processing. Our new psychophysics and electrophysiology results prove that human perception of color appearance is not based on neural computations within a separate, isolated color system. Rather, signals evoked by color contrast and luminance contrast interact to produce the colors we see.

Pathologists light level preferences using the microscope-study to guide digital pathology display use.

Background: Currently, there is a paucity of guidelines relating to displays used for digital pathology making procurement decisions, and optimal display configuration, challenging.Experience suggests pathologists have personal preferences for brightness when using a conventional microscope which we hypothesized could be used as a predictor for display setup. Methods: We conducted an online survey across six NHS hospitals, totalling 108 practicing pathologists, to capture brightness adjustment habits on both microscopes and displays.A convenience subsample of respondents was then invited to take part in a practical task to determine microscope brightness and display luminance preferences in the normal working environment. A novel adaptation for a lightmeter was developed to directly measure the light output from the microscope eyepiece. Results: The survey (response rate 59% n=64) indicates 81% of respondents adjust the brightness on their microscope. In comparison, only 11% report adjusting their digital display. Display adjustments were more likely to be for visual comfort and ambient light compensation rather than for tissue factors, common for microscope adjustments. Part of this discrepancy relates to lack of knowledge of how to adjust displays and lack of guidance on whether this is safe; But, 66% felt that the ability to adjust the light on the display was important.Twenty consultants took part in the practical brightness assessment. Light preferences on the microscope showed no correlation with display preferences, except where a pathologist has a markedly brighter microscope light preference. All of the preferences in this cohort were for a display luminance of <500 cd/m2, with 90% preferring 350 cd/m2 or less. There was no correlation between these preferences and the ambient lighting in the room. Conclusions: We conclude that microscope preferences can only be used to predict display luminance requirements where the microscope is being used at very high brightness levels. A display capable of a brightness of 500 cd/m2 should be suitable for almost all pathologists with 300 cd/m2 suitable for the majority. Although display luminance is not frequently changed by users, the ability to do so was felt to be important by the majority of respondents.Further work needs to be undertaken to establish the relationship between diagnostic performance, luminance preferences, and ambient lighting levels.

The interplay between spatial and non-spatial grouping cues over approximate number perception.

Humans and animals share the cognitive ability to quickly extract approximate number information from sets. Main psychophysical models suggest that visual approximate numerosity relies on segmented units, which can be affected by Gestalt rules. Indeed, arrays containing spatial grouping cues, such as connectedness, closure, and even symmetry, are underestimated compared to ungrouped arrays with equal low-level features. Recent evidence suggests that non-spatial cues, such as color-similarity, also trigger numerosity underestimation. However, in natural vision, several grouping cues may coexist in the scene. Notably, conjunction of grouping cues (color and closure) reduces perceived numerosity following an additive rule. To test whether the conjunction-effect holds for other Gestalt cues, we investigated the effect of connectedness and symmetry over numerosity perception both in isolation and, critically, in conjunction with luminance similarity. Participants performed a comparison-task between a reference and a test stimulus varying in numerosity. In Experiment 1, test stimuli contained two isolated groupings (connectedness or luminance), a conjunction (connectedness and luminance), and a neutral condition (no groupings). Results show that point of subjective equality was higher in both isolated grouping conditions compared to the neutral condition. Furthermore, in the conjunction condition, the biases from isolated grouping cues added linearly, resulting in a numerosity underestimation equal to the sum of the isolated biases. In Experiment 2 we found that conjunction of symmetry and luminance followed the same additive rule. These findings strongly suggest that both spatial and non-spatial isolated cues affect numerosity perception. Crucially, we show that their conjunction effect extends to symmetry and connectedness.

Differential cortical and subcortical visual processing with eyes shut.

Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar blood oxygenation level-dependent (BOLD) responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitatively distinct pattern of visual processing when the eyes are closed-one that is not simply an overall attenuation but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserve information about stimuli but are then gated off downstream in visual cortex.NEW & NOTEWORTHY When we close our eyes coarse luminance information is still accessible by the visual system. Using functional magnetic resonance imaging, we examined whether eyelid closure plays a unique role in visual processing. We discovered that while the LGN and V1 show equivalent responses when the eyes are open or closed, extrastriate cortex exhibited attenuated responses with eye closure. This suggests that when the eyes are closed, downstream visual processing is blind to this information.

Optical design of low-location illumination based on asymmetric double freeform surfaces.

The development of optical optics for low-location road lighting is a challenging problem in providing high luminance and uniformity of illumination and meeting many other specific requirements. This study proposes an optical design method of low-location illumination based on an asymmetric double freeform surface lens. The ray emitted from the light source is refracted and reflected through the different surface types to the corresponding area of the receiving surface. In the design example, the road has dual-side mounted luminaires and a width of 6 m, and a height of 0.8 m. Simulation results indicate that, compared with conventional high-pole streetlights, the luminance uniformity had increased from 0.60 to 0.66, the illuminance uniformity had improved from 0.75 to 0.86, and the glare had been reduced.

Modulation of the neuronal response in human primary visual cortex by re-entrant projections during retinal input processing as manifest in the visual evoked potential.

Initial deflections in the visual evoked potential (VEP) reflect the neuronal process of extracting features from the retinal input; a process not modulated by re-entrant projections. Later deflections in the VEP reflect the neuronal process of combining features into an object, a process referred to as 'object closure' and modulated by re-entrant projections. Our earlier work indicated that the VEP reflects independent neuronal responses processing temporal - and spatial luminance contrast and that these responses arise from an interaction between forward and re-entrant input. In this earlier work, changing the temporal luminance contrast property of a stimulus altered its spatial luminance contrast property. We recorded the VEP in 12 volunteers viewing image pairs of a windmill, regular dartboard or an RMS dartboard rotated by either Π/4, Π/2, 3Π/4 or Π radians with respect to each other. The windmill and regular dartboard had identical white to black ratio, while the two dartboards identical contrast edges per unit area. Rotation varied temporal luminance contrast of a stimulus without affecting its spatial luminance contrast. N75, P100, N135 and P240 amplitude and latency were compared and a source localisation and temporal frequency analysis performed. P100 amplitude signals a neuronal response processing temporal luminance contrast that is modulated by re-entrant projections with fast axonal conduction velocities. N135 and P240 signal the neuronal response processing spatial luminance contrast and is modulated by re-entrant projections with slow axonal conduction velocities. The dorsal stream is interconnected by fast axonal conduction velocities, the ventral stream by slow axonal conduction velocities.

The execution of saccadic eye movements suppresses visual processing of both color and luminance in the early visual cortex of humans.

Our eyes execute rapid, directional movements known as saccades, occurring several times per second, to focus on objects of interest in our environment. During these movements, visual sensitivity is temporarily reduced. Despite numerous studies on this topic, the underlying mechanism remains elusive, including a lingering debate on whether saccadic suppression affects the parvocellular visual pathway. To address this issue, we conducted a study employing steady-state visual evoked potentials (SSVEPs) elicited by chromatic and luminance stimuli while observers performed saccadic eye movements. We also employed an innovative analysis pipeline to enhance the signal-to-noise ratio, yielding superior results compared to the previous method. Our findings revealed a clear suppression effect on SSVEP signals during saccades compared to fixation periods. Notably, this suppression effect was comparable for both chromatic and luminance stimuli. We went further to measure the suppression effect across various contrast levels, which enabled us to model SSVEP responses with contrast response functions. The results suggest that saccades primarily reduce response gain without significantly affecting contrast gain and that this reduction applies uniformly to both chromatic and luminance pathways. In summary, our study provides robust evidence that saccades similarly suppress visual processing in both the parvocellular and magnocellular pathways within the human early visual cortex, as indicated by SSVEP responses. The observation that saccadic eye movements impact response gain rather than contrast gain implies that they influence visual processing through a multiplicative mechanism.NEW & NOTEWORTHY The present study demonstrates that saccadic eye movements reduce the processing of both luminance and chromatic stimuli in the early visual cortex of humans. By modeling the contrast response function, the study further shows that saccades affect visual processing by reducing the response gain rather than altering the contrast gain, suggesting that a multiplicative mechanism of visual attenuation affects both parvocellular and magnocellular pathways.

Sex Hormones Influence the Helmholtz-Kohlrausch Effect.

Purpose: Saturated lights appear brighter than white lights of the same luminance. This is the Helmholtz-Kohlrausch (H-K) effect, and the phenomenon can be estimated by modeling achromatic luminance and saturation to total brightness. Current H-K effect models are different between women and men and are also more variable in women, which may be due to hormonal changes across the menstrual cycle (MC). Methods: Total brightness (B) and achromatic luminance (L) were measured across blue, green, yellow-green, yellow, and red hues. These data were measured along with salivary hormone levels for nine cycling women and seven oral contraceptive (OC) users at points representing the menstrual, peri-ovulation, and luteal phases. Results: Simple brightness/luminance (B/L) ratio estimates of the H-K effect did not differ by OC use or MC phase, but B/L ratios were higher for the red stimulus in cycling women than OC users during the luteal phase. Estrogen, progesterone, and their interaction predicted 18% of the variation in brightness for cycling women. For OC users, only estrogen could be fit to brightness models where it accounted for 5% of brightness variance. Conclusion: These findings first provide clear support for separating cycling women from OC users, particularly when examining long-wavelength mechanisms. Next, the interaction of OC use and MC phase on B/L ratios for the red stimulus adds to a rich history of long-wavelength mechanisms. Lastly, the current result amends previous brightness models with multiple hormone terms for cycling women but not OC users.

Optimum display luminance and contrast polarity of desktop head-up display under office lighting level based on visual ergonomic study.

New type desktop head-up display (HUD) can reduce visual fatigue and protect vision through long viewing distance. In this study, participants evaluated visual performance, fatigue, and discomfort of desktop HUD under two contrast polarity (N = 36) and five display luminance levels (N = 21). A positive polarity advantage was found over negative in visual fatigue and discomfort (p < .05). Statistically significant effect of luminance was found on visual performance, fatigue, and discomfort (p < .05). The calculated optimum display luminance by the proposed inverted-U fitted model was 153 cd/m2 under 300 lx, higher than that of traditional desktop displays. It is speculated that higher luminance is required to offset the reduction in contrast sensitivity due to smaller target angular size, which caused by longer viewing distance. These findings suggest that positive polarity and 153 cd/m2 can be used to improve performance and avoid fatigue and discomfort when utilising desktop HUD under 300 lx.

A visual ergonomic study was conducted on new type desktop HUD. With visual performance, fatigue, and discomfort as optimisation goals, positive polarity and 153 cd/m² was recommended under 300 lx. Compared with traditional desktop displays, higher luminance was required in desktop HUD under the same illumination.