Human brain mapping using co-registered fUS, fMRI and ESM during awake brain surgeries: A proof-of-concept study.

Accurate, depth-resolved functional imaging is key in both understanding and treatment of the human brain. A new sonography-based imaging technique named functional Ultrasound (fUS) uniquely combines high sensitivity with submillimeter-subsecond spatiotemporal resolution available in large fields-of-view. In this proof-of-concept study we show that: (A) fUS reveals the same eloquent regions as found by fMRI while concomitantly visualizing in-vivo microvascular morphology underlying these functional hemodynamics and (B) fUS-based functional maps are confirmed by Electrocortical Stimulation Mapping (ESM), the current gold-standard in awake neurosurgical practice. This unique cross-modality experiment was performed using motor, visual and language-related functional tasks in patients undergoing awake brain tumor resection. The current work serves as an important milestone towards further maturity of fUS as well as a novel avenue to increase our understanding of hemodynamics-based functional brain imaging.

Computational model of dot-pattern selective cells.

A computational model of a dot-pattern selective neuron is proposed. This type of neuron is found in the inferotemporal cortex of monkeys. It responds strongly to groups of dots and spots of light intensity variation but very weakly or not at all to single dots and spots that are not part of a pattern. This non-linear behaviour is quite different from the spatial frequency filtering behaviour exhibited by other neurons that react to spot-shaped stimuli, such as neurons with centre-surround receptive field profiles found in the lateral geniculate nuclei and layer 4Cbeta of V1. It is implemented in the proposed computational model by using an AND-type non-linearity to combine the responses of centre-surround cells. The proposed model is capable of explaining the results of neurophysiological experiments as well as certain psychophysical observations.

Nonlinear operator for oriented texture.

Texture is an important part of the visual world of animals and humans and their visual systems successfully detect, discriminate, and segment texture. Relatively recently progress was made concerning structures in the brain that are presumably responsible for texture processing. Neurophysiologists reported on the discovery of a new type of orientation selective neuron in areas V1 and V2 of the visual cortex of monkeys which they called grating cells. Such cells respond vigorously to a grating of bars of appropriate orientation, position and periodicity. In contrast to other orientation selective cells, grating cells respond very weakly or not at all to single bars which do not make part of a grating. Elsewhere we proposed a nonlinear model of this type of cell and demonstrated the advantages of grating cells with respect to the separation of texture and form information. In this paper, we use grating cell operators to obtain features and compare these operators in texture analysis tasks with commonly used feature extracting operators such as Gabor-energy and co-occurrence matrix operators. For a quantitative comparison of the discrimination properties of the concerned operators a new method is proposed which is based on the Fisher (1923) linear discriminant and the Fisher criterion. The operators are also qualitatively compared with respect to their ability to separate texture from form information and their suitability for texture segmentation.

Computational models of visual neurons specialised in the detection of periodic and aperiodic oriented visual stimuli: bar and grating cells.

Computational models of periodic- and aperiodic-pattern selective cells, also called grating and bar cells, respectively, are proposed. Grating cells are found in areas V1 and V2 of the visual cortex of monkeys and respond strongly to bar gratings of a given orientation and periodicity but very weakly or not at all to single bars. This non-linear behaviour, which is quite different from the spatial frequency filtering behaviour exhibited by the other types of orientation-selective neurons such as the simple cells, is incorporated in the proposed computational model by using an AND-type non-linearity to combine the responses of simple cells with symmetric receptive field profiles and opposite polarities. The functional behaviour of bar cells, which are found in the same areas of the visual cortex as grating cells, is less well explored and documented in the literature. In general, these cells respond to single bars and their responses decrease when further bars are added to form a periodic pattern. These properties of bar cells are implemented in a computational model in which the responses of bar cells are computed as thresholded differences of the responses of corresponding complex (or simple) cells and grating cells. Bar and grating cells seem to play complementary roles in resolving the ambiguity with which the responses of simple and complex cells represent oriented visual stimuli, in that bar cells are selective only for form information as present in contours and grating cells only respond to oriented texture information. The proposed model is capable of explaining the results of neurophysiological experiments as well as the psychophysical observation that the perception of texture and the perception of form are complementary processes.