Evolving Images for Visual Neurons Using a Deep Generative Network Reveals Coding Principles and Neuronal Preferences.

What specific features should visual neurons encode, given the infinity of real-world images and the limited number of neurons available to represent them? We investigated neuronal selectivity in monkey inferotemporal cortex via the vast hypothesis space of a generative deep neural network, avoiding assumptions about features or semantic categories. A genetic algorithm searched this space for stimuli that maximized neuronal firing. This led to the evolution of rich synthetic images of objects with complex combinations of shapes, colors, and textures, sometimes resembling animals or familiar people, other times revealing novel patterns that did not map to any clear semantic category. These results expand our conception of the dictionary of features encoded in the cortex, and the approach can potentially reveal the internal representations of any system whose input can be captured by a generative model.

Macaques recognize features in synthetic images derived from ventral stream neurons.

Primates can recognize features in virtually all types of images, an ability that still requires a comprehensive computational explanation. One hypothesis is that visual cortex neurons learn patterns from scenes, objects, and textures, and use these patterns to interpolate incoming visual information. We have used machine learning algorithms to instantiate visual patterns stored by neurons-we call these highly activating images prototypes. Prototypes from inferotemporal (IT) neurons often resemble parts of real-world objects, such as monkey faces and body parts, a similarity established via pretrained neural networks [C. R. Ponce et al., Cell 177, 999-1009.e10 (2019)] and naïve human participants [A. Bardon, W. Xiao, C. R. Ponce, M. S. Livingstone, G. Kreiman, Proc. Natl. Acad. Sci. U.S.A. 119, e2118705119 (2022)]. However, it is not known whether monkeys themselves perceive similarities between neuronal prototypes and real-world objects. Here, we investigated whether monkeys reported similarities between prototypes and real-world objects using a two-alternative forced choice task. We trained the animals to saccade to synthetic images of monkeys, and subsequently tested how they classified prototypes synthesized from IT and primary visual cortex (V1). We found monkeys classified IT prototypes as conspecifics more often than they did random generator images and V1 prototypes, and their choices were partially predicted by convolutional neural networks. Further, we confirmed that monkeys could abstract general shape information from images of real-world objects. Finally, we verified these results with human participants. Our results provide further evidence that prototypes from cortical neurons represent interpretable abstractions from the visual world.

Face neurons encode nonsemantic features.

The primate inferior temporal cortex contains neurons that respond more strongly to faces than to other objects. Termed "face neurons," these neurons are thought to be selective for faces as a semantic category. However, face neurons also partly respond to clocks, fruits, and single eyes, raising the question of whether face neurons are better described as selective for visual features related to faces but dissociable from them. We used a recently described algorithm, XDream, to evolve stimuli that strongly activated face neurons. XDream leverages a generative neural network that is not limited to realistic objects. Human participants assessed images evolved for face neurons and for nonface neurons and natural images depicting faces, cars, fruits, etc. Evolved images were consistently judged to be distinct from real faces. Images evolved for face neurons were rated as slightly more similar to faces than images evolved for nonface neurons. There was a correlation among natural images between face neuron activity and subjective "faceness" ratings, but this relationship did not hold for face neuron­evolved images, which triggered high activity but were rated low in faceness. Our results suggest that so-called face neurons are better described as tuned to visual features rather than semantic categories.

Host space, not energy or symbiont size, constrains feather mite abundance across passerine bird species.

Comprehending symbiont abundance among host species is a major ecological endeavour, and the metabolic theory of ecology has been proposed to understand what constrains symbiont populations. We parameterized metabolic theory equations to investigate how bird species' body size and the body size of their feather mites relate to mite abundance according to four potential energy (uropygial gland size) and space constraints (wing area, total length of barbs and number of feather barbs). Predictions were compared with the empirical scaling of feather mite abundance across 106 passerine bird species (26,604 individual birds sampled), using phylogenetic modelling and quantile regression. Feather mite abundance was strongly constrained by host space (number of feather barbs) but not by energy. Moreover, feather mite species' body size was unrelated to the body size of their host species. We discuss the implications of our results for our understanding of the bird-feather mite system and for symbiont abundance in general.

Look twice: A generalist computational model predicts return fixations across tasks and species.

Primates constantly explore their surroundings via saccadic eye movements that bring different parts of an image into high resolution. In addition to exploring new regions in the visual field, primates also make frequent return fixations, revisiting previously foveated locations. We systematically studied a total of 44,328 return fixations out of 217,440 fixations. Return fixations were ubiquitous across different behavioral tasks, in monkeys and humans, both when subjects viewed static images and when subjects performed natural behaviors. Return fixations locations were consistent across subjects, tended to occur within short temporal offsets, and typically followed a 180-degree turn in saccadic direction. To understand the origin of return fixations, we propose a proof-of-principle, biologically-inspired and image-computable neural network model. The model combines five key modules: an image feature extractor, bottom-up saliency cues, task-relevant visual features, finite inhibition-of-return, and saccade size constraints. Even though there are no free parameters that are fine-tuned for each specific task, species, or condition, the model produces fixation sequences resembling the universal properties of return fixations. These results provide initial steps towards a mechanistic understanding of the trade-off between rapid foveal recognition and the need to scrutinize previous fixation locations.

Identification of potential invasive alien species in Spain through horizon scanning.

Invasive alien species have widespread impacts on native biodiversity and ecosystem services. Since the number of introductions worldwide is continuously rising, it is essential to prevent the entry, establishment and spread of new alien species through a systematic examination of future potential threats. Applying a three-step horizon scanning consensus method, we evaluated non-established alien species that could potentially arrive, establish and cause major ecological impact in Spain within the next 10 years. Overall, we identified 47 species with a very high risk (e.g. Oreochromis niloticus, Popillia japonica, Hemidactylus frenatus, Crassula helmsii or Halophila stipulacea), 61 with high risk, 93 with moderate risk, and 732 species with low risk. Many of the species categorized as very high or high risk to Spanish biodiversity are either already present in Europe and neighbouring countries or have a long invasive history elsewhere. This study provides an updated list of potential invasive alien species useful for prioritizing efforts and resources against their introduction. Compared to previous horizon scanning exercises in Spain, the current study screens potential invaders from a wider range of terrestrial, freshwater, and marine organisms, and can serve as a basis for more comprehensive risk analyses to improve management and increase the efficiency of the early warning and rapid response framework for invasive alien species. We also stress the usefulness of measuring agreement and consistency as two different properties of the reliability of expert scores, in order to more easily elaborate consensus ranked lists of potential invasive alien species.

End-Stopping Predicts Curvature Tuning along the Ventral Stream.

Neurons in primate inferotemporal cortex (IT) are clustered into patches of shared image preferences. Functional imaging has shown that these patches are activated by natural categories (e.g., faces, body parts, and places), artificial categories (numerals, words) and geometric features (curvature and real-world size). These domains develop in the same cortical locations across monkeys and humans, which raises the possibility of common innate mechanisms. Although these commonalities could be high-level template-based categories, it is alternatively possible that the domain locations are constrained by low-level properties such as end-stopping, eccentricity, and the shape of the preferred images. To explore this, we looked for correlations among curvature preference, receptive field (RF) end-stopping, and RF eccentricity in the ventral stream. We recorded from sites in V1, V4, and posterior IT (PIT) from six monkeys using microelectrode arrays. Across all visual areas, we found a tendency for end-stopped sites to prefer curved over straight contours. Further, we found a progression in population curvature preferences along the visual hierarchy, where, on average, V1 sites preferred straight Gabors, V4 sites preferred curved stimuli, and many PIT sites showed a preference for curvature that was concave relative to fixation. Our results provide evidence that high-level functional domains may be mapped according to early rudimentary properties of the visual system. SIGNIFICANCE STATEMENT: The macaque occipitotemporal cortex contains clusters of neurons with preferences for categories such as faces, body parts, and places. One common question is how these clusters (or "domains") acquire their cortical position along the ventral stream. We and other investigators previously established an fMRI-level correlation among these category domains, retinotopy, and curvature preferences: for example, in inferotemporal cortex, face- and curvature-preferring domains show a central visual field bias whereas place- and rectilinear-preferring domains show a more peripheral visual field bias. Here, we have found an electrophysiological-level explanation for the correlation among domain preference, curvature, and retinotopy based on neuronal preference for short over long contours, also called end-stopping.

Posterior Inferotemporal Cortex Cells Use Multiple Input Pathways for Shape Encoding.

In the macaque monkey brain, posterior inferior temporal (PIT) cortex cells contribute to visual object recognition. They receive concurrent inputs from visual areas V4, V3, and V2. We asked how these different anatomical pathways shape PIT response properties by deactivating them while monitoring PIT activity in two male macaques. We found that cooling of V4 or V2|3 did not lead to consistent changes in population excitatory drive; however, population pattern analyses showed that V4-based pathways were more important than V2|3-based pathways. We did not find any image features that predicted decoding accuracy differences between both interventions. Using the HMAX hierarchical model of visual recognition, we found that different groups of simulated "PIT" units with different input histories (lacking "V2|3" or "V4" input) allowed for comparable levels of object-decoding performance and that removing a large fraction of "PIT" activity resulted in similar drops in performance as in the cooling experiments. We conclude that distinct input pathways to PIT relay similar types of shape information, with V1-dependent V4 cells providing more quantitatively useful information for overall encoding than cells in V2 projecting directly to PIT.SIGNIFICANCE STATEMENT Convolutional neural networks are the best models of the visual system, but most emphasize input transformations across a serial hierarchy akin to the primary "ventral stream" (V1 → V2 → V4 → IT). However, the ventral stream also comprises parallel "bypass" pathways: V1 also connects to V4, and V2 to IT. To explore the advantages of mixing long and short pathways in the macaque brain, we used cortical cooling to silence inputs to posterior IT and compared the findings with an HMAX model with parallel pathways.

LeNRT1.1 Improves Nitrate Uptake in Grafted Tomato Plants under High Nitrogen Demand.

Grafting has become a common practice among tomato growers to obtain vigorous plants. These plants present a substantial increase in nitrogen (N) uptake from the root zone. However, the mechanisms involved in this higher uptake capacity have not been investigated. To elucidate whether the increase in N uptake in grafted tomato plants under high N demand conditions is related to the functioning of low- (high capacity) or high-affinity (low capacity) root plasma membrane transporters, a series of experiments were conducted. Plants grafted onto a vigorous rootstock, as well as ungrafted and homograft plants, were exposed to two radiation levels (400 and 800 µmol m-2 s-1). We assessed root plasma membrane nitrate transporters (LeNRT1.1, LeNRT1.2, LeNRT2.1, LeNRT2.2 and LeNRT2.3) expression, Michaelis‒Menten kinetics parameters (Vmax and Km), root and leaf nitrate reductase activity, and root respiration rates. The majority of nitrate uptake is mediated by LeNRT1.1 and LeNRT1.2 in grafted and ungrafted plants. Under high N demand conditions, vigorous rootstocks show similar levels of expression for LeNRT1.1 and LeNRT1.2, whereas ungrafted plants present a higher expression of LeNRT1.2. No differences in the uptake capacity (evaluated as Vmax), root respiration rates, or root nitrate assimilation capacity were found among treatments.

A global synthesis of the effects of diversified farming systems on arthropod diversity within fields and across agricultural landscapes.

Agricultural intensification is a leading cause of global biodiversity loss, which can reduce the provisioning of ecosystem services in managed ecosystems. Organic farming and plant diversification are farm management schemes that may mitigate potential ecological harm by increasing species richness and boosting related ecosystem services to agroecosystems. What remains unclear is the extent to which farm management schemes affect biodiversity components other than species richness, and whether impacts differ across spatial scales and landscape contexts. Using a global metadataset, we quantified the effects of organic farming and plant diversification on abundance, local diversity (communities within fields), and regional diversity (communities across fields) of arthropod pollinators, predators, herbivores, and detritivores. Both organic farming and higher in-field plant diversity enhanced arthropod abundance, particularly for rare taxa. This resulted in increased richness but decreased evenness. While these responses were stronger at local relative to regional scales, richness and abundance increased at both scales, and richness on farms embedded in complex relative to simple landscapes. Overall, both organic farming and in-field plant diversification exerted the strongest effects on pollinators and predators, suggesting these management schemes can facilitate ecosystem service providers without augmenting herbivore (pest) populations. Our results suggest that organic farming and plant diversification promote diverse arthropod metacommunities that may provide temporal and spatial stability of ecosystem service provisioning. Conserving diverse plant and arthropod communities in farming systems therefore requires sustainable practices that operate both within fields and across landscapes.

[Early complications with colon esophageal substitution for children via retrosternal]. / Complicaciones tempranas de la sustitución esofágica con colon por vía retroesternal en niños.

OBJECTIVE: To describe the early complications of esophageal replacement with colon in children. METHODS: Descriptive cross-sectional study from 2005 to 2011 in pediatric patients diagnosed with alkali intake, esophageal atresia or esophageal injury traumatic esophageal replacement handled via retrosternal colon. Descriptive statistical analysis using SPSS 20.0. RESULTS: We included 19 esophageal replacements, age seven (4-15), 13 (68%) male and six (31%) female. Initial diagnosis of ingestion of caustic 13 patients (68%) and type III esophageal atresia six cases (32%). Of the six esophageal atresia, four(66%) had dehiscence plasty, one (17%) long-gap atresia and type 1 (17%) esophageal perforation by dilatation. The segment of transverse colon was used in eight (42%), transverse/descending seven (36%), ascending/transverse three (15%), and descending colon one (5%). Early complications were pneumothorax one patient (5%), pneumonia three (15%), sepsis three (15%), intestinal obstruction due to adhesions two (10%), intussusception one (5%), cervical fistula three (15%). One death from sepsis (5%) at four days after surgery. DISCUSSION: Esophageal replacement with colon is a good alternative for esophageal replacement; the most frequent early complications were cervical fistula, pneumonia, and sepsis.

Structuring adaptations: Resilience, restrictive deterrence, and the Cunningham precursor control papers.

Inspired by Giommoni's assessment of the Cunningham precursor control scholarship, we propose two concepts to help drug policy scholars think through the mechanisms that operate when market participants are faced with a change in precursor availability. The first is the concept of restrictive deterrence, that emphasizes risks mitigation strategies such as looking into changes in the frequency, methods, markets that may occur after different types of interventions. While restrictive deterrence is an improvement over current approaches in thinking through adaptations, it falls short in its narrower focus on the individual, rather than organizations or the market as a collective. The concept of resilience is then proposed as alternative that allows scholars to elaborate specific hypotheses and assess both organizations and markets based on their capacity to anticipate, cope, adapt and ultimately recover from disruptions. We finish by providing a reading of the Cunningham and colleagues precursor control papers with the resilience framework in mind, showing that many of the elements were already present in their work.

Contributions of indirect pathways to visual response properties in macaque middle temporal area MT.

The primate visual cortex exhibits a remarkable degree of interconnectivity. Each visual area receives an average of 10 to 15 inputs, many of them from cortical areas with overlapping, but not identical, functional properties. In this study, we assessed the functional significance of this anatomical parallelism to the middle temporal area (MT) of the macaque visual cortex. MT receives major feedforward inputs from areas V1, V2, and V3, but little is known about the properties of each of these pathways. We previously demonstrated that reversible inactivation of V2 and V3 causes a disproportionate degradation of tuning for binocular disparity of MT neurons, relative to direction tuning (Ponce et al., 2008). Here we show that MT neurons continued to encode speed and size information during V2/3 inactivation; however, many became significantly less responsive to fast speeds and others showed a modest decrease in surround suppression. These changes resemble previously reported effects of reducing stimulus contrast (Pack et al., 2005; Krekelberg et al., 2006), but we show here that they differ in their temporal dynamics. We find no evidence that the indirect pathways selectively target different functional regions within MT. Overall, our findings suggest that the indirect pathways to MT primarily convey modality-specific information on binocular disparity, but that they also contribute to the processing of stimuli moving at fast speeds.

Integrating motion and depth via parallel pathways.

Processing of visual information is both parallel and hierarchical, with each visual area richly interconnected with other visual areas. An example of the parallel architecture of the primate visual system is the existence of two principal pathways providing input to the middle temporal visual area (MT): namely, a direct projection from striate cortex (V1), and a set of indirect projections that also originate in V1 but then relay through V2 and V3. Here we have reversibly inactivated the indirect pathways while recording from MT neurons and measuring eye movements in alert monkeys, a procedure that has enabled us to assess whether the two different input pathways are redundant or whether they carry different kinds of information. We find that this inactivation causes a disproportionate degradation of binocular disparity tuning relative to direction tuning in MT neurons, suggesting that the indirect pathways are important in the recovery of depth in three-dimensional scenes.

Tuning landscapes of the ventral stream.

A goal in visual neuroscience is to explain how neurons respond to natural scenes. However, neurons are generally tested using simpler stimuli, often because they can be transformed smoothly, allowing the measurement of tuning functions (i.e., response peaks and slopes). Here, we test the idea that all classic tuning curves can be viewed as slices of a higher-dimensional tuning landscape. We use activation-maximizing stimuli ("prototypes") as landmarks in a generative image space and map tuning functions around these peaks. We find that neurons show smooth bell-shaped tuning consistent with radial basis functions, spanning a vast image transformation range, with systematic differences in landscape geometry from V1 to inferotemporal cortex. By modeling these trends, we infer that neurons in the higher visual cortex have higher intrinsic feature dimensionality. Overall, these results suggest that visual neurons are better viewed as signaling distances to prototypes on an image manifold.

[Outcomes of percutaneous balloon pulmonary valvuloplasty in pulmonary valve stenosis in the pediatric population in a single center, Lima - Peru]. / Resultados de la valvuloplastia percutánea con balón en la estenosis valvular pulmonar en población pediátrica en el Instituto Nacional Cardiovascular - INCOR, Lima - Perú.

Objective: To evaluate the effectiveness of the procedure and outcomes during follow-up. Methods: 80 patients with pulmonary valvular stenosis who underwent percutaneous balloon valvuloplasty between January 2014 and December 2019 are described. Demographic, echocardiographic, and hemodynamic characteristics of the procedure were evaluated. Follow-up included clinical, echocardiographic parameters, pulmonary regurgitation severity, and residual pulmonary gradient at each cutoff point. Results: The age range was 2 years (interquartile range: 10.5 months - 6 years), and the predominant sex was male with 56.2%. The transvalvular pulmonary gradient decreased from 61.7 mmHg +- 21.2 to 17 mmHg (interquartile range: 11-26 mmHg). The immediate success rate was 90%. Follow-up time showed a median of 21 months (interquartile range: 5-47.5 months). All patients at follow-up showed some degree of pulmonary insufficiency at each cutoff point; 17% of the cases at the end of their follow-up were found to have severe insufficiency. Three cases of long-term restenosis were found (3.8%), and 6 (7.5%) were admitted for valvuloplasty surgery or pulmonary valve replacement. The complications reported reached 10% of cases, two patients were admitted to surgery during the procedure for major complications. A significant association was found with severe pulmonary insufficiency at the end of follow-up and ring/balloon ratio. Conclusions: Percutaneous transluminal valvuloplasty with balloon is an effective technique in the treatment of pulmonary valvular stenosis, with reported complications but with good results during follow-up.

Meta-analysis of the effectiveness of marked wire in reducing avian collisions with power lines.

Collisions of birds with power transmission and distribution lines have been documented for many species, and cause millions of casualties worldwide. Attempts to reduce mortality from such collisions include placing bird flight diverters (i.e., wire markers in the form of, e.g., spirals, swivels, plates, or spheres) on static and some electrified wires to increase their visibility. Although studies of the effectiveness of such devices have yielded contradictory results, the implementation of flight diverters is increasing rapidly. We reviewed the results of studies in which transmission or distribution wires were marked and conducted a meta-analysis to examine the effectiveness of flight diverters in reducing bird mortality. We included in our meta-analysis all studies in which researchers searched for carcasses of birds killed by a collision with wires. In those studies that also included data on flight frequency, we examined 8 covariates of effectiveness: source of data, study design, alternate design (if marked and unmarked spans were alternated in the same line), periodicity of searches for carcasses, width of the search transect, and number of species, lines, and stretches of wire searched. The presence of flight diverters was associated with a decrease in bird collisions. At unmarked lines, there were 0.21 deaths/1000 birds (n =339,830) that flew among lines or over lines. At marked lines, the mortality rate was 78% lower (n =1,060,746). Only the number of species studied had a significant influence on effect size; this was larger in studies that addressed more species. When comparing mortality at marked and unmarked lines, we recommend use of the same time intervals and habitats and standardizing the periodicity of carcass searches.

Visual prototypes in the ventral stream are attuned to complexity and gaze behavior.

Early theories of efficient coding suggested the visual system could compress the world by learning to represent features where information was concentrated, such as contours. This view was validated by the discovery that neurons in posterior visual cortex respond to edges and curvature. Still, it remains unclear what other information-rich features are encoded by neurons in more anterior cortical regions (e.g., inferotemporal cortex). Here, we use a generative deep neural network to synthesize images guided by neuronal responses from across the visuocortical hierarchy, using floating microelectrode arrays in areas V1, V4 and inferotemporal cortex of two macaque monkeys. We hypothesize these images ("prototypes") represent such predicted information-rich features. Prototypes vary across areas, show moderate complexity, and resemble salient visual attributes and semantic content of natural images, as indicated by the animals' gaze behavior. This suggests the code for object recognition represents compressed features of behavioral relevance, an underexplored aspect of efficient coding.

The neurons that mistook a hat for a face.

Despite evidence that context promotes the visual recognition of objects, decades of research have led to the pervasive notion that the object processing pathway in primate cortex consists of multiple areas that each process the intrinsic features of a few particular categories (e.g. faces, bodies, hands, objects, and scenes). Here we report that such category-selective neurons do not in fact code individual categories in isolation but are also sensitive to object relationships that reflect statistical regularities of the experienced environment. We show by direct neuronal recording that face-selective neurons respond not just to an image of a face, but also to parts of an image where contextual cues-for example a body-indicate a face ought to be, even if what is there is not a face.