Unsupervised neural network models of the ventral visual stream.
Proc Natl Acad Sci U S A
; 118(3)2021 01 19.
Article
in En
| MEDLINE
| ID: mdl-33431673
ABSTRACT
Deep neural networks currently provide the best quantitative models of the response patterns of neurons throughout the primate ventral visual stream. However, such networks have remained implausible as a model of the development of the ventral stream, in part because they are trained with supervised methods requiring many more labels than are accessible to infants during development. Here, we report that recent rapid progress in unsupervised learning has largely closed this gap. We find that neural network models learned with deep unsupervised contrastive embedding methods achieve neural prediction accuracy in multiple ventral visual cortical areas that equals or exceeds that of models derived using today's best supervised methods and that the mapping of these neural network models' hidden layers is neuroanatomically consistent across the ventral stream. Strikingly, we find that these methods produce brain-like representations even when trained solely with real human child developmental data collected from head-mounted cameras, despite the fact that these datasets are noisy and limited. We also find that semisupervised deep contrastive embeddings can leverage small numbers of labeled examples to produce representations with substantially improved error-pattern consistency to human behavior. Taken together, these results illustrate a use of unsupervised learning to provide a quantitative model of a multiarea cortical brain system and present a strong candidate for a biologically plausible computational theory of primate sensory learning.
Key words
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Main subject:
Pattern Recognition, Visual
/
Visual Cortex
/
Neural Networks, Computer
/
Nerve Net
/
Neurons
Type of study:
Prognostic_studies
Limits:
Animals
/
Child
/
Humans
Language:
En
Journal:
Proc Natl Acad Sci U S A
Year:
2021
Document type:
Article