Brain-optimized deep neural network models of human visual areas learn non-hierarchical representations.
Nat Commun
; 14(1): 3329, 2023 06 07.
Article
en En
| MEDLINE
| ID: mdl-37286563
ABSTRACT
Deep neural networks (DNNs) optimized for visual tasks learn representations that align layer depth with the hierarchy of visual areas in the primate brain. One interpretation of this finding is that hierarchical representations are necessary to accurately predict brain activity in the primate visual system. To test this interpretation, we optimized DNNs to directly predict brain activity measured with fMRI in human visual areas V1-V4. We trained a single-branch DNN to predict activity in all four visual areas jointly, and a multi-branch DNN to predict each visual area independently. Although it was possible for the multi-branch DNN to learn hierarchical representations, only the single-branch DNN did so. This result shows that hierarchical representations are not necessary to accurately predict human brain activity in V1-V4, and that DNNs that encode brain-like visual representations may differ widely in their architecture, ranging from strict serial hierarchies to multiple independent branches.
Texto completo:
1
Base de datos:
MEDLINE
Asunto principal:
Encéfalo
/
Redes Neurales de la Computación
Tipo de estudio:
Prognostic_studies
Límite:
Animals
/
Humans
Idioma:
En
Revista:
Nat Commun
Asunto de la revista:
BIOLOGIA
/
CIENCIA
Año:
2023
Tipo del documento:
Article
País de afiliación:
Estados Unidos