A framework for the general design and computation of hybrid neural networks.
Nat Commun
; 13(1): 3427, 2022 06 14.
Article
in En
| MEDLINE
| ID: mdl-35701391
ABSTRACT
There is a growing trend to design hybrid neural networks (HNNs) by combining spiking neural networks and artificial neural networks to leverage the strengths of both. Here, we propose a framework for general design and computation of HNNs by introducing hybrid units (HUs) as a linkage interface. The framework not only integrates key features of these computing paradigms but also decouples them to improve flexibility and efficiency. HUs are designable and learnable to promote transmission and modulation of hybrid information flows in HNNs. Through three cases, we demonstrate that the framework can facilitate hybrid model design. The hybrid sensing network implements multi-pathway sensing, achieving high tracking accuracy and energy efficiency. The hybrid modulation network implements hierarchical information abstraction, enabling meta-continual learning of multiple tasks. The hybrid reasoning network performs multimodal reasoning in an interpretable, robust and parallel manner. This study advances cross-paradigm modeling for a broad range of intelligent tasks.
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Main subject:
Neural Networks, Computer
/
Neurons
Language:
En
Journal:
Nat Commun
Journal subject:
BIOLOGIA
/
CIENCIA
Year:
2022
Document type:
Article
Affiliation country:
China