Eight challenges in developing theory of intelligence.
Front Comput Neurosci
; 18: 1388166, 2024.
Article
in En
| MEDLINE
| ID: mdl-39114083
ABSTRACT
A good theory of mathematical beauty is more practical than any current observation, as new predictions about physical reality can be self-consistently verified. This belief applies to the current status of understanding deep neural networks including large language models and even the biological intelligence. Toy models provide a metaphor of physical reality, allowing mathematically formulating the reality (i.e., the so-called theory), which can be updated as more conjectures are justified or refuted. One does not need to present all details in a model, but rather, more abstract models are constructed, as complex systems such as the brains or deep networks have many sloppy dimensions but much less stiff dimensions that strongly impact macroscopic observables. This type of bottom-up mechanistic modeling is still promising in the modern era of understanding the natural or artificial intelligence. Here, we shed light on eight challenges in developing theory of intelligence following this theoretical paradigm. Theses challenges are representation learning, generalization, adversarial robustness, continual learning, causal learning, internal model of the brain, next-token prediction, and the mechanics of subjective experience.
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Language:
En
Journal:
Front Comput Neurosci
Year:
2024
Document type:
Article
Affiliation country:
China