Hacker News new | past | comments | ask | show | jobs | submit login

9.2 million parameters per neuron. There an estimated 86 billion neurons in the human brain [0] and 19 billion in the neocortex [1]. That means that, for this strategy to emulate a human brain or neocortex would require 791 quadrillion parameters or 175 quadrillion parameters, respectively. The largest ANN built so far, GPT-3, has 175 billion parameters [2]. We are 6 orders of magnitude from being able to pull it off.

[0]: https://en.wikipedia.org/wiki/Human_brain

[1]: https://pubmed.ncbi.nlm.nih.gov/9215725/

[2]: https://siliconangle.com/2021/08/04/microsoft-researchers-re...




This is assuming there's no weight sharing.

Some of those weights presumably go to reproducing highly-conserved features, like the kinetics of particular ion channels. These are "tied" via the genome, in the sense that there's one KCNC1 gene, but millions of neurons express the ion channel it encodes.

On the other hand, this model is also missing all sorts of other interactions: hormones and other neuromodulators, ephaptic coupling, etc.

It's so complicated I would venture that no one even has a reasonable guesstimate of how close we are, beyond "Not very."




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: