Hacker News new | past | comments | ask | show | jobs | submit login

Your argument has a very concrete example. We are a generalist intelligence. And when we encountered chess, we eventually developed specialist intelligence to be the best at chess.



General intelligence builds tools as required, maybe having a whole bunch of them built-in already. Maybe the ones that are most frequently useful. Maybe a more general intelligence can build more of these tools into itself as required.

Interesting philosophic topic how to ensure objectives aren't affected too much. You can make this mind experiment even as a human. There are parts of our goal system we might want to adjust, and parts we'd be horrified to, being very reluctant to accidentally risk affecting it.


This is another level though. GPT4 wont do that. But maybe whatever is coming next can.




Consider applying for YC's W25 batch! Applications are open till Nov 12.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: