Saying that: 'we don't know how human intelligence works AND we don't know how AI works IMPLIES human intelligence EQUALS AI' is clearly a logical fallacy, sadly one heard far too often on HN, given that people here should know better.
What was said is that intelligent output from an LLM implies a "possibility" (keyword) of intelligence.
After all, outputs and inputs are all that we use to assume you as a human are intelligent. As of this moment we have no other way of judging whether something is intelligent or not.
> What was said is that intelligent output from an LLM implies a "possibility" (keyword) of intelligence.
No it doesn't, because you can break down how they "learn" and generate output from their models, and thought or intelligence doesn't occur at any step of it.
It's like the first chess computer, which was actually a small guy hiding under the table. If you just show that to someone who treats it as a black box, sure, you might wonder if this machine understands chess. But if you put a little guy in there, you know for a fact that it doesn't.
No you can't break it down. The experts don't fully understand the high level implications of an LLM. This is definitive. We have no theoretical modelling of what LLMs will output. We can't predict it at all, therefore we do not fully understand LLMs from a high level.
'Possibility' - thus as per my original point, the burden of proof is on the proponents.
'outputs and inputs' - that is reduction almost to absurdity, clearly human intelligence is rather more than that. Again, we come back to the 'we don't understand human intelligence therefore something else we don't understand but seems to mimic humans under certain conditions is also intelligent'.
The only thing absurd is your argument. Short of mind reading inputs and outputs are the only thing we have to determine what is intelligent. Go ahead prove to me you are an intelligent being without emitting any output and I'll 100 percent flip my stance and believe you.
That is the whole point of the turing test. Turing developed it simply because we can't fully know what is intelligent through telepathy. We can only compare outputs and inputs.
>- thus as per my original point, the burden of proof is on the proponents
There are no proponents making a claim that intelligence is absolutely true. There are only proponents saying it is possibly true.
Burdens are human qualities assigned to random people for no apparent reason. If it talks like a human then the possibility becomes open by common sense, burden of proof is just some random tag you are just using here.
But again no one is making a claim that LLMs are conscious. But you seem to be making a claim that it isn't. You made a claim, Great. looks like it's your burden now. Or perhaps this burden thing is just stupid and we should all use common sense to investigate what's going on rather then making baseless claims then throwing burdens on everyone else.
I think the Turing Test has a lot to answer here for the current fandango. It (and your input/output argument) boils down to 'if it can't be measured it cannot exist', which does not hold up to philosophical scrutiny.
Burden of proof is a well established legal and scientific concept that puts the onus on one side of the debate to show they are right, and if they are unable to prove that, then the other side would automatically given the 'judgement'. For example, if someone claimed there was life on the Moon, it would be on them to prove it, otherwise the opposite would quite rightly be assumed (after all, the Moon is an apparently lifeless place). Another example, a new drug has to be proven safe and effective before it can be rolled out - instead of others having to prove it is NOT safe and effective to STOP the rollout.
Nobody said if it can't be measured it doesn't exist. Nothing of this nature was said or implied.
What I do believe is that if it can't measured then it's existence is only worthwhile and relevant to you. It is not worthwhile to talk about unmeasurable things in a rigorous way. We can talk about unmeasurable things hypothetically, but topics like whether something is intelligent or not where we need definitive information one way or another requires measurements and communication in a shared reality that is interpretable by all parties.
If you want to make a claim outside of our shared reality then sure, be my guest. Let's talk about religion and mythology and all that stuff it's fine. However...
There's a hard demarcation between this stuff and science and a reason why people on HN tend to stick with science before jumping off the deep end into philosophy or religion.
My point on burden of proof was lost on you. Who the burden is placed on is irrelevant to the situation. Imagine we see a house explode and I thus make a claim that because I saw a house explode an actual house must have exploded. Then you suddenly conveniently declare that if I made the claim the burden is on me to prove it. What? Do you see the absurdity there?
We see AI imitating humans pretty well. I make a soft claim that maybe the AI is intelligent and suddenly some guy is like the burden of proof is on you to prove that AI is intelligent!
Bro. Let's be real. First no definitive claim was made second it's a reasonable speculation irregardless of burdens. The burden of proof exists in medicine to prevent distribution and save lives, people do not use the burden of proof to prevent reasonable speculation.