On: Why aren’t we using SSH for everything?

[arielb1]

There's nothing preventing you from transporting an SSH public key over some other secured channel. Then it's "I know that you are someone that has access to the SSH key transported over that secure channel".