1) Verifying an address is not the same as verifying an identity.
2) Your credit card billing info does mostly include your address. It does not however include your name. Your address is (mostly) validated by the transaction, your name is not at all.