Why do you think that? You entered a legally binding contract with an obligation to pay. You refuse to pay without canceling the contract. Why should the fact that it's a recurring payment change anything here?
No, merely having payment information is not giving consent, but you signing up for a subscription service was giving consent to a recurring subscription. That's a totally different situation.