In the US, you do have to confirm the details on your card when you change your shipping address in Amazon, or you need to make any updates to it (i.e. cvv / exiry date). Otherwise, not so much.
Edit: Oops, just noticed that point was also posted twice in sibling comments. Oh well, third time's the charm I guess?
