It will get worse with the advancement of AI and could scam the less vulnerable people too for example by voice cloning from few minutes of a voice sample of your friends or relatives.
There was a CEO of a company who already got scammed in a similar way:
https://www.identityiq.com/scams-and-fraud/scammers-use-ai-g...
And the even more scary thing will be when they will be able to use a ChatGPT like AI to automate the whole thing in the future.