So, I totally agree with everything you've said, (I am also a data scientist, so appreciate that part especially).
OTOH, ads pay for a lot of stuff, so if you could delete the raw data after some short time, and only retain the model which was used for serving/prediction, then I think a lot of those concerns go away, and the whole infrastructure around data is made an awful lot safer.
Lots of your other points only really apply to the US (the cavalier attitude towards data and privacy, especially), so I wonder if this is something that would work better in the EU, because you do have much stricter laws around the use of personal data.
OTOH, ads pay for a lot of stuff, so if you could delete the raw data after some short time, and only retain the model which was used for serving/prediction, then I think a lot of those concerns go away, and the whole infrastructure around data is made an awful lot safer.
Lots of your other points only really apply to the US (the cavalier attitude towards data and privacy, especially), so I wonder if this is something that would work better in the EU, because you do have much stricter laws around the use of personal data.