Here's how it will probably go wrong; because privacy abuses always sit on a slippery slope:
Detect CP
Detect child abuse
Detect signs of child abuse
Detect signs of abuse
Detect signs of violent crime
Detect violent crime
Detect crimes
Detect "crimes"
People not believing me, then tell one example of a privacy encroaching policy that didn't expand its original scope of "think of the children" and "terrorism".
The worst part is that they are probably doing it and abusing it and are now seeking a way to normalize their conduct.
Apple is already helping both the FBI and CCP illegally spy on their citizen-subjects. Most iCloud data in the US is stored unencrypted to aid the US national spying, and iCloud data in China is stored on CCP-accessible servers for the same reason.
This is no different. Apple knows which way the wind blows.
The difference now is that they couldn't be used officially and at least, in principle, three letters agencies had to go through a legal process for unmasking.
Now there's a constant search warrant on your phone that can be used against you in a court of law.
Detect CP
Detect child abuse
Detect signs of child abuse
Detect signs of abuse
Detect signs of violent crime
Detect violent crime
Detect crimes
Detect "crimes"
People not believing me, then tell one example of a privacy encroaching policy that didn't expand its original scope of "think of the children" and "terrorism".
The worst part is that they are probably doing it and abusing it and are now seeking a way to normalize their conduct.