I don't know about should, but given that cameras and microphones and processors and power and communication are all probably going to continue to get cheaper and smaller and lighter it seems to me that this is nearly inevitable. So the question really should be - how do we adapt to it? How can we try to mitigate the harm (through social, legal, and/or technical means) and steer our changing society closer to a future that we'd actually want to live in?
Yeah, not only are cameras going to get cheaper and smaller and lighter (and way more ubiquitous as a result), but there's other factors to consider too. Face recognition is also getting cheaper and more ubiquitous (and other similar technologies like gait recognition and even skeletal kinematics identification).
The privacy implications are astounding. But, as you say, this is all inevitable (I intentionally left out your "nearly" there), and it's a very good question about how that's going to change society and whether we (I) want to live in that.
