If privacy is really private, and not merely a promise from a benevolent entity they won't look at your details, not that they can't, then you will always find in your company those who need privacy because they are hiding from all of society that hate them. Even if we were to go 100,000 years into the future where morals are entirely different and alien to modern day ones, if privacy exists at all, you'll find it most popular among those whose behaviors are the most morally repugnant to the futuristic society.
Privacy is good even when you have nothing to hide, but it is imperative for those who do need to be hidden. The ethical issues I generally see people concerned with are ethical issues with privacy itself, not a specific implementation.
There's also a very long history of ideas that were fundamental to scientific and societal progress being morally repugnant to a majority, initially.
Heliocentrism, democracy, etc.
Without some degree of freedom to violate the majority's morality (or even one's parents' morality!) without judgement, we should expect society to stagnate due to arbitrary lock-in of the status quo on any sufficiently controversial issue.
Privacy is great because it lets groups violate the majority's morality invisibly, without flagrantly disrupting the sense the majority has of there being a moral order.
Privacy gives you the upside of social innovation without the downside of a generalized, diminished belief in the morality of others (which can be a downward spiral for societal self-organization.)
Privacy is good even when you have nothing to hide, but it is imperative for those who do need to be hidden. The ethical issues I generally see people concerned with are ethical issues with privacy itself, not a specific implementation.