It’s not easy to just stop caring about what people think of you or a lot of people would do it. We’re built to respond to social pressure whether we like it or not. The few that can not care (ie sociopaths) do incredibly well in our current society.