You make a good point. There are some kinds of "institutional dysfunction" that are too problematic to overcome. It that sense it's really not only about the manager. At best managers can carve out a small pocket of good work environment for the employee, but even that has limits that won't be enough for people to stay.
