I guess their complaint is that the phrase "visually impaired", rather than "people with a visual impairment", or even the less respectful "visually impaired people", sort of makes it sound like the people he spoke with are defined by their disability.
