The normal office hours ARE elite. They're available only to people who have been accepted into YC. The goal of the program is to make more of those (A) group people members of underrepresented demographics.
YC is a private business of course, but since they started this initiative, wouldn't it be even more efficient to make YC staff itself more diverse? Rather than doing segregated open hours.