I was one of the richer kids in what was one of the more "bohemian" houses, as another commenter referred to them. Page was actually toward the top of the wealth spectrum when I was there (recently). There was also a lot of wealth disparity within each house, too, by the way.
However, the signals are more subtle than you think. Things like being happy to go out to eat on weekends, having a big wardrobe, having technical toys, and having a car (at all) were all signs of wealth. A few particular sports were also indicators. "Rich people cars" are usually not given to kids in their 20's, even by wealthy parents.
More subtly, there are a lot of social things, like asking what your parents do and asking about your last vacation. Most rich kids know how to read the room enough not to brag about expensive vacations directly, but will ask assuming you recently had one. Having parents who fly in for things and flying out for short vacations is a dead giveaway.
Also, at Caltech in particular, being well-read was a sign of wealth, but I assume that doesn't translate to non-science schools.
And it would never come up in rotation, but certain house cultures just are more attractive to certain types of people. I think that's the source of the disparity, not any sort of rotation-related thing.
At the University of Washington, there are kids with Lambos and Ferraris.
I was well-read, at least in the field of scifi books!
I don't recall anyone's parents flying in or them flying out for vacations. You might see them dropping their kid off at the beginning of the year, or picking them up at the end.
I eventually got a car for my senior year, but it was my beater Mustang from high school I'd rescued from oblivion.
But, just because I didn't notice these things, doesn't mean they weren't there.