Not just wall street. All of the governments, and thus their budgets, where this real estate resides are completely dependent on property taxes and the overall commerce in the area which will collapse if people (and then secondary small businesses) just simply aren't there anymore.
Budget collapses would be karmic, given how many local governments court commercial real estate while neglecting residential real estate by not encouraging (or actively fighting) the development of new homes. Too many city halls decided that housing people who work in their city is someone else's problem, and would be quite happy with 0 new residents within city limits if it meant all new developments are commercial.