Landlords taxed too much for vacant properties would just knock the property down and keep the land. Then later, when they want to recoup their investment, they rebuild.
Most properties it isn't the building that is valuable, but the inner city land where one can build a building.
(if they sell up because they can't stomach the taxes, reducing home prices that is also a positive outcome)