There's just not enough energy stored in the mass that way. There was a cool comment some time ago with the calculation, that I can't find now, but the result was on the order of: moving many tonnes of concrete by a few metres gives you enough energy to run some appliances for a day. Not enough to be worth doing on its own.
