There is an actually valid concern that instead of guaranteeing credit default swaps in a handful of institutions, you could've spent the same amount of money propping up some of these underwater mortgages.
Same outcome - a bunch of public money goes towards restoring confidence in the system - but with significantly less significant social costs/moral hazards.