You're forgetting about the other major costs: default risk and loan servicing. Sure, the government might save an amount equal to banks' net profits on student loans, but that could be outweighed by the servicing costs, as the government would need to build a loan servicing operation (and build or install associated software) from scratch.
