Any security measure you take can only make attacks harder. If you have a really determined adversary nothing will protect you forever. Compared to the current status quo e-mail encryption even if the private keys are only kept moderately private would be a huge improvement.
