Even then, not a good idea for them, hence very few rich countries do it (unless they are very small).
Controlling interest rates is incredibly important, especially in times of crisis. If you were pegged to the USD right now (which is skyrocketing relative to most other currencies), you would be in trouble.