When I go to a construction site, I only bring a hammer. I feel a screw driver would weigh me down spiritually. Sure, it could be useful, but I sometimes show up at construction sites and all they have is a hammer. Keeping a toolbox of tools, is just more stuff that I have to keep track of.
I think it's a bit unfair to call vim and all the standard command-line tools in a typical linux distro "a hammer." There is a hell of a lot you can do before you begin to customize them.