I agree, but I'll add that vim is much easier on a project where things are well organized and laid out.
Some IDEs make it easier to find classes by name or navigate by click. This can lead to disorganization when many people are involved.
I've found that in such an environment, there is a fixed overhead which makes vim much harder to use productively.
