The thing is that rare events occur frequently enough on evolutionary time scales that not being able to handle them as a species is equivalent to not being fit. This is connected to one of the theories of why humans evolved our rather strange intellectual capacities. It was a way to be fit in a rapidly changing environment. We may not have been the fittest in any specific situation, having no claws, bad eyes and weak stomachs and all, but when the environment changed we were able to retool ourselves better than animals that were optimized for specific and no longer existing environmental conditions.
Whoa whoa who says humans have bad eyes? Our color vision is like animal kingdom best practices, and we invest a ton of brainpower into visual processing.
Humans are great at throwing too, and traveling long distances.