You're right, the fish are safer to eat. However, I know a relative that died ice fishing and a friend of my fathers that died in a boating accident. Being on the water comes with its own set of risks.
I've never picked a toxic mushroom. So while it's a risk one should be aware of, and you should know how to do it right, it's not that dangerous if you follow the safety advice. Just like most people don't get killed by sharks or fall of anboat.and drown when going fishing.