One of the ways high energy neutrons interact is by scattering protons elastically. Their masses are essentially the same so the neutron can transfer its momentum very efficiently. These scattered protons (perhaps from plastic in the packaging etc) are then the charged particles that flip bits. These protons are generally lower energy than cosmic ray protons, which means they deposit MORE energy per distance traveled, so they can be worse than cosmics directly.
