And when they flee they take some of their food supplies with them and hide the rest. Foraging army might be able to find some of it, but rarely all. Also, if you are in enemy territory it is entirely possible to completely miss some remote village. It's not like they have a satellite map.
That "Just" word is carrying a very heavy load . . .
(The people whose food you are planning to forage will be objecting, likely with weapons)