It gets even weirder. The laws of physics are time reversible as far as we know. Very basically, it means that if you froze our universe and reversed all the velocities of the elementary particles, and then restarted the simulation again, it would be as if time was running backward. In other words, the computer program that simulates our universe forward in time is the same as the computer program that simulates our universe backward in time. This makes the fact that we remember the past and not the future even weirder: if the laws of physics are identical forward or backward in time, then how come the future doesn't affect our memory like the past does?
The theory that tries to explain why we nevertheless only remember the past is called thermodynamics. It has to do with how the universe started out in a very orderly state. If you start the simulation in an orderly state it's likely to become less orderly as you run the simulation. Whether you run time forward or backward doesn't matter: in both directions it will get less orderly. According to thermodynamics that's why we remember the past and not the future. If god had started the simulation with time running backward we'd still have the same experience: we experience the past as whatever direction is toward the more orderly state.
The theory that tries to explain why we nevertheless only remember the past is called thermodynamics. It has to do with how the universe started out in a very orderly state. If you start the simulation in an orderly state it's likely to become less orderly as you run the simulation. Whether you run time forward or backward doesn't matter: in both directions it will get less orderly. According to thermodynamics that's why we remember the past and not the future. If god had started the simulation with time running backward we'd still have the same experience: we experience the past as whatever direction is toward the more orderly state.