This is true, but being able to ask the computer what changed is much more powerful than trying to remember what you did last night and how that's different from the version you had yesterday morning.
Being able to write code that does something in the first place is the most important.
Having to learn a VCS at the same time you are learning the difference between a parameter and an argument will cause more harm than good for a novice.
On the other hand, being free to experiment, screw up and revert back quickly is great for someone just learning.
I wouldn't recommend it to someone at the hello world level, but would not long after. The industry is plagued by people that don't know how to use source control.