You don't need to set up a git server on your own sever. Just create a git repo, add it as a remote revenue to your local repo, and use ssh+git to push changes directly.
But if you have your own server, why don't you just scp it directly there? That's the piece most people are missing.
SCP is really the solution here. But to be fair, I only discovered scp after a year or two of CLI work. I might have been tempted to hack something together like Taze's solution in my earlier days
But if you have your own server, why don't you just scp it directly there? That's the piece most people are missing.