This works both ways. Atheistic forms are there along deity ones. And still this or another way this makes you a Buddhist which IS a religion. Atheistic Buddhist is an oxymoron, I hope you understand at least this much
No, it is not. To be an athiest has nothing to do with religious inclination, it has to do with lack of belief in god(s). It's right there in the word: a-: lack of; -theist: one who believes in a deity. A Buddhist in the vein of the Buddha, who did not believe in god(s), is an atheist.
Most of the definitions I've found define religion as in terms like 'belief in a supernatural power', or 'worship of gods or similar higher powers'.
Buddhism is not involved with either. I see it really as little different to going to the gym. Do the correct practices consistently and see results. No magic, no worship, no blind beliefs, just steadily progressing and seeing results...