I'm not sure the number is constant. I think it scales with either the age or the prominence of the comment. I've seen threads where I was unable to downvote top tier comments, even though I could downvote their children.
I did see interesting behavior when I crossed the threshold: I couldn't downvote comments that existed before I reached that karma level (or at least the UI didn't render them with a down vote button).
