I would have thought it was an asshole comment for implying that having kids makes you less productive. But having kids DOES make you less productive (at least when they are young) or at the very least removes great swaths of time that you would have had available otherwise, if you involve yourself with their lives at all.
Having kids or not is intensely personal and everyone has to make that decision themselves, not having them is extremely valid