Part of the problem is that any legitimate "men's issue" attracts misogynists and anti-feminists like moths to a flame, and they discredit the discussion by their association.
This is a near-universal problem with social issues. People tend to remember the angry shouting of the Westboro Baptists and TERFs of the world and forget about the calm, reasoned arguments buried under the rubble.