I see it as more than a semantic problem, but the problem does boil down to the membership. If they are the lawful structure I'll abide by their decisions, I just don't want to be forced to join.
I hate the idea. I've been in a union once and will never willingly do that again, but it would be more palatable if they couldn't claim me as a 'member'.