You don't have to be special. You just have to have a skillset and knowledge base that's difficult enough to replace that people treat you with a modicum of respect. If the place isn't burning to the ground, I don't think it's unreasonable to push back.
I guess it depends on how low your bar for calling something "special" is. I would put on two different levels someone who truly has a "special" skillset vs. someone who is simply very effective and in whom the company has a sunk investment.
