If you have the option to extract rents by forming a cartel (without legal punishment), you'll do it regardless of the underlying value of the asset you're trying to control because it's free money (assuming you can trust the other members of the cartel)
If someone's being that greedy, they can't really use supply and demand to say their hands were tied in terms of controlling rent.