I could be wrong but I understood one of the problems is misaligned incentives. If the arbitrator is to be kept in business then it's tough for them to rule against businesses that bring cases to them consistently even if the case merits it, which disadvantages employees. In reality I've heard it indeed doesn't turn out fair.