Fair he's always been polarizing, but the size of the naysayers (and fanboys) seems to have grown quite a bit recently and I think it comes down to politics.
He’s also become the richest man in the world over the last few years (at least publicly known wealth). That tends to bring you a lot of attention. His politics isn’t the only thing that changed