I think it's probably tied to the rise in gated content. Especially news. Unless they want to delist every for-profit news site, they can't carte blanche remove walled content. The algo is fundamentally based on popularity. If enough users are logging in to those sites and clicking on them, they'll keep being ranked.
