Also quality of google search after the first few years didn't meaningfully improve as a user. I'd expect the big ramp up we're in to taper off as well. Once you reach the point where you train a model on the corpus of "the whole internet", that's it, all you can do is incrementally train it. Of course there can be whole new architectures but that's harder to put your eggs in for investing.
I don't think there's enough third world countries to categorize and sanitize a dataset from YouTube. Meta would have to "give internet" to a few more before we can start dreaming that big.
