On: Cutting Google out of your life (2019)

[dmoy]

There are benchmarks, but they're probably closely guarded secrets of the various search teams out there.

So not very useful public benchmarks, no.

[amelius → dmoy]

Perhaps you are right, but still difficult to believe that nobody at a university or in open-source built something like this.

It's the thing I would start with if I wanted to design a search engine.

[dmoy → amelius]

Defining such a benchmark and making it public would be incredibly difficult, because as soon as you do, it becomes too easy to game. Think of the worst possible SEO hacks out there, except from the perspective of the engine itself.