I'm really shocked by your naive arrogance in this thread. You can't see beyond your own niche and use case. There is an enormous space of good content where the best method of finding that content is searching the internet, not having a previous relationship with a client/customer. In an earlier comment I gave one of many examples, medical conditions that people don't care about until they get it, and at that point they turn to google to search for information.
Google is effectively a monopoly on this front, and at some level should have an obligation to the common good.
The problem here is not that 'good content' is not going to be found, it seems to be that in spaces where there is a ton of competition that the competitors are all in some kind of state where they all feel they and they alone have a right to be the ones to engage with the searchers on topic 'x'.
I highly doubt that in the use-case that you envision (which is indeed not one that I had in mind when reading the comment above) where you are providing to the point information about something you care about you'll find that your information gets drowned out by content that has been SEO'd to the hilt. But even if that were the case I'd blame the SEO guys, not the search engine.
Remember how altavista was spammed to death with on-page trickery and google came and it all suddenly was much better. At the time we did not realize that this would come at the price of the destruction of what made the web great, the links that would lead you from one place to another.
The fact that google is a monopoly is our collective problem, not google's, it's only a monopoly because we let them and because - for now - they are still the best way to get to relevant content.
The thing that could happen in your use-case is that someone would end up finding their information somewhere else or that they would engage with someone else. The only case where there would be a loss to them (your hypothetical visitor) is if they would not engage with anybody at all. But that can't really be true since we're theorizing here from the point of view where there is a glut of relevant content competing for a limited number of slots and then regardless of what the criteria are some of those sites will simply miss out on potential visitors.
The only real worry I have here is that the users would not find any relevant content or places to engage at all. And that's far from being proven.
Google does not have an obligation to the common good other than an ethical and a moral one, a real obligation is a legal one and I - in spite of being fairly harshly critical of google on lots of fronts - have no doubt that if they could solve the spam problem in an effective way would not need any prodding at all to go and do that immediately.
Demanding they do better is tantamount to dictating that an advance in technology be made, maybe the problem is harder than it seems?
"you'll find that your information gets drowned out by content that has been SEO'd to the hilt. But even if that were the case I'd blame the SEO guys, not the search engine."
Maybe, but the part that bothers me is that if you listen to Matt Cutt's he basically says that you should make good content, make a good user experience, build a relationship with your audience, and not think about SEO explicitly. This isn't true for large swathes of content types.
"The fact that google is a monopoly is our collective problem, not google's, it's only a monopoly because we let them"
This is like saying that we don't need antitrust laws because it's our own fault if we allow them to become a monopoly or get into some other situation where fair competition isn't possible.
"The thing that could happen in your use-case is that someone would end up finding their information somewhere else or that they would engage with someone else. The only case where there would be a loss to them (your hypothetical visitor) is if they would not engage with anybody at all"
No, there is a loss if the only content they find at the top of google is demand media style content with no good information but that is SEO'd to the hilt, and people with good and real content can't outrank them.
"Demanding they do better is tantamount to dictating that an advance in technology be made, maybe the problem is harder than it seems?"
I mostly agree, but I think this is a bit too simplistic. I worked on search engines for years and fully understand how hard this problem is. I don't know the answer to this problem, but I see a clear problem or problems. One of which is Google's PR which says "hey, just make a good site with good content and the rest will take care of itself". They aren't really being honest here. For years they dodged the question of negative SEO.
> Maybe, but the part that bothers me is that if you listen to Matt Cutt's he basically says that you should make good content, make a good user experience, build a relationship with your audience, and not think about SEO explicitly. This isn't true for large swathes of content types.
I'd go one step further and I'd say: stop making sites that only exist by the grace of search engines. Not that anybody will listen to that because after all it is easy money but it is very unwise from a business perspective. Do you see Apple spend time on checking their 'link profile' (new term I learned today)?
> This is like saying that we don't need antitrust laws because it's our own fault if we allow them to become a monopoly or get into some other situation where fair competition isn't possible.
No, anti-trust is about anti-competitive behaviour by a monopolist (or a de-facto monopolist), it is not about forcing companies to act in the public interest. They probably should but that's a totally different problem.
So anti-trust would be google squashing duckduckgo.com through some trick using their de-facto monopoly to get rid of a nasty little upstart.
> No, there is a loss if the only content they find at the top of google is demand media style content with no good information but that is SEO'd to the hilt, and people with good and real content can't outrank them.
Yes, and that's exactly the sort of thing that google is finally addressing. I loathe demand media and all the sites operating on that principle.
> I mostly agree, but I think this is a bit too simplistic. I worked on search engines for years and fully understand how hard this problem is. I don't know the answer to this problem, but I see a clear problem or problems. One of which is Google's PR which says "hey, just make a good site with good content and the rest will take care of itself". They aren't really being honest here. For years they dodged the question of negative SEO.
We agree on that they are dodging the question of negative SEO, and it is bad they do that but I can see that Google's image will take a nosedive if they admit that the issue is beyond their technical capabilities. They're essentially lying about this, but what else is new in corporate country?
I wished someone would find a way to make a search engine that uses a completely different aspect to rank pages than the link graph (maybe back to on-page?) and that that search engine would take away 50% of googles' share. That way the SEO dudes would be in for a much harder time.
> I'd go one step further and I'd say: stop making sites that only exist by the grace of search engines.
You are aware that there are large (enormous) swathes of Internet users whose primary mode of navigation is typing whatever they want to visit into Google, trusting it'll correct their (terrible) misspellings, and click one of the first few links of the first result page?
There will type URLs there. Like "Apple.com". Because they don't know what URLs are for, any more.
It sounds to me, if you really suggest to stop making sites for these people, you're not actually aware how numerous they are. They are both the old, and the new generations.
Yes it's sad this is the case. But they are people. What if they are searching for some niche information (like a disease, as another poster already pointed out), but the honest blog post that'd be useful for them has been torpedoed out of the water with this "negative SEO", in favour of some scummy SEO site trying to sell them ineffective fake medicine (or whatever).
Is that too far-fetched? I don't know, but it seems to me that giving evil SEOers the power to blast sites from Google's index by abusing "negative SEO", is a bad thing in general. Your argument seems to be that it'll give SEOers a taste of their own medicine, which I agree that will probably happen. But there will be collateral too, and I don't think that's worth it.
anti-trust is broader than your definition. From wikipedia.
"United States antitrust law is a collection of federal and state government laws, which regulates the conduct and organization of business corporations, generally to promote fair competition for the benefit of consumers. The main statutes are the Sherman Act 1890, the Clayton Act 1914 and the Federal Trade Commission Act 1914. These Acts, first, restrict the formation of cartels and prohibit other collusive practices regarded as being in restraint of trade. Second, they restrict the mergers and acquisitions of organizations which could substantially lessen competition. Third, they prohibit the creation of a monopoly and the abuse of monopoly power."
Google is effectively a monopoly on this front, and at some level should have an obligation to the common good.