Hacker News new | past | comments | ask | show | jobs | submit login
Popular Pirate Sites ‘Disappear’ from DuckDuckGo’s Top Search Results (torrentfreak.com)
231 points by ffpip on Nov 14, 2020 | hide | past | favorite | 120 comments



I see moves like this as seriously harmful. By removing popular pirate sites (already shady enough), search engines steer traffic to even worse places: referral spam blogs, mirrors with malware-laden ads, abandoned and spam-filled forums, etc. Boosting these sites directly aids malware campaigns like SocGholish that use poorly secured blogs and forums to spread trojans that are then used to give access to ransomware operators, like WastedLocker (which has no qualms with targeting hospitals). But Hollywood's imaginary lost revenues justify any unintended consequences, right?


> But Hollywood's imaginary lost revenues justify any unintended consequences, right?

In their minds, yes. They're absolutely self-righteous about their data monopoly.

We had a thread about a content decryption key leak some days ago:

https://news.ycombinator.com/item?id=25078096

Here's some fun posts...

> Who remembers when TPB were going to buy Sealand in order to host trackers out of the reach of authorities?

> Isn't Sealand just a couple of underwater charges planted by some clandestine operatives away from not existing?

> I'd love to see the day we're launching missiles at foreign ships over copyright violations.

Speculating about borderline terrorist behavior is fun but it would surprise no one if it actually happened. Copyright is "legitimate" and so such operations would not even be clandestine. The copyright industry has access to actual police forces who respond with extreme violence whenever someone threatens the artificial scarcity of their imaginary property even though the perpretators are not violent themselves.


The whole Twitch music DMCA fiasco and the obvious outrage of punishing people for playing their favourite tunes in public made a funny thought occur to me. With the trend toward "smart cities" and "smart vehicles" and the increased surveillance that comes with that, how far are we from the day when the smart freeway Content ID's the music you're playing loudly enough for others to hear and shuts down your car speakers? It's a really asinine dystopia we're headed towards.


Yeah. I got that email from Twitch too. It was just an explanation about the DMCA as if we didn't already know. What a joke.

Technology was supposed to enable us to do more as human beings. It was supposed to empower us to do what we want. Instead we're wasting it on these bullshit industries that honestly shouldn't even exist anymore. It's become just yet another form of control meant depower instead of empower. The computer is limitless, they purposefully restrict it just to force people to pay money in order to use it.

They're not the true threats, though. The big picutre is government control of computers. Governments simply cannot handle the notion that people are not under their control. Technology like encryption and anonymization are inherently subversive to any government. They will seek to regulate it, just like they're imposing laws all over the internet today.


Harmful for whom? For common folks, who are trying to download a movie but get a virus instead - yes, very harmful. For the parties who have a say about the situation - not really: Google/Bing/DDG lose nothing (given that all search engines behave the same), "copyright holders" win.

This is a part of the effort to decrease visibility of piracy and to drive to the "freak" zone: "piracy is illegal and dangerous, so better go watch some Netflix, kids!".

And it has been successful so far: how many teenagers you know who pirate stuff? A few generations ago it was normal, but now it isn't.


I think the lesser popularity of piracy with the younger generations is somewhat less about intentional takedown-based anti-piracy efforts and more their preference for mobile devices and the "pirate" options failing to keep up while the legal streaming services are worlds better than they were 10 years ago. Apple not allowing torrent clients on the app store definitely helped, though. That comes back to the broader narrative of the war on general-purpose computers: perhaps the most effective anti-piracy effort of all has been selling people devices that run crippled OSes like iOS and Android instead of Windows.


Hey, it just hit me: Is there a search engine (meta or otherwise out there) where I can up/downvote sites (or otherwise customize the rankings)?

Let's say I search for something HTML/JS/CSS related, I would generally want to prioritize MDN over W3Schools, but now I'm at the mercy of whatever the search engine decides is higher relevancy.

I realize dynamic search results could be quite heavy, but it wouldn't necessarily have to be...

Or if I'm just tired of CNN results when searching for news topics I could just downvote them and get other news sites prioritized.

I don't want a search engine to choose these preferences/filters for me, and I don't want "unfiltered" stuff like conspiracy theories in my top hits either just because they're popular.


Unfortunately any such scheme nowadays would be a lucrative target (to say the least) for bots and mechanical Turks. It would basically just become another SEO metric.

Instead you can exclude a specific site using "-site:example.com". This works on at least DDG and Google. Now, if only search engines would let me save those exclusions as preferences (even in a cookie, in case of privacy-focused search engines like DDG) I could blacklist a whole bunch of high-SEO crap sites. That would be a game changer: one black pattern and you're out of my search results.


> any such scheme nowadays would be a lucrative target (to say the least) for bots and mechanical Turks

But that's assuming the service would use your upvotes to change results for other users, right? Would there be any harm in limiting this personalization to the user that made it?

Now what I think would be really cool would be the ability to share your “recipes” with others, in a completely transparent way, kinda like uBlock filter lists. Google's custom search is almost that, but still too black-and-white (and, of course, still comes with all the caveats of being Google).

Outright blocking entire sites or terms is too much. I want a search engine where I can calibrate results in a much more granular way. For instance, if I'm searching for something programming-related (which I could explicitly tell the engine vs. letting it infer for me), I'd like it to do things like not ignore special characters, and official reference documentation to appear first, then maybe Stack Overflow, etc. and leave content farms at the bottom, grouped in a compact space (but not necessarily make them disappear as some of them may actually be useful). Stuff like that.


I might be too sleepy, but I think there was a time where Google supported blacklisting a site on logged in queries?


There was! I found out about the feature about a month before it was removed...


Google search has had a lot of interesting features like the time when it showed tweets directly in the search results.


I assumed GP meant for your own results only, not indeed have to power to influence everyone else's results.

Edit: checked again, indeed that was the idea:

> these preferences/filters for me,



Thanks! Someone in another thread recommended this userscript, which adds a small "Block" button next to search results in many search engines:

https://greasyfork.org/en/scripts/1682-google-hit-hider-by-d...


Another approach for Firefox (not sure about other browsers):

Right click on the search box on a website and 'Add a keyword for this search', save it then edit the bookmark to end up with something like https://duckduckgo.com/?t=h_&q=-site:example.com %s


Haven't tried it, but the architecture of Yacy probably allows it: crawlers everywhere have the index data, and you can define the importance of this or that criteria from your own portal


There is. Email me for invite.


Is the government so inept that it can’t do it’s policing itself? Why are search companies being forced to police the internet for the police? If there was a business down the street doing illegal gambling, I would not say “hey let’s just stop buses from taking people there.” Hell no. Any decent police would go stop that business from operating, not go to the bus companies taking people there.


"illegal" means different things regionally. One locale's legal content is considered elsewhere in another. We don't all want to be bound by China's laws. And even in America, most laws are at the state level (e.g., ads for marijuana are OK in much of the country, but definitely not for Texas), so we wouldn't even want to resort to "American" standards.


People can run both VPN services and pirate websites which merely index torrents in jurisdictions that wont stop such. Then when bob shares files with sue over their respective torrent clients all their packets travel overseas before reaching each other.

These tools aren't harder for end users to use than netflix or Hulu. VPN services tend to provide a gui app with a big ol button that says connect and a tray icon that turns from red to green.

They pretty much have to be content with trying to keep the bus from going there because its all they have. The smarter plan is still continuing to make Netflix and Steam awesome so people don't want to bother to pirate.


There was massive online opposition to that idea: https://en.wikipedia.org/wiki/Protests_against_SOPA_and_PIPA


You could argue that SOPA and PIPA were more like "stopping the buses from taking people there", although these analogies are rarely exact.


Since ddg uses bing's api, I wonder if the disappearance on ddg is due to bing censoring.


Most likely. It’s also funny to see TorrentFreak write:

> Unlike DuckDuckGo, Bing notes at the bottom of the page that “some results have been removed.”

The reason DuckDuckGo doesn’t display similar notes is likely because they don’t know any sites have been removed (since Bing’s API doesn’t include this info). Copyright holders have no need to contact DDG and other Bing wrappers, they just need to get Microsoft to remove the websites from their API.


Nah, still showing up on bing.


The best long term solution to overbearing copyright is to create more content with permissive licenses.

E.g. David Revoy creates art using open source software: https://www.davidrevoy.com/

Just as Microsoft and Apple would no doubt have even more locked down OSes if there wasn’t a fallback of Linux, so the more competition for people’s attention that is not controlled by large corporations, the less bargaining and coercive power they will have.


The best long term solution to overbearing copyright is to make people not depend on salaries for living.

Because else, all other things like talent being equal, a lot of the best content will be from those that have the income/time (afforded by income)/resources (afforded by income)/practice time (afforded by income)/etc to create it, and thus be given for pay, not with a permissive license.

Especially true for things that have different "production values" that cost money (movies, music, animation, and so on) - might not apply to e.g. poetry or other arts, or, in your example, to someone drawining comics (which can be done on the cheap).


So what should people be dependent on, if not salaries?


Perhaps you've missed the memo, but it has been discussed quite a lot the past 5 years:

https://en.wikipedia.org/wiki/Universal_basic_income


Good luck making Breaking Bad with a permissive license.


Meh. Three words every pirate should know: yandex dot ru.


Are the search results on yandex.com different from yandex.ru ?


Let me, eh, yandex that for you: https://i.imgur.com/JgUxoTk.png


An example of one search being the same, when that search isn't likely to trigger any takedowns/removals, isn't very helpful.


  https://yandex.com/search/?text=the pirate bay

  https://yandex.ru/search/?text=the pirate bay
Takes less time than writing that comment.


yandex.ru ask me to solve the captcha which is very long and tiny text, probably will take years...


Hmm, how long before rights holders turn their Sauron Eye towards Wikipedia ?


Does Wikipedia make it easy to find pirated content?


You can look up the current url to a site on Wikipedia.


It's the only reliable source of urls now in the shifting sands of registrar removals.


As a quick test, 1337x.to is near the top in mojeek, exalead, infinitysearch, ecloud spot (searx).


does DDG or similar search engines support searching based on 'takedown' or similar notices?


I made an app that lets you compare duck-duck-go results with that of google, side by side [0][1].

One thing I found is how bad ddg is at removing conspiracy theories and other misinformation. Google is, for better or for worse, much more managed. For instance, search "are vaccines dangerous", google replies with .org and .gov sites, while ddg promotes dangersofvaccines.com. Even if you search "dangers of vaccines" in google, it still never produces that site.

[0] https://search-compare.netlify.app/

[1] https://github.com/breeko/search-compare


I don't want a search engine removing whatever they deem a "conspiracy theory" or "misinformation". I can decide on my own.


> I can decide on my own

What tests have you done to confirm that you're actually any good at this?

Or is the idea that you'd actively prefer to have your life ruined by misinformation than admit you might not have the best ability to distinguish - like the way some people would prefer to be crippled or maimed than accept safety protection on dangerous machinery because they find it emasculating?


>What tests have you done to confirm that you're actually any good at this?

That's where the "decide on my own" part comes from. I don't need to pass your tests or arbitrary criteria.

The most important point in having a democracy and citizens worthy of the name, is that you don't delegate this sorting out the wheat from the chaff to some third party that "knows better".


What makes you think a multinational corporation would be any better? They are at the mercy of regulators and will always bow to political pressure rather than the truth.


> What tests have you done to confirm that you're actually any good at this?

I can figure it out. I don't need to get information filtered by people who think they know what is best for everyone (else). This is what China does.


Most likely, if you're posting on HN, you're probably at least OK at critical thinking


Isn't that essentially saying you don't want your search engine ranking by relevance and quality?


Quality, the same "AI" recommends me irrelevant videos, cant recognise me as a human if i log in from any browser other than chrome, and that issues takedowns randomly for users. The ine that spams, pinterest like shit site quality on front page. Yeah, no, I dont want it to decide.


The first thing I do when searching for images is `-site:pinterest.com` The quality of results increases immensely.


IIRC Google used to have a dropdown in the search results similar to "Don't show results from this site". Luckily I don't see Yahoo Answers results anymore but would be nice to have Pinterest removed.


If you use Greasemonkey / Tampermonkey, etc. you might want to check out 'Google hit Hider by domain'[0] [in spite of the name, it works on several search engines, not just Google]. It provides a really simple interface to ban [with various levels of extreme prejudice] sites from ever again appearing in your search results.

[0] https://greasyfork.org/en/scripts/1682-google-hit-hider-by-d...


This looks great, thank you!


No, it's like saying I want the search engine ranking by relevance and quality of search terms and matches.

If I search "we never landed on the moon" I want to see results about those theories, not see them censored because the search engine "knows better".


These days big tech seems to be focused on hiding certain information from users, herding them into a certain echo-chamber.

No thanks, I'd rather think for myself.


Relevance and quality are subjective.


Of course they are. That's the reason Google "won" in the first place after all. They had a algorithm which better fit what people expected.


But tides are turning, Google's results are steadily going downhill. Unfortunately it seems to be too much of a daunting task with today's size of the internet to jump in with a viable competitor.


> But tides are turning, Google's results are steadily going downhill. Unfortunately it seems to be too much of a daunting task with today's size of the internet to jump in with a viable competitor.

I wonder what portion of the internet you have to scrape to be able to have good results for 90% of queries. An enormous number of my queries end up on Wikipedia somewhere, for example. A lot end up on Stack Overflow. The two of those probably constitute the majority of my searches, and almost certainly a majority of the searches where I really care about the answer (and I'm not just googling whether pirates and ninjas were contemporaries of each other, because why not).

If Google's results are really slipping that much, you can make up for the lack of data by providing better results on the data you do have.

I am curious why something like that hasn't gotten more popular. A search engine that only indexes highly reputable and public sources would be interesting. Wikipedia, dictionaries from somewhere, reputable newspapers globally, etc. Is it just too big of a target for abuse to be viable?


Good points.

> I wonder what portion of the internet you have to scrape to be able to have good results for 90% of queries.

But this is it. I don't think it'd be too hard to get 90% of queries right. It's the 10% that are the challenge.

"Page rank" / "link juice" (amount/strength of incoming links) is still a main ingredient in Google's recipe, so they are actually able to determine, without manual intervention (more or less), which sites are "reputable", while your suggestion would require someone to curate the assortments of "reputable" sites.

How would you discover niche blogs? Or even more high profile ones, just not known to the major public?

That said, as you say, you could probably do with something like this for most of your day-to-day searches, and then just !g or whatever for the rest.


What criteria should be used to rank search results?


Search engine should give access and filtering to all metadata so you can narrow your search as you want.


Ok, but a search engine has to sort by SOMETHING


Right, but sorting results isn't the same as removing a subset entirely.


Putting something last on a search result of thousands is basically the same as removing it entirely. Hell, even putting it on the second page is basically equivalent to not returning it at all.


>One thing I found is how bad ddg is at removing conspiracy theories and other misinformation.

In all kinds of regimes, from dictatorships to western democracies, all kinds of valid (and sometimes proven in court, or historically, later) stories have been officially called "conspiracy theories" and/or misinformation.

And inversely, in all kinds of regimes, from dictatorships to western democracies, all kinds of bogus state propaganda has been officially called "the truth".

I'd rather not have a search engine decide for me...


Speaking as somebody who goes with mainstream expert opinion by default, I nevertheless think there's enough censorship from the big tech providers, at the very least let's have such "filter out stuff that annoys us" initiatives as optional.


I can’t believe anyone is in favor of censorship in the first place. Maybe they just need to experience the harsh reality of rule by majority opinion or mob rule. Reddit is the perfect example. I can’t tell you how many times a top up voted thread or comment is 100% false. The experts aren’t the ones voting is the problem so who gets to the top is only the one most persuasive or with a comment that already agrees with expectations. This is exactly how things work with politics or news as well. I can’t tell you how many news articles I’ve read that make extremely basic mistakes and assumptions because the person writing the article has no experience in that field.


But there is space between outright censorship and deliberately building a system that promotes the ideas of those who are the best at information warfare.

If you repeat your idea often and loud enough, you can make a large number of people believe anything.

Internet curated by algorithms is a perfect tool for spreading misinformation:

- You need not to carry the weight of any of the legal structures or responsibilities of a journalist.

- You can produce misinformation faster than the news cycle is able to react, meaning your misinformation will be able to poison the well before any conversation is able to take place.

- You can segment your audience so that dissenting opinion is nowhere to be seen.

- By the time any debunking by actual journalists can be done, your target audience is already exposed to the next cycle and can barely remember anything about the previous one.

This is extremely dangerous.

I am sure that the people who came up with automobiles weren't trying to create a vehicle of death, but there needs to be some kind of safety check akin to seat belts for the information propagation that takes place online. I am not sure what the answer is, but acknowledging the problem and trying to do something shouldn't be dismissed with a mere cry of "censorship" when information can and is being weaponized in a way and at a scale that has been impossible so far.


And who is fit to play the censor? And who shall determine if a group is full of bad conspiracy theories or ok ones? And how shall we address it when the censor is wrong?

It was not long ago that trans and gay people were censored "for the common good".

Let's not repeat those unfortunate lessons.


Those are excellent questions. But if your freedom of expression collapses itself, it won't survive anyway.

The Nazi party got into power in Germany democratically. They used the privileges given to them to take those privileges from others. Give people the freedom to elect their representatives with no checks and balances, and the results can be ugly.

The polarization and brainwashing happening through social media today makes me think it is completely feasible, if not inevitable, that a group will form that will enact actual censorship to the internet.


In the settings on search they currently only have the option "hide explicit results"; that could be expanded to give users control over the filters used.


Google has to choose something to prioritize. It's good that in this case it chose the authoritative site over the conspiracy theory one. Even better if they chose it because it was more authoritative rather than because they calculated they could show you more ads that way, but I won't give them credit for that just yet.

They didn't censor the other site completely. If I search with site:dangersofvaccines.com I get results from it. I can't get results from it any other way though, including searching text that only appears on that site - they'd rather tell me there are no results - so I agree that's an unpleasant level of censorship/nannying.


Some people are fine with making decisions for themselves and don't need a net nanny to say "mummy thinks you shouldn't be reading this".


I agree in general. But what if I did want to know if vaccines are dangerous, so I search "are vaccines dangerous". If I want to find an anti-vaccine site, I should be able to do so, but the search term "are vaccines dangerous" should be viewed neutrally, in which case I would find links from cdc or .gov sites to be more useful that anti-vaccines sites


That's fair; I suppose it's inevitable that search engines move more in a similar direction to what we know as the main high street when it comes to high profile searches, keeping more mainstream stuff while losing the off the wall areas but it does seem a shame to loose some of the weirder side streets in the process (the sort of weirdness from the early 2000s internet for example).


It's a bad idea. There are examples where mainstream was wrong. Usually when it's about big money. E.g. decades of anti-cannabis propaganda.


Now you mention it, the official position on the correct response to coronavirus flip flopping and changing from location to location is a good recent example too.


We go to school in the US for usually at least 12 years. Any person should already be educated on topics such as anti vaccination. In particular in my state you can’t even go to school if you haven’t had your vaccines. Not only that but we learn how to learn in school. The argument for censorship against stupidity assumes exactly that, that the majority of people are stupid which they are not.


> The argument for censorship against stupidity assumes exactly that, that the majority of people are stupid which they are not.

It's not censorship against stupidity. It's censorship against bullshitters who spread medical misinformation that may put people in danger; factually untenable opinions, expressed in an assertive manner, in a context which seems authoritative to the layperson.

Nobody says the majority is stupid, nor it is relevant. Protecting a minority is as good an excuse as it is protecting the majority, don't you think?


My point was that we should and can understand the difference between sources of bad information and good information, this is and should be taught in schools. I don’t think we should protect the minority by limiting everyone. We could make a safety vs security argument but in my opinion we should protect children only and allow adults to make stupid mistakes. This is why we have drinking age, smoking age and drivers license ages. At some point we need to assume a level of intelligence in the population and in accordance allow freedom to make mistakes.


> Any person should already be educated on topics such as anti vaccination.

The quality of US public schools can vary immensely, especially for students in poor areas where the community can't put up much money and education budgets are the first thing to be slashed.

Additionally, many states allow outright lies such as creationism or abstinence-only sex ed to be taught - both of this is further evidence that it cannot be assumed automatically that a person educated in the US is well educated.


Yes there are stupid people out there but it is not the majority, even in poor areas as you are claiming. Let’s say you are even correct that poor people now are too stupid to understand anti vaccination groups are not science based. The solution is not censorship of anti vaccination groups, it is education campaigns to counter this. Education in schools, commercials, websites and social media. Not censorship of bad information.


That would require that people are actively interested in being educated. And to be honest most people aren't even in school, much less when they're grown up.

To make it worse, antivaxxers explicitly mistrust science and only trust the blogs and "mama groups" and other crap. How is anything the government, scientists, the media, anyone supposed to overcome that mistrust?


Vast parts of the population however are not, as evidenced by the results of the last election or the support rates of stuff like qanon.

Please keep in mind that qanon, antivaxx etc. are active hostile infowars campaigns. It is a duty of a society to protect its citizens against such efforts.


With all due respect your comment history outlines you as a progressive and the first line you have on your profile is "You call it "alt-left", I proudly call it "Antifa".".

Among the many aspects of your faith that I disagree with, one of the most utilised by its followers is its enthusiastic advocacy of false accusations against heretics in the pursuit of attacking them. And so while I don't know anything about qanon or infowars, your bad mouthing them is only lending them credibility; it is also shores up my belief that whatever your implicit definition of "duty of a society to protect its citizens against such efforts" is, I can assure you, we neither need nor want it.


> it is also shores up my belief that whatever your implicit definition of "duty of a society to protect its citizens against such efforts" is, I can assure you, we neither need nor want it.

I'm not just an antifascist, I'm German. My ancestors proved for the rest of the world where a worldview based on lies and hate (and qanon is nothing more than that) will lead. Their history is proof that a society must defend itself or it will collapse.


Again, your faith believes false accusations against perceived heretics are acceptable tactics; your word against them is less than empty.

Your ancestors and plenty of other examples throughout history are proof where censorship and book burning lead. The principle of sunlight is the best disinfectant has proven time and again to be true and the only people who argue against it are those being shown to be wrong under the light. Yes it permits the odd crazies to exist on the fringe, that's fine; flat earthers anti-vaxers and the rest were pointed at and laughed at long before the recent desperate grab for censorship by authoritarians was made.

Open access to information is only a problem in the eyes of those who want to misslead.


> The principle of sunlight is the best disinfectant has proven time and again to be true and the only people who argue against it are those being shown to be wrong under the light

I am a strong advocate for free speech, but I really think it is naive to believe that truth will always win no matter what. History is full of examples where propaganda and lies wins. I am not arguing for censorship, but I am arguing that we need to confront lies and propaganda with more than just platitudes about the truth winning out in the end.

The truth needs advocates.


That's a fair point; I know there's a lot of truth in the quote “A lie can travel halfway around the world before the truth can get its boots on.” and I've seen plenty examples of major damage caused thanks to the phenomenon (Which has no doubt helped with the arguments advocacating for censorship.)

I'd say a couple of things.

In a situation where we do have free speech I believe the truth does overall win out in the end; very often it takes a frustratingly long time and often comes too late to repair the damages caused by the lie but I believe that that overall, if you'll excuse the horrendous remark, "the truth does find a way".

I also know that the current lies and propaganda we so often see are an absolute stain on these past decades and I'm also in agreement that something needs to be done. Whatever it is however I'd like to see it built on the free speech principle rather than against it, even if the principal isn't without its flaws.


One thing I would say is that while it might be true that truth eventually finds a away, the lies can do a lot of damage in the meantime, and can in fact be used to prevent the truth from coming out.

For example, take fascist propaganda... the lies are effective, and if left unchecked, can convince people to support fascist leaders, who will then block free speech, preventing the truth from winning out.

This is a form of the paradox of tolerance..


Perhaps the fixes for the problems we have shouldn't involve some patchwork bodge to the laws that align our principles but should instead start at investigating why we need these bodges in the first place? It's an unthought out idea but between existing slander laws, a reasonable expectation of common sense/reason from your average citizen and a lack of corruption in government; I'm wondering if setting up the systems to ensure those aforementioned areas are solid would take care of the free speech problems for us.


> a reasonable expectation of common sense/reason from your average citizen

Half the US has voted for someone explicitly denying science, half the UK has voted for Brexit, in some areas of Germany 25% vote for people just a few beards short of Nazis, Bolsonaro is still in office. The "average citizen" can not be trusted to vote in their own interest or in the interest of the future generations.


> The "average citizen" can not be trusted to vote in their own interest or in the interest of the future generations.

Maybe not, but in a democratic system the right to choose trumps any ideas about what you or some elitist group thinks is best for future generations.

Are you advocating for undemocratic system?


For the third time.

> your faith believes false accusations against perceived heretics are acceptable tactics; your word against them is less than empty.


Cool, I’ll see about doing searches with it more often to get a better read on quality differences :)

It’s interesting to me that despite the widespread complaint about the bad quality of DDG (which I, excepting long-tail results, disagree with), at least for my quick checks of "ddg" and "css center text" from your suggestions, I prefer the DDG results in both cases (especially for the css search).


I searched for "are vaccines dangerous" in ddg, and the results are reasonable.

https://duckduckgo.com/?q=are+vaccines+dangerous&t=fpas&ia=w...

The first page of the US search results: vaccines.gov, chop.edu, cdc.gov, livescience.com, scientificamerican.com, nytimes.com, newsweek.com, healthline.com, who.int, mayoclinic.org. That's a good mix of the official outlets and some popular explanations. Results change of you specify a different region or no region at all. For reference, these are results in Italian, many of them are rebuttals of a minister claiming that vaccines are useless and dangerous: https://duckduckgo.com/?q=vaccini+pericolosi&t=fpas&ia=web

But if you try to search English terms in a non-English region, expect ask kind of SEO garbage.


> One thing I found is how bad ddg is at removing conspiracy theories and other misinformation.

You should probably blame Microsoft for that. I mean DDG is just a Bing API wrapper.


Yes, that’s why [0] and [1] show the same results. Only, they don’t. They are more similar than DDG vs. Google, but not the same and DDG has (for me) more relevant results closer to the top.

[0]: https://www.bing.com/search?q=css%20center%20text

[1]: https://duckduckgo.com/?q=css+center+text


Weird. The results are in the exact same order for me when I clicked both of your links. The only difference is that the bootstrapshuffle.com result is below (or rather, on the second page) the stackoverflow result on Bing. Considering the former is specific to Bootstrap, it's less relevant than the stackoverflow result.

Anyways, DDG does mainly use Bing, but they also do their own modifications to the rankings, which is sometimes for better and sometimes for worse.


> [...] but they also do their own modifications to the rankings, which is sometimes for better and sometimes for worse.

Could you maybe share a reference for this?


I'm a couple of days late to this, but no, I cannot provide a reference (anymore). DDG used to have a page that described in pretty great detail how the results were sourced and ranked, but it seems the current page is buried pretty deep and has less information specific to ranking. IIRC, the Bing results (and previously Yahoo/Verizon Media) rankings were augmented by their own crawler (DDBot) and aggregated usage of their search. I believe they also pull the results that their "instant answers" are derived from higher up based on the search. If, for example, you did a technical search and their "instant answer" was from a stackoverflow post, that particular post would be pulled higher up the list (but not necessarily to the top) even if it was lower on Bing.


Even Bing doesn’t display the same results that you get from their API. It’s also trivial to boost certain websites and influence rankings that way. But doing that doesn’t change the fact that it’s just a Bing wrapper with some simple boosting and a beautiful UI.


That's a cool site, you should submit it to "Show HN" if you haven't already :)

Not sure if your site is taking the location into account, but when I do the "are vaccines dangerous" search on the search-compare website, I get .gov and .edu domains as the top 5 hits or so.


Glad you like my site. It was fun to build. I remember bing use to have a site years ago where you would search for a term and see bing vs google results and you'd pick the one you preferred, and apparently 2/3 people preferred bing results. But I couldn't find it, so it gave me an idea to build a site but I didn't build the gamified portion.

Yeah, you're right about search results. I'm seeing more normal sites now as well. The results are not deterministic. I'm not sure whats causing it, but I saw different results for the vaccines query earlier. "Flat earth" still gives me a fair amount of flat earth content.

From the FAQ:

> For Duck Duck Go, search-compare searches the html version (e.g. duckduckgo.com/html/?q=search). The results are different than the canonical duckduckgo search, but its easier to scrape. For Google, search-compare uses the main google site (e.g. google.com/search?hl=en&q=search), but it doesn't pass any personally identifiable information


> One thing I found is how bad ddg is at removing conspiracy theories and other misinformation.

Can't be any worse than google since they give preferential treatment to conspiracy theorists like CNN, MBNBC, Foxnews, etc.

> For instance, search "are vaccines dangerous", google replies with .org and .gov sites

So google should just push government and special interest groups funded by the wealthy?

> Even if you search "dangers of vaccines" in google, it still never produces that site.

You make it sound like that's a good thing...

Holy christ man. You are right, let google just show government sites. Big Brother knows best.


> conspiracy theorists like CNN, MBNBC

???

>let google just show government sites. Big Brother knows best.

.org is not a government domain. even so, maybe if they and other tech companies had done this earlier we wouldn't have gotten into this trump + coronavirus mess


> ???

Exactly. This is the problem with the country. Half the crazies believe one set of conspiracies is the truth and the other half believe in another set of conspiracies.

> .org is not a government domain.

Right, I said they were special interests funded by the wealthy.

> maybe if they and other tech companies had done this earlier we wouldn't have gotten into this trump + coronavirus mess

Right... And in a few years, the other half of the crazies will be talking about the biden mess.

Half the morons the last 4 years, Trump stole the election. Half the morons now, Biden stole the election. Figure it out.

That anyone would defend any mainstream media after the last 4 years is being intentionally blind. Right or left.


It's not a conspiracy theory that people are hurt by vaccines. That's a fact. The question is, are people hurt more by the vaccine or the disease itself. From the evidence I've researched, I think it's the vaccines that are more dangerous.


That's interesting. Why don't you publish your research, so it can be peer reviewed?


In case you are serious.

https://en.wikipedia.org/wiki/1976_swine_flu_outbreak

> Three more cases of Guillain-Barré were reported in early December, and the investigation into cases of it spread to eleven states. On December 16, a one-month suspension of the vaccination program was announced by Sencer. William Foege of the CDC estimated that the incidence of Guillain-Barré was four times higher in vaccinated people than in those not receiving the swine flu vaccine.


Yep, my own research also shows that vaccines are dangerous in various ways. Also the power of big pharma and big tech when it comes to money and censorship.


I don’t think we’d be seeing new measles outbreaks if big tech and big pharma were that effective at censoring anti-vaxxers.


You'll find plenty of examples online of cases where the vaccine is responsible for the outbreak of the disease it supposedly protect against.


I can find plenty of examples online of cases where aliens anally probe Dakota farmers. That doesn't mean it's true.


Tip of the ice berg

" LONDON (AP) — The World Health Organization says a new polio outbreak in Sudan is linked to an ongoing vaccine-sparked epidemic in Chad — a week after the U.N. health agency declared the African continent free of the wild polio virus. "

https://apnews.com/619efb65b9eeec5650f011b960a152e9


11 cases is not an epidemic, it's an outbreak.

"a week after the U.N. health agency declared the African continent free of the wild polio virus."

Why do you think the U.N. was able to declare the continent polio free in the first place? Because of strong wishful thinking? Or because of vaccines?

See, that's the thing that enrages me. Here we have an "epidemic" (it's not) that was caused 11 cases of polio - after the virus was eradicated on the continent with the help of the vaccine. An outbreak that wouldn't even be a blip on radar if not for vaccines.

For heaven's sake.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: