Hacker News new | past | comments | ask | show | jobs | submit login
Search Engine for Web Page Source Code with 300M Sites Indexed (publicwww.com)
101 points by ArtWomb on Aug 16, 2018 | hide | past | favorite | 24 comments



What a gem for web sites vulnerability hunters. Listing pages using some buggy WP plugin should be trivial.


Which is not a bad thing. Security by obscurity is not security.


> Security by obscurity is not security.

Security by obscurity alone isn't security, but obfuscation is a great tool to add to your security toolbox. The concept is often derided, but it is very effective when used properly.


lots of results for regexing basic auth tokens.


This seemed really cool and I was going to share it in a local community, but the first search I try gets me 3 results a la "lXXX.com" or "dXXX.org" and I have to pay $49 to view the results of my first search query. Never mind.


They don't have a very focused marketing message but I think they intend to support people who want to make websites like builtwith.com and don't want to run their own indexer. $49/month for that would be quite reasonable.

I'm unaffiliated and guessing of course, but the first two features are 1M search results and an API for integrating in other websites, which would be of limited use for the average web researcher using the website frontend.


One potential use is to find signatures related to crypto miners:

https://badpackets.net/how-to-find-cryptojacking-malware/

Crypto miners are ncreasingly using webassembly and multithreaded executables in background processes. Details in this recent report on state of browser mining:

Digging Into Browser-Based Mining

https://arxiv.org/pdf/1808.00811.pdf


So looking for the famous "OH MY GOD DOES WATCOM SUCK" from DooM, I get ONE hit and I have to pay to see it?

Yeah, great. 0/10


$49 per month?? For that price I could afford a human to search code for me.


You only need it for one hour per month?


You can outsource to developing countries, clearly. https://anti-captcha.com/mainpage would be an example.


You can do it for a lot cheaper than $49/hr. Mechanical Turk will likely get you tens of hours of work of this kind.


Emailing a plain text password? A bold move...


Does the same dumb matching of things that are similar to the search query like many "normal" search engines, even when putting things in "quotes", making it useless for at least some queries :/



How did you find the pages to index ? Do you follow any link or you have a criteria ?


Maybe common crawl


With a different business model this could have been a game-changing product. Opportunity missed.


Out of curiosity, how would you suggesting monetizing this?


Better free tier to make sure it goes viral. Even more important as it's appeal is limited to devs and marketing types. Charge corporate clients for volume and service. This could have been the Google of source code but you need to take the risks Google took in making their search engine free to the masses otherwise it remains a niche product.


Same ways builtwith.com and wappylzer

- Business people want to see what frameworks competitors are running

- Selling data analytics to business companies

- Companies who have liscened software (greensock animation, etc) and want to see if any companies are illegally using their software through CDNs.


So is it a coincidence this is priced $10 a month less than the smallest paid Shodan license?


You can’t find things like “<time” (HTML tags)?


The majority of results are locked behind a paywall..




Consider applying for YC's W25 batch! Applications are open till Nov 12.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: