I add a delay on the server side for IPs that seem scrappy and throw heavy javas...

hawkoy on Sept 9, 2020 | parent | context | favorite | on: How we learnt to stop worrying and love web scrapi...

I add a delay on the server side for IPs that seem scrappy and throw heavy javascript to blast off the resources. So far, it seems to work well in some cases.