Are the scrapers hand-tuned to each website? If not how did you do it? | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

buss on March 21, 2011 | parent | context | favorite | on: Overview of Text Extraction Algorithms

Are the scrapers hand-tuned to each website? If not how did you do it?

semanticist on March 21, 2011 [–]

We need to extract site-specific metadata, and I'm no expert at NLP, so it's mostly one scraper per site.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact