* filters outs posts which have words like "Ask (HN|YC|PG)", links to techcrunch.com and other noise
* fetches the pages linked to in each of the post. * filters outs posts which have words like "Ask (HN|YC|PG)", links to techcrunch.com and other noise
* fetches the pages linked to in each of the post.