GoFuckYourself.com - Adult Webmaster Forum - View Single Post - [SEO] Scraping data from Google and Bing serps

AdultSites · 05-03-2015, 05:53 AM

Anybody familiar with it. I know that it is not an easy thing, as they are very good at blocking. There are these addons for Firefox, which can do that, but it is on page after pages basis, and not all results. I think it is SeoBook, I actually have it installed. I've never tried scraping though.

What would be the best way to pull all results for something like "site:domain-name.com"? List of urls is the most important, or actually the only thing, which is needed for this.

Thanks.

05-03-2015, 05:53 AM
AdultSites Confirmed User Industry Role: Join Date: Feb 2015 Posts: 203	[SEO] Scraping data from Google and Bing serps Anybody familiar with it. I know that it is not an easy thing, as they are very good at blocking. There are these addons for Firefox, which can do that, but it is on page after pages basis, and not all results. I think it is SeoBook, I actually have it installed. I've never tried scraping though. What would be the best way to pull all results for something like "site:domain-name.com"? List of urls is the most important, or actually the only thing, which is needed for this. Thanks.