Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar Mark Forums Read
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 09-11-2013, 02:25 PM   #1
$5 submissions
I help you SUCCEED
 
$5 submissions's Avatar
 
Industry Role:
Join Date: Nov 2003
Location: The Pearl of the Orient Seas
Posts: 32,195
Can anyone recommend a good DATA SCRAPER?

I am trying to scrape data from many different sites that feature different formats (some are in WP, most aren't) into one unified database. Is there a 'trainable' spider tool that can allow me to scrape many different sites easily?
$5 submissions is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 02:42 PM   #2
sandman!
Icq: 14420613
 
sandman!'s Avatar
 
Industry Role:
Join Date: Mar 2001
Location: chicago
Posts: 15,432
no such thing exists everyone that does what your trying to do has custom work done.
__________________
Need WebHosting ? Email me for some great deals [email protected]
sandman! is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 02:58 PM   #3
woj
<&(©¿©)&>
 
woj's Avatar
 
Industry Role:
Join Date: Jul 2002
Location: Chicago
Posts: 47,882
Quote:
Originally Posted by sandman! View Post
no such thing exists everyone that does what your trying to do has custom work done.
true

If you want some custom solution, icq: 33375924 or woj a_t wojfun dot com to discuss details...
__________________
Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000
Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager
Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager
woj is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 03:54 PM   #4
$5 submissions
I help you SUCCEED
 
$5 submissions's Avatar
 
Industry Role:
Join Date: Nov 2003
Location: The Pearl of the Orient Seas
Posts: 32,195
Quote:
Originally Posted by sandman! View Post
no such thing exists everyone that does what your trying to do has custom work done.
Thanks, Dan. I'll think about getting the custom scraper done.
$5 submissions is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 06:13 PM   #5
helmuc
HostMaria
 
helmuc's Avatar
 
Industry Role:
Join Date: Aug 2012
Location: UK
Posts: 440
.. well, WP stands for wordpress >> it isn't a text format at all :?

please define exactly what kind of information/data you are after...

prices, reviews, locations or other?
__________________
☕ 🖥️ 🌱 Founder: HostMaria.com and DomainSummit.com | Owner: DNForum.com and AcornDomains.co.uk
helmuc is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 11:38 PM   #6
BigBen
Confirmed User
 
Join Date: Nov 2004
Location: scv
Posts: 2,299
Worth a look...

http://pipes.yahoo.com/pipes/
http://zapier.com
http://scraperwiki.com
BigBen is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-11-2013, 11:50 PM   #7
Mr. Stiff
So Fucking Stiff!
 
Mr. Stiff's Avatar
 
Industry Role:
Join Date: Oct 2005
Posts: 493
http://www.visualwebripper.com/
__________________
ICQ 208807506
Mr. Stiff is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-12-2013, 01:08 AM   #8
freecartoonporn
Confirmed User
 
freecartoonporn's Avatar
 
Industry Role:
Join Date: Jan 2012
Location: NC
Posts: 7,683
you can start with php

there are scrapers for dummies but their cost are high like 1K-2K
you just point and scrape ....

but if u are looking for something special then custom made is your answer.

i created couple of scrapers in the past. with php and http://simplehtmldom.sourceforge.net/


hope this helps.
freecartoonporn is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks
Thread Tools



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.