Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
12-12-2016, 03:41 AM | #1 |
Confirmed User
Join Date: Dec 2005
Posts: 956
|
Web scraper tool recommendation?
I need something to go through the links in the first table column of a page such as https://en.wikipedia.org/wiki/EFL_Ch...urrent_members, get a few things from the details page (ground, full name, web site) and perhaps larger version of a logo too. Is there a tool for this (win installable preferably)?
Tried a couple of tools (there's plenty of them it seems) but nothing usable so far. Datatoolbar looked better then the rest but it tends to miss links and stuff for no obvious reason. |
12-12-2016, 03:46 AM | #2 |
Webmaster
Industry Role:
Join Date: Jun 2004
Posts: 14,295
|
You need a script written for that.
Ask WOJ to make you one. |
12-12-2016, 04:02 AM | #3 |
Confirmed User
Join Date: Dec 2005
Posts: 956
|
Thank you but would prefer cheaper solution, it's a hobby project.
Woj, how much for smth like that otherwise? |
12-12-2016, 04:04 AM | #4 |
Confirmed User
Industry Role:
Join Date: Oct 2003
Location: L.A.
Posts: 5,740
|
Learn PHP. It ain't that hard.
__________________
Blog Posts - Contextual Links - Hardlinks on 600+ Blog Network
* Handwritten * 180 C Class IPs * Permanent! * Many Niches! * Bulk Discounts! GFYPosts /at/ J2Media.net |
12-12-2016, 06:17 AM | #5 |
Confirmed User
Industry Role:
Join Date: Jan 2012
Location: NC
Posts: 7,683
|
woj is your man.
or you can always find developers on upwork.
__________________
SSD Cloud Server, VPS Server, Simple Cloud Hosting | DigitalOcean
|
12-12-2016, 06:41 AM | #6 |
BACON BACON BACON
Industry Role:
Join Date: Nov 2002
Location: Poems everybody, the laddie fancies himself a poet
Posts: 35,457
|
i use downthemall, but it is not automated it only works on the page you are on
|