CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
INDEX
Search Posts SEARCH
POSTS
Who's Online WHO'S
ONLINE
Log in LOG
IN

Home: Need a Custom or Prewritten Perl Program?: I need a program that...:
Web Crawler

 



kidd
User

May 13, 2003, 4:55 PM

Post #1 of 4 (1544 views)
Web Crawler Can't Post

Does any one have a link to buy a web crawler, the main thing is to retrieve data from the urls...



THANK

"So you want to be a cowboy
Well you know it's more than just a ride
Guess you got to know the real thing
If you want to know the other side
Ain't nobody riding shotgun
In this world tonight"


Jasmine
Administrator

May 14, 2003, 8:56 PM

Post #2 of 4 (1541 views)
Re: [kidd] Web Crawler [In reply to] Can't Post

Not sure how you intend to apply it, but here's a few that I found:

http://search.cpan.org/author/ASHLEY/WWW-Spyder-0.18/
http://sourceforge.net/projects/webharvest/
http://www.focalmedia.net/index_tb.html

Note that I haven't tried any of the above, and can't vouch for its helpfulness, usefulness or integrity.


John123
New User

May 14, 2003, 10:48 PM

Post #3 of 4 (1539 views)
Re: [kidd] Web Crawler [In reply to] Can't Post

Take a look at the Web Extractor here:

http://www.cgiconnection.com/cgi-bin/cgi-con/system.cgi?area=scripts&docs=4900

It will collect e-mail addresses and links from any URL or search engine you can think of.


kidd
User

May 15, 2003, 6:11 AM

Post #4 of 4 (1537 views)
Re: [Jasmine] Web Crawler [In reply to] Can't Post

THANKS Wink

"So you want to be a cowboy
Well you know it's more than just a ride
Guess you got to know the real thing
If you want to know the other side
Ain't nobody riding shotgun
In this world tonight"

 
 


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives