CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
INDEX
Search Posts SEARCH
POSTS
Who's Online WHO'S
ONLINE
Log in LOG
IN

Home: Perl Programming Help: Advanced:
Perl + web2 crawler

 



ptop
Novice

Nov 2, 2009, 6:25 AM

Post #1 of 1 (1510 views)
Perl + web2 crawler Can't Post

Hi,

I'm trying to write a web2 crawler :

it should be able to parse JavaScript link , JavaScript Function , Daynamic JavaScripts , Flash + Daynamic Flash objects

Links including daynamic links which are generated by XML-HTTP-Request , Ajax + All the web2 fetures.

I know it's quite complicated to write this crawler, so i was thinking of using a "Browser Emulator" to do it,

The idea is to pipe the website URL to the "Browser Emulator" and by it's API to "Click" on each link on the website and collecting the results

does any one konw how to do it or a well known tool that do it (it must be in Perl) ?

thanks in advance for any help.Crazy

 
 


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives