CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
Search Posts SEARCH
Who's Online WHO'S
Log in LOG

Home: Perl Programming Help: Advanced:
Perl + web2 crawler



Nov 2, 2009, 6:25 AM

Post #1 of 1 (1747 views)
Perl + web2 crawler Can't Post


I'm trying to write a web2 crawler :

it should be able to parse JavaScript link , JavaScript Function , Daynamic JavaScripts , Flash + Daynamic Flash objects

Links including daynamic links which are generated by XML-HTTP-Request , Ajax + All the web2 fetures.

I know it's quite complicated to write this crawler, so i was thinking of using a "Browser Emulator" to do it,

The idea is to pipe the website URL to the "Browser Emulator" and by it's API to "Click" on each link on the website and collecting the results

does any one konw how to do it or a well known tool that do it (it must be in Perl) ?

thanks in advance for any help.Crazy


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives