CGI/Perl Guide | Learning Center | Forums | Advertise | Login Site Search: in Perl Guide PerlGuru Forums Learning Ctr

	MAIN INDEX	SEARCH POSTS	WHO'S ONLINE	LOG IN

Home: Perl Programming Help: Advanced: Perl + web2 crawler

ptop Novice Nov 2, 2009, 6:25 AM Post #1 of 1 (1139 views) Perl + web2 crawler Can't Post Hi, I'm trying to write a web2 crawler : it should be able to parse JavaScript link , JavaScript Function , Daynamic JavaScripts , Flash + Daynamic Flash objects Links including daynamic links which are generated by XML-HTTP-Request , Ajax + All the web2 fetures. I know it's quite complicated to write this crawler, so i was thinking of using a "Browser Emulator" to do it, The idea is to pipe the website URL to the "Browser Emulator" and by it's API to "Click" on each link on the website and collecting the results does any one konw how to do it or a well known tool that do it (it must be in Perl) ? thanks in advance for any help.

Announcements     PerlGuru Announcements Perl Programming Help     Frequently Asked Questions     Beginner     Intermediate     Advanced     Regular Expressions     mod_perl     DBI     Win32 Programming Help Fun With Perl     Perl Quizzes - Learn Perl the Fun Way     Perl Golf     Perl Poetry Need a Custom or Prewritten Perl Program?     I need a program that...     I Need a Programmer for Freelance Work     Throw Down The Gauntlet General Discussions     General Questions     Feedback     Tutorial/Article Suggestions for The Learning Cent     Internet Security Other Programming Languages     Javascript     PHP

Search this forum this category all forums for All words Any words Whole Phrase (options)

Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives