Home: Perl Programming Help: Beginner:
help with writing a web crawler with LWP


Sep 8, 2018, 9:06 AM

Views: 543
help with writing a web crawler with LWP

good day dear experts,

need some help with writing a web crawler with LWP

found a great tutorial with fairly nice and helpful explanations:
but unfortunatly there is no help - with some hints how to step further.

see the video here: https://www.youtube.com/watch?v=2-kU-mKrYjM

Dr. Rob Edwards from San Diego State University shows how to use Perl and LWP::Simple to write a simple web crawler.
Perl part 6: Writing a web crawler with LWP

unfortunatly we cannot follow the tutorial - since the code is not visible.

can you help out here a bit.

that would be a great pleasure.. and help in learing


Sep 11, 2018, 7:42 AM

Views: 530
Re: [dilbert] help with writing a web crawler with LWP

Hi Dilbert,

You have been looking into LWP::* for a long time now, we have provided various examples throughout. The youtube example is a very basic script, I'd say for those completely new to LWP. I suggest you Google basic LWP::Simple examples, run them, and practice modifying until you are confident. If you get stuck, ask specific questions rather than general ones, as it stands I'm not sure what kind of help you need or want.



(This post was edited by Zhris on Sep 11, 2018, 7:42 AM)