Feb 25, 2009, 9:56 AM
Post #2 of 3
Re: [LordXenu] WWW::Mechanize looping through site archive pages?
[In reply to]
You probably could do that, but it seems like overkill. WWW::Mechanize is really intended for sites that require you to interact with them via forms (e.g., login, accept license agreement, etc.). For simple site traversal, you can use HTML::TreeBuilder to look for an 'a' (anchor) tag with the text "Next Page", get the url from the link, and fetch the next page with LWP.
(This post was edited by 1arryb on Feb 25, 2009, 9:57 AM)