LWP

mike101 · Jul 20, 2001

I need to learn LWP so that I can go to an html page and have it look for certain html codes in the source and when it finds it to print what is after it until some other html commands. For example "<a href='

http://www.whatever.com'>"

I would want it to get say... the

http://www.whatever.com

part how do I do this using one of the LWP Modules? Once I see one or 2 examples I will understans.
Thanks.

goBoating · Jul 21, 2001

This approach will not let you time-out the 'get'. If you want more control over the 'get' you'll need to use some of the other LWP tricks. Sorry, my examples of those are on my PC at work. If you need them, I can get them monday.

Code:

#!/usr/local/bin/perl 

use LWP::Simple;

$uri = '[URL unfurl="true"]http://www.perl.com';[/URL]
$page_content = get($uri);

# use pattern matching to see if the page contains 'body' tags.
if ($page_content =~ /<body>.*?<\/body>/i )
{
print &quot;Page, $uri, has body tags and maybe something inbtween them.\n&quot;;
}

I think that will work.
HTH

keep the rudder amid ship and beware the odd typo

mike101 · Jul 21, 2001

Can you tell me how to make what is in between those body tags, for example, variables so I can use them variables to print it or change it around. Thanks. This will help me a ton. And if you could e-mail me those examples when you get to work on Monday that will be great because I will be leaving town on Wednesday for 2 weeks.

goBoating · Jul 23, 2001

wrap the part of your pattern that you want to catch in parens, and if you get a match the part in parens will go into $1. The second set of parens would go into $2, third into $3, and so on.

if ($page_content =~ /<body>(.*?)<\/body>/i )
{
my $body = $1;
print "here is the stuff between the body tags.\n";
print "$body\n\n";
}

HTH

keep the rudder amid ship and beware the odd typo

mike101 · Jul 23, 2001

THANK YOU SO MUCH!!!

Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

LWP

mike101

Programmer

goBoating

Programmer

mike101

Programmer

goBoating

Programmer

mike101

Programmer

Similar threads

Part and Inventory Search

Sponsor