HTTPS with Perl

king4lex · Mar 31, 2005

Hi,

I'm pretty much a n00b with Perl. I'm writing a script that needs to be able to screen scrape pages off the Internet. I've figured out how to GET and POST using LWP::UserAgent's simple_request() function. But I also need to be able to access HTTPS pages, not just HTTP. I'm not sure how to go about that. Can anyone point me in the right direction?

Thx.

king4lex · Mar 31, 2005

Never mind. I figured it out. Just use LWP::UserAgent's request() function instead of simple_request(). Example:

Code:

use LWP::UserAgent;
my $ua = LWP::UserAgent->new;
my $site = $ua->request( new HTTP::Request( 'GET', '[URL unfurl="true"]https://www.nodeworks.com'[/URL] ) );
# Print whatever is returned by [URL unfurl="true"]https://www.nodeworks.com[/URL]
print $blah->content;

tchatzi · Apr 4, 2005

You see what happens if you take some time to read the documentation?

Good job!

TIMTOWTDI

Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

HTTPS with Perl

king4lex

Programmer

king4lex

Programmer

tchatzi

Technical User

Similar threads

Part and Inventory Search

Sponsor