Read in a URL as string - Webcrawler

[Johnnie100]

Hello and help,

I am building a webcrawler and have written it in VBScript/ASP but when I come to run it a get a server.ScriptTimeout error - I have increased the time but feel that perhaps ASP is the wrong development environment in which to code - do you agree or is there a way around this?

So I am looking to transfer the code and write a VB project to do this - VB obviously won't give any time out errors - but what I need to do is find a way of reading in a web page as a text string. i.e. I give it a URL and it returns to me the HTML as a string. I know how to do this in ASP but is there a way to do it in VB?

Thanks
Andy

 

[paulbent]

Use the Internet Transfer Control (MSINET.OCX)

Paul Bent
Northwind IT Systems

http://www.northwindit.co.uk

 

[vb5prgrmr]

There are several ways, XML, Webbrowser Control, INet control (as mentioned by paulbent), API ....

Good Luck