Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations Chriss Miller on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Web scraping and Posting with VB.NET

Status
Not open for further replies.

CitiDude

Programmer
Nov 4, 2003
2
US
I've been assigned a project that requires me to go to a specific web site, put a number in a specific blank, click the
'Search' button, and then scrape the amounts posted on the screen that displays the results of the search. I will need to move back and forth between both screens.

I have found next to no information on how to do this in VB.NET. I'm sure there has to be a way to screen scrape and post to a web site with VB.NET, but I have no idea where to start.

Anyone has any ideas on how to accomplish this?
 
You'll probably want to use either the System.Net.WebClient object or the System.Net.WebRequest and System.Net.WebRespone objects.

You shouldn't need to load the first page, only load it in the browser, find the name for the entry, and then pass that as data with the URL, using either the post or get method, depending on how the form is usually sent.

-T

01000111 01101111 01110100 00100000 01000011 01101111 01100110 01100110 01100101 01100101 00111111
The never-completed website:
 
I tried using the System.Net.WebClient and System.Net.WebRequest as suggested, but have had no success. When I try to start the GetResponse I always get back an error 403 (Access Forbidden). I checked our proxy settings, and our Web Browsers are set to point to an automatic proxy configuration file. I tried accessing the proxy server directly by setting the proxy properties to the IP address of the proxy server and its port, but it will not allow me to access it directly...
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top