INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Member Login

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips now!

Talk With Other Members
Be Notified Of Responses
To Your Posts
Keyword Search
One-Click Access To Your
Favorite Forums
Automated Signatures
On Your Posts
Best Of All, It's Free!

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

LINK TO THIS FORUM!

Tek-Tips LinkedIn^® Group

Join our
LinkedIn^® Group!

Hook up with past and present colleagues and classmates quickly.

Partner With Us!

"Best Of Breed" Forums Add Stickiness To Your Site

(Download This Button Today!)

Feedback

"...This site is a great forum to exchange knowledge..."

More...

Geography

Where in the world do Tek-Tips members come from?

Click Here To Find Out!

Tek-Tips Shirts!

Get your
Tek-Tips Forums
SWAG here!

Home > Forums > Programmers > Languages > Visual Basic(Microsoft) -VB.NET Forum

Capturing data from multiple web pages at one time

Read More Threads Like This One

chris86t (TechnicalUser)

15 Aug 12 17:31

I have made a program that captures data from a webpage. This action is repeated a few hundred to a few thousand times. Right now it is taking about a second per capture because of the time it takes to load each page. Here is an outline of what I'm doing.

1) use web client to retrieve the page
2) loop through html until regular expression match is found
2) save data to an array
4) do it again.

How would you make this process any faster?

SkipVought (Programmer)

16 Aug 12 8:37

...and your code?

How could anyone evaluate this process without evaluating the star or villain of the process?

Skip,
_{Just traded in my old subtlety...

for a NUANCE!}

ug505 (Programmer)

30 Oct 12 10:12

I don't think you can make it any faster unless you get faster internet. You could try having multiple webbrowser components capturing the data.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members!

Back To Forum

Back To Visual Basic(Microsoft) -VB.NET