×
INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Jobs

Extract data in blocks of 15,000 from outside server to my SQL database

Extract data in blocks of 15,000 from outside server to my SQL database

Extract data in blocks of 15,000 from outside server to my SQL database

(OP)
I have been tasked with extracting data from an outside SQL server. The problem is that I am hitting their "live" database. They only want me to pull 15k records at a time. The connection is set up and working fine. I want to use a date, i.e. service_date to pull the records, WHERE service_date between 2018-01-01 and 2018-01-31. How do I set up the query to pull the next months data without having to go in and changing the date for each extract? All help is greatly appreciated.

RE: Extract data in blocks of 15,000 from outside server to my SQL database

A couple of questions here to help nail down what your look for.

You posted this in Microsoft SQL Server: Integration Services (SSIS) Forum so I am guessing you are planning on using SSIS?

15k at a time with some time interval in between?

Is there another column like ID that numbered?

Is this a one time thing or something that you will be doing frequently?

Thanks

Simi

RE: Extract data in blocks of 15,000 from outside server to my SQL database

(OP)
Hi Simi,

Yes, I am using SSIS to move the data.
I'm using a date to pull the records - i.e. DOS between 2018-08-01 and 2018-08-31
The ID won't work great.
I may be using this process over.

Thanks!
Bob

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members! Already a Member? Login

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close