Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here


unix script for downloading the files from website

unix script for downloading the files from website

unix script for downloading the files from website


I need to download the files from the website and put in to the UNIX server, Can you please suggest.

The website look like this

Thanks in Advance
Ratna Kumar

RE: unix script for downloading the files from website

The best way is to have a logon/signon on their server, and then have a sftp job to get (or mget) the files. man sftp for help with secure file transfer protocol.

Some considerations:
  • How often will the files be downloaded?
  • Once the files are downloaded, how do you make sure you don't download them again?
  • If the files aren't present when your process runs, how do you requeue your process? How long do you wait between attempts? How many attempts before you create an error? How and to whom do you report the error?
  • If your server is down for a few days, what happens to the files on the host server? Do they append? Will they overwrite the current files? One file for each date?
adaptive uber info galaxies (bigger, better, faster, and more adept than agile big data clouds)

RE: unix script for downloading the files from website

You can use wget or curl

The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members!

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close