unix script for downloading the files from website

The best way is to have a logon/signon on their server, and then have a sftp job to get (or mget) the files. man sftp for help with secure file transfer protocol.

Some considerations:
[ul]
[li]How often will the files be downloaded?[/li]
[li]Once the files are downloaded, how do you make sure you don't download them again?[/li]
[li]If the files aren't present when your process runs, how do you requeue your process? How long do you wait between attempts? How many attempts before you create an error? How and to whom do you report the error?[/li]
[li]If your server is down for a few days, what happens to the files on the host server? Do they append? Will they overwrite the current files? One file for each date?[/li]
[/ul]

==================================
adaptive uber info galaxies (bigger, better, faster, and more adept than agile big data clouds)

You can use wget or curl



----------------------------------------------------------------------------
The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb