For a bank, considering resources ($) should be available, you should really look into Terminal Services with VPN, great, really great!. You get to run all your programs, all as if you are right there at you office computer; speed wise too. Just set up my first last week ( sorry Loveboat, this was another area of ignorance for me). Requires a low end server(mirrored disks for safety), good bit of ram. You still need a Wan connection; my client has a 280k up, 1.5 down cable connection with a static ip address connecting to standard cable and DSL endpoints. The setup at the client has Treminal services running on a 1 ghz server with 2 gig ram; all program run as fast or faster than on some 2 ghz workstation machines at the client's site. This was a LAN server replaced by a faster unit. Personally a low end >2 ghz would be a better choice.
For a bare minimum VPN, I would go with two firewall boxes capable of 128 bit encryption. You still need a WAN connection with a static address at the bank. With this setup you will have access to you bank LAN but access is very slow, and if you need to connect to any database or very large files your out of luck. For example for a 300k Excel file to load or download, you could go to the kitchen, and have a fast coffee break before before it completes ( maybe that is not so bad, wonder what loveboat has to say ?). I have been using Sonicwall products but Cisco and others have firewall/VPN products. If you have little experience I highly recommend you outsource the inital setup; communications setup can become a frustrating/tedious learning experience.
Trust me, if at all possible Terminal services is the way to go, Citrix Metaframe if resources are unlimited.
As far a installation, not difficult but a VPN, though not absolutely necessary (TS has encryption)is highly recommended; for a bank really necessary.
PcAnywhere due to bank security is not an option, miserably slow