What are you backing up to (a local tape drive, a backup-to-disk folder, etc)?
Since Server1 is your media server (Backup Exec host), it is expected that it will be much faster, since it does not need to transfer the data over the network, but transfers it directly to your backup media.
Server2...