Set your sw port speeds to 100 Full Duplex and force the same settings on the server, if you look at your switch port, it's probably generating a lot of errors...
Any servers running on your switches should always have their nic's forced to max speed the switches support...
Mike J