My problem seems to be inside the LAN. I have a LAN consisting of the Server 2003, and five Windows XP machines, and the LAN connects to the internet via a Netgear router. The router is the DHCP server and gateway, the five workstations are DHCP clients, and the server is statically assigned.
As for my speeds, using that test I get 4770kbps download and 355kbps upload. The ironic thing is I can only transfer to my server shares(internally, over the LAN) at about 40 or 50 kbps.