Then that me the problem. You may start bursting on the NIC for your datastore, trying to keep up with the file transfer. Have you watched the performance tab on your host to see what the network utilization is like? Also, I'm assuming you are running at GigE, and have you made sure that you are connected at 1000Full if you are?
If at all possible, I would separate the data traffic from the storage traffic.
-KjB