If you have a slow link then perhaps you should only deploy the basic agent plus SD.
You can then use software Delivery to push out the AM and RC plugins. This will reduce the deployment package size.
You should also check if you are deploying via a scalability server or not. If you have an SS local to your agents then this will also reduce the deployment time.