its seems that you have some kind of dependencies between servers type in the process , e.g the link type set to specific , you have parameters values that the map from one server type to the second or you using "execute on remote server" feature. is that correct?
In all of those cases if you have more than one server in the source server type you need satisfied the dependencies , meaning the agents in the destination server types need to know on which agents in the source they depended. (Normally in those situation you have only one server in the source server type.)
Hope this help