There is a solution, but it involves binding all collectors to a specific IP address.
You can do it by using the property introscope.enterprisemanager.ipaddress, I mean each collector to a specific binding address that they want agents to communicate on
This propery was added to the product when a customer had Collector machine with two NIC cards, where MOM was communicating on interface and agents on the other
So, right now collectors send all the interfaces found that machine to MOM and MOM broadcasts all those addresses to agents so agents can try to connect whichever host their network recognizes
If we bind the collector to a specific ip, Collector will be bound to that port and MOM and agents will use that i.p only