I know this post is older than dirt and the OP probably doesn't care, but it came up in Google for me when I was having the same issue.
I already had my ESXi host's fully qualified domain name (FQDN) in DNS (both forward and reverse), but I had not gone into ...
ESXi's Configuration -> DNS and Routing -> Properties...
... and set my hostname and domain to match the FQDN in DNS. After setting that, the seemingly quirky fileTransfer.exe thing stopped crashing.
Credit to the other poster for the DNS tip that led to this discovery.