When in Full Screen with "Use Full Screen for Retina Display" option (checked), resolution on Mac changes to max. res. by the display, yet when you de-select checkbox "custom scaling" is set as custom.. and user must adjust this..
Why doesn't this go back to how is was before you unchecked?
I get "custom scaling" is manually done by user, after VMWare Tools is installed, but not when display automatic ajusts to full screen by itself..