You can only remove the permission on the object where it is set.
In VC go to the inventory and select the item where the permission for the user is set (e.g. Hosts & Clusters). There go to the permissions tab and delete the user.
By the way in my opinion it is better to grant permission by using windows groups (local or domain groups). There you can easily manage the membership for the different roles.
Regards
Axel