No.
You'd need to enter in 'keygen.exe' for the app name to be monitored. It will start to be detected multiple times. You will need to select the correct one (based on hash) and select it. Only that particular one that matches the hash will be blocked.
In either case (ADC or app to monitor) you need to know the hash.
The use of wildcards is very limited in SEP. It has been asked for for a long time now.