I believe for this to happen you need to create multiple alarmnotifier applications.
Either by using -n or copying the entier Notifier directory to another name and configuring it separately.
Either way, OneClick will see the running applications via connection to the SpectroSERVER.
Running a SINGLE notifier with many policies - what you state is happening will be true in a default configuration.