We will be having changes (patching/code deployments) on application or DB servers everyday (although not happening on fixed recurring scheduled basis). During these monitored processes stop/start activity will be happening. We would be requiring to disable email alerts for those impacted services/CIs from SOI during that time.
There are various ways to disable the email alerts from SOI.
1. By disabling the specific Policy in 'Escalation Policies and Actions', (if it is specific to only for the Service for which alerts are anticipated, else editing the policy to remove the Service from that policy).
2. Editing the Policy -> Escalation Schedule -> Escalate only on the following selected business hours -> Create and change the start date time to begin after the server/service downtime time. And then revert the schedule back to option '24x7 (Always escalate)'.
3. By disabling the specific Email action in 'Escalation Policies and Actions', (if it is specific to only the Service for which alerts are anticipated).
4. By setting the Service/CI in Maintenance mode.
Here in 1st and 3rd way, we have only option to 'Disable' the policy or email action indefinitely and needs to be manually enabled after the change on the servers (corresponding to particular Service) is completed. And we have observed that admin users often miss out to enable it after the change, leading to monitoring miss. We do have feature to disable alerts for a particular duration in other monitoring tools.
How about if we have a schedule option (either one time or on recurring basis, as found in: (Right click on Service)-> Advanced Maintenance-> Assign Maintenance Schedules with Children -> Create) while we are choosing 'Disable' in 'Escalation Policies and Actions'. This way we don't have to again revisit these sections to enable the policy or action. The email alerts should be BAU after the specified schedule is over.
For 3rd way, ofcourse we can have maintenance schedule that can be schedule for one time or recurrring basis, but we can't go by this mode, as it affects our Service availability metrics if we are setting Service in Maintenance mode.
Posted by mistake as Question. Posting the same as Idea. Please provide your opinions/suggestions in the idea.
Option to disable SOI email alerts for a custom duration in 'Escalation Policies and Actions'.