Options to get notified if no files received

[Santhosh Gollapudi]

We have multiple continuous file watcher events in our projects. Events will not be having any schedule and procedure will be having below jobs:

1. File Watcher
2. SAP Job to process the file
3. Link/Task job to retrigger the event to reactivate the file watcher again.

For the first time when we create definition and event, we manually trigger the event to activate the file watcher.

Now, we have a ask that if we can setup any alerts if these jobs didn't run by a specific day and time. 

Like we wanted to be notified

• if event A didn't run every day atleast once by 11 PM ET. 
• if event B didn't run by 2nd day by 10 PM ET.

In other words, we need to be notified if we didn't receive the file by specific day / time. What are the options we have in ESP to achieve this ? 

[Jonas Dusil]

Hi Santhosh,

If I understand your scenario correctly, I would recommend using DUEOUT statement in the job you want to be notified about. 
In it you can use schedule criteria to set a time after which the job is considered overdue. You can then use NOTIFY statement to get a notification for that.
Notification can be console message, email or simply triggering another ESP event.
You can read more about that also in the using sections: Notify Users of Job Status and Monitor Overdue Jobs

Following example from DEOUT statement page illustrates the basic use:

Example: Flag overdue and issue Alert
The following DUEOUT and ALERT statements indicate the time when a job is flagged as overdue, and that a message is sent to a user:

JOB PAYJOB3
  NOTIFY OVERDUE USER(CYB01)
  DUEOUT EXEC 7AM
ENDJOB

In this example, if PAYJOB3 is not successfully complete by 7 am (and has started executing):
It is flagged as overdue and the CSF shows OVERDUE in the Status field for the job
A message indicating that PAYJOB3 is overdue is sent to CYB01.

Another approach would be to use a "notify" job with DELAYSUB to run with your workload that would handle actions you need to take when the file does not arrive.
If the file would arrive, as another successor to the file watcher you would force complete that job waiting for delayed submission using AJ command
to disable this "notify" job if the file watcher was hit in time.

[Chris_Elvin]

• I agree with the answer given by Jonas and to match it with your specific needs, I would do something like this
  Put a "DUEOUT EXEC 11PM TODAY" into the FILE_TRIGGER job
  Put a "DUEOUT INPUT 10PM TOMORROW" into the successor SAP job
  
  Or you could reverse these.  In either case you get 2 alarms - one that the file has not been received and the other that the file has not been processed
  
  
  

[Santhosh Gollapudi]

I considered DUEOUT and NOTIFY statements earlier but since these are continuous file watchers with retrigger step at the end, we have a problem.

If file comes at 5 AM, job will process the file and a next generation will be triggered as soon as it completes (consider it is completed by 6 AM). In this case, file for that day has come and processed but the next generation that triggers after SAP job at 6 AM will still have DUEOUT at 7 AM and trigger a false alert. 

[Lucy Zhang]

Hi Santhosh,

You may set up a new event with proper SCHEDULE statements to check if the JOBs have run, like 11PM DAILY and 10PM EVERY 2 DAYS; in short, they are the date/time when the notification should be sent if the jobs haven't run yet.

In the related ESP Proc, you can use one of the methods:
1. Define EXTERNAL JOB with SCOPE to look back: if there is a run, then it will complete and no notification required. If not, then a notification needs to be sent;
2. Check a specific ESP global variable value and see if it contains the proper date. Note: this means, when the JOB runs, it should issue VSET to set the date (and time) .

If more help is needed, please open a support ticket.

Hope this helps in some way,

Lucy