$U Resource Condition for file type - Directory do not exist

[Gerry Muyargas]

Hello,

We have UVMS/UVC 6.9.21, DUAS 6.7.41.  First of all, we require a job or uproc to be triggered, as soon as we see a file we received or sign on to another node to check fro a file from an external node or vendor.  Note that we are not aware of how to set this up so we are testing how to set it up, and when we tested it, it didn't work.  

Can someone kindly assist how we can set it up?  Thanks in advance for your help.

Below is how we created the uproc and resource.  

First, we created a resource, named FILEALERT, to search for a file, Test.txt, in my laptop folder.

Then we created the uproc with the following, Type is CL_INT.

We then proceeded to run the uproc, but then after starting it, it went into Event wait status, Time Overrun, because we got an error in the Resource log, as follows,
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2020-06-05 13:51:24 | FILEALERT.00000000 | 0000087 | Scan Number 14 | Checking resource FILEALERT...
2020-06-05 13:51:24 | FILEALERT.00000000 | 0000087 | Scan Number 14 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:51:24 | FILEALERT.00000000 | 0000087 | Scan Number 14 | Check KO: resource missing
2020-06-05 13:51:54 | FILEALERT.00000000 | 0000087 | Scan Number 15 | Checking resource FILEALERT...
2020-06-05 13:51:54 | FILEALERT.00000000 | 0000087 | Scan Number 15 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:51:54 | FILEALERT.00000000 | 0000087 | Scan Number 15 | Check KO: resource missing
2020-06-05 13:52:25 | FILEALERT.00000000 | 0000087 | Scan Number 16 | Checking resource FILEALERT...
2020-06-05 13:52:25 | FILEALERT.00000000 | 0000087 | Scan Number 16 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:52:25 | FILEALERT.00000000 | 0000087 | Scan Number 16 | Check KO: resource missing
2020-06-05 13:52:55 | FILEALERT.00000000 | 0000087 | Scan Number 17 | Checking resource FILEALERT...
2020-06-05 13:52:55 | FILEALERT.00000000 | 0000087 | Scan Number 17 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:52:55 | FILEALERT.00000000 | 0000087 | Scan Number 17 | Check KO: resource missing
2020-06-05 13:53:25 | FILEALERT.00000000 | 0000087 | Scan Number 18 | Checking resource FILEALERT...
2020-06-05 13:53:25 | FILEALERT.00000000 | 0000087 | Scan Number 18 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:53:25 | FILEALERT.00000000 | 0000087 | Scan Number 18 | Check KO: resource missing
2020-06-05 13:53:56 | FILEALERT.00000000 | 0000087 | Scan Number 19 | Checking resource FILEALERT...
2020-06-05 13:53:56 | FILEALERT.00000000 | 0000087 | Scan Number 19 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:53:56 | FILEALERT.00000000 | 0000087 | Scan Number 19 | Check KO: resource missing
2020-06-05 13:54:26 | FILEALERT.00000000 | 0000087 | Scan Number 20 | Checking resource FILEALERT...
2020-06-05 13:54:26 | FILEALERT.00000000 | 0000087 | Scan Number 20 | No file matching filter. Directory [C:\Users\GMuyargas\Documents] do not exist.
2020-06-05 13:54:26 | FILEALERT.00000000 | 0000087 | Scan Number 20 | Check KO: resource missing
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

[Angus Reid]

​May be security on the file, what account is used on the $U services such as EPP, IO?  $U needs to be able to see the file otherwise it will just return a no file condition.

Does the Uproc run if the file is already present (as a test)?

[Gerry Muyargas]

Thanks for your response Angus.

This is just a test, as I'm actually accessing the file from the folder path on my personal C: drive from our DUAS node, which is an AIX server.  Will this work?  Or do I have to add in the script to sign on to an account that can access my c: drive?   If this is so, then if I want to access another server then I have to connect to it first with an account that can access the file, don't I?   This will be the first time for us to do this process, so do you mind giving an example script to connect to a server?

My script on the test uproc only does an exit.
sleep 0
exit

Yes, we want our uproc to detect the file, and when it finds it, delete it, and continue with the script in the uproc.

Thanks again,
Gerry

[Angus Reid]

You are running a command on an AIX to access a file on a PC somewhere?
​
The remote location needs to be visible from AIX and the file also needs to be seen. Dollar Universe will be able to see files around the network if these are visible from the AIX.

Outwith Dollar Universe can you see the file on your PC from command line on the AIX? Do you need to log on with any particular user to see the file on the PC from the AIX?

[Gerry Muyargas]

For this test uproc, before I created the Resource name, FILEALERT, I created a file named, Test.txt in my local pc folder, C:\Users\GMuyargas\Documents.  Then I go to the Location section of the Resource, and choose the folder path above.  Note though that when I display the folder path, the file I created is not visible or it doesn't see the file I created (see screenshot).  So I just manually type the file name in the File parameter.

On the Dollar Universe, I cannot see the file from the AIX command line.  I cannot even ftp to my pc from the AIX.

[Angus Reid]

​If Dollar Universe is installed on AIX just try using a local file as a test to prove that a file will be detected and the uproc will work as expected. 

After that move onto detecting files elsewhere like on a share. The files need to be visible to Dollar Universe.

[Gerry Muyargas]

Hi Angus,
We tested as you suggested, and worked okay.  We will work on checking for files on other servers.  I think we are okay now.  Thanks a lot for all your help!
Best regards,
Gerry

[Angus Reid]

​Final note on this, the submission account the services that DUAS runs is the key to file visibility with resources. It may be that you need to change the service accounts  that the IO, ESP and GSI services (on windows anyway) run for to allow access to the file resources.

To get round this issue fro 6.9 the is a new type of uproc called file watcher which will do the same as a file resource but has more flexibility w.r.t. submission accounts and scheduling.

Other alternatinve is to create a script that detects the file and then schedule that in a uproc or put the command inside a loopin the script the uproc calls.

[Gerry Muyargas]

Thanks a lot again for all your help!
Best regards.