Automic Workload Automation

 View Only
Expand all | Collapse all

UC4 WP processes crashes when a new file is added to the batch directory

  • 1.  UC4 WP processes crashes when a new file is added to the batch directory

    Posted 16 days ago
    Edited by Martin S 16 days ago

    20230910/184506.255 - Signal 11 (SEGV) at 0x7f56aa470000 with code 2
    20230910/184506.255 - U00009909 TRACE: (Parameter List)                           0x7ffcbe8c8090 001296
                                    00000000  25255352 30310400 00000000 20202020  >%%SR01......    <
                                    00000010= 20202020 20202020 20202020 20202020  >                <
                                    00000400  20202020 20202020 20202020 00000100  >            ....<
                                    00000410  92000000 90480200 38D25100 B0501700  ><92>...<90>H..8ÒQ.°P..<
                                    00000420  2A534552 56455220 20202020 20202020  >*SERVER         <
                                    00000430  20202020 20202020 20202020 20202020  >                <
                                    00000440  55434456 41525F52 00000000 50524F44  >UCDVAR_<
                                    00000450  524D532D 41505031 2E455854 52415354  ><
                                    00000490  2E434F4D 20202020 4D514350 30303220  >.COM    MQCP002 <
                                    000004A0  A58F5A29 00000000 2A435030 30322330  >¥<8f>Z)....*CP002#0<
                                    000004E0= 20202020 20202020 20202020 20202020  >                <
                                    00000500  20202020 20202020 C8000000 00000000  >        È.......<
    20230910/184506.255 - U00009909 TRACE: (Input Memory)                             0x02305590 000146



  • 2.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 16 days ago
    Edited by Antony Beeston 16 days ago

    Hello Martin S

    a little bit more context information in order to be able to give a helpful answer would be good.

    1. Which Automic version do you use.
    2. Which batch directory do you mean. 
    3. Did you add the file or is the file added by Automic itself?
    4. Is this behavior new, comes it with an update on automic components, is this the first try to write in the batch folder.
    5. Does the log of the WP show any messages before the WP crashes?

    Maybe if i do not misunderstood your problem, if you create files in ae owned directories, this can lead under certain circumstances to problems. I don't know how WP's acutally access the directory, but if they watch for files and your file is not in expected format, this can cause trouble.

    -----------------------------------

    Best regards

    Andrzej Golaszewski




  • 3.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 16 days ago
    Edited by Andrzej Golaszewski 16 days ago

    Hello Martin S

    after an investigation about your problem i have a possible root cause an a hint for solution. 

    Signal 11 (SIGSEGV, also known as segmentation violation) means that the program accessed a memory location that was not assigned to it.

    With the information i gather from you, i found out there are some known memory leak bugs in the version you use.
    I used the Release Notes Tool to get a list from V11.1.0.HF1 up to the latest Patchlevel in your Major version 11 V11.2.10.HF2. There are at least 5 possible memory leaks, so an update is the best you can do. 
    Maybe with a complete Server reboot or a check of used preconditions there could be a possibility to detect the root cause.

    An community thread allready exists, maybe this can give you a hint.

    Here a screenshot of Release Notes:

    Automic Download Center - Release Notes
    Hope that helps you detecting your error.
    ---------------------------------------------------------
    Best regards
    Andrzej Golaszewski

     




  • 4.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 16 days ago

    Hi Andrzej,

    We need to copy files to the directory. Can you please share if there is an workaround for this?

    Thanks,
    Martin




  • 5.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 16 days ago

    Also, is there any reason why UC4 accesses new files in that directory?


    Thanks,
    Martin




  • 6.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Broadcom Employee
    Posted 15 days ago

    Hi, 

    what do you mean by "batch directory"?

    Regards, Markus




  • 7.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 15 days ago
    Edited by Andrzej Golaszewski 15 days ago

    Hi Martin S,

    it is difficult to give a hint for a workaround, when root cause of error ist not detected. Maybe there is a file event listening to the directory, What system changes have you done before the error occur. There are many possibilities. 

    • File /Folder rights
    • Event's watching folder
    • Is it an Automic system folder.
    • How does Automic interact with this folder. 
    • There are new security patches installed. 
    • Is a new job/workflow/event or a change on a job/worklow/event related to the problem
    • Focus on the timeframe when the first error occur and check if any changes in the automic environment or the underlying os where made. Does someone updatet the configurations.
    • Is the error reproduceable. Maybe your system administrators can help you solving the problem.
    • Can a system reboot solve the problem.

    Without kowing whats exactly going on there, it's a wide range of possible solutions.

    hope tha helps to focus on the root cause

    -------------------------------------------

    best regards

    Andrzej Golaszewski




  • 8.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 14 days ago
    • File /Folder rights- No issues with the file/folder permissions. We have been keeping the shell script and scheduled them in Jobs for so many days.
    • Event's watching folder- No idea about this.
    • Is it an Automic system folder.- It is not an Automic system folder. 
    • How does Automic interact with this folder. - We have some shell scripts in that folder and they are used in UC4 jobs.
    • Is a new job/workflow/event or a change on a job/worklow/event related to the problem- No changes
    • Focus on the timeframe when the first error occur and check if any changes in the automic environment or the underlying os where made. Does someone updatet the configurations.- No changes we made
    • Is the error reproduceable. Maybe your system administrators can help you solving the problem. - It is reproduceable if we add a new file in the folder.
    • Can a system reboot solve the problem.- No, system reboot is not solving the problem. We have to remove the files from the directory.



  • 9.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 12 days ago

    Hello Martin S,

    well a really difficult error pattern. I do not know how AE internal work in the version you use, but it is definitly not working as it should be. If you don't have the possibility to update ( update of production systems always require careful action )  i would recommend the following options.

    1. If it is possible run shell scripts within the automation engine, don't execute a shell script.
    2. Try to create another empty directory not in your "batch" folder and try to copy script by script to the new folder. It can be a possible way to narrow down the problem witch script is causing the trouble. After every copy and reconfiguration of the pathes in your automic jobs try to create a new file. 
    3. Another option is to use a different batchdirectory not within your "batch" folder until you upgrade your system to a newer (patched) version of automic. After the update try do merge the folders to get back your well known directory structure.

    -------------------------------------

    Best regards

    Andrzej Golaszewski




  • 10.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 12 days ago

    Hi Andrzej,

    Thank you for the recommendations.

    Thanks,
    Martin




  • 11.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Posted 14 days ago

    Hi Markus,

    In batch directory, we have some shell scripts and we scheduled them in UC4 jobs.

    Thanks,
    Martin




  • 12.  RE: UC4 WP processes crashes when a new file is added to the batch directory

    Broadcom Employee
    Posted 12 days ago

    Hi,

    pls share the version of you AE.
    Did you perform ZDU?

    I recommend opening a case and since it is reproduceable active IP=2 and DB=4 trace and attach the traces to the case.

    Regards, Markus