AutoSys Workload Automation

 View Only

Application server hungs frequently

  • 1.  Application server hungs frequently

    Posted Jan 13, 2021 11:59 AM
    Edited by Rajadurai PratapKumar Jan 13, 2021 12:02 PM
    Dear all , 

    We could see the application server is hung frequently in primary and secondary server . After recycling as_server services we are able to execute autosys commands 

    On investigation we found the below details on as_server logs 

    01/12/2021 13:48:55] CAUAJM_E_18416 Event Server: <DB NAME> Failed Query: <BEGIN :RetVal := ujo_audit_msg_log (14629902, 90, 'sql_command', '"begin wfl_mon.p_wf_mon_start(:
    :
    :
    ; END;>
    [01/12/2021 13:48:55] CAUAJM_E_18402 ORA-01756: quoted string not properly terminated
    [01/12/2021 13:49:02] CAUAJM_E_18400 An error has occurred while interfacing with ORACLE.
    [01/12/2021 13:49:02] CAUAJM_E_18401 Function <doParse> invoked from <parseInternal> failed <494>

    Additional logs for reference

    [01/13/2021 08:25:42] CAUAJM_E_18412 The database client has been interrupted while query execution is in progress.
    [01/13/2021 08:25:42] CAUAJM_E_18400 An error has occurred while interfacing with ORACLE.
    [01/13/2021 08:25:42] CAUAJM_E_18401 Function <doExecute> invoked from <execute> failed <908>
    [01/13/2021 08:25:42] CAUAJM_W_10900 The database monitoring system has detected a potential problem with the database.
    [01/13/2021 08:25:42] CAUAJM_I_10901 The database monitoring system is beginning validation of database connections.
    [01/13/2021 08:27:01] CAUAJM_E_18416 Event Server: <DB NAME> Failed Query: <SELECT j.joid,j.job_name,j.job_type,s.status,s.last_start,s.last_end,s.run_num,s.ntry,s.exit_code,run_priority,i.timezone,j.as_applic,j.as_group, (case when s.pid like 'NOEXEC_%' THEN s.pid else '$' end) FROM ujo_job j JOIN ujo_job_status s ON j.joid = s.joid JOIN ujo_sched_info i ON j.joid = i.joid AND j.job_ver = i.job_ver AND j.over_num = i.over_num LEFT OUTER JOIN ujo_job z ON (z.joid=j.box_joid AND z.is_active=:I_I_1 AND z.is_currver=:I_I_2) AND (z.joid>:I_I_3) AND (z.job_name LIKE :I_S_4 ESCAPE :I_S_5) WHERE (j.job_name like :I_S_6 escape :I_S_7 AND j.is_active=:I_I_8 AND j.is_currver=:I_I_9) AND (z.joid IS NULL) ORDER BY j.joid ASC NULLS FIRST <<1,1,0,'xxx!_D%','!','xxx!_D%','!',1,1>>>
    [01/13/2021 08:27:01] CAUAJM_E_18412 The database client has been interrupted while query execution is in progress.
    [01/13/2021 08:27:01] CAUAJM_E_18400 An error has occurred while interfacing with ORACLE.
    [01/13/2021 08:27:01] CAUAJM_E_18401 Function <doExecute> invoked from <execute> failed <908>
    [01/13/2021 08:27:01] CAUAJM_I_10902 The database monitoring system has completed validation of database connections.
    [01/13/2021 08:27:01] CAUAJM_I_10903 The database monitoring system will resume monitoring for database problems.
    [01/13/2021 08:27:01] CAUAJM_W_10900 The database monitoring system has detected a potential problem with the database.
    [01/13/2021 08:27:01] CAUAJM_I_10901 The database monitoring system is beginning validation of database connections.


    Any suggestions to have a permanent fix