ESP Workload Automation

Expand all | Collapse all

$HASP310 by JES and CA7 job stuck in ACT queue

RenateLynn Edwards

RenateLynn EdwardsAug 04, 2017 05:50 PM

Rajesh Janakiraman

Rajesh JanakiramanAug 04, 2017 05:54 PM

Rajesh Janakiraman

Rajesh JanakiramanAug 04, 2017 05:55 PM

Rajesh Janakiraman

Rajesh JanakiramanAug 07, 2017 09:57 AM

Legacy User

Legacy UserSep 28, 2017 02:37 PM

Srosenfe

SrosenfeSep 29, 2017 08:45 AM

  • 1.  $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 03, 2017 01:36 PM

    Hello All,

     

    Recently in my project we faced an issue, were the CA7 defined job started its execution in JES and shows in CA7 ACT queue. Meanwhile after sometimes it ended with $HASP310 jobname TERMINATED AT END OF MEMORY but job was still running Active in CA7. On analyzing the job in its log we found it was ended abnormally but the job in CA7 has not moved to abend queue, It was manually requeued. Can anyone suggest the reason why it was not moved to the abend queue / failure status in CA7?

     

     

    Thanks in advance!!

     

    Marysue CA7-Renate can you please help me on this?

     

    Regards,

    Rajesh Janakiraman



  • 2.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 03, 2017 02:03 PM

    Rajesh, 

     

    Thank you so much for your confidence in me.  Only thing I can think of was that somehow the sms records aren't being captured...   but I'm not sure...   Marysue will have a better idea...  this is a little out of my field of knowledge. 

     

    again thanks

    Renate



  • 3.  Re: $HASP310 by JES and CA7 job stuck in ACT queue
    Best Answer

    Broadcom Employee
    Posted Aug 04, 2017 04:27 PM

    The reason CA 7 keep the job in active queue is because the lack of smf data. This job terminated out of system and CA 7 did not get a smf type 5 record or either there was not enough information in the type 5 record for CA 7 to determine what happened to job.

     

    -Roderick Woods (CA Support)



  • 4.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 04, 2017 05:50 PM

    cool I was right....   I just had a typo... sms v/s smf 



  • 5.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 04, 2017 05:54 PM

    No worries I understood that



  • 6.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 04, 2017 05:55 PM

    Thanks for your Input Roderick



  • 7.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 07, 2017 09:57 AM

    Can you please advise on how to overcome this issue?



  • 8.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 29, 2017 03:56 PM

    Raj -

     

    $HASP310 jobname TERMINATED AT END OF MEMORY means zOS scarified the address space to keep the system running.  It's also a warning that not all clean-up actions may have been successful.  SMF records (which CA-7 looks for) are generally not written - the address space is just "thrown away".

     

    One cause of this is running out of LSQA (Local System Queue Area - system storage in the address space).  SOMETIMES this can be fixed simply by specifying REGION=0M - or NOT specifying 0M.  Other times you may need to tweek various settings (IEFUSI region, system &utility parms, etc.), which is beyond the scope of this discussion.

     

    - Don



  • 9.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 08, 2017 11:29 AM

    More than likely there was never an SMF job termination record (SMF type 05) produced for this job.  If you need further information, please open a case in Support Online for CA 7 support and we will gather data to help explain.



  • 10.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 11, 2017 03:09 PM

    Does a different SMF record get generated for this that we need CA7 to capture? We continue to have this occur occasionally and it is an out of memory condition but doesn't throw a s878 or similar code?

     

    ------ JES2 JOB STATISTICS ------ 

    05 JAN 2017 JOB EXECUTION DATE 

    48 CARDS READ 

    143 SYSOUT PRINT RECORDS 

    0 SYSOUT PUNCH RECORDS 

    7 SYSOUT SPOOL KBYTES 

    (UNKNOWN) MINUTES EXECUTION TIME



  • 11.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Aug 11, 2017 03:19 PM

    In our case this condition is being caused by another CA product. Is it possible to check with that group and identify what smf record is being generated? This seems to be occurring more frequently. In our case it is a DB2 - load product - PTLDRIVM is the "Platinum Fast Unload" which is part of the "CA Unicenter Database Management Solutions for DB2 for z/OS"

    Read more: http://ibmmainframes.com/about7300.html#ixzz4pTYnE5vG



  • 12.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 28, 2017 11:31 AM
    I coded MPF INSTALLATION EXIT FOR MESSAGE $HASP310 to send command to CA7


  • 13.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 28, 2017 12:02 PM

    Can you send me what you coded?



  • 14.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 29, 2017 03:47 PM

    This can also be done in your automation product - if you have one (like OPS/MVS or AF/Operator or Netview), but the exit should also work.

     

    I thought I remembered a way CA-7 can intercept a message, but it's been a while since I've played around with this.

     

    - Don



  • 15.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 28, 2017 02:37 PM
    what is the name of the CA7 STC? it's CA7ONL? 


  • 16.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 29, 2017 06:43 AM

    //ZPS185A   JOB  ,'JOAO',CLASS=A,REGION=0M,TIME=300,                            
    //          NOTIFY=&SYSUID,COND=(0,NE)                                          
    //ST01      EXEC PGM=ASMA90,PARM='OBJECT,RENT'                                  
    //SYSLIB    DD   DSN=SYS1.MACLIB,DISP=SHR                                       
    //          DD   DSN=SYS1.MODGEN,DISP=SHR                                       
    //SYSLIN    DD   DSN=SYS1.OBJECT(HASP310),DISP=SHR                              
    //SYSUT1    DD   UNIT=3390,SPACE=(CYL,(10,5))                                   
    //SYSPRINT  DD   SYSOUT=*                                                       
    //SYSPUNCH  DD   DUMMY                                                          
    //SYSIN     DD   *                                                              
             PRINT NOGEN                                                            
    *------------------------------------------------------------------*    00043200
    *                                                                  *    00043300
    * Program: HASP310  (MPF Exit)                                     *    00043401
    *                                                                  *    00043300
    *    Get MSG "$HASP310 jobname--TERMINATED AT END OF MEMORY"       *    00043600
    *          Issue command        "F CA7,/REQUEUE,JOB=XXXXXXXX       *    00043500
    *                                                                  *    00043300
    * Linkedit in a LNKLSTed dataset                                   *    00044000
    *                F LLA,REFRESH                                     *    00044100
    *                                                                  *    00043300
    *                Include in SYS1.PARMLIB(MPFLSTxx):                *    00044100
    *                $HASP310,SUP(NO),USEREXIT(HASP310),AUTO(NO)       *    00045001
    *                                                                  *    00043300
    *                Refresh MPFLIST:  T MPF=00                        *    00046000
    *                                                                  *    00043300
    *        Because the exit routine executes as a part of the        *    00043300
    *        control program, issue a Getmain or Storage macro         *    00043300
    *        only in subpools 229, 230, and 249.                       *    00043300
    *                                                                  *    00043300
    *        Register at Entry                                         *    00043300
    *        -----------------                                         *    00043300
    *        Register 1 contains the address of a pointer to the       *    00043300
    *        exit parameter list (the CTXT), which is mapped by        *    00043300
    *        macro IEZVX100 (data area CTXT).                          *    00043300
    *                                                                  *    00043300
    *         $HASP310 jobname- TERMINATED AT END OF MEMORY            *            
    *                                                                  *    00043300
    *                                              Joao - 23/05/2005   *    00043300
    *                                                     29/09/2017   *    00043300
    *------------------------------------------------------------------*    00043200
             EJECT                                                                  
    *------------------------------------------------------------------*    00043200
    *                                                                  *    00043300
    *                   M a i n     R o u t i n e                      *    00043300
    *                                                                  *    00043300
    *------------------------------------------------------------------*    00043200
             SPACE                                                                  
    HASP310  CSECT                                 *-------------------*    00421001
    HASP310  AMODE 31                              *                   *    00422001
    HASP310  RMODE ANY                             *                   *    00423001
             BAKR  R14,0                           * Save Regs         *            
             LR    R12,R15                         * load Base         *            
             USING HASP310,R12                     * R12 HASP310 Base  *    00430000
             L     R2,0(,R1)                       * CTXT addr         *    00434000
             USING CTXT,R2                         * using CTXT        *    00435000
             L     R3,CTXTTXPJ                     * Major Line addr   *    00437000
             USING CTXTATTR,R3                     * Major Line base   *    00438000
             LA    R4,CTXTTMSG                     * Msg Text addr     *    00440000
             USING MSGTEXT,R4                      * Msg Text Base     *    00450000
             CLC   MSGID(8),=C'$HASP310'           * Msg $HASP375 ?    *    00550000
             BNE   END00                           * No exit           *    00560000
             LA    R0,AREA_L                       * R0 Area length    *            
             GETMAIN RU,LV=(R0),SP=230             *                   *            
             LR    R11,R1                          * Work Area addr    *            
             USING AREA,R11                        * Work Area base    *            
             MVC   CMDLEN,=XL2'46'                 * CMDLEN 70 bytes   *    00633009
             MVC   CMDAREA(70),=70C' '             * Clear Cmdarea     *    00633109
             MVC   CMDAREA(30),MSG0                * Move Cmd          *    00633209
             MVC   JOB,JOBNAME                     * WORK AREA BASE    *            
             LA    R2,CMDLEN                       * Command Lenght    *            
             MGCRE MF=(E,CMD00),TEXT=(R2),         *                   *   X        
                   CONSID=MSTRID,UTOKEN=(R7)       * Send command      *            
             LA    R0,AREA_L                       *                   *            
             FREEMAIN RU,LV=(R0),A=(R11),SP=230    * Free memory       *            
    END00    EQU   *                               *                   *    00191003
             PR                                    *-------------------*    00662600
    *                                                                       00190303
             EJECT                                                                  
    *------------------------------------------------------------------*    00234303
    *                                                                  *    00234403
    *          W o r k    A r e a s    &    C o n s t a n t s          *    00234403
    *                                                                  *    00234403
    *------------------------------------------------------------------*    00234503
             SPACE                                                                  
    MSG0     DC    CL30'F CA7,/REQUEUE,JOB=           '  CA7 STC Name                          
    *                   ....+....1....+....2....+....3                              
             DS    0F                                                               
    CMD00    MGCRE MF=L                                                     00232911
    MSTRID   DC    F'0'                                                             
    R0       EQU   0                                                                
    R1       EQU   1                                                                
    R2       EQU   2                                                                
    R3       EQU   3                                                                
    R4       EQU   4                                                                
    R5       EQU   5                                                                
    R6       EQU   6                                                                
    R7       EQU   7                                                                
    R8       EQU   8                                                                
    R9       EQU   9                                                                
    R10      EQU  10                                                                
    R11      EQU  11                                                                
    R12      EQU  12                                                                
    R13      EQU  13                                                                
    R14      EQU  14                                                                
    R15      EQU  15                                                                
             LTORG                                                                  
    *                                                                       00436000
    AREA     DSECT                                                          00664000
    CMDLEN   DS    XL2                                                      00664100
    CMDAREA  DS    0CL70                                                    00664200
             DS    CL19                                                             
    JOB      DS    CL8                                                              
             DS    CL43                                                             
                                                                                    
    AREA_L   EQU   *-AREA                                                   00664500
    *                                                                               
    MSGTEXT  DSECT                                                          00664802
    MSGID    DS    CL8                            $HASP310                  00664902
             DS    CL1                            space                     00665002
    JOBNAME  DS    CL8                            JOBNAME                   00665102
             DS    CL1                            space                     00665202
             DS    CL10                           TERMINATED                00665302
             DS    CL1                            space                     00665202
             DS    CL2                            AT                        00665402
             DS    CL1                            space                     00665202
             DS    CL3                            END                       00665202
             DS    CL1                            space                     00665202
    KBYTES   DS    CL3                            OFF                       00665502
             DS    CL1                            space                     00665202
             DS    CL6                            MEMORY                    00665202
    *                                                                               
             IEZVX100                                                       00667700
             END                                                            00236303
    /*                                                                              
    //LKED     EXEC PGM=HEWL,PARM='LIST,MAP,XREF,RENT,REUS,AC=1'                    
    //SYSPRINT DD   SYSOUT=*                                                        
    //SYSLMOD  DD   DSN=SYS1.TOOLS.LINKLIB,DISP=SHR                                 
    //OBJECT   DD   DSN=SYS1.OBJECT,DISP=SHR                                        
    //SYSUT1   DD   SPACE=(CYL,(2,1)),UNIT=3390,DCB=BUFNO=1                         
    //SYSLIN   DD   *                                                               
      INCLUDE OBJECT(HASP310)                                                       
      ENTRY HASP310                                                                 
      SETSSI  28092017                                                              
      NAME    HASP310(R)                                                            
    /*                                                                              
    //ST03     EXEC PGM=SWS0,PARM=1                                                 
    //SYSOUT   DD   SYSOUT=*                                                        
    //SYSRDR   DD   DUMMY                                                           
    //SYSIN    DD   *                                                               
    CMD=F LLA,REFRESH                                                               
    WAIT=0000100                                                                    
    CMD=SET MPF=00                                                                  
    /*                                                                              



  • 17.  Re: $HASP310 by JES and CA7 job stuck in ACT queue

    Posted Sep 29, 2017 08:45 AM

    Thank you Joao !

     

    Thanks,

    Stephen