DX Application Performance Management

Expand all | Collapse all

watchdog doesnt restart the stopped EM

  • 1.  watchdog doesnt restart the stopped EM

    Posted 08-25-2015 04:32 AM

    Hi All,

    if i understood it correctly, watchdog shoudl restart the EM service, if EM stops and it doesnt restart it.

     

    [camon@s0a9119l ~]$ ps -ef | grep camon

    camon     3397     1  0 Aug11 ?        00:11:24 /opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java -jar WatchDog.jar _runwatchdog -watch -port 4321 -startcmd /opt/CAMON/Introscope9.6.0.0/bin/../Introscope_E                              nterprise_Manager -interval 10 -jre /opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java

    camon     3457  3397  1 Aug11 ?        03:53:18 ./jre/bin/java -Xms8192m -Xmx8192m -Djava.awt.headless=true -XX:MaxPermSize=256m -Dmail.mime.charset=UTF-8 -Dorg.owasp.esapi.resources=./config/esapi -Xss51                              2k com.zerog.lax.LAX /opt/CAMON/Introscope9.6.0.0/bin/../Introscope_Enterprise_Manager.lax /tmp/env.properties.3457

    pivodas  17273 17240  0 10:04 pts/1    00:00:00 grep camon

     

    [camon@s0a9119l ~]$ kill -9 3457

    [camon@s0a9119l ~]$

    [camon@s0a9119l ~]$

    [camon@s0a9119l ~]$ ps -ef | grep camon

    camon     3397     1  0 Aug11 ?        00:11:25 /opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java -jar WatchDog.jar _runwatchdog -watch -port 4321 -startcmd /opt/CAMON/Introscope9.6.0.0/bin/../Introscope_E                              nterprise_Manager -interval 10 -jre /opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java

    root     17299 17240  0 10:04 pts/1    00:00:00 sudo su - camon

    root     17323 17299  0 10:04 pts/1    00:00:00 su - camon

    camon    17324 17323  0 10:04 pts/1    00:00:00 cmdlog -bash

    camon    17325 17324  0 10:04 pts/2    00:00:00 -bash

    camon    17516 17325  3 10:05 pts/2    00:00:00 ps -ef

    camon    17517 17325  0 10:05 pts/2    00:00:00 grep camon

    [camon@s0a9119l ~]$

     

    do you have any idea what i configured incorrectly?

     

    thank you,

    stefan



  • 2.  Re: watchdog doesnt restart the stopped EM

    Broadcom Employee
    Posted 08-26-2015 04:18 AM

    Hi Stefan,

    What does "./Watchdog.sh status" show? You can also check the WatchDog.log in EM_HOME/logs

    Did you use the default WatchDog.sh script (with "watch" command) or the WatchDog.jar file to start WatchDog & EM together? Or was EM already running before you did that?

    Are you running EM on default port 5001? The WatchDog runs the CLW jar with help option to check if EM is running on its port and so by default will only check for port 5001 unless you start WatchDog using the jar file with "-emport" option.

    Here is the APM 10.0 wiki ref which applies to 9.6 as well:

    Use the WatchDog Command-Line Tool

    WatchDog Commands

    WatchDog Command Options

     

    Hope this helps

     

    Regards,

     

    Lynn



  • 3.  Re: watchdog doesnt restart the stopped EM

    Posted 08-27-2015 08:04 AM

    HI Lynn,

     

    i started it with "../jre/bin/java -jar WatchDog.jar start -watch -startcmd ../Introscope_Enterprise_Manager" command.

     

    the EM is running, however the WatchDog cant see it:

     

    [camon@s0a9119l bin]$ ./WatchDog.sh status

     

    WatchMgr:  _iPort = 4321; _lInterval = 10; _lStartupTime = 30; _bOptionWatch = false; _lEmPort = 5001; _sEmUser = Admin; _sJRE = ../jre/bin/java; _sStartCmd = ../Introscope_Enterprise_Manager; _sEmHost = localhost; _sEmProperties = ../config/IntroscopeEnterpriseManager.properties

     

    stopped & wdwatching

    [camon@s0a9119l bin]$

     

     

     

     

    here is an output from the Watchdog.log file:

     

     

    [camon@s0a9119l bin]$ ../jre/bin/java -jar WatchDog.jar start -watch -startcmd ../Introscope_Enterprise_Manager

     

    WatchMgr:  Do you want to specify password ? Enter "y" for Yes or any other character for using default value.

    f

    _iPort = 4321; _lInterval = 10; _lStartupTime = 30; _bOptionWatch = true; _lEmPort = 5001; _sEmUser = Admin; _sJRE = ../jre/bin/java; _sStartCmd = ../Introscope_Enterprise_Manager; _sEmHost = localhost; _sEmProperties = ../config/IntroscopeEnterpriseManager.properties

     

    startcommandissued & wdstartedwatching

    [camon@s0a9119l bin]$

    [camon@s0a9119l bin]$ ./WatchDog.sh status

     

    WatchMgr:  _iPort = 4321; _lInterval = 10; _lStartupTime = 30; _bOptionWatch = false; _lEmPort = 5001; _sEmUser = Admin; _sJRE = ../jre/bin/java; _sStartCmd = ../Introscope_Enterprise_Manager; _sEmHost = localhost; _sEmProperties = ../config/IntroscopeEnterpriseManager.properties

     

    stopped & wdwatching

    [camon@s0a9119l bin]$

    [camon@s0a9119l bin]$ tail -f ../logs/WatchDog.log

    2015.08.27  14:01:09   Util.runClwCommand()13: ProcessBuilder command = [/opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java, -jar, ../lib/CLWorkstation.jar, help]

    2015.08.27  14:01:09   WatchDogServer13: isWatchDogStartingEM _o._lStartupTime = 30

    2015.08.27  14:01:09   WatcherThread13: Start Watching

    2015.08.27  14:01:09   ServerThread13: ...returning:  startcommandissued & wdstartedwatching

    2015.08.27  14:01:09   Util.runClwCommand()17: ProcessBuilder command = [/opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java, -jar, ../lib/CLWorkstation.jar, help]

    2015.08.27  14:01:09   WatchDogServer17: isWatchDogStartingEM _o._lStartupTime = 30

    2015.08.27  14:01:09   WatcherThread17: waiting for EM to start....

    2015.08.27  14:01:19   Util.runClwCommand()17: ProcessBuilder command = [/opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java, -jar, ../lib/CLWorkstation.jar, help]

    2015.08.27  14:01:20   WatchDogServer17: isWatchDogStartingEM _o._lStartupTime = 30

    2015.08.27  14:01:20   WatcherThread17: waiting for EM to start....

    2015.08.27  14:01:30   Util.runClwCommand()17: ProcessBuilder command = [/opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java, -jar, ../lib/CLWorkstation.jar, help]

    2015.08.27  14:01:30   WatchDogServer17: isWatchDogStartingEM _o._lStartupTime = 30

    2015.08.27  14:01:30   WatcherThread17: waiting for EM to start....

    2015.08.27  14:01:40   Util.runClwCommand()17: ProcessBuilder command = [/opt/CAMON/Introscope9.6.0.0/bin/../jre/bin/java, -jar, ../lib/CLWorkstation.jar, help]

    2015.08.27  14:01:40   WatchDogServer17: isWatchDogStartingEM _o._lStartupTime = 30

    2015.08.27  14:01:40   WatcherThread17: waiting for EM to start....

     

    [camon@s0a9119l bin]$ ./EMCtrl.sh status

    ./EMCtrl.sh status: Enterprise Manager (pid 30155) is running

    [camon@s0a9119l bin]$

     

     

    any idea please what i did wrong?

     

    thank you,

    stefan