DX NetOps

 View Only
  • 1.  Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Posted Jan 27, 2020 09:38 AM
    We have just migrated to Spectrum 10.4 onto a Redhat Linux 7.6 platform and my Digital Delivery guys are using Titanium agents and scripts to automatically force system and security patches monthly to the boxes.  Sometimes there are multiple patches with reboots inbetween.  I got lucky this weekend with finding out when it was going to happen and was able to bring it down gracefully before the patch but I may not be so lucky the next time and I don't want to babysit the process every patch cycle.  What is the best option to automate the shutdown and startup process?  I'm a complete novice in this process, so keep it simple.

    ------------------------------
    Aubrey Conner
    Systems Administrator
    IT-Monitoring and Systems Management
    RAYMOND JAMES & ASSOCIATES INC.
    ------------------------------


  • 2.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server
    Best Answer

    Posted Jan 27, 2020 10:43 AM
    Hi Conner,

    We have been using a script (to stop Spectrum) at OS run levels in RHEL 6.x. Not sure, if the same works in RHEL 7.x.




    ------------------------------
    Thank you.
    Rajashekar
    ------------------------------



  • 3.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Broadcom Employee
    Posted Jan 28, 2020 10:26 AM
    Aubrey,

    The issue with shutting down the system is before processd can shutdown the SpectroSERVER and Archive Manager processes gracefully, the shutdown kills them.
    On Windows, you can increase the WaitToKillServiceTimeout value using the Registry Editor. 

    On Linux, add the "PROCESSD_SHUTDOWN_TIMEOUT=60000" parameter to the /opt/SPECTRUM/spectrum80.env file. A restart of processd needs to be done for this to take affect.

    How high you increase them depends on how long it normally takes the SpectroSERVER and Archive Manager processes to gracefully shutdown in your env.

    To automatically start up, edit the SS.idb and ARCHMGR.idb files and set AUTOBOOTSTART to "Y". A restart of processd is required for this to take affect.

    It is NOT recommended to set the AUTORESTART to "Y" for the SS and ARCH.

    Joe


  • 4.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Posted Jan 28, 2020 10:45 AM
    Edited by Rajashekar Allala Jan 28, 2020 10:45 AM
    Hi Joe,

    Will it also take care of stopping the Spectrum along with the processd to avoid SSDB crash?

    On Linux, add the "PROCESSD_SHUTDOWN_TIMEOUT=60000" parameter to the /opt/SPECTRUM/spectrum80.env file. A restart of processd needs to be done for this to take affect.


    ------------------------------
    Thank you.
    Rajashekar
    ------------------------------



  • 5.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Broadcom Employee
    Posted Jan 28, 2020 10:50 AM
    Yes.


  • 6.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Posted Feb 06, 2020 03:48 AM
    Hi Joe!

    "PROCESSD_SHUTDOWN_TIMEOUT=60000" - is this 60 seconds?

    Cheers!
    Joern


    ------------------------------
    Senior System Engineer
    Computacenter
    ------------------------------



  • 7.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Broadcom Employee
    Posted Feb 06, 2020 08:22 AM
    Yes that is 60 seconds.


  • 8.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Posted Feb 07, 2020 03:24 AM
    Thanks Joe!

    ------------------------------
    Senior System Engineer
    Computacenter
    ------------------------------



  • 9.  RE: Automated reboot of OneClick and SpectroServer on Linux 7.6 server

    Posted Feb 07, 2020 03:35 AM
    Just to let you know, we have our servers up in AWS and our internal DevOps team don't always pass on the message when AWS wants to shunt the instances across to new tin. So, we set our timeout to 120000 (2 minutes) and this has worked fine for us for a number of years.

    JB.