DX NetOps

 View Only
  • 1.  CAPM Vertica is Down

    Posted May 29, 2020 04:02 AM
    Hi All,

     We have  three node vertica Database in that one of our node is down ,it is going into recovering state and moving to down ?   Tried to repair also but no luck .
     Whether we can rollback last good db for that alone or it will restore for all three nodes .


  • 2.  RE: CAPM Vertica is Down

    Broadcom Employee
    Posted May 29, 2020 09:16 AM
    Did you try Start Vertica on Host in admintools?  Does that fail?

    If so, try this as dradmin account on the down DR node.
    /opt/vertica/bin/admintools -t restart_node -s nodeIPAddress -p DBPASSWORD -d DBNAME -F

    DBNAME is most likely drdata.  DBPASSWORD is password for dradmin (or equiv) db account.

    If that doesn't work, please open a support case for a support person to work with you.


  • 3.  RE: CAPM Vertica is Down

    Posted May 29, 2020 10:07 AM
    Yes tried the above too , DB is in recovering mode and after sometime it goes down


  • 4.  RE: CAPM Vertica is Down

    Broadcom Employee
    Posted May 29, 2020 10:10 AM
    Best case in this moment would be a support case. I'd also recommend generating a set of logging from the DB cluster using the scrutinize command.

    Attach that logging to the case that gets opened. We'll want to take a run through the logs to make sure the right solution is applied to get the DB restarted.

    Instructions for gathering the scrutinize can be found here.

    https://knowledge.broadcom.com/external/article/31795

    ------------------------------
    Technical Support Engineer IV
    Broadcom
    ------------------------------



  • 5.  RE: CAPM Vertica is Down
    Best Answer

    Broadcom Employee
    Posted May 29, 2020 10:10 AM
    Support will probably need to see the vertica.log from the recovering node.

    Maybe it's losing connection to spread process, missing heartbeats and shutting down.

    There are some tools vertica provides to look at performance.
    https://techdocs.broadcom.com/content/broadcom/techdocs/us/en/ca-enterprise-software/it-operations-management/performance-management/3-7/administrating/data-repository-administration/run-data-repository-diagnostic-utilities.html

    You may want to run them and open a support issue.