DX Unified Infrastructure Management

  • 1.  nas queue backing up intermittantly

    Posted Apr 10, 2014 02:05 PM

    Hi,

     

    We have our nas queue backing up very often and experiencing production down every now and then. I had to flush the queue using Dr.Nimbus and restart the hub to have monitoring resumed. Is there a permanent fix to this? Any quick response will be appreciated.

     

    Thanks,

    Ananda Guberan K



  • 2.  Re: nas queue backing up intermittantly

    Posted Apr 10, 2014 02:22 PM

    Does it actually stop processing messages, or does it only slow down?



  • 3.  Re: nas queue backing up intermittantly

    Posted Apr 10, 2014 05:41 PM

    We had a similiar issue like this I would watch the logs on the alarm_enrichment probe what our issue ended up being was we had one snmptoolkit probe that was constantly restarting which would then trigger all the clear events over and over again the alarm_enrichment probe could not catch up so alerts would eventually make it to the nas but be way behind until I flushed the queue and fixed the toolkit issue.



  • 4.  Re: nas queue backing up intermittantly

    Posted Apr 10, 2014 07:34 PM

    We've had to restart the alarm_enrichment probe on numerous occasions
    for it to process the queue properly. But that is the alarm_enrichment
    queue that grows and not the nas queue.

     

    I've not actually run into the problem of the nas not processing the
    queue fast enough, unless it is because of other issues. Like the bug
    where the nas chain-segfaults and restarts due to the source overflow
    bug I wrote about in a different post.



  • 5.  Re: nas queue backing up intermittantly

    Posted Apr 11, 2014 08:17 PM

    Hi Anders,

     

    The problem with us here is that nas queue falls down intermittently and fails to process the alarm. Resulting no alerts in the alarm console. We have working out various possible solutions like disabling the nis_bridge and flushing the queues and nothing helped us. We also upgraded nas to 4.32 it was stable for a while and later failed to process the queues. Kindly advice.

     

    Thanks,

    Ananda Guberan K



  • 6.  Re: nas queue backing up intermittantly

    Posted Apr 12, 2014 01:14 AM

    If the problem is a bad alarm message at the front of the queue, you should be able to get past it by popping just 1 message from the queue. I think DrNimBUS will do that, but otherwise there is some old standalone utility that Nimsoft had produced years ago that can probably still do it. (The name escapes me, and I am not sure if they would still provide it.)

     

    If you had to flush the entire queue to get things working again, that sounds much more severe.



  • 7.  Re: nas queue backing up intermittantly

    Posted Apr 12, 2014 12:43 PM

    I think it's qtool Keith's talking about. You can find it in this thread http://forum.nimsoft.com/t5/General/qtool-experience/m-p/22673/highlight/true#M8232

     

    There's also dbparser and some other exe which will do the same and can be found in the customer portal, but both tools should be able to do the job.

     

    I wonder if this might also be AV issue?

     

    -jon