DX Application Performance Management

 View Only
  • 1.  Agent Continuing to be Disconnected from Collector

    Posted Feb 09, 2021 08:22 AM
    We've seen several agents that when trying to start up receive the below in their log file. Any starters on what to look at for this? Several agents are missing from the investigator, it seems due to this.

    2/05/21 07:34:11 PM EST [WARN] [IntroscopeAgent.Agent] Enterprise Manager responding too slowly, disconnecting
    2/05/21 07:34:11 PM EST [WARN] [IntroscopeAgent.ConnectionThread] Failed to connect to the Introscope Enterprise Manager at xyz:5001,com.wily.isengard.postofficehub.link.net.DefaultSocketFactory (1).
    2/05/21 07:39:11 PM EST [WARN] [IntroscopeAgent.Agent] Enterprise Manager responding too slowly, disconnecting
    2/05/21 07:39:11 PM EST [WARN] [IntroscopeAgent.ConnectionThread] Failed to connect to the Introscope Enterprise Manager at xyz:5001,com.wily.isengard.postofficehub.link.net.DefaultSocketFactory (1).


  • 2.  RE: Agent Continuing to be Disconnected from Collector

    Broadcom Employee
    Posted Feb 09, 2021 08:37 AM
    Hello Travis,

    The message "The Enterprise Manager is responding slowly" often indicates that the Enterprise Manager (collector) could be short on heap and generally struggling with its load. If there is any spare memory on the collector machines, bumping it up a few GB or two is useful, unless they are already in double-digit GB range.

    It might be a case of checking the whole cluster for capacity and seeing if the agent load is balanced in terms of numbers and metrics, but there are a number of factors to review.

    The perflog.txt is a useful resource to check collector health and performance
    How to interpret the values of Perflog.txt fields.
    Broadcom remove preview
    How to interpret the values of Perflog.txt fields.
    Resolution The EM collects Metrics about itself and reports them to a file called perflog.txt. This file rolls over to another file called perflog.txt.previous when the file size limit configured in the IntroscopeEnterpriseManager.properties file is reached. Some fields differ between the MOM and Collector perflogs. All performance Metrics are for 15 second time periods.
    View this on Broadcom >


    It might need more investigation from support, which 'we' could help with, but would likely point to a review of the health of the cluster.

    Many thanks,
    David Lewis





  • 3.  RE: Agent Continuing to be Disconnected from Collector

    Posted Feb 09, 2021 08:55 AM
    Thanks for this information! I am relatively new to the team and to this application but have always been told that our environment is oversaturated. I will look into the memory of our collectors and do some testing.

    Much appreciated! This has been driving me nuts!


  • 4.  RE: Agent Continuing to be Disconnected from Collector

    Broadcom Employee
    Posted Feb 09, 2021 09:21 AM
    APM Introscope Enterprise Manager - Troubleshooting and Best Practices
    Broadcom remove preview
    APM Introscope Enterprise Manager - Troubleshooting and Best Practices
    Resolution If you notice a performance degradation after applying any of the below recommendations, for example, MOM-Collector disconnections, OutOfMemory issues, unable to connect to the workstation, empty dashboards, etc, restore the original values or files as soon as possible and contact Broadcom Support Team for advice.
    View this on Broadcom >
    Hi Travis,
    There is a big list of recommendations and things to review here if you have a chance to read through:

    APM Introscope Enterprise Manager - Troubleshooting and Best Practices
    Broadcom remove preview
    APM Introscope Enterprise Manager - Troubleshooting and Best Practices
    Resolution If you notice a performance degradation after applying any of the below recommendations, for example, MOM-Collector disconnections, OutOfMemory issues, unable to connect to the workstation, empty dashboards, etc, restore the original values or files as soon as possible and contact Broadcom Support Team for advice.
    View this on Broadcom >


    There might be some tweaks in the lists there you could achieve but it sounds like the system could be at capacity - at the moment. 

    Thanks,
    David