Is it possible to get a Heartbeat alarm when a server/Agent has become gray in Introscope?
You can create an alert to monitor the metric at Custom Metric Host | Custom Metric Process | Custom Metric Agent (Collector host name or IP) | Agents | <agent host name or IP> | <agent name> | Connection Status
1 is connected
2 is connected but running slow
3 is disconnected.
Yes, it will show 3. An agent goes grey when it disconnects.
It would be more proactive to alert on anything other than 1 because if it is connected and reporting slowly (designated by a connection status of 2) you would want to know about it.
I do have an IV for coffee if you need it.
Regarding your suggestion, it will be perfectly fine in case of standalone wily implementation.
For clustered deployment, we face issues regarding connection status metric reporting.
Refer - https://communities.ca.com/ideas/111998910#comment-233894171 for discussion and some useful suggestion. Hope it helps.
We do this periodically for JVMs that are prone to going "sick" but it is a bit fiddly
Create a calculator against a java metric that should always report - e.g heap bytes in use
Create a metric grouping from that calculator
Create an alert from that metric grouping
Alert if value < 1, as Heap should always have a positive value, so if is no longer reporting the calculator value will be 0
Typically we find that these sort of jvm's will be javacoring at the same time anyway, so we have a default core file detector running via EP agent as well.